2024-09-18T01:14:46.876 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-18T01:14:46.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T01:14:46.968 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909724 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7909724' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b0d356b98e08f6bc59ef15652f0d0e4298fc83c7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9034 sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b0d356b98e08f6bc59ef15652f0d0e4298fc83c7 targets: smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLXTveyF7JR6Z9x/cxKk0Oy5hTC5tVTR0FZoGbi1A2xLsmgaKoeERLYPF4ORFmMhGoENBJm/m+IlRUCwQBFVe2E= smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqGBIhdtPBMEkZldw8MDFQ541BJVEjgycC2xXStfEKGJ3ofbhfg086OfBina/kXKqrSsuawPHBERdoqLJfHhnQ= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_21:40:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-18T01:14:46.969 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa; will attempt to use it 2024-09-18T01:14:46.969 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa/tasks 2024-09-18T01:14:46.969 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-18T01:14:46.971 INFO:teuthology.task.internal:Checking packages... 2024-09-18T01:14:46.991 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c2ddf9721ef254645201cdbabd9c8f49c30a586f' 2024-09-18T01:14:46.991 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T01:14:46.991 INFO:teuthology.packaging:ref: None 2024-09-18T01:14:46.991 INFO:teuthology.packaging:tag: None 2024-09-18T01:14:46.991 INFO:teuthology.packaging:branch: squid 2024-09-18T01:14:46.991 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T01:14:46.991 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-18T01:14:47.190 INFO:teuthology.task.internal:Found packages for ceph version 19.2.0-0 2024-09-18T01:14:47.192 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-18T01:14:47.203 INFO:teuthology.task.internal:no buildpackages task found 2024-09-18T01:14:47.204 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-18T01:14:47.223 INFO:teuthology.task.internal:Saving configuration 2024-09-18T01:14:47.235 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-18T01:14:47.247 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-18T01:14:47.272 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909724', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 01:09:50.064494', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLXTveyF7JR6Z9x/cxKk0Oy5hTC5tVTR0FZoGbi1A2xLsmgaKoeERLYPF4ORFmMhGoENBJm/m+IlRUCwQBFVe2E='} 2024-09-18T01:14:47.293 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909724', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 01:09:50.062521', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqGBIhdtPBMEkZldw8MDFQ541BJVEjgycC2xXStfEKGJ3ofbhfg086OfBina/kXKqrSsuawPHBERdoqLJfHhnQ='} 2024-09-18T01:14:47.293 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-18T01:14:47.305 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-18T01:14:47.305 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-18T01:14:47.305 INFO:teuthology.run_tasks:Running task console_log... 2024-09-18T01:14:47.372 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2a95203ac0>, signals=[15]) 2024-09-18T01:14:47.373 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-18T01:14:47.384 INFO:teuthology.task.internal:Opening connections... 2024-09-18T01:14:47.384 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2024-09-18T01:14:47.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:14:47.468 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T01:14:47.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:14:47.541 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-18T01:14:47.551 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-09-18T01:14:47.569 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-09-18T01:14:47.569 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-09-18T01:14:47.625 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-09-18T01:14:47.626 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-09-18T01:14:47.626 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-09-18T01:14:47.626 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-09-18T01:14:47.626 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-09-18T01:14:47.626 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-09-18T01:14:47.627 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T01:14:47.627 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-09-18T01:14:47.627 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-09-18T01:14:47.627 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T01:14:47.627 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-09-18T01:14:47.627 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T01:14:47.627 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T01:14:47.628 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T01:14:47.629 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-09-18T01:14:47.831 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-09-18T01:14:47.850 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-09-18T01:14:47.850 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-09-18T01:14:47.908 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-09-18T01:14:47.908 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-09-18T01:14:47.908 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-09-18T01:14:47.908 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-09-18T01:14:47.908 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-09-18T01:14:47.908 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-09-18T01:14:47.908 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T01:14:47.908 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-09-18T01:14:47.908 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-09-18T01:14:47.908 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T01:14:47.909 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-09-18T01:14:47.909 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T01:14:47.909 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T01:14:47.909 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T01:14:47.909 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-09-18T01:14:47.930 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-18T01:14:47.939 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-18T01:14:47.952 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-18T01:14:47.953 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2024-09-18T01:14:47.955 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-09-18T01:14:47.972 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-18T01:14:47.982 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-18T01:14:47.983 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2024-09-18T01:14:48.012 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-09-18T01:14:48.037 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-18T01:14:48.092 INFO:teuthology.run_tasks:Running task kernel... 2024-09-18T01:14:48.111 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-18T01:14:48.111 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-18T01:14:48.111 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T01:14:48.112 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T01:14:48.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:14:48.127 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-09-18T01:14:48.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:14:48.129 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-18T01:14:48.183 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-503.el9.x86_64 2024-09-18T01:14:48.183 INFO:teuthology.task.kernel:Running kernel on smithi092: 5.14.0-503.el9.x86_64 2024-09-18T01:14:48.184 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2024-09-18T01:14:48.185 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-503.el9.x86_64 2024-09-18T01:14:48.185 INFO:teuthology.task.kernel:Running kernel on smithi100: 5.14.0-503.el9.x86_64 2024-09-18T01:14:48.186 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum install -y kernel 2024-09-18T01:14:51.632 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.3 MB 00:01 2024-09-18T01:14:51.825 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.3 MB 00:01 2024-09-18T01:14:53.792 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-18T01:14:58.251 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-18T01:14:59.810 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-18T01:15:01.114 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-18T01:15:06.686 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-18T01:15:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T01:15:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T01:15:08.700 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:15:08.709 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-18T01:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T01:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-18T01:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T01:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T01:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T01:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:15:08.710 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:15:08.711 INFO:teuthology.orchestra.run.smithi092.stdout:Install 4 Packages 2024-09-18T01:15:08.711 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:15:08.711 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 79 M 2024-09-18T01:15:08.711 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 126 M 2024-09-18T01:15:08.711 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:15:09.112 INFO:teuthology.orchestra.run.smithi092.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 120 kB/s | 36 kB 00:00 2024-09-18T01:15:09.948 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-18T01:15:13.186 INFO:teuthology.orchestra.run.smithi092.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.6 MB/s | 16 MB 00:04 2024-09-18T01:15:15.873 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-18T01:15:16.719 INFO:teuthology.orchestra.run.smithi092.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.8 MB/s | 29 MB 00:07 2024-09-18T01:15:17.490 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-18T01:15:19.662 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 11 MB/s | 23 MB 00:02 2024-09-18T01:15:25.042 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-18T01:15:26.759 INFO:teuthology.orchestra.run.smithi092.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 1.9 MB/s | 35 MB 00:17 2024-09-18T01:15:26.760 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:15:26.760 INFO:teuthology.orchestra.run.smithi092.stdout:Total 4.4 MB/s | 79 MB 00:18 2024-09-18T01:15:26.916 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T01:15:26.916 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T01:15:27.010 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:15:27.017 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:15:27.017 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-09-18T01:15:27.017 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:15:27.017 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:15:27.017 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T01:15:27.017 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T01:15:27.018 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T01:15:27.018 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T01:15:27.018 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T01:15:27.018 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:15:27.018 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:15:27.018 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:15:27.018 INFO:teuthology.orchestra.run.smithi100.stdout:Install 4 Packages 2024-09-18T01:15:27.018 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:15:27.018 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 79 M 2024-09-18T01:15:27.018 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 126 M 2024-09-18T01:15:27.018 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:15:27.352 INFO:teuthology.orchestra.run.smithi100.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 482 kB/s | 36 kB 00:00 2024-09-18T01:15:27.440 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:15:27.821 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:15:27.821 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:15:28.787 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:15:28.787 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:15:31.234 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:15:31.352 INFO:teuthology.orchestra.run.smithi100.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-18T01:15:31.861 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T01:15:31.959 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T01:15:34.717 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T01:15:34.838 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T01:15:35.010 INFO:teuthology.orchestra.run.smithi100.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.7 MB/s | 29 MB 00:07 2024-09-18T01:15:36.785 INFO:teuthology.orchestra.run.smithi100.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.6 MB/s | 35 MB 00:09 2024-09-18T01:15:36.785 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:15:36.785 INFO:teuthology.orchestra.run.smithi100.stdout:Total 8.1 MB/s | 79 MB 00:09 2024-09-18T01:15:37.467 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:15:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:15:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:15:38.784 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:15:38.785 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:15:39.668 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T01:15:39.739 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:15:41.227 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:15:41.915 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T01:15:42.002 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T01:15:44.598 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:15:44.797 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T01:15:44.932 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T01:15:49.753 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T01:15:49.790 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:15:54.676 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:16:22.815 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:16:22.858 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:16:23.217 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:16:23.217 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T01:16:23.217 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T01:16:23.218 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T01:16:24.028 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:16:24.028 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:16:24.028 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:16:24.028 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T01:16:24.028 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T01:16:24.029 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T01:16:24.029 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T01:16:24.029 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:16:24.029 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:16:24.362 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T01:16:24.446 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T01:16:24.446 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T01:16:24.446 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T01:16:24.447 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T01:16:24.447 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T01:16:24.447 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-18T01:16:24.447 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi092.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T01:16:24.447 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T01:16:24.506 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T01:16:24.506 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T01:16:24.506 DEBUG:teuthology.orchestra.run.smithi092:> sudo rpm -qi grub2-tools 2024-09-18T01:16:24.538 INFO:teuthology.orchestra.run.smithi092.stdout:Name : grub2-tools 2024-09-18T01:16:24.538 INFO:teuthology.orchestra.run.smithi092.stdout:Epoch : 1 2024-09-18T01:16:24.538 INFO:teuthology.orchestra.run.smithi092.stdout:Version : 2.06 2024-09-18T01:16:24.539 INFO:teuthology.orchestra.run.smithi092.stdout:Release : 82.el9 2024-09-18T01:16:24.539 INFO:teuthology.orchestra.run.smithi092.stdout:Architecture: x86_64 2024-09-18T01:16:24.539 INFO:teuthology.orchestra.run.smithi092.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T01:16:24.539 INFO:teuthology.orchestra.run.smithi092.stdout:Group : Unspecified 2024-09-18T01:16:24.539 INFO:teuthology.orchestra.run.smithi092.stdout:Size : 8274670 2024-09-18T01:16:24.539 INFO:teuthology.orchestra.run.smithi092.stdout:License : GPLv3+ 2024-09-18T01:16:24.539 INFO:teuthology.orchestra.run.smithi092.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T01:16:24.539 INFO:teuthology.orchestra.run.smithi092.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T01:16:24.539 INFO:teuthology.orchestra.run.smithi092.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T01:16:24.539 INFO:teuthology.orchestra.run.smithi092.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T01:16:24.539 INFO:teuthology.orchestra.run.smithi092.stdout:Packager : builder@centos.org 2024-09-18T01:16:24.539 INFO:teuthology.orchestra.run.smithi092.stdout:Vendor : CentOS 2024-09-18T01:16:24.539 INFO:teuthology.orchestra.run.smithi092.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T01:16:24.540 INFO:teuthology.orchestra.run.smithi092.stdout:Summary : Support tools for GRUB. 2024-09-18T01:16:24.540 INFO:teuthology.orchestra.run.smithi092.stdout:Description : 2024-09-18T01:16:24.540 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:16:24.540 INFO:teuthology.orchestra.run.smithi092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T01:16:24.540 INFO:teuthology.orchestra.run.smithi092.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T01:16:24.540 INFO:teuthology.orchestra.run.smithi092.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T01:16:24.540 INFO:teuthology.orchestra.run.smithi092.stdout:hardware devices. 2024-09-18T01:16:24.540 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:16:24.540 INFO:teuthology.orchestra.run.smithi092.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T01:16:24.542 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T01:16:24.542 INFO:teuthology.task.kernel:Updating grub on smithi092 to boot 5.14.0-508.el9.x86_64 2024-09-18T01:16:24.542 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T01:16:25.228 INFO:teuthology.orchestra.run.smithi092.stderr:Generating grub configuration file ... 2024-09-18T01:16:26.540 INFO:teuthology.orchestra.run.smithi092.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T01:16:26.570 INFO:teuthology.orchestra.run.smithi092.stderr:done 2024-09-18T01:16:26.577 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-09-18T01:16:26.593 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.qLlIrq9jE1 2024-09-18T01:16:26.594 DEBUG:teuthology.orchestra.run.smithi092:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qLlIrq9jE1 2024-09-18T01:16:26.660 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.qLlIrq9jE1 2024-09-18T01:16:26.810 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.qLlIrq9jE1 is 6KB 2024-09-18T01:16:26.831 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.qLlIrq9jE1 2024-09-18T01:16:26.847 DEBUG:teuthology.orchestra.run.smithi092:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T01:16:26.916 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T01:16:26.916 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T01:16:26.916 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T01:16:26.916 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T01:16:26.918 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T01:16:27.071 DEBUG:teuthology.orchestra.run.smithi092:> sudo shutdown -r now 2024-09-18T01:16:33.063 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:16:33.102 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:16:33.474 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:16:33.474 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T01:16:33.474 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T01:16:33.474 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T01:16:34.293 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:16:34.293 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:16:34.293 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:16:34.293 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T01:16:34.293 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T01:16:34.293 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T01:16:34.293 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T01:16:34.294 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:16:34.294 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:16:34.608 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T01:16:34.703 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T01:16:34.703 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T01:16:34.703 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T01:16:34.703 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T01:16:34.703 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T01:16:34.703 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-18T01:16:34.704 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T01:16:34.704 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T01:16:34.762 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T01:16:34.762 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T01:16:34.762 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2024-09-18T01:16:34.794 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2024-09-18T01:16:34.794 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2024-09-18T01:16:34.794 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.06 2024-09-18T01:16:34.794 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 82.el9 2024-09-18T01:16:34.794 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2024-09-18T01:16:34.795 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T01:16:34.795 INFO:teuthology.orchestra.run.smithi100.stdout:Group : Unspecified 2024-09-18T01:16:34.795 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 8274670 2024-09-18T01:16:34.795 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2024-09-18T01:16:34.795 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T01:16:34.795 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T01:16:34.795 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T01:16:34.795 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T01:16:34.795 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : builder@centos.org 2024-09-18T01:16:34.795 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2024-09-18T01:16:34.795 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T01:16:34.795 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2024-09-18T01:16:34.795 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2024-09-18T01:16:34.796 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:16:34.796 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T01:16:34.796 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T01:16:34.796 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T01:16:34.796 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2024-09-18T01:16:34.796 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:16:34.796 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T01:16:34.797 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T01:16:34.797 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 5.14.0-508.el9.x86_64 2024-09-18T01:16:34.797 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T01:16:35.445 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2024-09-18T01:16:36.793 INFO:teuthology.orchestra.run.smithi100.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T01:16:36.824 INFO:teuthology.orchestra.run.smithi100.stderr:done 2024-09-18T01:16:36.827 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-09-18T01:16:36.842 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.uj5e7TYaPy 2024-09-18T01:16:36.843 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uj5e7TYaPy 2024-09-18T01:16:36.908 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.uj5e7TYaPy 2024-09-18T01:16:37.051 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.uj5e7TYaPy is 6KB 2024-09-18T01:16:37.100 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.uj5e7TYaPy 2024-09-18T01:16:37.115 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T01:16:37.177 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T01:16:37.178 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T01:16:37.178 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T01:16:37.178 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T01:16:37.179 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T01:16:37.340 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2024-09-18T01:16:57.075 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-18T01:16:57.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-18T01:16:57.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:17:07.353 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-18T01:17:07.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-18T01:17:07.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:17:31.581 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-09-18T01:17:40.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-18T01:17:40.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:17:58.973 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-09-18T01:18:07.365 DEBUG:teuthology.orchestra.remote:timed out 2024-09-18T01:18:10.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-18T01:18:10.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:18:11.344 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-18T01:18:11.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-18T01:18:11.736 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-18T01:18:11.737 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-09-18T01:18:11.751 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-508.el9.x86_64 2024-09-18T01:18:11.751 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T01:18:11.751 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T01:18:11.751 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T01:18:12.752 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-18T01:18:12.752 DEBUG:teuthology.orchestra.run.smithi092:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T01:18:12.835 INFO:teuthology.orchestra.run.smithi092.stdout:ttyS1 2024-09-18T01:18:12.866 DEBUG:teuthology.parallel:result is None 2024-09-18T01:18:16.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-18T01:18:16.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:18:16.853 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-18T01:18:17.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-18T01:18:17.262 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-508.el9.x86_64"... 2024-09-18T01:18:17.262 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-18T01:18:17.277 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-508.el9.x86_64 2024-09-18T01:18:17.277 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T01:18:17.277 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T01:18:17.277 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T01:18:18.278 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-18T01:18:18.279 DEBUG:teuthology.orchestra.run.smithi100:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T01:18:18.372 INFO:teuthology.orchestra.run.smithi100.stdout:ttyS1 2024-09-18T01:18:18.405 DEBUG:teuthology.parallel:result is None 2024-09-18T01:18:18.406 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-18T01:18:18.412 INFO:teuthology.task.internal:Creating test directory... 2024-09-18T01:18:18.413 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T01:18:18.416 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T01:18:18.431 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-18T01:18:18.440 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-18T01:18:18.446 INFO:teuthology.task.internal:Creating archive directory... 2024-09-18T01:18:18.446 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T01:18:18.471 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T01:18:18.501 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-18T01:18:18.507 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-18T01:18:18.507 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T01:18:18.540 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T01:18:18.564 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T01:18:18.573 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T01:18:18.583 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T01:18:18.593 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T01:18:18.595 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-18T01:18:18.602 INFO:teuthology.task.internal:Configuring sudo... 2024-09-18T01:18:18.602 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T01:18:18.617 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T01:18:18.664 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-18T01:18:18.675 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-18T01:18:18.675 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T01:18:18.683 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T01:18:18.723 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T01:18:18.781 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T01:18:18.837 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T01:18:18.914 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T01:18:18.960 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-18T01:18:18.960 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T01:18:19.024 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T01:18:19.066 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T01:18:19.116 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T01:18:19.202 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T01:18:19.246 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:18:19.246 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T01:18:19.315 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2024-09-18T01:18:19.318 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-09-18T01:18:19.366 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T01:18:19.402 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T01:18:19.869 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-18T01:18:19.880 INFO:teuthology.task.internal:Starting timer... 2024-09-18T01:18:19.880 INFO:teuthology.run_tasks:Running task pcp... 2024-09-18T01:18:19.892 INFO:teuthology.run_tasks:Running task selinux... 2024-09-18T01:18:19.901 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-18T01:18:19.901 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2024-09-18T01:18:19.988 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2024-09-18T01:18:19.990 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-09-18T01:18:20.046 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-09-18T01:18:20.048 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-18T01:18:20.048 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2024-09-18T01:18:20.074 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2024-09-18T01:18:20.074 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-09-18T01:18:20.100 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-09-18T01:18:20.101 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi092.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi100.front.sepia.ceph.com': 'permissive'} 2024-09-18T01:18:20.101 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T01:18:20.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:18:20.141 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T01:18:20.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:18:20.168 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-18T01:18:20.169 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2024-09-18T01:18:20.219 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-09-18T01:18:20.249 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-18T01:18:20.259 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-18T01:18:20.270 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-18T01:18:20.271 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi092.front.sepia.ceph.com,smithi100.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-18T01:22:04.340 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi092.front.sepia.ceph.com'), Remote(name='ubuntu@smithi100.front.sepia.ceph.com')] 2024-09-18T01:22:04.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-18T01:22:04.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:22:04.419 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-18T01:22:04.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-18T01:22:04.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-18T01:22:04.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:22:04.576 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-18T01:22:04.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-18T01:22:04.661 INFO:teuthology.run_tasks:Running task clock... 2024-09-18T01:22:04.671 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-18T01:22:04.671 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T01:22:04.672 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T01:22:04.674 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T01:22:04.674 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T01:22:04.702 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T01:22:04.716 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T01:22:04.729 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T01:22:04.741 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2024-09-18T01:22:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T01:22:04.752 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2024-09-18T01:22:04.767 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T01:22:04.768 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-09-18T01:22:04.779 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-09-18T01:22:04.781 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T01:22:04.794 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T01:22:04.808 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T01:22:04.838 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-18T01:22:04.841 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T01:22:04.841 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-18T01:22:04.842 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:22:04.842 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:22:04.842 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:22:04.842 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:22:04.864 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-18T01:22:04.868 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T01:22:04.868 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-18T01:22:04.868 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:22:04.868 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:22:04.868 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:22:04.869 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:22:04.869 INFO:teuthology.run_tasks:Running task install... 2024-09-18T01:22:04.877 DEBUG:teuthology.task.install:project ceph 2024-09-18T01:22:04.878 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}} 2024-09-18T01:22:04.878 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'} 2024-09-18T01:22:04.878 INFO:teuthology.task.install:Using flavor: default 2024-09-18T01:22:04.883 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-18T01:22:04.883 INFO:teuthology.task.install:extra packages: [] 2024-09-18T01:22:04.883 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'tag': None, 'wait_for_package': False} 2024-09-18T01:22:04.884 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T01:22:04.886 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'tag': None, 'wait_for_package': False} 2024-09-18T01:22:04.886 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T01:22:05.029 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/ 2024-09-18T01:22:05.029 INFO:teuthology.task.install.rpm:Package version is 19.1.1-330.gc2ddf972 2024-09-18T01:22:05.033 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/ 2024-09-18T01:22:05.033 INFO:teuthology.task.install.rpm:Package version is 19.1.1-330.gc2ddf972 2024-09-18T01:22:05.141 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T01:22:05.142 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-18T01:22:05.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T01:22:05.145 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T01:22:05.145 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:22:05.145 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T01:22:05.169 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T01:22:05.169 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c2ddf9721ef254645201cdbabd9c8f49c30a586f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T01:22:05.172 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T01:22:05.172 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c2ddf9721ef254645201cdbabd9c8f49c30a586f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T01:22:05.235 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T01:22:05.237 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T01:22:05.310 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T01:22:05.311 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T01:22:05.374 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2024-09-18T01:22:05.375 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2024-09-18T01:22:05.376 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-09-18T01:22:05.377 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-09-18T01:22:05.605 INFO:teuthology.orchestra.run.smithi100.stdout:45 files removed 2024-09-18T01:22:05.607 INFO:teuthology.orchestra.run.smithi092.stdout:45 files removed 2024-09-18T01:22:05.632 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw 2024-09-18T01:22:05.634 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw 2024-09-18T01:22:06.179 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-09-18T01:22:06.193 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-18T01:22:06.471 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-18T01:22:06.477 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-18T01:22:06.744 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-18T01:22:06.746 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-18T01:22:07.286 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-18T01:22:09.280 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.3 MB 00:02 2024-09-18T01:22:11.098 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-18T01:22:11.695 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 20 MB 00:03 2024-09-18T01:22:15.946 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-18T01:22:16.632 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-18T01:22:17.630 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-18T01:22:18.483 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-18T01:22:19.278 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-18T01:22:20.337 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 13 MB/s | 23 MB 00:01 2024-09-18T01:22:24.659 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-18T01:22:25.776 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-18T01:22:26.876 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:22:26.879 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:22:26.879 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-18T01:22:26.879 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:22:26.879 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:22:26.879 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 11 M 2024-09-18T01:22:26.879 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2024-09-18T01:22:26.880 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.4 M 2024-09-18T01:22:26.880 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.2 M 2024-09-18T01:22:26.880 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-18T01:22:26.880 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T01:22:26.880 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.4 M 2024-09-18T01:22:26.880 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 21 M 2024-09-18T01:22:26.880 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 25 k 2024-09-18T01:22:26.880 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T01:22:26.880 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T01:22:26.880 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T01:22:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 751 k 2024-09-18T01:22:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T01:22:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T01:22:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T01:22:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 506 k 2024-09-18T01:22:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T01:22:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.3 M 2024-09-18T01:22:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T01:22:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T01:22:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T01:22:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 45 k 2024-09-18T01:22:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 136 k 2024-09-18T01:22:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 162 k 2024-09-18T01:22:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T01:22:26.882 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 320 k 2024-09-18T01:22:26.882 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 300 k 2024-09-18T01:22:26.882 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 99 k 2024-09-18T01:22:26.882 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-18T01:22:26.882 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-18T01:22:26.882 INFO:teuthology.orchestra.run.smithi092.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T01:22:26.882 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T01:22:26.882 INFO:teuthology.orchestra.run.smithi092.stdout:Installing weak dependencies: 2024-09-18T01:22:26.882 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-18T01:22:26.882 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:22:26.882 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:22:26.882 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:22:26.882 INFO:teuthology.orchestra.run.smithi092.stdout:Install 30 Packages 2024-09-18T01:22:26.883 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 2 Packages 2024-09-18T01:22:26.883 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:22:26.883 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 60 M 2024-09-18T01:22:26.883 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:22:27.776 INFO:teuthology.orchestra.run.smithi092.stdout:(1/32): ceph-base-19.1.1-330.gc2ddf972.el9.x86_ 11 MB/s | 5.4 MB 00:00 2024-09-18T01:22:27.828 INFO:teuthology.orchestra.run.smithi092.stdout:(2/32): ceph-selinux-19.1.1-330.gc2ddf972.el9.x 505 kB/s | 25 kB 00:00 2024-09-18T01:22:27.926 INFO:teuthology.orchestra.run.smithi092.stdout:(3/32): libcephfs2-19.1.1-330.gc2ddf972.el9.x86 7.3 MB/s | 751 kB 00:00 2024-09-18T01:22:27.978 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:22:27.998 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:22:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T01:22:27.998 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:22:27.998 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:22:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 11 M 2024-09-18T01:22:27.998 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-09-18T01:22:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.4 M 2024-09-18T01:22:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.2 M 2024-09-18T01:22:27.998 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T01:22:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T01:22:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.4 M 2024-09-18T01:22:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 21 M 2024-09-18T01:22:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 25 k 2024-09-18T01:22:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T01:22:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T01:22:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T01:22:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 751 k 2024-09-18T01:22:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T01:22:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T01:22:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T01:22:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 506 k 2024-09-18T01:22:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T01:22:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.3 M 2024-09-18T01:22:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T01:22:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T01:22:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T01:22:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 45 k 2024-09-18T01:22:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 136 k 2024-09-18T01:22:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 162 k 2024-09-18T01:22:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T01:22:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 320 k 2024-09-18T01:22:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 300 k 2024-09-18T01:22:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 99 k 2024-09-18T01:22:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-18T01:22:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-18T01:22:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T01:22:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T01:22:28.001 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-09-18T01:22:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-18T01:22:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:22:28.001 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:22:28.001 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:22:28.001 INFO:teuthology.orchestra.run.smithi100.stdout:Install 30 Packages 2024-09-18T01:22:28.001 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 2 Packages 2024-09-18T01:22:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:22:28.002 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 60 M 2024-09-18T01:22:28.002 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:22:28.035 INFO:teuthology.orchestra.run.smithi092.stdout:(4/32): libradosstriper1-19.1.1-330.gc2ddf972.e 4.6 MB/s | 506 kB 00:00 2024-09-18T01:22:28.335 INFO:teuthology.orchestra.run.smithi092.stdout:(5/32): ceph-radosgw-19.1.1-330.gc2ddf972.el9.x 10 MB/s | 11 MB 00:01 2024-09-18T01:22:28.544 INFO:teuthology.orchestra.run.smithi092.stdout:(6/32): ceph-common-19.1.1-330.gc2ddf972.el9.x8 17 MB/s | 21 MB 00:01 2024-09-18T01:22:28.647 INFO:teuthology.orchestra.run.smithi092.stdout:(7/32): python3-ceph-argparse-19.1.1-330.gc2ddf 193 kB/s | 45 kB 00:00 2024-09-18T01:22:28.654 INFO:teuthology.orchestra.run.smithi092.stdout:(8/32): librgw2-19.1.1-330.gc2ddf972.el9.x86_64 8.7 MB/s | 5.3 MB 00:00 2024-09-18T01:22:28.690 INFO:teuthology.orchestra.run.smithi092.stdout:(9/32): python3-ceph-common-19.1.1-330.gc2ddf97 1.0 MB/s | 136 kB 00:00 2024-09-18T01:22:28.703 INFO:teuthology.orchestra.run.smithi100.stdout:(1/32): ceph-base-19.1.1-330.gc2ddf972.el9.x86_ 8.7 MB/s | 5.4 MB 00:00 2024-09-18T01:22:28.703 INFO:teuthology.orchestra.run.smithi092.stdout:(10/32): python3-cephfs-19.1.1-330.gc2ddf972.el 1.2 MB/s | 162 kB 00:00 2024-09-18T01:22:28.729 INFO:teuthology.orchestra.run.smithi092.stdout:(11/32): python3-rados-19.1.1-330.gc2ddf972.el9 4.2 MB/s | 320 kB 00:00 2024-09-18T01:22:28.754 INFO:teuthology.orchestra.run.smithi092.stdout:(12/32): python3-rbd-19.1.1-330.gc2ddf972.el9.x 3.9 MB/s | 300 kB 00:00 2024-09-18T01:22:28.770 INFO:teuthology.orchestra.run.smithi100.stdout:(2/32): ceph-selinux-19.1.1-330.gc2ddf972.el9.x 378 kB/s | 25 kB 00:00 2024-09-18T01:22:28.779 INFO:teuthology.orchestra.run.smithi092.stdout:(13/32): python3-rgw-19.1.1-330.gc2ddf972.el9.x 1.3 MB/s | 99 kB 00:00 2024-09-18T01:22:28.862 INFO:teuthology.orchestra.run.smithi100.stdout:(3/32): libcephfs2-19.1.1-330.gc2ddf972.el9.x86 8.0 MB/s | 751 kB 00:00 2024-09-18T01:22:28.921 INFO:teuthology.orchestra.run.smithi092.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 556 kB/s | 107 kB 00:00 2024-09-18T01:22:28.946 INFO:teuthology.orchestra.run.smithi092.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 271 kB/s | 45 kB 00:00 2024-09-18T01:22:28.972 INFO:teuthology.orchestra.run.smithi092.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 737 kB/s | 160 kB 00:00 2024-09-18T01:22:28.979 INFO:teuthology.orchestra.run.smithi100.stdout:(4/32): ceph-radosgw-19.1.1-330.gc2ddf972.el9.x 12 MB/s | 11 MB 00:00 2024-09-18T01:22:29.012 INFO:teuthology.orchestra.run.smithi100.stdout:(5/32): libradosstriper1-19.1.1-330.gc2ddf972.e 3.3 MB/s | 506 kB 00:00 2024-09-18T01:22:29.022 INFO:teuthology.orchestra.run.smithi092.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 848 kB/s | 42 kB 00:00 2024-09-18T01:22:29.064 INFO:teuthology.orchestra.run.smithi092.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-18T01:22:29.087 INFO:teuthology.orchestra.run.smithi100.stdout:(6/32): python3-ceph-argparse-19.1.1-330.gc2ddf 601 kB/s | 45 kB 00:00 2024-09-18T01:22:29.089 INFO:teuthology.orchestra.run.smithi092.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-18T01:22:29.114 INFO:teuthology.orchestra.run.smithi092.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-18T01:22:29.140 INFO:teuthology.orchestra.run.smithi092.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 477 kB/s | 36 kB 00:00 2024-09-18T01:22:29.165 INFO:teuthology.orchestra.run.smithi092.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 625 kB/s | 47 kB 00:00 2024-09-18T01:22:29.179 INFO:teuthology.orchestra.run.smithi100.stdout:(7/32): python3-ceph-common-19.1.1-330.gc2ddf97 1.5 MB/s | 136 kB 00:00 2024-09-18T01:22:29.232 INFO:teuthology.orchestra.run.smithi092.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 500 kB/s | 26 kB 00:00 2024-09-18T01:22:29.255 INFO:teuthology.orchestra.run.smithi100.stdout:(8/32): librgw2-19.1.1-330.gc2ddf972.el9.x86_64 19 MB/s | 5.3 MB 00:00 2024-09-18T01:22:29.257 INFO:teuthology.orchestra.run.smithi092.stdout:(24/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.1 MB/s | 308 kB 00:00 2024-09-18T01:22:29.282 INFO:teuthology.orchestra.run.smithi092.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 970 kB/s | 49 kB 00:00 2024-09-18T01:22:29.288 INFO:teuthology.orchestra.run.smithi100.stdout:(9/32): python3-cephfs-19.1.1-330.gc2ddf972.el9 1.5 MB/s | 162 kB 00:00 2024-09-18T01:22:29.308 INFO:teuthology.orchestra.run.smithi092.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-18T01:22:29.314 INFO:teuthology.orchestra.run.smithi100.stdout:(10/32): python3-rados-19.1.1-330.gc2ddf972.el9 5.3 MB/s | 320 kB 00:00 2024-09-18T01:22:29.347 INFO:teuthology.orchestra.run.smithi100.stdout:(11/32): python3-rbd-19.1.1-330.gc2ddf972.el9.x 5.0 MB/s | 300 kB 00:00 2024-09-18T01:22:29.358 INFO:teuthology.orchestra.run.smithi092.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 3.8 MB/s | 191 kB 00:00 2024-09-18T01:22:29.373 INFO:teuthology.orchestra.run.smithi100.stdout:(12/32): python3-rgw-19.1.1-330.gc2ddf972.el9.x 1.7 MB/s | 99 kB 00:00 2024-09-18T01:22:29.468 INFO:teuthology.orchestra.run.smithi092.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 839 kB 00:00 2024-09-18T01:22:29.625 INFO:teuthology.orchestra.run.smithi092.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2024-09-18T01:22:29.698 INFO:teuthology.orchestra.run.smithi100.stdout:(13/32): ceph-common-19.1.1-330.gc2ddf972.el9.x 13 MB/s | 21 MB 00:01 2024-09-18T01:22:29.723 INFO:teuthology.orchestra.run.smithi100.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 285 kB/s | 107 kB 00:00 2024-09-18T01:22:29.748 INFO:teuthology.orchestra.run.smithi100.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 427 kB/s | 160 kB 00:00 2024-09-18T01:22:29.774 INFO:teuthology.orchestra.run.smithi100.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-09-18T01:22:29.824 INFO:teuthology.orchestra.run.smithi100.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 844 kB/s | 42 kB 00:00 2024-09-18T01:22:29.825 INFO:teuthology.orchestra.run.smithi092.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-09-18T01:22:29.858 INFO:teuthology.orchestra.run.smithi100.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-18T01:22:29.908 INFO:teuthology.orchestra.run.smithi100.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 717 kB/s | 36 kB 00:00 2024-09-18T01:22:29.933 INFO:teuthology.orchestra.run.smithi100.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-18T01:22:29.967 INFO:teuthology.orchestra.run.smithi100.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-09-18T01:22:30.001 INFO:teuthology.orchestra.run.smithi100.stdout:(22/32): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 662 kB 00:00 2024-09-18T01:22:30.009 INFO:teuthology.orchestra.run.smithi092.stdout:(31/32): librados2-19.1.1-330.gc2ddf972.el9.x86 6.3 MB/s | 3.4 MB 00:00 2024-09-18T01:22:30.051 INFO:teuthology.orchestra.run.smithi100.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-18T01:22:30.085 INFO:teuthology.orchestra.run.smithi100.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-09-18T01:22:30.110 INFO:teuthology.orchestra.run.smithi100.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 255 kB/s | 26 kB 00:00 2024-09-18T01:22:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-18T01:22:30.186 INFO:teuthology.orchestra.run.smithi100.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-18T01:22:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.3 MB/s | 839 kB 00:00 2024-09-18T01:22:30.445 INFO:teuthology.orchestra.run.smithi100.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-09-18T01:22:30.562 INFO:teuthology.orchestra.run.smithi100.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 4.4 MB 00:00 2024-09-18T01:22:30.634 INFO:teuthology.orchestra.run.smithi092.stdout:(32/32): librbd1-19.1.1-330.gc2ddf972.el9.x86_6 3.1 MB/s | 3.2 MB 00:01 2024-09-18T01:22:30.640 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:22:30.640 INFO:teuthology.orchestra.run.smithi092.stdout:Total 16 MB/s | 60 MB 00:03 2024-09-18T01:22:30.746 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:22:30.781 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:22:30.781 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:22:30.820 INFO:teuthology.orchestra.run.smithi100.stdout:(31/32): librados2-19.1.1-330.gc2ddf972.el9.x86 6.6 MB/s | 3.4 MB 00:00 2024-09-18T01:22:31.245 INFO:teuthology.orchestra.run.smithi100.stdout:(32/32): librbd1-19.1.1-330.gc2ddf972.el9.x86_6 3.9 MB/s | 3.2 MB 00:00 2024-09-18T01:22:31.251 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:22:31.251 INFO:teuthology.orchestra.run.smithi100.stdout:Total 19 MB/s | 60 MB 00:03 2024-09-18T01:22:31.359 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:22:31.396 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:22:31.396 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:22:31.466 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:22:31.466 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:22:32.055 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:22:32.055 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:22:32.934 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:22:33.024 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-18T01:22:33.064 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-18T01:22:33.089 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-18T01:22:33.112 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T01:22:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T01:22:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T01:22:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T01:22:33.539 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:22:33.619 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-18T01:22:33.658 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-18T01:22:33.689 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-18T01:22:33.707 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T01:22:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-18T01:22:33.730 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T01:22:33.783 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T01:22:33.875 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T01:22:33.925 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T01:22:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 8/34 2024-09-18T01:22:33.980 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T01:22:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-18T01:22:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-18T01:22:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-18T01:22:34.128 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 11/34 2024-09-18T01:22:34.207 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-18T01:22:34.236 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T01:22:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T01:22:34.334 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-18T01:22:34.365 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-18T01:22:34.436 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T01:22:34.445 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-18T01:22:34.477 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-18T01:22:34.528 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-18T01:22:34.528 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T01:22:34.559 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-18T01:22:34.596 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-18T01:22:34.620 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 8/34 2024-09-18T01:22:34.629 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-18T01:22:34.671 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-18T01:22:34.742 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-18T01:22:34.787 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-18T01:22:34.848 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 11/34 2024-09-18T01:22:34.929 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-18T01:22:34.956 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T01:22:34.958 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-18T01:22:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-18T01:22:35.020 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T01:22:35.055 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-18T01:22:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-18T01:22:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 23/34 2024-09-18T01:22:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-18T01:22:35.183 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-18T01:22:35.222 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-18T01:22:35.274 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-18T01:22:35.313 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-18T01:22:35.350 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-18T01:22:35.392 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-18T01:22:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-18T01:22:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-18T01:22:35.703 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-18T01:22:35.746 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-18T01:22:35.760 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-18T01:22:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 27/34 2024-09-18T01:22:35.837 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-18T01:22:35.863 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 28/34 2024-09-18T01:22:35.867 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 23/34 2024-09-18T01:22:35.902 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-18T01:22:36.393 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-18T01:22:36.423 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-18T01:22:36.499 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-18T01:22:36.573 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 27/34 2024-09-18T01:22:36.626 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 28/34 2024-09-18T01:22:38.490 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T01:22:38.534 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T01:22:38.954 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T01:22:38.989 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T01:22:39.095 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T01:22:39.137 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-18T01:22:39.211 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-18T01:22:39.211 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T01:22:39.212 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T01:22:39.212 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:22:39.321 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T01:22:39.561 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T01:22:39.603 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-18T01:22:39.697 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-18T01:22:39.698 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T01:22:39.698 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T01:22:39.698 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:22:39.738 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T01:22:49.327 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T01:22:49.327 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2024-09-18T01:22:49.328 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2024-09-18T01:22:49.328 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2024-09-18T01:22:49.328 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2024-09-18T01:22:49.328 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2024-09-18T01:22:49.328 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /root 2024-09-18T01:22:49.329 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2024-09-18T01:22:49.329 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:22:49.731 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T01:22:49.731 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-09-18T01:22:49.731 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-09-18T01:22:49.731 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-09-18T01:22:49.731 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-09-18T01:22:49.731 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-09-18T01:22:49.732 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-09-18T01:22:49.732 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-09-18T01:22:49.732 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:22:50.329 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-18T01:22:50.354 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-18T01:22:50.354 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:22:50.354 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T01:22:50.354 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T01:22:50.355 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T01:22:50.355 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:22:50.356 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T01:22:50.422 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T01:22:50.422 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T01:22:50.721 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-18T01:22:50.746 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-18T01:22:50.747 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:22:50.747 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T01:22:50.747 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T01:22:50.747 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T01:22:50.747 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:22:50.749 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T01:22:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T01:22:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T01:22:51.611 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T01:22:51.611 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 1/34 2024-09-18T01:22:51.611 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2/34 2024-09-18T01:22:51.611 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 3/34 2024-09-18T01:22:51.611 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 4/34 2024-09-18T01:22:51.611 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 5/34 2024-09-18T01:22:51.611 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 6/34 2024-09-18T01:22:51.611 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T01:22:51.611 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 8/34 2024-09-18T01:22:51.612 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 9/34 2024-09-18T01:22:51.612 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 10/34 2024-09-18T01:22:51.612 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 11/34 2024-09-18T01:22:51.612 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-18T01:22:51.612 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T01:22:51.612 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-18T01:22:51.612 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-18T01:22:51.612 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-18T01:22:51.612 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-18T01:22:51.612 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-18T01:22:51.613 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-18T01:22:51.613 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-18T01:22:51.613 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-18T01:22:51.613 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-18T01:22:51.613 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-18T01:22:51.613 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-18T01:22:51.613 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-18T01:22:51.613 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-18T01:22:51.613 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-18T01:22:51.613 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-18T01:22:51.613 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-18T01:22:51.613 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-18T01:22:51.614 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T01:22:51.614 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-18T01:22:51.614 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 33/34 2024-09-18T01:22:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T01:22:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 1/34 2024-09-18T01:22:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2/34 2024-09-18T01:22:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 3/34 2024-09-18T01:22:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 4/34 2024-09-18T01:22:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 5/34 2024-09-18T01:22:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 6/34 2024-09-18T01:22:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T01:22:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 8/34 2024-09-18T01:22:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 9/34 2024-09-18T01:22:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 10/34 2024-09-18T01:22:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 11/34 2024-09-18T01:22:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-18T01:22:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T01:22:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-18T01:22:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-18T01:22:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-18T01:22:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-18T01:22:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-18T01:22:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-18T01:22:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-18T01:22:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-18T01:22:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-18T01:22:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-18T01:22:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-18T01:22:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-18T01:22:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-18T01:22:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-18T01:22:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-18T01:22:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-18T01:22:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-18T01:22:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T01:22:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-18T01:22:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 33/34 2024-09-18T01:22:52.538 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T01:22:52.538 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:22:52.538 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2024-09-18T01:22:52.538 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.538 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.538 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:22:52.538 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T01:22:52.538 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.538 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.538 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.538 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.539 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T01:22:52.539 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T01:22:52.539 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T01:22:52.539 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.539 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T01:22:52.539 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T01:22:52.539 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T01:22:52.539 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.539 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T01:22:52.539 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.539 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T01:22:52.539 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T01:22:52.539 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T01:22:52.540 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.540 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.540 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.540 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T01:22:52.540 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.540 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.540 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:52.540 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-18T01:22:52.540 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-18T01:22:52.540 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-18T01:22:52.540 INFO:teuthology.orchestra.run.smithi092.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T01:22:52.540 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T01:22:52.540 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:22:52.541 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:22:52.902 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-test 2024-09-18T01:22:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T01:22:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:22:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-09-18T01:22:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:22:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T01:22:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T01:22:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T01:22:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T01:22:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T01:22:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T01:22:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T01:22:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T01:22:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T01:22:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T01:22:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T01:22:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T01:22:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:22:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-18T01:22:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-18T01:22:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-18T01:22:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T01:22:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T01:22:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:22:53.129 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:22:53.470 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-test 2024-09-18T01:22:53.481 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:29 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:22:53.621 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:22:53.622 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:22:53.622 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-18T01:22:53.622 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:22:53.622 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:22:53.622 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 49 M 2024-09-18T01:22:53.622 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-18T01:22:53.622 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 163 k 2024-09-18T01:22:53.622 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T01:22:53.622 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T01:22:53.623 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:22:53.623 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:22:53.623 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:22:53.623 INFO:teuthology.orchestra.run.smithi092.stdout:Install 4 Packages 2024-09-18T01:22:53.623 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:22:53.623 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 49 M 2024-09-18T01:22:53.623 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 209 M 2024-09-18T01:22:53.624 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:22:54.044 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:29 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:22:54.068 INFO:teuthology.orchestra.run.smithi092.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-18T01:22:54.093 INFO:teuthology.orchestra.run.smithi092.stdout:(2/4): libcephsqlite-19.1.1-330.gc2ddf972.el9.x 756 kB/s | 163 kB 00:00 2024-09-18T01:22:54.119 INFO:teuthology.orchestra.run.smithi092.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-18T01:22:54.180 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:22:54.180 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:22:54.180 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T01:22:54.180 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:22:54.181 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:22:54.181 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 49 M 2024-09-18T01:22:54.181 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T01:22:54.181 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 163 k 2024-09-18T01:22:54.181 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T01:22:54.181 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T01:22:54.181 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:22:54.181 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:22:54.181 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:22:54.181 INFO:teuthology.orchestra.run.smithi100.stdout:Install 4 Packages 2024-09-18T01:22:54.181 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:22:54.182 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 49 M 2024-09-18T01:22:54.182 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 209 M 2024-09-18T01:22:54.182 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:22:54.430 INFO:teuthology.orchestra.run.smithi100.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-18T01:22:54.480 INFO:teuthology.orchestra.run.smithi100.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-18T01:22:54.505 INFO:teuthology.orchestra.run.smithi100.stdout:(3/4): libcephsqlite-19.1.1-330.gc2ddf972.el9.x 545 kB/s | 163 kB 00:00 2024-09-18T01:22:55.444 INFO:teuthology.orchestra.run.smithi092.stdout:(4/4): ceph-test-19.1.1-330.gc2ddf972.el9.x86_6 31 MB/s | 49 MB 00:01 2024-09-18T01:22:55.446 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:22:55.446 INFO:teuthology.orchestra.run.smithi092.stdout:Total 27 MB/s | 49 MB 00:01 2024-09-18T01:22:55.472 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:22:55.492 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:22:55.492 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:22:55.876 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:22:55.876 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:22:56.409 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:22:56.487 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T01:22:56.543 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T01:22:56.579 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-18T01:22:56.739 INFO:teuthology.orchestra.run.smithi100.stdout:(4/4): ceph-test-19.1.1-330.gc2ddf972.el9.x86_6 19 MB/s | 49 MB 00:02 2024-09-18T01:22:56.740 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:22:56.741 INFO:teuthology.orchestra.run.smithi100.stdout:Total 19 MB/s | 49 MB 00:02 2024-09-18T01:22:56.768 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:22:56.788 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:22:56.788 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:22:57.170 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:22:57.170 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:22:57.698 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:22:57.780 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T01:22:57.821 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T01:22:57.857 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-18T01:23:01.261 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-18T01:23:01.352 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-18T01:23:02.456 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-18T01:23:02.539 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-18T01:23:03.761 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-18T01:23:03.761 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 1/4 2024-09-18T01:23:03.761 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2/4 2024-09-18T01:23:03.762 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T01:23:04.078 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T01:23:04.078 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:04.078 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:23:04.078 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:04.078 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:04.078 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T01:23:04.078 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T01:23:04.078 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:04.078 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:23:04.379 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph 2024-09-18T01:23:04.990 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:23:05.073 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-18T01:23:05.073 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 1/4 2024-09-18T01:23:05.073 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2/4 2024-09-18T01:23:05.073 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T01:23:05.130 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:23:05.133 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:05.133 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-18T01:23:05.133 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:05.133 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:23:05.133 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 6.5 k 2024-09-18T01:23:05.133 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-18T01:23:05.133 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 2.4 M 2024-09-18T01:23:05.133 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 1.5 M 2024-09-18T01:23:05.134 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 249 k 2024-09-18T01:23:05.134 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 4.7 M 2024-09-18T01:23:05.134 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 17 M 2024-09-18T01:23:05.134 INFO:teuthology.orchestra.run.smithi092.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-18T01:23:05.134 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-18T01:23:05.134 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-18T01:23:05.134 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T01:23:05.134 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T01:23:05.134 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T01:23:05.134 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T01:23:05.134 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T01:23:05.135 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T01:23:05.135 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T01:23:05.135 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-18T01:23:05.135 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T01:23:05.135 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T01:23:05.135 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T01:23:05.135 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T01:23:05.135 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T01:23:05.136 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T01:23:05.136 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T01:23:05.136 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T01:23:05.136 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T01:23:05.136 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T01:23:05.136 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T01:23:05.136 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T01:23:05.136 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T01:23:05.136 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T01:23:05.136 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T01:23:05.136 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T01:23:05.137 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T01:23:05.137 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T01:23:05.137 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T01:23:05.137 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T01:23:05.137 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:05.137 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:23:05.137 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:05.137 INFO:teuthology.orchestra.run.smithi092.stdout:Install 37 Packages 2024-09-18T01:23:05.137 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:05.138 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 30 M 2024-09-18T01:23:05.138 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 108 M 2024-09-18T01:23:05.138 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:23:05.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T01:23:05.415 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:05.415 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:23:05.415 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:05.415 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:05.415 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T01:23:05.415 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T01:23:05.415 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:05.415 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:23:05.478 INFO:teuthology.orchestra.run.smithi092.stdout:(1/37): ceph-19.1.1-330.gc2ddf972.el9.x86_64.rp 54 kB/s | 6.5 kB 00:00 2024-09-18T01:23:05.661 INFO:teuthology.orchestra.run.smithi092.stdout:(2/37): ceph-mgr-19.1.1-330.gc2ddf972.el9.x86_6 5.0 MB/s | 1.5 MB 00:00 2024-09-18T01:23:05.701 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph 2024-09-18T01:23:05.720 INFO:teuthology.orchestra.run.smithi092.stdout:(3/37): ceph-mds-19.1.1-330.gc2ddf972.el9.x86_6 6.6 MB/s | 2.4 MB 00:00 2024-09-18T01:23:05.820 INFO:teuthology.orchestra.run.smithi092.stdout:(4/37): ceph-mgr-modules-core-19.1.1-330.gc2ddf 2.4 MB/s | 249 kB 00:00 2024-09-18T01:23:05.904 INFO:teuthology.orchestra.run.smithi092.stdout:(5/37): ceph-mon-19.1.1-330.gc2ddf972.el9.x86_6 11 MB/s | 4.7 MB 00:00 2024-09-18T01:23:06.021 INFO:teuthology.orchestra.run.smithi092.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-18T01:23:06.063 INFO:teuthology.orchestra.run.smithi092.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-18T01:23:06.113 INFO:teuthology.orchestra.run.smithi092.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-18T01:23:06.283 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:23:06.288 INFO:teuthology.orchestra.run.smithi092.stdout:(9/37): ceph-osd-19.1.1-330.gc2ddf972.el9.x86_6 27 MB/s | 17 MB 00:00 2024-09-18T01:23:06.322 INFO:teuthology.orchestra.run.smithi092.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.9 MB/s | 1.2 MB 00:00 2024-09-18T01:23:06.347 INFO:teuthology.orchestra.run.smithi092.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 534 kB/s | 125 kB 00:00 2024-09-18T01:23:06.381 INFO:teuthology.orchestra.run.smithi092.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.3 MB/s | 215 kB 00:00 2024-09-18T01:23:06.423 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:23:06.426 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:06.426 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T01:23:06.426 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:06.426 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:23:06.426 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 6.5 k 2024-09-18T01:23:06.426 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T01:23:06.426 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 2.4 M 2024-09-18T01:23:06.426 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 1.5 M 2024-09-18T01:23:06.426 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 249 k 2024-09-18T01:23:06.426 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 4.7 M 2024-09-18T01:23:06.426 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 17 M 2024-09-18T01:23:06.426 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-18T01:23:06.427 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-18T01:23:06.427 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-18T01:23:06.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T01:23:06.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T01:23:06.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T01:23:06.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T01:23:06.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T01:23:06.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T01:23:06.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T01:23:06.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-18T01:23:06.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T01:23:06.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T01:23:06.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T01:23:06.428 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T01:23:06.428 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T01:23:06.428 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T01:23:06.428 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T01:23:06.428 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T01:23:06.428 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T01:23:06.428 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T01:23:06.428 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T01:23:06.428 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T01:23:06.428 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T01:23:06.428 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T01:23:06.428 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T01:23:06.428 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T01:23:06.428 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T01:23:06.429 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T01:23:06.429 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T01:23:06.429 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T01:23:06.429 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:06.429 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:23:06.429 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:06.429 INFO:teuthology.orchestra.run.smithi100.stdout:Install 37 Packages 2024-09-18T01:23:06.429 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:06.430 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 30 M 2024-09-18T01:23:06.430 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 108 M 2024-09-18T01:23:06.430 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:23:06.489 INFO:teuthology.orchestra.run.smithi092.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 321 kB/s | 35 kB 00:00 2024-09-18T01:23:06.514 INFO:teuthology.orchestra.run.smithi092.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 980 kB/s | 188 kB 00:00 2024-09-18T01:23:06.540 INFO:teuthology.orchestra.run.smithi092.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 895 kB/s | 172 kB 00:00 2024-09-18T01:23:06.565 INFO:teuthology.orchestra.run.smithi092.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-18T01:23:06.593 INFO:teuthology.orchestra.run.smithi092.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 777 kB/s | 42 kB 00:00 2024-09-18T01:23:06.619 INFO:teuthology.orchestra.run.smithi092.stdout:(18/37): python3-packaging-20.9-5.el9.noarch.rp 596 kB/s | 77 kB 00:00 2024-09-18T01:23:06.644 INFO:teuthology.orchestra.run.smithi092.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 283 kB/s | 22 kB 00:00 2024-09-18T01:23:06.711 INFO:teuthology.orchestra.run.smithi092.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 472 kB/s | 43 kB 00:00 2024-09-18T01:23:06.745 INFO:teuthology.orchestra.run.smithi092.stdout:(21/37): luarocks-3.9.2-5.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-09-18T01:23:06.778 INFO:teuthology.orchestra.run.smithi092.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 322 kB/s | 11 kB 00:00 2024-09-18T01:23:06.804 INFO:teuthology.orchestra.run.smithi092.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-18T01:23:06.829 INFO:teuthology.orchestra.run.smithi092.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 351 kB/s | 18 kB 00:00 2024-09-18T01:23:06.854 INFO:teuthology.orchestra.run.smithi092.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-18T01:23:06.879 INFO:teuthology.orchestra.run.smithi092.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-18T01:23:06.905 INFO:teuthology.orchestra.run.smithi092.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-18T01:23:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-18T01:23:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-18T01:23:06.980 INFO:teuthology.orchestra.run.smithi092.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-18T01:23:07.006 INFO:teuthology.orchestra.run.smithi092.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-18T01:23:07.031 INFO:teuthology.orchestra.run.smithi092.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-18T01:23:07.056 INFO:teuthology.orchestra.run.smithi092.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-18T01:23:07.082 INFO:teuthology.orchestra.run.smithi092.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-18T01:23:07.115 INFO:teuthology.orchestra.run.smithi092.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-18T01:23:07.119 INFO:teuthology.orchestra.run.smithi100.stdout:(1/37): ceph-19.1.1-330.gc2ddf972.el9.x86_64.rp 52 kB/s | 6.5 kB 00:00 2024-09-18T01:23:07.140 INFO:teuthology.orchestra.run.smithi092.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 342 kB/s | 20 kB 00:00 2024-09-18T01:23:07.166 INFO:teuthology.orchestra.run.smithi092.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-18T01:23:07.170 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:07.170 INFO:teuthology.orchestra.run.smithi092.stdout:Total 15 MB/s | 30 MB 00:02 2024-09-18T01:23:07.318 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:23:07.320 INFO:teuthology.orchestra.run.smithi100.stdout:(2/37): ceph-mds-19.1.1-330.gc2ddf972.el9.x86_6 7.3 MB/s | 2.4 MB 00:00 2024-09-18T01:23:07.359 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:23:07.359 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:23:07.362 INFO:teuthology.orchestra.run.smithi100.stdout:(3/37): ceph-mgr-19.1.1-330.gc2ddf972.el9.x86_6 4.1 MB/s | 1.5 MB 00:00 2024-09-18T01:23:07.462 INFO:teuthology.orchestra.run.smithi100.stdout:(4/37): ceph-mgr-modules-core-19.1.1-330.gc2ddf 2.4 MB/s | 249 kB 00:00 2024-09-18T01:23:07.596 INFO:teuthology.orchestra.run.smithi100.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-09-18T01:23:07.835 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:23:07.835 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:23:07.854 INFO:teuthology.orchestra.run.smithi100.stdout:(6/37): ceph-osd-19.1.1-330.gc2ddf972.el9.x86_6 32 MB/s | 17 MB 00:00 2024-09-18T01:23:07.921 INFO:teuthology.orchestra.run.smithi100.stdout:(7/37): ceph-mon-19.1.1-330.gc2ddf972.el9.x86_6 5.9 MB/s | 4.7 MB 00:00 2024-09-18T01:23:07.955 INFO:teuthology.orchestra.run.smithi100.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 3.4 MB/s | 1.2 MB 00:00 2024-09-18T01:23:08.013 INFO:teuthology.orchestra.run.smithi100.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-09-18T01:23:08.039 INFO:teuthology.orchestra.run.smithi100.stdout:(10/37): python3-ply-3.11-14.el9.noarch.rpm 579 kB/s | 106 kB 00:00 2024-09-18T01:23:08.064 INFO:teuthology.orchestra.run.smithi100.stdout:(11/37): python3-pycparser-2.20-6.el9.noarch.rp 948 kB/s | 135 kB 00:00 2024-09-18T01:23:08.097 INFO:teuthology.orchestra.run.smithi100.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-18T01:23:08.123 INFO:teuthology.orchestra.run.smithi100.stdout:(13/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.9 MB/s | 215 kB 00:00 2024-09-18T01:23:08.148 INFO:teuthology.orchestra.run.smithi100.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 690 kB/s | 35 kB 00:00 2024-09-18T01:23:08.182 INFO:teuthology.orchestra.run.smithi100.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-18T01:23:08.207 INFO:teuthology.orchestra.run.smithi100.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 918 kB/s | 77 kB 00:00 2024-09-18T01:23:08.232 INFO:teuthology.orchestra.run.smithi100.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-18T01:23:08.258 INFO:teuthology.orchestra.run.smithi100.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 550 kB/s | 42 kB 00:00 2024-09-18T01:23:08.325 INFO:teuthology.orchestra.run.smithi100.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 653 kB/s | 43 kB 00:00 2024-09-18T01:23:08.358 INFO:teuthology.orchestra.run.smithi100.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-09-18T01:23:08.401 INFO:teuthology.orchestra.run.smithi100.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-18T01:23:08.426 INFO:teuthology.orchestra.run.smithi100.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 433 kB/s | 11 kB 00:00 2024-09-18T01:23:08.451 INFO:teuthology.orchestra.run.smithi100.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 705 kB/s | 18 kB 00:00 2024-09-18T01:23:08.484 INFO:teuthology.orchestra.run.smithi100.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 695 kB/s | 23 kB 00:00 2024-09-18T01:23:08.518 INFO:teuthology.orchestra.run.smithi100.stdout:(25/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2024-09-18T01:23:08.543 INFO:teuthology.orchestra.run.smithi100.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 376 kB/s | 19 kB 00:00 2024-09-18T01:23:08.569 INFO:teuthology.orchestra.run.smithi100.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 393 kB/s | 20 kB 00:00 2024-09-18T01:23:08.594 INFO:teuthology.orchestra.run.smithi100.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 920 kB/s | 46 kB 00:00 2024-09-18T01:23:08.620 INFO:teuthology.orchestra.run.smithi100.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-18T01:23:08.645 INFO:teuthology.orchestra.run.smithi100.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 662 kB/s | 16 kB 00:00 2024-09-18T01:23:08.687 INFO:teuthology.orchestra.run.smithi100.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-18T01:23:08.712 INFO:teuthology.orchestra.run.smithi100.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-18T01:23:08.737 INFO:teuthology.orchestra.run.smithi100.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-18T01:23:08.779 INFO:teuthology.orchestra.run.smithi100.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-18T01:23:08.813 INFO:teuthology.orchestra.run.smithi100.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 600 kB/s | 20 kB 00:00 2024-09-18T01:23:08.838 INFO:teuthology.orchestra.run.smithi100.stdout:(36/37): lua-devel-5.4.4-4.el9.x86_64.rpm 35 kB/s | 22 kB 00:00 2024-09-18T01:23:08.872 INFO:teuthology.orchestra.run.smithi100.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.1 MB/s | 427 kB 00:00 2024-09-18T01:23:08.876 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:08.877 INFO:teuthology.orchestra.run.smithi100.stdout:Total 12 MB/s | 30 MB 00:02 2024-09-18T01:23:09.027 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:23:09.068 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:23:09.068 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:23:09.178 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:23:09.252 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-18T01:23:09.300 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-18T01:23:09.337 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-18T01:23:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-18T01:23:09.470 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-18T01:23:09.502 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-18T01:23:09.559 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:23:09.560 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:23:09.594 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-18T01:23:09.664 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-18T01:23:09.713 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-18T01:23:09.756 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-18T01:23:09.786 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-18T01:23:09.821 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-18T01:23:09.854 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-18T01:23:09.894 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-18T01:23:09.930 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-18T01:23:09.973 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-18T01:23:10.021 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-18T01:23:10.053 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-18T01:23:10.134 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-18T01:23:10.287 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-18T01:23:10.368 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-18T01:23:10.422 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-18T01:23:10.461 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-18T01:23:10.509 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-18T01:23:10.573 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-18T01:23:10.759 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-18T01:23:10.806 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-18T01:23:10.884 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-18T01:23:10.909 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:23:10.966 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-18T01:23:10.972 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-18T01:23:11.001 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-18T01:23:11.023 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-18T01:23:11.029 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-18T01:23:11.099 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-18T01:23:11.137 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-18T01:23:11.161 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-18T01:23:11.194 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-18T01:23:11.285 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-18T01:23:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 32/37 2024-09-18T01:23:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-18T01:23:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-18T01:23:11.359 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:23:11.359 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T01:23:11.359 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T01:23:11.359 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T01:23:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:11.373 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-18T01:23:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-18T01:23:11.448 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-18T01:23:11.479 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-18T01:23:11.513 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-18T01:23:11.546 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-18T01:23:11.587 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-18T01:23:11.631 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-18T01:23:11.665 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-18T01:23:11.722 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-18T01:23:11.762 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-18T01:23:11.835 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-18T01:23:11.974 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-18T01:23:12.053 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-18T01:23:12.106 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-18T01:23:12.145 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-18T01:23:12.194 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-18T01:23:12.257 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-18T01:23:12.443 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-18T01:23:12.491 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-18T01:23:12.569 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-18T01:23:12.657 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-18T01:23:12.721 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-18T01:23:12.800 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-18T01:23:12.827 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-18T01:23:12.827 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:23:12.827 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T01:23:12.827 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T01:23:12.827 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T01:23:12.827 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:12.839 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-18T01:23:13.004 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 32/37 2024-09-18T01:23:13.035 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-18T01:23:13.060 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-18T01:23:13.060 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:23:13.060 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T01:23:13.061 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T01:23:13.061 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T01:23:13.061 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:13.259 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-18T01:23:13.282 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-18T01:23:13.282 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:23:13.282 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T01:23:13.282 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T01:23:13.282 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T01:23:13.283 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:13.509 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-18T01:23:13.533 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-18T01:23:13.533 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:23:13.533 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T01:23:13.533 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T01:23:13.533 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T01:23:13.533 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:13.599 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-18T01:23:14.503 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-18T01:23:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-18T01:23:14.529 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:23:14.529 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T01:23:14.529 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T01:23:14.529 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T01:23:14.530 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-18T01:23:14.985 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-18T01:23:14.985 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:23:14.985 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T01:23:14.985 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T01:23:14.985 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T01:23:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-18T01:23:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-18T01:23:15.252 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:23:15.252 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T01:23:15.253 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T01:23:15.253 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T01:23:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-18T01:23:15.420 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-18T01:23:15.420 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 1/37 2024-09-18T01:23:15.420 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2/37 2024-09-18T01:23:15.420 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 3/37 2024-09-18T01:23:15.421 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 4/37 2024-09-18T01:23:15.421 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 5/37 2024-09-18T01:23:15.421 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 6/37 2024-09-18T01:23:15.421 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-18T01:23:15.421 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-18T01:23:15.421 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-18T01:23:15.421 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-18T01:23:15.421 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-18T01:23:15.421 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-18T01:23:15.421 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-18T01:23:15.421 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-18T01:23:15.421 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-18T01:23:15.421 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-18T01:23:15.422 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-18T01:23:15.422 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-18T01:23:15.422 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-18T01:23:15.422 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-18T01:23:15.422 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-18T01:23:15.422 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-18T01:23:15.422 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-18T01:23:15.422 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-18T01:23:15.422 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-18T01:23:15.422 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-18T01:23:15.422 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-18T01:23:15.423 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-18T01:23:15.423 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-18T01:23:15.424 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-18T01:23:15.424 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-18T01:23:15.424 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-18T01:23:15.424 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-18T01:23:15.424 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-18T01:23:15.424 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-18T01:23:15.424 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-18T01:23:16.362 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-18T01:23:16.362 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:16.362 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:23:16.362 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:16.363 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:16.363 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:16.363 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:16.363 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:16.363 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:16.363 INFO:teuthology.orchestra.run.smithi092.stdout: lua-5.4.4-4.el9.x86_64 2024-09-18T01:23:16.363 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-18T01:23:16.363 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-18T01:23:16.363 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T01:23:16.363 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T01:23:16.363 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T01:23:16.363 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T01:23:16.363 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T01:23:16.363 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T01:23:16.364 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T01:23:16.364 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T01:23:16.364 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T01:23:16.364 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T01:23:16.364 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T01:23:16.364 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T01:23:16.364 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T01:23:16.364 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T01:23:16.364 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T01:23:16.364 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T01:23:16.364 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T01:23:16.364 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T01:23:16.365 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T01:23:16.365 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T01:23:16.365 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T01:23:16.365 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T01:23:16.365 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T01:23:16.365 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T01:23:16.365 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T01:23:16.365 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T01:23:16.365 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T01:23:16.365 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T01:23:16.365 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:16.365 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:23:16.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-base 2024-09-18T01:23:17.201 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-18T01:23:17.201 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 1/37 2024-09-18T01:23:17.201 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2/37 2024-09-18T01:23:17.202 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 3/37 2024-09-18T01:23:17.202 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 4/37 2024-09-18T01:23:17.202 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 5/37 2024-09-18T01:23:17.202 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 6/37 2024-09-18T01:23:17.202 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-18T01:23:17.202 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-18T01:23:17.202 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-18T01:23:17.202 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-18T01:23:17.202 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-18T01:23:17.202 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-18T01:23:17.202 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-18T01:23:17.202 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-18T01:23:17.202 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-18T01:23:17.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-18T01:23:17.204 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-18T01:23:17.204 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-18T01:23:17.204 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-18T01:23:17.204 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-18T01:23:17.204 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-18T01:23:17.204 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-18T01:23:17.300 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:23:17.388 INFO:teuthology.orchestra.run.smithi092.stdout:Package ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:23:17.430 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:23:17.431 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-18T01:23:17.431 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:23:17.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install cephadm 2024-09-18T01:23:18.064 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:54 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:23:18.133 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-18T01:23:18.133 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:18.134 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:23:18.134 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:18.134 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:18.134 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:18.134 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:18.134 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:18.134 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:18.134 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-09-18T01:23:18.134 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-18T01:23:18.134 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-18T01:23:18.134 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T01:23:18.134 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T01:23:18.134 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T01:23:18.135 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T01:23:18.135 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T01:23:18.135 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T01:23:18.135 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T01:23:18.135 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T01:23:18.135 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T01:23:18.135 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T01:23:18.135 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T01:23:18.135 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T01:23:18.135 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T01:23:18.135 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T01:23:18.135 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T01:23:18.135 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T01:23:18.135 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T01:23:18.136 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T01:23:18.136 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T01:23:18.136 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T01:23:18.136 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T01:23:18.136 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T01:23:18.136 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T01:23:18.136 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T01:23:18.136 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T01:23:18.136 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T01:23:18.136 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T01:23:18.136 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T01:23:18.136 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:18.136 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:23:18.194 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:23:18.195 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:18.195 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-18T01:23:18.195 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:18.195 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:23:18.195 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 765 k 2024-09-18T01:23:18.196 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:18.196 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:23:18.196 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:18.196 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-18T01:23:18.196 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:18.196 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 765 k 2024-09-18T01:23:18.196 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 771 k 2024-09-18T01:23:18.196 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:23:18.449 INFO:teuthology.orchestra.run.smithi092.stdout:cephadm-19.1.1-330.gc2ddf972.el9.noarch.rpm 3.0 MB/s | 765 kB 00:00 2024-09-18T01:23:18.450 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:18.450 INFO:teuthology.orchestra.run.smithi092.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-18T01:23:18.450 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:23:18.456 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:23:18.456 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:23:18.462 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:23:18.462 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:23:18.534 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:23:18.577 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-base 2024-09-18T01:23:18.938 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:23:19.029 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:23:19.160 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:54 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:23:19.247 INFO:teuthology.orchestra.run.smithi100.stdout:Package ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:23:19.289 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:23:19.290 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T01:23:19.290 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:23:19.383 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install cephadm 2024-09-18T01:23:19.433 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:23:19.684 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:23:19.684 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:19.684 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:23:19.684 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:19.684 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:19.684 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:23:19.914 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T01:23:19.960 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:54 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:23:20.093 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:23:20.093 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:20.093 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T01:23:20.094 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:20.094 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:23:20.094 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 765 k 2024-09-18T01:23:20.094 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:20.094 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:23:20.094 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:20.095 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T01:23:20.095 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:20.095 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 765 k 2024-09-18T01:23:20.095 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 771 k 2024-09-18T01:23:20.095 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:23:20.355 INFO:teuthology.orchestra.run.smithi100.stdout:cephadm-19.1.1-330.gc2ddf972.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-18T01:23:20.356 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:20.356 INFO:teuthology.orchestra.run.smithi100.stdout:Total 2.8 MB/s | 765 kB 00:00 2024-09-18T01:23:20.356 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:23:20.361 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:23:20.361 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:23:20.367 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:23:20.368 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:23:20.444 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:23:20.503 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:56 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:23:20.639 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:23:20.640 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:20.640 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2024-09-18T01:23:20.640 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:20.640 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:23:20.640 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 145 k 2024-09-18T01:23:20.640 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:20.641 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:23:20.641 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:20.641 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-18T01:23:20.641 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:20.641 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 145 k 2024-09-18T01:23:20.641 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 435 k 2024-09-18T01:23:20.641 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:23:20.857 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-immutable-object-cache-19.1.1-330.gc2ddf97 673 kB/s | 145 kB 00:00 2024-09-18T01:23:20.857 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:20.858 INFO:teuthology.orchestra.run.smithi092.stdout:Total 669 kB/s | 145 kB 00:00 2024-09-18T01:23:20.858 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:23:20.865 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:23:20.865 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:23:20.916 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:23:20.922 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:23:20.923 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:23:21.008 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:23:21.078 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:23:21.141 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T01:23:21.166 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T01:23:21.166 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:23:21.166 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T01:23:21.166 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:21.402 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:23:21.659 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:23:21.659 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:21.659 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:23:21.659 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:21.659 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:21.659 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:23:21.874 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T01:23:22.091 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T01:23:22.091 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:22.091 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:23:22.091 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:22.091 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:22.091 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:23:22.318 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr 2024-09-18T01:23:22.475 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:57 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:23:22.613 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:23:22.614 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:22.614 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-09-18T01:23:22.614 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:22.614 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:23:22.614 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 145 k 2024-09-18T01:23:22.614 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:22.614 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:23:22.614 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:22.614 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T01:23:22.614 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:22.614 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 145 k 2024-09-18T01:23:22.615 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 435 k 2024-09-18T01:23:22.615 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:23:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-immutable-object-cache-19.1.1-330.gc2ddf97 654 kB/s | 145 kB 00:00 2024-09-18T01:23:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:Total 650 kB/s | 145 kB 00:00 2024-09-18T01:23:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:23:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:23:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:23:22.903 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:23:22.904 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:23:22.911 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:58 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:23:23.003 INFO:teuthology.orchestra.run.smithi092.stdout:Package ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:23:23.045 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:23:23.046 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-18T01:23:23.046 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:23:23.060 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:23:23.114 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T01:23:23.138 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T01:23:23.163 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T01:23:23.163 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:23:23.163 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T01:23:23.163 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:23.691 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:59 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:23:23.823 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:23:23.824 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:23.824 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-18T01:23:23.824 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:23.824 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:23:23.824 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 3.6 M 2024-09-18T01:23:23.824 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-18T01:23:23.825 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-18T01:23:23.825 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 32 k 2024-09-18T01:23:23.825 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 16 k 2024-09-18T01:23:23.825 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-18T01:23:23.825 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-18T01:23:23.825 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-18T01:23:23.825 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-18T01:23:23.825 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-18T01:23:23.825 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-18T01:23:23.825 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T01:23:23.825 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T01:23:23.825 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:23.825 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:23:23.826 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:23.826 INFO:teuthology.orchestra.run.smithi092.stdout:Install 12 Packages 2024-09-18T01:23:23.826 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:23.826 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 8.7 M 2024-09-18T01:23:23.826 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 104 M 2024-09-18T01:23:23.826 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:23:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T01:23:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:24.101 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:23:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:24.101 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:23:24.309 INFO:teuthology.orchestra.run.smithi092.stdout:(1/12): ceph-grafana-dashboards-19.1.1-330.gc2d 212 kB/s | 32 kB 00:00 2024-09-18T01:23:24.334 INFO:teuthology.orchestra.run.smithi092.stdout:(2/12): ceph-prometheus-alerts-19.1.1-330.gc2dd 94 kB/s | 16 kB 00:00 2024-09-18T01:23:24.357 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr 2024-09-18T01:23:24.501 INFO:teuthology.orchestra.run.smithi092.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.6 MB/s | 269 kB 00:00 2024-09-18T01:23:24.560 INFO:teuthology.orchestra.run.smithi092.stdout:(4/12): ceph-mgr-dashboard-19.1.1-330.gc2ddf972 8.9 MB/s | 3.6 MB 00:00 2024-09-18T01:23:24.602 INFO:teuthology.orchestra.run.smithi092.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2024-09-18T01:23:24.660 INFO:teuthology.orchestra.run.smithi092.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 379 kB/s | 19 kB 00:00 2024-09-18T01:23:24.694 INFO:teuthology.orchestra.run.smithi092.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.0 MB/s | 548 kB 00:00 2024-09-18T01:23:24.719 INFO:teuthology.orchestra.run.smithi092.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-18T01:23:24.736 INFO:teuthology.orchestra.run.smithi092.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-09-18T01:23:24.778 INFO:teuthology.orchestra.run.smithi092.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-18T01:23:24.870 INFO:teuthology.orchestra.run.smithi092.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.3 MB/s | 863 kB 00:00 2024-09-18T01:23:24.912 INFO:teuthology.orchestra.run.smithi092.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 8.1 MB/s | 2.0 MB 00:00 2024-09-18T01:23:24.916 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:24.916 INFO:teuthology.orchestra.run.smithi092.stdout:Total 7.9 MB/s | 8.7 MB 00:01 2024-09-18T01:23:24.950 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:59 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:23:24.965 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:23:24.983 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:23:24.983 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:23:25.042 INFO:teuthology.orchestra.run.smithi100.stdout:Package ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:23:25.084 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:23:25.085 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T01:23:25.085 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:23:25.186 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T01:23:25.186 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:23:25.187 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:23:25.742 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:23:25.757 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:00 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:23:25.821 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-18T01:23:25.856 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-18T01:23:25.888 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:23:25.889 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:25.889 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T01:23:25.889 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:25.889 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:23:25.889 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 3.6 M 2024-09-18T01:23:25.889 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T01:23:25.889 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-18T01:23:25.890 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 32 k 2024-09-18T01:23:25.890 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 16 k 2024-09-18T01:23:25.890 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-18T01:23:25.890 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-18T01:23:25.890 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-18T01:23:25.890 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-18T01:23:25.890 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-18T01:23:25.890 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-18T01:23:25.890 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T01:23:25.890 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T01:23:25.890 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:25.890 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:23:25.890 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:25.891 INFO:teuthology.orchestra.run.smithi100.stdout:Install 12 Packages 2024-09-18T01:23:25.891 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:25.891 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 8.7 M 2024-09-18T01:23:25.891 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 104 M 2024-09-18T01:23:25.891 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:23:25.903 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-18T01:23:25.933 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-18T01:23:26.040 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-18T01:23:26.167 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-18T01:23:26.261 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-18T01:23:26.304 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-18T01:23:26.341 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-18T01:23:26.372 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 10/12 2024-09-18T01:23:26.491 INFO:teuthology.orchestra.run.smithi100.stdout:(1/12): ceph-grafana-dashboards-19.1.1-330.gc2d 194 kB/s | 32 kB 00:00 2024-09-18T01:23:26.516 INFO:teuthology.orchestra.run.smithi100.stdout:(2/12): ceph-prometheus-alerts-19.1.1-330.gc2dd 87 kB/s | 16 kB 00:00 2024-09-18T01:23:26.725 INFO:teuthology.orchestra.run.smithi100.stdout:(3/12): ceph-mgr-dashboard-19.1.1-330.gc2ddf972 9.0 MB/s | 3.6 MB 00:00 2024-09-18T01:23:26.908 INFO:teuthology.orchestra.run.smithi100.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.6 MB/s | 863 kB 00:00 2024-09-18T01:23:26.992 INFO:teuthology.orchestra.run.smithi100.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 6.4 MB/s | 548 kB 00:00 2024-09-18T01:23:27.017 INFO:teuthology.orchestra.run.smithi100.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-18T01:23:27.159 INFO:teuthology.orchestra.run.smithi100.stdout:(7/12): python3-protobuf-3.14.0-13.el9.noarch.r 419 kB/s | 269 kB 00:00 2024-09-18T01:23:27.235 INFO:teuthology.orchestra.run.smithi100.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.9 MB/s | 144 kB 00:00 2024-09-18T01:23:27.277 INFO:teuthology.orchestra.run.smithi100.stdout:(9/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 7.9 MB/s | 2.0 MB 00:00 2024-09-18T01:23:27.302 INFO:teuthology.orchestra.run.smithi100.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 456 kB/s | 31 kB 00:00 2024-09-18T01:23:27.327 INFO:teuthology.orchestra.run.smithi100.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-18T01:23:27.429 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 11/12 2024-09-18T01:23:27.453 INFO:teuthology.orchestra.run.smithi100.stdout:(12/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2024-09-18T01:23:27.456 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:27.456 INFO:teuthology.orchestra.run.smithi100.stdout:Total 5.5 MB/s | 8.7 MB 00:01 2024-09-18T01:23:27.473 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-18T01:23:27.503 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:23:27.520 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:23:27.520 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:23:27.721 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:23:27.721 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:23:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:23:28.337 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-18T01:23:28.380 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-18T01:23:28.427 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-18T01:23:28.465 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-18T01:23:28.560 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-18T01:23:28.692 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-18T01:23:28.802 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-18T01:23:28.843 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-18T01:23:28.843 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 1/12 2024-09-18T01:23:28.843 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 2/12 2024-09-18T01:23:28.843 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 3/12 2024-09-18T01:23:28.843 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-18T01:23:28.843 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-18T01:23:28.843 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-18T01:23:28.843 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-18T01:23:28.843 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-18T01:23:28.844 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-18T01:23:28.844 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-18T01:23:28.844 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-18T01:23:28.846 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-18T01:23:28.882 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-18T01:23:28.914 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 10/12 2024-09-18T01:23:29.153 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-18T01:23:29.153 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:29.153 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:23:29.153 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-18T01:23:29.153 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:29.154 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:29.154 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:29.154 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-18T01:23:29.154 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-18T01:23:29.154 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-18T01:23:29.154 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-18T01:23:29.154 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-18T01:23:29.154 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-18T01:23:29.154 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T01:23:29.154 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T01:23:29.154 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:29.154 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:23:29.407 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T01:23:29.970 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 11/12 2024-09-18T01:23:29.983 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:05 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:23:30.007 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-18T01:23:30.114 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:23:30.117 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================== 2024-09-18T01:23:30.117 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-18T01:23:30.118 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================== 2024-09-18T01:23:30.118 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:23:30.118 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 7.4 M 2024-09-18T01:23:30.118 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-18T01:23:30.118 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T01:23:30.118 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T01:23:30.118 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T01:23:30.118 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T01:23:30.118 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T01:23:30.118 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T01:23:30.118 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T01:23:30.119 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T01:23:30.119 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T01:23:30.119 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T01:23:30.119 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T01:23:30.119 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:30.119 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:23:30.119 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================== 2024-09-18T01:23:30.119 INFO:teuthology.orchestra.run.smithi092.stdout:Install 12 Packages 2024-09-18T01:23:30.119 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:30.120 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 38 M 2024-09-18T01:23:30.120 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 212 M 2024-09-18T01:23:30.120 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:23:30.677 INFO:teuthology.orchestra.run.smithi092.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-18T01:23:30.777 INFO:teuthology.orchestra.run.smithi092.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 327 kB/s | 33 kB 00:00 2024-09-18T01:23:30.811 INFO:teuthology.orchestra.run.smithi092.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-18T01:23:30.886 INFO:teuthology.orchestra.run.smithi092.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 243 kB/s | 18 kB 00:00 2024-09-18T01:23:30.970 INFO:teuthology.orchestra.run.smithi092.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2024-09-18T01:23:30.986 INFO:teuthology.orchestra.run.smithi092.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 383 kB/s | 38 kB 00:00 2024-09-18T01:23:31.070 INFO:teuthology.orchestra.run.smithi092.stdout:(7/12): ceph-mgr-diskprediction-local-19.1.1-33 13 MB/s | 7.4 MB 00:00 2024-09-18T01:23:31.096 INFO:teuthology.orchestra.run.smithi092.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-18T01:23:31.187 INFO:teuthology.orchestra.run.smithi092.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 23 MB/s | 4.9 MB 00:00 2024-09-18T01:23:31.213 INFO:teuthology.orchestra.run.smithi092.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-09-18T01:23:31.390 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-18T01:23:31.390 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 1/12 2024-09-18T01:23:31.390 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 2/12 2024-09-18T01:23:31.391 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 3/12 2024-09-18T01:23:31.391 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-18T01:23:31.391 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-18T01:23:31.391 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-18T01:23:31.391 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-18T01:23:31.391 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-18T01:23:31.391 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-18T01:23:31.391 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-18T01:23:31.391 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-18T01:23:31.455 INFO:teuthology.orchestra.run.smithi092.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 61 MB/s | 16 MB 00:00 2024-09-18T01:23:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-18T01:23:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:Total 27 MB/s | 38 MB 00:01 2024-09-18T01:23:31.709 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-18T01:23:31.710 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:31.710 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:23:31.710 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-18T01:23:31.710 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:31.710 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:31.710 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:31.710 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-18T01:23:31.710 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-18T01:23:31.710 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-18T01:23:31.710 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-18T01:23:31.710 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-18T01:23:31.710 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-18T01:23:31.711 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T01:23:31.711 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T01:23:31.711 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:31.711 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:23:31.900 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:23:31.927 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:23:31.927 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:23:31.983 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T01:23:32.364 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:23:32.365 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:23:32.566 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:07 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:23:32.701 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:23:32.702 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-18T01:23:32.702 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T01:23:32.702 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-18T01:23:32.702 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:23:32.702 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 7.4 M 2024-09-18T01:23:32.702 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T01:23:32.702 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T01:23:32.702 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T01:23:32.702 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T01:23:32.702 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T01:23:32.703 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T01:23:32.703 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T01:23:32.703 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T01:23:32.703 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T01:23:32.703 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T01:23:32.703 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T01:23:32.703 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T01:23:32.703 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:32.703 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:23:32.703 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-18T01:23:32.703 INFO:teuthology.orchestra.run.smithi100.stdout:Install 12 Packages 2024-09-18T01:23:32.703 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:32.704 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 38 M 2024-09-18T01:23:32.704 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 212 M 2024-09-18T01:23:32.704 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:23:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:23:33.169 INFO:teuthology.orchestra.run.smithi100.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-18T01:23:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T01:23:33.211 INFO:teuthology.orchestra.run.smithi100.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-18T01:23:33.236 INFO:teuthology.orchestra.run.smithi100.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 491 kB/s | 33 kB 00:00 2024-09-18T01:23:33.244 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T01:23:33.278 INFO:teuthology.orchestra.run.smithi100.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 436 kB/s | 18 kB 00:00 2024-09-18T01:23:33.320 INFO:teuthology.orchestra.run.smithi100.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 922 kB/s | 38 kB 00:00 2024-09-18T01:23:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T01:23:33.400 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T01:23:33.462 INFO:teuthology.orchestra.run.smithi100.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-09-18T01:23:33.563 INFO:teuthology.orchestra.run.smithi100.stdout:(7/12): ceph-mgr-diskprediction-local-19.1.1-33 14 MB/s | 7.4 MB 00:00 2024-09-18T01:23:33.580 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T01:23:33.588 INFO:teuthology.orchestra.run.smithi100.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-18T01:23:33.611 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T01:23:33.663 INFO:teuthology.orchestra.run.smithi100.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 14 MB/s | 4.9 MB 00:00 2024-09-18T01:23:33.687 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T01:23:33.688 INFO:teuthology.orchestra.run.smithi100.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.4 MB/s | 250 kB 00:00 2024-09-18T01:23:33.897 INFO:teuthology.orchestra.run.smithi100.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-09-18T01:23:34.106 INFO:teuthology.orchestra.run.smithi100.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-18T01:23:34.106 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:34.107 INFO:teuthology.orchestra.run.smithi100.stdout:Total 27 MB/s | 38 MB 00:01 2024-09-18T01:23:34.341 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T01:23:34.457 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T01:23:34.461 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:23:34.488 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:23:34.488 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:23:34.912 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:23:34.913 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:23:35.694 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T01:23:35.788 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T01:23:35.828 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T01:23:35.936 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T01:23:35.971 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T01:23:36.156 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T01:23:36.195 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T01:23:36.272 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T01:23:36.825 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T01:23:36.860 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-18T01:23:36.921 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T01:23:37.033 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T01:23:38.275 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T01:23:39.307 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T01:23:39.337 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-18T01:23:39.477 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-18T01:23:39.477 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 1/12 2024-09-18T01:23:39.478 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T01:23:39.478 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T01:23:39.478 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T01:23:39.478 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T01:23:39.478 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T01:23:39.478 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T01:23:39.478 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T01:23:39.478 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T01:23:39.478 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T01:23:39.478 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T01:23:39.856 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T01:23:39.857 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:39.857 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:23:39.857 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:39.857 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T01:23:39.857 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T01:23:39.857 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T01:23:39.857 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T01:23:39.857 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T01:23:39.857 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T01:23:39.857 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T01:23:39.857 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T01:23:39.857 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T01:23:39.858 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T01:23:39.858 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T01:23:39.858 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:39.858 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:23:40.235 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-rook 2024-09-18T01:23:40.826 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:16 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:23:40.957 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:23:40.958 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:40.958 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-18T01:23:40.958 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:40.958 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:23:40.958 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 49 k 2024-09-18T01:23:40.959 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-18T01:23:40.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T01:23:40.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T01:23:40.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T01:23:40.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T01:23:40.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T01:23:40.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T01:23:40.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T01:23:40.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T01:23:40.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T01:23:40.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T01:23:40.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T01:23:40.960 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T01:23:40.960 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:40.960 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:23:40.960 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:40.960 INFO:teuthology.orchestra.run.smithi092.stdout:Install 13 Packages 2024-09-18T01:23:40.960 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:40.960 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 2.2 M 2024-09-18T01:23:40.961 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 26 M 2024-09-18T01:23:40.961 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:23:41.093 INFO:teuthology.orchestra.run.smithi092.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 370 kB/s | 19 kB 00:00 2024-09-18T01:23:41.118 INFO:teuthology.orchestra.run.smithi092.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 333 kB/s | 26 kB 00:00 2024-09-18T01:23:41.218 INFO:teuthology.orchestra.run.smithi092.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 222 kB 00:00 2024-09-18T01:23:41.244 INFO:teuthology.orchestra.run.smithi092.stdout:(4/13): ceph-mgr-rook-19.1.1-330.gc2ddf972.el9. 243 kB/s | 49 kB 00:00 2024-09-18T01:23:41.269 INFO:teuthology.orchestra.run.smithi092.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-09-18T01:23:41.311 INFO:teuthology.orchestra.run.smithi092.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 777 kB/s | 32 kB 00:00 2024-09-18T01:23:41.336 INFO:teuthology.orchestra.run.smithi092.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 581 kB/s | 54 kB 00:00 2024-09-18T01:23:41.364 INFO:teuthology.orchestra.run.smithi092.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 280 kB/s | 14 kB 00:00 2024-09-18T01:23:41.403 INFO:teuthology.orchestra.run.smithi092.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-18T01:23:41.470 INFO:teuthology.orchestra.run.smithi092.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 911 kB/s | 59 kB 00:00 2024-09-18T01:23:41.495 INFO:teuthology.orchestra.run.smithi092.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.4 MB/s | 220 kB 00:00 2024-09-18T01:23:41.537 INFO:teuthology.orchestra.run.smithi092.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2024-09-18T01:23:41.621 INFO:teuthology.orchestra.run.smithi092.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.0 MB/s | 1.0 MB 00:00 2024-09-18T01:23:41.624 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:41.624 INFO:teuthology.orchestra.run.smithi092.stdout:Total 3.3 MB/s | 2.2 MB 00:00 2024-09-18T01:23:41.687 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:23:41.701 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:23:41.701 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:23:41.790 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:23:41.791 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:23:41.886 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-18T01:23:41.886 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 1/12 2024-09-18T01:23:41.886 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T01:23:41.886 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T01:23:41.887 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T01:23:41.887 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T01:23:41.887 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T01:23:41.887 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T01:23:41.887 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T01:23:41.887 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T01:23:41.887 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T01:23:41.887 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T01:23:42.297 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:23:42.310 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T01:23:42.310 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:42.310 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:23:42.310 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:42.310 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T01:23:42.310 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T01:23:42.310 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T01:23:42.310 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T01:23:42.310 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T01:23:42.311 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T01:23:42.311 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T01:23:42.311 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T01:23:42.311 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T01:23:42.311 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T01:23:42.311 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T01:23:42.311 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:42.311 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:23:42.459 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T01:23:42.514 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T01:23:42.569 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T01:23:42.606 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T01:23:42.648 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T01:23:42.699 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-rook 2024-09-18T01:23:42.758 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T01:23:42.868 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T01:23:42.916 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T01:23:43.293 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:18 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:23:43.425 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:23:43.426 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:43.426 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T01:23:43.426 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:43.426 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:23:43.426 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 49 k 2024-09-18T01:23:43.426 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T01:23:43.426 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T01:23:43.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T01:23:43.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T01:23:43.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T01:23:43.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T01:23:43.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T01:23:43.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T01:23:43.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T01:23:43.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T01:23:43.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T01:23:43.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T01:23:43.427 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T01:23:43.427 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:43.427 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:23:43.428 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:43.428 INFO:teuthology.orchestra.run.smithi100.stdout:Install 13 Packages 2024-09-18T01:23:43.428 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:43.428 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 2.2 M 2024-09-18T01:23:43.428 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 26 M 2024-09-18T01:23:43.428 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:23:43.572 INFO:teuthology.orchestra.run.smithi100.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 283 kB/s | 26 kB 00:00 2024-09-18T01:23:43.597 INFO:teuthology.orchestra.run.smithi100.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 166 kB/s | 19 kB 00:00 2024-09-18T01:23:43.629 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T01:23:43.655 INFO:teuthology.orchestra.run.smithi100.stdout:(3/13): ceph-mgr-rook-19.1.1-330.gc2ddf972.el9. 282 kB/s | 49 kB 00:00 2024-09-18T01:23:43.688 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T01:23:43.706 INFO:teuthology.orchestra.run.smithi100.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-18T01:23:43.730 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T01:23:43.731 INFO:teuthology.orchestra.run.smithi100.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-18T01:23:43.756 INFO:teuthology.orchestra.run.smithi100.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-18T01:23:43.787 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T01:23:43.798 INFO:teuthology.orchestra.run.smithi100.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-18T01:23:43.816 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-18T01:23:43.824 INFO:teuthology.orchestra.run.smithi100.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 234 kB/s | 14 kB 00:00 2024-09-18T01:23:43.865 INFO:teuthology.orchestra.run.smithi100.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.3 MB/s | 279 kB 00:00 2024-09-18T01:23:43.891 INFO:teuthology.orchestra.run.smithi100.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-09-18T01:23:43.933 INFO:teuthology.orchestra.run.smithi100.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.5 MB/s | 90 kB 00:00 2024-09-18T01:23:43.958 INFO:teuthology.orchestra.run.smithi100.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 642 kB/s | 59 kB 00:00 2024-09-18T01:23:44.025 INFO:teuthology.orchestra.run.smithi100.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.1 MB/s | 1.0 MB 00:00 2024-09-18T01:23:44.030 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:44.030 INFO:teuthology.orchestra.run.smithi100.stdout:Total 3.7 MB/s | 2.2 MB 00:00 2024-09-18T01:23:44.091 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:23:44.106 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:23:44.106 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:23:44.197 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:23:44.199 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:23:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-18T01:23:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 1/13 2024-09-18T01:23:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T01:23:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T01:23:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T01:23:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T01:23:44.588 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T01:23:44.588 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T01:23:44.588 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T01:23:44.588 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T01:23:44.588 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T01:23:44.588 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T01:23:44.588 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T01:23:44.711 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:23:44.906 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T01:23:44.916 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T01:23:44.916 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:44.917 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:23:44.917 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:44.917 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T01:23:44.917 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T01:23:44.917 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T01:23:44.917 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T01:23:44.917 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T01:23:44.918 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T01:23:44.918 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T01:23:44.918 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T01:23:44.918 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T01:23:44.918 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T01:23:44.918 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T01:23:44.918 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T01:23:44.919 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:44.919 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:23:44.985 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T01:23:45.040 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T01:23:45.077 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T01:23:45.119 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T01:23:45.166 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T01:23:45.220 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T01:23:45.322 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T01:23:45.378 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T01:23:45.743 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:21 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:23:45.874 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:23:45.875 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:45.875 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-18T01:23:45.875 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:45.875 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:23:45.875 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 146 k 2024-09-18T01:23:45.875 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-18T01:23:45.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T01:23:45.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T01:23:45.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T01:23:45.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T01:23:45.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T01:23:45.876 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:45.876 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:23:45.876 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:45.876 INFO:teuthology.orchestra.run.smithi092.stdout:Install 6 Packages 2024-09-18T01:23:45.876 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:45.877 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 7.0 M 2024-09-18T01:23:45.877 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 33 M 2024-09-18T01:23:45.877 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:23:46.100 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T01:23:46.160 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T01:23:46.193 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T01:23:46.242 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T01:23:46.271 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-18T01:23:46.297 INFO:teuthology.orchestra.run.smithi092.stdout:(1/6): ceph-mgr-cephadm-19.1.1-330.gc2ddf972.el 719 kB/s | 146 kB 00:00 2024-09-18T01:23:46.322 INFO:teuthology.orchestra.run.smithi092.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-18T01:23:46.381 INFO:teuthology.orchestra.run.smithi092.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 989 kB/s | 58 kB 00:00 2024-09-18T01:23:46.423 INFO:teuthology.orchestra.run.smithi092.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.3 MB/s | 548 kB 00:00 2024-09-18T01:23:46.448 INFO:teuthology.orchestra.run.smithi092.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-18T01:23:47.059 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-18T01:23:47.060 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 1/13 2024-09-18T01:23:47.060 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T01:23:47.060 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T01:23:47.060 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T01:23:47.060 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T01:23:47.060 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T01:23:47.060 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T01:23:47.060 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T01:23:47.060 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T01:23:47.060 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T01:23:47.060 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T01:23:47.060 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T01:23:47.165 INFO:teuthology.orchestra.run.smithi092.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.6 MB/s | 6.0 MB 00:01 2024-09-18T01:23:47.167 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:47.167 INFO:teuthology.orchestra.run.smithi092.stdout:Total 5.4 MB/s | 7.0 MB 00:01 2024-09-18T01:23:47.237 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:23:47.249 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:23:47.249 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:23:47.348 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:23:47.349 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:23:47.416 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T01:23:47.416 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:47.416 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:23:47.416 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:47.416 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T01:23:47.416 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T01:23:47.416 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T01:23:47.416 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T01:23:47.416 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T01:23:47.417 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T01:23:47.417 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T01:23:47.417 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T01:23:47.417 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T01:23:47.417 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T01:23:47.417 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T01:23:47.417 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T01:23:47.417 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:47.417 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:23:47.654 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:23:47.700 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T01:23:47.819 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T01:23:47.866 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T01:23:48.280 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:23 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:23:48.383 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T01:23:48.414 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:23:48.414 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:48.415 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T01:23:48.415 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:48.415 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:23:48.415 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 146 k 2024-09-18T01:23:48.415 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T01:23:48.415 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T01:23:48.415 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T01:23:48.415 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T01:23:48.415 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T01:23:48.415 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T01:23:48.415 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:48.415 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:23:48.416 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:48.416 INFO:teuthology.orchestra.run.smithi100.stdout:Install 6 Packages 2024-09-18T01:23:48.416 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:48.416 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 7.0 M 2024-09-18T01:23:48.416 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 33 M 2024-09-18T01:23:48.416 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:23:48.469 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T01:23:48.533 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T01:23:48.562 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-18T01:23:49.069 INFO:teuthology.orchestra.run.smithi100.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-18T01:23:49.095 INFO:teuthology.orchestra.run.smithi100.stdout:(2/6): ceph-mgr-cephadm-19.1.1-330.gc2ddf972.el 605 kB/s | 146 kB 00:00 2024-09-18T01:23:49.154 INFO:teuthology.orchestra.run.smithi100.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 989 kB/s | 58 kB 00:00 2024-09-18T01:23:49.187 INFO:teuthology.orchestra.run.smithi100.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-18T01:23:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.6 MB/s | 548 kB 00:00 2024-09-18T01:23:49.301 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-18T01:23:49.301 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/6 2024-09-18T01:23:49.301 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T01:23:49.301 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T01:23:49.301 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T01:23:49.301 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T01:23:49.496 INFO:teuthology.orchestra.run.smithi100.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 9.3 MB/s | 6.0 MB 00:00 2024-09-18T01:23:49.498 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:49.499 INFO:teuthology.orchestra.run.smithi100.stdout:Total 6.5 MB/s | 7.0 MB 00:01 2024-09-18T01:23:49.570 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:23:49.574 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T01:23:49.574 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:49.575 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:23:49.575 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:49.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T01:23:49.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T01:23:49.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T01:23:49.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T01:23:49.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T01:23:49.575 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:49.575 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:23:49.581 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:23:49.581 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:23:49.680 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:23:49.681 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:23:49.856 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-fuse 2024-09-18T01:23:49.992 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:23:50.178 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T01:23:50.231 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T01:23:50.428 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:23:50.559 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:23:50.559 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:50.559 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-18T01:23:50.559 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:50.559 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:23:50.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 897 k 2024-09-18T01:23:50.559 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-18T01:23:50.560 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T01:23:50.560 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:50.560 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:23:50.560 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:50.560 INFO:teuthology.orchestra.run.smithi092.stdout:Install 2 Packages 2024-09-18T01:23:50.560 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:50.560 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 977 k 2024-09-18T01:23:50.561 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 2.9 M 2024-09-18T01:23:50.561 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:23:50.756 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T01:23:50.851 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T01:23:50.932 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T01:23:50.950 INFO:teuthology.orchestra.run.smithi092.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 699 kB/s | 80 kB 00:00 2024-09-18T01:23:50.960 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-18T01:23:51.125 INFO:teuthology.orchestra.run.smithi092.stdout:(2/2): ceph-fuse-19.1.1-330.gc2ddf972.el9.x86_6 3.0 MB/s | 897 kB 00:00 2024-09-18T01:23:51.125 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:51.126 INFO:teuthology.orchestra.run.smithi092.stdout:Total 1.7 MB/s | 977 kB 00:00 2024-09-18T01:23:51.137 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:23:51.158 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:23:51.158 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:23:51.239 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:23:51.240 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:23:51.432 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:23:51.578 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T01:23:51.650 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-18T01:23:51.773 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-18T01:23:51.773 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/6 2024-09-18T01:23:51.773 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T01:23:51.773 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T01:23:51.773 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T01:23:51.773 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T01:23:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T01:23:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:52.073 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:23:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T01:23:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T01:23:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T01:23:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T01:23:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T01:23:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:52.074 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:23:52.326 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-18T01:23:52.326 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/2 2024-09-18T01:23:52.334 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-fuse 2024-09-18T01:23:52.609 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T01:23:52.609 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:52.610 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:23:52.610 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T01:23:52.610 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:52.610 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:23:52.877 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-volume 2024-09-18T01:23:52.906 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:27 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:23:53.038 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:23:53.039 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T01:23:53.039 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:53.039 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:23:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 897 k 2024-09-18T01:23:53.039 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T01:23:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T01:23:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:53.039 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:23:53.039 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:53.040 INFO:teuthology.orchestra.run.smithi100.stdout:Install 2 Packages 2024-09-18T01:23:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:53.040 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 977 k 2024-09-18T01:23:53.040 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 2.9 M 2024-09-18T01:23:53.040 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:23:53.449 INFO:teuthology.orchestra.run.smithi100.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 616 kB/s | 80 kB 00:00 2024-09-18T01:23:53.474 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:29 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:23:53.607 INFO:teuthology.orchestra.run.smithi100.stdout:(2/2): ceph-fuse-19.1.1-330.gc2ddf972.el9.x86_6 3.0 MB/s | 897 kB 00:00 2024-09-18T01:23:53.607 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:53.607 INFO:teuthology.orchestra.run.smithi100.stdout:Total 1.7 MB/s | 977 kB 00:00 2024-09-18T01:23:53.610 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:23:53.610 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:53.611 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-18T01:23:53.611 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:53.611 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:23:53.611 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 285 k 2024-09-18T01:23:53.611 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:53.611 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:23:53.611 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:53.611 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-18T01:23:53.611 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:53.611 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 285 k 2024-09-18T01:23:53.611 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 1.3 M 2024-09-18T01:23:53.611 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:23:53.618 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:23:53.640 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:23:53.640 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:23:53.720 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:23:53.721 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:23:53.837 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-volume-19.1.1-330.gc2ddf972.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-18T01:23:53.838 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:53.838 INFO:teuthology.orchestra.run.smithi092.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-18T01:23:53.838 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:23:53.846 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:23:53.846 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:23:53.870 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:23:53.871 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:23:53.918 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:23:54.061 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T01:23:54.093 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:23:54.139 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-18T01:23:54.156 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:23:54.172 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:23:54.172 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:23:54.172 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-18T01:23:54.172 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:54.779 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-18T01:23:54.779 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/2 2024-09-18T01:23:55.040 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T01:23:55.040 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:55.040 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:23:55.040 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T01:23:55.040 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:55.040 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:23:55.132 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:23:55.132 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:55.133 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:23:55.133 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:55.133 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:55.133 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:23:55.318 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-volume 2024-09-18T01:23:55.417 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install librados-devel 2024-09-18T01:23:55.908 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:30 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:23:56.012 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:23:56.043 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:23:56.044 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:56.044 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T01:23:56.044 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:56.044 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:23:56.044 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 285 k 2024-09-18T01:23:56.044 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:56.044 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:23:56.044 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:56.044 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T01:23:56.045 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:56.045 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 285 k 2024-09-18T01:23:56.045 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 1.3 M 2024-09-18T01:23:56.045 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:23:56.146 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:23:56.146 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:56.147 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2024-09-18T01:23:56.147 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:56.147 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:23:56.147 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 127 k 2024-09-18T01:23:56.147 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:56.147 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:23:56.147 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:56.147 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-18T01:23:56.147 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:56.147 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 127 k 2024-09-18T01:23:56.147 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 456 k 2024-09-18T01:23:56.147 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:23:56.279 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-volume-19.1.1-330.gc2ddf972.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-18T01:23:56.280 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:56.280 INFO:teuthology.orchestra.run.smithi100.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-18T01:23:56.280 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:23:56.288 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:23:56.289 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:23:56.311 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:23:56.312 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:23:56.358 INFO:teuthology.orchestra.run.smithi092.stdout:librados-devel-19.1.1-330.gc2ddf972.el9.x86_64. 600 kB/s | 127 kB 00:00 2024-09-18T01:23:56.359 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:56.359 INFO:teuthology.orchestra.run.smithi092.stdout:Total 596 kB/s | 127 kB 00:00 2024-09-18T01:23:56.359 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:23:56.365 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:23:56.365 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:23:56.429 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:23:56.429 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:23:56.534 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:23:56.587 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:23:56.640 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:23:56.656 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:23:56.656 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:23:56.656 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-18T01:23:56.656 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:56.681 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:23:57.103 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:23:57.367 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:23:57.367 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:57.367 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:23:57.367 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:57.367 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:57.367 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:23:57.611 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install libcephfs2 2024-09-18T01:23:57.672 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:23:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:57.673 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:23:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:23:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:57.673 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:23:57.975 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librados-devel 2024-09-18T01:23:58.207 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:23:58.299 INFO:teuthology.orchestra.run.smithi092.stdout:Package libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:23:58.344 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:23:58.345 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-18T01:23:58.345 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:23:58.410 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install libcephfs-devel 2024-09-18T01:23:58.578 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:33 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:23:58.714 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:23:58.715 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:58.715 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-09-18T01:23:58.715 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:58.715 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:23:58.716 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 127 k 2024-09-18T01:23:58.716 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:58.716 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:23:58.716 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:23:58.716 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T01:23:58.716 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:58.716 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 127 k 2024-09-18T01:23:58.716 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 456 k 2024-09-18T01:23:58.716 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:23:58.927 INFO:teuthology.orchestra.run.smithi100.stdout:librados-devel-19.1.1-330.gc2ddf972.el9.x86_64. 602 kB/s | 127 kB 00:00 2024-09-18T01:23:58.927 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:58.927 INFO:teuthology.orchestra.run.smithi100.stdout:Total 598 kB/s | 127 kB 00:00 2024-09-18T01:23:58.927 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:23:58.933 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:23:58.933 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:23:58.985 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:23:58.995 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:23:58.996 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:23:59.117 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:23:59.118 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:59.118 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2024-09-18T01:23:59.118 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:59.118 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:23:59.118 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 32 k 2024-09-18T01:23:59.118 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:59.118 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:23:59.118 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:23:59.118 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-18T01:23:59.118 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:23:59.118 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 32 k 2024-09-18T01:23:59.119 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 142 k 2024-09-18T01:23:59.119 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:23:59.150 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:23:59.249 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:23:59.269 INFO:teuthology.orchestra.run.smithi092.stdout:libcephfs-devel-19.1.1-330.gc2ddf972.el9.x86_64 210 kB/s | 32 kB 00:00 2024-09-18T01:23:59.270 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:23:59.270 INFO:teuthology.orchestra.run.smithi092.stdout:Total 208 kB/s | 32 kB 00:00 2024-09-18T01:23:59.270 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:23:59.274 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:23:59.274 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:23:59.294 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:23:59.294 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:23:59.377 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:23:59.492 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:23:59.700 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:23:59.882 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:23:59.953 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:23:59.953 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:59.953 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:23:59.953 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:23:59.953 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:23:59.953 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:24:00.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:00.105 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:00.105 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:24:00.105 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:24:00.105 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:00.105 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:24:00.253 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install libcephfs2 2024-09-18T01:24:00.282 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install librados2 2024-09-18T01:24:00.850 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:24:00.853 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:24:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:Package libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:24:00.952 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:24:00.984 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:24:00.984 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:24:00.984 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T01:24:00.985 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:24:00.985 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-18T01:24:00.985 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:24:01.047 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install librbd1 2024-09-18T01:24:01.072 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install libcephfs-devel 2024-09-18T01:24:01.624 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:24:01.654 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:24:01.713 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:24:01.755 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:24:01.757 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-18T01:24:01.757 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:24:01.786 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:24:01.787 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:24:01.787 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-09-18T01:24:01.787 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:24:01.787 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:24:01.787 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 32 k 2024-09-18T01:24:01.787 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:01.787 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:24:01.787 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:24:01.787 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T01:24:01.788 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:01.788 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 32 k 2024-09-18T01:24:01.788 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 142 k 2024-09-18T01:24:01.788 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:24:01.812 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rados 2024-09-18T01:24:01.931 INFO:teuthology.orchestra.run.smithi100.stdout:libcephfs-devel-19.1.1-330.gc2ddf972.el9.x86_64 223 kB/s | 32 kB 00:00 2024-09-18T01:24:01.932 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:24:01.932 INFO:teuthology.orchestra.run.smithi100.stdout:Total 220 kB/s | 32 kB 00:00 2024-09-18T01:24:01.932 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:24:01.935 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:24:01.935 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:24:01.954 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:24:01.954 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:24:02.031 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:24:02.136 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:02.397 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:24:02.486 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:24:02.498 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:02.530 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:24:02.530 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-18T01:24:02.531 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:24:02.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rgw 2024-09-18T01:24:02.729 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:02.729 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:02.729 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:24:02.729 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:24:02.729 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:02.729 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:24:02.974 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librados2 2024-09-18T01:24:03.176 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:24:03.265 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:24:03.308 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:24:03.309 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-18T01:24:03.309 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:24:03.374 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-cephfs 2024-09-18T01:24:03.551 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:24:03.639 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:24:03.682 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:24:03.683 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T01:24:03.683 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:24:03.773 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librbd1 2024-09-18T01:24:03.954 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:24:04.043 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:24:04.086 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:24:04.088 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-18T01:24:04.088 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:24:04.144 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rbd 2024-09-18T01:24:04.346 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:24:04.435 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:24:04.478 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:24:04.479 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T01:24:04.479 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:24:04.566 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rados 2024-09-18T01:24:04.746 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:40 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:24:04.839 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:24:04.885 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:24:04.886 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-18T01:24:04.886 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:24:04.956 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-fuse 2024-09-18T01:24:05.147 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:40 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:24:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:24:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:24:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T01:24:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:24:05.371 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rgw 2024-09-18T01:24:05.542 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:24:05.675 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:24:05.675 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:24:05.675 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-18T01:24:05.675 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:24:05.675 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:24:05.675 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 85 k 2024-09-18T01:24:05.675 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:05.675 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:24:05.675 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:24:05.676 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-18T01:24:05.676 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:05.676 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 85 k 2024-09-18T01:24:05.676 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 231 k 2024-09-18T01:24:05.676 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:24:05.881 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-fuse-19.1.1-330.gc2ddf972.el9.x86_64.rpm 418 kB/s | 85 kB 00:00 2024-09-18T01:24:05.881 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:24:05.882 INFO:teuthology.orchestra.run.smithi092.stdout:Total 415 kB/s | 85 kB 00:00 2024-09-18T01:24:05.882 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:24:05.889 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:24:05.889 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:24:05.951 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:24:05.951 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:24:05.958 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:40 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:24:06.048 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:24:06.090 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:24:06.107 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:24:06.107 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T01:24:06.107 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:24:06.180 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-cephfs 2024-09-18T01:24:06.203 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:06.618 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:06.766 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:24:06.854 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:24:06.866 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:06.866 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:06.866 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:24:06.866 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:24:06.866 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:06.866 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:24:06.897 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:24:06.898 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T01:24:06.898 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:24:06.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rbd 2024-09-18T01:24:07.122 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-mirror 2024-09-18T01:24:07.561 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:42 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:24:07.651 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:24:07.693 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:24:07.694 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T01:24:07.694 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:24:07.724 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:43 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:24:07.783 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-fuse 2024-09-18T01:24:07.863 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:24:07.863 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:24:07.864 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2024-09-18T01:24:07.864 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:24:07.864 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:24:07.864 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.1 M 2024-09-18T01:24:07.864 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:07.864 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:24:07.864 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:24:07.864 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-18T01:24:07.864 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:07.864 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 3.1 M 2024-09-18T01:24:07.864 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 13 M 2024-09-18T01:24:07.864 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:24:08.200 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-mirror-19.1.1-330.gc2ddf972.el9.x86_64.rpm 9.2 MB/s | 3.1 MB 00:00 2024-09-18T01:24:08.201 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:24:08.201 INFO:teuthology.orchestra.run.smithi092.stdout:Total 9.2 MB/s | 3.1 MB 00:00 2024-09-18T01:24:08.201 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:24:08.210 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:24:08.210 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:24:08.291 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:24:08.292 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:24:08.359 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:43 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:24:08.492 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:24:08.493 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:24:08.493 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-09-18T01:24:08.493 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:24:08.493 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:24:08.493 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 85 k 2024-09-18T01:24:08.493 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:08.493 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:24:08.493 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:24:08.493 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T01:24:08.494 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:08.494 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 85 k 2024-09-18T01:24:08.494 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 231 k 2024-09-18T01:24:08.494 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:24:08.692 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-fuse-19.1.1-330.gc2ddf972.el9.x86_64.rpm 430 kB/s | 85 kB 00:00 2024-09-18T01:24:08.693 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:24:08.693 INFO:teuthology.orchestra.run.smithi100.stdout:Total 427 kB/s | 85 kB 00:00 2024-09-18T01:24:08.693 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:24:08.700 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:24:08.700 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:24:08.720 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:24:08.767 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:24:08.767 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:24:08.776 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:08.802 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:08.802 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:24:08.802 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T01:24:08.802 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T01:24:08.802 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T01:24:08.802 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:08.910 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:24:09.014 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:09.659 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:24:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:24:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:09.660 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:24:09.863 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:09.863 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:09.863 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:24:09.863 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:24:09.863 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:09.863 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:24:09.965 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-mirror 2024-09-18T01:24:10.068 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-nbd 2024-09-18T01:24:10.588 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:45 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:24:10.658 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:46 ago on Wed 18 Sep 2024 01:22:24 AM UTC. 2024-09-18T01:24:10.745 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:24:10.746 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:24:10.746 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-09-18T01:24:10.746 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:24:10.746 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:24:10.746 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.1 M 2024-09-18T01:24:10.746 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:10.746 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:24:10.746 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:24:10.746 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T01:24:10.746 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:10.746 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 3.1 M 2024-09-18T01:24:10.746 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 13 M 2024-09-18T01:24:10.746 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:24:10.792 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-18T01:24:10.793 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:24:10.793 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-18T01:24:10.793 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:24:10.793 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-18T01:24:10.793 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 170 k 2024-09-18T01:24:10.793 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:10.793 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-18T01:24:10.794 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-18T01:24:10.794 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-18T01:24:10.794 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:10.794 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 170 k 2024-09-18T01:24:10.794 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 494 k 2024-09-18T01:24:10.794 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-18T01:24:11.003 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-nbd-19.1.1-330.gc2ddf972.el9.x86_64.rpm 816 kB/s | 170 kB 00:00 2024-09-18T01:24:11.004 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:24:11.004 INFO:teuthology.orchestra.run.smithi092.stdout:Total 811 kB/s | 170 kB 00:00 2024-09-18T01:24:11.004 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-18T01:24:11.011 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-18T01:24:11.011 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-18T01:24:11.063 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-mirror-19.1.1-330.gc2ddf972.el9.x86_64.rpm 9.8 MB/s | 3.1 MB 00:00 2024-09-18T01:24:11.064 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:24:11.064 INFO:teuthology.orchestra.run.smithi100.stdout:Total 9.7 MB/s | 3.1 MB 00:00 2024-09-18T01:24:11.064 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:24:11.073 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:24:11.074 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:24:11.075 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-18T01:24:11.075 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-18T01:24:11.158 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:24:11.159 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:24:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-18T01:24:11.342 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:11.595 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:24:11.664 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:11.689 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:11.689 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:24:11.689 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T01:24:11.690 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T01:24:11.690 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T01:24:11.690 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:11.796 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:12.055 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-18T01:24:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:24:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:12.055 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-18T01:24:12.289 DEBUG:teuthology.parallel:result is None 2024-09-18T01:24:12.865 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:12.865 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:12.866 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:24:12.866 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:24:12.866 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:12.866 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:24:13.144 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-nbd 2024-09-18T01:24:13.741 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:48 ago on Wed 18 Sep 2024 01:22:25 AM UTC. 2024-09-18T01:24:13.874 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T01:24:13.875 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:24:13.875 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-09-18T01:24:13.875 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:24:13.876 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T01:24:13.876 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 170 k 2024-09-18T01:24:13.876 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:13.876 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T01:24:13.876 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T01:24:13.876 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T01:24:13.876 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:13.876 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 170 k 2024-09-18T01:24:13.876 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 494 k 2024-09-18T01:24:13.876 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T01:24:14.093 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-nbd-19.1.1-330.gc2ddf972.el9.x86_64.rpm 789 kB/s | 170 kB 00:00 2024-09-18T01:24:14.093 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:24:14.093 INFO:teuthology.orchestra.run.smithi100.stdout:Total 783 kB/s | 170 kB 00:00 2024-09-18T01:24:14.093 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T01:24:14.101 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T01:24:14.101 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T01:24:14.165 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T01:24:14.165 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T01:24:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T01:24:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:14.852 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:24:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:15.096 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T01:24:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:24:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:15.096 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T01:24:15.377 DEBUG:teuthology.parallel:result is None 2024-09-18T01:24:15.377 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T01:24:15.524 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T01:24:15.549 INFO:teuthology.orchestra.run.smithi092.stdout:19.1.1-330.gc2ddf972.el9 2024-09-18T01:24:15.550 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330.gc2ddf972.el9 2024-09-18T01:24:15.550 INFO:teuthology.task.install:The correct ceph version 19.1.1-330.gc2ddf972 is installed. 2024-09-18T01:24:15.551 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T01:24:15.692 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T01:24:15.713 INFO:teuthology.orchestra.run.smithi100.stdout:19.1.1-330.gc2ddf972.el9 2024-09-18T01:24:15.713 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330.gc2ddf972.el9 2024-09-18T01:24:15.713 INFO:teuthology.task.install:The correct ceph version 19.1.1-330.gc2ddf972 is installed. 2024-09-18T01:24:15.715 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-18T01:24:15.715 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-18T01:24:15.716 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T01:24:15.746 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:15.746 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T01:24:15.779 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-18T01:24:15.779 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-18T01:24:15.779 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T01:24:15.813 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T01:24:15.878 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:15.879 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T01:24:15.903 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T01:24:15.967 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-18T01:24:15.968 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-18T01:24:15.968 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T01:24:15.992 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T01:24:16.058 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:16.058 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T01:24:16.082 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T01:24:16.152 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-18T01:24:16.152 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-18T01:24:16.152 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T01:24:16.176 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T01:24:16.241 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:16.241 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T01:24:16.266 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T01:24:16.332 INFO:teuthology.run_tasks:Running task ceph... 2024-09-18T01:24:16.415 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-18T01:24:16.415 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /var/log/ceph 2024-09-18T01:24:16.418 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2024-09-18T01:24:16.442 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-18T01:24:16.442 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T01:24:16.482 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T01:24:16.507 INFO:tasks.ceph:Creating extra log directories... 2024-09-18T01:24:16.507 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T01:24:16.548 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T01:24:16.580 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-18T01:24:16.581 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-18T01:24:16.581 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909724', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7909724', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b0d356b98e08f6bc59ef15652f0d0e4298fc83c7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9034, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b0d356b98e08f6bc59ef15652f0d0e4298fc83c7', 'targets': {'smithi092.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLXTveyF7JR6Z9x/cxKk0Oy5hTC5tVTR0FZoGbi1A2xLsmgaKoeERLYPF4ORFmMhGoENBJm/m+IlRUCwQBFVe2E=', 'smithi100.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqGBIhdtPBMEkZldw8MDFQ541BJVEjgycC2xXStfEKGJ3ofbhfg086OfBina/kXKqrSsuawPHBERdoqLJfHhnQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_21:40:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-18T01:24:16.581 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T01:24:16.612 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T01:24:16.628 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T01:24:16.667 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T01:24:16.692 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-18T01:24:16.692 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T01:24:16.745 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T01:24:16.745 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2024-09-18T01:24:16.800 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T01:24:16.800 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:24:16.800 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-18T01:24:16.800 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:24:16.800 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:24:16.801 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-18 01:24:09.055117383 +0000 2024-09-18T01:24:16.801 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-18 01:21:46.287221227 +0000 2024-09-18T01:24:16.801 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-18 01:21:46.287221227 +0000 2024-09-18T01:24:16.801 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-18 01:21:46.287221227 +0000 2024-09-18T01:24:16.801 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T01:24:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-18T01:24:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-18T01:24:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000242392 s, 2.1 MB/s 2024-09-18T01:24:16.864 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T01:24:16.920 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2024-09-18T01:24:16.975 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T01:24:16.975 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:24:16.975 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-18T01:24:16.976 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:24:16.976 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:24:16.976 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-18 01:24:09.056117354 +0000 2024-09-18T01:24:16.976 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-18 01:21:46.611211885 +0000 2024-09-18T01:24:16.976 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-18 01:21:46.611211885 +0000 2024-09-18T01:24:16.976 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-18 01:21:46.611211885 +0000 2024-09-18T01:24:16.976 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T01:24:17.038 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-18T01:24:17.038 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-18T01:24:17.038 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000188234 s, 2.7 MB/s 2024-09-18T01:24:17.039 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T01:24:17.095 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2024-09-18T01:24:17.150 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T01:24:17.150 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:24:17.150 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-18T01:24:17.151 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:24:17.151 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:24:17.151 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-18 01:24:09.056117354 +0000 2024-09-18T01:24:17.151 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-18 01:21:46.935202543 +0000 2024-09-18T01:24:17.151 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-18 01:21:46.935202543 +0000 2024-09-18T01:24:17.151 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-18 01:21:46.935202543 +0000 2024-09-18T01:24:17.151 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T01:24:17.213 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-18T01:24:17.213 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-18T01:24:17.213 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000220296 s, 2.3 MB/s 2024-09-18T01:24:17.214 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T01:24:17.270 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2024-09-18T01:24:17.325 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T01:24:17.325 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:24:17.325 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-18T01:24:17.326 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:24:17.326 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:24:17.326 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-18 01:24:09.056117354 +0000 2024-09-18T01:24:17.326 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-18 01:21:47.273192797 +0000 2024-09-18T01:24:17.326 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-18 01:21:47.273192797 +0000 2024-09-18T01:24:17.326 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-18 01:21:47.273192797 +0000 2024-09-18T01:24:17.326 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T01:24:17.388 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-18T01:24:17.388 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-18T01:24:17.389 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000190103 s, 2.7 MB/s 2024-09-18T01:24:17.390 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T01:24:17.446 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-18T01:24:17.446 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:17.447 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T01:24:17.463 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T01:24:17.464 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-09-18T01:24:17.520 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T01:24:17.520 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:24:17.520 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-18T01:24:17.520 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:24:17.520 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:24:17.521 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-18 01:24:11.948357596 +0000 2024-09-18T01:24:17.521 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-18 01:21:45.227422682 +0000 2024-09-18T01:24:17.521 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-18 01:21:45.227422682 +0000 2024-09-18T01:24:17.521 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-18 01:21:45.227422682 +0000 2024-09-18T01:24:17.521 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T01:24:17.585 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-18T01:24:17.585 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-18T01:24:17.585 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.00020865 s, 2.5 MB/s 2024-09-18T01:24:17.586 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T01:24:17.644 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-09-18T01:24:17.700 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T01:24:17.700 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:24:17.700 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-18T01:24:17.700 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:24:17.701 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:24:17.701 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-18 01:24:11.948357596 +0000 2024-09-18T01:24:17.701 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-18 01:21:45.570413890 +0000 2024-09-18T01:24:17.701 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-18 01:21:45.570413890 +0000 2024-09-18T01:24:17.701 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-18 01:21:45.570413890 +0000 2024-09-18T01:24:17.701 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T01:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-18T01:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-18T01:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000212512 s, 2.4 MB/s 2024-09-18T01:24:17.766 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T01:24:17.822 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-09-18T01:24:17.877 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T01:24:17.878 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:24:17.878 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-18T01:24:17.878 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:24:17.878 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:24:17.878 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-18 01:24:11.949357570 +0000 2024-09-18T01:24:17.878 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-18 01:21:45.886405790 +0000 2024-09-18T01:24:17.878 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-18 01:21:45.886405790 +0000 2024-09-18T01:24:17.878 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-18 01:21:45.886405790 +0000 2024-09-18T01:24:17.878 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T01:24:17.941 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-18T01:24:17.941 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-18T01:24:17.941 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000230265 s, 2.2 MB/s 2024-09-18T01:24:17.942 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T01:24:17.999 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-09-18T01:24:18.054 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T01:24:18.054 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:24:18.054 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-18T01:24:18.054 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:24:18.054 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:24:18.054 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-18 01:24:11.949357570 +0000 2024-09-18T01:24:18.054 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-18 01:21:46.231396946 +0000 2024-09-18T01:24:18.054 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-18 01:21:46.231396946 +0000 2024-09-18T01:24:18.054 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-18 01:21:46.231396946 +0000 2024-09-18T01:24:18.055 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T01:24:18.116 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-18T01:24:18.117 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-18T01:24:18.117 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000184133 s, 2.8 MB/s 2024-09-18T01:24:18.118 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T01:24:18.174 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-18T01:24:18.174 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-18T01:24:18.174 INFO:tasks.ceph:Generating config... 2024-09-18T01:24:18.175 INFO:tasks.ceph:[client] debug ms = 1 2024-09-18T01:24:18.175 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-18T01:24:18.175 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-18T01:24:18.175 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-18T01:24:18.176 INFO:tasks.ceph:[client] setuser = ceph 2024-09-18T01:24:18.176 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-18T01:24:18.176 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-18T01:24:18.176 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-18T01:24:18.176 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-18T01:24:18.177 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-18T01:24:18.177 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-18T01:24:18.177 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-18T01:24:18.177 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-18T01:24:18.177 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-18T01:24:18.177 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-18T01:24:18.177 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-18T01:24:18.177 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-18T01:24:18.177 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-18T01:24:18.177 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-18T01:24:18.177 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-18T01:24:18.177 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-18T01:24:18.177 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-18T01:24:18.177 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-18T01:24:18.177 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-18T01:24:18.178 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-18T01:24:18.178 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-18T01:24:18.178 INFO:tasks.ceph:Setting up mon.a... 2024-09-18T01:24:18.178 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-18T01:24:18.231 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.keyring 2024-09-18T01:24:18.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-18T01:24:18.277 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T01:24:18.302 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.92')] 2024-09-18T01:24:18.303 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.92'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-18T01:24:18.303 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-18T01:24:18.303 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T01:24:18.358 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.92 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:24:18.437 INFO:teuthology.orchestra.run.smithi092.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:24:18.437 INFO:teuthology.orchestra.run.smithi092.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:24:18.438 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:24:18.438 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: generated fsid b78e7965-b05a-4410-91d0-045de6d3262c 2024-09-18T01:24:18.438 INFO:teuthology.orchestra.run.smithi092.stdout:setting min_mon_release = quincy 2024-09-18T01:24:18.438 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 0 2024-09-18T01:24:18.438 INFO:teuthology.orchestra.run.smithi092.stdout:fsid b78e7965-b05a-4410-91d0-045de6d3262c 2024-09-18T01:24:18.438 INFO:teuthology.orchestra.run.smithi092.stdout:last_changed 2024-09-18T01:24:18.437696+0000 2024-09-18T01:24:18.438 INFO:teuthology.orchestra.run.smithi092.stdout:created 2024-09-18T01:24:18.437696+0000 2024-09-18T01:24:18.438 INFO:teuthology.orchestra.run.smithi092.stdout:min_mon_release 17 (quincy) 2024-09-18T01:24:18.438 INFO:teuthology.orchestra.run.smithi092.stdout:election_strategy: 1 2024-09-18T01:24:18.438 INFO:teuthology.orchestra.run.smithi092.stdout:0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-18T01:24:18.438 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-18T01:24:18.439 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T01:24:18.494 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b78e7965-b05a-4410-91d0-045de6d3262c... 2024-09-18T01:24:18.495 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T01:24:18.538 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T01:24:18.578 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2024-09-18T01:24:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: chdir = "" 2024-09-18T01:24:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T01:24:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: auth supported = cephx 2024-09-18T01:24:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: filestore xattr use omap = true 2024-09-18T01:24:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: mon clock drift allowed = 1.000 2024-09-18T01:24:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: osd crush chooseleaf type = 0 2024-09-18T01:24:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: auth debug = true 2024-09-18T01:24:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on old message = true 2024-09-18T01:24:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on bug = true 2024-09-18T01:24:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T01:24:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn max object skew = 0 2024-09-18T01:24:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T01:24:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T01:24:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default size = 2 2024-09-18T01:24:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow primary affinity = true 2024-09-18T01:24:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow pg remap = true 2024-09-18T01:24:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on legacy crush tunables = false 2024-09-18T01:24:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on crush straw calc version zero = false 2024-09-18T01:24:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on no sortbitwise = false 2024-09-18T01:24:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on osd down out interval zero = false 2024-09-18T01:24:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on too few osds = false 2024-09-18T01:24:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T01:24:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T01:24:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: mon_allow_pool_size_one = true 2024-09-18T01:24:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T01:24:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: osd default data pool replay window = 5 2024-09-18T01:24:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: mon allow pool delete = true 2024-09-18T01:24:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: mon cluster log file level = debug 2024-09-18T01:24:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: debug asserts on shutdown = true 2024-09-18T01:24:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: mon health detail to clog = false 2024-09-18T01:24:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: mon host = 172.21.15.92 2024-09-18T01:24:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = b78e7965-b05a-4410-91d0-045de6d3262c 2024-09-18T01:24:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.581 INFO:teuthology.orchestra.run.smithi092.stdout:[osd] 2024-09-18T01:24:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: osd journal size = 100 2024-09-18T01:24:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub load threshold = 5.0 2024-09-18T01:24:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub max interval = 600 2024-09-18T01:24:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: osd mclock profile = high_recovery_ops 2024-09-18T01:24:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: osd recover clone overlap = true 2024-09-18T01:24:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: osd recovery max chunk = 1048576 2024-09-18T01:24:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug shutdown = true 2024-09-18T01:24:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug op order = true 2024-09-18T01:24:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify stray on activate = true 2024-09-18T01:24:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug trim objects = true 2024-09-18T01:24:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: osd open classes on start = true 2024-09-18T01:24:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug pg log writeout = true 2024-09-18T01:24:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: osd deep scrub update digest min age = 30 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: osd map max advance = 10 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: journal zero on create = true 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: filestore ondisk finisher threads = 3 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: filestore apply finisher threads = 3 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: bdev debug aio = true 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug misdirected ops = true 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: debug objclass = 20 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: bdev async discard = True 2024-09-18T01:24:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: bdev enable discard = True 2024-09-18T01:24:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore allocator = bitmap 2024-09-18T01:24:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore block size = 96636764160 2024-09-18T01:24:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore fsck on mount = True 2024-09-18T01:24:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluefs = 1/20 2024-09-18T01:24:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluestore = 1/20 2024-09-18T01:24:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: debug osd = 20 2024-09-18T01:24:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: debug rocksdb = 4/10 2024-09-18T01:24:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T01:24:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd full ratio = 0.9 2024-09-18T01:24:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd nearfull ratio = 0.8 2024-09-18T01:24:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: osd failsafe full ratio = 0.95 2024-09-18T01:24:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: osd objectstore = bluestore 2024-09-18T01:24:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.584 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr] 2024-09-18T01:24:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-09-18T01:24:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: debug mgr = 20 2024-09-18T01:24:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2024-09-18T01:24:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2024-09-18T01:24:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2024-09-18T01:24:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2024-09-18T01:24:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: mgr/telemetry/nag = false 2024-09-18T01:24:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.585 INFO:teuthology.orchestra.run.smithi092.stdout:[mon] 2024-09-18T01:24:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-09-18T01:24:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2024-09-18T01:24:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: debug paxos = 20 2024-09-18T01:24:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2024-09-18T01:24:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: mon data avail warn = 5 2024-09-18T01:24:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: mon mgr mkfs grace = 240 2024-09-18T01:24:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2024-09-18T01:24:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd reporter subtree level = osd 2024-09-18T01:24:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd prime pg temp = true 2024-09-18T01:24:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2024-09-18T01:24:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T01:24:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T01:24:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T01:24:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T01:24:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T01:24:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T01:24:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: # 1m isn't quite enough 2024-09-18T01:24:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: mon_down_mkfs_grace = 2m 2024-09-18T01:24:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_filestore_osds = false 2024-09-18T01:24:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:18.587 INFO:teuthology.orchestra.run.smithi092.stdout:[client] 2024-09-18T01:24:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: rgw cache enabled = true 2024-09-18T01:24:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable ops log = true 2024-09-18T01:24:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable usage log = true 2024-09-18T01:24:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T01:24:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T01:24:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-09-18T01:24:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: rgw gc obj min wait = 15 2024-09-18T01:24:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: debug rgw = 20 2024-09-18T01:24:18.588 INFO:teuthology.orchestra.run.smithi092.stdout: setgroup = ceph 2024-09-18T01:24:18.588 INFO:teuthology.orchestra.run.smithi092.stdout: setuser = ceph 2024-09-18T01:24:18.588 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.a] 2024-09-18T01:24:18.588 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-09-18T01:24:18.588 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2024-09-18T01:24:18.588 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T01:24:18.588 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2024-09-18T01:24:18.588 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.589 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2024-09-18T01:24:18.589 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.589 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2024-09-18T01:24:18.589 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.589 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2024-09-18T01:24:18.589 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2024-09-18T01:24:18.589 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.589 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2024-09-18T01:24:18.589 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2024-09-18T01:24:18.589 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.589 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T01:24:18.589 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2024-09-18T01:24:18.589 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.590 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T01:24:18.590 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T01:24:18.590 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.590 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2024-09-18T01:24:18.590 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.590 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2024-09-18T01:24:18.590 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2024-09-18T01:24:18.590 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2024-09-18T01:24:18.590 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2024-09-18T01:24:18.591 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2024-09-18T01:24:18.591 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2024-09-18T01:24:18.591 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2024-09-18T01:24:18.591 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T01:24:18.591 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T01:24:18.591 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2024-09-18T01:24:18.591 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.591 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T01:24:18.591 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.591 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2024-09-18T01:24:18.591 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.591 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2024-09-18T01:24:18.591 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.591 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2024-09-18T01:24:18.592 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2024-09-18T01:24:18.592 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2024-09-18T01:24:18.592 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = 172.21.15.92 2024-09-18T01:24:18.592 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = b78e7965-b05a-4410-91d0-045de6d3262c 2024-09-18T01:24:18.592 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.592 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2024-09-18T01:24:18.592 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2024-09-18T01:24:18.592 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.592 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2024-09-18T01:24:18.592 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2024-09-18T01:24:18.592 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock profile = high_recovery_ops 2024-09-18T01:24:18.592 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.592 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2024-09-18T01:24:18.593 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2024-09-18T01:24:18.593 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.593 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2024-09-18T01:24:18.593 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2024-09-18T01:24:18.593 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2024-09-18T01:24:18.593 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug trim objects = true 2024-09-18T01:24:18.593 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.593 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2024-09-18T01:24:18.593 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2024-09-18T01:24:18.593 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.593 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2024-09-18T01:24:18.593 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.593 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2024-09-18T01:24:18.593 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.594 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2024-09-18T01:24:18.594 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.594 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2024-09-18T01:24:18.594 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2024-09-18T01:24:18.594 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.594 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2024-09-18T01:24:18.594 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2024-09-18T01:24:18.594 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-18T01:24:18.594 INFO:teuthology.orchestra.run.smithi100.stdout: debug objclass = 20 2024-09-18T01:24:18.594 INFO:teuthology.orchestra.run.smithi100.stdout: bdev async discard = True 2024-09-18T01:24:18.594 INFO:teuthology.orchestra.run.smithi100.stdout: bdev enable discard = True 2024-09-18T01:24:18.594 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore allocator = bitmap 2024-09-18T01:24:18.594 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2024-09-18T01:24:18.594 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2024-09-18T01:24:18.595 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 1/20 2024-09-18T01:24:18.595 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 1/20 2024-09-18T01:24:18.595 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2024-09-18T01:24:18.595 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 4/10 2024-09-18T01:24:18.595 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T01:24:18.595 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2024-09-18T01:24:18.595 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2024-09-18T01:24:18.595 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2024-09-18T01:24:18.595 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2024-09-18T01:24:18.595 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2024-09-18T01:24:18.595 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-18T01:24:18.595 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2024-09-18T01:24:18.595 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-09-18T01:24:18.596 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-09-18T01:24:18.596 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-09-18T01:24:18.596 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-09-18T01:24:18.596 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2024-09-18T01:24:18.596 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.596 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2024-09-18T01:24:18.596 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-18T01:24:18.596 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-09-18T01:24:18.596 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2024-09-18T01:24:18.596 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-09-18T01:24:18.596 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2024-09-18T01:24:18.596 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2024-09-18T01:24:18.596 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-09-18T01:24:18.596 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2024-09-18T01:24:18.597 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2024-09-18T01:24:18.597 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-09-18T01:24:18.597 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.597 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T01:24:18.597 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T01:24:18.597 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T01:24:18.597 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.597 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T01:24:18.597 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T01:24:18.597 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T01:24:18.597 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.597 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2024-09-18T01:24:18.597 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2024-09-18T01:24:18.597 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.598 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2024-09-18T01:24:18.598 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T01:24:18.598 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2024-09-18T01:24:18.598 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2024-09-18T01:24:18.598 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2024-09-18T01:24:18.598 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2024-09-18T01:24:18.598 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T01:24:18.598 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T01:24:18.598 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-18T01:24:18.598 INFO:teuthology.orchestra.run.smithi100.stdout: rgw gc obj min wait = 15 2024-09-18T01:24:18.598 INFO:teuthology.orchestra.run.smithi100.stdout: debug rgw = 20 2024-09-18T01:24:18.598 INFO:teuthology.orchestra.run.smithi100.stdout: setgroup = ceph 2024-09-18T01:24:18.598 INFO:teuthology.orchestra.run.smithi100.stdout: setuser = ceph 2024-09-18T01:24:18.598 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2024-09-18T01:24:18.600 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-18T01:24:18.600 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-18T01:24:18.694 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-18T01:24:18.694 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-18T01:24:18.694 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-18T01:24:18.709 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-18T01:24:18.709 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-18T01:24:18.764 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi092.front.sepia.ceph.com 2024-09-18T01:24:18.764 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-18T01:24:18.764 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T01:24:18.764 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T01:24:18.838 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-18T01:24:18.838 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:24:18.894 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T01:24:18.894 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:18.894 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T01:24:18.894 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T01:24:18.929 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:18.929 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:24:18.984 INFO:tasks.ceph:Setting up mon nodes... 2024-09-18T01:24:18.985 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-18T01:24:18.985 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T01:24:19.087 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T01:24:19.090 INFO:tasks.ceph:Setting up mds nodes... 2024-09-18T01:24:19.090 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-18T01:24:19.090 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-18T01:24:19.130 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-18T01:24:19.142 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-18T01:24:19.143 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-18T01:24:19.143 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-18T01:24:19.167 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-18T01:24:19.167 INFO:tasks.ceph:role: osd.0 2024-09-18T01:24:19.167 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com 2024-09-18T01:24:19.167 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T01:24:19.239 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T01:24:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T01:24:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T01:24:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T01:24:19.239 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T01:24:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-09-18T01:24:19.239 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T01:24:19.239 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T01:24:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T01:24:19.240 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T01:24:19.752 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2024-09-18T01:24:19.754 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-09-18T01:24:19.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-18T01:24:19.879 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-18T01:24:19.914 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:24:20.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:20.007+0000 7f4a11e0e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-18T01:24:20.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:20.010+0000 7f4a11e0e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-18T01:24:20.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:20.010+0000 7f4a11e0e640 -1 bdev(0x55f6c6b07800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-18T01:24:20.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:20.010+0000 7f4a11e0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-18T01:24:23.701 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T01:24:23.733 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-18T01:24:23.763 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-18T01:24:23.763 INFO:tasks.ceph:role: osd.1 2024-09-18T01:24:23.763 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T01:24:23.763 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T01:24:23.839 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T01:24:23.840 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T01:24:23.840 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T01:24:23.840 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T01:24:23.840 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T01:24:23.840 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-18T01:24:23.840 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T01:24:23.840 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T01:24:23.840 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T01:24:23.840 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T01:24:24.335 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-18T01:24:24.337 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-18T01:24:24.337 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-18T01:24:24.448 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-18T01:24:24.484 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-18T01:24:24.552 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-18T01:24:24.552 INFO:tasks.ceph:role: osd.2 2024-09-18T01:24:24.552 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T01:24:24.552 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T01:24:24.626 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T01:24:24.626 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T01:24:24.626 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T01:24:24.626 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T01:24:24.626 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T01:24:24.626 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-18T01:24:24.626 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T01:24:24.626 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T01:24:24.626 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T01:24:24.626 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T01:24:25.075 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-18T01:24:25.077 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-18T01:24:25.077 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-18T01:24:25.149 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-18T01:24:25.219 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-18T01:24:25.284 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-18T01:24:25.285 INFO:tasks.ceph:role: osd.3 2024-09-18T01:24:25.285 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T01:24:25.285 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-18T01:24:25.357 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T01:24:25.357 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T01:24:25.357 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T01:24:25.357 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T01:24:25.357 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T01:24:25.358 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-18T01:24:25.358 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T01:24:25.358 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T01:24:25.358 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T01:24:25.358 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T01:24:25.843 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-18T01:24:25.845 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-18T01:24:25.845 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-18T01:24:25.947 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-18T01:24:25.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:24:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:26.083+0000 7feabd416640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-18T01:24:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:26.083+0000 7feabd416640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-18T01:24:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:26.083+0000 7feabd416640 -1 bdev(0x562292227800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-18T01:24:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:26.083+0000 7feabd416640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-18T01:24:29.755 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T01:24:29.785 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:24:29.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:29.876+0000 7fcbb2212640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-18T01:24:29.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:29.877+0000 7fcbb2212640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-18T01:24:29.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:29.877+0000 7fcbb2212640 -1 bdev(0x55cba77b3800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-18T01:24:29.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:29.877+0000 7fcbb2212640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-18T01:24:33.541 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T01:24:33.571 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:24:33.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:33.659+0000 7fb03c211640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-18T01:24:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:33.659+0000 7fb03c211640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-18T01:24:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:33.659+0000 7fb03c211640 -1 bdev(0x55baa6b49800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-18T01:24:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:33.659+0000 7fb03c211640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-18T01:24:37.556 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T01:24:37.585 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-18T01:24:37.586 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-18T01:24:37.586 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-18T01:24:37.615 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:37.615 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-18T01:24:37.653 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:37.654 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-18T01:24:37.721 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:37.721 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-18T01:24:37.787 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:37.788 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-18T01:24:37.854 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:37.855 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-18T01:24:37.911 INFO:tasks.ceph:Adding keys to all mons... 2024-09-18T01:24:37.911 DEBUG:teuthology.orchestra.run.smithi092:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-18T01:24:37.938 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.0] 2024-09-18T01:24:37.939 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDEK+pmNamGABAAk3jfGvt2IqaloiQXEDNfbQ== 2024-09-18T01:24:37.939 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.x] 2024-09-18T01:24:37.939 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDDK+pm8oA1BRAA2ePEQ9KfVl9arLFCtPAWMA== 2024-09-18T01:24:37.939 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.1] 2024-09-18T01:24:37.939 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDKK+pmm04UBRAA/5LP9sTm1tJ7dJFKJ0nZzw== 2024-09-18T01:24:37.939 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.2] 2024-09-18T01:24:37.939 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDNK+pmwYZeNBAAnu4th71c/l/QS3sBo2Mnag== 2024-09-18T01:24:37.939 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.3] 2024-09-18T01:24:37.939 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDRK+pmT0ddJxAANXtJCB2DXJge4QIZ/aNkqQ== 2024-09-18T01:24:37.939 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2024-09-18T01:24:37.939 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDDK+pmdCDDBxAAtlkQyg/PPDCwwLopB3XX8Q== 2024-09-18T01:24:37.941 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T01:24:38.040 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T01:24:38.099 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T01:24:38.157 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T01:24:38.211 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T01:24:38.263 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T01:24:38.316 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-18T01:24:38.317 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-18T01:24:38.341 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T01:24:38.437 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-18T01:24:38.462 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:24:38.517 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-18T01:24:38.517 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-18T01:24:38.518 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-18T01:24:38.559 INFO:tasks.ceph.mon.a:Started 2024-09-18T01:24:38.560 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-18T01:24:38.560 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-18T01:24:38.560 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-18T01:24:38.562 INFO:tasks.ceph.mgr.x:Started 2024-09-18T01:24:38.563 INFO:tasks.ceph:Setting crush tunables to default 2024-09-18T01:24:38.563 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd crush tunables default 2024-09-18T01:24:38.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.660+0000 7f1ef898d640 1 Processor -- start 2024-09-18T01:24:38.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.660+0000 7f1ef898d640 1 -- start start 2024-09-18T01:24:38.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.660+0000 7f1ef898d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1ef4098a20 0x7f1ef412d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:38.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.660+0000 7f1ef898d640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef4131890 con 0x7f1ef412c570 2024-09-18T01:24:38.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.660+0000 7f1ef898d640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef4098550 con 0x7f1ef4098a20 2024-09-18T01:24:38.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.661+0000 7f1ef1d9b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1ef4098a20 0x7f1ef412d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:38.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.661+0000 7f1ef1d9b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1ef4098a20 0x7f1ef412d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45128/0 (socket says 172.21.15.92:45128) 2024-09-18T01:24:38.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.661+0000 7f1ef259c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f1ef412c570 0x7f1ef412c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:35408/0 (socket says 172.21.15.92:35408) 2024-09-18T01:24:38.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.661+0000 7f1ef1d9b640 1 -- 172.21.15.92:0/1516704793 learned_addr learned my addr 172.21.15.92:0/1516704793 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:38.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.661+0000 7f1ef1d9b640 1 -- 172.21.15.92:0/1516704793 >> v2:172.21.15.92:3300/0 conn(0x7f1ef4098a20 msgr2=0x7f1ef412d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-18T01:24:38.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.661+0000 7f1ef1d9b640 1 -- 172.21.15.92:0/1516704793 >> v2:172.21.15.92:3300/0 conn(0x7f1ef4098a20 msgr2=0x7f1ef412d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-18T01:24:38.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.661+0000 7f1ef1d9b640 1 --2- 172.21.15.92:0/1516704793 >> v2:172.21.15.92:3300/0 conn(0x7f1ef4098a20 0x7f1ef412d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-18T01:24:38.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.661+0000 7f1ef1d9b640 1 --2- 172.21.15.92:0/1516704793 >> v2:172.21.15.92:3300/0 conn(0x7f1ef4098a20 0x7f1ef412d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-18T01:24:38.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.669+0000 7f1ef159a640 1 -- 172.21.15.92:0/1516704793 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1537411465 0 0) 0x7f1ef4131890 con 0x7f1ef412c570 2024-09-18T01:24:38.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.669+0000 7f1ef159a640 1 -- 172.21.15.92:0/1516704793 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1edc003520 con 0x7f1ef412c570 2024-09-18T01:24:38.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.669+0000 7f1ef159a640 1 -- 172.21.15.92:0/1516704793 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2840923382 0 0) 0x7f1edc003520 con 0x7f1ef412c570 2024-09-18T01:24:38.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.669+0000 7f1ef159a640 1 -- 172.21.15.92:0/1516704793 >> v2:172.21.15.92:3300/0 conn(0x7f1ef4098a20 msgr2=0x7f1ef412d060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-18T01:24:38.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.669+0000 7f1ef159a640 1 --2- 172.21.15.92:0/1516704793 >> v2:172.21.15.92:3300/0 conn(0x7f1ef4098a20 0x7f1ef412d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:38.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.669+0000 7f1ef159a640 1 -- 172.21.15.92:0/1516704793 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef4132a70 con 0x7f1ef412c570 2024-09-18T01:24:38.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.669+0000 7f1ef159a640 1 -- 172.21.15.92:0/1516704793 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1303262187 0 0) 0x7f1ee40015a0 con 0x7f1ef412c570 2024-09-18T01:24:38.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.669+0000 7f1ef159a640 1 -- 172.21.15.92:0/1516704793 >> v1:172.21.15.92:6789/0 conn(0x7f1ef412c570 legacy=0x7f1ef412c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:38.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.669+0000 7f1ef159a640 1 --2- 172.21.15.92:0/1516704793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1edc0039b0 0x7f1edc003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:38.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.669+0000 7f1ef159a640 1 -- 172.21.15.92:0/1516704793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef4098550 con 0x7f1edc0039b0 2024-09-18T01:24:38.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.669+0000 7f1ef259c640 1 --2- 172.21.15.92:0/1516704793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1edc0039b0 0x7f1edc003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:38.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.670+0000 7f1ef259c640 1 -- 172.21.15.92:0/1516704793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1edc003520 con 0x7f1edc0039b0 2024-09-18T01:24:38.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.672+0000 7f1ef259c640 1 --2- 172.21.15.92:0/1516704793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1edc0039b0 0x7f1edc003db0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4007f40 tx=0x7f1edc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9fa28876534128 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:38.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.672+0000 7f1ef159a640 1 -- 172.21.15.92:0/1516704793 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ee4007be0 con 0x7f1edc0039b0 2024-09-18T01:24:38.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.672+0000 7f1ef159a640 1 -- 172.21.15.92:0/1516704793 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee4007070 con 0x7f1edc0039b0 2024-09-18T01:24:38.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.672+0000 7f1ef159a640 1 -- 172.21.15.92:0/1516704793 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ee4007370 con 0x7f1edc0039b0 2024-09-18T01:24:38.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.673+0000 7f1ef898d640 1 -- 172.21.15.92:0/1516704793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1edc0039b0 msgr2=0x7f1edc003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:38.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.673+0000 7f1ef898d640 1 --2- 172.21.15.92:0/1516704793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1edc0039b0 0x7f1edc003db0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4007f40 tx=0x7f1edc005830 comp rx=0 tx=0).stop 2024-09-18T01:24:38.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.673+0000 7f1ef898d640 1 -- 172.21.15.92:0/1516704793 shutdown_connections 2024-09-18T01:24:38.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.673+0000 7f1ef898d640 1 --2- 172.21.15.92:0/1516704793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1edc0039b0 0x7f1edc003db0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:38.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.673+0000 7f1ef898d640 1 --2- 172.21.15.92:0/1516704793 >> v2:172.21.15.92:3300/0 conn(0x7f1ef4098a20 0x7f1ef412d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:38.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.673+0000 7f1ef898d640 1 -- 172.21.15.92:0/1516704793 >> 172.21.15.92:0/1516704793 conn(0x7f1ef409f020 msgr2=0x7f1ef409f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:38.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.673+0000 7f1ef898d640 1 -- 172.21.15.92:0/1516704793 shutdown_connections 2024-09-18T01:24:38.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.673+0000 7f1ef898d640 1 -- 172.21.15.92:0/1516704793 wait complete. 2024-09-18T01:24:38.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.674+0000 7f1ef898d640 1 Processor -- start 2024-09-18T01:24:38.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.674+0000 7f1ef898d640 1 -- start start 2024-09-18T01:24:38.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.674+0000 7f1ef898d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1edc0039b0 0x7f1ef4070af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:38.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.674+0000 7f1ef898d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef4131df0 con 0x7f1edc0039b0 2024-09-18T01:24:38.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.674+0000 7f1ef259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1edc0039b0 0x7f1ef4070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:38.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.674+0000 7f1ef259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1edc0039b0 0x7f1ef4070af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45140/0 (socket says 172.21.15.92:45140) 2024-09-18T01:24:38.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.674+0000 7f1ef259c640 1 -- 172.21.15.92:0/549507231 learned_addr learned my addr 172.21.15.92:0/549507231 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:38.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.675+0000 7f1ef259c640 1 -- 172.21.15.92:0/549507231 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef40729d0 con 0x7f1edc0039b0 2024-09-18T01:24:38.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.675+0000 7f1ef259c640 1 --2- 172.21.15.92:0/549507231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1edc0039b0 0x7f1ef4070af0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1ee402ae10 tx=0x7f1ef4050870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:38.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.675+0000 7f1ee2ffd640 1 -- 172.21.15.92:0/549507231 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ee4042020 con 0x7f1edc0039b0 2024-09-18T01:24:38.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.675+0000 7f1ef898d640 1 -- 172.21.15.92:0/549507231 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef4126d60 con 0x7f1edc0039b0 2024-09-18T01:24:38.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.675+0000 7f1ef898d640 1 -- 172.21.15.92:0/549507231 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef412ddb0 con 0x7f1edc0039b0 2024-09-18T01:24:38.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.675+0000 7f1ee2ffd640 1 -- 172.21.15.92:0/549507231 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee4001080 con 0x7f1edc0039b0 2024-09-18T01:24:38.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.675+0000 7f1ee2ffd640 1 -- 172.21.15.92:0/549507231 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ee4004b20 con 0x7f1edc0039b0 2024-09-18T01:24:38.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.675+0000 7f1ee2ffd640 1 -- 172.21.15.92:0/549507231 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1ee4045020 con 0x7f1edc0039b0 2024-09-18T01:24:38.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.675+0000 7f1ee2ffd640 1 -- 172.21.15.92:0/549507231 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1ee4032550 con 0x7f1edc0039b0 2024-09-18T01:24:38.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.676+0000 7f1ef898d640 1 -- 172.21.15.92:0/549507231 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef4071c70 con 0x7f1edc0039b0 2024-09-18T01:24:38.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.678+0000 7f1ee2ffd640 1 -- 172.21.15.92:0/549507231 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1ee404c030 con 0x7f1edc0039b0 2024-09-18T01:24:38.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.738+0000 7f1ef898d640 1 -- 172.21.15.92:0/549507231 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f1ef41322a0 con 0x7f1edc0039b0 2024-09-18T01:24:38.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.739+0000 7f1ee2ffd640 1 -- 172.21.15.92:0/549507231 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f1ee403e9f0 con 0x7f1edc0039b0 2024-09-18T01:24:38.740 INFO:teuthology.orchestra.run.smithi092.stderr:adjusted tunables profile to default 2024-09-18T01:24:38.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.740+0000 7f1ef898d640 1 -- 172.21.15.92:0/549507231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1edc0039b0 msgr2=0x7f1ef4070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:38.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.740+0000 7f1ef898d640 1 --2- 172.21.15.92:0/549507231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1edc0039b0 0x7f1ef4070af0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1ee402ae10 tx=0x7f1ef4050870 comp rx=0 tx=0).stop 2024-09-18T01:24:38.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.740+0000 7f1ef898d640 1 -- 172.21.15.92:0/549507231 shutdown_connections 2024-09-18T01:24:38.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.740+0000 7f1ef898d640 1 --2- 172.21.15.92:0/549507231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1edc0039b0 0x7f1ef4070af0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:38.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.740+0000 7f1ef898d640 1 -- 172.21.15.92:0/549507231 >> 172.21.15.92:0/549507231 conn(0x7f1ef409f020 msgr2=0x7f1ef412a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:38.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.740+0000 7f1ef898d640 1 -- 172.21.15.92:0/549507231 shutdown_connections 2024-09-18T01:24:38.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:38.740+0000 7f1ef898d640 1 -- 172.21.15.92:0/549507231 wait complete. 2024-09-18T01:24:38.752 INFO:tasks.ceph:check_enable_crimson: False 2024-09-18T01:24:38.752 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-18T01:24:38.752 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-18T01:24:38.752 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-18T01:24:38.776 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:38.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-18T01:24:38.783 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:38.782+0000 7f73f3a1c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-18T01:24:38.802 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:38.802 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-18T01:24:38.826 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:38.825+0000 7f73f3a1c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-18T01:24:38.850 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T01:24:38.851 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-18T01:24:38.915 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new 682fe679-c400-4f69-a149-b79e2378d5c3 0 2024-09-18T01:24:38.973 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:38.972+0000 7f73f3a1c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-18T01:24:39.026 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:39.025+0000 7f73f3a1c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-18T01:24:39.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.053+0000 7fc1b7dd6640 1 Processor -- start 2024-09-18T01:24:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.053+0000 7fc1b7dd6640 1 -- start start 2024-09-18T01:24:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.053+0000 7fc1b7dd6640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc1b0117fb0 0x7fc1b0118390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.053+0000 7fc1b7dd6640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b0112960 con 0x7fc1b0111da0 2024-09-18T01:24:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.053+0000 7fc1b7dd6640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fc1b0118a50 con 0x7fc1b0117fb0 2024-09-18T01:24:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.054+0000 7fc1b5b72640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc1b0117fb0 0x7fc1b0118390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.054+0000 7fc1b5371640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc1b0111da0 0x7fc1b0112250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:38252/0 (socket says 172.21.15.100:38252) 2024-09-18T01:24:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.054+0000 7fc1b5371640 1 -- 172.21.15.100:0/3364898046 learned_addr learned my addr 172.21.15.100:0/3364898046 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:24:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.054+0000 7fc1b5b72640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc1b0117fb0 0x7fc1b0118390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:49960/0 (socket says 172.21.15.100:49960) 2024-09-18T01:24:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.054+0000 7fc1b5b72640 1 -- 172.21.15.100:0/3364898046 >> v1:172.21.15.92:6789/0 conn(0x7fc1b0111da0 legacy=0x7fc1b0112250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.054+0000 7fc1b5b72640 1 -- 172.21.15.100:0/3364898046 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b0112b30 con 0x7fc1b0117fb0 2024-09-18T01:24:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.054+0000 7fc1b4b70640 1 -- 172.21.15.100:0/3364898046 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 360375730 0 0) 0x7fc1b0112960 con 0x7fc1b0111da0 2024-09-18T01:24:39.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.055+0000 7fc1b5b72640 1 --2- 172.21.15.100:0/3364898046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1b0117fb0 0x7fc1b0118390 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009720 tx=0x7fc1a002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29979e441bd1399e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:39.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.055+0000 7fc1b4b70640 1 -- 172.21.15.100:0/3364898046 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a0037070 con 0x7fc1b0117fb0 2024-09-18T01:24:39.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.055+0000 7fc1b4b70640 1 -- 172.21.15.100:0/3364898046 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a002ad90 con 0x7fc1b0117fb0 2024-09-18T01:24:39.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.055+0000 7fc1b4b70640 1 -- 172.21.15.100:0/3364898046 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a0032590 con 0x7fc1b0117fb0 2024-09-18T01:24:39.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.055+0000 7fc1b7dd6640 1 -- 172.21.15.100:0/3364898046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1b0117fb0 msgr2=0x7fc1b0118390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.055+0000 7fc1b7dd6640 1 --2- 172.21.15.100:0/3364898046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1b0117fb0 0x7fc1b0118390 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009720 tx=0x7fc1a002a110 comp rx=0 tx=0).stop 2024-09-18T01:24:39.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.056+0000 7fc1b7dd6640 1 -- 172.21.15.100:0/3364898046 shutdown_connections 2024-09-18T01:24:39.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.056+0000 7fc1b7dd6640 1 --2- 172.21.15.100:0/3364898046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1b0117fb0 0x7fc1b0118390 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:39.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.056+0000 7fc1b7dd6640 1 -- 172.21.15.100:0/3364898046 >> 172.21.15.100:0/3364898046 conn(0x7fc1b006e5e0 msgr2=0x7fc1b006e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:39.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.056+0000 7fc1b7dd6640 1 -- 172.21.15.100:0/3364898046 shutdown_connections 2024-09-18T01:24:39.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.056+0000 7fc1b7dd6640 1 -- 172.21.15.100:0/3364898046 wait complete. 2024-09-18T01:24:39.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.056+0000 7fc1b7dd6640 1 Processor -- start 2024-09-18T01:24:39.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.056+0000 7fc1b7dd6640 1 -- start start 2024-09-18T01:24:39.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.056+0000 7fc1b7dd6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1b0111da0 0x7fc1b01a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:39.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.056+0000 7fc1b7dd6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b011e120 con 0x7fc1b0111da0 2024-09-18T01:24:39.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.057+0000 7fc1b5b72640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1b0111da0 0x7fc1b01a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:39.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.057+0000 7fc1b5b72640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1b0111da0 0x7fc1b01a6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:49976/0 (socket says 172.21.15.100:49976) 2024-09-18T01:24:39.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.057+0000 7fc1b5b72640 1 -- 172.21.15.100:0/335920473 learned_addr learned my addr 172.21.15.100:0/335920473 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:24:39.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.057+0000 7fc1b5b72640 1 -- 172.21.15.100:0/335920473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b01a6f20 con 0x7fc1b0111da0 2024-09-18T01:24:39.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.057+0000 7fc1b5b72640 1 --2- 172.21.15.100:0/335920473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1b0111da0 0x7fc1b01a6950 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0035040 tx=0x7fc1a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:39.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.057+0000 7fc1a67fc640 1 -- 172.21.15.100:0/335920473 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a0037040 con 0x7fc1b0111da0 2024-09-18T01:24:39.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.057+0000 7fc1a67fc640 1 -- 172.21.15.100:0/335920473 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a0004030 con 0x7fc1b0111da0 2024-09-18T01:24:39.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.057+0000 7fc1b7dd6640 1 -- 172.21.15.100:0/335920473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b01a7210 con 0x7fc1b0111da0 2024-09-18T01:24:39.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.057+0000 7fc1a67fc640 1 -- 172.21.15.100:0/335920473 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a0004350 con 0x7fc1b0111da0 2024-09-18T01:24:39.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.057+0000 7fc1b7dd6640 1 -- 172.21.15.100:0/335920473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b01ab1e0 con 0x7fc1b0111da0 2024-09-18T01:24:39.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.058+0000 7fc1a67fc640 1 -- 172.21.15.100:0/335920473 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc1a003a040 con 0x7fc1b0111da0 2024-09-18T01:24:39.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.058+0000 7fc1a67fc640 1 -- 172.21.15.100:0/335920473 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fc1a003eb40 con 0x7fc1b0111da0 2024-09-18T01:24:39.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.058+0000 7fc1b7dd6640 1 -- 172.21.15.100:0/335920473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b0118410 con 0x7fc1b0111da0 2024-09-18T01:24:39.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.061+0000 7fc1a67fc640 1 -- 172.21.15.100:0/335920473 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc1a0042020 con 0x7fc1b0111da0 2024-09-18T01:24:39.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.129+0000 7fc1b7dd6640 1 -- 172.21.15.100:0/335920473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "682fe679-c400-4f69-a149-b79e2378d5c3", "id": 0} v 0) -- 0x7fc1b0117fb0 con 0x7fc1b0111da0 2024-09-18T01:24:39.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.130+0000 7fc1a67fc640 1 -- 172.21.15.100:0/335920473 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "682fe679-c400-4f69-a149-b79e2378d5c3", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fc1a003ede0 con 0x7fc1b0111da0 2024-09-18T01:24:39.132 INFO:teuthology.orchestra.run.smithi100.stdout:0 2024-09-18T01:24:39.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.131+0000 7fc1b7dd6640 1 -- 172.21.15.100:0/335920473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1b0111da0 msgr2=0x7fc1b01a6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.131+0000 7fc1b7dd6640 1 --2- 172.21.15.100:0/335920473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1b0111da0 0x7fc1b01a6950 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0035040 tx=0x7fc1a00046c0 comp rx=0 tx=0).stop 2024-09-18T01:24:39.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.131+0000 7fc1b7dd6640 1 -- 172.21.15.100:0/335920473 shutdown_connections 2024-09-18T01:24:39.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.131+0000 7fc1b7dd6640 1 --2- 172.21.15.100:0/335920473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1b0111da0 0x7fc1b01a6950 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:39.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.131+0000 7fc1b7dd6640 1 -- 172.21.15.100:0/335920473 >> 172.21.15.100:0/335920473 conn(0x7fc1b006e5e0 msgr2=0x7fc1b0113ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:39.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.131+0000 7fc1b7dd6640 1 -- 172.21.15.100:0/335920473 shutdown_connections 2024-09-18T01:24:39.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.131+0000 7fc1b7dd6640 1 -- 172.21.15.100:0/335920473 wait complete. 2024-09-18T01:24:39.143 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new ac9e21ba-ed5c-42f9-95ee-a96375bb9d1f 1 2024-09-18T01:24:39.190 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:39.189+0000 7f73f3a1c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-18T01:24:39.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.282+0000 7fe0e7242640 1 Processor -- start 2024-09-18T01:24:39.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.282+0000 7fe0e7242640 1 -- start start 2024-09-18T01:24:39.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.282+0000 7fe0e7242640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe0e0117fb0 0x7fe0e0118390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:39.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.282+0000 7fe0e7242640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e0112960 con 0x7fe0e0111da0 2024-09-18T01:24:39.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.282+0000 7fe0e7242640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e0118a50 con 0x7fe0e0117fb0 2024-09-18T01:24:39.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.282+0000 7fe0e4fde640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe0e0117fb0 0x7fe0e0118390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:39.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.282+0000 7fe0dffff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fe0e0111da0 0x7fe0e0112250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:38256/0 (socket says 172.21.15.100:38256) 2024-09-18T01:24:39.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.282+0000 7fe0e4fde640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe0e0117fb0 0x7fe0e0118390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:49986/0 (socket says 172.21.15.100:49986) 2024-09-18T01:24:39.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.282+0000 7fe0dffff640 1 -- 172.21.15.100:0/28314659 learned_addr learned my addr 172.21.15.100:0/28314659 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:24:39.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.282+0000 7fe0e4fde640 1 -- 172.21.15.100:0/28314659 >> v1:172.21.15.92:6789/0 conn(0x7fe0e0111da0 legacy=0x7fe0e0112250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.283+0000 7fe0e4fde640 1 -- 172.21.15.100:0/28314659 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e0112b30 con 0x7fe0e0117fb0 2024-09-18T01:24:39.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.283+0000 7fe0df7fe640 1 -- 172.21.15.100:0/28314659 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 689947892 0 0) 0x7fe0e0112960 con 0x7fe0e0111da0 2024-09-18T01:24:39.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.283+0000 7fe0e4fde640 1 --2- 172.21.15.100:0/28314659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e0117fb0 0x7fe0e0118390 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009720 tx=0x7fe0d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8df07f391b3edf server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:39.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.283+0000 7fe0df7fe640 1 -- 172.21.15.100:0/28314659 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0d4037070 con 0x7fe0e0117fb0 2024-09-18T01:24:39.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.283+0000 7fe0df7fe640 1 -- 172.21.15.100:0/28314659 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d402ad90 con 0x7fe0e0117fb0 2024-09-18T01:24:39.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.283+0000 7fe0df7fe640 1 -- 172.21.15.100:0/28314659 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0d4032590 con 0x7fe0e0117fb0 2024-09-18T01:24:39.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.284+0000 7fe0e7242640 1 -- 172.21.15.100:0/28314659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e0117fb0 msgr2=0x7fe0e0118390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.284+0000 7fe0e7242640 1 --2- 172.21.15.100:0/28314659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e0117fb0 0x7fe0e0118390 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009720 tx=0x7fe0d402a110 comp rx=0 tx=0).stop 2024-09-18T01:24:39.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.284+0000 7fe0e7242640 1 -- 172.21.15.100:0/28314659 shutdown_connections 2024-09-18T01:24:39.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.284+0000 7fe0e7242640 1 --2- 172.21.15.100:0/28314659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e0117fb0 0x7fe0e0118390 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:39.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.284+0000 7fe0e7242640 1 -- 172.21.15.100:0/28314659 >> 172.21.15.100:0/28314659 conn(0x7fe0e006e5e0 msgr2=0x7fe0e006e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:39.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.284+0000 7fe0e7242640 1 -- 172.21.15.100:0/28314659 shutdown_connections 2024-09-18T01:24:39.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.284+0000 7fe0e7242640 1 -- 172.21.15.100:0/28314659 wait complete. 2024-09-18T01:24:39.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.285+0000 7fe0e7242640 1 Processor -- start 2024-09-18T01:24:39.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.285+0000 7fe0e7242640 1 -- start start 2024-09-18T01:24:39.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.285+0000 7fe0e7242640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e0111da0 0x7fe0e01a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:39.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.285+0000 7fe0e7242640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e011e120 con 0x7fe0e0111da0 2024-09-18T01:24:39.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.285+0000 7fe0e4fde640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e0111da0 0x7fe0e01a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:39.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.285+0000 7fe0e4fde640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e0111da0 0x7fe0e01a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:49988/0 (socket says 172.21.15.100:49988) 2024-09-18T01:24:39.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.285+0000 7fe0e4fde640 1 -- 172.21.15.100:0/506998565 learned_addr learned my addr 172.21.15.100:0/506998565 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:24:39.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.286+0000 7fe0e4fde640 1 -- 172.21.15.100:0/506998565 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e01a6f30 con 0x7fe0e0111da0 2024-09-18T01:24:39.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.286+0000 7fe0e4fde640 1 --2- 172.21.15.100:0/506998565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e0111da0 0x7fe0e01a69f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000c00 tx=0x7fe0d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:39.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.286+0000 7fe0dd7fa640 1 -- 172.21.15.100:0/506998565 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0d4041070 con 0x7fe0e0111da0 2024-09-18T01:24:39.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.286+0000 7fe0dd7fa640 1 -- 172.21.15.100:0/506998565 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d403c590 con 0x7fe0e0111da0 2024-09-18T01:24:39.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.286+0000 7fe0dd7fa640 1 -- 172.21.15.100:0/506998565 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0d4037040 con 0x7fe0e0111da0 2024-09-18T01:24:39.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.286+0000 7fe0e7242640 1 -- 172.21.15.100:0/506998565 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e01a7220 con 0x7fe0e0111da0 2024-09-18T01:24:39.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.286+0000 7fe0e7242640 1 -- 172.21.15.100:0/506998565 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e01ab2d0 con 0x7fe0e0111da0 2024-09-18T01:24:39.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.286+0000 7fe0dd7fa640 1 -- 172.21.15.100:0/506998565 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe0d4044070 con 0x7fe0e0111da0 2024-09-18T01:24:39.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.286+0000 7fe0dd7fa640 1 -- 172.21.15.100:0/506998565 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fe0d4046b00 con 0x7fe0e0111da0 2024-09-18T01:24:39.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.287+0000 7fe0e7242640 1 -- 172.21.15.100:0/506998565 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e0118410 con 0x7fe0e0111da0 2024-09-18T01:24:39.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.289+0000 7fe0dd7fa640 1 -- 172.21.15.100:0/506998565 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe0d4046da0 con 0x7fe0e0111da0 2024-09-18T01:24:39.307 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:39.306+0000 7f73f3a1c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-18T01:24:39.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.359+0000 7fe0e7242640 1 -- 172.21.15.100:0/506998565 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ac9e21ba-ed5c-42f9-95ee-a96375bb9d1f", "id": 1} v 0) -- 0x7fe0e01a7450 con 0x7fe0e0111da0 2024-09-18T01:24:39.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.360+0000 7fe0dd7fa640 1 -- 172.21.15.100:0/506998565 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ac9e21ba-ed5c-42f9-95ee-a96375bb9d1f", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fe0d403c8b0 con 0x7fe0e0111da0 2024-09-18T01:24:39.362 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-18T01:24:39.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.361+0000 7fe0e7242640 1 -- 172.21.15.100:0/506998565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e0111da0 msgr2=0x7fe0e01a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.361+0000 7fe0e7242640 1 --2- 172.21.15.100:0/506998565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e0111da0 0x7fe0e01a69f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000c00 tx=0x7fe0d40046c0 comp rx=0 tx=0).stop 2024-09-18T01:24:39.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.362+0000 7fe0e7242640 1 -- 172.21.15.100:0/506998565 shutdown_connections 2024-09-18T01:24:39.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.362+0000 7fe0e7242640 1 --2- 172.21.15.100:0/506998565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e0111da0 0x7fe0e01a69f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:39.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.362+0000 7fe0e7242640 1 -- 172.21.15.100:0/506998565 >> 172.21.15.100:0/506998565 conn(0x7fe0e006e5e0 msgr2=0x7fe0e0114080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:39.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.362+0000 7fe0e7242640 1 -- 172.21.15.100:0/506998565 shutdown_connections 2024-09-18T01:24:39.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.362+0000 7fe0e7242640 1 -- 172.21.15.100:0/506998565 wait complete. 2024-09-18T01:24:39.373 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new 007ace6b-0046-48e4-9135-506e415b57a5 2 2024-09-18T01:24:39.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.511+0000 7f95b8f65640 1 Processor -- start 2024-09-18T01:24:39.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.511+0000 7f95b8f65640 1 -- start start 2024-09-18T01:24:39.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.511+0000 7f95b8f65640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f95b410f870 0x7f95b411b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:39.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.511+0000 7f95b8f65640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b411b650 con 0x7f95b410ed80 2024-09-18T01:24:39.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.511+0000 7f95b8f65640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f95b411c830 con 0x7f95b410f870 2024-09-18T01:24:39.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.512+0000 7f95b1d9b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f95b410f870 0x7f95b411b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:39.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.512+0000 7f95b259c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f95b410ed80 0x7f95b410f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:38266/0 (socket says 172.21.15.100:38266) 2024-09-18T01:24:39.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.512+0000 7f95b1d9b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f95b410f870 0x7f95b411b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:50000/0 (socket says 172.21.15.100:50000) 2024-09-18T01:24:39.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.512+0000 7f95b259c640 1 -- 172.21.15.100:0/790532643 learned_addr learned my addr 172.21.15.100:0/790532643 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:24:39.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.512+0000 7f95b1d9b640 1 -- 172.21.15.100:0/790532643 >> v1:172.21.15.92:6789/0 conn(0x7f95b410ed80 legacy=0x7f95b410f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.512+0000 7f95b1d9b640 1 -- 172.21.15.100:0/790532643 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b411c9b0 con 0x7f95b410f870 2024-09-18T01:24:39.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.512+0000 7f95b159a640 1 -- 172.21.15.100:0/790532643 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4054271047 0 0) 0x7f95b411b650 con 0x7f95b410ed80 2024-09-18T01:24:39.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.513+0000 7f95b1d9b640 1 --2- 172.21.15.100:0/790532643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b410f870 0x7f95b411b110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f959c009720 tx=0x7f959c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a602664b370caa27 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:39.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.513+0000 7f95b159a640 1 -- 172.21.15.100:0/790532643 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f959c037070 con 0x7f95b410f870 2024-09-18T01:24:39.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.513+0000 7f95b159a640 1 -- 172.21.15.100:0/790532643 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959c02ad90 con 0x7f95b410f870 2024-09-18T01:24:39.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.513+0000 7f95b159a640 1 -- 172.21.15.100:0/790532643 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f959c032590 con 0x7f95b410f870 2024-09-18T01:24:39.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.513+0000 7f95b8f65640 1 -- 172.21.15.100:0/790532643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b410f870 msgr2=0x7f95b411b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.513+0000 7f95b8f65640 1 --2- 172.21.15.100:0/790532643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b410f870 0x7f95b411b110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f959c009720 tx=0x7f959c02a110 comp rx=0 tx=0).stop 2024-09-18T01:24:39.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.514+0000 7f95b8f65640 1 -- 172.21.15.100:0/790532643 shutdown_connections 2024-09-18T01:24:39.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.514+0000 7f95b8f65640 1 --2- 172.21.15.100:0/790532643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b410f870 0x7f95b411b110 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:39.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.514+0000 7f95b8f65640 1 -- 172.21.15.100:0/790532643 >> 172.21.15.100:0/790532643 conn(0x7f95b406f7c0 msgr2=0x7f95b4071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:39.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.514+0000 7f95b8f65640 1 -- 172.21.15.100:0/790532643 shutdown_connections 2024-09-18T01:24:39.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.514+0000 7f95b8f65640 1 -- 172.21.15.100:0/790532643 wait complete. 2024-09-18T01:24:39.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.514+0000 7f95b8f65640 1 Processor -- start 2024-09-18T01:24:39.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.514+0000 7f95b8f65640 1 -- start start 2024-09-18T01:24:39.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.515+0000 7f95b8f65640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b410ed80 0x7f95b41aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:39.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.515+0000 7f95b8f65640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95b411bbf0 con 0x7f95b410ed80 2024-09-18T01:24:39.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.515+0000 7f95b259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b410ed80 0x7f95b41aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:39.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.515+0000 7f95b259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b410ed80 0x7f95b41aa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:50012/0 (socket says 172.21.15.100:50012) 2024-09-18T01:24:39.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.515+0000 7f95b259c640 1 -- 172.21.15.100:0/1806531265 learned_addr learned my addr 172.21.15.100:0/1806531265 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:24:39.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.515+0000 7f95b259c640 1 -- 172.21.15.100:0/1806531265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b41aa9c0 con 0x7f95b410ed80 2024-09-18T01:24:39.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.515+0000 7f95b259c640 1 --2- 172.21.15.100:0/1806531265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b410ed80 0x7f95b41aa3f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00c760 tx=0x7f95ac00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:39.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.515+0000 7f95aaffd640 1 -- 172.21.15.100:0/1806531265 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95ac018070 con 0x7f95b410ed80 2024-09-18T01:24:39.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.515+0000 7f95aaffd640 1 -- 172.21.15.100:0/1806531265 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ac004d70 con 0x7f95b410ed80 2024-09-18T01:24:39.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.516+0000 7f95aaffd640 1 -- 172.21.15.100:0/1806531265 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95ac00a790 con 0x7f95b410ed80 2024-09-18T01:24:39.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.516+0000 7f95b8f65640 1 -- 172.21.15.100:0/1806531265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b41aac50 con 0x7f95b410ed80 2024-09-18T01:24:39.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.516+0000 7f95b8f65640 1 -- 172.21.15.100:0/1806531265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b41a4660 con 0x7f95b410ed80 2024-09-18T01:24:39.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.516+0000 7f95aaffd640 1 -- 172.21.15.100:0/1806531265 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f95ac01b070 con 0x7f95b410ed80 2024-09-18T01:24:39.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.516+0000 7f95aaffd640 1 -- 172.21.15.100:0/1806531265 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f95ac0077b0 con 0x7f95b410ed80 2024-09-18T01:24:39.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.516+0000 7f95b8f65640 1 -- 172.21.15.100:0/1806531265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b411c1d0 con 0x7f95b410ed80 2024-09-18T01:24:39.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.519+0000 7f95aaffd640 1 -- 172.21.15.100:0/1806531265 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f95ac0079b0 con 0x7f95b410ed80 2024-09-18T01:24:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.588+0000 7f95b8f65640 1 -- 172.21.15.100:0/1806531265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "007ace6b-0046-48e4-9135-506e415b57a5", "id": 2} v 0) -- 0x7f95b41aae80 con 0x7f95b410ed80 2024-09-18T01:24:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.590+0000 7f95aaffd640 1 -- 172.21.15.100:0/1806531265 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "007ace6b-0046-48e4-9135-506e415b57a5", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f95ac007280 con 0x7f95b410ed80 2024-09-18T01:24:39.591 INFO:teuthology.orchestra.run.smithi100.stdout:2 2024-09-18T01:24:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.590+0000 7f95b8f65640 1 -- 172.21.15.100:0/1806531265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b410ed80 msgr2=0x7f95b41aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.590+0000 7f95b8f65640 1 --2- 172.21.15.100:0/1806531265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b410ed80 0x7f95b41aa3f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00c760 tx=0x7f95ac00cc20 comp rx=0 tx=0).stop 2024-09-18T01:24:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.590+0000 7f95b8f65640 1 -- 172.21.15.100:0/1806531265 shutdown_connections 2024-09-18T01:24:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.590+0000 7f95b8f65640 1 --2- 172.21.15.100:0/1806531265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b410ed80 0x7f95b41aa3f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.590+0000 7f95b8f65640 1 -- 172.21.15.100:0/1806531265 >> 172.21.15.100:0/1806531265 conn(0x7f95b406f7c0 msgr2=0x7f95b4112990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.591+0000 7f95b8f65640 1 -- 172.21.15.100:0/1806531265 shutdown_connections 2024-09-18T01:24:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.591+0000 7f95b8f65640 1 -- 172.21.15.100:0/1806531265 wait complete. 2024-09-18T01:24:39.602 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new be610877-3846-4095-9cf3-30d6ee8d0f31 3 2024-09-18T01:24:39.659 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:39.658+0000 7f73f3a1c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-18T01:24:39.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.710+0000 7f0d85966640 1 Processor -- start 2024-09-18T01:24:39.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.710+0000 7f0d85966640 1 -- start start 2024-09-18T01:24:39.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.710+0000 7f0d85966640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0d8010f870 0x7f0d8011b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:39.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.710+0000 7f0d85966640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d8011b650 con 0x7f0d8010ed80 2024-09-18T01:24:39.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.710+0000 7f0d85966640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0d8011c830 con 0x7f0d8010f870 2024-09-18T01:24:39.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.711+0000 7f0d7e7fc640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0d8010f870 0x7f0d8011b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:39.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.711+0000 7f0d7effd640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0d8010ed80 0x7f0d8010f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:38270/0 (socket says 172.21.15.100:38270) 2024-09-18T01:24:39.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.711+0000 7f0d7effd640 1 -- 172.21.15.100:0/279898326 learned_addr learned my addr 172.21.15.100:0/279898326 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:24:39.712 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:39.711+0000 7f73f3a1c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-18T01:24:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.711+0000 7f0d7e7fc640 1 -- 172.21.15.100:0/279898326 >> v1:172.21.15.92:6789/0 conn(0x7f0d8010ed80 legacy=0x7f0d8010f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.711+0000 7f0d7e7fc640 1 -- 172.21.15.100:0/279898326 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8011c9b0 con 0x7f0d8010f870 2024-09-18T01:24:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.711+0000 7f0d7dffb640 1 -- 172.21.15.100:0/279898326 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2677525937 0 0) 0x7f0d8011b650 con 0x7f0d8010ed80 2024-09-18T01:24:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.712+0000 7f0d7e7fc640 1 --2- 172.21.15.100:0/279898326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d8010f870 0x7f0d8011b110 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009720 tx=0x7f0d7402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8818ad51f802caa server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.712+0000 7f0d7dffb640 1 -- 172.21.15.100:0/279898326 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d74037070 con 0x7f0d8010f870 2024-09-18T01:24:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.712+0000 7f0d7dffb640 1 -- 172.21.15.100:0/279898326 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d7402ad90 con 0x7f0d8010f870 2024-09-18T01:24:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.712+0000 7f0d7dffb640 1 -- 172.21.15.100:0/279898326 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d74032590 con 0x7f0d8010f870 2024-09-18T01:24:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.712+0000 7f0d85966640 1 -- 172.21.15.100:0/279898326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d8010f870 msgr2=0x7f0d8011b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.712+0000 7f0d85966640 1 --2- 172.21.15.100:0/279898326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d8010f870 0x7f0d8011b110 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009720 tx=0x7f0d7402a110 comp rx=0 tx=0).stop 2024-09-18T01:24:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.713+0000 7f0d85966640 1 -- 172.21.15.100:0/279898326 shutdown_connections 2024-09-18T01:24:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.713+0000 7f0d85966640 1 --2- 172.21.15.100:0/279898326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d8010f870 0x7f0d8011b110 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.713+0000 7f0d85966640 1 -- 172.21.15.100:0/279898326 >> 172.21.15.100:0/279898326 conn(0x7f0d8006f7c0 msgr2=0x7f0d80071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.713+0000 7f0d85966640 1 -- 172.21.15.100:0/279898326 shutdown_connections 2024-09-18T01:24:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.713+0000 7f0d85966640 1 -- 172.21.15.100:0/279898326 wait complete. 2024-09-18T01:24:39.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.713+0000 7f0d85966640 1 Processor -- start 2024-09-18T01:24:39.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.713+0000 7f0d85966640 1 -- start start 2024-09-18T01:24:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.714+0000 7f0d85966640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d8010ed80 0x7f0d801aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.714+0000 7f0d85966640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8011bbf0 con 0x7f0d8010ed80 2024-09-18T01:24:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.714+0000 7f0d7effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d8010ed80 0x7f0d801aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.714+0000 7f0d7effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d8010ed80 0x7f0d801aa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:50022/0 (socket says 172.21.15.100:50022) 2024-09-18T01:24:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.714+0000 7f0d7effd640 1 -- 172.21.15.100:0/570046346 learned_addr learned my addr 172.21.15.100:0/570046346 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:24:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.714+0000 7f0d7effd640 1 -- 172.21.15.100:0/570046346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d801aa9c0 con 0x7f0d8010ed80 2024-09-18T01:24:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.714+0000 7f0d7effd640 1 --2- 172.21.15.100:0/570046346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d8010ed80 0x7f0d801aa3f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c3e0 tx=0x7f0d7000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.715+0000 7f0d67fff640 1 -- 172.21.15.100:0/570046346 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d70007410 con 0x7f0d8010ed80 2024-09-18T01:24:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.715+0000 7f0d67fff640 1 -- 172.21.15.100:0/570046346 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d700075d0 con 0x7f0d8010ed80 2024-09-18T01:24:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.715+0000 7f0d85966640 1 -- 172.21.15.100:0/570046346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d801aac50 con 0x7f0d8010ed80 2024-09-18T01:24:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.715+0000 7f0d67fff640 1 -- 172.21.15.100:0/570046346 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d70004950 con 0x7f0d8010ed80 2024-09-18T01:24:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.715+0000 7f0d85966640 1 -- 172.21.15.100:0/570046346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d801a4660 con 0x7f0d8010ed80 2024-09-18T01:24:39.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.715+0000 7f0d67fff640 1 -- 172.21.15.100:0/570046346 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0d70011070 con 0x7f0d8010ed80 2024-09-18T01:24:39.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.715+0000 7f0d67fff640 1 -- 172.21.15.100:0/570046346 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f0d7001d3f0 con 0x7f0d8010ed80 2024-09-18T01:24:39.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.716+0000 7f0d85966640 1 -- 172.21.15.100:0/570046346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8011c1d0 con 0x7f0d8010ed80 2024-09-18T01:24:39.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.718+0000 7f0d67fff640 1 -- 172.21.15.100:0/570046346 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0d7001d680 con 0x7f0d8010ed80 2024-09-18T01:24:39.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.800+0000 7f0d85966640 1 -- 172.21.15.100:0/570046346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "be610877-3846-4095-9cf3-30d6ee8d0f31", "id": 3} v 0) -- 0x7f0d801aae80 con 0x7f0d8010ed80 2024-09-18T01:24:39.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.803+0000 7f0d67fff640 1 -- 172.21.15.100:0/570046346 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be610877-3846-4095-9cf3-30d6ee8d0f31", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f0d70004af0 con 0x7f0d8010ed80 2024-09-18T01:24:39.805 INFO:teuthology.orchestra.run.smithi100.stdout:3 2024-09-18T01:24:39.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.804+0000 7f0d85966640 1 -- 172.21.15.100:0/570046346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d8010ed80 msgr2=0x7f0d801aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.804+0000 7f0d85966640 1 --2- 172.21.15.100:0/570046346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d8010ed80 0x7f0d801aa3f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c3e0 tx=0x7f0d7000c8a0 comp rx=0 tx=0).stop 2024-09-18T01:24:39.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.804+0000 7f0d85966640 1 -- 172.21.15.100:0/570046346 shutdown_connections 2024-09-18T01:24:39.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.804+0000 7f0d85966640 1 --2- 172.21.15.100:0/570046346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d8010ed80 0x7f0d801aa3f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:39.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.804+0000 7f0d85966640 1 -- 172.21.15.100:0/570046346 >> 172.21.15.100:0/570046346 conn(0x7f0d8006f7c0 msgr2=0x7f0d80112990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:39.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.805+0000 7f0d85966640 1 -- 172.21.15.100:0/570046346 shutdown_connections 2024-09-18T01:24:39.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:24:39.805+0000 7f0d85966640 1 -- 172.21.15.100:0/570046346 wait complete. 2024-09-18T01:24:39.816 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-18T01:24:39.816 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-18T01:24:39.819 INFO:tasks.ceph.osd.0:Started 2024-09-18T01:24:39.819 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-18T01:24:39.819 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-18T01:24:39.821 INFO:tasks.ceph.osd.1:Started 2024-09-18T01:24:39.821 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-18T01:24:39.821 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-18T01:24:39.823 INFO:tasks.ceph.osd.2:Started 2024-09-18T01:24:39.823 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-18T01:24:39.824 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-18T01:24:39.826 INFO:tasks.ceph.osd.3:Started 2024-09-18T01:24:39.826 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T01:24:39.891 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:39.890+0000 7f73f3a1c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-18T01:24:39.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.929+0000 7f3368b11640 1 Processor -- start 2024-09-18T01:24:39.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.929+0000 7f3368b11640 1 -- start start 2024-09-18T01:24:39.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.930+0000 7f3368b11640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f336412e940 0x7f3364130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:39.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.930+0000 7f3368b11640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f336406eba0 con 0x7f336406eda0 2024-09-18T01:24:39.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.930+0000 7f3368b11640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f336406d2f0 con 0x7f336412e940 2024-09-18T01:24:39.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.930+0000 7f3361d9b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f336412e940 0x7f3364130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:39.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.930+0000 7f336259c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f336406eda0 0x7f336406f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:35418/0 (socket says 172.21.15.92:35418) 2024-09-18T01:24:39.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.930+0000 7f336259c640 1 -- 172.21.15.92:0/1158465006 learned_addr learned my addr 172.21.15.92:0/1158465006 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:24:39.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.930+0000 7f3361d9b640 1 -- 172.21.15.92:0/1158465006 >> v1:172.21.15.92:6789/0 conn(0x7f336406eda0 legacy=0x7f336406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.930+0000 7f3361d9b640 1 -- 172.21.15.92:0/1158465006 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3364070d50 con 0x7f336412e940 2024-09-18T01:24:39.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.931+0000 7f3361d9b640 1 --2- 172.21.15.92:0/1158465006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f336412e940 0x7f3364130d30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3358009720 tx=0x7f335802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7158d71eb9c486d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:39.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.931+0000 7f336159a640 1 -- 172.21.15.92:0/1158465006 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3358037070 con 0x7f336412e940 2024-09-18T01:24:39.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.931+0000 7f336159a640 1 -- 172.21.15.92:0/1158465006 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f335802ae20 con 0x7f336412e940 2024-09-18T01:24:39.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.931+0000 7f336159a640 1 -- 172.21.15.92:0/1158465006 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3358032590 con 0x7f336412e940 2024-09-18T01:24:39.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.931+0000 7f3368b11640 1 -- 172.21.15.92:0/1158465006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f336412e940 msgr2=0x7f3364130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.931+0000 7f3368b11640 1 --2- 172.21.15.92:0/1158465006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f336412e940 0x7f3364130d30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3358009720 tx=0x7f335802a1a0 comp rx=0 tx=0).stop 2024-09-18T01:24:39.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.931+0000 7f3368b11640 1 -- 172.21.15.92:0/1158465006 shutdown_connections 2024-09-18T01:24:39.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.931+0000 7f3368b11640 1 --2- 172.21.15.92:0/1158465006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f336412e940 0x7f3364130d30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:39.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.931+0000 7f3368b11640 1 -- 172.21.15.92:0/1158465006 >> 172.21.15.92:0/1158465006 conn(0x7f336409a890 msgr2=0x7f336409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:39.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.932+0000 7f3368b11640 1 -- 172.21.15.92:0/1158465006 shutdown_connections 2024-09-18T01:24:39.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.932+0000 7f3368b11640 1 -- 172.21.15.92:0/1158465006 wait complete. 2024-09-18T01:24:39.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.932+0000 7f3368b11640 1 Processor -- start 2024-09-18T01:24:39.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.933+0000 7f3368b11640 1 -- start start 2024-09-18T01:24:39.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.933+0000 7f3368b11640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f336406eda0 0x7f3364127950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:39.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.933+0000 7f3368b11640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f336406fcd0 con 0x7f336406eda0 2024-09-18T01:24:39.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.933+0000 7f336259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f336406eda0 0x7f3364127950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:39.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.933+0000 7f336259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f336406eda0 0x7f3364127950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45174/0 (socket says 172.21.15.92:45174) 2024-09-18T01:24:39.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.933+0000 7f336259c640 1 -- 172.21.15.92:0/3337721910 learned_addr learned my addr 172.21.15.92:0/3337721910 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:39.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.933+0000 7f336259c640 1 -- 172.21.15.92:0/3337721910 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3364125d80 con 0x7f336406eda0 2024-09-18T01:24:39.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.933+0000 7f336259c640 1 --2- 172.21.15.92:0/3337721910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f336406eda0 0x7f3364127950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f335400c4a0 tx=0x7f335400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:39.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.933+0000 7f3352ffd640 1 -- 172.21.15.92:0/3337721910 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3354017070 con 0x7f336406eda0 2024-09-18T01:24:39.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.934+0000 7f3352ffd640 1 -- 172.21.15.92:0/3337721910 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3354005c10 con 0x7f336406eda0 2024-09-18T01:24:39.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.934+0000 7f3368b11640 1 -- 172.21.15.92:0/3337721910 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3364126d70 con 0x7f336406eda0 2024-09-18T01:24:39.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.934+0000 7f3352ffd640 1 -- 172.21.15.92:0/3337721910 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3354007070 con 0x7f336406eda0 2024-09-18T01:24:39.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.934+0000 7f3368b11640 1 -- 172.21.15.92:0/3337721910 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3364127e90 con 0x7f336406eda0 2024-09-18T01:24:39.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.934+0000 7f3352ffd640 1 -- 172.21.15.92:0/3337721910 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f335401a070 con 0x7f336406eda0 2024-09-18T01:24:39.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.934+0000 7f3352ffd640 1 -- 172.21.15.92:0/3337721910 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f335401cb50 con 0x7f336406eda0 2024-09-18T01:24:39.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.934+0000 7f3368b11640 1 -- 172.21.15.92:0/3337721910 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f336406f180 con 0x7f336406eda0 2024-09-18T01:24:39.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.936+0000 7f3352ffd640 1 -- 172.21.15.92:0/3337721910 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f335401c440 con 0x7f336406eda0 2024-09-18T01:24:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.992+0000 7f3368b11640 1 -- 172.21.15.92:0/3337721910 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33641255d0 con 0x7f336406eda0 2024-09-18T01:24:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.993+0000 7f3352ffd640 1 -- 172.21.15.92:0/3337721910 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f335401ce20 con 0x7f336406eda0 2024-09-18T01:24:39.994 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:39.994 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":6,"fsid":"b78e7965-b05a-4410-91d0-045de6d3262c","created":"2024-09-18T01:24:38.657876+0000","modified":"2024-09-18T01:24:39.801526+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T01:24:39.801526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"682fe679-c400-4f69-a149-b79e2378d5c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ac9e21ba-ed5c-42f9-95ee-a96375bb9d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"007ace6b-0046-48e4-9135-506e415b57a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"be610877-3846-4095-9cf3-30d6ee8d0f31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T01:24:39.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.993+0000 7f3368b11640 1 -- 172.21.15.92:0/3337721910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f336406eda0 msgr2=0x7f3364127950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:39.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.993+0000 7f3368b11640 1 --2- 172.21.15.92:0/3337721910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f336406eda0 0x7f3364127950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f335400c4a0 tx=0x7f335400c960 comp rx=0 tx=0).stop 2024-09-18T01:24:39.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.993+0000 7f3368b11640 1 -- 172.21.15.92:0/3337721910 shutdown_connections 2024-09-18T01:24:39.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.993+0000 7f3368b11640 1 --2- 172.21.15.92:0/3337721910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f336406eda0 0x7f3364127950 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:39.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.993+0000 7f3368b11640 1 -- 172.21.15.92:0/3337721910 >> 172.21.15.92:0/3337721910 conn(0x7f336409a890 msgr2=0x7f3364097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:39.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.993+0000 7f3368b11640 1 -- 172.21.15.92:0/3337721910 shutdown_connections 2024-09-18T01:24:39.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:39.993+0000 7f3368b11640 1 -- 172.21.15.92:0/3337721910 wait complete. 2024-09-18T01:24:40.005 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-18T01:24:40.005 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-18T01:24:40.409 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T01:24:40.500 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.498+0000 7f49ef2d9640 1 Processor -- start 2024-09-18T01:24:40.500 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.498+0000 7f49ef2d9640 1 -- start start 2024-09-18T01:24:40.500 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.498+0000 7f49ef2d9640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f49e8094540 0x7f49e8130650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:40.501 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.498+0000 7f49ef2d9640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e8127ec0 con 0x7f49e8128310 2024-09-18T01:24:40.501 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.498+0000 7f49ef2d9640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f49e806e430 con 0x7f49e8094540 2024-09-18T01:24:40.501 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.498+0000 7f49ec874640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f49e8094540 0x7f49e8130650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:40.501 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.498+0000 7f49ed075640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f49e8128310 0x7f49e81286f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:35424/0 (socket says 172.21.15.92:35424) 2024-09-18T01:24:40.501 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.499+0000 7f49ed075640 1 -- 172.21.15.92:0/2407807667 learned_addr learned my addr 172.21.15.92:0/2407807667 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:24:40.501 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.499+0000 7f49ec874640 1 --2- 172.21.15.92:0/2407807667 >> v2:172.21.15.92:3300/0 conn(0x7f49e8094540 0x7f49e8130650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45184/0 (socket says 172.21.15.92:45184) 2024-09-18T01:24:40.501 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.499+0000 7f49ec874640 1 -- 172.21.15.92:0/2407807667 >> v1:172.21.15.92:6789/0 conn(0x7f49e8128310 legacy=0x7f49e81286f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:40.501 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.499+0000 7f49ec874640 1 -- 172.21.15.92:0/2407807667 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e8094970 con 0x7f49e8094540 2024-09-18T01:24:40.504 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.499+0000 7f49ec874640 1 --2- 172.21.15.92:0/2407807667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e8094540 0x7f49e8130650 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009720 tx=0x7f49d802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a586712da4de7c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:40.504 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.500+0000 7f49dffff640 1 -- 172.21.15.92:0/2407807667 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d8037070 con 0x7f49e8094540 2024-09-18T01:24:40.504 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.500+0000 7f49dffff640 1 -- 172.21.15.92:0/2407807667 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d802ad90 con 0x7f49e8094540 2024-09-18T01:24:40.504 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.500+0000 7f49dffff640 1 -- 172.21.15.92:0/2407807667 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d8032590 con 0x7f49e8094540 2024-09-18T01:24:40.504 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.500+0000 7f49ef2d9640 1 -- 172.21.15.92:0/2407807667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e8094540 msgr2=0x7f49e8130650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:40.504 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.500+0000 7f49ef2d9640 1 --2- 172.21.15.92:0/2407807667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e8094540 0x7f49e8130650 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009720 tx=0x7f49d802a110 comp rx=0 tx=0).stop 2024-09-18T01:24:40.504 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.500+0000 7f49ef2d9640 1 -- 172.21.15.92:0/2407807667 shutdown_connections 2024-09-18T01:24:40.504 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.500+0000 7f49ef2d9640 1 --2- 172.21.15.92:0/2407807667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e8094540 0x7f49e8130650 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:40.504 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.500+0000 7f49ef2d9640 1 -- 172.21.15.92:0/2407807667 >> 172.21.15.92:0/2407807667 conn(0x7f49e809ac90 msgr2=0x7f49e809b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:40.504 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.500+0000 7f49ef2d9640 1 -- 172.21.15.92:0/2407807667 shutdown_connections 2024-09-18T01:24:40.504 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.500+0000 7f49ef2d9640 1 -- 172.21.15.92:0/2407807667 wait complete. 2024-09-18T01:24:40.505 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.501+0000 7f49ef2d9640 1 Processor -- start 2024-09-18T01:24:40.505 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.501+0000 7f49ef2d9640 1 -- start start 2024-09-18T01:24:40.505 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.501+0000 7f49ef2d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e8094540 0x7f49e8126080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:40.505 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.501+0000 7f49ef2d9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f49e8130d10 con 0x7f49e8094540 2024-09-18T01:24:40.505 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.501+0000 7f49ed075640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e8094540 0x7f49e8126080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:40.505 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.501+0000 7f49ed075640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e8094540 0x7f49e8126080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45200/0 (socket says 172.21.15.92:45200) 2024-09-18T01:24:40.505 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.501+0000 7f49ed075640 1 -- 172.21.15.92:0/2940181232 learned_addr learned my addr 172.21.15.92:0/2940181232 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:40.505 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.502+0000 7f49ed075640 1 -- 172.21.15.92:0/2940181232 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e8129950 con 0x7f49e8094540 2024-09-18T01:24:40.505 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.502+0000 7f49ed075640 1 --2- 172.21.15.92:0/2940181232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e8094540 0x7f49e8126080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f49e400c4a0 tx=0x7f49e400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:40.505 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.502+0000 7f49ddffb640 1 -- 172.21.15.92:0/2940181232 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49e4017070 con 0x7f49e8094540 2024-09-18T01:24:40.505 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.502+0000 7f49ddffb640 1 -- 172.21.15.92:0/2940181232 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e4005c10 con 0x7f49e8094540 2024-09-18T01:24:40.505 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.502+0000 7f49ef2d9640 1 -- 172.21.15.92:0/2940181232 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e8072af0 con 0x7f49e8094540 2024-09-18T01:24:40.505 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.502+0000 7f49ddffb640 1 -- 172.21.15.92:0/2940181232 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49e4007070 con 0x7f49e8094540 2024-09-18T01:24:40.506 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.502+0000 7f49ddffb640 1 -- 172.21.15.92:0/2940181232 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f49e401a070 con 0x7f49e8094540 2024-09-18T01:24:40.506 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.502+0000 7f49ef2d9640 1 -- 172.21.15.92:0/2940181232 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e8129bf0 con 0x7f49e8094540 2024-09-18T01:24:40.506 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.502+0000 7f49ddffb640 1 -- 172.21.15.92:0/2940181232 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f49e4012c50 con 0x7f49e8094540 2024-09-18T01:24:40.506 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.503+0000 7f49ef2d9640 1 -- 172.21.15.92:0/2940181232 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e80733a0 con 0x7f49e8094540 2024-09-18T01:24:40.506 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.505+0000 7f49ddffb640 1 -- 172.21.15.92:0/2940181232 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f49e4021070 con 0x7f49e8094540 2024-09-18T01:24:40.563 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.561+0000 7f49ef2d9640 1 -- 172.21.15.92:0/2940181232 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49e80756c0 con 0x7f49e8094540 2024-09-18T01:24:40.563 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.562+0000 7f49ddffb640 1 -- 172.21.15.92:0/2940181232 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f49e8129950 con 0x7f49e8094540 2024-09-18T01:24:40.563 INFO:teuthology.misc.health.smithi092.stdout: 2024-09-18T01:24:40.564 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":6,"fsid":"b78e7965-b05a-4410-91d0-045de6d3262c","created":"2024-09-18T01:24:38.657876+0000","modified":"2024-09-18T01:24:39.801526+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T01:24:39.801526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"682fe679-c400-4f69-a149-b79e2378d5c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ac9e21ba-ed5c-42f9-95ee-a96375bb9d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"007ace6b-0046-48e4-9135-506e415b57a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"be610877-3846-4095-9cf3-30d6ee8d0f31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T01:24:40.564 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.562+0000 7f49ef2d9640 1 -- 172.21.15.92:0/2940181232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e8094540 msgr2=0x7f49e8126080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:40.564 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.562+0000 7f49ef2d9640 1 --2- 172.21.15.92:0/2940181232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e8094540 0x7f49e8126080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f49e400c4a0 tx=0x7f49e400c960 comp rx=0 tx=0).stop 2024-09-18T01:24:40.565 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.562+0000 7f49ef2d9640 1 -- 172.21.15.92:0/2940181232 shutdown_connections 2024-09-18T01:24:40.565 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.562+0000 7f49ef2d9640 1 --2- 172.21.15.92:0/2940181232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e8094540 0x7f49e8126080 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:40.565 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.562+0000 7f49ef2d9640 1 -- 172.21.15.92:0/2940181232 >> 172.21.15.92:0/2940181232 conn(0x7f49e809ac90 msgr2=0x7f49e8094bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:40.565 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.563+0000 7f49ef2d9640 1 -- 172.21.15.92:0/2940181232 shutdown_connections 2024-09-18T01:24:40.565 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:40.563+0000 7f49ef2d9640 1 -- 172.21.15.92:0/2940181232 wait complete. 2024-09-18T01:24:40.573 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-18T01:24:40.876 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:40.875+0000 7f73f3a1c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-18T01:24:40.928 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:40.927+0000 7f73f3a1c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-18T01:24:41.290 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:41.289+0000 7f73f3a1c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-18T01:24:41.376 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:41.375+0000 7f73f3a1c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-18T01:24:41.480 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:41.479+0000 7f73f3a1c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-18T01:24:41.494 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-18T01:24:41.493+0000 7f631540d640 -1 Falling back to public interface 2024-09-18T01:24:41.525 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:41.524+0000 7f73f3a1c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-18T01:24:41.568 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-09-18T01:24:41.567+0000 7fbf376a5640 -1 Falling back to public interface 2024-09-18T01:24:41.572 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T01:24:41.571+0000 7f0af4c0b640 -1 Falling back to public interface 2024-09-18T01:24:41.639 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:41.637+0000 7f73f3a1c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-18T01:24:41.701 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:41.700+0000 7f73f3a1c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-18T01:24:41.745 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:41.744+0000 7f73f3a1c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-18T01:24:41.854 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-09-18T01:24:41.853+0000 7faf718f1640 -1 Falling back to public interface 2024-09-18T01:24:41.857 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:41.856+0000 7f73f3a1c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-18T01:24:41.910 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:41.909+0000 7f73f3a1c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-18T01:24:41.959 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:41.958+0000 7f73f3a1c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-18T01:24:42.025 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:42.024+0000 7f73f3a1c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-18T01:24:42.068 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:42.067+0000 7f73f3a1c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-18T01:24:42.112 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:42.111+0000 7f73f3a1c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-18T01:24:42.759 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:42.758+0000 7f73f3a1c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-18T01:24:43.768 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-18T01:24:43.767+0000 7f7393709640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-18T01:24:45.391 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T01:24:45.390+0000 7f0af4c0b640 -1 osd.2 0 log_to_monitors true 2024-09-18T01:24:45.597 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-09-18T01:24:45.596+0000 7fbf376a5640 -1 osd.1 0 log_to_monitors true 2024-09-18T01:24:45.745 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-18T01:24:45.745+0000 7f631540d640 -1 osd.0 0 log_to_monitors true 2024-09-18T01:24:46.163 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-09-18T01:24:46.162+0000 7faf718f1640 -1 osd.3 0 log_to_monitors true 2024-09-18T01:24:46.976 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T01:24:47.072 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.072+0000 7f4434d31640 1 Processor -- start 2024-09-18T01:24:47.073 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.072+0000 7f4434d31640 1 -- start start 2024-09-18T01:24:47.074 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.073+0000 7f4434d31640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f443012a250 0x7f443012a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:47.074 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.073+0000 7f4434d31640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f443006be80 con 0x7f443012ab70 2024-09-18T01:24:47.074 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.073+0000 7f4434d31640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f443006c320 con 0x7f443012a250 2024-09-18T01:24:47.075 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.073+0000 7f442e59c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f443012a250 0x7f443012a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:47.075 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.073+0000 7f442e59c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f443012a250 0x7f443012a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45914/0 (socket says 172.21.15.92:45914) 2024-09-18T01:24:47.075 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.073+0000 7f442e59c640 1 -- 172.21.15.92:0/2876743804 learned_addr learned my addr 172.21.15.92:0/2876743804 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:47.075 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.073+0000 7f442e59c640 1 -- 172.21.15.92:0/2876743804 >> v1:172.21.15.92:6789/0 conn(0x7f443012ab70 legacy=0x7f4430070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:47.075 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.073+0000 7f442e59c640 1 -- 172.21.15.92:0/2876743804 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443012b000 con 0x7f443012a250 2024-09-18T01:24:47.075 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.073+0000 7f442dd9b640 1 -- 172.21.15.92:0/2876743804 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3669936671 0 0) 0x7f443006be80 con 0x7f443012ab70 2024-09-18T01:24:47.075 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.074+0000 7f442e59c640 1 --2- 172.21.15.92:0/2876743804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443012a250 0x7f443012a630 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f44200097f0 tx=0x7f442002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10058783f5f20a3e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:47.075 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.074+0000 7f442dd9b640 1 -- 172.21.15.92:0/2876743804 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4420037070 con 0x7f443012a250 2024-09-18T01:24:47.075 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.074+0000 7f442dd9b640 1 -- 172.21.15.92:0/2876743804 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4420032440 con 0x7f443012a250 2024-09-18T01:24:47.075 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.074+0000 7f442dd9b640 1 -- 172.21.15.92:0/2876743804 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f442002ae60 con 0x7f443012a250 2024-09-18T01:24:47.077 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.075+0000 7f4434d31640 1 -- 172.21.15.92:0/2876743804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443012a250 msgr2=0x7f443012a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:47.077 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.075+0000 7f4434d31640 1 --2- 172.21.15.92:0/2876743804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443012a250 0x7f443012a630 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f44200097f0 tx=0x7f442002a1e0 comp rx=0 tx=0).stop 2024-09-18T01:24:47.077 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.075+0000 7f4434d31640 1 -- 172.21.15.92:0/2876743804 shutdown_connections 2024-09-18T01:24:47.078 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.075+0000 7f4434d31640 1 --2- 172.21.15.92:0/2876743804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443012a250 0x7f443012a630 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:47.078 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.075+0000 7f4434d31640 1 -- 172.21.15.92:0/2876743804 >> 172.21.15.92:0/2876743804 conn(0x7f443009bb90 msgr2=0x7f443009d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:47.078 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.075+0000 7f4434d31640 1 -- 172.21.15.92:0/2876743804 shutdown_connections 2024-09-18T01:24:47.078 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.075+0000 7f4434d31640 1 -- 172.21.15.92:0/2876743804 wait complete. 2024-09-18T01:24:47.078 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.076+0000 7f4434d31640 1 Processor -- start 2024-09-18T01:24:47.078 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.076+0000 7f4434d31640 1 -- start start 2024-09-18T01:24:47.078 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.076+0000 7f4434d31640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443012a250 0x7f443011a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:47.078 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.076+0000 7f4434d31640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f443009dfa0 con 0x7f443012a250 2024-09-18T01:24:47.078 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.076+0000 7f442e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443012a250 0x7f443011a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:47.078 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.076+0000 7f442e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443012a250 0x7f443011a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45922/0 (socket says 172.21.15.92:45922) 2024-09-18T01:24:47.078 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.076+0000 7f442e59c640 1 -- 172.21.15.92:0/1727221886 learned_addr learned my addr 172.21.15.92:0/1727221886 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:47.078 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.077+0000 7f442e59c640 1 -- 172.21.15.92:0/1727221886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443011d060 con 0x7f443012a250 2024-09-18T01:24:47.078 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.077+0000 7f442e59c640 1 --2- 172.21.15.92:0/1727221886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443012a250 0x7f443011a520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4420035040 tx=0x7f44200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:47.079 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.077+0000 7f44277fe640 1 -- 172.21.15.92:0/1727221886 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4420037040 con 0x7f443012a250 2024-09-18T01:24:47.079 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.077+0000 7f44277fe640 1 -- 172.21.15.92:0/1727221886 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4420004030 con 0x7f443012a250 2024-09-18T01:24:47.079 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.077+0000 7f4434d31640 1 -- 172.21.15.92:0/1727221886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f443011d6d0 con 0x7f443012a250 2024-09-18T01:24:47.079 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.077+0000 7f44277fe640 1 -- 172.21.15.92:0/1727221886 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4420004330 con 0x7f443012a250 2024-09-18T01:24:47.079 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.077+0000 7f4434d31640 1 -- 172.21.15.92:0/1727221886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f443011aa60 con 0x7f443012a250 2024-09-18T01:24:47.079 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.078+0000 7f44277fe640 1 -- 172.21.15.92:0/1727221886 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) ==== 45681+0+0 (secure 0 0 0) 0x7f442003a040 con 0x7f443012a250 2024-09-18T01:24:47.080 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.078+0000 7f4434d31640 1 -- 172.21.15.92:0/1727221886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f443011be30 con 0x7f443012a250 2024-09-18T01:24:47.080 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.078+0000 7f44277fe640 1 --2- 172.21.15.92:0/1727221886 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4410038260 0x7f441003a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:47.080 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.078+0000 7f4425d9b640 1 --2- 172.21.15.92:0/1727221886 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4410038260 0x7f441003a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:47.080 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.078+0000 7f44277fe640 1 -- 172.21.15.92:0/1727221886 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1607+0+0 (secure 0 0 0) 0x7f442006b2a0 con 0x7f443012a250 2024-09-18T01:24:47.080 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.079+0000 7f4425d9b640 1 --2- 172.21.15.92:0/1727221886 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4410038260 0x7f441003a720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4418007fd0 tx=0x7f4418007900 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:47.084 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.084+0000 7f44277fe640 1 -- 172.21.15.92:0/1727221886 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f443011d060 con 0x7f443012a250 2024-09-18T01:24:47.289 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.288+0000 7f4434d31640 1 -- 172.21.15.92:0/1727221886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f443011ce40 con 0x7f443012a250 2024-09-18T01:24:47.289 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.289+0000 7f44277fe640 1 -- 172.21.15.92:0/1727221886 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7f4420042020 con 0x7f443012a250 2024-09-18T01:24:47.290 INFO:teuthology.misc.health.smithi092.stdout: 2024-09-18T01:24:47.290 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":8,"fsid":"b78e7965-b05a-4410-91d0-045de6d3262c","created":"2024-09-18T01:24:38.657876+0000","modified":"2024-09-18T01:24:46.770899+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T01:24:39.801526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"682fe679-c400-4f69-a149-b79e2378d5c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ac9e21ba-ed5c-42f9-95ee-a96375bb9d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"007ace6b-0046-48e4-9135-506e415b57a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"be610877-3846-4095-9cf3-30d6ee8d0f31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T01:24:47.292 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.292+0000 7f4434d31640 1 -- 172.21.15.92:0/1727221886 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4410038260 msgr2=0x7f441003a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:47.293 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.292+0000 7f4434d31640 1 --2- 172.21.15.92:0/1727221886 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4410038260 0x7f441003a720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4418007fd0 tx=0x7f4418007900 comp rx=0 tx=0).stop 2024-09-18T01:24:47.293 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.292+0000 7f4434d31640 1 -- 172.21.15.92:0/1727221886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443012a250 msgr2=0x7f443011a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:47.293 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.292+0000 7f4434d31640 1 --2- 172.21.15.92:0/1727221886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443012a250 0x7f443011a520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4420035040 tx=0x7f44200046c0 comp rx=0 tx=0).stop 2024-09-18T01:24:47.293 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.292+0000 7f4434d31640 1 -- 172.21.15.92:0/1727221886 shutdown_connections 2024-09-18T01:24:47.293 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.292+0000 7f4434d31640 1 --2- 172.21.15.92:0/1727221886 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4410038260 0x7f441003a720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:47.293 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.292+0000 7f4434d31640 1 --2- 172.21.15.92:0/1727221886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443012a250 0x7f443011a520 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:47.293 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.292+0000 7f4434d31640 1 -- 172.21.15.92:0/1727221886 >> 172.21.15.92:0/1727221886 conn(0x7f443009bb90 msgr2=0x7f443012b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:47.293 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.292+0000 7f4434d31640 1 -- 172.21.15.92:0/1727221886 shutdown_connections 2024-09-18T01:24:47.293 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:47.292+0000 7f4434d31640 1 -- 172.21.15.92:0/1727221886 wait complete. 2024-09-18T01:24:47.303 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-18T01:24:47.621 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-18T01:24:47.621+0000 7f6311512640 -1 osd.0 0 waiting for initial osdmap 2024-09-18T01:24:47.632 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-18T01:24:47.632+0000 7f6308b0d640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T01:24:48.158 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T01:24:48.157+0000 7f0aefcdb640 -1 osd.2 0 waiting for initial osdmap 2024-09-18T01:24:48.173 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T01:24:48.172+0000 7f0ae830d640 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T01:24:48.183 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-09-18T01:24:48.183+0000 7fbf32e11640 -1 osd.1 0 waiting for initial osdmap 2024-09-18T01:24:48.194 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-09-18T01:24:48.193+0000 7fbf2b443640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T01:24:48.640 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-09-18T01:24:48.639+0000 7faf6d05d640 -1 osd.3 0 waiting for initial osdmap 2024-09-18T01:24:48.649 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-09-18T01:24:48.648+0000 7faf6568f640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T01:24:53.706 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T01:24:53.808 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.806+0000 7f61e1637640 1 Processor -- start 2024-09-18T01:24:53.808 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.806+0000 7f61e1637640 1 -- start start 2024-09-18T01:24:53.808 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.806+0000 7f61e1637640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f61dc128310 0x7f61dc094540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:53.808 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.806+0000 7f61e1637640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61dc127ec0 con 0x7f61dc1286f0 2024-09-18T01:24:53.808 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.806+0000 7f61e1637640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f61dc06e430 con 0x7f61dc128310 2024-09-18T01:24:53.808 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.806+0000 7f61daffd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f61dc128310 0x7f61dc094540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:53.808 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.806+0000 7f61da7fc640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f61dc1286f0 0x7f61dc095d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39422/0 (socket says 172.21.15.92:39422) 2024-09-18T01:24:53.809 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.806+0000 7f61da7fc640 1 -- 172.21.15.92:0/3515125438 learned_addr learned my addr 172.21.15.92:0/3515125438 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:24:53.809 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.807+0000 7f61daffd640 1 -- 172.21.15.92:0/3515125438 >> v1:172.21.15.92:6789/0 conn(0x7f61dc1286f0 legacy=0x7f61dc095d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:53.809 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.807+0000 7f61daffd640 1 -- 172.21.15.92:0/3515125438 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc06dac0 con 0x7f61dc128310 2024-09-18T01:24:53.810 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.807+0000 7f61daffd640 1 --2- 172.21.15.92:0/3515125438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61dc128310 0x7f61dc094540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009720 tx=0x7f61cc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c771203c8c12e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:53.810 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.808+0000 7f61d9ffb640 1 -- 172.21.15.92:0/3515125438 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61cc037070 con 0x7f61dc128310 2024-09-18T01:24:53.810 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.808+0000 7f61d9ffb640 1 -- 172.21.15.92:0/3515125438 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61cc02ad90 con 0x7f61dc128310 2024-09-18T01:24:53.810 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.808+0000 7f61d9ffb640 1 -- 172.21.15.92:0/3515125438 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61cc032590 con 0x7f61dc128310 2024-09-18T01:24:53.810 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.808+0000 7f61e1637640 1 -- 172.21.15.92:0/3515125438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61dc128310 msgr2=0x7f61dc094540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:53.810 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.808+0000 7f61e1637640 1 --2- 172.21.15.92:0/3515125438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61dc128310 0x7f61dc094540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009720 tx=0x7f61cc02a110 comp rx=0 tx=0).stop 2024-09-18T01:24:53.810 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.808+0000 7f61e1637640 1 -- 172.21.15.92:0/3515125438 shutdown_connections 2024-09-18T01:24:53.811 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.808+0000 7f61e1637640 1 --2- 172.21.15.92:0/3515125438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61dc128310 0x7f61dc094540 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:53.811 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.808+0000 7f61e1637640 1 -- 172.21.15.92:0/3515125438 >> 172.21.15.92:0/3515125438 conn(0x7f61dc09ac90 msgr2=0x7f61dc09b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:53.811 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.808+0000 7f61e1637640 1 -- 172.21.15.92:0/3515125438 shutdown_connections 2024-09-18T01:24:53.811 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.808+0000 7f61e1637640 1 -- 172.21.15.92:0/3515125438 wait complete. 2024-09-18T01:24:53.813 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.809+0000 7f61e1637640 1 Processor -- start 2024-09-18T01:24:53.813 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.809+0000 7f61e1637640 1 -- start start 2024-09-18T01:24:53.813 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.810+0000 7f61e1637640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61dc128310 0x7f61dc1c1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:53.814 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.810+0000 7f61e1637640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc096410 con 0x7f61dc128310 2024-09-18T01:24:53.814 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.810+0000 7f61daffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61dc128310 0x7f61dc1c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:53.814 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.810+0000 7f61daffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61dc128310 0x7f61dc1c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46048/0 (socket says 172.21.15.92:46048) 2024-09-18T01:24:53.814 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.810+0000 7f61daffd640 1 -- 172.21.15.92:0/1197163700 learned_addr learned my addr 172.21.15.92:0/1197163700 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:53.814 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.810+0000 7f61daffd640 1 -- 172.21.15.92:0/1197163700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc130e40 con 0x7f61dc128310 2024-09-18T01:24:53.814 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.810+0000 7f61daffd640 1 --2- 172.21.15.92:0/1197163700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61dc128310 0x7f61dc1c1880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009840 tx=0x7f61cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:53.814 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.810+0000 7f61c37fe640 1 -- 172.21.15.92:0/1197163700 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61cc041070 con 0x7f61dc128310 2024-09-18T01:24:53.814 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.810+0000 7f61c37fe640 1 -- 172.21.15.92:0/1197163700 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61cc03c460 con 0x7f61dc128310 2024-09-18T01:24:53.814 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.810+0000 7f61e1637640 1 -- 172.21.15.92:0/1197163700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61dc130740 con 0x7f61dc128310 2024-09-18T01:24:53.814 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.810+0000 7f61c37fe640 1 -- 172.21.15.92:0/1197163700 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61cc037040 con 0x7f61dc128310 2024-09-18T01:24:53.814 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.810+0000 7f61e1637640 1 -- 172.21.15.92:0/1197163700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61dc1c1fa0 con 0x7f61dc128310 2024-09-18T01:24:53.814 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.811+0000 7f61c37fe640 1 -- 172.21.15.92:0/1197163700 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f61cc044070 con 0x7f61dc128310 2024-09-18T01:24:53.814 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.811+0000 7f61e1637640 1 -- 172.21.15.92:0/1197163700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61dc12ff70 con 0x7f61dc128310 2024-09-18T01:24:53.814 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.811+0000 7f61c37fe640 1 --2- 172.21.15.92:0/1197163700 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f61c80382a0 0x7f61c803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:53.815 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.811+0000 7f61c37fe640 1 -- 172.21.15.92:0/1197163700 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f61cc06b940 con 0x7f61dc128310 2024-09-18T01:24:53.815 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.812+0000 7f61da7fc640 1 --2- 172.21.15.92:0/1197163700 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f61c80382a0 0x7f61c803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:53.815 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.812+0000 7f61da7fc640 1 --2- 172.21.15.92:0/1197163700 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f61c80382a0 0x7f61c803a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f61d0007fd0 tx=0x7f61d0007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:53.818 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.816+0000 7f61c37fe640 1 -- 172.21.15.92:0/1197163700 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61dc12ff70 con 0x7f61dc128310 2024-09-18T01:24:53.986 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.984+0000 7f61e1637640 1 -- 172.21.15.92:0/1197163700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61dc096ad0 con 0x7f61dc128310 2024-09-18T01:24:53.986 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.985+0000 7f61c37fe640 1 -- 172.21.15.92:0/1197163700 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7990 (secure 0 0 0) 0x7f61cc044360 con 0x7f61dc128310 2024-09-18T01:24:53.986 INFO:teuthology.misc.health.smithi092.stdout: 2024-09-18T01:24:53.987 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":14,"fsid":"b78e7965-b05a-4410-91d0-045de6d3262c","created":"2024-09-18T01:24:38.657876+0000","modified":"2024-09-18T01:24:53.173189+0000","last_up_change":"2024-09-18T01:24:49.159870+0000","last_in_change":"2024-09-18T01:24:39.801526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T01:24:50.794525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682fe679-c400-4f69-a149-b79e2378d5c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6801","nonce":2777570747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6803","nonce":2777570747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6807","nonce":2777570747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6805","nonce":2777570747}]},"public_addr":"172.21.15.92:6801/2777570747","cluster_addr":"172.21.15.92:6803/2777570747","heartbeat_back_addr":"172.21.15.92:6807/2777570747","heartbeat_front_addr":"172.21.15.92:6805/2777570747","state":["exists","up"]},{"osd":1,"uuid":"ac9e21ba-ed5c-42f9-95ee-a96375bb9d1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6801","nonce":170575980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6803","nonce":170575980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6807","nonce":170575980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6805","nonce":170575980}]},"public_addr":"172.21.15.100:6801/170575980","cluster_addr":"172.21.15.100:6803/170575980","heartbeat_back_addr":"172.21.15.100:6807/170575980","heartbeat_front_addr":"172.21.15.100:6805/170575980","state":["exists","up"]},{"osd":2,"uuid":"007ace6b-0046-48e4-9135-506e415b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6809","nonce":3104327688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6811","nonce":3104327688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6815","nonce":3104327688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6813","nonce":3104327688}]},"public_addr":"172.21.15.100:6809/3104327688","cluster_addr":"172.21.15.100:6811/3104327688","heartbeat_back_addr":"172.21.15.100:6815/3104327688","heartbeat_front_addr":"172.21.15.100:6813/3104327688","state":["exists","up"]},{"osd":3,"uuid":"be610877-3846-4095-9cf3-30d6ee8d0f31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6817","nonce":595195757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6819","nonce":595195757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6823","nonce":595195757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6821","nonce":595195757}]},"public_addr":"172.21.15.100:6817/595195757","cluster_addr":"172.21.15.100:6819/595195757","heartbeat_back_addr":"172.21.15.100:6823/595195757","heartbeat_front_addr":"172.21.15.100:6821/595195757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:46.705981+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:46.602358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:46.419325+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:47.136084+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T01:24:53.989 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.987+0000 7f61e1637640 1 -- 172.21.15.92:0/1197163700 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f61c80382a0 msgr2=0x7f61c803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:53.989 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.987+0000 7f61e1637640 1 --2- 172.21.15.92:0/1197163700 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f61c80382a0 0x7f61c803a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f61d0007fd0 tx=0x7f61d0007ac0 comp rx=0 tx=0).stop 2024-09-18T01:24:53.989 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.987+0000 7f61e1637640 1 -- 172.21.15.92:0/1197163700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61dc128310 msgr2=0x7f61dc1c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:53.989 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.987+0000 7f61e1637640 1 --2- 172.21.15.92:0/1197163700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61dc128310 0x7f61dc1c1880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009840 tx=0x7f61cc0046c0 comp rx=0 tx=0).stop 2024-09-18T01:24:53.989 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.987+0000 7f61e1637640 1 -- 172.21.15.92:0/1197163700 shutdown_connections 2024-09-18T01:24:53.989 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.987+0000 7f61e1637640 1 --2- 172.21.15.92:0/1197163700 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f61c80382a0 0x7f61c803a760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:53.989 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.987+0000 7f61e1637640 1 --2- 172.21.15.92:0/1197163700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61dc128310 0x7f61dc1c1880 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:53.989 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.987+0000 7f61e1637640 1 -- 172.21.15.92:0/1197163700 >> 172.21.15.92:0/1197163700 conn(0x7f61dc09ac90 msgr2=0x7f61dc12b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:53.989 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.987+0000 7f61e1637640 1 -- 172.21.15.92:0/1197163700 shutdown_connections 2024-09-18T01:24:53.989 INFO:teuthology.misc.health.smithi092.stderr:2024-09-18T01:24:53.987+0000 7f61e1637640 1 -- 172.21.15.92:0/1197163700 wait complete. 2024-09-18T01:24:53.998 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-18T01:24:53.998 INFO:tasks.ceph:Creating RBD pool 2024-09-18T01:24:53.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-18T01:24:54.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.094+0000 7f0181c47640 1 Processor -- start 2024-09-18T01:24:54.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.094+0000 7f0181c47640 1 -- start start 2024-09-18T01:24:54.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.095+0000 7f0181c47640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f017c09bd50 0x7f017c09c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:54.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.095+0000 7f0181c47640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017c09d3b0 con 0x7f017c09c670 2024-09-18T01:24:54.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.095+0000 7f0181c47640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f017c098230 con 0x7f017c09bd50 2024-09-18T01:24:54.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.095+0000 7f017b7fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f017c09bd50 0x7f017c09c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:54.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.095+0000 7f017affd640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f017c09c670 0x7f017c0990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39436/0 (socket says 172.21.15.92:39436) 2024-09-18T01:24:54.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.095+0000 7f017affd640 1 -- 172.21.15.92:0/989666470 learned_addr learned my addr 172.21.15.92:0/989666470 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:24:54.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.095+0000 7f017b7fe640 1 -- 172.21.15.92:0/989666470 >> v1:172.21.15.92:6789/0 conn(0x7f017c09c670 legacy=0x7f017c0990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:54.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.095+0000 7f017b7fe640 1 -- 172.21.15.92:0/989666470 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c0983e0 con 0x7f017c09bd50 2024-09-18T01:24:54.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.096+0000 7f017b7fe640 1 --2- 172.21.15.92:0/989666470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f017c09bd50 0x7f017c09c130 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f016c009720 tx=0x7f016c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db41746cdf82dfe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:54.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.096+0000 7f017a7fc640 1 -- 172.21.15.92:0/989666470 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f016c037070 con 0x7f017c09bd50 2024-09-18T01:24:54.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.096+0000 7f017a7fc640 1 -- 172.21.15.92:0/989666470 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016c02ad90 con 0x7f017c09bd50 2024-09-18T01:24:54.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.096+0000 7f017a7fc640 1 -- 172.21.15.92:0/989666470 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f016c032590 con 0x7f017c09bd50 2024-09-18T01:24:54.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.097+0000 7f0181c47640 1 -- 172.21.15.92:0/989666470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f017c09bd50 msgr2=0x7f017c09c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:54.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.097+0000 7f0181c47640 1 --2- 172.21.15.92:0/989666470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f017c09bd50 0x7f017c09c130 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f016c009720 tx=0x7f016c02a110 comp rx=0 tx=0).stop 2024-09-18T01:24:54.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.097+0000 7f0181c47640 1 -- 172.21.15.92:0/989666470 shutdown_connections 2024-09-18T01:24:54.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.097+0000 7f0181c47640 1 --2- 172.21.15.92:0/989666470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f017c09bd50 0x7f017c09c130 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:54.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.097+0000 7f0181c47640 1 -- 172.21.15.92:0/989666470 >> 172.21.15.92:0/989666470 conn(0x7f017c06d4a0 msgr2=0x7f017c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:54.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.097+0000 7f0181c47640 1 -- 172.21.15.92:0/989666470 shutdown_connections 2024-09-18T01:24:54.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.097+0000 7f0181c47640 1 -- 172.21.15.92:0/989666470 wait complete. 2024-09-18T01:24:54.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.098+0000 7f0181c47640 1 Processor -- start 2024-09-18T01:24:54.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.098+0000 7f0181c47640 1 -- start start 2024-09-18T01:24:54.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.098+0000 7f0181c47640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f017c09bd50 0x7f017c1c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:54.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.098+0000 7f0181c47640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f017c099b90 con 0x7f017c09bd50 2024-09-18T01:24:54.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.098+0000 7f017b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f017c09bd50 0x7f017c1c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:54.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.098+0000 7f017b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f017c09bd50 0x7f017c1c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46056/0 (socket says 172.21.15.92:46056) 2024-09-18T01:24:54.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.098+0000 7f017b7fe640 1 -- 172.21.15.92:0/1551797730 learned_addr learned my addr 172.21.15.92:0/1551797730 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:54.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.099+0000 7f017b7fe640 1 -- 172.21.15.92:0/1551797730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c1b3080 con 0x7f017c09bd50 2024-09-18T01:24:54.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.099+0000 7f017b7fe640 1 --2- 172.21.15.92:0/1551797730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f017c09bd50 0x7f017c1c3900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f016c009840 tx=0x7f016c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:54.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.099+0000 7f0173fff640 1 -- 172.21.15.92:0/1551797730 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f016c041070 con 0x7f017c09bd50 2024-09-18T01:24:54.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.099+0000 7f0173fff640 1 -- 172.21.15.92:0/1551797730 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016c03c460 con 0x7f017c09bd50 2024-09-18T01:24:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.099+0000 7f0181c47640 1 -- 172.21.15.92:0/1551797730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017c1b4880 con 0x7f017c09bd50 2024-09-18T01:24:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.099+0000 7f0173fff640 1 -- 172.21.15.92:0/1551797730 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f016c037040 con 0x7f017c09bd50 2024-09-18T01:24:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.099+0000 7f0181c47640 1 -- 172.21.15.92:0/1551797730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f017c1b1a80 con 0x7f017c09bd50 2024-09-18T01:24:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.100+0000 7f0173fff640 1 -- 172.21.15.92:0/1551797730 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f016c044070 con 0x7f017c09bd50 2024-09-18T01:24:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.100+0000 7f0181c47640 1 -- 172.21.15.92:0/1551797730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f017c09a130 con 0x7f017c09bd50 2024-09-18T01:24:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.100+0000 7f0173fff640 1 --2- 172.21.15.92:0/1551797730 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f015c0382d0 0x7f015c03a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.100+0000 7f0173fff640 1 -- 172.21.15.92:0/1551797730 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f016c06bb20 con 0x7f017c09bd50 2024-09-18T01:24:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.100+0000 7f017affd640 1 --2- 172.21.15.92:0/1551797730 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f015c0382d0 0x7f015c03a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.101+0000 7f017affd640 1 --2- 172.21.15.92:0/1551797730 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f015c0382d0 0x7f015c03a790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0164007fd0 tx=0x7f0164007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:54.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.105+0000 7f0173fff640 1 -- 172.21.15.92:0/1551797730 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f017c1b3080 con 0x7f017c09bd50 2024-09-18T01:24:54.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:54.271+0000 7f0181c47640 1 -- 172.21.15.92:0/1551797730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f017c09d020 con 0x7f017c09bd50 2024-09-18T01:24:55.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.183+0000 7f0173fff640 1 -- 172.21.15.92:0/1551797730 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (secure 0 0 0) 0x7f016c044760 con 0x7f017c09bd50 2024-09-18T01:24:55.184 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'rbd' created 2024-09-18T01:24:55.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.185+0000 7f0181c47640 1 -- 172.21.15.92:0/1551797730 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f015c0382d0 msgr2=0x7f015c03a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:55.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.185+0000 7f0181c47640 1 --2- 172.21.15.92:0/1551797730 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f015c0382d0 0x7f015c03a790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0164007fd0 tx=0x7f0164007ac0 comp rx=0 tx=0).stop 2024-09-18T01:24:55.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.185+0000 7f0181c47640 1 -- 172.21.15.92:0/1551797730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f017c09bd50 msgr2=0x7f017c1c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:55.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.185+0000 7f0181c47640 1 --2- 172.21.15.92:0/1551797730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f017c09bd50 0x7f017c1c3900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f016c009840 tx=0x7f016c0046c0 comp rx=0 tx=0).stop 2024-09-18T01:24:55.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.185+0000 7f0181c47640 1 -- 172.21.15.92:0/1551797730 shutdown_connections 2024-09-18T01:24:55.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.185+0000 7f0181c47640 1 --2- 172.21.15.92:0/1551797730 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f015c0382d0 0x7f015c03a790 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:55.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.185+0000 7f0181c47640 1 --2- 172.21.15.92:0/1551797730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f017c09bd50 0x7f017c1c3900 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:55.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.185+0000 7f0181c47640 1 -- 172.21.15.92:0/1551797730 >> 172.21.15.92:0/1551797730 conn(0x7f017c06d4a0 msgr2=0x7f017c09eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:55.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.186+0000 7f0181c47640 1 -- 172.21.15.92:0/1551797730 shutdown_connections 2024-09-18T01:24:55.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.186+0000 7f0181c47640 1 -- 172.21.15.92:0/1551797730 wait complete. 2024-09-18T01:24:55.201 DEBUG:teuthology.orchestra.run.smithi092:> rbd --cluster ceph pool init rbd 2024-09-18T01:24:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:24:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:24:55.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.259+0000 7f0904143d80 1 Processor -- start 2024-09-18T01:24:55.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.259+0000 7f0904143d80 1 -- start start 2024-09-18T01:24:55.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.259+0000 7f0904143d80 1 --2- >> v2:172.21.15.92:3300/0 conn(0x564daf864ee0 0x564daf8fb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:55.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.259+0000 7f0904143d80 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x564daf6d1050 con 0x564daf8f5620 2024-09-18T01:24:55.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.259+0000 7f0904143d80 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x564daf6df930 con 0x564daf864ee0 2024-09-18T01:24:55.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.259+0000 7f08fa438640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x564daf864ee0 0x564daf8fb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:55.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.259+0000 7f0902c39640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x564daf8f5620 0x564daf8f5a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39450/0 (socket says 172.21.15.92:39450) 2024-09-18T01:24:55.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.259+0000 7f0902c39640 1 -- 172.21.15.92:0/770391916 learned_addr learned my addr 172.21.15.92:0/770391916 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:24:55.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.260+0000 7f08fa438640 1 -- 172.21.15.92:0/770391916 >> v1:172.21.15.92:6789/0 conn(0x564daf8f5620 legacy=0x564daf8f5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:55.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.260+0000 7f08fa438640 1 -- 172.21.15.92:0/770391916 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564daf6bace0 con 0x564daf864ee0 2024-09-18T01:24:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.261+0000 7f08fa438640 1 --2- 172.21.15.92:0/770391916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564daf864ee0 0x564daf8fb670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00a470 tx=0x7f08ec045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c169b019fdad8c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.262+0000 7f0902438640 1 -- 172.21.15.92:0/770391916 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08ec053570 con 0x564daf864ee0 2024-09-18T01:24:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.262+0000 7f0902438640 1 -- 172.21.15.92:0/770391916 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08ec058070 con 0x564daf864ee0 2024-09-18T01:24:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.262+0000 7f0902438640 1 -- 172.21.15.92:0/770391916 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08ec053880 con 0x564daf864ee0 2024-09-18T01:24:55.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.262+0000 7f0904143d80 1 -- 172.21.15.92:0/770391916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564daf864ee0 msgr2=0x564daf8fb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:55.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.262+0000 7f0904143d80 1 --2- 172.21.15.92:0/770391916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564daf864ee0 0x564daf8fb670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00a470 tx=0x7f08ec045a20 comp rx=0 tx=0).stop 2024-09-18T01:24:55.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.262+0000 7f0904143d80 1 -- 172.21.15.92:0/770391916 shutdown_connections 2024-09-18T01:24:55.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.262+0000 7f0904143d80 1 --2- 172.21.15.92:0/770391916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564daf864ee0 0x564daf8fb670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:55.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.262+0000 7f0904143d80 1 -- 172.21.15.92:0/770391916 >> 172.21.15.92:0/770391916 conn(0x564daf865ce0 msgr2=0x564daf863520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:55.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.262+0000 7f0904143d80 1 -- 172.21.15.92:0/770391916 shutdown_connections 2024-09-18T01:24:55.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.262+0000 7f0904143d80 1 -- 172.21.15.92:0/770391916 wait complete. 2024-09-18T01:24:55.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.263+0000 7f0904143d80 1 Processor -- start 2024-09-18T01:24:55.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.263+0000 7f0904143d80 1 -- start start 2024-09-18T01:24:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.263+0000 7f0904143d80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564daf864ee0 0x564daf8e3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.263+0000 7f0904143d80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564daf6e1540 con 0x564daf864ee0 2024-09-18T01:24:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.264+0000 7f0902c39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564daf864ee0 0x564daf8e3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.264+0000 7f0902c39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564daf864ee0 0x564daf8e3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46080/0 (socket says 172.21.15.92:46080) 2024-09-18T01:24:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.264+0000 7f0902c39640 1 -- 172.21.15.92:0/1323691149 learned_addr learned my addr 172.21.15.92:0/1323691149 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.264+0000 7f0902c39640 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564daf8e4f80 con 0x564daf864ee0 2024-09-18T01:24:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.264+0000 7f0902c39640 1 --2- 172.21.15.92:0/1323691149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564daf864ee0 0x564daf8e3450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08f400bbb0 tx=0x7f08f4009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.264+0000 7f08fb7fe640 1 -- 172.21.15.92:0/1323691149 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08f4012070 con 0x564daf864ee0 2024-09-18T01:24:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.264+0000 7f08fb7fe640 1 -- 172.21.15.92:0/1323691149 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f400e470 con 0x564daf864ee0 2024-09-18T01:24:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.264+0000 7f0904143d80 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564daf8e60b0 con 0x564daf864ee0 2024-09-18T01:24:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.264+0000 7f08fb7fe640 1 -- 172.21.15.92:0/1323691149 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08f400e750 con 0x564daf864ee0 2024-09-18T01:24:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.264+0000 7f0904143d80 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564daf8f3ff0 con 0x564daf864ee0 2024-09-18T01:24:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.265+0000 7f08fb7fe640 1 -- 172.21.15.92:0/1323691149 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f08f4015070 con 0x564daf864ee0 2024-09-18T01:24:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.265+0000 7f08fb7fe640 1 --2- 172.21.15.92:0/1323691149 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f08e4036b40 0x7f08e4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.265+0000 7f08fb7fe640 1 -- 172.21.15.92:0/1323691149 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3471+0+0 (secure 0 0 0) 0x7f08f4049f90 con 0x564daf864ee0 2024-09-18T01:24:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.265+0000 7f0904143d80 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x564daf8e3cc0 con 0x564daf864ee0 2024-09-18T01:24:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.266+0000 7f08fa438640 1 --2- 172.21.15.92:0/1323691149 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f08e4036b40 0x7f08e4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:55.266+0000 7f08fa438640 1 --2- 172.21.15.92:0/1323691149 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f08e4036b40 0x7f08e4039000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f08ec057000 tx=0x7f08ec052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:56.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.184+0000 7f08fb7fe640 1 -- 172.21.15.92:0/1323691149 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 141+0+0 (secure 0 0 0) 0x7f08f400d750 con 0x564daf864ee0 2024-09-18T01:24:56.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.184+0000 7f0904143d80 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f08ec058070 con 0x564daf864ee0 2024-09-18T01:24:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.186+0000 7f08fb7fe640 1 -- 172.21.15.92:0/1323691149 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f08f400d3d0 con 0x564daf864ee0 2024-09-18T01:24:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.186+0000 7f0901c37640 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f08e8002ae0 con 0x564daf864ee0 2024-09-18T01:24:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.186+0000 7f08fb7fe640 1 -- 172.21.15.92:0/1323691149 <== mon.0 v2:172.21.15.92:3300/0 8 ==== osd_map(16..16 src has 1..16) ==== 650+0+0 (secure 0 0 0) 0x7f08f4037e00 con 0x564daf864ee0 2024-09-18T01:24:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.187+0000 7f0904143d80 1 --2- 172.21.15.92:0/1323691149 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564daf8f5620 0x564daf909af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.187+0000 7f0904143d80 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x564daf90a030 con 0x564daf8f5620 2024-09-18T01:24:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.187+0000 7f0903e9b640 1 --2- 172.21.15.92:0/1323691149 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564daf8f5620 0x564daf909af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:56.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.188+0000 7f0903e9b640 1 --2- 172.21.15.92:0/1323691149 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564daf8f5620 0x564daf909af0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:56.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.195+0000 7f0903e9b640 1 -- 172.21.15.92:0/1323691149 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(1 rbd_trash [create] v16'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f08fc002040 con 0x564daf8f5620 2024-09-18T01:24:56.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.198+0000 7f0904143d80 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x564daf95b830 con 0x564daf8f5620 2024-09-18T01:24:56.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.198+0000 7f0903e9b640 1 -- 172.21.15.92:0/1323691149 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f08fc002040 con 0x564daf8f5620 2024-09-18T01:24:56.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.198+0000 7f0904143d80 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x564daf95a940 con 0x564daf8f5620 2024-09-18T01:24:56.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.199+0000 7f0903e9b640 1 -- 172.21.15.92:0/1323691149 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f08fc002040 con 0x564daf8f5620 2024-09-18T01:24:56.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:56.199+0000 7f0901436640 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f08dc001f00 con 0x564daf864ee0 2024-09-18T01:24:57.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:57.191+0000 7f08fb7fe640 1 -- 172.21.15.92:0/1323691149 <== mon.0 v2:172.21.15.92:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v17) ==== 55+0+0 (secure 0 0 0) 0x7f08f40163b0 con 0x564daf864ee0 2024-09-18T01:24:57.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:57.191+0000 7f08fb7fe640 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f08e403c6f0 con 0x564daf864ee0 2024-09-18T01:24:57.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:57.191+0000 7f08fb7fe640 1 -- 172.21.15.92:0/1323691149 <== mon.0 v2:172.21.15.92:3300/0 10 ==== osd_map(17..17 src has 1..17) ==== 626+0+0 (secure 0 0 0) 0x7f08f4016b50 con 0x564daf864ee0 2024-09-18T01:24:57.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:57.192+0000 7f0901c37640 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f08e80056e0 con 0x564daf8f5620 2024-09-18T01:24:57.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:57.195+0000 7f0903e9b640 1 -- 172.21.15.92:0/1323691149 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v17'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f08fc002040 con 0x564daf8f5620 2024-09-18T01:24:57.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:57.195+0000 7f0901436640 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v17) -- 0x7f08dc003350 con 0x564daf864ee0 2024-09-18T01:24:58.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.194+0000 7f08fb7fe640 1 -- 172.21.15.92:0/1323691149 <== mon.0 v2:172.21.15.92:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v18) ==== 43+0+0 (secure 0 0 0) 0x7f08f4016d50 con 0x564daf864ee0 2024-09-18T01:24:58.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.194+0000 7f08fb7fe640 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=18}) -- 0x7f08e403c970 con 0x564daf864ee0 2024-09-18T01:24:58.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.194+0000 7f08fb7fe640 1 -- 172.21.15.92:0/1323691149 <== mon.0 v2:172.21.15.92:3300/0 12 ==== osd_map(18..18 src has 1..18) ==== 654+0+0 (secure 0 0 0) 0x7f08f400ecf0 con 0x564daf864ee0 2024-09-18T01:24:58.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.194+0000 7f0901c37640 1 -- 172.21.15.92:0/1323691149 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f08e8005a80 con 0x564daf8f5620 2024-09-18T01:24:58.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.197+0000 7f0903e9b640 1 -- 172.21.15.92:0/1323691149 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(7 rbd_info [write 0~19] v18'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08fc002040 con 0x564daf8f5620 2024-09-18T01:24:58.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.198+0000 7f0904143d80 1 -- 172.21.15.92:0/1323691149 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564daf8f5620 msgr2=0x564daf909af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:58.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.198+0000 7f0904143d80 1 --2- 172.21.15.92:0/1323691149 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564daf8f5620 0x564daf909af0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:58.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.198+0000 7f0904143d80 1 -- 172.21.15.92:0/1323691149 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f08e4036b40 msgr2=0x7f08e4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:58.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.198+0000 7f0904143d80 1 --2- 172.21.15.92:0/1323691149 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f08e4036b40 0x7f08e4039000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f08ec057000 tx=0x7f08ec052000 comp rx=0 tx=0).stop 2024-09-18T01:24:58.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.198+0000 7f0904143d80 1 -- 172.21.15.92:0/1323691149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564daf864ee0 msgr2=0x564daf8e3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:58.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.198+0000 7f0904143d80 1 --2- 172.21.15.92:0/1323691149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564daf864ee0 0x564daf8e3450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08f400bbb0 tx=0x7f08f4009640 comp rx=0 tx=0).stop 2024-09-18T01:24:58.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.198+0000 7f0904143d80 1 -- 172.21.15.92:0/1323691149 shutdown_connections 2024-09-18T01:24:58.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.198+0000 7f0904143d80 1 --2- 172.21.15.92:0/1323691149 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564daf8f5620 0x564daf909af0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:58.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.198+0000 7f0904143d80 1 --2- 172.21.15.92:0/1323691149 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f08e4036b40 0x7f08e4039000 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:58.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.198+0000 7f0904143d80 1 --2- 172.21.15.92:0/1323691149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564daf864ee0 0x564daf8e3450 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:58.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.198+0000 7f0904143d80 1 -- 172.21.15.92:0/1323691149 >> 172.21.15.92:0/1323691149 conn(0x564daf865ce0 msgr2=0x564daf866a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:58.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.198+0000 7f0904143d80 1 -- 172.21.15.92:0/1323691149 shutdown_connections 2024-09-18T01:24:58.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.198+0000 7f0904143d80 1 -- 172.21.15.92:0/1323691149 wait complete. 2024-09-18T01:24:58.213 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-18T01:24:58.213 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-18T01:24:58.213 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-18T01:24:58.214 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-18T01:24:58.214 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-18T01:24:58.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.320+0000 7f0d3b3b9640 1 Processor -- start 2024-09-18T01:24:58.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.320+0000 7f0d3b3b9640 1 -- start start 2024-09-18T01:24:58.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.321+0000 7f0d3b3b9640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0d3412f9d0 0x7f0d34131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:58.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.321+0000 7f0d3b3b9640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d34071f70 con 0x7f0d3412cca0 2024-09-18T01:24:58.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.321+0000 7f0d3b3b9640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0d3406e350 con 0x7f0d3412f9d0 2024-09-18T01:24:58.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.321+0000 7f0d38954640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0d3412f9d0 0x7f0d34131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:58.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.321+0000 7f0d38954640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0d3412f9d0 0x7f0d34131dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46086/0 (socket says 172.21.15.92:46086) 2024-09-18T01:24:58.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.321+0000 7f0d39155640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0d3412cca0 0x7f0d3412d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39454/0 (socket says 172.21.15.92:39454) 2024-09-18T01:24:58.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.321+0000 7f0d38954640 1 -- 172.21.15.92:0/3623452022 learned_addr learned my addr 172.21.15.92:0/3623452022 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:58.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.321+0000 7f0d38954640 1 -- 172.21.15.92:0/3623452022 >> v1:172.21.15.92:6789/0 conn(0x7f0d3412cca0 legacy=0x7f0d3412d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:58.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.321+0000 7f0d38954640 1 -- 172.21.15.92:0/3623452022 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d340715c0 con 0x7f0d3412f9d0 2024-09-18T01:24:58.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.322+0000 7f0d38954640 1 --2- 172.21.15.92:0/3623452022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d3412f9d0 0x7f0d34131dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0d240097f0 tx=0x7f0d2402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28db632e132be281 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:58.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.322+0000 7f0d2bfff640 1 -- 172.21.15.92:0/3623452022 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d24037070 con 0x7f0d3412f9d0 2024-09-18T01:24:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.322+0000 7f0d2bfff640 1 -- 172.21.15.92:0/3623452022 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d24032440 con 0x7f0d3412f9d0 2024-09-18T01:24:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.322+0000 7f0d2bfff640 1 -- 172.21.15.92:0/3623452022 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2402ae60 con 0x7f0d3412f9d0 2024-09-18T01:24:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.322+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/3623452022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d3412f9d0 msgr2=0x7f0d34131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.322+0000 7f0d3b3b9640 1 --2- 172.21.15.92:0/3623452022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d3412f9d0 0x7f0d34131dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0d240097f0 tx=0x7f0d2402a1e0 comp rx=0 tx=0).stop 2024-09-18T01:24:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.322+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/3623452022 shutdown_connections 2024-09-18T01:24:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.322+0000 7f0d3b3b9640 1 --2- 172.21.15.92:0/3623452022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d3412f9d0 0x7f0d34131dc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.322+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/3623452022 >> 172.21.15.92:0/3623452022 conn(0x7f0d3409a890 msgr2=0x7f0d3409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.322+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/3623452022 shutdown_connections 2024-09-18T01:24:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.323+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/3623452022 wait complete. 2024-09-18T01:24:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.323+0000 7f0d3b3b9640 1 Processor -- start 2024-09-18T01:24:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.323+0000 7f0d3b3b9640 1 -- start start 2024-09-18T01:24:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.324+0000 7f0d3b3b9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d3412cca0 0x7f0d341258b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.324+0000 7f0d3b3b9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3412ca50 con 0x7f0d3412cca0 2024-09-18T01:24:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.324+0000 7f0d39155640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d3412cca0 0x7f0d341258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.324+0000 7f0d39155640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d3412cca0 0x7f0d341258b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46092/0 (socket says 172.21.15.92:46092) 2024-09-18T01:24:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.324+0000 7f0d39155640 1 -- 172.21.15.92:0/2641181724 learned_addr learned my addr 172.21.15.92:0/2641181724 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.324+0000 7f0d39155640 1 -- 172.21.15.92:0/2641181724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d34123af0 con 0x7f0d3412cca0 2024-09-18T01:24:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.324+0000 7f0d39155640 1 --2- 172.21.15.92:0/2641181724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d3412cca0 0x7f0d341258b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000c720 tx=0x7f0d3000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.324+0000 7f0d29ffb640 1 -- 172.21.15.92:0/2641181724 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d30017070 con 0x7f0d3412cca0 2024-09-18T01:24:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.324+0000 7f0d29ffb640 1 -- 172.21.15.92:0/2641181724 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d30005da0 con 0x7f0d3412cca0 2024-09-18T01:24:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.324+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/2641181724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d34126db0 con 0x7f0d3412cca0 2024-09-18T01:24:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.324+0000 7f0d29ffb640 1 -- 172.21.15.92:0/2641181724 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3000a790 con 0x7f0d3412cca0 2024-09-18T01:24:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.325+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/2641181724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d34125df0 con 0x7f0d3412cca0 2024-09-18T01:24:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.325+0000 7f0d29ffb640 1 -- 172.21.15.92:0/2641181724 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0d3001a070 con 0x7f0d3412cca0 2024-09-18T01:24:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.325+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/2641181724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d34073120 con 0x7f0d3412cca0 2024-09-18T01:24:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.325+0000 7f0d29ffb640 1 --2- 172.21.15.92:0/2641181724 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0d180382a0 0x7f0d1803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.326+0000 7f0d29ffb640 1 -- 172.21.15.92:0/2641181724 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f0d3004a740 con 0x7f0d3412cca0 2024-09-18T01:24:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.326+0000 7f0d38954640 1 --2- 172.21.15.92:0/2641181724 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0d180382a0 0x7f0d1803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.326+0000 7f0d38954640 1 --2- 172.21.15.92:0/2641181724 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0d180382a0 0x7f0d1803a760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0d240097f0 tx=0x7f0d2402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:58.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.330+0000 7f0d29ffb640 1 -- 172.21.15.92:0/2641181724 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d34073120 con 0x7f0d3412cca0 2024-09-18T01:24:58.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.538+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/2641181724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0d3412d080 con 0x7f0d3412cca0 2024-09-18T01:24:58.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.540+0000 7f0d29ffb640 1 -- 172.21.15.92:0/2641181724 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87489 (secure 0 0 0) 0x7f0d3000a930 con 0x7f0d3412cca0 2024-09-18T01:24:58.542 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.542+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/2641181724 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0d180382a0 msgr2=0x7f0d1803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.542+0000 7f0d3b3b9640 1 --2- 172.21.15.92:0/2641181724 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0d180382a0 0x7f0d1803a760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0d240097f0 tx=0x7f0d2402e000 comp rx=0 tx=0).stop 2024-09-18T01:24:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.542+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/2641181724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d3412cca0 msgr2=0x7f0d341258b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.542+0000 7f0d3b3b9640 1 --2- 172.21.15.92:0/2641181724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d3412cca0 0x7f0d341258b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000c720 tx=0x7f0d3000cbe0 comp rx=0 tx=0).stop 2024-09-18T01:24:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.542+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/2641181724 shutdown_connections 2024-09-18T01:24:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.542+0000 7f0d3b3b9640 1 --2- 172.21.15.92:0/2641181724 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0d180382a0 0x7f0d1803a760 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.542+0000 7f0d3b3b9640 1 --2- 172.21.15.92:0/2641181724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d3412cca0 0x7f0d341258b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.542+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/2641181724 >> 172.21.15.92:0/2641181724 conn(0x7f0d3409a890 msgr2=0x7f0d34097ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.542+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/2641181724 shutdown_connections 2024-09-18T01:24:58.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.542+0000 7f0d3b3b9640 1 -- 172.21.15.92:0/2641181724 wait complete. 2024-09-18T01:24:58.554 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2336055460},{"type":"v1","addr":"172.21.15.100:6825","nonce":2336055460}]},"active_addr":"172.21.15.100:6825/2336055460","active_change":"2024-09-18T01:24:42.760829+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":885415177}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3123525736}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":2558707819}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":4104309710}]}]} 2024-09-18T01:24:58.556 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-18T01:24:58.556 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-18T01:24:58.556 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T01:24:58.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.652+0000 7fcb77baf640 1 Processor -- start 2024-09-18T01:24:58.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.652+0000 7fcb77baf640 1 -- start start 2024-09-18T01:24:58.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.653+0000 7fcb77baf640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcb7009a100 0x7fcb70133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:58.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.653+0000 7fcb77baf640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb7009d3b0 con 0x7fcb7009bd50 2024-09-18T01:24:58.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.653+0000 7fcb77baf640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fcb7009c840 con 0x7fcb7009a100 2024-09-18T01:24:58.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.653+0000 7fcb7514a640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcb7009a100 0x7fcb70133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:58.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.653+0000 7fcb7594b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fcb7009bd50 0x7fcb7009c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39470/0 (socket says 172.21.15.92:39470) 2024-09-18T01:24:58.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.653+0000 7fcb7594b640 1 -- 172.21.15.92:0/2057579902 learned_addr learned my addr 172.21.15.92:0/2057579902 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:24:58.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.653+0000 7fcb7514a640 1 -- 172.21.15.92:0/2057579902 >> v1:172.21.15.92:6789/0 conn(0x7fcb7009bd50 legacy=0x7fcb7009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:58.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.653+0000 7fcb74949640 1 -- 172.21.15.92:0/2057579902 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3170905648 0 0) 0x7fcb64001110 con 0x7fcb7009bd50 2024-09-18T01:24:58.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.653+0000 7fcb7514a640 1 -- 172.21.15.92:0/2057579902 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb70098230 con 0x7fcb7009a100 2024-09-18T01:24:58.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.654+0000 7fcb7514a640 1 --2- 172.21.15.92:0/2057579902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb7009a100 0x7fcb70133da0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009720 tx=0x7fcb6c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f322f666ac3578a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:58.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.654+0000 7fcb74949640 1 -- 172.21.15.92:0/2057579902 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb6c037070 con 0x7fcb7009a100 2024-09-18T01:24:58.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.654+0000 7fcb74949640 1 -- 172.21.15.92:0/2057579902 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6c02ad90 con 0x7fcb7009a100 2024-09-18T01:24:58.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.654+0000 7fcb74949640 1 -- 172.21.15.92:0/2057579902 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb6c032590 con 0x7fcb7009a100 2024-09-18T01:24:58.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.655+0000 7fcb77baf640 1 -- 172.21.15.92:0/2057579902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb7009a100 msgr2=0x7fcb70133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:58.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.655+0000 7fcb77baf640 1 --2- 172.21.15.92:0/2057579902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb7009a100 0x7fcb70133da0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009720 tx=0x7fcb6c02a110 comp rx=0 tx=0).stop 2024-09-18T01:24:58.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.655+0000 7fcb77baf640 1 -- 172.21.15.92:0/2057579902 shutdown_connections 2024-09-18T01:24:58.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.655+0000 7fcb77baf640 1 --2- 172.21.15.92:0/2057579902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb7009a100 0x7fcb70133da0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:58.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.655+0000 7fcb77baf640 1 -- 172.21.15.92:0/2057579902 >> 172.21.15.92:0/2057579902 conn(0x7fcb7006d4a0 msgr2=0x7fcb7006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:58.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.655+0000 7fcb77baf640 1 -- 172.21.15.92:0/2057579902 shutdown_connections 2024-09-18T01:24:58.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.655+0000 7fcb77baf640 1 -- 172.21.15.92:0/2057579902 wait complete. 2024-09-18T01:24:58.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.655+0000 7fcb77baf640 1 Processor -- start 2024-09-18T01:24:58.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.655+0000 7fcb77baf640 1 -- start start 2024-09-18T01:24:58.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.656+0000 7fcb77baf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb7009a100 0x7fcb70132a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:58.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.656+0000 7fcb77baf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcb70134670 con 0x7fcb7009a100 2024-09-18T01:24:58.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.656+0000 7fcb7594b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb7009a100 0x7fcb70132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:58.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.656+0000 7fcb7594b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb7009a100 0x7fcb70132a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46108/0 (socket says 172.21.15.92:46108) 2024-09-18T01:24:58.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.656+0000 7fcb7594b640 1 -- 172.21.15.92:0/3228736595 learned_addr learned my addr 172.21.15.92:0/3228736595 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:58.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.656+0000 7fcb7594b640 1 -- 172.21.15.92:0/3228736595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb70125fc0 con 0x7fcb7009a100 2024-09-18T01:24:58.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.656+0000 7fcb7594b640 1 --2- 172.21.15.92:0/3228736595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb7009a100 0x7fcb70132a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c700 tx=0x7fcb6400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:58.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.656+0000 7fcb627fc640 1 -- 172.21.15.92:0/3228736595 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb64018070 con 0x7fcb7009a100 2024-09-18T01:24:58.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.656+0000 7fcb627fc640 1 -- 172.21.15.92:0/3228736595 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb640070d0 con 0x7fcb7009a100 2024-09-18T01:24:58.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.656+0000 7fcb627fc640 1 -- 172.21.15.92:0/3228736595 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb640073f0 con 0x7fcb7009a100 2024-09-18T01:24:58.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.656+0000 7fcb77baf640 1 -- 172.21.15.92:0/3228736595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb70096570 con 0x7fcb7009a100 2024-09-18T01:24:58.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.656+0000 7fcb77baf640 1 -- 172.21.15.92:0/3228736595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb70096f80 con 0x7fcb7009a100 2024-09-18T01:24:58.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.657+0000 7fcb627fc640 1 -- 172.21.15.92:0/3228736595 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcb6401b070 con 0x7fcb7009a100 2024-09-18T01:24:58.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.657+0000 7fcb77baf640 1 -- 172.21.15.92:0/3228736595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb70126360 con 0x7fcb7009a100 2024-09-18T01:24:58.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.657+0000 7fcb627fc640 1 --2- 172.21.15.92:0/3228736595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcb540382a0 0x7fcb5403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:58.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.657+0000 7fcb627fc640 1 -- 172.21.15.92:0/3228736595 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fcb6404a600 con 0x7fcb7009a100 2024-09-18T01:24:58.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.658+0000 7fcb7514a640 1 --2- 172.21.15.92:0/3228736595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcb540382a0 0x7fcb5403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:58.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.658+0000 7fcb7514a640 1 --2- 172.21.15.92:0/3228736595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcb540382a0 0x7fcb5403a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c034000 tx=0x7fcb6c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:58.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.662+0000 7fcb627fc640 1 -- 172.21.15.92:0/3228736595 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb70125fc0 con 0x7fcb7009a100 2024-09-18T01:24:58.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.832+0000 7fcb77baf640 1 -- 172.21.15.92:0/3228736595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb7009d020 con 0x7fcb7009a100 2024-09-18T01:24:58.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.832+0000 7fcb627fc640 1 -- 172.21.15.92:0/3228736595 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9890 (secure 0 0 0) 0x7fcb7009d3b0 con 0x7fcb7009a100 2024-09-18T01:24:58.834 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:58.834 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":18,"fsid":"b78e7965-b05a-4410-91d0-045de6d3262c","created":"2024-09-18T01:24:38.657876+0000","modified":"2024-09-18T01:24:58.191395+0000","last_up_change":"2024-09-18T01:24:49.159870+0000","last_in_change":"2024-09-18T01:24:39.801526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T01:24:50.794525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T01:24:54.289682+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682fe679-c400-4f69-a149-b79e2378d5c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6801","nonce":2777570747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6803","nonce":2777570747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6807","nonce":2777570747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6805","nonce":2777570747}]},"public_addr":"172.21.15.92:6801/2777570747","cluster_addr":"172.21.15.92:6803/2777570747","heartbeat_back_addr":"172.21.15.92:6807/2777570747","heartbeat_front_addr":"172.21.15.92:6805/2777570747","state":["exists","up"]},{"osd":1,"uuid":"ac9e21ba-ed5c-42f9-95ee-a96375bb9d1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6801","nonce":170575980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6803","nonce":170575980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6807","nonce":170575980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6805","nonce":170575980}]},"public_addr":"172.21.15.100:6801/170575980","cluster_addr":"172.21.15.100:6803/170575980","heartbeat_back_addr":"172.21.15.100:6807/170575980","heartbeat_front_addr":"172.21.15.100:6805/170575980","state":["exists","up"]},{"osd":2,"uuid":"007ace6b-0046-48e4-9135-506e415b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6809","nonce":3104327688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6811","nonce":3104327688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6815","nonce":3104327688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6813","nonce":3104327688}]},"public_addr":"172.21.15.100:6809/3104327688","cluster_addr":"172.21.15.100:6811/3104327688","heartbeat_back_addr":"172.21.15.100:6815/3104327688","heartbeat_front_addr":"172.21.15.100:6813/3104327688","state":["exists","up"]},{"osd":3,"uuid":"be610877-3846-4095-9cf3-30d6ee8d0f31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6817","nonce":595195757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6819","nonce":595195757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6823","nonce":595195757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6821","nonce":595195757}]},"public_addr":"172.21.15.100:6817/595195757","cluster_addr":"172.21.15.100:6819/595195757","heartbeat_back_addr":"172.21.15.100:6823/595195757","heartbeat_front_addr":"172.21.15.100:6821/595195757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:46.705981+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:46.602358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:46.419325+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:47.136084+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T01:24:58.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.834+0000 7fcb77baf640 1 -- 172.21.15.92:0/3228736595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcb540382a0 msgr2=0x7fcb5403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:58.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.834+0000 7fcb77baf640 1 --2- 172.21.15.92:0/3228736595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcb540382a0 0x7fcb5403a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c034000 tx=0x7fcb6c02e000 comp rx=0 tx=0).stop 2024-09-18T01:24:58.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.834+0000 7fcb77baf640 1 -- 172.21.15.92:0/3228736595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb7009a100 msgr2=0x7fcb70132a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:58.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.834+0000 7fcb77baf640 1 --2- 172.21.15.92:0/3228736595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb7009a100 0x7fcb70132a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c700 tx=0x7fcb6400cbc0 comp rx=0 tx=0).stop 2024-09-18T01:24:58.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.834+0000 7fcb77baf640 1 -- 172.21.15.92:0/3228736595 shutdown_connections 2024-09-18T01:24:58.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.834+0000 7fcb77baf640 1 --2- 172.21.15.92:0/3228736595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcb540382a0 0x7fcb5403a760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:58.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.834+0000 7fcb77baf640 1 --2- 172.21.15.92:0/3228736595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb7009a100 0x7fcb70132a40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.834+0000 7fcb77baf640 1 -- 172.21.15.92:0/3228736595 >> 172.21.15.92:0/3228736595 conn(0x7fcb7006d4a0 msgr2=0x7fcb7008d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.834+0000 7fcb77baf640 1 -- 172.21.15.92:0/3228736595 shutdown_connections 2024-09-18T01:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.834+0000 7fcb77baf640 1 -- 172.21.15.92:0/3228736595 wait complete. 2024-09-18T01:24:58.846 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-18T01:24:58.846 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T01:24:58.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.942+0000 7f7fde9bd640 1 Processor -- start 2024-09-18T01:24:58.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.942+0000 7f7fde9bd640 1 -- start start 2024-09-18T01:24:58.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.942+0000 7f7fde9bd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7fd8096a10 0x7f7fd806e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:58.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.942+0000 7f7fde9bd640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd80702f0 con 0x7f7fd8096630 2024-09-18T01:24:58.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.942+0000 7f7fde9bd640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f7fd8096e20 con 0x7f7fd8096a10 2024-09-18T01:24:58.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.942+0000 7f7fd77fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7fd8096a10 0x7f7fd806e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:58.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.942+0000 7f7fd7fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f7fd8096630 0x7f7fd806d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39472/0 (socket says 172.21.15.92:39472) 2024-09-18T01:24:58.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.942+0000 7f7fd7fff640 1 -- 172.21.15.92:0/1511167451 learned_addr learned my addr 172.21.15.92:0/1511167451 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:24:58.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.943+0000 7f7fd77fe640 1 -- 172.21.15.92:0/1511167451 >> v1:172.21.15.92:6789/0 conn(0x7f7fd8096630 legacy=0x7f7fd806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:58.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.943+0000 7f7fd6ffd640 1 -- 172.21.15.92:0/1511167451 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3724006237 0 0) 0x7f7fd80702f0 con 0x7f7fd8096630 2024-09-18T01:24:58.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.943+0000 7f7fd77fe640 1 -- 172.21.15.92:0/1511167451 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd806f1f0 con 0x7f7fd8096a10 2024-09-18T01:24:58.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.943+0000 7f7fd77fe640 1 --2- 172.21.15.92:0/1511167451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd8096a10 0x7f7fd806e020 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009720 tx=0x7f7fc002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f69af8409859ad server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:58.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.943+0000 7f7fd6ffd640 1 -- 172.21.15.92:0/1511167451 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc0037070 con 0x7f7fd8096a10 2024-09-18T01:24:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.943+0000 7f7fd6ffd640 1 -- 172.21.15.92:0/1511167451 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc002ad90 con 0x7f7fd8096a10 2024-09-18T01:24:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.943+0000 7f7fd6ffd640 1 -- 172.21.15.92:0/1511167451 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc0032590 con 0x7f7fd8096a10 2024-09-18T01:24:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.944+0000 7f7fde9bd640 1 -- 172.21.15.92:0/1511167451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd8096a10 msgr2=0x7f7fd806e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.944+0000 7f7fde9bd640 1 --2- 172.21.15.92:0/1511167451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd8096a10 0x7f7fd806e020 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009720 tx=0x7f7fc002a110 comp rx=0 tx=0).stop 2024-09-18T01:24:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.944+0000 7f7fde9bd640 1 -- 172.21.15.92:0/1511167451 shutdown_connections 2024-09-18T01:24:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.944+0000 7f7fde9bd640 1 --2- 172.21.15.92:0/1511167451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd8096a10 0x7f7fd806e020 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.944+0000 7f7fde9bd640 1 -- 172.21.15.92:0/1511167451 >> 172.21.15.92:0/1511167451 conn(0x7f7fd809a890 msgr2=0x7f7fd809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.944+0000 7f7fde9bd640 1 -- 172.21.15.92:0/1511167451 shutdown_connections 2024-09-18T01:24:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.944+0000 7f7fde9bd640 1 -- 172.21.15.92:0/1511167451 wait complete. 2024-09-18T01:24:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.945+0000 7f7fde9bd640 1 Processor -- start 2024-09-18T01:24:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.945+0000 7f7fde9bd640 1 -- start start 2024-09-18T01:24:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.945+0000 7f7fde9bd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd8096630 0x7f7fd81c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.945+0000 7f7fde9bd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd806e6e0 con 0x7f7fd8096630 2024-09-18T01:24:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.945+0000 7f7fd7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd8096630 0x7f7fd81c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.945+0000 7f7fd7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd8096630 0x7f7fd81c11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46128/0 (socket says 172.21.15.92:46128) 2024-09-18T01:24:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.945+0000 7f7fd7fff640 1 -- 172.21.15.92:0/733482620 learned_addr learned my addr 172.21.15.92:0/733482620 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.946+0000 7f7fd7fff640 1 -- 172.21.15.92:0/733482620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd8130dc0 con 0x7f7fd8096630 2024-09-18T01:24:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.946+0000 7f7fd7fff640 1 --2- 172.21.15.92:0/733482620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd8096630 0x7f7fd81c11a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800c420 tx=0x7f7fc800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.946+0000 7f7fd4ff9640 1 -- 172.21.15.92:0/733482620 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc8018070 con 0x7f7fd8096630 2024-09-18T01:24:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.946+0000 7f7fd4ff9640 1 -- 172.21.15.92:0/733482620 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc80074d0 con 0x7f7fd8096630 2024-09-18T01:24:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.946+0000 7f7fde9bd640 1 -- 172.21.15.92:0/733482620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd8132310 con 0x7f7fd8096630 2024-09-18T01:24:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.946+0000 7f7fd4ff9640 1 -- 172.21.15.92:0/733482620 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc8004950 con 0x7f7fd8096630 2024-09-18T01:24:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.946+0000 7f7fde9bd640 1 -- 172.21.15.92:0/733482620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd8130290 con 0x7f7fd8096630 2024-09-18T01:24:58.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.947+0000 7f7fd4ff9640 1 -- 172.21.15.92:0/733482620 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7fc801b070 con 0x7f7fd8096630 2024-09-18T01:24:58.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.947+0000 7f7fde9bd640 1 -- 172.21.15.92:0/733482620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd806d080 con 0x7f7fd8096630 2024-09-18T01:24:58.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.947+0000 7f7fd4ff9640 1 --2- 172.21.15.92:0/733482620 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7fb80382a0 0x7f7fb803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:58.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.947+0000 7f7fd4ff9640 1 -- 172.21.15.92:0/733482620 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f7fc804a5f0 con 0x7f7fd8096630 2024-09-18T01:24:58.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.947+0000 7f7fd77fe640 1 --2- 172.21.15.92:0/733482620 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7fb80382a0 0x7f7fb803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:58.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.948+0000 7f7fd77fe640 1 --2- 172.21.15.92:0/733482620 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7fb80382a0 0x7f7fb803a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0034000 tx=0x7f7fc002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:58.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:58.952+0000 7f7fd4ff9640 1 -- 172.21.15.92:0/733482620 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7fd8130dc0 con 0x7f7fd8096630 2024-09-18T01:24:59.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.117+0000 7f7fde9bd640 1 -- 172.21.15.92:0/733482620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7fd806eda0 con 0x7f7fd8096630 2024-09-18T01:24:59.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.117+0000 7f7fd4ff9640 1 -- 172.21.15.92:0/733482620 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9890 (secure 0 0 0) 0x7f7fc8011980 con 0x7f7fd8096630 2024-09-18T01:24:59.119 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:24:59.119 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":18,"fsid":"b78e7965-b05a-4410-91d0-045de6d3262c","created":"2024-09-18T01:24:38.657876+0000","modified":"2024-09-18T01:24:58.191395+0000","last_up_change":"2024-09-18T01:24:49.159870+0000","last_in_change":"2024-09-18T01:24:39.801526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T01:24:50.794525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T01:24:54.289682+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682fe679-c400-4f69-a149-b79e2378d5c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6801","nonce":2777570747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6803","nonce":2777570747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6807","nonce":2777570747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6805","nonce":2777570747}]},"public_addr":"172.21.15.92:6801/2777570747","cluster_addr":"172.21.15.92:6803/2777570747","heartbeat_back_addr":"172.21.15.92:6807/2777570747","heartbeat_front_addr":"172.21.15.92:6805/2777570747","state":["exists","up"]},{"osd":1,"uuid":"ac9e21ba-ed5c-42f9-95ee-a96375bb9d1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6801","nonce":170575980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6803","nonce":170575980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6807","nonce":170575980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6805","nonce":170575980}]},"public_addr":"172.21.15.100:6801/170575980","cluster_addr":"172.21.15.100:6803/170575980","heartbeat_back_addr":"172.21.15.100:6807/170575980","heartbeat_front_addr":"172.21.15.100:6805/170575980","state":["exists","up"]},{"osd":2,"uuid":"007ace6b-0046-48e4-9135-506e415b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6809","nonce":3104327688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6811","nonce":3104327688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6815","nonce":3104327688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6813","nonce":3104327688}]},"public_addr":"172.21.15.100:6809/3104327688","cluster_addr":"172.21.15.100:6811/3104327688","heartbeat_back_addr":"172.21.15.100:6815/3104327688","heartbeat_front_addr":"172.21.15.100:6813/3104327688","state":["exists","up"]},{"osd":3,"uuid":"be610877-3846-4095-9cf3-30d6ee8d0f31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6817","nonce":595195757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6819","nonce":595195757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6823","nonce":595195757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6821","nonce":595195757}]},"public_addr":"172.21.15.100:6817/595195757","cluster_addr":"172.21.15.100:6819/595195757","heartbeat_back_addr":"172.21.15.100:6823/595195757","heartbeat_front_addr":"172.21.15.100:6821/595195757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:46.705981+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:46.602358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:46.419325+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:47.136084+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T01:24:59.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.119+0000 7f7fde9bd640 1 -- 172.21.15.92:0/733482620 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7fb80382a0 msgr2=0x7f7fb803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.119+0000 7f7fde9bd640 1 --2- 172.21.15.92:0/733482620 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7fb80382a0 0x7f7fb803a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0034000 tx=0x7f7fc002e000 comp rx=0 tx=0).stop 2024-09-18T01:24:59.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.119+0000 7f7fde9bd640 1 -- 172.21.15.92:0/733482620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd8096630 msgr2=0x7f7fd81c11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.119+0000 7f7fde9bd640 1 --2- 172.21.15.92:0/733482620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd8096630 0x7f7fd81c11a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800c420 tx=0x7f7fc800c8e0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.119+0000 7f7fde9bd640 1 -- 172.21.15.92:0/733482620 shutdown_connections 2024-09-18T01:24:59.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.119+0000 7f7fde9bd640 1 --2- 172.21.15.92:0/733482620 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7fb80382a0 0x7f7fb803a760 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.119+0000 7f7fde9bd640 1 --2- 172.21.15.92:0/733482620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd8096630 0x7f7fd81c11a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.119+0000 7f7fde9bd640 1 -- 172.21.15.92:0/733482620 >> 172.21.15.92:0/733482620 conn(0x7f7fd809a890 msgr2=0x7f7fd8097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.120+0000 7f7fde9bd640 1 -- 172.21.15.92:0/733482620 shutdown_connections 2024-09-18T01:24:59.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.120+0000 7f7fde9bd640 1 -- 172.21.15.92:0/733482620 wait complete. 2024-09-18T01:24:59.132 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-18T01:24:59.132 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-18T01:24:59.133 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-18T01:24:59.133 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-18T01:24:59.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.234+0000 7f194b8f8640 1 Processor -- start 2024-09-18T01:24:59.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.234+0000 7faeecaf8640 1 Processor -- start 2024-09-18T01:24:59.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.235+0000 7faeecaf8640 1 -- start start 2024-09-18T01:24:59.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.235+0000 7f7b1712c640 1 Processor -- start 2024-09-18T01:24:59.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.235+0000 7f8183c65640 1 Processor -- start 2024-09-18T01:24:59.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.235+0000 7f194b8f8640 1 -- start start 2024-09-18T01:24:59.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.235+0000 7f7b1712c640 1 -- start start 2024-09-18T01:24:59.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.235+0000 7f8183c65640 1 -- start start 2024-09-18T01:24:59.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.235+0000 7faeecaf8640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7faee80962e0 0x7faee80966c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.235+0000 7f194b8f8640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1944096630 0x7f1944096a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.235+0000 7f194b8f8640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19440702f0 con 0x7f194406d910 2024-09-18T01:24:59.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.235+0000 7f194b8f8640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f194406f1f0 con 0x7f1944096630 2024-09-18T01:24:59.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.235+0000 7faeecaf8640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faee80732e0 con 0x7faee8096c00 2024-09-18T01:24:59.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.235+0000 7faeecaf8640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7faee806fee0 con 0x7faee80962e0 2024-09-18T01:24:59.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f7b1712c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7b1009bd50 0x7f7b1009c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.235+0000 7f8183c65640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f817c06d080 0x7f817c096630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f8183c65640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f817c0702f0 con 0x7f817c06d490 2024-09-18T01:24:59.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f8183c65640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f817c06f1f0 con 0x7f817c06d080 2024-09-18T01:24:59.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f7b1712c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1009d3b0 con 0x7f7b1009c670 2024-09-18T01:24:59.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f1949694640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1944096630 0x7f1944096a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f7b1712c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f7b10098230 con 0x7f7b1009bd50 2024-09-18T01:24:59.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f1949694640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1944096630 0x7f1944096a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46164/0 (socket says 172.21.15.92:46164) 2024-09-18T01:24:59.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f7b14ec8640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7b1009bd50 0x7f7b1009c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f8181a01640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f817c06d080 0x7f817c096630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f1949694640 1 -- 172.21.15.92:0/1797315732 learned_addr learned my addr 172.21.15.92:0/1797315732 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:59.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f8181200640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f817c06d490 0x7f817c06d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39516/0 (socket says 172.21.15.92:39516) 2024-09-18T01:24:59.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f8181200640 1 -- 172.21.15.92:0/875096112 learned_addr learned my addr 172.21.15.92:0/875096112 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:24:59.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f7b0ffff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f7b1009c670 0x7f7b100990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39522/0 (socket says 172.21.15.92:39522) 2024-09-18T01:24:59.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f7b0ffff640 1 -- 172.21.15.92:0/2090197125 learned_addr learned my addr 172.21.15.92:0/2090197125 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:24:59.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7faee5d9b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7faee8096c00 0x7faee806d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39500/0 (socket says 172.21.15.92:39500) 2024-09-18T01:24:59.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7faee5d9b640 1 -- 172.21.15.92:0/3584285344 learned_addr learned my addr 172.21.15.92:0/3584285344 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:24:59.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7faee659c640 1 --2- 172.21.15.92:0/3584285344 >> v2:172.21.15.92:3300/0 conn(0x7faee80962e0 0x7faee80966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f1949694640 1 -- 172.21.15.92:0/1797315732 >> v1:172.21.15.92:6789/0 conn(0x7f194406d910 legacy=0x7f194406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f1949694640 1 -- 172.21.15.92:0/1797315732 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194406fb80 con 0x7f1944096630 2024-09-18T01:24:59.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f7b14ec8640 1 -- 172.21.15.92:0/2090197125 >> v1:172.21.15.92:6789/0 conn(0x7f7b1009c670 legacy=0x7f7b100990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f8181a01640 1 -- 172.21.15.92:0/875096112 >> v1:172.21.15.92:6789/0 conn(0x7f817c06d490 legacy=0x7f817c06d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f7b14ec8640 1 -- 172.21.15.92:0/2090197125 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b100983e0 con 0x7f7b1009bd50 2024-09-18T01:24:59.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7f8181a01640 1 -- 172.21.15.92:0/875096112 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817c06fb80 con 0x7f817c06d080 2024-09-18T01:24:59.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7faee659c640 1 -- 172.21.15.92:0/3584285344 >> v1:172.21.15.92:6789/0 conn(0x7faee8096c00 legacy=0x7faee806d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.236+0000 7faee659c640 1 -- 172.21.15.92:0/3584285344 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee8070100 con 0x7faee80962e0 2024-09-18T01:24:59.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.237+0000 7f1949694640 1 --2- 172.21.15.92:0/1797315732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1944096630 0x7f1944096a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f19400097f0 tx=0x7f194002b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42a6445c596a81 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.237+0000 7f8181a01640 1 --2- 172.21.15.92:0/875096112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f817c06d080 0x7f817c096630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8178009720 tx=0x7f817802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ae12144592beb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.237+0000 7f193bfff640 1 -- 172.21.15.92:0/1797315732 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1940037070 con 0x7f1944096630 2024-09-18T01:24:59.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.237+0000 7f81809ff640 1 -- 172.21.15.92:0/875096112 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8178037070 con 0x7f817c06d080 2024-09-18T01:24:59.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.237+0000 7f81809ff640 1 -- 172.21.15.92:0/875096112 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817802ad90 con 0x7f817c06d080 2024-09-18T01:24:59.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.237+0000 7f193bfff640 1 -- 172.21.15.92:0/1797315732 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1940030640 con 0x7f1944096630 2024-09-18T01:24:59.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.237+0000 7f193bfff640 1 -- 172.21.15.92:0/1797315732 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1940030940 con 0x7f1944096630 2024-09-18T01:24:59.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.237+0000 7f81809ff640 1 -- 172.21.15.92:0/875096112 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8178032590 con 0x7f817c06d080 2024-09-18T01:24:59.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.237+0000 7f7b14ec8640 1 --2- 172.21.15.92:0/2090197125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1009bd50 0x7f7b1009c130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009720 tx=0x7f7b0402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70ec096d6d3678d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7faee659c640 1 --2- 172.21.15.92:0/3584285344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faee80962e0 0x7faee80966c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faed8009720 tx=0x7faed802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3167738e39b91c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f7b0f7fe640 1 -- 172.21.15.92:0/2090197125 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b04037070 con 0x7f7b1009bd50 2024-09-18T01:24:59.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f7b0f7fe640 1 -- 172.21.15.92:0/2090197125 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0402ad90 con 0x7f7b1009bd50 2024-09-18T01:24:59.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f7b0f7fe640 1 -- 172.21.15.92:0/2090197125 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b04032590 con 0x7f7b1009bd50 2024-09-18T01:24:59.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7faee559a640 1 -- 172.21.15.92:0/3584285344 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faed8037070 con 0x7faee80962e0 2024-09-18T01:24:59.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7faee559a640 1 -- 172.21.15.92:0/3584285344 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed802ad90 con 0x7faee80962e0 2024-09-18T01:24:59.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7faee559a640 1 -- 172.21.15.92:0/3584285344 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faed8032590 con 0x7faee80962e0 2024-09-18T01:24:59.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f8183c65640 1 -- 172.21.15.92:0/875096112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f817c06d080 msgr2=0x7f817c096630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f8183c65640 1 --2- 172.21.15.92:0/875096112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f817c06d080 0x7f817c096630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8178009720 tx=0x7f817802a110 comp rx=0 tx=0).stop 2024-09-18T01:24:59.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f8183c65640 1 -- 172.21.15.92:0/875096112 shutdown_connections 2024-09-18T01:24:59.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f8183c65640 1 --2- 172.21.15.92:0/875096112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f817c06d080 0x7f817c096630 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f8183c65640 1 -- 172.21.15.92:0/875096112 >> 172.21.15.92:0/875096112 conn(0x7f817c09a890 msgr2=0x7f817c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f194b8f8640 1 -- 172.21.15.92:0/1797315732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1944096630 msgr2=0x7f1944096a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f194b8f8640 1 --2- 172.21.15.92:0/1797315732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1944096630 0x7f1944096a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f19400097f0 tx=0x7f194002b410 comp rx=0 tx=0).stop 2024-09-18T01:24:59.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f8183c65640 1 -- 172.21.15.92:0/875096112 shutdown_connections 2024-09-18T01:24:59.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f194b8f8640 1 -- 172.21.15.92:0/1797315732 shutdown_connections 2024-09-18T01:24:59.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f194b8f8640 1 --2- 172.21.15.92:0/1797315732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1944096630 0x7f1944096a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f194b8f8640 1 -- 172.21.15.92:0/1797315732 >> 172.21.15.92:0/1797315732 conn(0x7f194409a890 msgr2=0x7f194409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f8183c65640 1 -- 172.21.15.92:0/875096112 wait complete. 2024-09-18T01:24:59.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f194b8f8640 1 -- 172.21.15.92:0/1797315732 shutdown_connections 2024-09-18T01:24:59.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.238+0000 7f194b8f8640 1 -- 172.21.15.92:0/1797315732 wait complete. 2024-09-18T01:24:59.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7f7b1712c640 1 -- 172.21.15.92:0/2090197125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1009bd50 msgr2=0x7f7b1009c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7f7b1712c640 1 --2- 172.21.15.92:0/2090197125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1009bd50 0x7f7b1009c130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009720 tx=0x7f7b0402a110 comp rx=0 tx=0).stop 2024-09-18T01:24:59.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7faeecaf8640 1 -- 172.21.15.92:0/3584285344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faee80962e0 msgr2=0x7faee80966c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7faeecaf8640 1 --2- 172.21.15.92:0/3584285344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faee80962e0 0x7faee80966c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faed8009720 tx=0x7faed802a110 comp rx=0 tx=0).stop 2024-09-18T01:24:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7faeecaf8640 1 -- 172.21.15.92:0/3584285344 shutdown_connections 2024-09-18T01:24:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7f7b1712c640 1 -- 172.21.15.92:0/2090197125 shutdown_connections 2024-09-18T01:24:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7f7b1712c640 1 --2- 172.21.15.92:0/2090197125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1009bd50 0x7f7b1009c130 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7f7b1712c640 1 -- 172.21.15.92:0/2090197125 >> 172.21.15.92:0/2090197125 conn(0x7f7b1006d4a0 msgr2=0x7f7b1006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7faeecaf8640 1 --2- 172.21.15.92:0/3584285344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faee80962e0 0x7faee80966c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7faeecaf8640 1 -- 172.21.15.92:0/3584285344 >> 172.21.15.92:0/3584285344 conn(0x7faee809a890 msgr2=0x7faee809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7f7b1712c640 1 -- 172.21.15.92:0/2090197125 shutdown_connections 2024-09-18T01:24:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7f7b1712c640 1 -- 172.21.15.92:0/2090197125 wait complete. 2024-09-18T01:24:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7faeecaf8640 1 -- 172.21.15.92:0/3584285344 shutdown_connections 2024-09-18T01:24:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7faeecaf8640 1 -- 172.21.15.92:0/3584285344 wait complete. 2024-09-18T01:24:59.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7f194b8f8640 1 Processor -- start 2024-09-18T01:24:59.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7f194b8f8640 1 -- start start 2024-09-18T01:24:59.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.239+0000 7f8183c65640 1 Processor -- start 2024-09-18T01:24:59.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7f8183c65640 1 -- start start 2024-09-18T01:24:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7f194b8f8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194406d910 0x7f19441275b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7f194b8f8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f194406d410 con 0x7f194406d910 2024-09-18T01:24:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7f1949694640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194406d910 0x7f19441275b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7f1949694640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194406d910 0x7f19441275b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46172/0 (socket says 172.21.15.92:46172) 2024-09-18T01:24:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7f1949694640 1 -- 172.21.15.92:0/3119012655 learned_addr learned my addr 172.21.15.92:0/3119012655 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7faeecaf8640 1 Processor -- start 2024-09-18T01:24:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7f8183c65640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f817c06d080 0x7f817c0952d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7f8183c65640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f817c06dfb0 con 0x7f817c06d080 2024-09-18T01:24:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7faeecaf8640 1 -- start start 2024-09-18T01:24:59.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7f8181a01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f817c06d080 0x7f817c0952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7f7b1712c640 1 Processor -- start 2024-09-18T01:24:59.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7f8181a01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f817c06d080 0x7f817c0952d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46178/0 (socket says 172.21.15.92:46178) 2024-09-18T01:24:59.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7f8181a01640 1 -- 172.21.15.92:0/1796395199 learned_addr learned my addr 172.21.15.92:0/1796395199 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:59.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.240+0000 7f7b1712c640 1 -- start start 2024-09-18T01:24:59.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7faeecaf8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faee80962e0 0x7faee8122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7f1949694640 1 -- 172.21.15.92:0/3119012655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1944125a60 con 0x7f194406d910 2024-09-18T01:24:59.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7faeecaf8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faee806bdb0 con 0x7faee80962e0 2024-09-18T01:24:59.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7f8181a01640 1 -- 172.21.15.92:0/1796395199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817c072ea0 con 0x7f817c06d080 2024-09-18T01:24:59.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7f8181a01640 1 --2- 172.21.15.92:0/1796395199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f817c06d080 0x7f817c0952d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8178035040 tx=0x7f81780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7faee659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faee80962e0 0x7faee8122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7f81727fc640 1 -- 172.21.15.92:0/1796395199 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8178037050 con 0x7f817c06d080 2024-09-18T01:24:59.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7faee659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faee80962e0 0x7faee8122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46194/0 (socket says 172.21.15.92:46194) 2024-09-18T01:24:59.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7faee659c640 1 -- 172.21.15.92:0/1890638084 learned_addr learned my addr 172.21.15.92:0/1890638084 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:59.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7f81727fc640 1 -- 172.21.15.92:0/1796395199 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8178043070 con 0x7f817c06d080 2024-09-18T01:24:59.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7f7b1712c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1009bd50 0x7f7b101b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7f7b1712c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7b10099b90 con 0x7f7b1009bd50 2024-09-18T01:24:59.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7f81727fc640 1 -- 172.21.15.92:0/1796395199 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8178032590 con 0x7f817c06d080 2024-09-18T01:24:59.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7f1949694640 1 --2- 172.21.15.92:0/3119012655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194406d910 0x7f19441275b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f19400090b0 tx=0x7f19400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7f8183c65640 1 -- 172.21.15.92:0/1796395199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f817c12d620 con 0x7f817c06d080 2024-09-18T01:24:59.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7f8183c65640 1 -- 172.21.15.92:0/1796395199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f817c095810 con 0x7f817c06d080 2024-09-18T01:24:59.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7f1939ffb640 1 -- 172.21.15.92:0/3119012655 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1940041020 con 0x7f194406d910 2024-09-18T01:24:59.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7faee659c640 1 -- 172.21.15.92:0/1890638084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee8126040 con 0x7faee80962e0 2024-09-18T01:24:59.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.242+0000 7faee659c640 1 --2- 172.21.15.92:0/1890638084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faee80962e0 0x7faee8122dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faed8009840 tx=0x7faed80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.242+0000 7faed6ffd640 1 -- 172.21.15.92:0/1890638084 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faed8042020 con 0x7faee80962e0 2024-09-18T01:24:59.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.242+0000 7faed6ffd640 1 -- 172.21.15.92:0/1890638084 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed803d5c0 con 0x7faee80962e0 2024-09-18T01:24:59.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.242+0000 7faed6ffd640 1 -- 172.21.15.92:0/1890638084 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faed8037040 con 0x7faee80962e0 2024-09-18T01:24:59.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.242+0000 7faeecaf8640 1 -- 172.21.15.92:0/1890638084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee81262e0 con 0x7faee80962e0 2024-09-18T01:24:59.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.242+0000 7f194b8f8640 1 -- 172.21.15.92:0/3119012655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1944072ea0 con 0x7f194406d910 2024-09-18T01:24:59.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.242+0000 7f194b8f8640 1 -- 172.21.15.92:0/3119012655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1944095c90 con 0x7f194406d910 2024-09-18T01:24:59.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.241+0000 7f1939ffb640 1 -- 172.21.15.92:0/3119012655 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19400328b0 con 0x7f194406d910 2024-09-18T01:24:59.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.242+0000 7faeecaf8640 1 -- 172.21.15.92:0/1890638084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee8125950 con 0x7faee80962e0 2024-09-18T01:24:59.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.242+0000 7f81727fc640 1 -- 172.21.15.92:0/1796395199 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8178003740 con 0x7f817c06d080 2024-09-18T01:24:59.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.243+0000 7f7b14ec8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1009bd50 0x7f7b101b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.243+0000 7f815ffff640 1 -- 172.21.15.92:0/1796395199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8158000f80 con 0x7f817c06d080 2024-09-18T01:24:59.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.243+0000 7f7b14ec8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1009bd50 0x7f7b101b3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46204/0 (socket says 172.21.15.92:46204) 2024-09-18T01:24:59.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.243+0000 7f7b14ec8640 1 -- 172.21.15.92:0/3335310992 learned_addr learned my addr 172.21.15.92:0/3335310992 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:59.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.243+0000 7faeecaf8640 1 -- 172.21.15.92:0/1890638084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faee80966c0 con 0x7faee80962e0 2024-09-18T01:24:59.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.243+0000 7f1939ffb640 1 -- 172.21.15.92:0/3119012655 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1940037040 con 0x7f194406d910 2024-09-18T01:24:59.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.243+0000 7f194b8f8640 1 -- 172.21.15.92:0/3119012655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1924000f80 con 0x7f194406d910 2024-09-18T01:24:59.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.243+0000 7faed6ffd640 1 -- 172.21.15.92:0/1890638084 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faed8045020 con 0x7faee80962e0 2024-09-18T01:24:59.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.243+0000 7f7b14ec8640 1 -- 172.21.15.92:0/3335310992 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1009a760 con 0x7f7b1009bd50 2024-09-18T01:24:59.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.243+0000 7f81727fc640 1 --2- 172.21.15.92:0/1796395199 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f81600382a0 0x7f816003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.243+0000 7faed6ffd640 1 --2- 172.21.15.92:0/1890638084 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7faec8038250 0x7faec803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.243+0000 7f81727fc640 1 -- 172.21.15.92:0/1796395199 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f817806c4d0 con 0x7f817c06d080 2024-09-18T01:24:59.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.243+0000 7faed6ffd640 1 -- 172.21.15.92:0/1890638084 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7faed806bdf0 con 0x7faee80962e0 2024-09-18T01:24:59.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7faed6ffd640 1 --2- 172.21.15.92:0/1890638084 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x7faec803d9d0 0x7faec803fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7f81727fc640 1 --2- 172.21.15.92:0/1796395199 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x7f816003da20 0x7f816003fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7f81727fc640 1 -- 172.21.15.92:0/1796395199 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8160040570 con 0x7f816003da20 2024-09-18T01:24:59.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7f81727fc640 1 -- 172.21.15.92:0/1796395199 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8178073050 con 0x7f817c06d080 2024-09-18T01:24:59.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7faed6ffd640 1 -- 172.21.15.92:0/1890638084 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faed803ae50 con 0x7faec803d9d0 2024-09-18T01:24:59.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7faed6ffd640 1 -- 172.21.15.92:0/1890638084 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7faed803d930 con 0x7faee80962e0 2024-09-18T01:24:59.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7f7b14ec8640 1 --2- 172.21.15.92:0/3335310992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1009bd50 0x7f7b101b3070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009840 tx=0x7f7b040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7faee5d9b640 1 --2- 172.21.15.92:0/1890638084 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7faec8038250 0x7faec803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7f8181200640 1 --2- 172.21.15.92:0/1796395199 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f81600382a0 0x7f816003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7faee6d9d640 1 --2- 172.21.15.92:0/1890638084 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x7faec803d9d0 0x7faec803fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7f8182202640 1 --2- 172.21.15.92:0/1796395199 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x7f816003da20 0x7f816003fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7f7b0d7fa640 1 -- 172.21.15.92:0/3335310992 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b04040020 con 0x7f7b1009bd50 2024-09-18T01:24:59.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7f7b0d7fa640 1 -- 172.21.15.92:0/3335310992 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b04038040 con 0x7f7b1009bd50 2024-09-18T01:24:59.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7f1939ffb640 1 -- 172.21.15.92:0/3119012655 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1940044020 con 0x7f194406d910 2024-09-18T01:24:59.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7f7b1712c640 1 -- 172.21.15.92:0/3335310992 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1008c5e0 con 0x7f7b1009bd50 2024-09-18T01:24:59.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7f8181200640 1 --2- 172.21.15.92:0/1796395199 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f81600382a0 0x7f816003a760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f816c007fd0 tx=0x7f816c007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7faee5d9b640 1 --2- 172.21.15.92:0/1890638084 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7faec8038250 0x7faec803a710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faedc007fd0 tx=0x7faedc007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7faee6d9d640 1 --2- 172.21.15.92:0/1890638084 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x7faec803d9d0 0x7faec803fe50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.244+0000 7f8182202640 1 --2- 172.21.15.92:0/1796395199 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x7f816003da20 0x7f816003fea0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.245+0000 7f1939ffb640 1 --2- 172.21.15.92:0/3119012655 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1928038340 0x7f192803a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.245+0000 7f1939ffb640 1 -- 172.21.15.92:0/3119012655 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f194006c600 con 0x7f194406d910 2024-09-18T01:24:59.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.245+0000 7f1948e93640 1 --2- 172.21.15.92:0/3119012655 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1928038340 0x7f192803a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.245+0000 7f7b0d7fa640 1 -- 172.21.15.92:0/3335310992 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b04037070 con 0x7f7b1009bd50 2024-09-18T01:24:59.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.245+0000 7f1939ffb640 1 --2- 172.21.15.92:0/3119012655 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x7f192803db40 0x7f192803ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.245+0000 7f1939ffb640 1 -- 172.21.15.92:0/3119012655 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f194003ae50 con 0x7f192803db40 2024-09-18T01:24:59.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.245+0000 7f7b1712c640 1 -- 172.21.15.92:0/3335310992 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b101b35b0 con 0x7f7b1009bd50 2024-09-18T01:24:59.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.245+0000 7f1939ffb640 1 -- 172.21.15.92:0/3119012655 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f194006c970 con 0x7f194406d910 2024-09-18T01:24:59.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.245+0000 7f81727fc640 1 -- 172.21.15.92:0/1796395199 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8160040570 con 0x7f816003da20 2024-09-18T01:24:59.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.245+0000 7f7b0d7fa640 1 -- 172.21.15.92:0/3335310992 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7b04043020 con 0x7f7b1009bd50 2024-09-18T01:24:59.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.245+0000 7faed6ffd640 1 -- 172.21.15.92:0/1890638084 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faed803ae50 con 0x7faec803d9d0 2024-09-18T01:24:59.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.245+0000 7f1949e95640 1 --2- 172.21.15.92:0/3119012655 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x7f192803db40 0x7f192803ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.245+0000 7f1948e93640 1 --2- 172.21.15.92:0/3119012655 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1928038340 0x7f192803a800 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1934000f60 tx=0x7f1934007a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.245+0000 7f7b0d7fa640 1 --2- 172.21.15.92:0/3335310992 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7af40382a0 0x7f7af403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.246+0000 7f7b0d7fa640 1 -- 172.21.15.92:0/3335310992 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f7b0406f260 con 0x7f7b1009bd50 2024-09-18T01:24:59.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.246+0000 7f1949e95640 1 --2- 172.21.15.92:0/3119012655 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x7f192803db40 0x7f192803ffc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.246+0000 7f7b0ffff640 1 --2- 172.21.15.92:0/3335310992 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7af40382a0 0x7f7af403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.246+0000 7f7b1712c640 1 --2- 172.21.15.92:0/3335310992 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7b1009c670 0x7f7b1009f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.246+0000 7f7b1712c640 1 -- 172.21.15.92:0/3335310992 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b1008bc70 con 0x7f7b1009c670 2024-09-18T01:24:59.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.246+0000 7f7b156c9640 1 --2- 172.21.15.92:0/3335310992 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7b1009c670 0x7f7b1009f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.246+0000 7f7b156c9640 1 --2- 172.21.15.92:0/3335310992 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7b1009c670 0x7f7b1009f1c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.246+0000 7f7b0ffff640 1 --2- 172.21.15.92:0/3335310992 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7af40382a0 0x7f7af403a760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7afc007fd0 tx=0x7f7afc007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.246+0000 7f1939ffb640 1 -- 172.21.15.92:0/3119012655 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f194003ae50 con 0x7f192803db40 2024-09-18T01:24:59.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.247+0000 7f7b0d7fa640 1 -- 172.21.15.92:0/3335310992 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b0800ad10 con 0x7f7b1009c670 2024-09-18T01:24:59.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.259+0000 7faeecaf8640 1 -- 172.21.15.92:0/1890638084 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faee8096c00 con 0x7faec803d9d0 2024-09-18T01:24:59.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7faed6ffd640 1 -- 172.21.15.92:0/1890638084 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faee8096c00 con 0x7faec803d9d0 2024-09-18T01:24:59.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7f194b8f8640 1 -- 172.21.15.92:0/3119012655 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1924002c70 con 0x7f192803db40 2024-09-18T01:24:59.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7faeecaf8640 1 -- 172.21.15.92:0/1890638084 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x7faec803d9d0 msgr2=0x7faec803fe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7faeecaf8640 1 --2- 172.21.15.92:0/1890638084 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x7faec803d9d0 0x7faec803fe50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7faeecaf8640 1 -- 172.21.15.92:0/1890638084 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7faec8038250 msgr2=0x7faec803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7faeecaf8640 1 --2- 172.21.15.92:0/1890638084 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7faec8038250 0x7faec803a710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faedc007fd0 tx=0x7faedc007ac0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7faeecaf8640 1 -- 172.21.15.92:0/1890638084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faee80962e0 msgr2=0x7faee8122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7faeecaf8640 1 --2- 172.21.15.92:0/1890638084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faee80962e0 0x7faee8122dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faed8009840 tx=0x7faed80046c0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7faeecaf8640 1 -- 172.21.15.92:0/1890638084 shutdown_connections 2024-09-18T01:24:59.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7faeecaf8640 1 --2- 172.21.15.92:0/1890638084 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x7faec803d9d0 0x7faec803fe50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7faeecaf8640 1 --2- 172.21.15.92:0/1890638084 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7faec8038250 0x7faec803a710 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7faeecaf8640 1 --2- 172.21.15.92:0/1890638084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faee80962e0 0x7faee8122dd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7faeecaf8640 1 -- 172.21.15.92:0/1890638084 >> 172.21.15.92:0/1890638084 conn(0x7faee809a890 msgr2=0x7faee8097fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7faeecaf8640 1 -- 172.21.15.92:0/1890638084 shutdown_connections 2024-09-18T01:24:59.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7faeecaf8640 1 -- 172.21.15.92:0/1890638084 wait complete. 2024-09-18T01:24:59.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.260+0000 7f1939ffb640 1 -- 172.21.15.92:0/3119012655 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1924002c70 con 0x7f192803db40 2024-09-18T01:24:59.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.261+0000 7f194b8f8640 1 -- 172.21.15.92:0/3119012655 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x7f192803db40 msgr2=0x7f192803ffc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.261+0000 7f194b8f8640 1 --2- 172.21.15.92:0/3119012655 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x7f192803db40 0x7f192803ffc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.261+0000 7f194b8f8640 1 -- 172.21.15.92:0/3119012655 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1928038340 msgr2=0x7f192803a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.261+0000 7f194b8f8640 1 --2- 172.21.15.92:0/3119012655 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1928038340 0x7f192803a800 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1934000f60 tx=0x7f1934007a30 comp rx=0 tx=0).stop 2024-09-18T01:24:59.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.261+0000 7f194b8f8640 1 -- 172.21.15.92:0/3119012655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194406d910 msgr2=0x7f19441275b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.261+0000 7f194b8f8640 1 --2- 172.21.15.92:0/3119012655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194406d910 0x7f19441275b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f19400090b0 tx=0x7f19400046c0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.261+0000 7f194b8f8640 1 -- 172.21.15.92:0/3119012655 shutdown_connections 2024-09-18T01:24:59.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.261+0000 7f194b8f8640 1 --2- 172.21.15.92:0/3119012655 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x7f192803db40 0x7f192803ffc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.261+0000 7f194b8f8640 1 --2- 172.21.15.92:0/3119012655 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1928038340 0x7f192803a800 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.261+0000 7f194b8f8640 1 --2- 172.21.15.92:0/3119012655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194406d910 0x7f19441275b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.261+0000 7f194b8f8640 1 -- 172.21.15.92:0/3119012655 >> 172.21.15.92:0/3119012655 conn(0x7f194409a890 msgr2=0x7f1944097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.261+0000 7f194b8f8640 1 -- 172.21.15.92:0/3119012655 shutdown_connections 2024-09-18T01:24:59.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.261+0000 7f194b8f8640 1 -- 172.21.15.92:0/3119012655 wait complete. 2024-09-18T01:24:59.284 INFO:teuthology.orchestra.run.smithi092.stdout:42949672966 2024-09-18T01:24:59.284 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T01:24:59.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.275+0000 7f815ffff640 1 -- 172.21.15.92:0/1796395199 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8158002c70 con 0x7f816003da20 2024-09-18T01:24:59.285 INFO:teuthology.orchestra.run.smithi092.stdout:42949672965 2024-09-18T01:24:59.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T01:24:59.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.275+0000 7f81727fc640 1 -- 172.21.15.92:0/1796395199 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8158002c70 con 0x7f816003da20 2024-09-18T01:24:59.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.276+0000 7f815ffff640 1 -- 172.21.15.92:0/1796395199 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x7f816003da20 msgr2=0x7f816003fea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.276+0000 7f815ffff640 1 --2- 172.21.15.92:0/1796395199 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x7f816003da20 0x7f816003fea0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.276+0000 7f815ffff640 1 -- 172.21.15.92:0/1796395199 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f81600382a0 msgr2=0x7f816003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.276+0000 7f815ffff640 1 --2- 172.21.15.92:0/1796395199 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f81600382a0 0x7f816003a760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f816c007fd0 tx=0x7f816c007ac0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.276+0000 7f815ffff640 1 -- 172.21.15.92:0/1796395199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f817c06d080 msgr2=0x7f817c0952d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.276+0000 7f815ffff640 1 --2- 172.21.15.92:0/1796395199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f817c06d080 0x7f817c0952d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8178035040 tx=0x7f81780046c0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.276+0000 7f815ffff640 1 -- 172.21.15.92:0/1796395199 shutdown_connections 2024-09-18T01:24:59.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.276+0000 7f815ffff640 1 --2- 172.21.15.92:0/1796395199 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x7f816003da20 0x7f816003fea0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.276+0000 7f815ffff640 1 --2- 172.21.15.92:0/1796395199 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f81600382a0 0x7f816003a760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.276+0000 7f815ffff640 1 --2- 172.21.15.92:0/1796395199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f817c06d080 0x7f817c0952d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.276+0000 7f815ffff640 1 -- 172.21.15.92:0/1796395199 >> 172.21.15.92:0/1796395199 conn(0x7f817c09a890 msgr2=0x7f817c0719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.276+0000 7f815ffff640 1 -- 172.21.15.92:0/1796395199 shutdown_connections 2024-09-18T01:24:59.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.276+0000 7f815ffff640 1 -- 172.21.15.92:0/1796395199 wait complete. 2024-09-18T01:24:59.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.277+0000 7f7b1712c640 1 -- 172.21.15.92:0/3335310992 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7b101b3db0 con 0x7f7b1009c670 2024-09-18T01:24:59.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.277+0000 7f7b0d7fa640 1 -- 172.21.15.92:0/3335310992 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7b101b3db0 con 0x7f7b1009c670 2024-09-18T01:24:59.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.277+0000 7f7b1712c640 1 -- 172.21.15.92:0/3335310992 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7b1009c670 msgr2=0x7f7b1009f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.277+0000 7f7b1712c640 1 --2- 172.21.15.92:0/3335310992 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7b1009c670 0x7f7b1009f1c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.277+0000 7f7b1712c640 1 -- 172.21.15.92:0/3335310992 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7af40382a0 msgr2=0x7f7af403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.277+0000 7f7b1712c640 1 --2- 172.21.15.92:0/3335310992 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7af40382a0 0x7f7af403a760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7afc007fd0 tx=0x7f7afc007ac0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.277+0000 7f7b1712c640 1 -- 172.21.15.92:0/3335310992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1009bd50 msgr2=0x7f7b101b3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.277+0000 7f7b1712c640 1 --2- 172.21.15.92:0/3335310992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1009bd50 0x7f7b101b3070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009840 tx=0x7f7b040046c0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.278+0000 7f7b1712c640 1 -- 172.21.15.92:0/3335310992 shutdown_connections 2024-09-18T01:24:59.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.278+0000 7f7b1712c640 1 --2- 172.21.15.92:0/3335310992 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7b1009c670 0x7f7b1009f1c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.278+0000 7f7b1712c640 1 --2- 172.21.15.92:0/3335310992 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7af40382a0 0x7f7af403a760 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.278+0000 7f7b1712c640 1 --2- 172.21.15.92:0/3335310992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1009bd50 0x7f7b101b3070 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.278+0000 7f7b1712c640 1 -- 172.21.15.92:0/3335310992 >> 172.21.15.92:0/3335310992 conn(0x7f7b1006d4a0 msgr2=0x7f7b1009eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.278+0000 7f7b1712c640 1 -- 172.21.15.92:0/3335310992 shutdown_connections 2024-09-18T01:24:59.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.278+0000 7f7b1712c640 1 -- 172.21.15.92:0/3335310992 wait complete. 2024-09-18T01:24:59.292 INFO:teuthology.orchestra.run.smithi092.stdout:42949672965 2024-09-18T01:24:59.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T01:24:59.293 INFO:teuthology.orchestra.run.smithi092.stdout:38654705669 2024-09-18T01:24:59.294 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T01:24:59.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.393+0000 7f54cde65640 1 Processor -- start 2024-09-18T01:24:59.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.393+0000 7f54cde65640 1 -- start start 2024-09-18T01:24:59.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.393+0000 7f54cde65640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f54c809bd50 0x7f54c809c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.393+0000 7f54cde65640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c809d3b0 con 0x7f54c809c670 2024-09-18T01:24:59.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.393+0000 7f54cde65640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f54c8098230 con 0x7f54c809bd50 2024-09-18T01:24:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.393+0000 7f54c6ffd640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f54c809c670 0x7f54c80990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39530/0 (socket says 172.21.15.92:39530) 2024-09-18T01:24:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.393+0000 7f54c6ffd640 1 -- 172.21.15.92:0/3211174102 learned_addr learned my addr 172.21.15.92:0/3211174102 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:24:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.393+0000 7f54c77fe640 1 --2- 172.21.15.92:0/3211174102 >> v2:172.21.15.92:3300/0 conn(0x7f54c809bd50 0x7f54c809c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.394+0000 7f54c67fc640 1 -- 172.21.15.92:0/3211174102 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605948342 0 0) 0x7f54bc001110 con 0x7f54c809c670 2024-09-18T01:24:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.394+0000 7f54c67fc640 1 -- 172.21.15.92:0/3211174102 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54b0003520 con 0x7f54c809c670 2024-09-18T01:24:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.394+0000 7f54c77fe640 1 -- 172.21.15.92:0/3211174102 >> v1:172.21.15.92:6789/0 conn(0x7f54c809c670 legacy=0x7f54c80990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.394+0000 7f54c77fe640 1 -- 172.21.15.92:0/3211174102 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c80983e0 con 0x7f54c809bd50 2024-09-18T01:24:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.395+0000 7f54c77fe640 1 --2- 172.21.15.92:0/3211174102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54c809bd50 0x7f54c809c130 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009720 tx=0x7f54b802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3ca858c7ae9565 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.395+0000 7f54c67fc640 1 -- 172.21.15.92:0/3211174102 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b8037070 con 0x7f54c809bd50 2024-09-18T01:24:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.395+0000 7f54c67fc640 1 -- 172.21.15.92:0/3211174102 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b802ad90 con 0x7f54c809bd50 2024-09-18T01:24:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.395+0000 7f54c67fc640 1 -- 172.21.15.92:0/3211174102 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b8032590 con 0x7f54c809bd50 2024-09-18T01:24:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.396+0000 7f54cde65640 1 -- 172.21.15.92:0/3211174102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54c809bd50 msgr2=0x7f54c809c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.396+0000 7f54cde65640 1 --2- 172.21.15.92:0/3211174102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54c809bd50 0x7f54c809c130 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009720 tx=0x7f54b802a110 comp rx=0 tx=0).stop 2024-09-18T01:24:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.396+0000 7f54cde65640 1 -- 172.21.15.92:0/3211174102 shutdown_connections 2024-09-18T01:24:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.396+0000 7f54cde65640 1 --2- 172.21.15.92:0/3211174102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54c809bd50 0x7f54c809c130 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.396+0000 7f54cde65640 1 -- 172.21.15.92:0/3211174102 >> 172.21.15.92:0/3211174102 conn(0x7f54c806d4a0 msgr2=0x7f54c806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.396+0000 7f54cde65640 1 -- 172.21.15.92:0/3211174102 shutdown_connections 2024-09-18T01:24:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.396+0000 7f54cde65640 1 -- 172.21.15.92:0/3211174102 wait complete. 2024-09-18T01:24:59.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.397+0000 7f54cde65640 1 Processor -- start 2024-09-18T01:24:59.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.398+0000 7f54cde65640 1 -- start start 2024-09-18T01:24:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.398+0000 7f54cde65640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54c809bd50 0x7f54c8094440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.398+0000 7f54cde65640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f54c8099b90 con 0x7f54c809bd50 2024-09-18T01:24:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.398+0000 7f54c77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54c809bd50 0x7f54c8094440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.398+0000 7f54c77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54c809bd50 0x7f54c8094440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46228/0 (socket says 172.21.15.92:46228) 2024-09-18T01:24:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.398+0000 7f54c77fe640 1 -- 172.21.15.92:0/1501607608 learned_addr learned my addr 172.21.15.92:0/1501607608 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.399+0000 7f54c77fe640 1 -- 172.21.15.92:0/1501607608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c809a760 con 0x7f54c809bd50 2024-09-18T01:24:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.399+0000 7f54c77fe640 1 --2- 172.21.15.92:0/1501607608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54c809bd50 0x7f54c8094440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f54b8000c00 tx=0x7f54b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.399+0000 7f54affff640 1 -- 172.21.15.92:0/1501607608 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b8041070 con 0x7f54c809bd50 2024-09-18T01:24:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.399+0000 7f54affff640 1 -- 172.21.15.92:0/1501607608 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b803c460 con 0x7f54c809bd50 2024-09-18T01:24:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.399+0000 7f54affff640 1 -- 172.21.15.92:0/1501607608 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b8037040 con 0x7f54c809bd50 2024-09-18T01:24:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.399+0000 7f54cde65640 1 -- 172.21.15.92:0/1501607608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c81ab4a0 con 0x7f54c809bd50 2024-09-18T01:24:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.399+0000 7f54cde65640 1 -- 172.21.15.92:0/1501607608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c8094980 con 0x7f54c809bd50 2024-09-18T01:24:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.400+0000 7f54affff640 1 -- 172.21.15.92:0/1501607608 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f54b8044070 con 0x7f54c809bd50 2024-09-18T01:24:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.400+0000 7f54cde65640 1 -- 172.21.15.92:0/1501607608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54c809a130 con 0x7f54c809bd50 2024-09-18T01:24:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.400+0000 7f54affff640 1 --2- 172.21.15.92:0/1501607608 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f54b40382d0 0x7f54b403a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.400+0000 7f54affff640 1 -- 172.21.15.92:0/1501607608 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f54b806ba10 con 0x7f54c809bd50 2024-09-18T01:24:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.401+0000 7f54c6ffd640 1 --2- 172.21.15.92:0/1501607608 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f54b40382d0 0x7f54b403a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.401+0000 7f54c6ffd640 1 --2- 172.21.15.92:0/1501607608 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f54b40382d0 0x7f54b403a790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f54c809cac0 tx=0x7f54bc001150 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.409+0000 7f54affff640 1 -- 172.21.15.92:0/1501607608 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54b803d3f0 con 0x7f54c809bd50 2024-09-18T01:24:59.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.435+0000 7f1c165d8640 1 Processor -- start 2024-09-18T01:24:59.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.435+0000 7f1c165d8640 1 -- start start 2024-09-18T01:24:59.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.435+0000 7fa6ab80e640 1 Processor -- start 2024-09-18T01:24:59.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.435+0000 7fa6ab80e640 1 -- start start 2024-09-18T01:24:59.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.435+0000 7f1c165d8640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1c1009a100 0x7f1c10133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.435+0000 7f1c165d8640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c1009d3b0 con 0x7f1c1009bd50 2024-09-18T01:24:59.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.435+0000 7f1c165d8640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f1c1009c840 con 0x7f1c1009a100 2024-09-18T01:24:59.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.435+0000 7f1c0f7fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1c1009a100 0x7f1c10133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.435+0000 7f1c0f7fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1c1009a100 0x7f1c10133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46234/0 (socket says 172.21.15.92:46234) 2024-09-18T01:24:59.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.435+0000 7f1c0f7fe640 1 -- 172.21.15.92:0/701382936 learned_addr learned my addr 172.21.15.92:0/701382936 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:59.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.436+0000 7fa6ab80e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa6a406f0b0 0x7fa6a4130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.436+0000 7fa6ab80e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6a4072780 con 0x7fa6a406e5c0 2024-09-18T01:24:59.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.436+0000 7fa6ab80e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fa6a4070000 con 0x7fa6a406f0b0 2024-09-18T01:24:59.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.436+0000 7f1c0f7fe640 1 -- 172.21.15.92:0/701382936 >> v1:172.21.15.92:6789/0 conn(0x7f1c1009bd50 legacy=0x7f1c1009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.436+0000 7fa6a8da9640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa6a406f0b0 0x7fa6a4130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.436+0000 7fa6a8da9640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa6a406f0b0 0x7fa6a4130ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46248/0 (socket says 172.21.15.92:46248) 2024-09-18T01:24:59.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.436+0000 7f1c0f7fe640 1 -- 172.21.15.92:0/701382936 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c10098230 con 0x7f1c1009a100 2024-09-18T01:24:59.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.436+0000 7fa6a8da9640 1 -- 172.21.15.92:0/4239075552 learned_addr learned my addr 172.21.15.92:0/4239075552 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:59.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.436+0000 7fa6a8da9640 1 -- 172.21.15.92:0/4239075552 >> v1:172.21.15.92:6789/0 conn(0x7fa6a406e5c0 legacy=0x7fa6a406e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-18T01:24:59.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.436+0000 7fa6a8da9640 1 -- 172.21.15.92:0/4239075552 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a4071460 con 0x7fa6a406f0b0 2024-09-18T01:24:59.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.437+0000 7f1c0f7fe640 1 --2- 172.21.15.92:0/701382936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c1009a100 0x7f1c10133da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c040097f0 tx=0x7f1c0402a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa21e8afa7e32596 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.437+0000 7f1c0effd640 1 -- 172.21.15.92:0/701382936 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c04037070 con 0x7f1c1009a100 2024-09-18T01:24:59.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.437+0000 7fa6a8da9640 1 --2- 172.21.15.92:0/4239075552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406f0b0 0x7fa6a4130ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa69400ba90 tx=0x7fa69402c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca16d7c61b2c7b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.437+0000 7f1c0effd640 1 -- 172.21.15.92:0/701382936 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c04032440 con 0x7f1c1009a100 2024-09-18T01:24:59.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.437+0000 7f1c0effd640 1 -- 172.21.15.92:0/701382936 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c04032740 con 0x7f1c1009a100 2024-09-18T01:24:59.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.437+0000 7fc2f9023640 1 Processor -- start 2024-09-18T01:24:59.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.437+0000 7fa69bfff640 1 -- 172.21.15.92:0/4239075552 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa694032640 con 0x7fa6a406f0b0 2024-09-18T01:24:59.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.437+0000 7fc2f9023640 1 -- start start 2024-09-18T01:24:59.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.437+0000 7fa69bfff640 1 -- 172.21.15.92:0/4239075552 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6940327e0 con 0x7fa6a406f0b0 2024-09-18T01:24:59.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.437+0000 7fa69bfff640 1 -- 172.21.15.92:0/4239075552 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa694032b00 con 0x7fa6a406f0b0 2024-09-18T01:24:59.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fa6ab80e640 1 -- 172.21.15.92:0/4239075552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406f0b0 msgr2=0x7fa6a4130ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fa6ab80e640 1 --2- 172.21.15.92:0/4239075552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406f0b0 0x7fa6a4130ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa69400ba90 tx=0x7fa69402c850 comp rx=0 tx=0).stop 2024-09-18T01:24:59.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7f1c165d8640 1 -- 172.21.15.92:0/701382936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c1009a100 msgr2=0x7f1c10133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7f1c165d8640 1 --2- 172.21.15.92:0/701382936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c1009a100 0x7f1c10133da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c040097f0 tx=0x7f1c0402a1f0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fc2f9023640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc2f412c850 0x7fc2f4131930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fa6ab80e640 1 -- 172.21.15.92:0/4239075552 shutdown_connections 2024-09-18T01:24:59.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fa6ab80e640 1 --2- 172.21.15.92:0/4239075552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406f0b0 0x7fa6a4130ce0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fc2f9023640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f412cda0 con 0x7fc2f412d1f0 2024-09-18T01:24:59.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fc2f2d9d640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc2f412d1f0 0x7fc2f40705f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39566/0 (socket says 172.21.15.92:39566) 2024-09-18T01:24:59.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fc2f9023640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f4070d00 con 0x7fc2f412c850 2024-09-18T01:24:59.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fa6ab80e640 1 -- 172.21.15.92:0/4239075552 >> 172.21.15.92:0/4239075552 conn(0x7fa6a409aa80 msgr2=0x7fa6a409ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fc2f2d9d640 1 -- 172.21.15.92:0/2732123546 learned_addr learned my addr 172.21.15.92:0/2732123546 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:24:59.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fc2ebfff640 1 --2- 172.21.15.92:0/2732123546 >> v2:172.21.15.92:3300/0 conn(0x7fc2f412c850 0x7fc2f4131930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7f1c165d8640 1 -- 172.21.15.92:0/701382936 shutdown_connections 2024-09-18T01:24:59.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7f1c165d8640 1 --2- 172.21.15.92:0/701382936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c1009a100 0x7f1c10133da0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7f1c165d8640 1 -- 172.21.15.92:0/701382936 >> 172.21.15.92:0/701382936 conn(0x7f1c1006d4a0 msgr2=0x7f1c1006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fa6ab80e640 1 -- 172.21.15.92:0/4239075552 shutdown_connections 2024-09-18T01:24:59.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7f1c165d8640 1 -- 172.21.15.92:0/701382936 shutdown_connections 2024-09-18T01:24:59.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fa6ab80e640 1 -- 172.21.15.92:0/4239075552 wait complete. 2024-09-18T01:24:59.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7f1c165d8640 1 -- 172.21.15.92:0/701382936 wait complete. 2024-09-18T01:24:59.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fc2ebfff640 1 -- 172.21.15.92:0/2732123546 >> v1:172.21.15.92:6789/0 conn(0x7fc2f412d1f0 legacy=0x7fc2f40705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.438+0000 7fc2ebfff640 1 -- 172.21.15.92:0/2732123546 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f40719d0 con 0x7fc2f412c850 2024-09-18T01:24:59.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.439+0000 7fa6ab80e640 1 Processor -- start 2024-09-18T01:24:59.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.439+0000 7f1c165d8640 1 Processor -- start 2024-09-18T01:24:59.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.439+0000 7fc2ebfff640 1 --2- 172.21.15.92:0/2732123546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f412c850 0x7fc2f4131930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009720 tx=0x7fc2dc02a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3898cfc98e80ea19 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.439+0000 7fa6ab80e640 1 -- start start 2024-09-18T01:24:59.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7fc2f259c640 1 -- 172.21.15.92:0/2732123546 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2dc037070 con 0x7fc2f412c850 2024-09-18T01:24:59.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7f1c165d8640 1 -- start start 2024-09-18T01:24:59.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7fc2f259c640 1 -- 172.21.15.92:0/2732123546 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2dc02abd0 con 0x7fc2f412c850 2024-09-18T01:24:59.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7fc2f259c640 1 -- 172.21.15.92:0/2732123546 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2dc037070 con 0x7fc2f412c850 2024-09-18T01:24:59.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7fa6ab80e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406e5c0 0x7fa6a4094470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7fa6ab80e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a406bba0 con 0x7fa6a406e5c0 2024-09-18T01:24:59.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7fa6a95aa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406e5c0 0x7fa6a4094470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7fa6a95aa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406e5c0 0x7fa6a4094470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46274/0 (socket says 172.21.15.92:46274) 2024-09-18T01:24:59.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7fa6a95aa640 1 -- 172.21.15.92:0/24121324 learned_addr learned my addr 172.21.15.92:0/24121324 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:59.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7f1c165d8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c1009a100 0x7f1c10094730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7f1c165d8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1c10134670 con 0x7f1c1009a100 2024-09-18T01:24:59.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7f1c0ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c1009a100 0x7f1c10094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7f1c0ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c1009a100 0x7f1c10094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46276/0 (socket says 172.21.15.92:46276) 2024-09-18T01:24:59.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7f1c0ffff640 1 -- 172.21.15.92:0/1631881119 learned_addr learned my addr 172.21.15.92:0/1631881119 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:59.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7fc2f9023640 1 -- 172.21.15.92:0/2732123546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f412c850 msgr2=0x7fc2f4131930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7fc2f9023640 1 --2- 172.21.15.92:0/2732123546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f412c850 0x7fc2f4131930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009720 tx=0x7fc2dc02a010 comp rx=0 tx=0).stop 2024-09-18T01:24:59.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.440+0000 7fa6a95aa640 1 -- 172.21.15.92:0/24121324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a4096560 con 0x7fa6a406e5c0 2024-09-18T01:24:59.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7fc2f9023640 1 -- 172.21.15.92:0/2732123546 shutdown_connections 2024-09-18T01:24:59.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7fc2f9023640 1 --2- 172.21.15.92:0/2732123546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f412c850 0x7fc2f4131930 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7fc2f9023640 1 -- 172.21.15.92:0/2732123546 >> 172.21.15.92:0/2732123546 conn(0x7fc2f409cbe0 msgr2=0x7fc2f409cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7f1c0ffff640 1 -- 172.21.15.92:0/1631881119 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c10126190 con 0x7f1c1009a100 2024-09-18T01:24:59.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7fc2f9023640 1 -- 172.21.15.92:0/2732123546 shutdown_connections 2024-09-18T01:24:59.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7fa6a95aa640 1 --2- 172.21.15.92:0/24121324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406e5c0 0x7fa6a4094470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000b360 tx=0x7fa6a000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7fc2f9023640 1 -- 172.21.15.92:0/2732123546 wait complete. 2024-09-18T01:24:59.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7f1c0ffff640 1 --2- 172.21.15.92:0/1631881119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c1009a100 0x7f1c10094730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000c450 tx=0x7f1c0000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7fa699ffb640 1 -- 172.21.15.92:0/24121324 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a0015020 con 0x7fa6a406e5c0 2024-09-18T01:24:59.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7fa6ab80e640 1 -- 172.21.15.92:0/24121324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a4097960 con 0x7fa6a406e5c0 2024-09-18T01:24:59.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7fa699ffb640 1 -- 172.21.15.92:0/24121324 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a0011760 con 0x7fa6a406e5c0 2024-09-18T01:24:59.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7f1c0cff9640 1 -- 172.21.15.92:0/1631881119 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c00017070 con 0x7f1c1009a100 2024-09-18T01:24:59.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7f1c0cff9640 1 -- 172.21.15.92:0/1631881119 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c00005220 con 0x7f1c1009a100 2024-09-18T01:24:59.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7f1c165d8640 1 -- 172.21.15.92:0/1631881119 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c10097270 con 0x7f1c1009a100 2024-09-18T01:24:59.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7f1c0cff9640 1 -- 172.21.15.92:0/1631881119 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c000035f0 con 0x7f1c1009a100 2024-09-18T01:24:59.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7fa699ffb640 1 -- 172.21.15.92:0/24121324 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a0015020 con 0x7fa6a406e5c0 2024-09-18T01:24:59.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7f1c165d8640 1 -- 172.21.15.92:0/1631881119 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c10094e50 con 0x7f1c1009a100 2024-09-18T01:24:59.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.441+0000 7fa6ab80e640 1 -- 172.21.15.92:0/24121324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a4094b90 con 0x7fa6a406e5c0 2024-09-18T01:24:59.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.442+0000 7fc2f9023640 1 Processor -- start 2024-09-18T01:24:59.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.442+0000 7f1c0cff9640 1 -- 172.21.15.92:0/1631881119 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1c0001a070 con 0x7f1c1009a100 2024-09-18T01:24:59.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.442+0000 7fc2f9023640 1 -- start start 2024-09-18T01:24:59.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.443+0000 7f1c165d8640 1 -- 172.21.15.92:0/1631881119 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c100a1d10 con 0x7f1c1009a100 2024-09-18T01:24:59.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.443+0000 7f1c0cff9640 1 --2- 172.21.15.92:0/1631881119 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1bfc0382f0 0x7f1bfc03a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.443+0000 7fa6ab80e640 1 -- 172.21.15.92:0/24121324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a409ec30 con 0x7fa6a406e5c0 2024-09-18T01:24:59.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.443+0000 7fa699ffb640 1 -- 172.21.15.92:0/24121324 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa6a0018020 con 0x7fa6a406e5c0 2024-09-18T01:24:59.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.443+0000 7f1c0cff9640 1 -- 172.21.15.92:0/1631881119 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f1c0004a5d0 con 0x7f1c1009a100 2024-09-18T01:24:59.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.443+0000 7fa699ffb640 1 --2- 172.21.15.92:0/24121324 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa688038430 0x7fa68803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.443+0000 7fc2f9023640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f412c850 0x7fc2f4097b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.443+0000 7fa699ffb640 1 -- 172.21.15.92:0/24121324 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fa6a004af60 con 0x7fa6a406e5c0 2024-09-18T01:24:59.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.443+0000 7fc2f9023640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4131ff0 con 0x7fc2f412c850 2024-09-18T01:24:59.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.443+0000 7f1c0f7fe640 1 --2- 172.21.15.92:0/1631881119 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1bfc0382f0 0x7f1bfc03a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.443+0000 7fa6a8da9640 1 --2- 172.21.15.92:0/24121324 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa688038430 0x7fa68803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.443+0000 7fc2f2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f412c850 0x7fc2f4097b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.443+0000 7fc2f2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f412c850 0x7fc2f4097b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46284/0 (socket says 172.21.15.92:46284) 2024-09-18T01:24:59.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.443+0000 7fc2f2d9d640 1 -- 172.21.15.92:0/2883681025 learned_addr learned my addr 172.21.15.92:0/2883681025 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:24:59.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.444+0000 7fc2f2d9d640 1 -- 172.21.15.92:0/2883681025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f4130490 con 0x7fc2f412c850 2024-09-18T01:24:59.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.444+0000 7f1c0f7fe640 1 --2- 172.21.15.92:0/1631881119 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1bfc0382f0 0x7f1bfc03a7b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1c04034000 tx=0x7f1c0402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.444+0000 7fa6a8da9640 1 --2- 172.21.15.92:0/24121324 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa688038430 0x7fa68803a8f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa694037000 tx=0x7fa694032000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.444+0000 7fc2f2d9d640 1 --2- 172.21.15.92:0/2883681025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f412c850 0x7fc2f4097b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400c700 tx=0x7fc2e400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.448+0000 7f1c0cff9640 1 -- 172.21.15.92:0/1631881119 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c1009d3b0 con 0x7f1c1009a100 2024-09-18T01:24:59.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.452+0000 7fc2eb7fe640 1 -- 172.21.15.92:0/2883681025 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2e4018070 con 0x7fc2f412c850 2024-09-18T01:24:59.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.452+0000 7fc2eb7fe640 1 -- 172.21.15.92:0/2883681025 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e4007200 con 0x7fc2f412c850 2024-09-18T01:24:59.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.452+0000 7fc2eb7fe640 1 -- 172.21.15.92:0/2883681025 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2e4007520 con 0x7fc2f412c850 2024-09-18T01:24:59.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.452+0000 7fc2f9023640 1 -- 172.21.15.92:0/2883681025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f408b370 con 0x7fc2f412c850 2024-09-18T01:24:59.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.452+0000 7fa699ffb640 1 -- 172.21.15.92:0/24121324 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6a001f020 con 0x7fa6a406e5c0 2024-09-18T01:24:59.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.452+0000 7fc2f9023640 1 -- 172.21.15.92:0/2883681025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f4098260 con 0x7fc2f412c850 2024-09-18T01:24:59.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.453+0000 7fc2eb7fe640 1 -- 172.21.15.92:0/2883681025 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc2e401b070 con 0x7fc2f412c850 2024-09-18T01:24:59.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.454+0000 7fc2eb7fe640 1 --2- 172.21.15.92:0/2883681025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc2d403c700 0x7fc2d403ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:24:59.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.454+0000 7fc2eb7fe640 1 -- 172.21.15.92:0/2883681025 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fc2e404a7c0 con 0x7fc2f412c850 2024-09-18T01:24:59.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.454+0000 7fc2ebfff640 1 --2- 172.21.15.92:0/2883681025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc2d403c700 0x7fc2d403ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:24:59.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.454+0000 7fc2f9023640 1 -- 172.21.15.92:0/2883681025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f40705f0 con 0x7fc2f412c850 2024-09-18T01:24:59.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.455+0000 7fc2ebfff640 1 --2- 172.21.15.92:0/2883681025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc2d403c700 0x7fc2d403ebc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc034000 tx=0x7fc2dc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:24:59.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.464+0000 7fc2eb7fe640 1 -- 172.21.15.92:0/2883681025 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2e4010300 con 0x7fc2f412c850 2024-09-18T01:24:59.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.589+0000 7f54cde65640 1 -- 172.21.15.92:0/1501607608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f54c81ab240 con 0x7f54c809bd50 2024-09-18T01:24:59.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.589+0000 7f54affff640 1 -- 172.21.15.92:0/1501607608 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f54b804e350 con 0x7f54c809bd50 2024-09-18T01:24:59.591 INFO:teuthology.orchestra.run.smithi092.stdout:42949672965 2024-09-18T01:24:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.591+0000 7f54cde65640 1 -- 172.21.15.92:0/1501607608 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f54b40382d0 msgr2=0x7f54b403a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.591+0000 7f54cde65640 1 --2- 172.21.15.92:0/1501607608 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f54b40382d0 0x7f54b403a790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f54c809cac0 tx=0x7f54bc001150 comp rx=0 tx=0).stop 2024-09-18T01:24:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.591+0000 7f54cde65640 1 -- 172.21.15.92:0/1501607608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54c809bd50 msgr2=0x7f54c8094440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.591+0000 7f54cde65640 1 --2- 172.21.15.92:0/1501607608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54c809bd50 0x7f54c8094440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f54b8000c00 tx=0x7f54b80046c0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.591+0000 7f54cde65640 1 -- 172.21.15.92:0/1501607608 shutdown_connections 2024-09-18T01:24:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.591+0000 7f54cde65640 1 --2- 172.21.15.92:0/1501607608 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f54b40382d0 0x7f54b403a790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.591+0000 7f54cde65640 1 --2- 172.21.15.92:0/1501607608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54c809bd50 0x7f54c8094440 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.591+0000 7f54cde65640 1 -- 172.21.15.92:0/1501607608 >> 172.21.15.92:0/1501607608 conn(0x7f54c806d4a0 msgr2=0x7f54c809eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.591+0000 7f54cde65640 1 -- 172.21.15.92:0/1501607608 shutdown_connections 2024-09-18T01:24:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.591+0000 7f54cde65640 1 -- 172.21.15.92:0/1501607608 wait complete. 2024-09-18T01:24:59.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.1 2024-09-18T01:24:59.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.627+0000 7f1c165d8640 1 -- 172.21.15.92:0/1631881119 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1c10096cb0 con 0x7f1c1009a100 2024-09-18T01:24:59.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.628+0000 7fa6ab80e640 1 -- 172.21.15.92:0/24121324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa6a4096ce0 con 0x7fa6a406e5c0 2024-09-18T01:24:59.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.628+0000 7f1c0cff9640 1 -- 172.21.15.92:0/1631881119 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1c0001ac60 con 0x7f1c1009a100 2024-09-18T01:24:59.630 INFO:teuthology.orchestra.run.smithi092.stdout:38654705668 2024-09-18T01:24:59.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.628+0000 7fa699ffb640 1 -- 172.21.15.92:0/24121324 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa6a001f020 con 0x7fa6a406e5c0 2024-09-18T01:24:59.630 INFO:teuthology.orchestra.run.smithi092.stdout:42949672964 2024-09-18T01:24:59.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7f1c165d8640 1 -- 172.21.15.92:0/1631881119 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1bfc0382f0 msgr2=0x7f1bfc03a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7f1c165d8640 1 --2- 172.21.15.92:0/1631881119 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1bfc0382f0 0x7f1bfc03a7b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1c04034000 tx=0x7f1c0402e000 comp rx=0 tx=0).stop 2024-09-18T01:24:59.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7f1c165d8640 1 -- 172.21.15.92:0/1631881119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c1009a100 msgr2=0x7f1c10094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7f1c165d8640 1 --2- 172.21.15.92:0/1631881119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c1009a100 0x7f1c10094730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000c450 tx=0x7f1c0000c910 comp rx=0 tx=0).stop 2024-09-18T01:24:59.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7f1c165d8640 1 -- 172.21.15.92:0/1631881119 shutdown_connections 2024-09-18T01:24:59.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7f1c165d8640 1 --2- 172.21.15.92:0/1631881119 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1bfc0382f0 0x7f1bfc03a7b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7f1c165d8640 1 --2- 172.21.15.92:0/1631881119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c1009a100 0x7f1c10094730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7f1c165d8640 1 -- 172.21.15.92:0/1631881119 >> 172.21.15.92:0/1631881119 conn(0x7f1c1006d4a0 msgr2=0x7f1c1008d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7fa6ab80e640 1 -- 172.21.15.92:0/24121324 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa688038430 msgr2=0x7fa68803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7fa6ab80e640 1 --2- 172.21.15.92:0/24121324 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa688038430 0x7fa68803a8f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa694037000 tx=0x7fa694032000 comp rx=0 tx=0).stop 2024-09-18T01:24:59.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7fa6ab80e640 1 -- 172.21.15.92:0/24121324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406e5c0 msgr2=0x7fa6a4094470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7fa6ab80e640 1 --2- 172.21.15.92:0/24121324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406e5c0 0x7fa6a4094470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000b360 tx=0x7fa6a000b820 comp rx=0 tx=0).stop 2024-09-18T01:24:59.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7f1c165d8640 1 -- 172.21.15.92:0/1631881119 shutdown_connections 2024-09-18T01:24:59.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7f1c165d8640 1 -- 172.21.15.92:0/1631881119 wait complete. 2024-09-18T01:24:59.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7fa6ab80e640 1 -- 172.21.15.92:0/24121324 shutdown_connections 2024-09-18T01:24:59.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7fa6ab80e640 1 --2- 172.21.15.92:0/24121324 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa688038430 0x7fa68803a8f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7fa6ab80e640 1 --2- 172.21.15.92:0/24121324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406e5c0 0x7fa6a4094470 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7fa6ab80e640 1 -- 172.21.15.92:0/24121324 >> 172.21.15.92:0/24121324 conn(0x7fa6a409aa80 msgr2=0x7fa6a408cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7fa6ab80e640 1 -- 172.21.15.92:0/24121324 shutdown_connections 2024-09-18T01:24:59.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.630+0000 7fa6ab80e640 1 -- 172.21.15.92:0/24121324 wait complete. 2024-09-18T01:24:59.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-09-18T01:24:59.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.3 2024-09-18T01:24:59.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.647+0000 7fc2f9023640 1 -- 172.21.15.92:0/2883681025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc2f4075b40 con 0x7fc2f412c850 2024-09-18T01:24:59.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.648+0000 7fc2eb7fe640 1 -- 172.21.15.92:0/2883681025 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc2e401be30 con 0x7fc2f412c850 2024-09-18T01:24:59.649 INFO:teuthology.orchestra.run.smithi092.stdout:42949672964 2024-09-18T01:24:59.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.650+0000 7fc2f9023640 1 -- 172.21.15.92:0/2883681025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc2d403c700 msgr2=0x7fc2d403ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.650+0000 7fc2f9023640 1 --2- 172.21.15.92:0/2883681025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc2d403c700 0x7fc2d403ebc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc034000 tx=0x7fc2dc02e000 comp rx=0 tx=0).stop 2024-09-18T01:24:59.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.650+0000 7fc2f9023640 1 -- 172.21.15.92:0/2883681025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f412c850 msgr2=0x7fc2f4097b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:24:59.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.650+0000 7fc2f9023640 1 --2- 172.21.15.92:0/2883681025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f412c850 0x7fc2f4097b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400c700 tx=0x7fc2e400cbc0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.650+0000 7fc2f9023640 1 -- 172.21.15.92:0/2883681025 shutdown_connections 2024-09-18T01:24:59.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.650+0000 7fc2f9023640 1 --2- 172.21.15.92:0/2883681025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc2d403c700 0x7fc2d403ebc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.650+0000 7fc2f9023640 1 --2- 172.21.15.92:0/2883681025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f412c850 0x7fc2f4097b40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:24:59.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.650+0000 7fc2f9023640 1 -- 172.21.15.92:0/2883681025 >> 172.21.15.92:0/2883681025 conn(0x7fc2f409cbe0 msgr2=0x7fc2f4129020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:24:59.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.650+0000 7fc2f9023640 1 -- 172.21.15.92:0/2883681025 shutdown_connections 2024-09-18T01:24:59.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:24:59.650+0000 7fc2f9023640 1 -- 172.21.15.92:0/2883681025 wait complete. 2024-09-18T01:24:59.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.2 2024-09-18T01:25:00.609 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T01:25:00.647 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T01:25:00.647 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T01:25:00.663 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T01:25:00.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.729+0000 7fde444dd640 1 Processor -- start 2024-09-18T01:25:00.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.729+0000 7fde444dd640 1 -- start start 2024-09-18T01:25:00.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.730+0000 7fde444dd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fde3c09a100 0x7fde3c133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:00.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.730+0000 7fde444dd640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde3c09d3b0 con 0x7fde3c09bd50 2024-09-18T01:25:00.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.730+0000 7fde444dd640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fde3c09c840 con 0x7fde3c09a100 2024-09-18T01:25:00.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.731+0000 7fde42279640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fde3c09bd50 0x7fde3c09c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39576/0 (socket says 172.21.15.92:39576) 2024-09-18T01:25:00.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.731+0000 7fde41a78640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fde3c09a100 0x7fde3c133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:00.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.731+0000 7fde42279640 1 -- 172.21.15.92:0/2484516598 learned_addr learned my addr 172.21.15.92:0/2484516598 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:25:00.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.731+0000 7fde41277640 1 -- 172.21.15.92:0/2484516598 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 871694354 0 0) 0x7fde38001110 con 0x7fde3c09bd50 2024-09-18T01:25:00.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.731+0000 7fde41277640 1 -- 172.21.15.92:0/2484516598 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde28003520 con 0x7fde3c09bd50 2024-09-18T01:25:00.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.731+0000 7fde41a78640 1 -- 172.21.15.92:0/2484516598 >> v1:172.21.15.92:6789/0 conn(0x7fde3c09bd50 legacy=0x7fde3c09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:00.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.731+0000 7fde41277640 1 -- 172.21.15.92:0/2484516598 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1964133244 0 0) 0x7fde28003520 con 0x7fde3c09bd50 2024-09-18T01:25:00.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.731+0000 7fde41a78640 1 -- 172.21.15.92:0/2484516598 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde3c098230 con 0x7fde3c09a100 2024-09-18T01:25:00.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.732+0000 7fde41a78640 1 --2- 172.21.15.92:0/2484516598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3c09a100 0x7fde3c133da0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fde30009720 tx=0x7fde3002a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618d611f8b92ddea server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:00.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.732+0000 7fde41277640 1 -- 172.21.15.92:0/2484516598 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde30037070 con 0x7fde3c09a100 2024-09-18T01:25:00.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.733+0000 7fde41277640 1 -- 172.21.15.92:0/2484516598 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3002ab30 con 0x7fde3c09a100 2024-09-18T01:25:00.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.733+0000 7fde41277640 1 -- 172.21.15.92:0/2484516598 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde38001770 con 0x7fde3c09a100 2024-09-18T01:25:00.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.734+0000 7fde444dd640 1 -- 172.21.15.92:0/2484516598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3c09a100 msgr2=0x7fde3c133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:00.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.734+0000 7fde444dd640 1 --2- 172.21.15.92:0/2484516598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3c09a100 0x7fde3c133da0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fde30009720 tx=0x7fde3002a0a0 comp rx=0 tx=0).stop 2024-09-18T01:25:00.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.734+0000 7fde444dd640 1 -- 172.21.15.92:0/2484516598 shutdown_connections 2024-09-18T01:25:00.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.734+0000 7fde444dd640 1 --2- 172.21.15.92:0/2484516598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3c09a100 0x7fde3c133da0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:00.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.734+0000 7fde444dd640 1 -- 172.21.15.92:0/2484516598 >> 172.21.15.92:0/2484516598 conn(0x7fde3c06d4a0 msgr2=0x7fde3c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:00.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.734+0000 7fde444dd640 1 -- 172.21.15.92:0/2484516598 shutdown_connections 2024-09-18T01:25:00.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.734+0000 7fde444dd640 1 -- 172.21.15.92:0/2484516598 wait complete. 2024-09-18T01:25:00.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.735+0000 7fde444dd640 1 Processor -- start 2024-09-18T01:25:00.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.735+0000 7fde444dd640 1 -- start start 2024-09-18T01:25:00.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.735+0000 7fde444dd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3c09a100 0x7fde3c1c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:00.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.735+0000 7fde444dd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c134670 con 0x7fde3c09a100 2024-09-18T01:25:00.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.735+0000 7fde42279640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3c09a100 0x7fde3c1c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:00.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.735+0000 7fde42279640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3c09a100 0x7fde3c1c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46302/0 (socket says 172.21.15.92:46302) 2024-09-18T01:25:00.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.735+0000 7fde42279640 1 -- 172.21.15.92:0/4192367696 learned_addr learned my addr 172.21.15.92:0/4192367696 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:00.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.736+0000 7fde42279640 1 -- 172.21.15.92:0/4192367696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde3c133200 con 0x7fde3c09a100 2024-09-18T01:25:00.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.736+0000 7fde42279640 1 --2- 172.21.15.92:0/4192367696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3c09a100 0x7fde3c1c7840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fde3800c6d0 tx=0x7fde3800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:00.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.736+0000 7fde2effd640 1 -- 172.21.15.92:0/4192367696 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde38017070 con 0x7fde3c09a100 2024-09-18T01:25:00.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.736+0000 7fde2effd640 1 -- 172.21.15.92:0/4192367696 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde380058d0 con 0x7fde3c09a100 2024-09-18T01:25:00.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.736+0000 7fde444dd640 1 -- 172.21.15.92:0/4192367696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde3c08db20 con 0x7fde3c09a100 2024-09-18T01:25:00.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.736+0000 7fde2effd640 1 -- 172.21.15.92:0/4192367696 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde38005c30 con 0x7fde3c09a100 2024-09-18T01:25:00.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.736+0000 7fde444dd640 1 -- 172.21.15.92:0/4192367696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde3c08d3b0 con 0x7fde3c09a100 2024-09-18T01:25:00.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.738+0000 7fde2effd640 1 -- 172.21.15.92:0/4192367696 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fde3801a070 con 0x7fde3c09a100 2024-09-18T01:25:00.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.738+0000 7fde444dd640 1 -- 172.21.15.92:0/4192367696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde3c0008d0 con 0x7fde3c09a100 2024-09-18T01:25:00.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.738+0000 7fde2effd640 1 --2- 172.21.15.92:0/4192367696 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fde200382a0 0x7fde2003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:00.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.738+0000 7fde2effd640 1 -- 172.21.15.92:0/4192367696 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fde3804a5e0 con 0x7fde3c09a100 2024-09-18T01:25:00.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.738+0000 7fde41a78640 1 --2- 172.21.15.92:0/4192367696 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fde200382a0 0x7fde2003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:00.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.739+0000 7fde41a78640 1 --2- 172.21.15.92:0/4192367696 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fde200382a0 0x7fde2003a760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fde30034000 tx=0x7fde3002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:00.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.743+0000 7fde2effd640 1 -- 172.21.15.92:0/4192367696 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde3c09d3b0 con 0x7fde3c09a100 2024-09-18T01:25:00.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.770+0000 7f7b20e8d640 1 Processor -- start 2024-09-18T01:25:00.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.770+0000 7f7b20e8d640 1 -- start start 2024-09-18T01:25:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.771+0000 7f7b20e8d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7b1c12c570 0x7f7b1c12c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.771+0000 7f7b20e8d640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1c131890 con 0x7f7b1c098a20 2024-09-18T01:25:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.771+0000 7f7b20e8d640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1c098550 con 0x7f7b1c12c570 2024-09-18T01:25:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.771+0000 7f7b1a59c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7b1c12c570 0x7f7b1c12c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.771+0000 7f7b1a59c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7b1c12c570 0x7f7b1c12c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46316/0 (socket says 172.21.15.92:46316) 2024-09-18T01:25:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.771+0000 7f7b1a59c640 1 -- 172.21.15.92:0/3756139114 learned_addr learned my addr 172.21.15.92:0/3756139114 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.771+0000 7f7b19d9b640 1 --1- 172.21.15.92:0/3756139114 >> v1:172.21.15.92:6789/0 conn(0x7f7b1c098a20 0x7f7b1c12ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39592/0 (socket says 172.21.15.92:39592) 2024-09-18T01:25:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.771+0000 7f7b1a59c640 1 -- 172.21.15.92:0/3756139114 >> v1:172.21.15.92:6789/0 conn(0x7f7b1c098a20 legacy=0x7f7b1c12ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.771+0000 7f7b1959a640 1 -- 172.21.15.92:0/3756139114 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3952233702 0 0) 0x7f7b1c131890 con 0x7f7b1c098a20 2024-09-18T01:25:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.771+0000 7f7b1a59c640 1 -- 172.21.15.92:0/3756139114 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c132a70 con 0x7f7b1c12c570 2024-09-18T01:25:00.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.772+0000 7fc98bcdd640 1 Processor -- start 2024-09-18T01:25:00.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.772+0000 7f7b1a59c640 1 --2- 172.21.15.92:0/3756139114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1c12c570 0x7f7b1c12c950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0097f0 tx=0x7f7b0c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e0ac1ab704ed71 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:00.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7f7b1959a640 1 -- 172.21.15.92:0/3756139114 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c037070 con 0x7f7b1c12c570 2024-09-18T01:25:00.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7fc98bcdd640 1 -- start start 2024-09-18T01:25:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7f7b1959a640 1 -- 172.21.15.92:0/3756139114 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c032440 con 0x7f7b1c12c570 2024-09-18T01:25:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7f7b1959a640 1 -- 172.21.15.92:0/3756139114 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c02ae60 con 0x7f7b1c12c570 2024-09-18T01:25:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7fc98bcdd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc984092c20 0x7fc984130230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7fc98bcdd640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98409a4a0 con 0x7fc984092130 2024-09-18T01:25:00.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7fc98bcdd640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fc984093790 con 0x7fc984092c20 2024-09-18T01:25:00.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7fc989278640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc984092c20 0x7fc984130230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:00.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7fc989278640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc984092c20 0x7fc984130230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46318/0 (socket says 172.21.15.92:46318) 2024-09-18T01:25:00.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7fc989278640 1 -- 172.21.15.92:0/465563581 learned_addr learned my addr 172.21.15.92:0/465563581 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:00.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7fc989a79640 1 --1- 172.21.15.92:0/465563581 >> v1:172.21.15.92:6789/0 conn(0x7fc984092130 0x7fc984092510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39598/0 (socket says 172.21.15.92:39598) 2024-09-18T01:25:00.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7f7b20e8d640 1 -- 172.21.15.92:0/3756139114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1c12c570 msgr2=0x7f7b1c12c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:00.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7f7b20e8d640 1 --2- 172.21.15.92:0/3756139114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1c12c570 0x7f7b1c12c950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0097f0 tx=0x7f7b0c02a1e0 comp rx=0 tx=0).stop 2024-09-18T01:25:00.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7fc989278640 1 -- 172.21.15.92:0/465563581 >> v1:172.21.15.92:6789/0 conn(0x7fc984092130 legacy=0x7fc984092510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:00.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.773+0000 7fc989278640 1 -- 172.21.15.92:0/465563581 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc984093fd0 con 0x7fc984092c20 2024-09-18T01:25:00.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.774+0000 7f7b20e8d640 1 -- 172.21.15.92:0/3756139114 shutdown_connections 2024-09-18T01:25:00.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.774+0000 7f7b20e8d640 1 --2- 172.21.15.92:0/3756139114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1c12c570 0x7f7b1c12c950 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:00.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.774+0000 7f7b20e8d640 1 -- 172.21.15.92:0/3756139114 >> 172.21.15.92:0/3756139114 conn(0x7f7b1c09f020 msgr2=0x7f7b1c09f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:00.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.774+0000 7f7b20e8d640 1 -- 172.21.15.92:0/3756139114 shutdown_connections 2024-09-18T01:25:00.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.774+0000 7f7b20e8d640 1 -- 172.21.15.92:0/3756139114 wait complete. 2024-09-18T01:25:00.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.774+0000 7fc989278640 1 --2- 172.21.15.92:0/465563581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc984092c20 0x7fc984130230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc9800097f0 tx=0x7fc98002c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6007518480d6088c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:00.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.775+0000 7fc988a77640 1 -- 172.21.15.92:0/465563581 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc980038070 con 0x7fc984092c20 2024-09-18T01:25:00.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.775+0000 7fc988a77640 1 -- 172.21.15.92:0/465563581 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc980031640 con 0x7fc984092c20 2024-09-18T01:25:00.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.775+0000 7fc988a77640 1 -- 172.21.15.92:0/465563581 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc980031940 con 0x7fc984092c20 2024-09-18T01:25:00.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.775+0000 7f7b20e8d640 1 Processor -- start 2024-09-18T01:25:00.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.775+0000 7f7b20e8d640 1 -- start start 2024-09-18T01:25:00.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.775+0000 7f7b20e8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1c098a20 0x7f7b1c1c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:00.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.775+0000 7f7b20e8d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c131df0 con 0x7f7b1c098a20 2024-09-18T01:25:00.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.775+0000 7fc98bcdd640 1 -- 172.21.15.92:0/465563581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc984092c20 msgr2=0x7fc984130230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:00.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.775+0000 7fc98bcdd640 1 --2- 172.21.15.92:0/465563581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc984092c20 0x7fc984130230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc9800097f0 tx=0x7fc98002c410 comp rx=0 tx=0).stop 2024-09-18T01:25:00.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.775+0000 7f7b1a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1c098a20 0x7f7b1c1c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:00.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.775+0000 7f7b1a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1c098a20 0x7f7b1c1c0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46322/0 (socket says 172.21.15.92:46322) 2024-09-18T01:25:00.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.775+0000 7fc98bcdd640 1 -- 172.21.15.92:0/465563581 shutdown_connections 2024-09-18T01:25:00.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.776+0000 7fc98bcdd640 1 --2- 172.21.15.92:0/465563581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc984092c20 0x7fc984130230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:00.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.776+0000 7fc98bcdd640 1 -- 172.21.15.92:0/465563581 >> 172.21.15.92:0/465563581 conn(0x7fc98409d6e0 msgr2=0x7fc984099bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:00.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.775+0000 7f7b1a59c640 1 -- 172.21.15.92:0/2430260222 learned_addr learned my addr 172.21.15.92:0/2430260222 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:00.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.776+0000 7fc98bcdd640 1 -- 172.21.15.92:0/465563581 shutdown_connections 2024-09-18T01:25:00.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.776+0000 7fc98bcdd640 1 -- 172.21.15.92:0/465563581 wait complete. 2024-09-18T01:25:00.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.776+0000 7f7b1a59c640 1 -- 172.21.15.92:0/2430260222 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c129900 con 0x7f7b1c098a20 2024-09-18T01:25:00.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.776+0000 7f7b1a59c640 1 --2- 172.21.15.92:0/2430260222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1c098a20 0x7f7b1c1c0e40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c02a220 tx=0x7f7b0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:00.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.776+0000 7f7b0affd640 1 -- 172.21.15.92:0/2430260222 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c037040 con 0x7f7b1c098a20 2024-09-18T01:25:00.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.776+0000 7f7b0affd640 1 -- 172.21.15.92:0/2430260222 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c004160 con 0x7f7b1c098a20 2024-09-18T01:25:00.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.776+0000 7f7b20e8d640 1 -- 172.21.15.92:0/2430260222 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1c072180 con 0x7f7b1c098a20 2024-09-18T01:25:00.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.776+0000 7f7b0affd640 1 -- 172.21.15.92:0/2430260222 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c004440 con 0x7f7b1c098a20 2024-09-18T01:25:00.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.776+0000 7f7b20e8d640 1 -- 172.21.15.92:0/2430260222 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1c071a30 con 0x7f7b1c098a20 2024-09-18T01:25:00.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.777+0000 7fc98bcdd640 1 Processor -- start 2024-09-18T01:25:00.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.777+0000 7fc98bcdd640 1 -- start start 2024-09-18T01:25:00.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.777+0000 7fc98bcdd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc984092130 0x7fc9841c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:00.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.777+0000 7fc98bcdd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc984075040 con 0x7fc984092130 2024-09-18T01:25:00.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.777+0000 7fc989a79640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc984092130 0x7fc9841c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:00.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.777+0000 7f7b20e8d640 1 -- 172.21.15.92:0/2430260222 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1c070460 con 0x7f7b1c098a20 2024-09-18T01:25:00.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.777+0000 7f7b0affd640 1 -- 172.21.15.92:0/2430260222 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7b0c03a070 con 0x7f7b1c098a20 2024-09-18T01:25:00.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.778+0000 7fc989a79640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc984092130 0x7fc9841c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46330/0 (socket says 172.21.15.92:46330) 2024-09-18T01:25:00.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.778+0000 7fc989a79640 1 -- 172.21.15.92:0/1816238250 learned_addr learned my addr 172.21.15.92:0/1816238250 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:00.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.778+0000 7f7b0affd640 1 --2- 172.21.15.92:0/2430260222 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7afc0382f0 0x7f7afc03a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:00.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.778+0000 7f7b0affd640 1 -- 172.21.15.92:0/2430260222 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f7b0c06bcf0 con 0x7f7b1c098a20 2024-09-18T01:25:00.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.778+0000 7fc989a79640 1 -- 172.21.15.92:0/1816238250 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9841af9c0 con 0x7fc984092130 2024-09-18T01:25:00.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.778+0000 7fc989a79640 1 --2- 172.21.15.92:0/1816238250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc984092130 0x7fc9841c4520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc97400c360 tx=0x7fc97400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:00.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.778+0000 7f7b19d9b640 1 --2- 172.21.15.92:0/2430260222 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7afc0382f0 0x7f7afc03a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:00.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.779+0000 7f7b19d9b640 1 --2- 172.21.15.92:0/2430260222 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7afc0382f0 0x7f7afc03a7b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7b10000c00 tx=0x7f7b10007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:00.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.782+0000 7fc97a7fc640 1 -- 172.21.15.92:0/1816238250 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc974007410 con 0x7fc984092130 2024-09-18T01:25:00.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.783+0000 7fc97a7fc640 1 -- 172.21.15.92:0/1816238250 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9740075b0 con 0x7fc984092130 2024-09-18T01:25:00.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.783+0000 7fc98bcdd640 1 -- 172.21.15.92:0/1816238250 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc984096920 con 0x7fc984092130 2024-09-18T01:25:00.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.783+0000 7f7b0affd640 1 -- 172.21.15.92:0/2430260222 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b0c041020 con 0x7f7b1c098a20 2024-09-18T01:25:00.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.783+0000 7fc97a7fc640 1 -- 172.21.15.92:0/1816238250 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc974007410 con 0x7fc984092130 2024-09-18T01:25:00.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.783+0000 7fc98bcdd640 1 -- 172.21.15.92:0/1816238250 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9841afc60 con 0x7fc984092130 2024-09-18T01:25:00.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.784+0000 7fc98bcdd640 1 -- 172.21.15.92:0/1816238250 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc984092510 con 0x7fc984092130 2024-09-18T01:25:00.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.784+0000 7fc97a7fc640 1 -- 172.21.15.92:0/1816238250 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc97401a020 con 0x7fc984092130 2024-09-18T01:25:00.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.784+0000 7fc97a7fc640 1 --2- 172.21.15.92:0/1816238250 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc9680385e0 0x7fc96803aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:00.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.784+0000 7fc97a7fc640 1 -- 172.21.15.92:0/1816238250 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fc9740047e0 con 0x7fc984092130 2024-09-18T01:25:00.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.784+0000 7fc989278640 1 --2- 172.21.15.92:0/1816238250 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc9680385e0 0x7fc96803aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:00.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.785+0000 7fc989278640 1 --2- 172.21.15.92:0/1816238250 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc9680385e0 0x7fc96803aaa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc980035000 tx=0x7fc980008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:00.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.789+0000 7fc97a7fc640 1 -- 172.21.15.92:0/1816238250 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc9841af9c0 con 0x7fc984092130 2024-09-18T01:25:00.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.834+0000 7fe17b6d7640 1 Processor -- start 2024-09-18T01:25:00.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.834+0000 7fe17b6d7640 1 -- start start 2024-09-18T01:25:00.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.835+0000 7fe17b6d7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe17409a100 0x7fe174133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:00.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.835+0000 7fe17b6d7640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17409d3b0 con 0x7fe17409bd50 2024-09-18T01:25:00.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.835+0000 7fe17b6d7640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fe17409c840 con 0x7fe17409a100 2024-09-18T01:25:00.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.835+0000 7fe179473640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fe17409bd50 0x7fe17409c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39602/0 (socket says 172.21.15.92:39602) 2024-09-18T01:25:00.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.835+0000 7fe179473640 1 -- 172.21.15.92:0/110155883 learned_addr learned my addr 172.21.15.92:0/110155883 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:25:00.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.835+0000 7fe178c72640 1 --2- 172.21.15.92:0/110155883 >> v2:172.21.15.92:3300/0 conn(0x7fe17409a100 0x7fe174133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:00.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.835+0000 7fe167fff640 1 -- 172.21.15.92:0/110155883 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923900278 0 0) 0x7fe170001110 con 0x7fe17409bd50 2024-09-18T01:25:00.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.835+0000 7fe167fff640 1 -- 172.21.15.92:0/110155883 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe160003520 con 0x7fe17409bd50 2024-09-18T01:25:00.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.835+0000 7fe178c72640 1 -- 172.21.15.92:0/110155883 >> v1:172.21.15.92:6789/0 conn(0x7fe17409bd50 legacy=0x7fe17409c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:00.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.835+0000 7fe178c72640 1 -- 172.21.15.92:0/110155883 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe174098230 con 0x7fe17409a100 2024-09-18T01:25:00.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.836+0000 7fe178c72640 1 --2- 172.21.15.92:0/110155883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17409a100 0x7fe174133da0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe168009720 tx=0x7fe16802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df95d5204d62b2ba server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:00.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.836+0000 7fe167fff640 1 -- 172.21.15.92:0/110155883 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe168037070 con 0x7fe17409a100 2024-09-18T01:25:00.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.836+0000 7fe167fff640 1 -- 172.21.15.92:0/110155883 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16802ad90 con 0x7fe17409a100 2024-09-18T01:25:00.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.836+0000 7fe167fff640 1 -- 172.21.15.92:0/110155883 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe168032590 con 0x7fe17409a100 2024-09-18T01:25:00.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.837+0000 7fe17b6d7640 1 -- 172.21.15.92:0/110155883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17409a100 msgr2=0x7fe174133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:00.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.837+0000 7fe17b6d7640 1 --2- 172.21.15.92:0/110155883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17409a100 0x7fe174133da0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe168009720 tx=0x7fe16802a110 comp rx=0 tx=0).stop 2024-09-18T01:25:00.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.837+0000 7fe17b6d7640 1 -- 172.21.15.92:0/110155883 shutdown_connections 2024-09-18T01:25:00.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.837+0000 7fe17b6d7640 1 --2- 172.21.15.92:0/110155883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17409a100 0x7fe174133da0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:00.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.837+0000 7fe17b6d7640 1 -- 172.21.15.92:0/110155883 >> 172.21.15.92:0/110155883 conn(0x7fe17406d4a0 msgr2=0x7fe17406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:00.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.837+0000 7fe17b6d7640 1 -- 172.21.15.92:0/110155883 shutdown_connections 2024-09-18T01:25:00.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.837+0000 7fe17b6d7640 1 -- 172.21.15.92:0/110155883 wait complete. 2024-09-18T01:25:00.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.838+0000 7fe17b6d7640 1 Processor -- start 2024-09-18T01:25:00.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.838+0000 7fe17b6d7640 1 -- start start 2024-09-18T01:25:00.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.839+0000 7fe17b6d7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17409a100 0x7fe174092f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:00.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.839+0000 7fe17b6d7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe174134670 con 0x7fe17409a100 2024-09-18T01:25:00.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.839+0000 7fe179473640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17409a100 0x7fe174092f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:00.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.839+0000 7fe179473640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17409a100 0x7fe174092f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46350/0 (socket says 172.21.15.92:46350) 2024-09-18T01:25:00.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.839+0000 7fe179473640 1 -- 172.21.15.92:0/4053201172 learned_addr learned my addr 172.21.15.92:0/4053201172 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:00.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.839+0000 7fe179473640 1 -- 172.21.15.92:0/4053201172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe174094be0 con 0x7fe17409a100 2024-09-18T01:25:00.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.840+0000 7fe179473640 1 --2- 172.21.15.92:0/4053201172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17409a100 0x7fe174092f40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe17000c6b0 tx=0x7fe17000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:00.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.840+0000 7fe165ffb640 1 -- 172.21.15.92:0/4053201172 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe170017070 con 0x7fe17409a100 2024-09-18T01:25:00.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.840+0000 7fe165ffb640 1 -- 172.21.15.92:0/4053201172 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe170007e40 con 0x7fe17409a100 2024-09-18T01:25:00.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.840+0000 7fe17b6d7640 1 -- 172.21.15.92:0/4053201172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe17409a760 con 0x7fe17409a100 2024-09-18T01:25:00.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.840+0000 7fe165ffb640 1 -- 172.21.15.92:0/4053201172 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1700059e0 con 0x7fe17409a100 2024-09-18T01:25:00.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.840+0000 7fe17b6d7640 1 -- 172.21.15.92:0/4053201172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe174095a50 con 0x7fe17409a100 2024-09-18T01:25:00.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.841+0000 7fe165ffb640 1 -- 172.21.15.92:0/4053201172 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe17001a070 con 0x7fe17409a100 2024-09-18T01:25:00.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.841+0000 7fe17b6d7640 1 -- 172.21.15.92:0/4053201172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe174094030 con 0x7fe17409a100 2024-09-18T01:25:00.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.842+0000 7fe165ffb640 1 --2- 172.21.15.92:0/4053201172 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe158038250 0x7fe15803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:00.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.842+0000 7fe165ffb640 1 -- 172.21.15.92:0/4053201172 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fe17004a620 con 0x7fe17409a100 2024-09-18T01:25:00.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.842+0000 7fe178c72640 1 --2- 172.21.15.92:0/4053201172 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe158038250 0x7fe15803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:00.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.843+0000 7fe178c72640 1 --2- 172.21.15.92:0/4053201172 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe158038250 0x7fe15803a710 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe168034000 tx=0x7fe16802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:00.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.851+0000 7fe165ffb640 1 -- 172.21.15.92:0/4053201172 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe17409d3b0 con 0x7fe17409a100 2024-09-18T01:25:00.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.959+0000 7fde444dd640 1 -- 172.21.15.92:0/4192367696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fde3c074970 con 0x7fde3c09a100 2024-09-18T01:25:00.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.959+0000 7fde2effd640 1 -- 172.21.15.92:0/4192367696 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fde38007590 con 0x7fde3c09a100 2024-09-18T01:25:00.961 INFO:teuthology.orchestra.run.smithi092.stdout:42949672965 2024-09-18T01:25:00.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.962+0000 7fde444dd640 1 -- 172.21.15.92:0/4192367696 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fde200382a0 msgr2=0x7fde2003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:00.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.962+0000 7fde444dd640 1 --2- 172.21.15.92:0/4192367696 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fde200382a0 0x7fde2003a760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fde30034000 tx=0x7fde3002e000 comp rx=0 tx=0).stop 2024-09-18T01:25:00.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.962+0000 7fde444dd640 1 -- 172.21.15.92:0/4192367696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3c09a100 msgr2=0x7fde3c1c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:00.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.962+0000 7fde444dd640 1 --2- 172.21.15.92:0/4192367696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3c09a100 0x7fde3c1c7840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fde3800c6d0 tx=0x7fde3800cb90 comp rx=0 tx=0).stop 2024-09-18T01:25:00.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.962+0000 7fde444dd640 1 -- 172.21.15.92:0/4192367696 shutdown_connections 2024-09-18T01:25:00.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.962+0000 7fde444dd640 1 --2- 172.21.15.92:0/4192367696 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fde200382a0 0x7fde2003a760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:00.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.962+0000 7fde444dd640 1 --2- 172.21.15.92:0/4192367696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3c09a100 0x7fde3c1c7840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:00.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.962+0000 7fde444dd640 1 -- 172.21.15.92:0/4192367696 >> 172.21.15.92:0/4192367696 conn(0x7fde3c06d4a0 msgr2=0x7fde3c09f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:00.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.962+0000 7fde444dd640 1 -- 172.21.15.92:0/4192367696 shutdown_connections 2024-09-18T01:25:00.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.962+0000 7fde444dd640 1 -- 172.21.15.92:0/4192367696 wait complete. 2024-09-18T01:25:00.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.963+0000 7f7b20e8d640 1 -- 172.21.15.92:0/2430260222 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7b1c1322a0 con 0x7f7b1c098a20 2024-09-18T01:25:00.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.964+0000 7f7b0affd640 1 -- 172.21.15.92:0/2430260222 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b0c06ab00 con 0x7f7b1c098a20 2024-09-18T01:25:00.965 INFO:teuthology.orchestra.run.smithi092.stdout:42949672964 2024-09-18T01:25:00.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.966+0000 7f7b20e8d640 1 -- 172.21.15.92:0/2430260222 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7afc0382f0 msgr2=0x7f7afc03a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:00.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.966+0000 7f7b20e8d640 1 --2- 172.21.15.92:0/2430260222 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7afc0382f0 0x7f7afc03a7b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7b10000c00 tx=0x7f7b10007910 comp rx=0 tx=0).stop 2024-09-18T01:25:00.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.966+0000 7f7b20e8d640 1 -- 172.21.15.92:0/2430260222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1c098a20 msgr2=0x7f7b1c1c0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:00.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.966+0000 7f7b20e8d640 1 --2- 172.21.15.92:0/2430260222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1c098a20 0x7f7b1c1c0e40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c02a220 tx=0x7f7b0c0046c0 comp rx=0 tx=0).stop 2024-09-18T01:25:00.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.966+0000 7f7b20e8d640 1 -- 172.21.15.92:0/2430260222 shutdown_connections 2024-09-18T01:25:00.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.966+0000 7f7b20e8d640 1 --2- 172.21.15.92:0/2430260222 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7afc0382f0 0x7f7afc03a7b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:00.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.966+0000 7f7b20e8d640 1 --2- 172.21.15.92:0/2430260222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b1c098a20 0x7f7b1c1c0e40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:00.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.966+0000 7f7b20e8d640 1 -- 172.21.15.92:0/2430260222 >> 172.21.15.92:0/2430260222 conn(0x7f7b1c09f020 msgr2=0x7f7b1c12a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:00.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.966+0000 7f7b20e8d640 1 -- 172.21.15.92:0/2430260222 shutdown_connections 2024-09-18T01:25:00.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.966+0000 7f7b20e8d640 1 -- 172.21.15.92:0/2430260222 wait complete. 2024-09-18T01:25:00.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.968+0000 7fc98bcdd640 1 -- 172.21.15.92:0/1816238250 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc984075b40 con 0x7fc984092130 2024-09-18T01:25:00.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.968+0000 7fc97a7fc640 1 -- 172.21.15.92:0/1816238250 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc9841af9c0 con 0x7fc984092130 2024-09-18T01:25:00.970 INFO:teuthology.orchestra.run.smithi092.stdout:38654705668 2024-09-18T01:25:00.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.972+0000 7fc98bcdd640 1 -- 172.21.15.92:0/1816238250 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc9680385e0 msgr2=0x7fc96803aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.972+0000 7fc98bcdd640 1 --2- 172.21.15.92:0/1816238250 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc9680385e0 0x7fc96803aaa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc980035000 tx=0x7fc980008030 comp rx=0 tx=0).stop 2024-09-18T01:25:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.972+0000 7fc98bcdd640 1 -- 172.21.15.92:0/1816238250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc984092130 msgr2=0x7fc9841c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.972+0000 7fc98bcdd640 1 --2- 172.21.15.92:0/1816238250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc984092130 0x7fc9841c4520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc97400c360 tx=0x7fc97400c820 comp rx=0 tx=0).stop 2024-09-18T01:25:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.972+0000 7fc98bcdd640 1 -- 172.21.15.92:0/1816238250 shutdown_connections 2024-09-18T01:25:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.972+0000 7fc98bcdd640 1 --2- 172.21.15.92:0/1816238250 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc9680385e0 0x7fc96803aaa0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.972+0000 7fc98bcdd640 1 --2- 172.21.15.92:0/1816238250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc984092130 0x7fc9841c4520 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.972+0000 7fc98bcdd640 1 -- 172.21.15.92:0/1816238250 >> 172.21.15.92:0/1816238250 conn(0x7fc98409d6e0 msgr2=0x7fc98408cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.972+0000 7fc98bcdd640 1 -- 172.21.15.92:0/1816238250 shutdown_connections 2024-09-18T01:25:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:00.972+0000 7fc98bcdd640 1 -- 172.21.15.92:0/1816238250 wait complete. 2024-09-18T01:25:00.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.1 2024-09-18T01:25:00.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.3 2024-09-18T01:25:00.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-09-18T01:25:01.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:01.028+0000 7fe17b6d7640 1 -- 172.21.15.92:0/4053201172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe17409d020 con 0x7fe17409a100 2024-09-18T01:25:01.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:01.028+0000 7fe165ffb640 1 -- 172.21.15.92:0/4053201172 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe17001ac60 con 0x7fe17409a100 2024-09-18T01:25:01.030 INFO:teuthology.orchestra.run.smithi092.stdout:42949672964 2024-09-18T01:25:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:01.030+0000 7fe17b6d7640 1 -- 172.21.15.92:0/4053201172 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe158038250 msgr2=0x7fe15803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:01.030+0000 7fe17b6d7640 1 --2- 172.21.15.92:0/4053201172 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe158038250 0x7fe15803a710 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe168034000 tx=0x7fe16802e000 comp rx=0 tx=0).stop 2024-09-18T01:25:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:01.030+0000 7fe17b6d7640 1 -- 172.21.15.92:0/4053201172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17409a100 msgr2=0x7fe174092f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:01.030+0000 7fe17b6d7640 1 --2- 172.21.15.92:0/4053201172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17409a100 0x7fe174092f40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe17000c6b0 tx=0x7fe17000cb70 comp rx=0 tx=0).stop 2024-09-18T01:25:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:01.030+0000 7fe17b6d7640 1 -- 172.21.15.92:0/4053201172 shutdown_connections 2024-09-18T01:25:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:01.030+0000 7fe17b6d7640 1 --2- 172.21.15.92:0/4053201172 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe158038250 0x7fe15803a710 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:01.030+0000 7fe17b6d7640 1 --2- 172.21.15.92:0/4053201172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17409a100 0x7fe174092f40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:01.030+0000 7fe17b6d7640 1 -- 172.21.15.92:0/4053201172 >> 172.21.15.92:0/4053201172 conn(0x7fe17406d4a0 msgr2=0x7fe17409f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:01.030+0000 7fe17b6d7640 1 -- 172.21.15.92:0/4053201172 shutdown_connections 2024-09-18T01:25:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:01.030+0000 7fe17b6d7640 1 -- 172.21.15.92:0/4053201172 wait complete. 2024-09-18T01:25:01.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.2 2024-09-18T01:25:01.977 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T01:25:01.984 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T01:25:01.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T01:25:02.043 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T01:25:02.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.089+0000 7ffbc6159640 1 Processor -- start 2024-09-18T01:25:02.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.089+0000 7ffbc6159640 1 -- start start 2024-09-18T01:25:02.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.089+0000 7ffbc6159640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ffbc0096b40 0x7ffbc0133e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.090+0000 7ffbc6159640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc0096f50 con 0x7ffbc0095b90 2024-09-18T01:25:02.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.090+0000 7ffbc6159640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc0097a90 con 0x7ffbc0096b40 2024-09-18T01:25:02.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.090+0000 7ffbbeffd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ffbc0096b40 0x7ffbc0133e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.090+0000 7ffbbf7fe640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ffbc0095b90 0x7ffbc0096430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39606/0 (socket says 172.21.15.92:39606) 2024-09-18T01:25:02.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.090+0000 7ffbbf7fe640 1 -- 172.21.15.92:0/2584826903 learned_addr learned my addr 172.21.15.92:0/2584826903 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:25:02.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.090+0000 7ffbbeffd640 1 -- 172.21.15.92:0/2584826903 >> v1:172.21.15.92:6789/0 conn(0x7ffbc0095b90 legacy=0x7ffbc0096430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.090+0000 7ffbbeffd640 1 -- 172.21.15.92:0/2584826903 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc0097120 con 0x7ffbc0096b40 2024-09-18T01:25:02.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.090+0000 7ffbbe7fc640 1 -- 172.21.15.92:0/2584826903 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 817509531 0 0) 0x7ffbc0096f50 con 0x7ffbc0095b90 2024-09-18T01:25:02.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.091+0000 7ffbbeffd640 1 --2- 172.21.15.92:0/2584826903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbc0096b40 0x7ffbc0133e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009720 tx=0x7ffbb402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b7425dafef5c60 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.091+0000 7ffbbe7fc640 1 -- 172.21.15.92:0/2584826903 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbb4037070 con 0x7ffbc0096b40 2024-09-18T01:25:02.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.091+0000 7ffbbe7fc640 1 -- 172.21.15.92:0/2584826903 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb4032440 con 0x7ffbc0096b40 2024-09-18T01:25:02.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.091+0000 7ffbbe7fc640 1 -- 172.21.15.92:0/2584826903 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbb4032740 con 0x7ffbc0096b40 2024-09-18T01:25:02.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.092+0000 7ffbc6159640 1 -- 172.21.15.92:0/2584826903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbc0096b40 msgr2=0x7ffbc0133e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.092+0000 7ffbc6159640 1 --2- 172.21.15.92:0/2584826903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbc0096b40 0x7ffbc0133e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009720 tx=0x7ffbb402a230 comp rx=0 tx=0).stop 2024-09-18T01:25:02.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.092+0000 7ffbc6159640 1 -- 172.21.15.92:0/2584826903 shutdown_connections 2024-09-18T01:25:02.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.092+0000 7ffbc6159640 1 --2- 172.21.15.92:0/2584826903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbc0096b40 0x7ffbc0133e10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.092+0000 7ffbc6159640 1 -- 172.21.15.92:0/2584826903 >> 172.21.15.92:0/2584826903 conn(0x7ffbc009cd50 msgr2=0x7ffbc009d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:02.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.092+0000 7ffbc6159640 1 -- 172.21.15.92:0/2584826903 shutdown_connections 2024-09-18T01:25:02.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.092+0000 7ffbc6159640 1 -- 172.21.15.92:0/2584826903 wait complete. 2024-09-18T01:25:02.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.093+0000 7ffbc6159640 1 Processor -- start 2024-09-18T01:25:02.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.093+0000 7ffbc6159640 1 -- start start 2024-09-18T01:25:02.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.093+0000 7ffbc6159640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbc0095b90 0x7ffbc0123d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.093+0000 7ffbc6159640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0134560 con 0x7ffbc0095b90 2024-09-18T01:25:02.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.094+0000 7ffbbf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbc0095b90 0x7ffbc0123d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.094+0000 7ffbbf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbc0095b90 0x7ffbc0123d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46368/0 (socket says 172.21.15.92:46368) 2024-09-18T01:25:02.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.094+0000 7ffbbf7fe640 1 -- 172.21.15.92:0/652087024 learned_addr learned my addr 172.21.15.92:0/652087024 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:02.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.094+0000 7ffbbf7fe640 1 -- 172.21.15.92:0/652087024 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc0125a30 con 0x7ffbc0095b90 2024-09-18T01:25:02.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.094+0000 7ffbbf7fe640 1 --2- 172.21.15.92:0/652087024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbc0095b90 0x7ffbc0123d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000c420 tx=0x7ffbb000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.094+0000 7ffba7fff640 1 -- 172.21.15.92:0/652087024 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbb0018070 con 0x7ffbc0095b90 2024-09-18T01:25:02.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.094+0000 7ffba7fff640 1 -- 172.21.15.92:0/652087024 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb00074d0 con 0x7ffbc0095b90 2024-09-18T01:25:02.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.094+0000 7ffbc6159640 1 -- 172.21.15.92:0/652087024 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc0094350 con 0x7ffbc0095b90 2024-09-18T01:25:02.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.094+0000 7ffba7fff640 1 -- 172.21.15.92:0/652087024 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbb0004950 con 0x7ffbc0095b90 2024-09-18T01:25:02.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.094+0000 7ffbc6159640 1 -- 172.21.15.92:0/652087024 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc0094c50 con 0x7ffbc0095b90 2024-09-18T01:25:02.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.096+0000 7ffba7fff640 1 -- 172.21.15.92:0/652087024 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffbb001b070 con 0x7ffbc0095b90 2024-09-18T01:25:02.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.096+0000 7ffbc6159640 1 -- 172.21.15.92:0/652087024 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc0096430 con 0x7ffbc0095b90 2024-09-18T01:25:02.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.096+0000 7ffba7fff640 1 --2- 172.21.15.92:0/652087024 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ffbac0382a0 0x7ffbac03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.096+0000 7ffba7fff640 1 -- 172.21.15.92:0/652087024 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7ffbb00119b0 con 0x7ffbc0095b90 2024-09-18T01:25:02.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.096+0000 7ffbbeffd640 1 --2- 172.21.15.92:0/652087024 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ffbac0382a0 0x7ffbac03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.101+0000 7ffbbeffd640 1 --2- 172.21.15.92:0/652087024 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ffbac0382a0 0x7ffbac03a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4034000 tx=0x7ffbb402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.105+0000 7ffba7fff640 1 -- 172.21.15.92:0/652087024 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffbb001ab40 con 0x7ffbc0095b90 2024-09-18T01:25:02.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.130+0000 7ff60761e640 1 Processor -- start 2024-09-18T01:25:02.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.130+0000 7ff60761e640 1 -- start start 2024-09-18T01:25:02.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.131+0000 7ff60761e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff60009a100 0x7ff600133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.131+0000 7ff604bb9640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff60009a100 0x7ff600133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.131+0000 7ff604bb9640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff60009a100 0x7ff600133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46370/0 (socket says 172.21.15.92:46370) 2024-09-18T01:25:02.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.131+0000 7ff604bb9640 1 -- 172.21.15.92:0/3346600853 learned_addr learned my addr 172.21.15.92:0/3346600853 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:02.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.131+0000 7ff60761e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60009d3b0 con 0x7ff60009bd50 2024-09-18T01:25:02.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.131+0000 7ff60761e640 1 -- 172.21.15.92:0/3346600853 --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff60009c840 con 0x7ff60009a100 2024-09-18T01:25:02.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.131+0000 7ff604bb9640 1 -- 172.21.15.92:0/3346600853 >> v1:172.21.15.92:6789/0 conn(0x7ff60009bd50 legacy=0x7ff60009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.131+0000 7ff604bb9640 1 -- 172.21.15.92:0/3346600853 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff600098230 con 0x7ff60009a100 2024-09-18T01:25:02.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.132+0000 7ff604bb9640 1 --2- 172.21.15.92:0/3346600853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff60009a100 0x7ff600133da0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00097f0 tx=0x7ff5f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc7c812d721eeb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.132+0000 7ff5f7fff640 1 -- 172.21.15.92:0/3346600853 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f0037070 con 0x7ff60009a100 2024-09-18T01:25:02.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.132+0000 7ff5f7fff640 1 -- 172.21.15.92:0/3346600853 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f0032440 con 0x7ff60009a100 2024-09-18T01:25:02.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.132+0000 7ff5f7fff640 1 -- 172.21.15.92:0/3346600853 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f002ae60 con 0x7ff60009a100 2024-09-18T01:25:02.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.133+0000 7f9e087f6640 1 Processor -- start 2024-09-18T01:25:02.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.133+0000 7f9e087f6640 1 -- start start 2024-09-18T01:25:02.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.133+0000 7ff60761e640 1 -- 172.21.15.92:0/3346600853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff60009a100 msgr2=0x7ff600133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.133+0000 7ff60761e640 1 --2- 172.21.15.92:0/3346600853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff60009a100 0x7ff600133da0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00097f0 tx=0x7ff5f002a1e0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.133+0000 7ff60761e640 1 -- 172.21.15.92:0/3346600853 shutdown_connections 2024-09-18T01:25:02.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.133+0000 7ff60761e640 1 --2- 172.21.15.92:0/3346600853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff60009a100 0x7ff600133da0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.133+0000 7ff60761e640 1 -- 172.21.15.92:0/3346600853 >> 172.21.15.92:0/3346600853 conn(0x7ff60006d4a0 msgr2=0x7ff60006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:02.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.134+0000 7ff60761e640 1 -- 172.21.15.92:0/3346600853 shutdown_connections 2024-09-18T01:25:02.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.134+0000 7ff60761e640 1 -- 172.21.15.92:0/3346600853 wait complete. 2024-09-18T01:25:02.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.134+0000 7f9e087f6640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9e0009a100 0x7f9e00133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.134+0000 7f9e087f6640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0009d3b0 con 0x7f9e0009bd50 2024-09-18T01:25:02.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.134+0000 7f9e05d91640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9e0009a100 0x7f9e00133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.134+0000 7f9e05d91640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9e0009a100 0x7f9e00133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46376/0 (socket says 172.21.15.92:46376) 2024-09-18T01:25:02.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.134+0000 7f9e05d91640 1 -- 172.21.15.92:0/2925305821 learned_addr learned my addr 172.21.15.92:0/2925305821 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:02.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.134+0000 7f9e087f6640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f9e0009c840 con 0x7f9e0009a100 2024-09-18T01:25:02.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.135+0000 7ff60761e640 1 Processor -- start 2024-09-18T01:25:02.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.135+0000 7ff60761e640 1 -- start start 2024-09-18T01:25:02.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.135+0000 7f9e05590640 1 -- 172.21.15.92:0/2925305821 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4048911919 0 0) 0x7f9dfc001110 con 0x7f9e0009bd50 2024-09-18T01:25:02.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.135+0000 7f9e05d91640 1 -- 172.21.15.92:0/2925305821 >> v1:172.21.15.92:6789/0 conn(0x7f9e0009bd50 legacy=0x7f9e0009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.135+0000 7f9e05d91640 1 -- 172.21.15.92:0/2925305821 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e00098230 con 0x7f9e0009a100 2024-09-18T01:25:02.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.136+0000 7ff60761e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff60009a100 0x7ff600094590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.136+0000 7ff60761e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff600134670 con 0x7ff60009a100 2024-09-18T01:25:02.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.136+0000 7f9e05d91640 1 --2- 172.21.15.92:0/2925305821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0009a100 0x7f9e00133da0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9df00097f0 tx=0x7f9df002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219824f890e67f17 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.136+0000 7ff6053ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff60009a100 0x7ff600094590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.136+0000 7f9e05590640 1 -- 172.21.15.92:0/2925305821 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9df0037070 con 0x7f9e0009a100 2024-09-18T01:25:02.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.136+0000 7ff6053ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff60009a100 0x7ff600094590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46388/0 (socket says 172.21.15.92:46388) 2024-09-18T01:25:02.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.136+0000 7ff6053ba640 1 -- 172.21.15.92:0/1121892852 learned_addr learned my addr 172.21.15.92:0/1121892852 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:02.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.136+0000 7f9e05590640 1 -- 172.21.15.92:0/2925305821 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df0032440 con 0x7f9e0009a100 2024-09-18T01:25:02.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.136+0000 7f9e05590640 1 -- 172.21.15.92:0/2925305821 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9df002ae60 con 0x7f9e0009a100 2024-09-18T01:25:02.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.136+0000 7ff6053ba640 1 -- 172.21.15.92:0/1121892852 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff600126130 con 0x7ff60009a100 2024-09-18T01:25:02.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.136+0000 7ff6053ba640 1 --2- 172.21.15.92:0/1121892852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff60009a100 0x7ff600094590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00c450 tx=0x7ff5fc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.137+0000 7ff5f5ffb640 1 -- 172.21.15.92:0/1121892852 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5fc017070 con 0x7ff60009a100 2024-09-18T01:25:02.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.137+0000 7ff5f5ffb640 1 -- 172.21.15.92:0/1121892852 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5fc005220 con 0x7ff60009a100 2024-09-18T01:25:02.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.137+0000 7ff5f5ffb640 1 -- 172.21.15.92:0/1121892852 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5fc0035f0 con 0x7ff60009a100 2024-09-18T01:25:02.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.137+0000 7ff60761e640 1 -- 172.21.15.92:0/1121892852 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff600096540 con 0x7ff60009a100 2024-09-18T01:25:02.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.137+0000 7f9e087f6640 1 -- 172.21.15.92:0/2925305821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0009a100 msgr2=0x7f9e00133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.137+0000 7f9e087f6640 1 --2- 172.21.15.92:0/2925305821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0009a100 0x7f9e00133da0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9df00097f0 tx=0x7f9df002a1e0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.137+0000 7f9e087f6640 1 -- 172.21.15.92:0/2925305821 shutdown_connections 2024-09-18T01:25:02.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.137+0000 7f9e087f6640 1 --2- 172.21.15.92:0/2925305821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0009a100 0x7f9e00133da0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.137+0000 7f9e087f6640 1 -- 172.21.15.92:0/2925305821 >> 172.21.15.92:0/2925305821 conn(0x7f9e0006d4a0 msgr2=0x7f9e0006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:02.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.137+0000 7f9e087f6640 1 -- 172.21.15.92:0/2925305821 shutdown_connections 2024-09-18T01:25:02.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.137+0000 7f9e087f6640 1 -- 172.21.15.92:0/2925305821 wait complete. 2024-09-18T01:25:02.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.137+0000 7ff60761e640 1 -- 172.21.15.92:0/1121892852 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff600096f90 con 0x7ff60009a100 2024-09-18T01:25:02.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.138+0000 7ff5f5ffb640 1 -- 172.21.15.92:0/1121892852 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff5fc01a070 con 0x7ff60009a100 2024-09-18T01:25:02.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.138+0000 7ff60761e640 1 -- 172.21.15.92:0/1121892852 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6000a1d10 con 0x7ff60009a100 2024-09-18T01:25:02.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.138+0000 7f9e087f6640 1 Processor -- start 2024-09-18T01:25:02.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.138+0000 7f9e087f6640 1 -- start start 2024-09-18T01:25:02.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.138+0000 7ff5f5ffb640 1 --2- 172.21.15.92:0/1121892852 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff5e4038250 0x7ff5e403a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.138+0000 7ff5f5ffb640 1 -- 172.21.15.92:0/1121892852 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7ff5fc04a730 con 0x7ff60009a100 2024-09-18T01:25:02.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.139+0000 7f9e087f6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0009a100 0x7f9e000941b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.139+0000 7f9e087f6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e00134670 con 0x7f9e0009a100 2024-09-18T01:25:02.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.139+0000 7ff604bb9640 1 --2- 172.21.15.92:0/1121892852 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff5e4038250 0x7ff5e403a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.139+0000 7f9e06592640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0009a100 0x7f9e000941b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.139+0000 7f9e06592640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0009a100 0x7f9e000941b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46392/0 (socket says 172.21.15.92:46392) 2024-09-18T01:25:02.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.139+0000 7f9e06592640 1 -- 172.21.15.92:0/801633986 learned_addr learned my addr 172.21.15.92:0/801633986 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:02.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.139+0000 7f9e06592640 1 -- 172.21.15.92:0/801633986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e000960f0 con 0x7f9e0009a100 2024-09-18T01:25:02.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.139+0000 7ff604bb9640 1 --2- 172.21.15.92:0/1121892852 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff5e4038250 0x7ff5e403a710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0034000 tx=0x7ff5f002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.139+0000 7f9e06592640 1 --2- 172.21.15.92:0/801633986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0009a100 0x7f9e000941b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00c700 tx=0x7f9dfc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.147+0000 7f9df6ffd640 1 -- 172.21.15.92:0/801633986 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dfc005070 con 0x7f9e0009a100 2024-09-18T01:25:02.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.147+0000 7f9df6ffd640 1 -- 172.21.15.92:0/801633986 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dfc005230 con 0x7f9e0009a100 2024-09-18T01:25:02.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.147+0000 7f9e087f6640 1 -- 172.21.15.92:0/801633986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e00125ce0 con 0x7f9e0009a100 2024-09-18T01:25:02.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.147+0000 7ff5f5ffb640 1 -- 172.21.15.92:0/1121892852 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff60009d3b0 con 0x7ff60009a100 2024-09-18T01:25:02.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.148+0000 7f9df6ffd640 1 -- 172.21.15.92:0/801633986 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dfc00a660 con 0x7f9e0009a100 2024-09-18T01:25:02.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.148+0000 7f9e087f6640 1 -- 172.21.15.92:0/801633986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e000946f0 con 0x7f9e0009a100 2024-09-18T01:25:02.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.148+0000 7f9df6ffd640 1 -- 172.21.15.92:0/801633986 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9dfc00a8c0 con 0x7f9e0009a100 2024-09-18T01:25:02.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.148+0000 7f9df6ffd640 1 --2- 172.21.15.92:0/801633986 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9de40382a0 0x7f9de403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.148+0000 7f9df6ffd640 1 -- 172.21.15.92:0/801633986 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f9dfc04e120 con 0x7f9e0009a100 2024-09-18T01:25:02.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.148+0000 7f9e05d91640 1 --2- 172.21.15.92:0/801633986 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9de40382a0 0x7f9de403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.149+0000 7f9e087f6640 1 -- 172.21.15.92:0/801633986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e000a1d10 con 0x7f9e0009a100 2024-09-18T01:25:02.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.149+0000 7f9e05d91640 1 --2- 172.21.15.92:0/801633986 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9de40382a0 0x7f9de403a760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9df0034000 tx=0x7f9df002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.158+0000 7f9df6ffd640 1 -- 172.21.15.92:0/801633986 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e0009d3b0 con 0x7f9e0009a100 2024-09-18T01:25:02.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.176+0000 7f2bfd627640 1 Processor -- start 2024-09-18T01:25:02.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.176+0000 7f2bfd627640 1 -- start start 2024-09-18T01:25:02.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.177+0000 7f2bfd627640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2bf809a100 0x7f2bf8133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.177+0000 7f2bfd627640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf809d3b0 con 0x7f2bf809bd50 2024-09-18T01:25:02.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.177+0000 7f2bfd627640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f2bf809c840 con 0x7f2bf809a100 2024-09-18T01:25:02.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.177+0000 7f2bf67fc640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2bf809a100 0x7f2bf8133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.177+0000 7f2bf6ffd640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f2bf809bd50 0x7f2bf809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:49136/0 (socket says 172.21.15.92:49136) 2024-09-18T01:25:02.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.177+0000 7f2bf6ffd640 1 -- 172.21.15.92:0/3934714744 learned_addr learned my addr 172.21.15.92:0/3934714744 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:25:02.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.177+0000 7f2bf5ffb640 1 -- 172.21.15.92:0/3934714744 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2170291472 0 0) 0x7f2be8001110 con 0x7f2bf809bd50 2024-09-18T01:25:02.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.177+0000 7f2bf5ffb640 1 -- 172.21.15.92:0/3934714744 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2be0003520 con 0x7f2bf809bd50 2024-09-18T01:25:02.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.178+0000 7f2bf67fc640 1 -- 172.21.15.92:0/3934714744 >> v1:172.21.15.92:6789/0 conn(0x7f2bf809bd50 legacy=0x7f2bf809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.178+0000 7f2bf67fc640 1 -- 172.21.15.92:0/3934714744 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf8098230 con 0x7f2bf809a100 2024-09-18T01:25:02.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.179+0000 7f2bf67fc640 1 --2- 172.21.15.92:0/3934714744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf809a100 0x7f2bf8133da0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009720 tx=0x7f2bec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cccc9d1fe7a2214 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.179+0000 7f2bf5ffb640 1 -- 172.21.15.92:0/3934714744 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bec037070 con 0x7f2bf809a100 2024-09-18T01:25:02.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.179+0000 7f2bf5ffb640 1 -- 172.21.15.92:0/3934714744 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bec02ad90 con 0x7f2bf809a100 2024-09-18T01:25:02.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.179+0000 7f2bf5ffb640 1 -- 172.21.15.92:0/3934714744 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bec032570 con 0x7f2bf809a100 2024-09-18T01:25:02.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.180+0000 7f2bfd627640 1 -- 172.21.15.92:0/3934714744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf809a100 msgr2=0x7f2bf8133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.180+0000 7f2bfd627640 1 --2- 172.21.15.92:0/3934714744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf809a100 0x7f2bf8133da0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009720 tx=0x7f2bec02a110 comp rx=0 tx=0).stop 2024-09-18T01:25:02.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.180+0000 7f2bfd627640 1 -- 172.21.15.92:0/3934714744 shutdown_connections 2024-09-18T01:25:02.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.180+0000 7f2bfd627640 1 --2- 172.21.15.92:0/3934714744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf809a100 0x7f2bf8133da0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.180+0000 7f2bfd627640 1 -- 172.21.15.92:0/3934714744 >> 172.21.15.92:0/3934714744 conn(0x7f2bf806d4a0 msgr2=0x7f2bf806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:02.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.180+0000 7f2bfd627640 1 -- 172.21.15.92:0/3934714744 shutdown_connections 2024-09-18T01:25:02.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.180+0000 7f2bfd627640 1 -- 172.21.15.92:0/3934714744 wait complete. 2024-09-18T01:25:02.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.181+0000 7f2bfd627640 1 Processor -- start 2024-09-18T01:25:02.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.182+0000 7f2bfd627640 1 -- start start 2024-09-18T01:25:02.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.182+0000 7f2bfd627640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf809a100 0x7f2bf80945f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.182+0000 7f2bfd627640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8134670 con 0x7f2bf809a100 2024-09-18T01:25:02.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.183+0000 7f2bf6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf809a100 0x7f2bf80945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.183+0000 7f2bf6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf809a100 0x7f2bf80945f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45460/0 (socket says 172.21.15.92:45460) 2024-09-18T01:25:02.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.183+0000 7f2bf6ffd640 1 -- 172.21.15.92:0/1328973947 learned_addr learned my addr 172.21.15.92:0/1328973947 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:02.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.183+0000 7f2bf6ffd640 1 -- 172.21.15.92:0/1328973947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf809a760 con 0x7f2bf809a100 2024-09-18T01:25:02.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.183+0000 7f2bf6ffd640 1 --2- 172.21.15.92:0/1328973947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf809a100 0x7f2bf80945f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2be800c6b0 tx=0x7f2be800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.183+0000 7f2bdf7fe640 1 -- 172.21.15.92:0/1328973947 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2be8017070 con 0x7f2bf809a100 2024-09-18T01:25:02.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.183+0000 7f2bfd627640 1 -- 172.21.15.92:0/1328973947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf80962e0 con 0x7f2bf809a100 2024-09-18T01:25:02.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.183+0000 7f2bfd627640 1 -- 172.21.15.92:0/1328973947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf8094b30 con 0x7f2bf809a100 2024-09-18T01:25:02.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.183+0000 7f2bdf7fe640 1 -- 172.21.15.92:0/1328973947 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be80058b0 con 0x7f2bf809a100 2024-09-18T01:25:02.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.183+0000 7f2bdf7fe640 1 -- 172.21.15.92:0/1328973947 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2be8005bd0 con 0x7f2bf809a100 2024-09-18T01:25:02.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.185+0000 7f2bfd627640 1 -- 172.21.15.92:0/1328973947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd8005080 con 0x7f2bf809a100 2024-09-18T01:25:02.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.185+0000 7f2bdf7fe640 1 -- 172.21.15.92:0/1328973947 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2be801a070 con 0x7f2bf809a100 2024-09-18T01:25:02.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.185+0000 7f2bdf7fe640 1 --2- 172.21.15.92:0/1328973947 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2be4038250 0x7f2be403a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.185+0000 7f2bdf7fe640 1 -- 172.21.15.92:0/1328973947 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f2be804a670 con 0x7f2bf809a100 2024-09-18T01:25:02.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.186+0000 7f2bf67fc640 1 --2- 172.21.15.92:0/1328973947 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2be4038250 0x7f2be403a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.186+0000 7f2bf67fc640 1 --2- 172.21.15.92:0/1328973947 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2be4038250 0x7f2be403a710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2bec034000 tx=0x7f2bec02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.190+0000 7f2bdf7fe640 1 -- 172.21.15.92:0/1328973947 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2bf809a760 con 0x7f2bf809a100 2024-09-18T01:25:02.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.284+0000 7ffbc6159640 1 -- 172.21.15.92:0/652087024 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ffbc0124ef0 con 0x7ffbc0095b90 2024-09-18T01:25:02.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.284+0000 7ffba7fff640 1 -- 172.21.15.92:0/652087024 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffbb001ad70 con 0x7ffbc0095b90 2024-09-18T01:25:02.286 INFO:teuthology.orchestra.run.smithi092.stdout:42949672967 2024-09-18T01:25:02.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.286+0000 7ffbc6159640 1 -- 172.21.15.92:0/652087024 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ffbac0382a0 msgr2=0x7ffbac03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.286+0000 7ffbc6159640 1 --2- 172.21.15.92:0/652087024 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ffbac0382a0 0x7ffbac03a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4034000 tx=0x7ffbb402e000 comp rx=0 tx=0).stop 2024-09-18T01:25:02.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.286+0000 7ffbc6159640 1 -- 172.21.15.92:0/652087024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbc0095b90 msgr2=0x7ffbc0123d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.286+0000 7ffbc6159640 1 --2- 172.21.15.92:0/652087024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbc0095b90 0x7ffbc0123d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000c420 tx=0x7ffbb000c8e0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.286+0000 7ffbc6159640 1 -- 172.21.15.92:0/652087024 shutdown_connections 2024-09-18T01:25:02.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.286+0000 7ffbc6159640 1 --2- 172.21.15.92:0/652087024 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ffbac0382a0 0x7ffbac03a760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.286+0000 7ffbc6159640 1 --2- 172.21.15.92:0/652087024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbc0095b90 0x7ffbc0123d30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.286+0000 7ffbc6159640 1 -- 172.21.15.92:0/652087024 >> 172.21.15.92:0/652087024 conn(0x7ffbc009cd50 msgr2=0x7ffbc00706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:02.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.287+0000 7ffbc6159640 1 -- 172.21.15.92:0/652087024 shutdown_connections 2024-09-18T01:25:02.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.287+0000 7ffbc6159640 1 -- 172.21.15.92:0/652087024 wait complete. 2024-09-18T01:25:02.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672967 for osd.1 2024-09-18T01:25:02.299 DEBUG:teuthology.parallel:result is None 2024-09-18T01:25:02.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.338+0000 7ff60761e640 1 -- 172.21.15.92:0/1121892852 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff600125ee0 con 0x7ff60009a100 2024-09-18T01:25:02.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.338+0000 7ff5f5ffb640 1 -- 172.21.15.92:0/1121892852 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff5fc01ac60 con 0x7ff60009a100 2024-09-18T01:25:02.340 INFO:teuthology.orchestra.run.smithi092.stdout:38654705669 2024-09-18T01:25:02.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.341+0000 7ff60761e640 1 -- 172.21.15.92:0/1121892852 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff5e4038250 msgr2=0x7ff5e403a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.341+0000 7ff60761e640 1 --2- 172.21.15.92:0/1121892852 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff5e4038250 0x7ff5e403a710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0034000 tx=0x7ff5f002e000 comp rx=0 tx=0).stop 2024-09-18T01:25:02.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.341+0000 7ff60761e640 1 -- 172.21.15.92:0/1121892852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff60009a100 msgr2=0x7ff600094590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.341+0000 7ff60761e640 1 --2- 172.21.15.92:0/1121892852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff60009a100 0x7ff600094590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00c450 tx=0x7ff5fc00c910 comp rx=0 tx=0).stop 2024-09-18T01:25:02.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.341+0000 7ff60761e640 1 -- 172.21.15.92:0/1121892852 shutdown_connections 2024-09-18T01:25:02.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.341+0000 7ff60761e640 1 --2- 172.21.15.92:0/1121892852 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff5e4038250 0x7ff5e403a710 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.342+0000 7ff60761e640 1 --2- 172.21.15.92:0/1121892852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff60009a100 0x7ff600094590 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.342+0000 7ff60761e640 1 -- 172.21.15.92:0/1121892852 >> 172.21.15.92:0/1121892852 conn(0x7ff60006d4a0 msgr2=0x7ff60008d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:02.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.342+0000 7ff60761e640 1 -- 172.21.15.92:0/1121892852 shutdown_connections 2024-09-18T01:25:02.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.342+0000 7ff60761e640 1 -- 172.21.15.92:0/1121892852 wait complete. 2024-09-18T01:25:02.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.347+0000 7f9e087f6640 1 -- 172.21.15.92:0/801633986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9e0009d020 con 0x7f9e0009a100 2024-09-18T01:25:02.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.347+0000 7f9df6ffd640 1 -- 172.21.15.92:0/801633986 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9e0009d3b0 con 0x7f9e0009a100 2024-09-18T01:25:02.349 INFO:teuthology.orchestra.run.smithi092.stdout:42949672966 2024-09-18T01:25:02.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.350+0000 7f9e087f6640 1 -- 172.21.15.92:0/801633986 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9de40382a0 msgr2=0x7f9de403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.350+0000 7f9e087f6640 1 --2- 172.21.15.92:0/801633986 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9de40382a0 0x7f9de403a760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9df0034000 tx=0x7f9df002e000 comp rx=0 tx=0).stop 2024-09-18T01:25:02.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.350+0000 7f9e087f6640 1 -- 172.21.15.92:0/801633986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0009a100 msgr2=0x7f9e000941b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.350+0000 7f9e087f6640 1 --2- 172.21.15.92:0/801633986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0009a100 0x7f9e000941b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00c700 tx=0x7f9dfc00cbc0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.350+0000 7f9e087f6640 1 -- 172.21.15.92:0/801633986 shutdown_connections 2024-09-18T01:25:02.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.350+0000 7f9e087f6640 1 --2- 172.21.15.92:0/801633986 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9de40382a0 0x7f9de403a760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.350+0000 7f9e087f6640 1 --2- 172.21.15.92:0/801633986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0009a100 0x7f9e000941b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.350+0000 7f9e087f6640 1 -- 172.21.15.92:0/801633986 >> 172.21.15.92:0/801633986 conn(0x7f9e0006d4a0 msgr2=0x7f9e0009fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:02.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.350+0000 7f9e087f6640 1 -- 172.21.15.92:0/801633986 shutdown_connections 2024-09-18T01:25:02.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.350+0000 7f9e087f6640 1 -- 172.21.15.92:0/801633986 wait complete. 2024-09-18T01:25:02.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-09-18T01:25:02.354 DEBUG:teuthology.parallel:result is None 2024-09-18T01:25:02.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672966 for osd.3 2024-09-18T01:25:02.366 DEBUG:teuthology.parallel:result is None 2024-09-18T01:25:02.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.374+0000 7f2bfd627640 1 -- 172.21.15.92:0/1328973947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2bd8005370 con 0x7f2bf809a100 2024-09-18T01:25:02.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.374+0000 7f2bdf7fe640 1 -- 172.21.15.92:0/1328973947 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2bf809d3b0 con 0x7f2bf809a100 2024-09-18T01:25:02.375 INFO:teuthology.orchestra.run.smithi092.stdout:42949672966 2024-09-18T01:25:02.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.376+0000 7f2bfd627640 1 -- 172.21.15.92:0/1328973947 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2be4038250 msgr2=0x7f2be403a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.376+0000 7f2bfd627640 1 --2- 172.21.15.92:0/1328973947 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2be4038250 0x7f2be403a710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2bec034000 tx=0x7f2bec02e000 comp rx=0 tx=0).stop 2024-09-18T01:25:02.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.376+0000 7f2bfd627640 1 -- 172.21.15.92:0/1328973947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf809a100 msgr2=0x7f2bf80945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.376+0000 7f2bfd627640 1 --2- 172.21.15.92:0/1328973947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf809a100 0x7f2bf80945f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2be800c6b0 tx=0x7f2be800cb70 comp rx=0 tx=0).stop 2024-09-18T01:25:02.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.376+0000 7f2bfd627640 1 -- 172.21.15.92:0/1328973947 shutdown_connections 2024-09-18T01:25:02.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.376+0000 7f2bfd627640 1 --2- 172.21.15.92:0/1328973947 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2be4038250 0x7f2be403a710 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.376+0000 7f2bfd627640 1 --2- 172.21.15.92:0/1328973947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf809a100 0x7f2bf80945f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.376+0000 7f2bfd627640 1 -- 172.21.15.92:0/1328973947 >> 172.21.15.92:0/1328973947 conn(0x7f2bf806d4a0 msgr2=0x7f2bf808d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:02.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.376+0000 7f2bfd627640 1 -- 172.21.15.92:0/1328973947 shutdown_connections 2024-09-18T01:25:02.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.376+0000 7f2bfd627640 1 -- 172.21.15.92:0/1328973947 wait complete. 2024-09-18T01:25:02.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672966 for osd.2 2024-09-18T01:25:02.388 DEBUG:teuthology.parallel:result is None 2024-09-18T01:25:02.388 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T01:25:02.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:25:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.524+0000 7fc7fe5fd640 1 Processor -- start 2024-09-18T01:25:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.524+0000 7fc7fe5fd640 1 -- start start 2024-09-18T01:25:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.525+0000 7fc7fe5fd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc7f809bd50 0x7fc7f809c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.525+0000 7fc7fe5fd640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f809d3b0 con 0x7fc7f809c670 2024-09-18T01:25:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.525+0000 7fc7fe5fd640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fc7f8098230 con 0x7fc7f809bd50 2024-09-18T01:25:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.525+0000 7fc7f7fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc7f809bd50 0x7fc7f809c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.525+0000 7fc7f77fe640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc7f809c670 0x7fc7f80990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:49150/0 (socket says 172.21.15.92:49150) 2024-09-18T01:25:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.525+0000 7fc7f77fe640 1 -- 172.21.15.92:0/2293944525 learned_addr learned my addr 172.21.15.92:0/2293944525 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:25:02.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.525+0000 7fc7f7fff640 1 -- 172.21.15.92:0/2293944525 >> v1:172.21.15.92:6789/0 conn(0x7fc7f809c670 legacy=0x7fc7f80990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.525+0000 7fc7f7fff640 1 -- 172.21.15.92:0/2293944525 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f80983e0 con 0x7fc7f809bd50 2024-09-18T01:25:02.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.525+0000 7fc7f6ffd640 1 -- 172.21.15.92:0/2293944525 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680379905 0 0) 0x7fc7ec001110 con 0x7fc7f809c670 2024-09-18T01:25:02.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.526+0000 7fc7f7fff640 1 --2- 172.21.15.92:0/2293944525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7f809bd50 0x7fc7f809c130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009720 tx=0x7fc7e802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb1d77a8aaf5e71 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.526+0000 7fc7f6ffd640 1 -- 172.21.15.92:0/2293944525 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7e8037070 con 0x7fc7f809bd50 2024-09-18T01:25:02.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.526+0000 7fc7f6ffd640 1 -- 172.21.15.92:0/2293944525 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e802ad90 con 0x7fc7f809bd50 2024-09-18T01:25:02.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.526+0000 7fc7f6ffd640 1 -- 172.21.15.92:0/2293944525 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7e8032590 con 0x7fc7f809bd50 2024-09-18T01:25:02.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.526+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2293944525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7f809bd50 msgr2=0x7fc7f809c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.526+0000 7fc7fe5fd640 1 --2- 172.21.15.92:0/2293944525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7f809bd50 0x7fc7f809c130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009720 tx=0x7fc7e802a110 comp rx=0 tx=0).stop 2024-09-18T01:25:02.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.527+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2293944525 shutdown_connections 2024-09-18T01:25:02.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.527+0000 7fc7fe5fd640 1 --2- 172.21.15.92:0/2293944525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7f809bd50 0x7fc7f809c130 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.527+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2293944525 >> 172.21.15.92:0/2293944525 conn(0x7fc7f806d4a0 msgr2=0x7fc7f806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:02.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.527+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2293944525 shutdown_connections 2024-09-18T01:25:02.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.527+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2293944525 wait complete. 2024-09-18T01:25:02.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.527+0000 7fc7fe5fd640 1 Processor -- start 2024-09-18T01:25:02.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.528+0000 7fc7fe5fd640 1 -- start start 2024-09-18T01:25:02.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.528+0000 7fc7fe5fd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7f809bd50 0x7fc7f81b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.528+0000 7fc7fe5fd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f8099b90 con 0x7fc7f809bd50 2024-09-18T01:25:02.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.528+0000 7fc7f7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7f809bd50 0x7fc7f81b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.528+0000 7fc7f7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7f809bd50 0x7fc7f81b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45482/0 (socket says 172.21.15.92:45482) 2024-09-18T01:25:02.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.528+0000 7fc7f7fff640 1 -- 172.21.15.92:0/2907916698 learned_addr learned my addr 172.21.15.92:0/2907916698 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:02.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.528+0000 7fc7f7fff640 1 -- 172.21.15.92:0/2907916698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f81b3020 con 0x7fc7f809bd50 2024-09-18T01:25:02.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.528+0000 7fc7f7fff640 1 --2- 172.21.15.92:0/2907916698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7f809bd50 0x7fc7f81b38b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009720 tx=0x7fc7e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.529+0000 7fc7f4ff9640 1 -- 172.21.15.92:0/2907916698 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7e8041070 con 0x7fc7f809bd50 2024-09-18T01:25:02.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.529+0000 7fc7f4ff9640 1 -- 172.21.15.92:0/2907916698 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e803c460 con 0x7fc7f809bd50 2024-09-18T01:25:02.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.529+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2907916698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f809a760 con 0x7fc7f809bd50 2024-09-18T01:25:02.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.529+0000 7fc7f4ff9640 1 -- 172.21.15.92:0/2907916698 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7e8037040 con 0x7fc7f809bd50 2024-09-18T01:25:02.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.529+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2907916698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f81b28f0 con 0x7fc7f809bd50 2024-09-18T01:25:02.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.529+0000 7fc7f4ff9640 1 -- 172.21.15.92:0/2907916698 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc7e8044070 con 0x7fc7f809bd50 2024-09-18T01:25:02.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.529+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2907916698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f81b2670 con 0x7fc7f809bd50 2024-09-18T01:25:02.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.530+0000 7fc7f4ff9640 1 --2- 172.21.15.92:0/2907916698 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc7e40382d0 0x7fc7e403a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.530+0000 7fc7f4ff9640 1 -- 172.21.15.92:0/2907916698 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fc7e806bd10 con 0x7fc7f809bd50 2024-09-18T01:25:02.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.530+0000 7fc7f77fe640 1 --2- 172.21.15.92:0/2907916698 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc7e40382d0 0x7fc7e403a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.530+0000 7fc7f77fe640 1 --2- 172.21.15.92:0/2907916698 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc7e40382d0 0x7fc7e403a790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec000c00 tx=0x7fc7ec001250 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.534+0000 7fc7f4ff9640 1 -- 172.21.15.92:0/2907916698 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc7f81b3020 con 0x7fc7f809bd50 2024-09-18T01:25:02.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.697+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2907916698 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7f809a130 con 0x7fc7e40382d0 2024-09-18T01:25:02.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.699+0000 7fc7f4ff9640 1 -- 172.21.15.92:0/2907916698 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32192 (secure 0 0 0) 0x7fc7f809a130 con 0x7fc7e40382d0 2024-09-18T01:25:02.701 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:25:02.701 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-18T01:25:02.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.701+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2907916698 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc7e40382d0 msgr2=0x7fc7e403a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.701+0000 7fc7fe5fd640 1 --2- 172.21.15.92:0/2907916698 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc7e40382d0 0x7fc7e403a790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec000c00 tx=0x7fc7ec001250 comp rx=0 tx=0).stop 2024-09-18T01:25:02.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.701+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2907916698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7f809bd50 msgr2=0x7fc7f81b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.701+0000 7fc7fe5fd640 1 --2- 172.21.15.92:0/2907916698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7f809bd50 0x7fc7f81b38b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009720 tx=0x7fc7e80046c0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.701+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2907916698 shutdown_connections 2024-09-18T01:25:02.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.701+0000 7fc7fe5fd640 1 --2- 172.21.15.92:0/2907916698 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc7e40382d0 0x7fc7e403a790 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.701+0000 7fc7fe5fd640 1 --2- 172.21.15.92:0/2907916698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7f809bd50 0x7fc7f81b38b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.701+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2907916698 >> 172.21.15.92:0/2907916698 conn(0x7fc7f806d4a0 msgr2=0x7fc7f809eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:02.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.701+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2907916698 shutdown_connections 2024-09-18T01:25:02.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.701+0000 7fc7fe5fd640 1 -- 172.21.15.92:0/2907916698 wait complete. 2024-09-18T01:25:02.713 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-18T01:25:00.766985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109900,"kb_used_data":1776,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377460,"statfs":{"total":386547056640,"available":386434519040,"internally_reserved":0,"allocated":1818624,"data_stored":1384422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.582062"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.198307+0000","last_change":"2024-09-18T01:24:58.198307+0000","last_active":"2024-09-18T01:24:58.198307+0000","last_peered":"2024-09-18T01:24:58.198307+0000","last_clean":"2024-09-18T01:24:58.198307+0000","last_became_active":"2024-09-18T01:24:56.602991+0000","last_became_peered":"2024-09-18T01:24:56.602991+0000","last_unstale":"2024-09-18T01:24:58.198307+0000","last_undegraded":"2024-09-18T01:24:58.198307+0000","last_fullsized":"2024-09-18T01:24:58.198307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:37:38.935073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077351,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.199646+0000","last_change":"2024-09-18T01:24:58.199970+0000","last_active":"2024-09-18T01:24:58.199646+0000","last_peered":"2024-09-18T01:24:58.199646+0000","last_clean":"2024-09-18T01:24:58.199646+0000","last_became_active":"2024-09-18T01:24:56.192301+0000","last_became_peered":"2024-09-18T01:24:56.192301+0000","last_unstale":"2024-09-18T01:24:58.199646+0000","last_undegraded":"2024-09-18T01:24:58.199646+0000","last_fullsized":"2024-09-18T01:24:58.199646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:15.228308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056449699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.198528+0000","last_change":"2024-09-18T01:24:58.198528+0000","last_active":"2024-09-18T01:24:58.198528+0000","last_peered":"2024-09-18T01:24:58.198528+0000","last_clean":"2024-09-18T01:24:58.198528+0000","last_became_active":"2024-09-18T01:24:56.191687+0000","last_became_peered":"2024-09-18T01:24:56.191687+0000","last_unstale":"2024-09-18T01:24:58.198528+0000","last_undegraded":"2024-09-18T01:24:58.198528+0000","last_fullsized":"2024-09-18T01:24:58.198528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:11:00.731633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012745390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.199711+0000","last_change":"2024-09-18T01:24:58.199959+0000","last_active":"2024-09-18T01:24:58.199711+0000","last_peered":"2024-09-18T01:24:58.199711+0000","last_clean":"2024-09-18T01:24:58.199711+0000","last_became_active":"2024-09-18T01:24:56.191033+0000","last_became_peered":"2024-09-18T01:24:56.191033+0000","last_unstale":"2024-09-18T01:24:58.199711+0000","last_undegraded":"2024-09-18T01:24:58.199711+0000","last_fullsized":"2024-09-18T01:24:58.199711+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:45.677191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000547898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.198912+0000","last_change":"2024-09-18T01:24:58.198236+0000","last_active":"2024-09-18T01:24:58.198912+0000","last_peered":"2024-09-18T01:24:58.198912+0000","last_clean":"2024-09-18T01:24:58.198912+0000","last_became_active":"2024-09-18T01:24:56.191713+0000","last_became_peered":"2024-09-18T01:24:56.191713+0000","last_unstale":"2024-09-18T01:24:58.198912+0000","last_undegraded":"2024-09-18T01:24:58.198912+0000","last_fullsized":"2024-09-18T01:24:58.198912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:55:46.520977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010043490000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.350485+0000","last_change":"2024-09-18T01:24:58.350485+0000","last_active":"2024-09-18T01:24:58.350485+0000","last_peered":"2024-09-18T01:24:58.350485+0000","last_clean":"2024-09-18T01:24:58.350485+0000","last_became_active":"2024-09-18T01:24:56.191162+0000","last_became_peered":"2024-09-18T01:24:56.191162+0000","last_unstale":"2024-09-18T01:24:58.350485+0000","last_undegraded":"2024-09-18T01:24:58.350485+0000","last_fullsized":"2024-09-18T01:24:58.350485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:38:00.033247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040921399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.197615+0000","last_change":"2024-09-18T01:24:58.197615+0000","last_active":"2024-09-18T01:24:58.197615+0000","last_peered":"2024-09-18T01:24:58.197615+0000","last_clean":"2024-09-18T01:24:58.197615+0000","last_became_active":"2024-09-18T01:24:56.191554+0000","last_became_peered":"2024-09-18T01:24:56.191554+0000","last_unstale":"2024-09-18T01:24:58.197615+0000","last_undegraded":"2024-09-18T01:24:58.197615+0000","last_fullsized":"2024-09-18T01:24:58.197615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:55.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041584599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.197569+0000","last_change":"2024-09-18T01:24:58.197569+0000","last_active":"2024-09-18T01:24:58.197569+0000","last_peered":"2024-09-18T01:24:58.197569+0000","last_clean":"2024-09-18T01:24:58.197569+0000","last_became_active":"2024-09-18T01:24:56.194443+0000","last_became_peered":"2024-09-18T01:24:56.194443+0000","last_unstale":"2024-09-18T01:24:58.197569+0000","last_undegraded":"2024-09-18T01:24:58.197569+0000","last_fullsized":"2024-09-18T01:24:58.197569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:43:12.854702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033763700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":170,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.195425+0000","last_change":"2024-09-18T01:24:52.297138+0000","last_active":"2024-09-18T01:24:58.195425+0000","last_peered":"2024-09-18T01:24:58.195425+0000","last_clean":"2024-09-18T01:24:58.195425+0000","last_became_active":"2024-09-18T01:24:52.296214+0000","last_became_peered":"2024-09-18T01:24:52.296214+0000","last_unstale":"2024-09-18T01:24:58.195425+0000","last_undegraded":"2024-09-18T01:24:58.195425+0000","last_fullsized":"2024-09-18T01:24:58.195425+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_clean_scrub_stamp":"2024-09-18T01:24:51.161687+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:36:16.487345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:25:02.714 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:25:02.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.810+0000 7f01c8966640 1 Processor -- start 2024-09-18T01:25:02.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.810+0000 7f01c8966640 1 -- start start 2024-09-18T01:25:02.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.810+0000 7f01c8966640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f01c406eda0 0x7f01c406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.810+0000 7f01c8966640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c406eba0 con 0x7f01c406f6c0 2024-09-18T01:25:02.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.810+0000 7f01c8966640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f01c406d2f0 con 0x7f01c406eda0 2024-09-18T01:25:02.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.810+0000 7f01c259c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f01c406eda0 0x7f01c406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.810+0000 7f01b9d9b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f01c406f6c0 0x7f01c4121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:49154/0 (socket says 172.21.15.92:49154) 2024-09-18T01:25:02.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.810+0000 7f01c259c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f01c406eda0 0x7f01c406f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45484/0 (socket says 172.21.15.92:45484) 2024-09-18T01:25:02.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.810+0000 7f01b9d9b640 1 -- 172.21.15.92:0/1390376691 learned_addr learned my addr 172.21.15.92:0/1390376691 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:25:02.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.811+0000 7f01c259c640 1 -- 172.21.15.92:0/1390376691 >> v1:172.21.15.92:6789/0 conn(0x7f01c406f6c0 legacy=0x7f01c4121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.811+0000 7f01c1d9b640 1 -- 172.21.15.92:0/1390376691 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3761931069 0 0) 0x7f01c406eba0 con 0x7f01c406f6c0 2024-09-18T01:25:02.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.811+0000 7f01c259c640 1 -- 172.21.15.92:0/1390376691 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c4070d50 con 0x7f01c406eda0 2024-09-18T01:25:02.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.811+0000 7f01c259c640 1 --2- 172.21.15.92:0/1390376691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c406eda0 0x7f01c406f180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009720 tx=0x7f01b402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6991e7402dae19c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.811+0000 7f01c1d9b640 1 -- 172.21.15.92:0/1390376691 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b4037070 con 0x7f01c406eda0 2024-09-18T01:25:02.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.811+0000 7f01c1d9b640 1 -- 172.21.15.92:0/1390376691 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b402ae20 con 0x7f01c406eda0 2024-09-18T01:25:02.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.811+0000 7f01c1d9b640 1 -- 172.21.15.92:0/1390376691 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b4032590 con 0x7f01c406eda0 2024-09-18T01:25:02.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.812+0000 7f01c8966640 1 -- 172.21.15.92:0/1390376691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c406eda0 msgr2=0x7f01c406f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.812+0000 7f01c8966640 1 --2- 172.21.15.92:0/1390376691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c406eda0 0x7f01c406f180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009720 tx=0x7f01b402a1a0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.812+0000 7f01c8966640 1 -- 172.21.15.92:0/1390376691 shutdown_connections 2024-09-18T01:25:02.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.812+0000 7f01c8966640 1 --2- 172.21.15.92:0/1390376691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c406eda0 0x7f01c406f180 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.812+0000 7f01c8966640 1 -- 172.21.15.92:0/1390376691 >> 172.21.15.92:0/1390376691 conn(0x7f01c409a890 msgr2=0x7f01c409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:02.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.812+0000 7f01c8966640 1 -- 172.21.15.92:0/1390376691 shutdown_connections 2024-09-18T01:25:02.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.812+0000 7f01c8966640 1 -- 172.21.15.92:0/1390376691 wait complete. 2024-09-18T01:25:02.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.813+0000 7f01c8966640 1 Processor -- start 2024-09-18T01:25:02.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.813+0000 7f01c8966640 1 -- start start 2024-09-18T01:25:02.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.813+0000 7f01c8966640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c406eda0 0x7f01c4124620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.813+0000 7f01c8966640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f01c4122160 con 0x7f01c406eda0 2024-09-18T01:25:02.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.814+0000 7f01c259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c406eda0 0x7f01c4124620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.814+0000 7f01c259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c406eda0 0x7f01c4124620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45488/0 (socket says 172.21.15.92:45488) 2024-09-18T01:25:02.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.814+0000 7f01c259c640 1 -- 172.21.15.92:0/2141137075 learned_addr learned my addr 172.21.15.92:0/2141137075 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:02.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.814+0000 7f01c259c640 1 -- 172.21.15.92:0/2141137075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c408b8d0 con 0x7f01c406eda0 2024-09-18T01:25:02.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.814+0000 7f01c259c640 1 --2- 172.21.15.92:0/2141137075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c406eda0 0x7f01c4124620 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f01b402a1e0 tx=0x7f01b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.814+0000 7f01bb7fe640 1 -- 172.21.15.92:0/2141137075 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b4042070 con 0x7f01c406eda0 2024-09-18T01:25:02.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.814+0000 7f01bb7fe640 1 -- 172.21.15.92:0/2141137075 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b403e590 con 0x7f01c406eda0 2024-09-18T01:25:02.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.814+0000 7f01c8966640 1 -- 172.21.15.92:0/2141137075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c408ce60 con 0x7f01c406eda0 2024-09-18T01:25:02.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.814+0000 7f01bb7fe640 1 -- 172.21.15.92:0/2141137075 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b4037040 con 0x7f01c406eda0 2024-09-18T01:25:02.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.814+0000 7f01c8966640 1 -- 172.21.15.92:0/2141137075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c4124b60 con 0x7f01c406eda0 2024-09-18T01:25:02.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.815+0000 7f01bb7fe640 1 -- 172.21.15.92:0/2141137075 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f01b4045070 con 0x7f01c406eda0 2024-09-18T01:25:02.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.815+0000 7f01bb7fe640 1 --2- 172.21.15.92:0/2141137075 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f01a40382a0 0x7f01a403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:02.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.815+0000 7f01c8966640 1 -- 172.21.15.92:0/2141137075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c408bdf0 con 0x7f01c406eda0 2024-09-18T01:25:02.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.815+0000 7f01bb7fe640 1 -- 172.21.15.92:0/2141137075 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f01b406bb00 con 0x7f01c406eda0 2024-09-18T01:25:02.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.815+0000 7f01b9d9b640 1 --2- 172.21.15.92:0/2141137075 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f01a40382a0 0x7f01a403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:02.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.816+0000 7f01b9d9b640 1 --2- 172.21.15.92:0/2141137075 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f01a40382a0 0x7f01a403a760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f01ac000c00 tx=0x7f01ac007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:02.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.820+0000 7f01bb7fe640 1 -- 172.21.15.92:0/2141137075 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f01c408bdf0 con 0x7f01c406eda0 2024-09-18T01:25:02.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.983+0000 7f01c8966640 1 -- 172.21.15.92:0/2141137075 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01c4125d80 con 0x7f01a40382a0 2024-09-18T01:25:02.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.985+0000 7f01bb7fe640 1 -- 172.21.15.92:0/2141137075 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32192 (secure 0 0 0) 0x7f01ac0070d0 con 0x7f01a40382a0 2024-09-18T01:25:02.986 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:25:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-18T01:25:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.987+0000 7f01c8966640 1 -- 172.21.15.92:0/2141137075 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f01a40382a0 msgr2=0x7f01a403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.987+0000 7f01c8966640 1 --2- 172.21.15.92:0/2141137075 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f01a40382a0 0x7f01a403a760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f01ac000c00 tx=0x7f01ac007910 comp rx=0 tx=0).stop 2024-09-18T01:25:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.987+0000 7f01c8966640 1 -- 172.21.15.92:0/2141137075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c406eda0 msgr2=0x7f01c4124620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.987+0000 7f01c8966640 1 --2- 172.21.15.92:0/2141137075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c406eda0 0x7f01c4124620 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f01b402a1e0 tx=0x7f01b40046c0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.987+0000 7f01c8966640 1 -- 172.21.15.92:0/2141137075 shutdown_connections 2024-09-18T01:25:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.987+0000 7f01c8966640 1 --2- 172.21.15.92:0/2141137075 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f01a40382a0 0x7f01a403a760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.987+0000 7f01c8966640 1 --2- 172.21.15.92:0/2141137075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c406eda0 0x7f01c4124620 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.987+0000 7f01c8966640 1 -- 172.21.15.92:0/2141137075 >> 172.21.15.92:0/2141137075 conn(0x7f01c409a890 msgr2=0x7f01c4097bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.987+0000 7f01c8966640 1 -- 172.21.15.92:0/2141137075 shutdown_connections 2024-09-18T01:25:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:02.987+0000 7f01c8966640 1 -- 172.21.15.92:0/2141137075 wait complete. 2024-09-18T01:25:02.999 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-18T01:25:02.767266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109900,"kb_used_data":1776,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377460,"statfs":{"total":386547056640,"available":386434519040,"internally_reserved":0,"allocated":1818624,"data_stored":1384422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.581423"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.198307+0000","last_change":"2024-09-18T01:24:58.198307+0000","last_active":"2024-09-18T01:24:58.198307+0000","last_peered":"2024-09-18T01:24:58.198307+0000","last_clean":"2024-09-18T01:24:58.198307+0000","last_became_active":"2024-09-18T01:24:56.602991+0000","last_became_peered":"2024-09-18T01:24:56.602991+0000","last_unstale":"2024-09-18T01:24:58.198307+0000","last_undegraded":"2024-09-18T01:24:58.198307+0000","last_fullsized":"2024-09-18T01:24:58.198307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:37:38.935073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077351,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.199646+0000","last_change":"2024-09-18T01:24:58.199970+0000","last_active":"2024-09-18T01:24:58.199646+0000","last_peered":"2024-09-18T01:24:58.199646+0000","last_clean":"2024-09-18T01:24:58.199646+0000","last_became_active":"2024-09-18T01:24:56.192301+0000","last_became_peered":"2024-09-18T01:24:56.192301+0000","last_unstale":"2024-09-18T01:24:58.199646+0000","last_undegraded":"2024-09-18T01:24:58.199646+0000","last_fullsized":"2024-09-18T01:24:58.199646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:15.228308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056449699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.198528+0000","last_change":"2024-09-18T01:24:58.198528+0000","last_active":"2024-09-18T01:24:58.198528+0000","last_peered":"2024-09-18T01:24:58.198528+0000","last_clean":"2024-09-18T01:24:58.198528+0000","last_became_active":"2024-09-18T01:24:56.191687+0000","last_became_peered":"2024-09-18T01:24:56.191687+0000","last_unstale":"2024-09-18T01:24:58.198528+0000","last_undegraded":"2024-09-18T01:24:58.198528+0000","last_fullsized":"2024-09-18T01:24:58.198528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:11:00.731633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012745390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.199711+0000","last_change":"2024-09-18T01:24:58.199959+0000","last_active":"2024-09-18T01:24:58.199711+0000","last_peered":"2024-09-18T01:24:58.199711+0000","last_clean":"2024-09-18T01:24:58.199711+0000","last_became_active":"2024-09-18T01:24:56.191033+0000","last_became_peered":"2024-09-18T01:24:56.191033+0000","last_unstale":"2024-09-18T01:24:58.199711+0000","last_undegraded":"2024-09-18T01:24:58.199711+0000","last_fullsized":"2024-09-18T01:24:58.199711+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:45.677191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000547898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.198912+0000","last_change":"2024-09-18T01:24:58.198236+0000","last_active":"2024-09-18T01:24:58.198912+0000","last_peered":"2024-09-18T01:24:58.198912+0000","last_clean":"2024-09-18T01:24:58.198912+0000","last_became_active":"2024-09-18T01:24:56.191713+0000","last_became_peered":"2024-09-18T01:24:56.191713+0000","last_unstale":"2024-09-18T01:24:58.198912+0000","last_undegraded":"2024-09-18T01:24:58.198912+0000","last_fullsized":"2024-09-18T01:24:58.198912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:55:46.520977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010043490000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.350485+0000","last_change":"2024-09-18T01:24:58.350485+0000","last_active":"2024-09-18T01:24:58.350485+0000","last_peered":"2024-09-18T01:24:58.350485+0000","last_clean":"2024-09-18T01:24:58.350485+0000","last_became_active":"2024-09-18T01:24:56.191162+0000","last_became_peered":"2024-09-18T01:24:56.191162+0000","last_unstale":"2024-09-18T01:24:58.350485+0000","last_undegraded":"2024-09-18T01:24:58.350485+0000","last_fullsized":"2024-09-18T01:24:58.350485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:38:00.033247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040921399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.197615+0000","last_change":"2024-09-18T01:24:58.197615+0000","last_active":"2024-09-18T01:24:58.197615+0000","last_peered":"2024-09-18T01:24:58.197615+0000","last_clean":"2024-09-18T01:24:58.197615+0000","last_became_active":"2024-09-18T01:24:56.191554+0000","last_became_peered":"2024-09-18T01:24:56.191554+0000","last_unstale":"2024-09-18T01:24:58.197615+0000","last_undegraded":"2024-09-18T01:24:58.197615+0000","last_fullsized":"2024-09-18T01:24:58.197615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:55.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041584599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.197569+0000","last_change":"2024-09-18T01:24:58.197569+0000","last_active":"2024-09-18T01:24:58.197569+0000","last_peered":"2024-09-18T01:24:58.197569+0000","last_clean":"2024-09-18T01:24:58.197569+0000","last_became_active":"2024-09-18T01:24:56.194443+0000","last_became_peered":"2024-09-18T01:24:56.194443+0000","last_unstale":"2024-09-18T01:24:58.197569+0000","last_undegraded":"2024-09-18T01:24:58.197569+0000","last_fullsized":"2024-09-18T01:24:58.197569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:43:12.854702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033763700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":170,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-18T01:24:58.195425+0000","last_change":"2024-09-18T01:24:52.297138+0000","last_active":"2024-09-18T01:24:58.195425+0000","last_peered":"2024-09-18T01:24:58.195425+0000","last_clean":"2024-09-18T01:24:58.195425+0000","last_became_active":"2024-09-18T01:24:52.296214+0000","last_became_peered":"2024-09-18T01:24:52.296214+0000","last_unstale":"2024-09-18T01:24:58.195425+0000","last_undegraded":"2024-09-18T01:24:58.195425+0000","last_fullsized":"2024-09-18T01:24:58.195425+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_clean_scrub_stamp":"2024-09-18T01:24:51.161687+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:36:16.487345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:25:03.000 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T01:25:03.000 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-18T01:25:03.000 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-18T01:25:03.000 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-18T01:25:03.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.095+0000 7f5548ee4640 1 Processor -- start 2024-09-18T01:25:03.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.095+0000 7f5548ee4640 1 -- start start 2024-09-18T01:25:03.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.095+0000 7f5548ee4640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f554412ed90 0x7f554412f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:03.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.095+0000 7f5548ee4640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f554406bd50 con 0x7f554412f6b0 2024-09-18T01:25:03.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.095+0000 7f5548ee4640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f554406eab0 con 0x7f554412ed90 2024-09-18T01:25:03.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.095+0000 7f554259c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f554412ed90 0x7f554412f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:03.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.095+0000 7f5541d9b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f554412f6b0 0x7f554406d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:49170/0 (socket says 172.21.15.92:49170) 2024-09-18T01:25:03.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.095+0000 7f5541d9b640 1 -- 172.21.15.92:0/2835165788 learned_addr learned my addr 172.21.15.92:0/2835165788 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:25:03.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.096+0000 7f554259c640 1 -- 172.21.15.92:0/2835165788 >> v1:172.21.15.92:6789/0 conn(0x7f554412f6b0 legacy=0x7f554406d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:03.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.096+0000 7f554259c640 1 -- 172.21.15.92:0/2835165788 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554409c640 con 0x7f554412ed90 2024-09-18T01:25:03.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.096+0000 7f554159a640 1 -- 172.21.15.92:0/2835165788 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2271129743 0 0) 0x7f554406bd50 con 0x7f554412f6b0 2024-09-18T01:25:03.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.096+0000 7f554259c640 1 --2- 172.21.15.92:0/2835165788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f554412ed90 0x7f554412f170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5534009720 tx=0x7f553402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7813513318245527 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:03.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.096+0000 7f554159a640 1 -- 172.21.15.92:0/2835165788 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5534037070 con 0x7f554412ed90 2024-09-18T01:25:03.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.097+0000 7f554159a640 1 -- 172.21.15.92:0/2835165788 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553402ad90 con 0x7f554412ed90 2024-09-18T01:25:03.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.097+0000 7f554159a640 1 -- 172.21.15.92:0/2835165788 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5534032590 con 0x7f554412ed90 2024-09-18T01:25:03.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.097+0000 7f5548ee4640 1 -- 172.21.15.92:0/2835165788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f554412ed90 msgr2=0x7f554412f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:03.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.097+0000 7f5548ee4640 1 --2- 172.21.15.92:0/2835165788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f554412ed90 0x7f554412f170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5534009720 tx=0x7f553402a110 comp rx=0 tx=0).stop 2024-09-18T01:25:03.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.097+0000 7f5548ee4640 1 -- 172.21.15.92:0/2835165788 shutdown_connections 2024-09-18T01:25:03.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.097+0000 7f5548ee4640 1 --2- 172.21.15.92:0/2835165788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f554412ed90 0x7f554412f170 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:03.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.097+0000 7f5548ee4640 1 -- 172.21.15.92:0/2835165788 >> 172.21.15.92:0/2835165788 conn(0x7f554409a890 msgr2=0x7f554409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:03.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.097+0000 7f5548ee4640 1 -- 172.21.15.92:0/2835165788 shutdown_connections 2024-09-18T01:25:03.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.097+0000 7f5548ee4640 1 -- 172.21.15.92:0/2835165788 wait complete. 2024-09-18T01:25:03.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.098+0000 7f5548ee4640 1 Processor -- start 2024-09-18T01:25:03.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.098+0000 7f5548ee4640 1 -- start start 2024-09-18T01:25:03.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.098+0000 7f5548ee4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f554412ed90 0x7f5544092a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:03.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.098+0000 7f5548ee4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f554406d910 con 0x7f554412ed90 2024-09-18T01:25:03.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.099+0000 7f554259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f554412ed90 0x7f5544092a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:03.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.099+0000 7f554259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f554412ed90 0x7f5544092a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45500/0 (socket says 172.21.15.92:45500) 2024-09-18T01:25:03.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.099+0000 7f554259c640 1 -- 172.21.15.92:0/1397606859 learned_addr learned my addr 172.21.15.92:0/1397606859 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:25:03.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.099+0000 7f554259c640 1 -- 172.21.15.92:0/1397606859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5544094700 con 0x7f554412ed90 2024-09-18T01:25:03.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.099+0000 7f554259c640 1 --2- 172.21.15.92:0/1397606859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f554412ed90 0x7f5544092a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5534009720 tx=0x7f55340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:03.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.099+0000 7f5532ffd640 1 -- 172.21.15.92:0/1397606859 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5534041070 con 0x7f554412ed90 2024-09-18T01:25:03.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.099+0000 7f5532ffd640 1 -- 172.21.15.92:0/1397606859 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553403c460 con 0x7f554412ed90 2024-09-18T01:25:03.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.099+0000 7f5532ffd640 1 -- 172.21.15.92:0/1397606859 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5534037040 con 0x7f554412ed90 2024-09-18T01:25:03.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.099+0000 7f5548ee4640 1 -- 172.21.15.92:0/1397606859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5544095930 con 0x7f554412ed90 2024-09-18T01:25:03.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.099+0000 7f5548ee4640 1 -- 172.21.15.92:0/1397606859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5544096260 con 0x7f554412ed90 2024-09-18T01:25:03.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.100+0000 7f5532ffd640 1 -- 172.21.15.92:0/1397606859 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5534044070 con 0x7f554412ed90 2024-09-18T01:25:03.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.100+0000 7f5548ee4640 1 -- 172.21.15.92:0/1397606859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5544095e70 con 0x7f554412ed90 2024-09-18T01:25:03.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.100+0000 7f5532ffd640 1 --2- 172.21.15.92:0/1397606859 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f55240382a0 0x7f552403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:03.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.100+0000 7f5532ffd640 1 -- 172.21.15.92:0/1397606859 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f553406bb10 con 0x7f554412ed90 2024-09-18T01:25:03.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.100+0000 7f5541d9b640 1 --2- 172.21.15.92:0/1397606859 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f55240382a0 0x7f552403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:03.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.101+0000 7f5541d9b640 1 --2- 172.21.15.92:0/1397606859 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f55240382a0 0x7f552403a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5538000c00 tx=0x7f5538007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:03.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.105+0000 7f5532ffd640 1 -- 172.21.15.92:0/1397606859 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5534070070 con 0x7f554412ed90 2024-09-18T01:25:03.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.312+0000 7f5548ee4640 1 -- 172.21.15.92:0/1397606859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f554412f170 con 0x7f554412ed90 2024-09-18T01:25:03.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.312+0000 7f5532ffd640 1 -- 172.21.15.92:0/1397606859 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f553403c740 con 0x7f554412ed90 2024-09-18T01:25:03.314 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:25:03.314 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-18T01:25:03.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.314+0000 7f5548ee4640 1 -- 172.21.15.92:0/1397606859 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f55240382a0 msgr2=0x7f552403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:03.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.314+0000 7f5548ee4640 1 --2- 172.21.15.92:0/1397606859 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f55240382a0 0x7f552403a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5538000c00 tx=0x7f5538007910 comp rx=0 tx=0).stop 2024-09-18T01:25:03.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.314+0000 7f5548ee4640 1 -- 172.21.15.92:0/1397606859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f554412ed90 msgr2=0x7f5544092a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:03.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.314+0000 7f5548ee4640 1 --2- 172.21.15.92:0/1397606859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f554412ed90 0x7f5544092a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5534009720 tx=0x7f55340046c0 comp rx=0 tx=0).stop 2024-09-18T01:25:03.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.315+0000 7f5548ee4640 1 -- 172.21.15.92:0/1397606859 shutdown_connections 2024-09-18T01:25:03.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.315+0000 7f5548ee4640 1 --2- 172.21.15.92:0/1397606859 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f55240382a0 0x7f552403a760 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:03.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.315+0000 7f5548ee4640 1 --2- 172.21.15.92:0/1397606859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f554412ed90 0x7f5544092a60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:03.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.315+0000 7f5548ee4640 1 -- 172.21.15.92:0/1397606859 >> 172.21.15.92:0/1397606859 conn(0x7f554409a890 msgr2=0x7f5544097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:03.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.315+0000 7f5548ee4640 1 -- 172.21.15.92:0/1397606859 shutdown_connections 2024-09-18T01:25:03.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:25:03.315+0000 7f5548ee4640 1 -- 172.21.15.92:0/1397606859 wait complete. 2024-09-18T01:25:03.326 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-18T01:25:03.327 INFO:teuthology.run_tasks:Running task rgw... 2024-09-18T01:25:03.341 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-18T01:25:03.341 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-18T01:25:03.341 INFO:tasks.rgw:Creating data pools 2024-09-18T01:25:03.342 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-18T01:25:03.342 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-18T01:25:03.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.454+0000 7f0308fef640 1 Processor -- start 2024-09-18T01:25:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.454+0000 7f0308fef640 1 -- start start 2024-09-18T01:25:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.455+0000 7f0308fef640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0304118020 0x7f0304118400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.455+0000 7f0308fef640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0304112940 con 0x7f0304111da0 2024-09-18T01:25:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.455+0000 7f0308fef640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0304118ac0 con 0x7f0304118020 2024-09-18T01:25:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.455+0000 7f030259c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0304118020 0x7f0304118400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.455+0000 7f030259c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0304118020 0x7f0304118400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:39398/0 (socket says 172.21.15.100:39398) 2024-09-18T01:25:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.455+0000 7f030259c640 1 -- 172.21.15.100:0/2973830094 learned_addr learned my addr 172.21.15.100:0/2973830094 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.455+0000 7f0301d9b640 1 --1- 172.21.15.100:0/2973830094 >> v1:172.21.15.92:6789/0 conn(0x7f0304111da0 0x7f0304112230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:40020/0 (socket says 172.21.15.100:40020) 2024-09-18T01:25:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.455+0000 7f030259c640 1 -- 172.21.15.100:0/2973830094 >> v1:172.21.15.92:6789/0 conn(0x7f0304111da0 legacy=0x7f0304112230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.455+0000 7f030259c640 1 -- 172.21.15.100:0/2973830094 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0304112b10 con 0x7f0304118020 2024-09-18T01:25:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.455+0000 7f030159a640 1 -- 172.21.15.100:0/2973830094 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2833519417 0 0) 0x7f0304112940 con 0x7f0304111da0 2024-09-18T01:25:03.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.456+0000 7f030259c640 1 --2- 172.21.15.100:0/2973830094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304118020 0x7f0304118400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009e50 tx=0x7f02f402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55f871eefc546e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:03.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.456+0000 7f030159a640 1 -- 172.21.15.100:0/2973830094 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02f4036070 con 0x7f0304118020 2024-09-18T01:25:03.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.456+0000 7f030159a640 1 -- 172.21.15.100:0/2973830094 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f4031400 con 0x7f0304118020 2024-09-18T01:25:03.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.456+0000 7f030159a640 1 -- 172.21.15.100:0/2973830094 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02f40315d0 con 0x7f0304118020 2024-09-18T01:25:03.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.457+0000 7f0308fef640 1 -- 172.21.15.100:0/2973830094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304118020 msgr2=0x7f0304118400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:03.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.457+0000 7f0308fef640 1 --2- 172.21.15.100:0/2973830094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304118020 0x7f0304118400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009e50 tx=0x7f02f402a730 comp rx=0 tx=0).stop 2024-09-18T01:25:03.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.457+0000 7f0308fef640 1 -- 172.21.15.100:0/2973830094 shutdown_connections 2024-09-18T01:25:03.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.457+0000 7f0308fef640 1 --2- 172.21.15.100:0/2973830094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304118020 0x7f0304118400 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:03.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.457+0000 7f0308fef640 1 -- 172.21.15.100:0/2973830094 >> 172.21.15.100:0/2973830094 conn(0x7f030406e680 msgr2=0x7f030406ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:03.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.457+0000 7f0308fef640 1 -- 172.21.15.100:0/2973830094 shutdown_connections 2024-09-18T01:25:03.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.457+0000 7f0308fef640 1 -- 172.21.15.100:0/2973830094 wait complete. 2024-09-18T01:25:03.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.458+0000 7f0308fef640 1 Processor -- start 2024-09-18T01:25:03.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.458+0000 7f0308fef640 1 -- start start 2024-09-18T01:25:03.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.458+0000 7f0308fef640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304111da0 0x7f03041a6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:03.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.458+0000 7f0308fef640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f030411e1a0 con 0x7f0304111da0 2024-09-18T01:25:03.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.458+0000 7f030259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304111da0 0x7f03041a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:03.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.458+0000 7f030259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304111da0 0x7f03041a6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:39410/0 (socket says 172.21.15.100:39410) 2024-09-18T01:25:03.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.458+0000 7f030259c640 1 -- 172.21.15.100:0/2235355885 learned_addr learned my addr 172.21.15.100:0/2235355885 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:03.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.458+0000 7f030259c640 1 -- 172.21.15.100:0/2235355885 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03041a6f60 con 0x7f0304111da0 2024-09-18T01:25:03.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.459+0000 7f030259c640 1 --2- 172.21.15.100:0/2235355885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304111da0 0x7f03041a6990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009e50 tx=0x7f02f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:03.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.459+0000 7f02f2ffd640 1 -- 172.21.15.100:0/2235355885 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02f4036040 con 0x7f0304111da0 2024-09-18T01:25:03.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.459+0000 7f02f2ffd640 1 -- 172.21.15.100:0/2235355885 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f4003990 con 0x7f0304111da0 2024-09-18T01:25:03.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.459+0000 7f0308fef640 1 -- 172.21.15.100:0/2235355885 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03041a71f0 con 0x7f0304111da0 2024-09-18T01:25:03.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.459+0000 7f02f2ffd640 1 -- 172.21.15.100:0/2235355885 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02f4003c90 con 0x7f0304111da0 2024-09-18T01:25:03.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.459+0000 7f0308fef640 1 -- 172.21.15.100:0/2235355885 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03041ab220 con 0x7f0304111da0 2024-09-18T01:25:03.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.460+0000 7f02f2ffd640 1 -- 172.21.15.100:0/2235355885 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f02f4004030 con 0x7f0304111da0 2024-09-18T01:25:03.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.460+0000 7f0308fef640 1 -- 172.21.15.100:0/2235355885 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03041a7420 con 0x7f0304111da0 2024-09-18T01:25:03.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.460+0000 7f02f2ffd640 1 --2- 172.21.15.100:0/2235355885 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f02e40382a0 0x7f02e403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:03.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.460+0000 7f02f2ffd640 1 -- 172.21.15.100:0/2235355885 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f02f406c690 con 0x7f0304111da0 2024-09-18T01:25:03.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.460+0000 7f0301d9b640 1 --2- 172.21.15.100:0/2235355885 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f02e40382a0 0x7f02e403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:03.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.460+0000 7f0301d9b640 1 --2- 172.21.15.100:0/2235355885 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f02e40382a0 0x7f02e403a760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f02f8000c00 tx=0x7f02f8007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:03.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.464+0000 7f02f2ffd640 1 -- 172.21.15.100:0/2235355885 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02f40465c0 con 0x7f0304111da0 2024-09-18T01:25:03.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.635+0000 7f0308fef640 1 -- 172.21.15.100:0/2235355885 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7f0304118020 con 0x7f0304111da0 2024-09-18T01:25:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.639+0000 7f02f2ffd640 1 -- 172.21.15.100:0/2235355885 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v19) ==== 171+0+0 (secure 0 0 0) 0x7f02f4046820 con 0x7f0304111da0 2024-09-18T01:25:03.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.642+0000 7f0308fef640 1 -- 172.21.15.100:0/2235355885 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f02e40382a0 msgr2=0x7f02e403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:03.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.642+0000 7f0308fef640 1 --2- 172.21.15.100:0/2235355885 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f02e40382a0 0x7f02e403a760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f02f8000c00 tx=0x7f02f8007910 comp rx=0 tx=0).stop 2024-09-18T01:25:03.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.642+0000 7f0308fef640 1 -- 172.21.15.100:0/2235355885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304111da0 msgr2=0x7f03041a6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:03.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.642+0000 7f0308fef640 1 --2- 172.21.15.100:0/2235355885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304111da0 0x7f03041a6990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009e50 tx=0x7f02f4004a40 comp rx=0 tx=0).stop 2024-09-18T01:25:03.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.642+0000 7f0308fef640 1 -- 172.21.15.100:0/2235355885 shutdown_connections 2024-09-18T01:25:03.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.642+0000 7f0308fef640 1 --2- 172.21.15.100:0/2235355885 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f02e40382a0 0x7f02e403a760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:03.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.642+0000 7f0308fef640 1 --2- 172.21.15.100:0/2235355885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304111da0 0x7f03041a6990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:03.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.642+0000 7f0308fef640 1 -- 172.21.15.100:0/2235355885 >> 172.21.15.100:0/2235355885 conn(0x7f030406e680 msgr2=0x7f0304113d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:03.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.642+0000 7f0308fef640 1 -- 172.21.15.100:0/2235355885 shutdown_connections 2024-09-18T01:25:03.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.642+0000 7f0308fef640 1 -- 172.21.15.100:0/2235355885 wait complete. 2024-09-18T01:25:03.653 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-18T01:25:03.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.752+0000 7f15142aa640 1 Processor -- start 2024-09-18T01:25:03.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.752+0000 7f15142aa640 1 -- start start 2024-09-18T01:25:03.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.752+0000 7f15142aa640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f150c113b00 0x7f150c113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:03.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.752+0000 7f15142aa640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f150c114540 con 0x7f150c073290 2024-09-18T01:25:03.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.752+0000 7f15142aa640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f150c073e30 con 0x7f150c113b00 2024-09-18T01:25:03.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.753+0000 7f1512046640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f150c113b00 0x7f150c113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:03.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.753+0000 7f1512046640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f150c113b00 0x7f150c113ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:39420/0 (socket says 172.21.15.100:39420) 2024-09-18T01:25:03.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.753+0000 7f1511845640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f150c073290 0x7f150c073720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:40024/0 (socket says 172.21.15.100:40024) 2024-09-18T01:25:03.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.753+0000 7f1512046640 1 -- 172.21.15.100:0/2779567157 learned_addr learned my addr 172.21.15.100:0/2779567157 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:03.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.753+0000 7f1512046640 1 -- 172.21.15.100:0/2779567157 >> v1:172.21.15.92:6789/0 conn(0x7f150c073290 legacy=0x7f150c073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:03.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.753+0000 7f1512046640 1 -- 172.21.15.100:0/2779567157 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150c073fe0 con 0x7f150c113b00 2024-09-18T01:25:03.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.754+0000 7f1512046640 1 --2- 172.21.15.100:0/2779567157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f150c113b00 0x7f150c113ee0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15080097f0 tx=0x7f150802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ed93ff07690267 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:03.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.754+0000 7f1511044640 1 -- 172.21.15.100:0/2779567157 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1508037070 con 0x7f150c113b00 2024-09-18T01:25:03.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.754+0000 7f1511044640 1 -- 172.21.15.100:0/2779567157 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1508032440 con 0x7f150c113b00 2024-09-18T01:25:03.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.754+0000 7f1511044640 1 -- 172.21.15.100:0/2779567157 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f150802ae60 con 0x7f150c113b00 2024-09-18T01:25:03.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.754+0000 7f15142aa640 1 -- 172.21.15.100:0/2779567157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f150c113b00 msgr2=0x7f150c113ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:03.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.754+0000 7f15142aa640 1 --2- 172.21.15.100:0/2779567157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f150c113b00 0x7f150c113ee0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15080097f0 tx=0x7f150802a1e0 comp rx=0 tx=0).stop 2024-09-18T01:25:03.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.754+0000 7f15142aa640 1 -- 172.21.15.100:0/2779567157 shutdown_connections 2024-09-18T01:25:03.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.754+0000 7f15142aa640 1 --2- 172.21.15.100:0/2779567157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f150c113b00 0x7f150c113ee0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:03.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.754+0000 7f15142aa640 1 -- 172.21.15.100:0/2779567157 >> 172.21.15.100:0/2779567157 conn(0x7f150c06f330 msgr2=0x7f150c071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:03.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.754+0000 7f15142aa640 1 -- 172.21.15.100:0/2779567157 shutdown_connections 2024-09-18T01:25:03.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.754+0000 7f15142aa640 1 -- 172.21.15.100:0/2779567157 wait complete. 2024-09-18T01:25:03.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.755+0000 7f15142aa640 1 Processor -- start 2024-09-18T01:25:03.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.755+0000 7f15142aa640 1 -- start start 2024-09-18T01:25:03.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.755+0000 7f15142aa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f150c073290 0x7f150c1a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:03.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.755+0000 7f15142aa640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f150c11ae80 con 0x7f150c073290 2024-09-18T01:25:03.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.755+0000 7f1512046640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f150c073290 0x7f150c1a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:03.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.755+0000 7f1512046640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f150c073290 0x7f150c1a4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:39424/0 (socket says 172.21.15.100:39424) 2024-09-18T01:25:03.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.755+0000 7f1512046640 1 -- 172.21.15.100:0/3686170428 learned_addr learned my addr 172.21.15.100:0/3686170428 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:03.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.756+0000 7f1512046640 1 -- 172.21.15.100:0/3686170428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150c1a4f60 con 0x7f150c073290 2024-09-18T01:25:03.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.756+0000 7f1512046640 1 --2- 172.21.15.100:0/3686170428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f150c073290 0x7f150c1a4a20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1508035040 tx=0x7f15080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:03.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.756+0000 7f1502ffd640 1 -- 172.21.15.100:0/3686170428 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1508041070 con 0x7f150c073290 2024-09-18T01:25:03.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.756+0000 7f1502ffd640 1 -- 172.21.15.100:0/3686170428 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150803c7a0 con 0x7f150c073290 2024-09-18T01:25:03.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.756+0000 7f15142aa640 1 -- 172.21.15.100:0/3686170428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f150c1a51f0 con 0x7f150c073290 2024-09-18T01:25:03.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.756+0000 7f1502ffd640 1 -- 172.21.15.100:0/3686170428 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1508037040 con 0x7f150c073290 2024-09-18T01:25:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.756+0000 7f15142aa640 1 -- 172.21.15.100:0/3686170428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f150c1a91a0 con 0x7f150c073290 2024-09-18T01:25:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.757+0000 7f1502ffd640 1 -- 172.21.15.100:0/3686170428 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1508044070 con 0x7f150c073290 2024-09-18T01:25:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.757+0000 7f15142aa640 1 -- 172.21.15.100:0/3686170428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f150c1a9b80 con 0x7f150c073290 2024-09-18T01:25:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.757+0000 7f1502ffd640 1 --2- 172.21.15.100:0/3686170428 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14f0038280 0x7f14f003a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.757+0000 7f1502ffd640 1 -- 172.21.15.100:0/3686170428 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3825+0+0 (secure 0 0 0) 0x7f150806bfe0 con 0x7f150c073290 2024-09-18T01:25:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.757+0000 7f1511845640 1 --2- 172.21.15.100:0/3686170428 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14f0038280 0x7f14f003a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.757+0000 7f1511845640 1 --2- 172.21.15.100:0/3686170428 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14f0038280 0x7f14f003a740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0015f0 tx=0x7f14fc007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:03.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.762+0000 7f1502ffd640 1 -- 172.21.15.100:0/3686170428 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f150806ad70 con 0x7f150c073290 2024-09-18T01:25:03.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:03.929+0000 7f15142aa640 1 -- 172.21.15.100:0/3686170428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f150c1a9da0 con 0x7f150c073290 2024-09-18T01:25:05.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.644+0000 7f1502ffd640 1 -- 172.21.15.100:0/3686170428 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v21) ==== 227+0+0 (secure 0 0 0) 0x7f150803a520 con 0x7f150c073290 2024-09-18T01:25:05.646 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'default.rgw.buckets.data' created 2024-09-18T01:25:05.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.647+0000 7f15142aa640 1 -- 172.21.15.100:0/3686170428 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14f0038280 msgr2=0x7f14f003a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:05.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.647+0000 7f15142aa640 1 --2- 172.21.15.100:0/3686170428 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14f0038280 0x7f14f003a740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0015f0 tx=0x7f14fc007a40 comp rx=0 tx=0).stop 2024-09-18T01:25:05.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.647+0000 7f15142aa640 1 -- 172.21.15.100:0/3686170428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f150c073290 msgr2=0x7f150c1a4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:05.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.647+0000 7f15142aa640 1 --2- 172.21.15.100:0/3686170428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f150c073290 0x7f150c1a4a20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1508035040 tx=0x7f15080046c0 comp rx=0 tx=0).stop 2024-09-18T01:25:05.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.647+0000 7f15142aa640 1 -- 172.21.15.100:0/3686170428 shutdown_connections 2024-09-18T01:25:05.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.647+0000 7f15142aa640 1 --2- 172.21.15.100:0/3686170428 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14f0038280 0x7f14f003a740 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:05.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.647+0000 7f15142aa640 1 --2- 172.21.15.100:0/3686170428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f150c073290 0x7f150c1a4a20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:05.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.647+0000 7f15142aa640 1 -- 172.21.15.100:0/3686170428 >> 172.21.15.100:0/3686170428 conn(0x7f150c06f330 msgr2=0x7f150c10f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:05.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.648+0000 7f15142aa640 1 -- 172.21.15.100:0/3686170428 shutdown_connections 2024-09-18T01:25:05.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.648+0000 7f15142aa640 1 -- 172.21.15.100:0/3686170428 wait complete. 2024-09-18T01:25:05.670 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-18T01:25:05.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.770+0000 7f331dc47640 1 Processor -- start 2024-09-18T01:25:05.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.770+0000 7f331dc47640 1 -- start start 2024-09-18T01:25:05.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.770+0000 7f331dc47640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f331806d540 0x7f331806d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:05.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.770+0000 7f331dc47640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f331806e2f0 con 0x7f331806de60 2024-09-18T01:25:05.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.770+0000 7f331dc47640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f331811e930 con 0x7f331806d540 2024-09-18T01:25:05.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.770+0000 7f33177fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f331806d540 0x7f331806d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:05.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.770+0000 7f33177fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f331806d540 0x7f331806d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:39438/0 (socket says 172.21.15.100:39438) 2024-09-18T01:25:05.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.770+0000 7f33177fe640 1 -- 172.21.15.100:0/3821658444 learned_addr learned my addr 172.21.15.100:0/3821658444 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:05.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.771+0000 7f33177fe640 1 -- 172.21.15.100:0/3821658444 >> v1:172.21.15.92:6789/0 conn(0x7f331806de60 legacy=0x7f331811c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:05.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.771+0000 7f33177fe640 1 -- 172.21.15.100:0/3821658444 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331811eab0 con 0x7f331806d540 2024-09-18T01:25:05.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.771+0000 7f33177fe640 1 --2- 172.21.15.100:0/3821658444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331806d540 0x7f331806d920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f33080097f0 tx=0x7f330802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc8002633e4814d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:05.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.771+0000 7f33167fc640 1 -- 172.21.15.100:0/3821658444 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3308037070 con 0x7f331806d540 2024-09-18T01:25:05.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.772+0000 7f33167fc640 1 -- 172.21.15.100:0/3821658444 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3308032440 con 0x7f331806d540 2024-09-18T01:25:05.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.772+0000 7f33167fc640 1 -- 172.21.15.100:0/3821658444 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3308032740 con 0x7f331806d540 2024-09-18T01:25:05.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.772+0000 7f331dc47640 1 -- 172.21.15.100:0/3821658444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331806d540 msgr2=0x7f331806d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:05.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.772+0000 7f331dc47640 1 --2- 172.21.15.100:0/3821658444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331806d540 0x7f331806d920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f33080097f0 tx=0x7f330802a270 comp rx=0 tx=0).stop 2024-09-18T01:25:05.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.772+0000 7f331dc47640 1 -- 172.21.15.100:0/3821658444 shutdown_connections 2024-09-18T01:25:05.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.772+0000 7f331dc47640 1 --2- 172.21.15.100:0/3821658444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331806d540 0x7f331806d920 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:05.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.772+0000 7f331dc47640 1 -- 172.21.15.100:0/3821658444 >> 172.21.15.100:0/3821658444 conn(0x7f3318071070 msgr2=0x7f3318073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:05.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.772+0000 7f331dc47640 1 -- 172.21.15.100:0/3821658444 shutdown_connections 2024-09-18T01:25:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.772+0000 7f331dc47640 1 -- 172.21.15.100:0/3821658444 wait complete. 2024-09-18T01:25:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.773+0000 7f331dc47640 1 Processor -- start 2024-09-18T01:25:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.773+0000 7f331dc47640 1 -- start start 2024-09-18T01:25:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.773+0000 7f331dc47640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331806d540 0x7f33181a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.773+0000 7f331dc47640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f331811de40 con 0x7f331806d540 2024-09-18T01:25:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.773+0000 7f33177fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331806d540 0x7f33181a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.773+0000 7f33177fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331806d540 0x7f33181a6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:39454/0 (socket says 172.21.15.100:39454) 2024-09-18T01:25:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.773+0000 7f33177fe640 1 -- 172.21.15.100:0/1416687177 learned_addr learned my addr 172.21.15.100:0/1416687177 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.774+0000 7f33177fe640 1 -- 172.21.15.100:0/1416687177 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33181a71a0 con 0x7f331806d540 2024-09-18T01:25:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.774+0000 7f33177fe640 1 --2- 172.21.15.100:0/1416687177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331806d540 0x7f33181a6bd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3308035040 tx=0x7f33080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.774+0000 7f32fffff640 1 -- 172.21.15.100:0/1416687177 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3308041070 con 0x7f331806d540 2024-09-18T01:25:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.774+0000 7f32fffff640 1 -- 172.21.15.100:0/1416687177 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330803c7a0 con 0x7f331806d540 2024-09-18T01:25:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.774+0000 7f32fffff640 1 -- 172.21.15.100:0/1416687177 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3308037040 con 0x7f331806d540 2024-09-18T01:25:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.774+0000 7f331dc47640 1 -- 172.21.15.100:0/1416687177 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33181a7430 con 0x7f331806d540 2024-09-18T01:25:05.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.774+0000 7f331dc47640 1 -- 172.21.15.100:0/1416687177 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33181ab500 con 0x7f331806d540 2024-09-18T01:25:05.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.775+0000 7f331dc47640 1 -- 172.21.15.100:0/1416687177 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f331806d920 con 0x7f331806d540 2024-09-18T01:25:05.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.775+0000 7f32fffff640 1 -- 172.21.15.100:0/1416687177 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3308044070 con 0x7f331806d540 2024-09-18T01:25:05.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.775+0000 7f32fffff640 1 --2- 172.21.15.100:0/1416687177 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f3304038250 0x7f330403a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:05.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.775+0000 7f32fffff640 1 -- 172.21.15.100:0/1416687177 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4272+0+0 (secure 0 0 0) 0x7f330806c0b0 con 0x7f331806d540 2024-09-18T01:25:05.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.775+0000 7f3316ffd640 1 --2- 172.21.15.100:0/1416687177 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f3304038250 0x7f330403a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:05.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.776+0000 7f3316ffd640 1 --2- 172.21.15.100:0/1416687177 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f3304038250 0x7f330403a710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f330c000f60 tx=0x7f330c007a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:05.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.780+0000 7f32fffff640 1 -- 172.21.15.100:0/1416687177 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f330803a760 con 0x7f331806d540 2024-09-18T01:25:05.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:05.946+0000 7f331dc47640 1 -- 172.21.15.100:0/1416687177 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f33180008d0 con 0x7f331806d540 2024-09-18T01:25:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.647+0000 7f32fffff640 1 -- 172.21.15.100:0/1416687177 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v22) ==== 185+0+0 (secure 0 0 0) 0x7f330803d3f0 con 0x7f331806d540 2024-09-18T01:25:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-18T01:25:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.651+0000 7f331dc47640 1 -- 172.21.15.100:0/1416687177 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f3304038250 msgr2=0x7f330403a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.651+0000 7f331dc47640 1 --2- 172.21.15.100:0/1416687177 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f3304038250 0x7f330403a710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f330c000f60 tx=0x7f330c007a30 comp rx=0 tx=0).stop 2024-09-18T01:25:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.651+0000 7f331dc47640 1 -- 172.21.15.100:0/1416687177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331806d540 msgr2=0x7f33181a6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.651+0000 7f331dc47640 1 --2- 172.21.15.100:0/1416687177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331806d540 0x7f33181a6bd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3308035040 tx=0x7f33080046c0 comp rx=0 tx=0).stop 2024-09-18T01:25:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.652+0000 7f331dc47640 1 -- 172.21.15.100:0/1416687177 shutdown_connections 2024-09-18T01:25:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.652+0000 7f331dc47640 1 --2- 172.21.15.100:0/1416687177 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f3304038250 0x7f330403a710 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:06.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.652+0000 7f331dc47640 1 --2- 172.21.15.100:0/1416687177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331806d540 0x7f33181a6bd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:06.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.652+0000 7f331dc47640 1 -- 172.21.15.100:0/1416687177 >> 172.21.15.100:0/1416687177 conn(0x7f3318071070 msgr2=0x7f331811c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:06.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.655+0000 7f331dc47640 1 -- 172.21.15.100:0/1416687177 shutdown_connections 2024-09-18T01:25:06.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.655+0000 7f331dc47640 1 -- 172.21.15.100:0/1416687177 wait complete. 2024-09-18T01:25:06.687 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-18T01:25:06.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.794+0000 7f0d775e4640 1 Processor -- start 2024-09-18T01:25:06.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.794+0000 7f0d775e4640 1 -- start start 2024-09-18T01:25:06.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.794+0000 7f0d775e4640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0d70114530 0x7f0d70114910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:06.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.794+0000 7f0d775e4640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d7010f940 con 0x7f0d7010ed80 2024-09-18T01:25:06.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.794+0000 7f0d775e4640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0d7010fb10 con 0x7f0d70114530 2024-09-18T01:25:06.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.795+0000 7f0d75380640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0d70114530 0x7f0d70114910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:06.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.795+0000 7f0d75380640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0d70114530 0x7f0d70114910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:39456/0 (socket says 172.21.15.100:39456) 2024-09-18T01:25:06.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.795+0000 7f0d75380640 1 -- 172.21.15.100:0/205214981 learned_addr learned my addr 172.21.15.100:0/205214981 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:06.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.795+0000 7f0d75380640 1 -- 172.21.15.100:0/205214981 >> v1:172.21.15.92:6789/0 conn(0x7f0d7010ed80 legacy=0x7f0d7010f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:06.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.795+0000 7f0d75380640 1 -- 172.21.15.100:0/205214981 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d70073260 con 0x7f0d70114530 2024-09-18T01:25:06.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.796+0000 7f0d75380640 1 --2- 172.21.15.100:0/205214981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d70114530 0x7f0d70114910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00ba90 tx=0x7f0d6c02c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b75e78725cb513 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:06.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.796+0000 7f0d67fff640 1 -- 172.21.15.100:0/205214981 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d6c033570 con 0x7f0d70114530 2024-09-18T01:25:06.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.796+0000 7f0d67fff640 1 -- 172.21.15.100:0/205214981 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6c038070 con 0x7f0d70114530 2024-09-18T01:25:06.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.796+0000 7f0d67fff640 1 -- 172.21.15.100:0/205214981 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d6c033860 con 0x7f0d70114530 2024-09-18T01:25:06.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.796+0000 7f0d775e4640 1 -- 172.21.15.100:0/205214981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d70114530 msgr2=0x7f0d70114910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:06.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.796+0000 7f0d775e4640 1 --2- 172.21.15.100:0/205214981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d70114530 0x7f0d70114910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00ba90 tx=0x7f0d6c02c8b0 comp rx=0 tx=0).stop 2024-09-18T01:25:06.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.796+0000 7f0d775e4640 1 -- 172.21.15.100:0/205214981 shutdown_connections 2024-09-18T01:25:06.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.796+0000 7f0d775e4640 1 --2- 172.21.15.100:0/205214981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d70114530 0x7f0d70114910 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:06.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.796+0000 7f0d775e4640 1 -- 172.21.15.100:0/205214981 >> 172.21.15.100:0/205214981 conn(0x7f0d7006f300 msgr2=0x7f0d70071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:06.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.797+0000 7f0d775e4640 1 -- 172.21.15.100:0/205214981 shutdown_connections 2024-09-18T01:25:06.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.797+0000 7f0d775e4640 1 -- 172.21.15.100:0/205214981 wait complete. 2024-09-18T01:25:06.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.797+0000 7f0d775e4640 1 Processor -- start 2024-09-18T01:25:06.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.797+0000 7f0d775e4640 1 -- start start 2024-09-18T01:25:06.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.797+0000 7f0d775e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7010ed80 0x7f0d701a8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:06.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.797+0000 7f0d775e4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7011a140 con 0x7f0d7010ed80 2024-09-18T01:25:06.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.798+0000 7f0d75380640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7010ed80 0x7f0d701a8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:06.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.798+0000 7f0d75380640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7010ed80 0x7f0d701a8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:39458/0 (socket says 172.21.15.100:39458) 2024-09-18T01:25:06.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.798+0000 7f0d75380640 1 -- 172.21.15.100:0/556795510 learned_addr learned my addr 172.21.15.100:0/556795510 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:06.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.798+0000 7f0d75380640 1 -- 172.21.15.100:0/556795510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d701a89d0 con 0x7f0d7010ed80 2024-09-18T01:25:06.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.798+0000 7f0d75380640 1 --2- 172.21.15.100:0/556795510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7010ed80 0x7f0d701a8400 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00ba90 tx=0x7f0d6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:06.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.798+0000 7f0d65ffb640 1 -- 172.21.15.100:0/556795510 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d6c046520 con 0x7f0d7010ed80 2024-09-18T01:25:06.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.798+0000 7f0d65ffb640 1 -- 172.21.15.100:0/556795510 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6c0466c0 con 0x7f0d7010ed80 2024-09-18T01:25:06.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.798+0000 7f0d65ffb640 1 -- 172.21.15.100:0/556795510 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d6c0469e0 con 0x7f0d7010ed80 2024-09-18T01:25:06.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.798+0000 7f0d775e4640 1 -- 172.21.15.100:0/556795510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d701a8c00 con 0x7f0d7010ed80 2024-09-18T01:25:06.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.799+0000 7f0d775e4640 1 -- 172.21.15.100:0/556795510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d701a2490 con 0x7f0d7010ed80 2024-09-18T01:25:06.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.799+0000 7f0d65ffb640 1 -- 172.21.15.100:0/556795510 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0d6c04d060 con 0x7f0d7010ed80 2024-09-18T01:25:06.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.799+0000 7f0d775e4640 1 -- 172.21.15.100:0/556795510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d70114530 con 0x7f0d7010ed80 2024-09-18T01:25:06.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.800+0000 7f0d65ffb640 1 --2- 172.21.15.100:0/556795510 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0d54038250 0x7f0d5403a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:06.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.800+0000 7f0d65ffb640 1 -- 172.21.15.100:0/556795510 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4283+0+0 (secure 0 0 0) 0x7f0d6c06e6b0 con 0x7f0d7010ed80 2024-09-18T01:25:06.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.800+0000 7f0d74b7f640 1 --2- 172.21.15.100:0/556795510 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0d54038250 0x7f0d5403a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:06.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.800+0000 7f0d74b7f640 1 --2- 172.21.15.100:0/556795510 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0d54038250 0x7f0d5403a710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0d60000f60 tx=0x7f0d60007a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:06.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.804+0000 7f0d65ffb640 1 -- 172.21.15.100:0/556795510 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d6c041070 con 0x7f0d7010ed80 2024-09-18T01:25:06.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:06.969+0000 7f0d775e4640 1 -- 172.21.15.100:0/556795510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f0d70114750 con 0x7f0d7010ed80 2024-09-18T01:25:07.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.651+0000 7f0d65ffb640 1 -- 172.21.15.100:0/556795510 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v23) ==== 169+0+0 (secure 0 0 0) 0x7f0d6c06e2c0 con 0x7f0d7010ed80 2024-09-18T01:25:07.653 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'default.rgw.buckets.index' created 2024-09-18T01:25:07.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.653+0000 7f0d775e4640 1 -- 172.21.15.100:0/556795510 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0d54038250 msgr2=0x7f0d5403a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:07.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.653+0000 7f0d775e4640 1 --2- 172.21.15.100:0/556795510 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0d54038250 0x7f0d5403a710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0d60000f60 tx=0x7f0d60007a30 comp rx=0 tx=0).stop 2024-09-18T01:25:07.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.653+0000 7f0d775e4640 1 -- 172.21.15.100:0/556795510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7010ed80 msgr2=0x7f0d701a8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:07.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.653+0000 7f0d775e4640 1 --2- 172.21.15.100:0/556795510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7010ed80 0x7f0d701a8400 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00ba90 tx=0x7f0d6c0046c0 comp rx=0 tx=0).stop 2024-09-18T01:25:07.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.654+0000 7f0d775e4640 1 -- 172.21.15.100:0/556795510 shutdown_connections 2024-09-18T01:25:07.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.654+0000 7f0d775e4640 1 --2- 172.21.15.100:0/556795510 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0d54038250 0x7f0d5403a710 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:07.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.654+0000 7f0d775e4640 1 --2- 172.21.15.100:0/556795510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7010ed80 0x7f0d701a8400 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:07.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.654+0000 7f0d775e4640 1 -- 172.21.15.100:0/556795510 >> 172.21.15.100:0/556795510 conn(0x7f0d7006f300 msgr2=0x7f0d701150d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.654+0000 7f0d775e4640 1 -- 172.21.15.100:0/556795510 shutdown_connections 2024-09-18T01:25:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.654+0000 7f0d775e4640 1 -- 172.21.15.100:0/556795510 wait complete. 2024-09-18T01:25:07.674 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-18T01:25:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.775+0000 7fae9d4f7640 1 Processor -- start 2024-09-18T01:25:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.776+0000 7fae9d4f7640 1 -- start start 2024-09-18T01:25:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.776+0000 7fae9d4f7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fae9811acb0 0x7fae9811d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.776+0000 7fae9d4f7640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae9811d5e0 con 0x7fae98117fe0 2024-09-18T01:25:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.776+0000 7fae9d4f7640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fae9811e7e0 con 0x7fae9811acb0 2024-09-18T01:25:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.776+0000 7fae967fc640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fae9811acb0 0x7fae9811d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.776+0000 7fae96ffd640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fae98117fe0 0x7fae981183c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:40050/0 (socket says 172.21.15.100:40050) 2024-09-18T01:25:07.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.776+0000 7fae96ffd640 1 -- 172.21.15.100:0/4090442311 learned_addr learned my addr 172.21.15.100:0/4090442311 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:07.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.776+0000 7fae967fc640 1 -- 172.21.15.100:0/4090442311 >> v1:172.21.15.92:6789/0 conn(0x7fae98117fe0 legacy=0x7fae981183c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:07.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.777+0000 7fae967fc640 1 -- 172.21.15.100:0/4090442311 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae9811e990 con 0x7fae9811acb0 2024-09-18T01:25:07.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.777+0000 7fae967fc640 1 --2- 172.21.15.100:0/4090442311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae9811acb0 0x7fae9811d0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae80009720 tx=0x7fae8002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b288f52db4b184 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:07.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.778+0000 7fae95ffb640 1 -- 172.21.15.100:0/4090442311 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae80037070 con 0x7fae9811acb0 2024-09-18T01:25:07.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.778+0000 7fae95ffb640 1 -- 172.21.15.100:0/4090442311 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae8002ad90 con 0x7fae9811acb0 2024-09-18T01:25:07.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.778+0000 7fae95ffb640 1 -- 172.21.15.100:0/4090442311 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae80032590 con 0x7fae9811acb0 2024-09-18T01:25:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.778+0000 7fae9d4f7640 1 -- 172.21.15.100:0/4090442311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae9811acb0 msgr2=0x7fae9811d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.778+0000 7fae9d4f7640 1 --2- 172.21.15.100:0/4090442311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae9811acb0 0x7fae9811d0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae80009720 tx=0x7fae8002a110 comp rx=0 tx=0).stop 2024-09-18T01:25:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.778+0000 7fae9d4f7640 1 -- 172.21.15.100:0/4090442311 shutdown_connections 2024-09-18T01:25:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.778+0000 7fae9d4f7640 1 --2- 172.21.15.100:0/4090442311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae9811acb0 0x7fae9811d0a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.778+0000 7fae9d4f7640 1 -- 172.21.15.100:0/4090442311 >> 172.21.15.100:0/4090442311 conn(0x7fae9806e680 msgr2=0x7fae9806ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.778+0000 7fae9d4f7640 1 -- 172.21.15.100:0/4090442311 shutdown_connections 2024-09-18T01:25:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.778+0000 7fae9d4f7640 1 -- 172.21.15.100:0/4090442311 wait complete. 2024-09-18T01:25:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.779+0000 7fae9d4f7640 1 Processor -- start 2024-09-18T01:25:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.779+0000 7fae9d4f7640 1 -- start start 2024-09-18T01:25:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.779+0000 7fae9d4f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae98117fe0 0x7fae981a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.779+0000 7fae9d4f7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fae9811dcd0 con 0x7fae98117fe0 2024-09-18T01:25:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.779+0000 7fae96ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae98117fe0 0x7fae981a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.780+0000 7fae96ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae98117fe0 0x7fae981a6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:39486/0 (socket says 172.21.15.100:39486) 2024-09-18T01:25:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.780+0000 7fae96ffd640 1 -- 172.21.15.100:0/2793969272 learned_addr learned my addr 172.21.15.100:0/2793969272 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.780+0000 7fae96ffd640 1 -- 172.21.15.100:0/2793969272 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae981a7160 con 0x7fae98117fe0 2024-09-18T01:25:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.780+0000 7fae96ffd640 1 --2- 172.21.15.100:0/2793969272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae98117fe0 0x7fae981a6b90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fae8800c380 tx=0x7fae8800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.780+0000 7fae8f7fe640 1 -- 172.21.15.100:0/2793969272 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae88005c10 con 0x7fae98117fe0 2024-09-18T01:25:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.780+0000 7fae8f7fe640 1 -- 172.21.15.100:0/2793969272 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae88005db0 con 0x7fae98117fe0 2024-09-18T01:25:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.780+0000 7fae9d4f7640 1 -- 172.21.15.100:0/2793969272 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae981a73f0 con 0x7fae98117fe0 2024-09-18T01:25:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.780+0000 7fae8f7fe640 1 -- 172.21.15.100:0/2793969272 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae88004930 con 0x7fae98117fe0 2024-09-18T01:25:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.780+0000 7fae9d4f7640 1 -- 172.21.15.100:0/2793969272 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae981ab4c0 con 0x7fae98117fe0 2024-09-18T01:25:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.781+0000 7fae9d4f7640 1 -- 172.21.15.100:0/2793969272 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae9811e290 con 0x7fae98117fe0 2024-09-18T01:25:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.781+0000 7fae8f7fe640 1 -- 172.21.15.100:0/2793969272 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fae8801a020 con 0x7fae98117fe0 2024-09-18T01:25:07.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.781+0000 7fae8f7fe640 1 --2- 172.21.15.100:0/2793969272 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fae780382a0 0x7fae7803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:07.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.782+0000 7fae8f7fe640 1 -- 172.21.15.100:0/2793969272 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4647+0+0 (secure 0 0 0) 0x7fae8804af60 con 0x7fae98117fe0 2024-09-18T01:25:07.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.782+0000 7fae967fc640 1 --2- 172.21.15.100:0/2793969272 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fae780382a0 0x7fae7803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:07.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.782+0000 7fae967fc640 1 --2- 172.21.15.100:0/2793969272 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fae780382a0 0x7fae7803a760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae80034000 tx=0x7fae8002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:07.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.787+0000 7fae8f7fe640 1 -- 172.21.15.100:0/2793969272 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae880499a0 con 0x7fae98117fe0 2024-09-18T01:25:07.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:07.952+0000 7fae9d4f7640 1 -- 172.21.15.100:0/2793969272 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fae981a7620 con 0x7fae98117fe0 2024-09-18T01:25:08.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:08.659+0000 7fae8f7fe640 1 -- 172.21.15.100:0/2793969272 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v24) ==== 187+0+0 (secure 0 0 0) 0x7fae880127f0 con 0x7fae98117fe0 2024-09-18T01:25:08.660 INFO:teuthology.orchestra.run.smithi100.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-18T01:25:08.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:08.661+0000 7fae9d4f7640 1 -- 172.21.15.100:0/2793969272 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fae780382a0 msgr2=0x7fae7803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:08.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:08.661+0000 7fae9d4f7640 1 --2- 172.21.15.100:0/2793969272 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fae780382a0 0x7fae7803a760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae80034000 tx=0x7fae8002e000 comp rx=0 tx=0).stop 2024-09-18T01:25:08.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:08.661+0000 7fae9d4f7640 1 -- 172.21.15.100:0/2793969272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae98117fe0 msgr2=0x7fae981a6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:08.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:08.661+0000 7fae9d4f7640 1 --2- 172.21.15.100:0/2793969272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae98117fe0 0x7fae981a6b90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fae8800c380 tx=0x7fae8800c840 comp rx=0 tx=0).stop 2024-09-18T01:25:08.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:08.661+0000 7fae9d4f7640 1 -- 172.21.15.100:0/2793969272 shutdown_connections 2024-09-18T01:25:08.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:08.661+0000 7fae9d4f7640 1 --2- 172.21.15.100:0/2793969272 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fae780382a0 0x7fae7803a760 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae80034000 tx=0x7fae8002e000 comp rx=0 tx=0).stop 2024-09-18T01:25:08.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:08.661+0000 7fae9d4f7640 1 --2- 172.21.15.100:0/2793969272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae98117fe0 0x7fae981a6b90 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fae8800c380 tx=0x7fae8800c840 comp rx=0 tx=0).stop 2024-09-18T01:25:08.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:08.661+0000 7fae9d4f7640 1 -- 172.21.15.100:0/2793969272 >> 172.21.15.100:0/2793969272 conn(0x7fae9806e680 msgr2=0x7fae98110d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:08.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:08.663+0000 7fae9d4f7640 1 -- 172.21.15.100:0/2793969272 shutdown_connections 2024-09-18T01:25:08.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:08.664+0000 7fae9d4f7640 1 -- 172.21.15.100:0/2793969272 wait complete. 2024-09-18T01:25:08.692 DEBUG:tasks.rgw:Pools created 2024-09-18T01:25:08.692 INFO:tasks.rgw:Starting rgw... 2024-09-18T01:25:08.692 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-18T01:25:08.692 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-18T01:25:08.692 DEBUG:teuthology.orchestra.run.smithi100:> sudo echo -n http://smithi100.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-18T01:25:08.719 INFO:teuthology.orchestra.run.smithi100.stdout:http://smithi100.front.sepia.ceph.com:80 2024-09-18T01:25:08.719 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-18T01:25:08.785 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-18T01:25:08.785 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-18T01:25:08.827 INFO:tasks.rgw.client.0:Started 2024-09-18T01:25:08.827 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi100.front.sepia.ceph.com:80/ 2024-09-18T01:25:08.828 DEBUG:teuthology.orchestra.run.smithi100:> curl http://smithi100.front.sepia.ceph.com:80/ 2024-09-18T01:25:08.855 INFO:teuthology.orchestra.run.smithi100.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T01:25:08.855 INFO:teuthology.orchestra.run.smithi100.stderr: Dload Upload Total Spent Left Speed 2024-09-18T01:25:08.856 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-18T01:25:08.856 INFO:teuthology.orchestra.run.smithi100.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-18T01:25:08.857 INFO:teuthology.orchestra.run.smithi100.stderr:curl: (7) Failed to connect to smithi100.front.sepia.ceph.com port 80: Connection refused 2024-09-18T01:25:09.858 DEBUG:teuthology.orchestra.run.smithi100:> curl http://smithi100.front.sepia.ceph.com:80/ 2024-09-18T01:25:09.879 INFO:teuthology.orchestra.run.smithi100.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T01:25:09.879 INFO:teuthology.orchestra.run.smithi100.stderr: Dload Upload Total Spent Left Speed 2024-09-18T01:25:09.879 INFO:teuthology.orchestra.run.smithi100.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-18T01:25:09.880 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-18T01:25:09.881 INFO:teuthology.orchestra.run.smithi100.stderr:curl: (7) Failed to connect to smithi100.front.sepia.ceph.com port 80: Connection refused 2024-09-18T01:25:11.882 DEBUG:teuthology.orchestra.run.smithi100:> curl http://smithi100.front.sepia.ceph.com:80/ 2024-09-18T01:25:11.906 INFO:teuthology.orchestra.run.smithi100.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T01:25:11.906 INFO:teuthology.orchestra.run.smithi100.stderr: Dload Upload Total Spent Left Speed 2024-09-18T01:25:11.906 INFO:teuthology.orchestra.run.smithi100.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-18T01:25:11.906 INFO:teuthology.orchestra.run.smithi100.stderr:curl: (7) Failed to connect to smithi100.front.sepia.ceph.com port 80: Connection refused 2024-09-18T01:25:11.907 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-18T01:25:15.908 DEBUG:teuthology.orchestra.run.smithi100:> curl http://smithi100.front.sepia.ceph.com:80/ 2024-09-18T01:25:15.932 INFO:teuthology.orchestra.run.smithi100.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T01:25:15.932 INFO:teuthology.orchestra.run.smithi100.stderr: Dload Upload Total Spent Left Speed 2024-09-18T01:25:15.932 INFO:teuthology.orchestra.run.smithi100.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-18T01:25:15.933 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-18T01:25:15.933 INFO:teuthology.orchestra.run.smithi100.stderr:curl: (7) Failed to connect to smithi100.front.sepia.ceph.com port 80: Connection refused 2024-09-18T01:25:17.788 INFO:tasks.rgw.client.0.smithi100.stdout:2024-09-18T01:25:17.787+0000 7fa50d326880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-18T01:25:23.934 DEBUG:teuthology.orchestra.run.smithi100:> curl http://smithi100.front.sepia.ceph.com:80/ 2024-09-18T01:25:23.958 INFO:teuthology.orchestra.run.smithi100.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T01:25:23.958 INFO:teuthology.orchestra.run.smithi100.stderr: Dload Upload Total Spent Left Speed 2024-09-18T01:25:23.960 INFO:teuthology.orchestra.run.smithi100.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-18T01:25:23.960 INFO:teuthology.orchestra.run.smithi100.stdout:anonymous 2024-09-18T01:25:23.961 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-18T01:25:25.674 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-18T01:25:25.674 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-18T01:25:25.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-18T01:25:25.674 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-18T01:25:25.724 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:25.724 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:25.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.723+0000 7ffa5f926800 1 Processor -- start 2024-09-18T01:25:25.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.723+0000 7ffa5f926800 1 -- start start 2024-09-18T01:25:25.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.724+0000 7ffa5f926800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560e11f77d80 0x560e11f7a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.724+0000 7ffa5f926800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560e11e30b30 con 0x560e11ee5600 2024-09-18T01:25:25.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.724+0000 7ffa5f926800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x560e11e12360 con 0x560e11f77d80 2024-09-18T01:25:25.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.724+0000 7ffa5ade2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560e11f77d80 0x560e11f7a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.724+0000 7ffa5b5e3640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x560e11ee5600 0x560e11f76660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59122/0 (socket says 172.21.15.100:59122) 2024-09-18T01:25:25.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.724+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/2122852469 learned_addr learned my addr 172.21.15.100:0/2122852469 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:25.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.724+0000 7ffa5ade2640 1 --2- 172.21.15.100:0/2122852469 >> v2:172.21.15.92:3300/0 conn(0x560e11f77d80 0x560e11f7a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60540/0 (socket says 172.21.15.100:60540) 2024-09-18T01:25:25.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.724+0000 7ffa5ade2640 1 -- 172.21.15.100:0/2122852469 >> v1:172.21.15.92:6789/0 conn(0x560e11ee5600 legacy=0x560e11f76660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.724+0000 7ffa5ade2640 1 -- 172.21.15.100:0/2122852469 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e11e38e00 con 0x560e11f77d80 2024-09-18T01:25:25.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.726+0000 7ffa5ade2640 1 --2- 172.21.15.100:0/2122852469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11f77d80 0x560e11f7a170 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000a470 tx=0x7ffa50045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b18c4a481d090b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.727+0000 7ffa5a5e1640 1 -- 172.21.15.100:0/2122852469 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa50053570 con 0x560e11f77d80 2024-09-18T01:25:25.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.727+0000 7ffa5a5e1640 1 -- 172.21.15.100:0/2122852469 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa50058070 con 0x560e11f77d80 2024-09-18T01:25:25.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.727+0000 7ffa5a5e1640 1 -- 172.21.15.100:0/2122852469 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa50053880 con 0x560e11f77d80 2024-09-18T01:25:25.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.727+0000 7ffa5f926800 1 -- 172.21.15.100:0/2122852469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11f77d80 msgr2=0x560e11f7a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.727+0000 7ffa5f926800 1 --2- 172.21.15.100:0/2122852469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11f77d80 0x560e11f7a170 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000a470 tx=0x7ffa50045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:25.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.727+0000 7ffa5f926800 1 -- 172.21.15.100:0/2122852469 shutdown_connections 2024-09-18T01:25:25.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.727+0000 7ffa5f926800 1 --2- 172.21.15.100:0/2122852469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11f77d80 0x560e11f7a170 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.727+0000 7ffa5f926800 1 -- 172.21.15.100:0/2122852469 >> 172.21.15.100:0/2122852469 conn(0x560e11f6bdd0 msgr2=0x560e11f6e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:25.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.727+0000 7ffa5f926800 1 -- 172.21.15.100:0/2122852469 shutdown_connections 2024-09-18T01:25:25.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.727+0000 7ffa5f926800 1 -- 172.21.15.100:0/2122852469 wait complete. 2024-09-18T01:25:25.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.743+0000 7ffa5f926800 1 Processor -- start 2024-09-18T01:25:25.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.743+0000 7ffa5f926800 1 -- start start 2024-09-18T01:25:25.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.743+0000 7ffa5f926800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11ee5600 0x560e12062a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.743+0000 7ffa5f926800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e11ebd320 con 0x560e11ee5600 2024-09-18T01:25:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.744+0000 7ffa5b5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11ee5600 0x560e12062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.744+0000 7ffa5b5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11ee5600 0x560e12062a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60548/0 (socket says 172.21.15.100:60548) 2024-09-18T01:25:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.744+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/2647401257 learned_addr learned my addr 172.21.15.100:0/2647401257 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.744+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/2647401257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e11e0abc0 con 0x560e11ee5600 2024-09-18T01:25:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.744+0000 7ffa5b5e3640 1 --2- 172.21.15.100:0/2647401257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11ee5600 0x560e12062a80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c001e10 tx=0x7ffa4c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f088f2fd9bf555c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.744+0000 7ff94960a640 1 -- 172.21.15.100:0/2647401257 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4c012020 con 0x560e11ee5600 2024-09-18T01:25:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.744+0000 7ff94960a640 1 -- 172.21.15.100:0/2647401257 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4c00e5a0 con 0x560e11ee5600 2024-09-18T01:25:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.744+0000 7ff94960a640 1 -- 172.21.15.100:0/2647401257 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4c00e8e0 con 0x560e11ee5600 2024-09-18T01:25:25.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.745+0000 7ffa5f926800 1 -- 172.21.15.100:0/2647401257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11ee5600 msgr2=0x560e12062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.745+0000 7ffa5f926800 1 --2- 172.21.15.100:0/2647401257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11ee5600 0x560e12062a80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c001e10 tx=0x7ffa4c00b780 comp rx=0 tx=0).stop 2024-09-18T01:25:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.745+0000 7ffa5f926800 1 -- 172.21.15.100:0/2647401257 shutdown_connections 2024-09-18T01:25:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.745+0000 7ffa5f926800 1 --2- 172.21.15.100:0/2647401257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11ee5600 0x560e12062a80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.745+0000 7ffa5f926800 1 -- 172.21.15.100:0/2647401257 >> 172.21.15.100:0/2647401257 conn(0x560e11f6bdd0 msgr2=0x560e1205e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.745+0000 7ffa5f926800 1 -- 172.21.15.100:0/2647401257 shutdown_connections 2024-09-18T01:25:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.745+0000 7ffa5f926800 1 -- 172.21.15.100:0/2647401257 wait complete. 2024-09-18T01:25:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.745+0000 7ffa5f926800 1 Processor -- start 2024-09-18T01:25:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.746+0000 7ffa5f926800 1 -- start start 2024-09-18T01:25:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.746+0000 7ffa5f926800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11f77d80 0x560e1206a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.746+0000 7ffa5f926800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e11f7a980 con 0x560e11f77d80 2024-09-18T01:25:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.746+0000 7ffa5b5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11f77d80 0x560e1206a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.746+0000 7ffa5b5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11f77d80 0x560e1206a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60564/0 (socket says 172.21.15.100:60564) 2024-09-18T01:25:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.746+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1754044891 learned_addr learned my addr 172.21.15.100:0/1754044891 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.746+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1754044891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e11e1efe0 con 0x560e11f77d80 2024-09-18T01:25:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.747+0000 7ffa5b5e3640 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11f77d80 0x560e1206a6b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c001e10 tx=0x7ffa4c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.747+0000 7ff947e07640 1 -- 172.21.15.100:0/1754044891 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4c012030 con 0x560e11f77d80 2024-09-18T01:25:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.747+0000 7ff947e07640 1 -- 172.21.15.100:0/1754044891 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4c01a700 con 0x560e11f77d80 2024-09-18T01:25:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.747+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e1206abf0 con 0x560e11f77d80 2024-09-18T01:25:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.747+0000 7ff947e07640 1 -- 172.21.15.100:0/1754044891 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4c01aa20 con 0x560e11f77d80 2024-09-18T01:25:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.747+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e1206b110 con 0x560e11f77d80 2024-09-18T01:25:25.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.748+0000 7ff947e07640 1 -- 172.21.15.100:0/1754044891 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffa4c015020 con 0x560e11f77d80 2024-09-18T01:25:25.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.748+0000 7ff947e07640 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff940036b90 0x7ff940039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.748+0000 7ff947e07640 1 -- 172.21.15.100:0/1754044891 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ffa4c020030 con 0x560e11f77d80 2024-09-18T01:25:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.748+0000 7ffa5ade2640 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff940036b90 0x7ff940039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.748+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560e1206f710 0x560e12071b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.748+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e12072040 con 0x560e1206f710 2024-09-18T01:25:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.748+0000 7ffa5bde4640 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560e1206f710 0x560e12071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.749+0000 7ffa5ade2640 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff940036b90 0x7ff940039050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffa50057000 tx=0x7ffa50052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.749+0000 7ffa5bde4640 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560e1206f710 0x560e12071b00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.749+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1754044891 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e1206f710 2024-09-18T01:25:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.749+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e1206ecd0 con 0x560e1206f710 2024-09-18T01:25:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.749+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1754044891 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e1206f710 2024-09-18T01:25:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.749+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560e12074310 0x560e12076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.749+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e12076da0 con 0x560e12074310 2024-09-18T01:25:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.750+0000 7ffa5b5e3640 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560e12074310 0x560e12076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.750+0000 7ffa5b5e3640 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560e12074310 0x560e12076700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.750+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1754044891 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffa4c018950 con 0x560e12074310 2024-09-18T01:25:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.750+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e120731b0 con 0x560e1206f710 2024-09-18T01:25:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.750+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1754044891 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e1206f710 2024-09-18T01:25:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.750+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560e12078200 0x560e1207a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.751+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e1207ad30 con 0x560e12078200 2024-09-18T01:25:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.751+0000 7ffa5ade2640 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560e12078200 0x560e1207a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.751+0000 7ffa5ade2640 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560e12078200 0x560e1207a5f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.752+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1754044891 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffa50051070 con 0x560e12078200 2024-09-18T01:25:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.752+0000 7ffa5f926800 1 Processor -- start 2024-09-18T01:25:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.752+0000 7ffa5f926800 1 -- start start 2024-09-18T01:25:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.752+0000 7ffa5f926800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e12088ae0 0x560e12088f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.752+0000 7ffa5f926800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e11e0c580 con 0x560e12088ae0 2024-09-18T01:25:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.752+0000 7ffa5b5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e12088ae0 0x560e12088f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.752+0000 7ffa5b5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e12088ae0 0x560e12088f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60578/0 (socket says 172.21.15.100:60578) 2024-09-18T01:25:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.752+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1496685284 learned_addr learned my addr 172.21.15.100:0/1496685284 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:25.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.753+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1496685284 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e12089440 con 0x560e12088ae0 2024-09-18T01:25:25.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.753+0000 7ffa5b5e3640 1 --2- 172.21.15.100:0/1496685284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e12088ae0 0x560e12088f00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c001750 tx=0x7ffa4c017c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.753+0000 7ff945602640 1 -- 172.21.15.100:0/1496685284 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4c00dae0 con 0x560e12088ae0 2024-09-18T01:25:25.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.753+0000 7ff945602640 1 -- 172.21.15.100:0/1496685284 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4c00dca0 con 0x560e12088ae0 2024-09-18T01:25:25.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.753+0000 7ffa5f926800 1 -- 172.21.15.100:0/1496685284 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e120896d0 con 0x560e12088ae0 2024-09-18T01:25:25.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.753+0000 7ff945602640 1 -- 172.21.15.100:0/1496685284 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4c00d3d0 con 0x560e12088ae0 2024-09-18T01:25:25.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.753+0000 7ffa5f926800 1 -- 172.21.15.100:0/1496685284 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e1208c3b0 con 0x560e12088ae0 2024-09-18T01:25:25.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.754+0000 7ff945602640 1 -- 172.21.15.100:0/1496685284 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffa4c040040 con 0x560e12088ae0 2024-09-18T01:25:25.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.754+0000 7ff945602640 1 --2- 172.21.15.100:0/1496685284 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff934036b40 0x7ff934039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.754+0000 7ff945602640 1 -- 172.21.15.100:0/1496685284 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ffa4c037c80 con 0x560e12088ae0 2024-09-18T01:25:25.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.754+0000 7ffa5ade2640 1 --2- 172.21.15.100:0/1496685284 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff934036b40 0x7ff934039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.754+0000 7ffa5f926800 1 Processor -- start 2024-09-18T01:25:25.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.755+0000 7ffa5f926800 1 -- start start 2024-09-18T01:25:25.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.755+0000 7ffa5ade2640 1 --2- 172.21.15.100:0/1496685284 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff934036b40 0x7ff934039000 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x560e1206ec10 tx=0x7ffa50005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.755+0000 7ffa5f926800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e120955b0 0x560e12095990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.755+0000 7ffa5f926800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e12063230 con 0x560e120955b0 2024-09-18T01:25:25.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.755+0000 7ffa5b5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e120955b0 0x560e12095990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.755+0000 7ffa5b5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e120955b0 0x560e12095990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60588/0 (socket says 172.21.15.100:60588) 2024-09-18T01:25:25.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.755+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1519887728 learned_addr learned my addr 172.21.15.100:0/1519887728 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:25.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.755+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1519887728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e12095ed0 con 0x560e120955b0 2024-09-18T01:25:25.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.755+0000 7ffa5b5e3640 1 --2- 172.21.15.100:0/1519887728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e120955b0 0x560e12095990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c03f250 tx=0x7ffa4c044560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23958f51d192c9db server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.756+0000 7ff93effd640 1 -- 172.21.15.100:0/1519887728 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4c05d070 con 0x560e120955b0 2024-09-18T01:25:25.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.756+0000 7ff93effd640 1 -- 172.21.15.100:0/1519887728 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4c00d8a0 con 0x560e120955b0 2024-09-18T01:25:25.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.756+0000 7ff93effd640 1 -- 172.21.15.100:0/1519887728 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4c04c700 con 0x560e120955b0 2024-09-18T01:25:25.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.756+0000 7ffa5f926800 1 -- 172.21.15.100:0/1519887728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e120955b0 msgr2=0x560e12095990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.756+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1519887728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e120955b0 0x560e12095990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c03f250 tx=0x7ffa4c044560 comp rx=0 tx=0).stop 2024-09-18T01:25:25.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.756+0000 7ffa5f926800 1 -- 172.21.15.100:0/1519887728 shutdown_connections 2024-09-18T01:25:25.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.756+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1519887728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e120955b0 0x560e12095990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.756+0000 7ffa5f926800 1 -- 172.21.15.100:0/1519887728 >> 172.21.15.100:0/1519887728 conn(0x560e12091960 msgr2=0x560e1208fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:25.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.756+0000 7ffa5f926800 1 -- 172.21.15.100:0/1519887728 shutdown_connections 2024-09-18T01:25:25.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.756+0000 7ffa5f926800 1 -- 172.21.15.100:0/1519887728 wait complete. 2024-09-18T01:25:25.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.756+0000 7ffa5f926800 1 Processor -- start 2024-09-18T01:25:25.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.757+0000 7ffa5f926800 1 -- start start 2024-09-18T01:25:25.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.757+0000 7ffa5f926800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e120955b0 0x560e1209c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.757+0000 7ffa5f926800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e12096410 con 0x560e120955b0 2024-09-18T01:25:25.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.757+0000 7ffa5b5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e120955b0 0x560e1209c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.757+0000 7ffa5b5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e120955b0 0x560e1209c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60604/0 (socket says 172.21.15.100:60604) 2024-09-18T01:25:25.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.757+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 learned_addr learned my addr 172.21.15.100:0/1053236017 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:25.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.757+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e1209cdb0 con 0x560e120955b0 2024-09-18T01:25:25.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.757+0000 7ffa5b5e3640 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e120955b0 0x560e1209c870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0245e0 tx=0x7ffa4c0168d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.758+0000 7ff93d7fa640 1 -- 172.21.15.100:0/1053236017 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4c067030 con 0x560e120955b0 2024-09-18T01:25:25.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.758+0000 7ff93d7fa640 1 -- 172.21.15.100:0/1053236017 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4c04cc60 con 0x560e120955b0 2024-09-18T01:25:25.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.758+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e1209cdb0 con 0x560e120955b0 2024-09-18T01:25:25.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.758+0000 7ff93d7fa640 1 -- 172.21.15.100:0/1053236017 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4c05d040 con 0x560e120955b0 2024-09-18T01:25:25.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.758+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e1209cdb0 con 0x560e120955b0 2024-09-18T01:25:25.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.758+0000 7ff93d7fa640 1 -- 172.21.15.100:0/1053236017 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffa4c06a030 con 0x560e120955b0 2024-09-18T01:25:25.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.759+0000 7ff93d7fa640 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff924036b40 0x7ff924039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.759+0000 7ff93d7fa640 1 -- 172.21.15.100:0/1053236017 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ffa4c068070 con 0x560e120955b0 2024-09-18T01:25:25.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.759+0000 7ffa5ade2640 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff924036b40 0x7ff924039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.759+0000 7ffa5f926800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.759+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560e120a7ef0 0x560e120aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.759+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e120aab00 con 0x560e120a7ef0 2024-09-18T01:25:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.759+0000 7ffa5bde4640 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560e120a7ef0 0x560e120aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.759+0000 7ffa5ade2640 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff924036b40 0x7ff924039000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa50053570 tx=0x7ffa50053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5bde4640 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560e120a7ef0 0x560e120aa3b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5f926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5f926800 20 realm 2024-09-18T01:25:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5f926800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e120aaf10 con 0x560e120a7ef0 2024-09-18T01:25:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5f926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5f926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5f926800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e120ab7e0 con 0x560e120a7ef0 2024-09-18T01:25:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5f926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5f926800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.760+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120a7ef0 2024-09-18T01:25:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.761+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.761+0000 7ffa5f926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.761+0000 7ffa5f926800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.761+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560e120ac6b0 0x560e120aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.761+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e120af1e0 con 0x560e120ac6b0 2024-09-18T01:25:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.761+0000 7ffa5b5e3640 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560e120ac6b0 0x560e120aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.761+0000 7ffa5b5e3640 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560e120ac6b0 0x560e120aeaa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.761+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.761+0000 7ffa5f926800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:25.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.761+0000 7ffa5f926800 20 searching for the correct realm 2024-09-18T01:25:25.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.761+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560e120b1240 0x560e120b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.761+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b3db0 con 0x560e120b1240 2024-09-18T01:25:25.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.761+0000 7ffa5ade2640 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560e120b1240 0x560e120b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.762+0000 7ffa5ade2640 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560e120b1240 0x560e120b36e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.762+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.762+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b3db0 con 0x560e120ac6b0 2024-09-18T01:25:25.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.762+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.762+0000 7ffa5b5e3640 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ffa4c043070 0x7ffa4c0281c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.762+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b3db0 con 0x7ffa4c043070 2024-09-18T01:25:25.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.763+0000 7ffa5bde4640 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ffa4c043070 0x7ffa4c0281c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.763+0000 7ffa5bde4640 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ffa4c043070 0x7ffa4c0281c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.763+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.763+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120a7ef0 2024-09-18T01:25:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.764+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.764+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120a7ef0 2024-09-18T01:25:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.764+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.764+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x7ffa4c043070 2024-09-18T01:25:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.764+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.764+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x7ffa4c043070 2024-09-18T01:25:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.765+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.765+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120ac6b0 2024-09-18T01:25:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.765+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.765+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120b1240 2024-09-18T01:25:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.765+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.765+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120a7ef0 2024-09-18T01:25:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.765+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.765+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x7ffa4c043070 2024-09-18T01:25:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.766+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.766+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120a7ef0 2024-09-18T01:25:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.766+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.766+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120ac6b0 2024-09-18T01:25:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.766+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.766+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120b1240 2024-09-18T01:25:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.766+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.766+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120b1240 2024-09-18T01:25:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.767+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.767+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x7ffa4c043070 2024-09-18T01:25:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.767+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.767+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120b1240 2024-09-18T01:25:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.767+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.767+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120b1240 2024-09-18T01:25:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.767+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.767+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120a7ef0 2024-09-18T01:25:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.768+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.768+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120a7ef0 2024-09-18T01:25:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.768+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.768+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x7ffa4c043070 2024-09-18T01:25:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.768+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.768+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120b1240 2024-09-18T01:25:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.769+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.769+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120ac6b0 2024-09-18T01:25:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.769+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.769+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120a7ef0 2024-09-18T01:25:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.769+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.769+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x7ffa4c043070 2024-09-18T01:25:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.770+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.770+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120b1240 2024-09-18T01:25:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.770+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.770+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x7ffa4c043070 2024-09-18T01:25:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.770+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.770+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120ac6b0 2024-09-18T01:25:25.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.770+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.770+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120b1240 2024-09-18T01:25:25.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.771+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.771+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x7ffa4c043070 2024-09-18T01:25:25.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.771+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.771+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120a7ef0 2024-09-18T01:25:25.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.771+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.771+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120abb80 con 0x560e120ac6b0 2024-09-18T01:25:25.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5f926800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:25.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5f926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:25.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5f926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:25.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5f926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:25.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5f926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:25.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5f926800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:25.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5f926800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e120afb60 con 0x560e120a7ef0 2024-09-18T01:25:25.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5f926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5f926800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e120aff50 con 0x560e120a7ef0 2024-09-18T01:25:25.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5f926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:25.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5f926800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.772+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e120aff50 con 0x7ffa4c043070 2024-09-18T01:25:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 20 zone default found 2024-09-18T01:25:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 4 Realm: () 2024-09-18T01:25:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 20 zonegroup default 2024-09-18T01:25:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e120b0370 con 0x7ffa4c043070 2024-09-18T01:25:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e120b0760 con 0x560e120b1240 2024-09-18T01:25:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e120b5c10 con 0x560e120b1240 2024-09-18T01:25:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 20 started sync module instance, tier type = 2024-09-18T01:25:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.773+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b50b0 con 0x560e120ac6b0 2024-09-18T01:25:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.775+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.775+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94618432263328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b4d10 con 0x560e120ac6b0 2024-09-18T01:25:25.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.775+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b6a80 con 0x560e120a7ef0 2024-09-18T01:25:25.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.776+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94618432263328] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.776+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.776+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94618432267728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b6ea0 con 0x560e120a7ef0 2024-09-18T01:25:25.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.776+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b7860 con 0x560e120b1240 2024-09-18T01:25:25.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.778+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94618432267728] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.778+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.778+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94618432268784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b6e10 con 0x560e120b1240 2024-09-18T01:25:25.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.778+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120ac6b0 2024-09-18T01:25:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.781+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94618432268784] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.781+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.781+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94618432273488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8f70 con 0x560e120ac6b0 2024-09-18T01:25:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.781+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b9930 con 0x560e120a7ef0 2024-09-18T01:25:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.784+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.784+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94618432279680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b9d50 con 0x560e120a7ef0 2024-09-18T01:25:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.784+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120ba810 con 0x7ffa4c043070 2024-09-18T01:25:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.786+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94618432273488] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.786+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.786+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94618432283360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120ba7d0 con 0x7ffa4c043070 2024-09-18T01:25:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.786+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120bb220 con 0x7ffa4c043070 2024-09-18T01:25:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.789+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94618432279680] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.789+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94618432283360] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.792+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.792+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94618432277184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120bad70 con 0x7ffa4c043070 2024-09-18T01:25:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.792+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120bb640 con 0x7ffa4c043070 2024-09-18T01:25:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.794+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.794+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94618432277184] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.794+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94618432286064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120bbcd0 con 0x7ffa4c043070 2024-09-18T01:25:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.794+0000 7ffa5f926800 20 add_watcher() i=0 2024-09-18T01:25:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.794+0000 7ffa5f926800 20 add_watcher() i=1 2024-09-18T01:25:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.794+0000 7ffa5f926800 20 add_watcher() i=2 2024-09-18T01:25:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.794+0000 7ffa5f926800 20 add_watcher() i=3 2024-09-18T01:25:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.794+0000 7ffa5f926800 20 add_watcher() i=4 2024-09-18T01:25:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.794+0000 7ffa5f926800 20 add_watcher() i=5 2024-09-18T01:25:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.794+0000 7ffa5f926800 20 add_watcher() i=6 2024-09-18T01:25:25.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.796+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94618432286064] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.796+0000 7ffa5f926800 20 add_watcher() i=7 2024-09-18T01:25:25.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.796+0000 7ffa5f926800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:25.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.796+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560e120bebf0 con 0x560e120a7ef0 2024-09-18T01:25:25.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.796+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.796+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94618432288528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120bbfe0 con 0x560e120a7ef0 2024-09-18T01:25:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.797+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94618432288528] v33'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.797+0000 7ff911fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.797+0000 7ffa5f926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.797+0000 7ffa5f926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.797+0000 7ffa5f926800 5 note: GC not initialized 2024-09-18T01:25:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.798+0000 7ff910fe1640 20 reqs_thread_entry: start 2024-09-18T01:25:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.798+0000 7ffa5f926800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.798+0000 7ffa5f926800 20 Filter name: none 2024-09-18T01:25:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.798+0000 7ff88a7fc640 20 reqs_thread_entry: start 2024-09-18T01:25:25.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.798+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120f1410 con 0x560e120b1240 2024-09-18T01:25:25.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.798+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(62 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.798+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120f1410 con 0x560e120b1240 2024-09-18T01:25:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.799+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(63 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.799+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120f1410 con 0x560e120a7ef0 2024-09-18T01:25:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.799+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(64 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.799+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120afb60 con 0x560e120a7ef0 2024-09-18T01:25:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.799+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.799+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120afb60 con 0x560e120ac6b0 2024-09-18T01:25:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.799+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(66 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.799+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120b1240 2024-09-18T01:25:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.800+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(67 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.800+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120a7ef0 2024-09-18T01:25:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.800+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.800+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120b1240 2024-09-18T01:25:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.800+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(69 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.800+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120ac6b0 2024-09-18T01:25:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.800+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(70 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.800+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120b1240 2024-09-18T01:25:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.800+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(71 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.800+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120a7ef0 2024-09-18T01:25:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.801+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(72 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.801+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x7ffa4c043070 2024-09-18T01:25:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.801+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.801+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x7ffa4c043070 2024-09-18T01:25:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.801+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(74 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.801+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120b1240 2024-09-18T01:25:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.802+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(75 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.802+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x7ffa4c043070 2024-09-18T01:25:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.802+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(76 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.802+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x7ffa4c043070 2024-09-18T01:25:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.802+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(77 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.802+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x7ffa4c043070 2024-09-18T01:25:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.802+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(78 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.802+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120b1240 2024-09-18T01:25:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.803+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(79 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.803+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120ac6b0 2024-09-18T01:25:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.803+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(80 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.803+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120a7ef0 2024-09-18T01:25:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.803+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(81 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.803+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120a7ef0 2024-09-18T01:25:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.803+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(82 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.803+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120b1240 2024-09-18T01:25:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.804+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(83 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.804+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120ac6b0 2024-09-18T01:25:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.804+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(84 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.804+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x7ffa4c043070 2024-09-18T01:25:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.804+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(85 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.804+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120a7ef0 2024-09-18T01:25:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.804+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(86 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.805+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x7ffa4c043070 2024-09-18T01:25:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.805+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(87 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.805+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120b1240 2024-09-18T01:25:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.805+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(88 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.805+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120ac6b0 2024-09-18T01:25:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.805+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(89 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.805+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x7ffa4c043070 2024-09-18T01:25:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.806+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(90 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.806+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120a7ef0 2024-09-18T01:25:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.806+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(91 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.806+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120b1240 2024-09-18T01:25:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.806+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(92 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.806+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8720 con 0x560e120ac6b0 2024-09-18T01:25:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.806+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(93 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.807+0000 7ff911fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.807+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94618432288528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120afb60 con 0x560e120a7ef0 2024-09-18T01:25:25.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.808+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94618432288528] v33'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.808+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94618432263328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120f13d0 con 0x560e120ac6b0 2024-09-18T01:25:25.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.811+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94618432263328] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.811+0000 7ffa5f926800 20 remove_watcher() i=0 2024-09-18T01:25:25.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.811+0000 7ffa5f926800 2 removed watcher, disabling cache 2024-09-18T01:25:25.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.811+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94618432267728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b54a0 con 0x560e120a7ef0 2024-09-18T01:25:25.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.812+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94618432267728] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.812+0000 7ffa5f926800 20 remove_watcher() i=1 2024-09-18T01:25:25.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.812+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94618432268784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b54a0 con 0x560e120b1240 2024-09-18T01:25:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.814+0000 7ffa5ade2640 1 -- 172.21.15.100:0/1053236017 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94618432268784] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50051070 con 0x560e120b1240 2024-09-18T01:25:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.814+0000 7ffa5f926800 20 remove_watcher() i=2 2024-09-18T01:25:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.814+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94618432273488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120f13d0 con 0x560e120ac6b0 2024-09-18T01:25:25.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.815+0000 7ffa5b5e3640 1 -- 172.21.15.100:0/1053236017 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94618432273488] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c073070 con 0x560e120ac6b0 2024-09-18T01:25:25.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.815+0000 7ffa5f926800 20 remove_watcher() i=3 2024-09-18T01:25:25.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.815+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94618432279680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b7c50 con 0x560e120a7ef0 2024-09-18T01:25:25.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.816+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94618432279680] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x560e120a7ef0 2024-09-18T01:25:25.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.816+0000 7ffa5f926800 20 remove_watcher() i=4 2024-09-18T01:25:25.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.816+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94618432283360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b9480 con 0x7ffa4c043070 2024-09-18T01:25:25.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.819+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94618432283360] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.819+0000 7ffa5f926800 20 remove_watcher() i=5 2024-09-18T01:25:25.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.819+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94618432277184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b9480 con 0x7ffa4c043070 2024-09-18T01:25:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.820+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94618432277184] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.820+0000 7ffa5f926800 20 remove_watcher() i=6 2024-09-18T01:25:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.820+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94618432286064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560e120b8ac0 con 0x7ffa4c043070 2024-09-18T01:25:25.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94618432286064] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5400a4a0 con 0x7ffa4c043070 2024-09-18T01:25:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5f926800 20 remove_watcher() i=7 2024-09-18T01:25:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ffa4c043070 msgr2=0x7ffa4c0281c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ffa4c043070 0x7ffa4c0281c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560e120a7ef0 msgr2=0x560e120aa3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560e120a7ef0 0x560e120aa3b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560e120ac6b0 msgr2=0x560e120aeaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560e120ac6b0 0x560e120aeaa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560e120b1240 msgr2=0x560e120b36e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560e120b1240 0x560e120b36e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff924036b40 msgr2=0x7ff924039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff924036b40 0x7ff924039000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa50053570 tx=0x7ffa50053000 comp rx=0 tx=0).stop 2024-09-18T01:25:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e120955b0 msgr2=0x560e1209c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1053236017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e120955b0 0x560e1209c870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0245e0 tx=0x7ffa4c0168d0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 reap_dead start 2024-09-18T01:25:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1053236017 reap_dead start 2024-09-18T01:25:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.821+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 shutdown_connections 2024-09-18T01:25:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 >> 172.21.15.100:0/1053236017 conn(0x560e12091960 msgr2=0x560e1208fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 shutdown_connections 2024-09-18T01:25:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 -- 172.21.15.100:0/1053236017 wait complete. 2024-09-18T01:25:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 -- 172.21.15.100:0/1496685284 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff934036b40 msgr2=0x7ff934039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1496685284 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff934036b40 0x7ff934039000 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x560e1206ec10 tx=0x7ffa50005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 -- 172.21.15.100:0/1496685284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e12088ae0 msgr2=0x560e12088f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1496685284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e12088ae0 0x560e12088f00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c001750 tx=0x7ffa4c017c50 comp rx=0 tx=0).stop 2024-09-18T01:25:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 -- 172.21.15.100:0/1496685284 shutdown_connections 2024-09-18T01:25:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1496685284 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff934036b40 0x7ff934039000 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1496685284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e12088ae0 0x560e12088f00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 -- 172.21.15.100:0/1496685284 >> 172.21.15.100:0/1496685284 conn(0x560e1207da70 msgr2=0x560e120805f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 -- 172.21.15.100:0/1496685284 shutdown_connections 2024-09-18T01:25:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 -- 172.21.15.100:0/1496685284 wait complete. 2024-09-18T01:25:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560e12078200 msgr2=0x560e1207a5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560e12078200 0x560e1207a5f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560e1206f710 msgr2=0x560e12071b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560e1206f710 0x560e12071b00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560e12074310 msgr2=0x560e12076700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560e12074310 0x560e12076700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff940036b90 msgr2=0x7ff940039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff940036b90 0x7ff940039050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffa50057000 tx=0x7ffa50052000 comp rx=0 tx=0).stop 2024-09-18T01:25:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11f77d80 msgr2=0x560e1206a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5f926800 1 --2- 172.21.15.100:0/1754044891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e11f77d80 0x560e1206a6b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c001e10 tx=0x7ffa4c000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.822+0000 7ffa5bde4640 1 -- 172.21.15.100:0/1754044891 reap_dead start 2024-09-18T01:25:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.823+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 shutdown_connections 2024-09-18T01:25:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.823+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 >> 172.21.15.100:0/1754044891 conn(0x560e11f6bdd0 msgr2=0x560e1205ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.823+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 shutdown_connections 2024-09-18T01:25:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.823+0000 7ffa5f926800 1 -- 172.21.15.100:0/1754044891 wait complete. 2024-09-18T01:25:25.833 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-18T01:25:25.833 DEBUG:tasks.util.rgw: json result: [] 2024-09-18T01:25:25.833 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-18T01:25:25.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-18T01:25:25.834 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-18T01:25:25.877 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:25.877 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:25.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.877+0000 7f233d82f800 1 Processor -- start 2024-09-18T01:25:25.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.877+0000 7f233d82f800 1 -- start start 2024-09-18T01:25:25.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.877+0000 7f233d82f800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5618c56c98f0 0x5618c56cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.877+0000 7f233d82f800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5618c5584b30 con 0x5618c56396b0 2024-09-18T01:25:25.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.877+0000 7f233d82f800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5618c5566360 con 0x5618c56c98f0 2024-09-18T01:25:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.878+0000 7f233ab29640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5618c56c98f0 0x5618c56cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.878+0000 7f233b32a640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5618c56396b0 0x5618c56c81d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59132/0 (socket says 172.21.15.100:59132) 2024-09-18T01:25:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.878+0000 7f233b32a640 1 -- 172.21.15.100:0/44795584 learned_addr learned my addr 172.21.15.100:0/44795584 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.878+0000 7f233ab29640 1 -- 172.21.15.100:0/44795584 >> v1:172.21.15.92:6789/0 conn(0x5618c56396b0 legacy=0x5618c56c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.878+0000 7f233ab29640 1 -- 172.21.15.100:0/44795584 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618c558ce00 con 0x5618c56c98f0 2024-09-18T01:25:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.880+0000 7f233ab29640 1 --2- 172.21.15.100:0/44795584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c98f0 0x5618c56cbd00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f233000a470 tx=0x7f2330045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97dec158e3910c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.880+0000 7f233a328640 1 -- 172.21.15.100:0/44795584 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2330053570 con 0x5618c56c98f0 2024-09-18T01:25:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.880+0000 7f233a328640 1 -- 172.21.15.100:0/44795584 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2330058070 con 0x5618c56c98f0 2024-09-18T01:25:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.880+0000 7f233a328640 1 -- 172.21.15.100:0/44795584 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2330053880 con 0x5618c56c98f0 2024-09-18T01:25:25.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.881+0000 7f233d82f800 1 -- 172.21.15.100:0/44795584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c98f0 msgr2=0x5618c56cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.881+0000 7f233d82f800 1 --2- 172.21.15.100:0/44795584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c98f0 0x5618c56cbd00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f233000a470 tx=0x7f2330045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:25.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.881+0000 7f233d82f800 1 -- 172.21.15.100:0/44795584 shutdown_connections 2024-09-18T01:25:25.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.881+0000 7f233d82f800 1 --2- 172.21.15.100:0/44795584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c98f0 0x5618c56cbd00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.881+0000 7f233d82f800 1 -- 172.21.15.100:0/44795584 >> 172.21.15.100:0/44795584 conn(0x5618c56bfde0 msgr2=0x5618c56c2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:25.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.881+0000 7f233d82f800 1 -- 172.21.15.100:0/44795584 shutdown_connections 2024-09-18T01:25:25.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.881+0000 7f233d82f800 1 -- 172.21.15.100:0/44795584 wait complete. 2024-09-18T01:25:25.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.894+0000 7f233d82f800 1 Processor -- start 2024-09-18T01:25:25.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.894+0000 7f233d82f800 1 -- start start 2024-09-18T01:25:25.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.894+0000 7f233d82f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56396b0 0x5618c57b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.894+0000 7f233d82f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618c5611330 con 0x5618c56396b0 2024-09-18T01:25:25.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.895+0000 7f233b32a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56396b0 0x5618c57b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.895+0000 7f233b32a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56396b0 0x5618c57b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60620/0 (socket says 172.21.15.100:60620) 2024-09-18T01:25:25.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.895+0000 7f233b32a640 1 -- 172.21.15.100:0/4087108199 learned_addr learned my addr 172.21.15.100:0/4087108199 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:25.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.895+0000 7f233b32a640 1 -- 172.21.15.100:0/4087108199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618c555ebc0 con 0x5618c56396b0 2024-09-18T01:25:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.895+0000 7f233b32a640 1 --2- 172.21.15.100:0/4087108199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56396b0 0x5618c57b4880 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f232c001e10 tx=0x7f232c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef91361b8ead7e52 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.895+0000 7f222960a640 1 -- 172.21.15.100:0/4087108199 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c012020 con 0x5618c56396b0 2024-09-18T01:25:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.895+0000 7f222960a640 1 -- 172.21.15.100:0/4087108199 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c00e5a0 con 0x5618c56396b0 2024-09-18T01:25:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.895+0000 7f222960a640 1 -- 172.21.15.100:0/4087108199 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c00e8e0 con 0x5618c56396b0 2024-09-18T01:25:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.896+0000 7f233d82f800 1 -- 172.21.15.100:0/4087108199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56396b0 msgr2=0x5618c57b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.896+0000 7f233d82f800 1 --2- 172.21.15.100:0/4087108199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56396b0 0x5618c57b4880 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f232c001e10 tx=0x7f232c00b780 comp rx=0 tx=0).stop 2024-09-18T01:25:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.896+0000 7f233d82f800 1 -- 172.21.15.100:0/4087108199 shutdown_connections 2024-09-18T01:25:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.896+0000 7f233d82f800 1 --2- 172.21.15.100:0/4087108199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56396b0 0x5618c57b4880 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.896+0000 7f233d82f800 1 -- 172.21.15.100:0/4087108199 >> 172.21.15.100:0/4087108199 conn(0x5618c56bfde0 msgr2=0x5618c57b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.896+0000 7f233d82f800 1 -- 172.21.15.100:0/4087108199 shutdown_connections 2024-09-18T01:25:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.896+0000 7f233d82f800 1 -- 172.21.15.100:0/4087108199 wait complete. 2024-09-18T01:25:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.896+0000 7f233d82f800 1 Processor -- start 2024-09-18T01:25:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.896+0000 7f233d82f800 1 -- start start 2024-09-18T01:25:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.897+0000 7f233d82f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56396b0 0x5618c57bc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.897+0000 7f233d82f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618c56cc680 con 0x5618c56396b0 2024-09-18T01:25:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.897+0000 7f233b32a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56396b0 0x5618c57bc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.897+0000 7f233b32a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56396b0 0x5618c57bc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60632/0 (socket says 172.21.15.100:60632) 2024-09-18T01:25:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.897+0000 7f233b32a640 1 -- 172.21.15.100:0/3283364404 learned_addr learned my addr 172.21.15.100:0/3283364404 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.897+0000 7f233b32a640 1 -- 172.21.15.100:0/3283364404 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618c5572fe0 con 0x5618c56396b0 2024-09-18T01:25:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.897+0000 7f233b32a640 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56396b0 0x5618c57bc2b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f232c00b7c0 tx=0x7f232c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.897+0000 7f2227e07640 1 -- 172.21.15.100:0/3283364404 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c012030 con 0x5618c56396b0 2024-09-18T01:25:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.897+0000 7f2227e07640 1 -- 172.21.15.100:0/3283364404 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c001470 con 0x5618c56396b0 2024-09-18T01:25:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.897+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618c57bc7f0 con 0x5618c56396b0 2024-09-18T01:25:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.897+0000 7f2227e07640 1 -- 172.21.15.100:0/3283364404 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c01a8d0 con 0x5618c56396b0 2024-09-18T01:25:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.898+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618c57bcd10 con 0x5618c56396b0 2024-09-18T01:25:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.898+0000 7f2227e07640 1 -- 172.21.15.100:0/3283364404 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f232c015020 con 0x5618c56396b0 2024-09-18T01:25:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.898+0000 7f2227e07640 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2220036b40 0x7f2220039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.899+0000 7f2227e07640 1 -- 172.21.15.100:0/3283364404 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f232c020030 con 0x5618c56396b0 2024-09-18T01:25:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.899+0000 7f233ab29640 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2220036b40 0x7f2220039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.899+0000 7f233d82f800 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618c56c98f0 0x5618c57c3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.899+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c57c38a0 con 0x5618c56c98f0 2024-09-18T01:25:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.899+0000 7f233bb2b640 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618c56c98f0 0x5618c57c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.899+0000 7f233ab29640 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2220036b40 0x7f2220039000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2330057000 tx=0x7f2330052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.899+0000 7f233bb2b640 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618c56c98f0 0x5618c57c3320 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.899+0000 7f233bb2b640 1 -- 172.21.15.100:0/3283364404 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c56c98f0 2024-09-18T01:25:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.899+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c57c08f0 con 0x5618c56c98f0 2024-09-18T01:25:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.900+0000 7f233bb2b640 1 -- 172.21.15.100:0/3283364404 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c56c98f0 2024-09-18T01:25:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.900+0000 7f233d82f800 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618c57c5bf0 0x5618c57c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.900+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c57c86d0 con 0x5618c57c5bf0 2024-09-18T01:25:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.900+0000 7f233b32a640 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618c57c5bf0 0x5618c57c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.900+0000 7f233b32a640 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618c57c5bf0 0x5618c57c7fe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.900+0000 7f233b32a640 1 -- 172.21.15.100:0/3283364404 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f232c02dcf0 con 0x5618c57c5bf0 2024-09-18T01:25:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.900+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c57c4a90 con 0x5618c56c98f0 2024-09-18T01:25:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.901+0000 7f233bb2b640 1 -- 172.21.15.100:0/3283364404 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c56c98f0 2024-09-18T01:25:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.901+0000 7f233d82f800 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5618c57c9b30 0x5618c57cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.901+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c57cc620 con 0x5618c57c9b30 2024-09-18T01:25:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.901+0000 7f233ab29640 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5618c57c9b30 0x5618c57cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.901+0000 7f233ab29640 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5618c57c9b30 0x5618c57cbf20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.902+0000 7f233ab29640 1 -- 172.21.15.100:0/3283364404 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2330051070 con 0x5618c57c9b30 2024-09-18T01:25:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.902+0000 7f233d82f800 1 Processor -- start 2024-09-18T01:25:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.902+0000 7f233d82f800 1 -- start start 2024-09-18T01:25:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.902+0000 7f233d82f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c57da390 0x5618c57da7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.902+0000 7f233d82f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618c5560580 con 0x5618c57da390 2024-09-18T01:25:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.902+0000 7f233b32a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c57da390 0x5618c57da7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.902+0000 7f233b32a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c57da390 0x5618c57da7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60634/0 (socket says 172.21.15.100:60634) 2024-09-18T01:25:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.902+0000 7f233b32a640 1 -- 172.21.15.100:0/3455002959 learned_addr learned my addr 172.21.15.100:0/3455002959 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:25.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.903+0000 7f233b32a640 1 -- 172.21.15.100:0/3455002959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618c57dacf0 con 0x5618c57da390 2024-09-18T01:25:25.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.903+0000 7f233b32a640 1 --2- 172.21.15.100:0/3455002959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c57da390 0x5618c57da7b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f232c04b1b0 tx=0x7f232c00db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.903+0000 7f2225602640 1 -- 172.21.15.100:0/3455002959 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c03c070 con 0x5618c57da390 2024-09-18T01:25:25.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.903+0000 7f233d82f800 1 -- 172.21.15.100:0/3455002959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618c57daf80 con 0x5618c57da390 2024-09-18T01:25:25.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.903+0000 7f2225602640 1 -- 172.21.15.100:0/3455002959 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c017c50 con 0x5618c57da390 2024-09-18T01:25:25.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.903+0000 7f2225602640 1 -- 172.21.15.100:0/3455002959 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c01ac50 con 0x5618c57da390 2024-09-18T01:25:25.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.903+0000 7f233d82f800 1 -- 172.21.15.100:0/3455002959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618c57daf80 con 0x5618c57da390 2024-09-18T01:25:25.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.904+0000 7f2225602640 1 -- 172.21.15.100:0/3455002959 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f232c03f070 con 0x5618c57da390 2024-09-18T01:25:25.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.904+0000 7f2225602640 1 --2- 172.21.15.100:0/3455002959 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2214036b40 0x7f2214039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.904+0000 7f2225602640 1 -- 172.21.15.100:0/3455002959 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f232c048050 con 0x5618c57da390 2024-09-18T01:25:25.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.904+0000 7f233ab29640 1 --2- 172.21.15.100:0/3455002959 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2214036b40 0x7f2214039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.904+0000 7f233d82f800 1 Processor -- start 2024-09-18T01:25:25.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.904+0000 7f233d82f800 1 -- start start 2024-09-18T01:25:25.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.904+0000 7f233ab29640 1 --2- 172.21.15.100:0/3455002959 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2214036b40 0x7f2214039000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5618c57c41a0 tx=0x7f2330005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.905+0000 7f233d82f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c4200 0x5618c56c4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.905+0000 7f233d82f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618c57b5030 con 0x5618c56c4200 2024-09-18T01:25:25.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.905+0000 7f233b32a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c4200 0x5618c56c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.905+0000 7f233b32a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c4200 0x5618c56c4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60644/0 (socket says 172.21.15.100:60644) 2024-09-18T01:25:25.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.905+0000 7f233b32a640 1 -- 172.21.15.100:0/3668609961 learned_addr learned my addr 172.21.15.100:0/3668609961 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:25.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.905+0000 7f233b32a640 1 -- 172.21.15.100:0/3668609961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618c56c4b40 con 0x5618c56c4200 2024-09-18T01:25:25.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.905+0000 7f233b32a640 1 --2- 172.21.15.100:0/3668609961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c4200 0x5618c56c4600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f232c018740 tx=0x7f232c037540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a521a75ff465459 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.905+0000 7f221effd640 1 -- 172.21.15.100:0/3668609961 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c03f5f0 con 0x5618c56c4200 2024-09-18T01:25:25.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.905+0000 7f221effd640 1 -- 172.21.15.100:0/3668609961 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c03f360 con 0x5618c56c4200 2024-09-18T01:25:25.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.905+0000 7f221effd640 1 -- 172.21.15.100:0/3668609961 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c01adf0 con 0x5618c56c4200 2024-09-18T01:25:25.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.906+0000 7f233d82f800 1 -- 172.21.15.100:0/3668609961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c4200 msgr2=0x5618c56c4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:25.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.906+0000 7f233d82f800 1 --2- 172.21.15.100:0/3668609961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c4200 0x5618c56c4600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f232c018740 tx=0x7f232c037540 comp rx=0 tx=0).stop 2024-09-18T01:25:25.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.906+0000 7f233d82f800 1 -- 172.21.15.100:0/3668609961 shutdown_connections 2024-09-18T01:25:25.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.906+0000 7f233d82f800 1 --2- 172.21.15.100:0/3668609961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c4200 0x5618c56c4600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:25.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.906+0000 7f233d82f800 1 -- 172.21.15.100:0/3668609961 >> 172.21.15.100:0/3668609961 conn(0x5618c57e2fc0 msgr2=0x5618c57e10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:25.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.906+0000 7f233d82f800 1 -- 172.21.15.100:0/3668609961 shutdown_connections 2024-09-18T01:25:25.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.906+0000 7f233d82f800 1 -- 172.21.15.100:0/3668609961 wait complete. 2024-09-18T01:25:25.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.906+0000 7f233d82f800 1 Processor -- start 2024-09-18T01:25:25.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.906+0000 7f233d82f800 1 -- start start 2024-09-18T01:25:25.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.906+0000 7f233d82f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c4200 0x5618c57f00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.906+0000 7f233d82f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618c56c5100 con 0x5618c56c4200 2024-09-18T01:25:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.906+0000 7f233b32a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c4200 0x5618c57f00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.906+0000 7f233b32a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c4200 0x5618c57f00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60660/0 (socket says 172.21.15.100:60660) 2024-09-18T01:25:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.906+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 learned_addr learned my addr 172.21.15.100:0/2304738091 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.907+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618c57f0600 con 0x5618c56c4200 2024-09-18T01:25:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.907+0000 7f233b32a640 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c4200 0x5618c57f00c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f232c018740 tx=0x7f232c050fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.907+0000 7f221d7fa640 1 -- 172.21.15.100:0/2304738091 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c06e030 con 0x5618c56c4200 2024-09-18T01:25:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.907+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618c57f0600 con 0x5618c56c4200 2024-09-18T01:25:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.907+0000 7f221d7fa640 1 -- 172.21.15.100:0/2304738091 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c044ca0 con 0x5618c56c4200 2024-09-18T01:25:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.907+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618c57f0600 con 0x5618c56c4200 2024-09-18T01:25:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.907+0000 7f221d7fa640 1 -- 172.21.15.100:0/2304738091 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c03fe00 con 0x5618c56c4200 2024-09-18T01:25:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.908+0000 7f221d7fa640 1 -- 172.21.15.100:0/2304738091 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f232c071070 con 0x5618c56c4200 2024-09-18T01:25:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.908+0000 7f221d7fa640 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2204036b40 0x7f2204039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.908+0000 7f221d7fa640 1 -- 172.21.15.100:0/2304738091 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f232c06f070 con 0x5618c56c4200 2024-09-18T01:25:25.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.908+0000 7f233ab29640 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2204036b40 0x7f2204039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.909+0000 7f233ab29640 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2204036b40 0x7f2204039000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2330053570 tx=0x7f2330053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.909+0000 7f233d82f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.909+0000 7f233d82f800 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618c57fb880 0x5618c57fdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.909+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c57fe490 con 0x5618c57fb880 2024-09-18T01:25:25.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.909+0000 7f233bb2b640 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618c57fb880 0x5618c57fdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.909+0000 7f233bb2b640 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618c57fb880 0x5618c57fdd40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.909+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.909+0000 7f233d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.909+0000 7f233d82f800 20 realm 2024-09-18T01:25:25.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233d82f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c57fe8a0 con 0x5618c57fb880 2024-09-18T01:25:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233d82f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233d82f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff170 con 0x5618c57fb880 2024-09-18T01:25:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233d82f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c57fb880 2024-09-18T01:25:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233d82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233d82f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233d82f800 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618c5800270 0x5618c5802660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c5802c70 con 0x5618c5800270 2024-09-18T01:25:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.910+0000 7f233b32a640 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618c5800270 0x5618c5802660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.911+0000 7f233b32a640 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618c5800270 0x5618c5802660 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.911+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.911+0000 7f233d82f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.911+0000 7f233d82f800 20 searching for the correct realm 2024-09-18T01:25:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.911+0000 7f233d82f800 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5618c5804c40 0x5618c58070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.911+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c58077a0 con 0x5618c5804c40 2024-09-18T01:25:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.911+0000 7f233ab29640 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5618c5804c40 0x5618c58070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.911+0000 7f233ab29640 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5618c5804c40 0x5618c58070d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.912+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.912+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c58077a0 con 0x5618c5800270 2024-09-18T01:25:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.912+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.912+0000 7f233b32a640 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f232c073030 0x7f232c039080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.912+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c58077a0 con 0x7f232c073030 2024-09-18T01:25:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.912+0000 7f233bb2b640 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f232c073030 0x7f232c039080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.912+0000 7f233bb2b640 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f232c073030 0x7f232c039080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.913+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.913+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c57fb880 2024-09-18T01:25:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.913+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.913+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c57fb880 2024-09-18T01:25:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.913+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.913+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x7f232c073030 2024-09-18T01:25:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.913+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.913+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x7f232c073030 2024-09-18T01:25:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.913+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.913+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c5800270 2024-09-18T01:25:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.914+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.914+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c5804c40 2024-09-18T01:25:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.914+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.914+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c57fb880 2024-09-18T01:25:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.914+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.914+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x7f232c073030 2024-09-18T01:25:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.915+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.915+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c57fb880 2024-09-18T01:25:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.915+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.915+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c5800270 2024-09-18T01:25:25.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.915+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.915+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c5804c40 2024-09-18T01:25:25.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.915+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.915+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c5804c40 2024-09-18T01:25:25.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.915+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.915+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x7f232c073030 2024-09-18T01:25:25.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.916+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.916+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c5804c40 2024-09-18T01:25:25.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.916+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.916+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c5804c40 2024-09-18T01:25:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.916+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.916+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c57fb880 2024-09-18T01:25:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.916+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.916+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c57fb880 2024-09-18T01:25:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.917+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.917+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x7f232c073030 2024-09-18T01:25:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.917+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.917+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c5804c40 2024-09-18T01:25:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.917+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.917+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c5800270 2024-09-18T01:25:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.918+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.918+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c57fb880 2024-09-18T01:25:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.918+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.918+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x7f232c073030 2024-09-18T01:25:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.918+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.918+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c5804c40 2024-09-18T01:25:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.918+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.918+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x7f232c073030 2024-09-18T01:25:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.919+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.919+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c5800270 2024-09-18T01:25:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.919+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.919+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c5804c40 2024-09-18T01:25:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.919+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.919+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x7f232c073030 2024-09-18T01:25:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.919+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.919+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c57fb880 2024-09-18T01:25:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5618c57ff510 con 0x5618c5800270 2024-09-18T01:25:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233d82f800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233d82f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233d82f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233d82f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233d82f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233d82f800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233d82f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c5803530 con 0x5618c57fb880 2024-09-18T01:25:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233d82f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c5803920 con 0x5618c57fb880 2024-09-18T01:25:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233d82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233d82f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.920+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c5803920 con 0x7f232c073030 2024-09-18T01:25:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233d82f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233d82f800 20 zone default found 2024-09-18T01:25:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233d82f800 4 Realm: () 2024-09-18T01:25:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233d82f800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233d82f800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233d82f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233d82f800 20 zonegroup default 2024-09-18T01:25:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233d82f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c5803190 con 0x7f232c073030 2024-09-18T01:25:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233d82f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c5803190 con 0x5618c5804c40 2024-09-18T01:25:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.921+0000 7f233d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.922+0000 7f233d82f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.922+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c58096b0 con 0x5618c5804c40 2024-09-18T01:25:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.922+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.922+0000 7f233d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.922+0000 7f233d82f800 20 started sync module instance, tier type = 2024-09-18T01:25:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.922+0000 7f233d82f800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.922+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c5808aa0 con 0x5618c5800270 2024-09-18T01:25:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.923+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.923+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94664392740496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c5809fc0 con 0x5618c5800270 2024-09-18T01:25:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.923+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580a810 con 0x5618c57fb880 2024-09-18T01:25:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.924+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94664392740496] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.924+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.924+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94664392743696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580a890 con 0x5618c57fb880 2024-09-18T01:25:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.924+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580b3b0 con 0x5618c5804c40 2024-09-18T01:25:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.925+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.925+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94664392748672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580bc50 con 0x5618c5804c40 2024-09-18T01:25:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.925+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580c740 con 0x5618c5800270 2024-09-18T01:25:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.925+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94664392743696] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.927+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94664392748672] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.927+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.927+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94664392753680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580cb30 con 0x5618c5800270 2024-09-18T01:25:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.927+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580d380 con 0x5618c57fb880 2024-09-18T01:25:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.930+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.930+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94664392756496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580d760 con 0x5618c57fb880 2024-09-18T01:25:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.930+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580e280 con 0x7f232c073030 2024-09-18T01:25:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.930+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94664392753680] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.931+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94664392756496] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.933+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.933+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94664392760656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580d1b0 con 0x7f232c073030 2024-09-18T01:25:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.933+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580e6f0 con 0x7f232c073030 2024-09-18T01:25:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.934+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94664392760656] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.935+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.935+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94664392745824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580e6f0 con 0x7f232c073030 2024-09-18T01:25:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.935+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580f0f0 con 0x7f232c073030 2024-09-18T01:25:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.936+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94664392745824] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.936+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.936+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94664392764416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580e6f0 con 0x7f232c073030 2024-09-18T01:25:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.936+0000 7f233d82f800 20 add_watcher() i=0 2024-09-18T01:25:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.936+0000 7f233d82f800 20 add_watcher() i=1 2024-09-18T01:25:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.936+0000 7f233d82f800 20 add_watcher() i=2 2024-09-18T01:25:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.936+0000 7f233d82f800 20 add_watcher() i=3 2024-09-18T01:25:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.936+0000 7f233d82f800 20 add_watcher() i=4 2024-09-18T01:25:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.936+0000 7f233d82f800 20 add_watcher() i=5 2024-09-18T01:25:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.936+0000 7f233d82f800 20 add_watcher() i=6 2024-09-18T01:25:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.937+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94664392764416] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.937+0000 7f233d82f800 20 add_watcher() i=7 2024-09-18T01:25:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.937+0000 7f233d82f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.937+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c5812510 con 0x5618c57fb880 2024-09-18T01:25:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.938+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.938+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94664392762384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580f9e0 con 0x5618c57fb880 2024-09-18T01:25:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.939+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94664392762384] v33'32 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.939+0000 7f21f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.939+0000 7f233d82f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.939+0000 7f233d82f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.939+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581b020 con 0x5618c57fb880 2024-09-18T01:25:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.940+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'40 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.940+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581b6f0 con 0x7f232c073030 2024-09-18T01:25:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.941+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.941+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581bb10 con 0x5618c5804c40 2024-09-18T01:25:25.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.942+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.942+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581c420 con 0x5618c57fb880 2024-09-18T01:25:25.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.945+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'33 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.945+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c5816d90 con 0x5618c5800270 2024-09-18T01:25:25.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.948+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'26 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.948+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c5816d90 con 0x5618c5804c40 2024-09-18T01:25:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.949+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'25 uv16 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.949+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581cf60 con 0x5618c57fb880 2024-09-18T01:25:25.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.951+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.951+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581d380 con 0x7f232c073030 2024-09-18T01:25:25.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.952+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'19 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.952+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581d380 con 0x5618c5800270 2024-09-18T01:25:25.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.954+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.954+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581d830 con 0x5618c5804c40 2024-09-18T01:25:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.956+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.956+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581d830 con 0x5618c5800270 2024-09-18T01:25:25.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.959+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.959+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581d830 con 0x7f232c073030 2024-09-18T01:25:25.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.961+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.961+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581d7e0 con 0x5618c5800270 2024-09-18T01:25:25.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.962+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.962+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581d8c0 con 0x7f232c073030 2024-09-18T01:25:25.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.965+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.965+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581d8c0 con 0x5618c57fb880 2024-09-18T01:25:25.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.967+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'34 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.967+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581d8c0 con 0x5618c5804c40 2024-09-18T01:25:25.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.970+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.970+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x5618c5800270 2024-09-18T01:25:25.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.971+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'28 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.971+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x5618c5804c40 2024-09-18T01:25:25.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.973+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'22 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.973+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x5618c57fb880 2024-09-18T01:25:25.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.976+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.976+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x5618c57fb880 2024-09-18T01:25:25.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.979+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.979+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x5618c5804c40 2024-09-18T01:25:25.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.980+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.980+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x5618c5800270 2024-09-18T01:25:25.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.981+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.981+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x5618c5804c40 2024-09-18T01:25:25.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.984+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.984+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x5618c5804c40 2024-09-18T01:25:25.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.985+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.985+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x5618c5804c40 2024-09-18T01:25:25.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.986+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.986+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x5618c5804c40 2024-09-18T01:25:25.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.987+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.987+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x7f232c073030 2024-09-18T01:25:25.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.988+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.988+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x5618c5804c40 2024-09-18T01:25:25.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.989+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.989+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x7f232c073030 2024-09-18T01:25:25.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.990+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.990+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x5618c5804c40 2024-09-18T01:25:25.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.991+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:25.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.992+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x7f232c073030 2024-09-18T01:25:25.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.992+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'32 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:25.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.992+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581ddc0 con 0x5618c5800270 2024-09-18T01:25:25.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.994+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.994+0000 7f21f0fe1640 20 reqs_thread_entry: start 2024-09-18T01:25:25.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.994+0000 7f233d82f800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:25.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.994+0000 7f233d82f800 20 Filter name: none 2024-09-18T01:25:25.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.994+0000 7f216a7fc640 20 reqs_thread_entry: start 2024-09-18T01:25:25.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.994+0000 7f233d82f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-18T01:25:25.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.994+0000 7f233d82f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:25.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.994+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5618c5848b10 con 0x5618c5800270 2024-09-18T01:25:25.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.994+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.994+0000 7f233d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:25.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.994+0000 7f233d82f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-18T01:25:25.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.994+0000 7f233d82f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T01:25:25.997 INFO:teuthology.orchestra.run.smithi100.stderr:could not remove user: unable to remove user, user does not exist 2024-09-18T01:25:25.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.995+0000 7f21f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:25.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.995+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94664392762384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c581c400 con 0x5618c57fb880 2024-09-18T01:25:25.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.996+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94664392762384] v33'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:25.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.996+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94664392740496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580e3e0 con 0x5618c5800270 2024-09-18T01:25:25.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.997+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94664392740496] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:25.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.997+0000 7f233d82f800 20 remove_watcher() i=0 2024-09-18T01:25:25.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.997+0000 7f233d82f800 2 removed watcher, disabling cache 2024-09-18T01:25:25.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.997+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94664392743696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c5808e90 con 0x5618c57fb880 2024-09-18T01:25:25.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.998+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94664392743696] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:26.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.998+0000 7f233d82f800 20 remove_watcher() i=1 2024-09-18T01:25:26.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.998+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94664392748672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c5808e90 con 0x5618c5804c40 2024-09-18T01:25:26.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:25.999+0000 7f233ab29640 1 -- 172.21.15.100:0/2304738091 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94664392748672] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2330051070 con 0x5618c5804c40 2024-09-18T01:25:26.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.000+0000 7f233d82f800 20 remove_watcher() i=2 2024-09-18T01:25:26.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.000+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94664392753680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580ae80 con 0x5618c5800270 2024-09-18T01:25:26.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.001+0000 7f233b32a640 1 -- 172.21.15.100:0/2304738091 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94664392753680] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f232c03e030 con 0x5618c5800270 2024-09-18T01:25:26.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.001+0000 7f233d82f800 20 remove_watcher() i=3 2024-09-18T01:25:26.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.001+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94664392756496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c5808e90 con 0x5618c57fb880 2024-09-18T01:25:26.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.002+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94664392756496] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5618c57fb880 2024-09-18T01:25:26.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.002+0000 7f233d82f800 20 remove_watcher() i=4 2024-09-18T01:25:26.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.002+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94664392760656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580c210 con 0x7f232c073030 2024-09-18T01:25:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.003+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94664392760656] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.003+0000 7f233d82f800 20 remove_watcher() i=5 2024-09-18T01:25:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.003+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94664392745824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c580ae80 con 0x7f232c073030 2024-09-18T01:25:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.003+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94664392745824] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:26.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.003+0000 7f233d82f800 20 remove_watcher() i=6 2024-09-18T01:25:26.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.003+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94664392764416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5618c5808e90 con 0x7f232c073030 2024-09-18T01:25:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.006+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94664392764416] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c073030 2024-09-18T01:25:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 20 remove_watcher() i=7 2024-09-18T01:25:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f232c073030 msgr2=0x7f232c039080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f232c073030 0x7f232c039080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618c57fb880 msgr2=0x5618c57fdd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618c57fb880 0x5618c57fdd40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618c5800270 msgr2=0x5618c5802660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618c5800270 0x5618c5802660 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5618c5804c40 msgr2=0x5618c58070d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5618c5804c40 0x5618c58070d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2204036b40 msgr2=0x7f2204039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2204036b40 0x7f2204039000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2330053570 tx=0x7f2330053000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c4200 msgr2=0x5618c57f00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 --2- 172.21.15.100:0/2304738091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56c4200 0x5618c57f00c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f232c018740 tx=0x7f232c050fe0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 reap_dead start 2024-09-18T01:25:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233bb2b640 1 -- 172.21.15.100:0/2304738091 reap_dead start 2024-09-18T01:25:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 shutdown_connections 2024-09-18T01:25:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 >> 172.21.15.100:0/2304738091 conn(0x5618c57e2fc0 msgr2=0x5618c57e1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 shutdown_connections 2024-09-18T01:25:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/2304738091 wait complete. 2024-09-18T01:25:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/3455002959 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2214036b40 msgr2=0x7f2214039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 --2- 172.21.15.100:0/3455002959 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2214036b40 0x7f2214039000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5618c57c41a0 tx=0x7f2330005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/3455002959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c57da390 msgr2=0x5618c57da7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 --2- 172.21.15.100:0/3455002959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c57da390 0x5618c57da7b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f232c04b1b0 tx=0x7f232c00db20 comp rx=0 tx=0).stop 2024-09-18T01:25:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/3455002959 shutdown_connections 2024-09-18T01:25:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 --2- 172.21.15.100:0/3455002959 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2214036b40 0x7f2214039000 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 --2- 172.21.15.100:0/3455002959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c57da390 0x5618c57da7b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/3455002959 >> 172.21.15.100:0/3455002959 conn(0x5618c57cf320 msgr2=0x5618c57d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/3455002959 shutdown_connections 2024-09-18T01:25:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.007+0000 7f233d82f800 1 -- 172.21.15.100:0/3455002959 wait complete. 2024-09-18T01:25:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5618c57c9b30 msgr2=0x5618c57cbf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233d82f800 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5618c57c9b30 0x5618c57cbf20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618c56c98f0 msgr2=0x5618c57c3320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233d82f800 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618c56c98f0 0x5618c57c3320 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618c57c5bf0 msgr2=0x5618c57c7fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233d82f800 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618c57c5bf0 0x5618c57c7fe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2220036b40 msgr2=0x7f2220039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233d82f800 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2220036b40 0x7f2220039000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2330057000 tx=0x7f2330052000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56396b0 msgr2=0x5618c57bc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233d82f800 1 --2- 172.21.15.100:0/3283364404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c56396b0 0x5618c57bc2b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f232c00b7c0 tx=0x7f232c000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233bb2b640 1 -- 172.21.15.100:0/3283364404 reap_dead start 2024-09-18T01:25:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 shutdown_connections 2024-09-18T01:25:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 >> 172.21.15.100:0/3283364404 conn(0x5618c56bfde0 msgr2=0x5618c57aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 shutdown_connections 2024-09-18T01:25:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.008+0000 7f233d82f800 1 -- 172.21.15.100:0/3283364404 wait complete. 2024-09-18T01:25:26.017 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-18T01:25:26.017 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-18T01:25:26.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-18T01:25:26.018 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-18T01:25:26.061 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:26.062 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:26.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.061+0000 7f7a0d463800 1 Processor -- start 2024-09-18T01:25:26.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.061+0000 7f7a0d463800 1 -- start start 2024-09-18T01:25:26.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.061+0000 7f7a0d463800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x556b2571a990 0x556b2571cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.061+0000 7f7a0d463800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b255d5b30 con 0x556b2568a610 2024-09-18T01:25:26.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.061+0000 7f7a0d463800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x556b255b7360 con 0x556b2571a990 2024-09-18T01:25:26.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.062+0000 7f7a02756640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x556b2571a990 0x556b2571cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.062+0000 7f7a0af57640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x556b2568a610 0x556b25719270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59144/0 (socket says 172.21.15.100:59144) 2024-09-18T01:25:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.062+0000 7f7a0af57640 1 -- 172.21.15.100:0/1969435113 learned_addr learned my addr 172.21.15.100:0/1969435113 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.062+0000 7f7a02756640 1 -- 172.21.15.100:0/1969435113 >> v1:172.21.15.92:6789/0 conn(0x556b2568a610 legacy=0x556b25719270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.062+0000 7f7a02756640 1 -- 172.21.15.100:0/1969435113 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b255dde00 con 0x556b2571a990 2024-09-18T01:25:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.062+0000 7f7a0a756640 1 -- 172.21.15.100:0/1969435113 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3769210514 0 0) 0x556b255d5b30 con 0x556b2568a610 2024-09-18T01:25:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.064+0000 7f7a02756640 1 --2- 172.21.15.100:0/1969435113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2571a990 0x556b2571cd80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f79f400a470 tx=0x7f79f4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3969837f978a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.064+0000 7f7a0a756640 1 -- 172.21.15.100:0/1969435113 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79f4053570 con 0x556b2571a990 2024-09-18T01:25:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.064+0000 7f7a0a756640 1 -- 172.21.15.100:0/1969435113 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79f4058070 con 0x556b2571a990 2024-09-18T01:25:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.064+0000 7f7a0a756640 1 -- 172.21.15.100:0/1969435113 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79f4053880 con 0x556b2571a990 2024-09-18T01:25:26.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.065+0000 7f7a0d463800 1 -- 172.21.15.100:0/1969435113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2571a990 msgr2=0x556b2571cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.065+0000 7f7a0d463800 1 --2- 172.21.15.100:0/1969435113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2571a990 0x556b2571cd80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f79f400a470 tx=0x7f79f4045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:26.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.065+0000 7f7a0d463800 1 -- 172.21.15.100:0/1969435113 shutdown_connections 2024-09-18T01:25:26.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.065+0000 7f7a0d463800 1 --2- 172.21.15.100:0/1969435113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2571a990 0x556b2571cd80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.065+0000 7f7a0d463800 1 -- 172.21.15.100:0/1969435113 >> 172.21.15.100:0/1969435113 conn(0x556b25710de0 msgr2=0x556b25713200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.065+0000 7f7a0d463800 1 -- 172.21.15.100:0/1969435113 shutdown_connections 2024-09-18T01:25:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.065+0000 7f7a0d463800 1 -- 172.21.15.100:0/1969435113 wait complete. 2024-09-18T01:25:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.078+0000 7f7a0d463800 1 Processor -- start 2024-09-18T01:25:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.078+0000 7f7a0d463800 1 -- start start 2024-09-18T01:25:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.078+0000 7f7a0d463800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2568a610 0x556b25716ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.078+0000 7f7a0d463800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556b25662330 con 0x556b2568a610 2024-09-18T01:25:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.079+0000 7f7a0af57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2568a610 0x556b25716ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.079+0000 7f7a0af57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2568a610 0x556b25716ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60678/0 (socket says 172.21.15.100:60678) 2024-09-18T01:25:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.079+0000 7f7a0af57640 1 -- 172.21.15.100:0/3268689512 learned_addr learned my addr 172.21.15.100:0/3268689512 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.079+0000 7f7a0af57640 1 -- 172.21.15.100:0/3268689512 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b255afbc0 con 0x556b2568a610 2024-09-18T01:25:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.079+0000 7f7a0af57640 1 --2- 172.21.15.100:0/3268689512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2568a610 0x556b25716ba0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00b240 tx=0x7f79fc00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6924362c6c322275 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.080+0000 7f78f8e09640 1 -- 172.21.15.100:0/3268689512 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc008070 con 0x556b2568a610 2024-09-18T01:25:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.080+0000 7f78f8e09640 1 -- 172.21.15.100:0/3268689512 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc00d500 con 0x556b2568a610 2024-09-18T01:25:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.080+0000 7f78f8e09640 1 -- 172.21.15.100:0/3268689512 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc00d860 con 0x556b2568a610 2024-09-18T01:25:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.080+0000 7f7a0d463800 1 -- 172.21.15.100:0/3268689512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2568a610 msgr2=0x556b25716ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.080+0000 7f7a0d463800 1 --2- 172.21.15.100:0/3268689512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2568a610 0x556b25716ba0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00b240 tx=0x7f79fc00b700 comp rx=0 tx=0).stop 2024-09-18T01:25:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.080+0000 7f7a0d463800 1 -- 172.21.15.100:0/3268689512 shutdown_connections 2024-09-18T01:25:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.080+0000 7f7a0d463800 1 --2- 172.21.15.100:0/3268689512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2568a610 0x556b25716ba0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.080+0000 7f7a0d463800 1 -- 172.21.15.100:0/3268689512 >> 172.21.15.100:0/3268689512 conn(0x556b25710de0 msgr2=0x556b25801050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.080+0000 7f7a0d463800 1 -- 172.21.15.100:0/3268689512 shutdown_connections 2024-09-18T01:25:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.080+0000 7f7a0d463800 1 -- 172.21.15.100:0/3268689512 wait complete. 2024-09-18T01:25:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.081+0000 7f7a0d463800 1 Processor -- start 2024-09-18T01:25:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.081+0000 7f7a0d463800 1 -- start start 2024-09-18T01:25:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.081+0000 7f7a0d463800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2568a610 0x556b2580f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.081+0000 7f7a0d463800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556b2571d680 con 0x556b2568a610 2024-09-18T01:25:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.081+0000 7f7a0af57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2568a610 0x556b2580f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.081+0000 7f7a0af57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2568a610 0x556b2580f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60692/0 (socket says 172.21.15.100:60692) 2024-09-18T01:25:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.081+0000 7f7a0af57640 1 -- 172.21.15.100:0/3871960396 learned_addr learned my addr 172.21.15.100:0/3871960396 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.082+0000 7f7a0af57640 1 -- 172.21.15.100:0/3871960396 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b255c3fe0 con 0x556b2568a610 2024-09-18T01:25:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.082+0000 7f7a0af57640 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2568a610 0x556b2580f2b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x556b257162a0 tx=0x7f79fc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.082+0000 7f78f7606640 1 -- 172.21.15.100:0/3871960396 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc019870 con 0x556b2568a610 2024-09-18T01:25:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.082+0000 7f78f7606640 1 -- 172.21.15.100:0/3871960396 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc019a10 con 0x556b2568a610 2024-09-18T01:25:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.082+0000 7f78f7606640 1 -- 172.21.15.100:0/3871960396 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc019d30 con 0x556b2568a610 2024-09-18T01:25:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.082+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b2580f7f0 con 0x556b2568a610 2024-09-18T01:25:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.082+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b2580fd10 con 0x556b2568a610 2024-09-18T01:25:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.083+0000 7f78f7606640 1 -- 172.21.15.100:0/3871960396 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f79fc017040 con 0x556b2568a610 2024-09-18T01:25:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.083+0000 7f78f7606640 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78f0036b90 0x7f78f0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.083+0000 7f78f7606640 1 -- 172.21.15.100:0/3871960396 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f79fc015020 con 0x556b2568a610 2024-09-18T01:25:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.083+0000 7f7a02756640 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78f0036b90 0x7f78f0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.083+0000 7f7a0d463800 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556b2571a990 0x556b25816320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.083+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b258168a0 con 0x556b2571a990 2024-09-18T01:25:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.083+0000 7f7a0b758640 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556b2571a990 0x556b25816320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.084+0000 7f7a02756640 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78f0036b90 0x7f78f0039050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f79f4057000 tx=0x7f79f4052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.084+0000 7f7a0b758640 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556b2571a990 0x556b25816320 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.084+0000 7f7a0b758640 1 -- 172.21.15.100:0/3871960396 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2571a990 2024-09-18T01:25:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.084+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b258138f0 con 0x556b2571a990 2024-09-18T01:25:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.084+0000 7f7a0b758640 1 -- 172.21.15.100:0/3871960396 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2571a990 2024-09-18T01:25:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.084+0000 7f7a0d463800 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556b25818bd0 0x556b2581afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.084+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b2581b660 con 0x556b25818bd0 2024-09-18T01:25:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.084+0000 7f7a0af57640 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556b25818bd0 0x556b2581afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.085+0000 7f7a0af57640 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556b25818bd0 0x556b2581afc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.085+0000 7f7a0af57640 1 -- 172.21.15.100:0/3871960396 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f79fc02d070 con 0x556b25818bd0 2024-09-18T01:25:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.085+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b25817a70 con 0x556b2571a990 2024-09-18T01:25:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.085+0000 7f7a0b758640 1 -- 172.21.15.100:0/3871960396 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2571a990 2024-09-18T01:25:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.085+0000 7f7a0d463800 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556b2581cac0 0x556b2581eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.085+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b2581f5b0 con 0x556b2581cac0 2024-09-18T01:25:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.085+0000 7f7a02756640 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556b2581cac0 0x556b2581eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.086+0000 7f7a02756640 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556b2581cac0 0x556b2581eeb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.086+0000 7f7a02756640 1 -- 172.21.15.100:0/3871960396 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f79f4051070 con 0x556b2581cac0 2024-09-18T01:25:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.086+0000 7f7a0d463800 1 Processor -- start 2024-09-18T01:25:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.086+0000 7f7a0d463800 1 -- start start 2024-09-18T01:25:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.087+0000 7f7a0d463800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2582d360 0x556b2582d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.087+0000 7f7a0d463800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556b255b1580 con 0x556b2582d360 2024-09-18T01:25:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.087+0000 7f7a0af57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2582d360 0x556b2582d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.087+0000 7f7a0af57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2582d360 0x556b2582d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60694/0 (socket says 172.21.15.100:60694) 2024-09-18T01:25:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.087+0000 7f7a0af57640 1 -- 172.21.15.100:0/599518330 learned_addr learned my addr 172.21.15.100:0/599518330 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.087+0000 7f7a0af57640 1 -- 172.21.15.100:0/599518330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b2582dcc0 con 0x556b2582d360 2024-09-18T01:25:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.087+0000 7f7a0af57640 1 --2- 172.21.15.100:0/599518330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2582d360 0x556b2582d780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f79fc04b770 tx=0x7f79fc01aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.087+0000 7f78f4e01640 1 -- 172.21.15.100:0/599518330 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc00f470 con 0x556b2582d360 2024-09-18T01:25:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.087+0000 7f78f4e01640 1 -- 172.21.15.100:0/599518330 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc034070 con 0x556b2582d360 2024-09-18T01:25:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.087+0000 7f78f4e01640 1 -- 172.21.15.100:0/599518330 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc00f740 con 0x556b2582d360 2024-09-18T01:25:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.087+0000 7f7a0d463800 1 -- 172.21.15.100:0/599518330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b2582df50 con 0x556b2582d360 2024-09-18T01:25:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.087+0000 7f7a0d463800 1 -- 172.21.15.100:0/599518330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b25830c30 con 0x556b2582d360 2024-09-18T01:25:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.088+0000 7f78f4e01640 1 -- 172.21.15.100:0/599518330 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f79fc044d40 con 0x556b2582d360 2024-09-18T01:25:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.088+0000 7f78f4e01640 1 --2- 172.21.15.100:0/599518330 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78e4036b40 0x7f78e4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.088+0000 7f78f4e01640 1 -- 172.21.15.100:0/599518330 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f79fc03acc0 con 0x556b2582d360 2024-09-18T01:25:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.088+0000 7f7a02756640 1 --2- 172.21.15.100:0/599518330 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78e4036b40 0x7f78e4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.088+0000 7f7a0d463800 1 Processor -- start 2024-09-18T01:25:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.089+0000 7f7a0d463800 1 -- start start 2024-09-18T01:25:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.089+0000 7f7a02756640 1 --2- 172.21.15.100:0/599518330 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78e4036b40 0x7f78e4039000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x556b25813810 tx=0x7f79f4005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.089+0000 7f7a0d463800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b25839fa0 0x556b2583a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.089+0000 7f7a0d463800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556b25715270 con 0x556b25839fa0 2024-09-18T01:25:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.089+0000 7f7a0af57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b25839fa0 0x556b2583a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.089+0000 7f7a0af57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b25839fa0 0x556b2583a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60702/0 (socket says 172.21.15.100:60702) 2024-09-18T01:25:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.089+0000 7f7a0af57640 1 -- 172.21.15.100:0/313259743 learned_addr learned my addr 172.21.15.100:0/313259743 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.089+0000 7f7a0af57640 1 -- 172.21.15.100:0/313259743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b2583a8c0 con 0x556b25839fa0 2024-09-18T01:25:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.089+0000 7f7a0af57640 1 --2- 172.21.15.100:0/313259743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b25839fa0 0x556b2583a380 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00ffd0 tx=0x7f79fc01c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06e522fd3f5c893 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.089+0000 7f78ee7fc640 1 -- 172.21.15.100:0/313259743 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc03e030 con 0x556b25839fa0 2024-09-18T01:25:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.089+0000 7f78ee7fc640 1 -- 172.21.15.100:0/313259743 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc01ca30 con 0x556b25839fa0 2024-09-18T01:25:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.089+0000 7f78ee7fc640 1 -- 172.21.15.100:0/313259743 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc01ce40 con 0x556b25839fa0 2024-09-18T01:25:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.090+0000 7f7a0d463800 1 -- 172.21.15.100:0/313259743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b25839fa0 msgr2=0x556b2583a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.090+0000 7f7a0d463800 1 --2- 172.21.15.100:0/313259743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b25839fa0 0x556b2583a380 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00ffd0 tx=0x7f79fc01c610 comp rx=0 tx=0).stop 2024-09-18T01:25:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.090+0000 7f7a0d463800 1 -- 172.21.15.100:0/313259743 shutdown_connections 2024-09-18T01:25:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.090+0000 7f7a0d463800 1 --2- 172.21.15.100:0/313259743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b25839fa0 0x556b2583a380 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.090+0000 7f7a0d463800 1 -- 172.21.15.100:0/313259743 >> 172.21.15.100:0/313259743 conn(0x556b25836350 msgr2=0x556b25834450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.090+0000 7f7a0d463800 1 -- 172.21.15.100:0/313259743 shutdown_connections 2024-09-18T01:25:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.090+0000 7f7a0d463800 1 -- 172.21.15.100:0/313259743 wait complete. 2024-09-18T01:25:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.090+0000 7f7a0d463800 1 Processor -- start 2024-09-18T01:25:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.090+0000 7f7a0d463800 1 -- start start 2024-09-18T01:25:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.090+0000 7f7a0d463800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b25839fa0 0x556b258412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.090+0000 7f7a0d463800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556b2583ae00 con 0x556b25839fa0 2024-09-18T01:25:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.091+0000 7f7a0af57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b25839fa0 0x556b258412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.091+0000 7f7a0af57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b25839fa0 0x556b258412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60708/0 (socket says 172.21.15.100:60708) 2024-09-18T01:25:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.091+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 learned_addr learned my addr 172.21.15.100:0/220365881 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.091+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b25841820 con 0x556b25839fa0 2024-09-18T01:25:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.091+0000 7f7a0af57640 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b25839fa0 0x556b258412e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f79fc02bb70 tx=0x7f79fc014eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.091+0000 7f78ecff9640 1 -- 172.21.15.100:0/220365881 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc03e070 con 0x556b25839fa0 2024-09-18T01:25:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.091+0000 7f78ecff9640 1 -- 172.21.15.100:0/220365881 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc067030 con 0x556b25839fa0 2024-09-18T01:25:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.091+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b25841820 con 0x556b25839fa0 2024-09-18T01:25:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.091+0000 7f78ecff9640 1 -- 172.21.15.100:0/220365881 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc04fce0 con 0x556b25839fa0 2024-09-18T01:25:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.091+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b25841820 con 0x556b25839fa0 2024-09-18T01:25:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.092+0000 7f78ecff9640 1 -- 172.21.15.100:0/220365881 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f79fc05e040 con 0x556b25839fa0 2024-09-18T01:25:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.092+0000 7f78ecff9640 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78d4036b40 0x7f78d4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.092+0000 7f78ecff9640 1 -- 172.21.15.100:0/220365881 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f79fc05c020 con 0x556b25839fa0 2024-09-18T01:25:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.092+0000 7f7a02756640 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78d4036b40 0x7f78d4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.093+0000 7f7a02756640 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78d4036b40 0x7f78d4039000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x556b2581f9b0 tx=0x7f79f4053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.093+0000 7f7a0d463800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.093+0000 7f7a0d463800 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556b2584c9f0 0x556b2584eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.093+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b2584f600 con 0x556b2584c9f0 2024-09-18T01:25:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.093+0000 7f7a0b758640 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556b2584c9f0 0x556b2584eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.093+0000 7f7a0b758640 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556b2584c9f0 0x556b2584eeb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.093+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.093+0000 7f7a0d463800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.093+0000 7f7a0d463800 20 realm 2024-09-18T01:25:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.093+0000 7f7a0d463800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.093+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b2584fa10 con 0x556b2584c9f0 2024-09-18T01:25:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0d463800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0d463800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0d463800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b258502e0 con 0x556b2584c9f0 2024-09-18T01:25:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0d463800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0d463800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b2584c9f0 2024-09-18T01:25:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0d463800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0d463800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0d463800 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556b258513e0 0x556b258537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b25853de0 con 0x556b258513e0 2024-09-18T01:25:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.094+0000 7f7a0af57640 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556b258513e0 0x556b258537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.095+0000 7f7a0af57640 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556b258513e0 0x556b258537d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.095+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.095+0000 7f7a0d463800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.095+0000 7f7a0d463800 20 searching for the correct realm 2024-09-18T01:25:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.095+0000 7f7a0d463800 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556b25855d90 0x556b25858250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.095+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25858920 con 0x556b25855d90 2024-09-18T01:25:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.095+0000 7f7a02756640 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556b25855d90 0x556b25858250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.095+0000 7f7a02756640 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556b25855d90 0x556b25858250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.095+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.095+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25858920 con 0x556b258513e0 2024-09-18T01:25:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.096+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.096+0000 7f7a0af57640 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f79fc057070 0x7f79fc02b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.096+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25858920 con 0x7f79fc057070 2024-09-18T01:25:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.096+0000 7f7a0b758640 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f79fc057070 0x7f79fc02b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.096+0000 7f7a0b758640 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f79fc057070 0x7f79fc02b4e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.097+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.097+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b2584c9f0 2024-09-18T01:25:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.097+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.097+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b2584c9f0 2024-09-18T01:25:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.097+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.097+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x7f79fc057070 2024-09-18T01:25:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.097+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.097+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x7f79fc057070 2024-09-18T01:25:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.097+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.097+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b258513e0 2024-09-18T01:25:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.098+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.098+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b25855d90 2024-09-18T01:25:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.098+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.098+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b2584c9f0 2024-09-18T01:25:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.098+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.098+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x7f79fc057070 2024-09-18T01:25:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.098+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.098+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b2584c9f0 2024-09-18T01:25:26.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.099+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.099+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b258513e0 2024-09-18T01:25:26.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.099+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.099+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b25855d90 2024-09-18T01:25:26.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.099+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.099+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b25855d90 2024-09-18T01:25:26.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.099+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.099+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x7f79fc057070 2024-09-18T01:25:26.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.100+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.100+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b25855d90 2024-09-18T01:25:26.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.100+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.100+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b25855d90 2024-09-18T01:25:26.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.100+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.100+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b2584c9f0 2024-09-18T01:25:26.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.100+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.100+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b2584c9f0 2024-09-18T01:25:26.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.101+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.101+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x7f79fc057070 2024-09-18T01:25:26.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.101+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.101+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b25855d90 2024-09-18T01:25:26.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.101+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.101+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b258513e0 2024-09-18T01:25:26.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.101+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.101+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b2584c9f0 2024-09-18T01:25:26.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.102+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.102+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x7f79fc057070 2024-09-18T01:25:26.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.102+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.102+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b25855d90 2024-09-18T01:25:26.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.102+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.102+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x7f79fc057070 2024-09-18T01:25:26.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.102+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.102+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b258513e0 2024-09-18T01:25:26.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.103+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.103+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b25855d90 2024-09-18T01:25:26.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.103+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.103+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x7f79fc057070 2024-09-18T01:25:26.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.103+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.103+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b2584c9f0 2024-09-18T01:25:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.103+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.103+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b25850680 con 0x556b258513e0 2024-09-18T01:25:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0d463800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0d463800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0d463800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0d463800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0d463800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0d463800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0d463800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b258546a0 con 0x556b2584c9f0 2024-09-18T01:25:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0d463800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0d463800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b25854a90 con 0x556b2584c9f0 2024-09-18T01:25:26.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0d463800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:26.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0d463800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.104+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b25854a90 con 0x7f79fc057070 2024-09-18T01:25:26.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:26.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 20 zone default found 2024-09-18T01:25:26.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 4 Realm: () 2024-09-18T01:25:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 20 zonegroup default 2024-09-18T01:25:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b25858da0 con 0x7f79fc057070 2024-09-18T01:25:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b2585a780 con 0x556b25855d90 2024-09-18T01:25:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b2585ab20 con 0x556b25855d90 2024-09-18T01:25:26.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 20 started sync module instance, tier type = 2024-09-18T01:25:26.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:26.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.105+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b25859c20 con 0x556b258513e0 2024-09-18T01:25:26.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.106+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.106+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93918679375888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b25859880 con 0x556b258513e0 2024-09-18T01:25:26.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.106+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585b820 con 0x556b2584c9f0 2024-09-18T01:25:26.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.107+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93918679375888] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.107+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.107+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93918679380128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585baf0 con 0x556b2584c9f0 2024-09-18T01:25:26.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.108+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585c5c0 con 0x556b25855d90 2024-09-18T01:25:26.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.109+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93918679380128] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.109+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.109+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93918679384240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585c9e0 con 0x556b25855d90 2024-09-18T01:25:26.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.109+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585d3e0 con 0x556b258513e0 2024-09-18T01:25:26.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.110+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.110+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93918679390160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585e0a0 con 0x556b258513e0 2024-09-18T01:25:26.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.110+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585eae0 con 0x556b2584c9f0 2024-09-18T01:25:26.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.111+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93918679390160] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.112+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93918679384240] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.112+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.112+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93918679393712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585dbf0 con 0x556b2584c9f0 2024-09-18T01:25:26.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.112+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585f380 con 0x7f79fc057070 2024-09-18T01:25:26.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.113+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93918679393712] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.113+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.113+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93918679381312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585f2a0 con 0x7f79fc057070 2024-09-18T01:25:26.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.113+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585faf0 con 0x7f79fc057070 2024-09-18T01:25:26.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.114+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.114+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93918679397504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585fe10 con 0x7f79fc057070 2024-09-18T01:25:26.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.114+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b25860930 con 0x7f79fc057070 2024-09-18T01:25:26.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.114+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93918679381312] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.115+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93918679397504] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.115+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.115+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93918679401472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585eda0 con 0x7f79fc057070 2024-09-18T01:25:26.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.115+0000 7f7a0d463800 20 add_watcher() i=0 2024-09-18T01:25:26.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.115+0000 7f7a0d463800 20 add_watcher() i=1 2024-09-18T01:25:26.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.115+0000 7f7a0d463800 20 add_watcher() i=2 2024-09-18T01:25:26.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.115+0000 7f7a0d463800 20 add_watcher() i=3 2024-09-18T01:25:26.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.115+0000 7f7a0d463800 20 add_watcher() i=4 2024-09-18T01:25:26.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.115+0000 7f7a0d463800 20 add_watcher() i=5 2024-09-18T01:25:26.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.115+0000 7f7a0d463800 20 add_watcher() i=6 2024-09-18T01:25:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.117+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93918679401472] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.117+0000 7f7a0d463800 20 add_watcher() i=7 2024-09-18T01:25:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.117+0000 7f7a0d463800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.117+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b25863920 con 0x556b2584c9f0 2024-09-18T01:25:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.117+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.117+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93918679398560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b25860da0 con 0x556b2584c9f0 2024-09-18T01:25:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.118+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93918679398560] v33'37 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.118+0000 7f78c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.118+0000 7f7a0d463800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.118+0000 7f7a0d463800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.118+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586c290 con 0x556b2584c9f0 2024-09-18T01:25:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.120+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'41 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.120+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586c960 con 0x7f79fc057070 2024-09-18T01:25:26.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.121+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.121+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586cd80 con 0x556b25855d90 2024-09-18T01:25:26.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.122+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.122+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586d2f0 con 0x556b2584c9f0 2024-09-18T01:25:26.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.123+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'38 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.123+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586d860 con 0x556b258513e0 2024-09-18T01:25:26.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.125+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.126+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586d860 con 0x556b25855d90 2024-09-18T01:25:26.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.126+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'27 uv16 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.127+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586dd10 con 0x556b2584c9f0 2024-09-18T01:25:26.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.127+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.127+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e100 con 0x7f79fc057070 2024-09-18T01:25:26.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.129+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'21 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.129+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e100 con 0x556b258513e0 2024-09-18T01:25:26.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.130+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.130+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e190 con 0x556b25855d90 2024-09-18T01:25:26.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.131+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.131+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e700 con 0x556b258513e0 2024-09-18T01:25:26.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.132+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'30 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.132+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e700 con 0x7f79fc057070 2024-09-18T01:25:26.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.133+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.133+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e700 con 0x556b258513e0 2024-09-18T01:25:26.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.134+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'17 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.134+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e700 con 0x7f79fc057070 2024-09-18T01:25:26.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.135+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.135+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e700 con 0x556b2584c9f0 2024-09-18T01:25:26.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.136+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'39 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.136+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e700 con 0x556b25855d90 2024-09-18T01:25:26.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.137+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.137+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e9b0 con 0x556b258513e0 2024-09-18T01:25:26.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.138+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'31 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.138+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e920 con 0x556b25855d90 2024-09-18T01:25:26.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.139+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'23 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.139+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e8f0 con 0x556b2584c9f0 2024-09-18T01:25:26.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.140+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.140+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e8f0 con 0x556b2584c9f0 2024-09-18T01:25:26.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.141+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'40 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.141+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e8f0 con 0x556b25855d90 2024-09-18T01:25:26.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.143+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.144+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e8f0 con 0x556b258513e0 2024-09-18T01:25:26.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.144+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.144+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e8f0 con 0x556b25855d90 2024-09-18T01:25:26.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.146+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.146+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e8f0 con 0x556b25855d90 2024-09-18T01:25:26.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.149+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.149+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e8f0 con 0x556b25855d90 2024-09-18T01:25:26.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.150+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.150+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e8f0 con 0x556b25855d90 2024-09-18T01:25:26.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.151+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.151+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e8f0 con 0x7f79fc057070 2024-09-18T01:25:26.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.152+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.152+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e8f0 con 0x556b25855d90 2024-09-18T01:25:26.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.153+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.153+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e8f0 con 0x7f79fc057070 2024-09-18T01:25:26.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.155+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.155+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e8f0 con 0x556b25855d90 2024-09-18T01:25:26.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.156+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.156+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e8f0 con 0x7f79fc057070 2024-09-18T01:25:26.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.157+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'34 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.157+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2586e8f0 con 0x556b258513e0 2024-09-18T01:25:26.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.158+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.158+0000 7f783bfff640 20 reqs_thread_entry: start 2024-09-18T01:25:26.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.158+0000 7f7a0d463800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:26.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.158+0000 7f7a0d463800 20 Filter name: none 2024-09-18T01:25:26.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.159+0000 7f7839ffb640 20 reqs_thread_entry: start 2024-09-18T01:25:26.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.159+0000 7f7a0d463800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-18T01:25:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.159+0000 7f7a0d463800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.159+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b258998f0 con 0x7f79fc057070 2024-09-18T01:25:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.159+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.159+0000 7f7a0d463800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.159+0000 7f7a0d463800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-18T01:25:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.159+0000 7f7a0d463800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T01:25:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:could not remove user: unable to remove user, user does not exist 2024-09-18T01:25:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.160+0000 7f78c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:26.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.160+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93918679398560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b25867a90 con 0x556b2584c9f0 2024-09-18T01:25:26.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.161+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93918679398560] v33'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.161+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93918679375888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585f8a0 con 0x556b258513e0 2024-09-18T01:25:26.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.163+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93918679375888] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.163+0000 7f7a0d463800 20 remove_watcher() i=0 2024-09-18T01:25:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.163+0000 7f7a0d463800 2 removed watcher, disabling cache 2024-09-18T01:25:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.163+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93918679380128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585a010 con 0x556b2584c9f0 2024-09-18T01:25:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.164+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93918679380128] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.164+0000 7f7a0d463800 20 remove_watcher() i=1 2024-09-18T01:25:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.164+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93918679384240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585b0a0 con 0x556b25855d90 2024-09-18T01:25:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.166+0000 7f7a02756640 1 -- 172.21.15.100:0/220365881 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93918679384240] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f407c040 con 0x556b25855d90 2024-09-18T01:25:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.166+0000 7f7a0d463800 20 remove_watcher() i=2 2024-09-18T01:25:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.166+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93918679390160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585c0b0 con 0x556b258513e0 2024-09-18T01:25:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.167+0000 7f7a0af57640 1 -- 172.21.15.100:0/220365881 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93918679390160] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc02d070 con 0x556b258513e0 2024-09-18T01:25:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.167+0000 7f7a0d463800 20 remove_watcher() i=3 2024-09-18T01:25:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.167+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93918679393712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585c0b0 con 0x556b2584c9f0 2024-09-18T01:25:26.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.168+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93918679393712] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x556b2584c9f0 2024-09-18T01:25:26.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.168+0000 7f7a0d463800 20 remove_watcher() i=4 2024-09-18T01:25:26.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.168+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93918679381312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585e5b0 con 0x7f79fc057070 2024-09-18T01:25:26.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.169+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93918679381312] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.169+0000 7f7a0d463800 20 remove_watcher() i=5 2024-09-18T01:25:26.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.169+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93918679397504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585c0b0 con 0x7f79fc057070 2024-09-18T01:25:26.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.171+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93918679397504] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.171+0000 7f7a0d463800 20 remove_watcher() i=6 2024-09-18T01:25:26.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.171+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93918679401472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b2585c0b0 con 0x7f79fc057070 2024-09-18T01:25:26.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.171+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93918679401472] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a0400a4a0 con 0x7f79fc057070 2024-09-18T01:25:26.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.171+0000 7f7a0d463800 20 remove_watcher() i=7 2024-09-18T01:25:26.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f79fc057070 msgr2=0x7f79fc02b4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f79fc057070 0x7f79fc02b4e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556b2584c9f0 msgr2=0x556b2584eeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556b2584c9f0 0x556b2584eeb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556b258513e0 msgr2=0x556b258537d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556b258513e0 0x556b258537d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556b25855d90 msgr2=0x556b25858250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556b25855d90 0x556b25858250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78d4036b40 msgr2=0x7f78d4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78d4036b40 0x7f78d4039000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x556b2581f9b0 tx=0x7f79f4053000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b25839fa0 msgr2=0x556b258412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 --2- 172.21.15.100:0/220365881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b25839fa0 0x556b258412e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f79fc02bb70 tx=0x7f79fc014eb0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 reap_dead start 2024-09-18T01:25:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0b758640 1 -- 172.21.15.100:0/220365881 reap_dead start 2024-09-18T01:25:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 shutdown_connections 2024-09-18T01:25:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 >> 172.21.15.100:0/220365881 conn(0x556b25836350 msgr2=0x556b25834420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 shutdown_connections 2024-09-18T01:25:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/220365881 wait complete. 2024-09-18T01:25:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/599518330 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78e4036b40 msgr2=0x7f78e4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 --2- 172.21.15.100:0/599518330 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78e4036b40 0x7f78e4039000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x556b25813810 tx=0x7f79f4005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/599518330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2582d360 msgr2=0x556b2582d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 --2- 172.21.15.100:0/599518330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2582d360 0x556b2582d780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f79fc04b770 tx=0x7f79fc01aee0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/599518330 shutdown_connections 2024-09-18T01:25:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 --2- 172.21.15.100:0/599518330 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78e4036b40 0x7f78e4039000 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 --2- 172.21.15.100:0/599518330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2582d360 0x556b2582d780 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/599518330 >> 172.21.15.100:0/599518330 conn(0x556b258222f0 msgr2=0x556b25824e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/599518330 shutdown_connections 2024-09-18T01:25:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.172+0000 7f7a0d463800 1 -- 172.21.15.100:0/599518330 wait complete. 2024-09-18T01:25:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556b2581cac0 msgr2=0x556b2581eeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0d463800 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556b2581cac0 0x556b2581eeb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556b2571a990 msgr2=0x556b25816320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0d463800 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556b2571a990 0x556b25816320 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556b25818bd0 msgr2=0x556b2581afc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0d463800 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556b25818bd0 0x556b2581afc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78f0036b90 msgr2=0x7f78f0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0d463800 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78f0036b90 0x7f78f0039050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f79f4057000 tx=0x7f79f4052000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2568a610 msgr2=0x556b2580f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0d463800 1 --2- 172.21.15.100:0/3871960396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b2568a610 0x556b2580f2b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x556b257162a0 tx=0x7f79fc000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0b758640 1 -- 172.21.15.100:0/3871960396 reap_dead start 2024-09-18T01:25:26.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 shutdown_connections 2024-09-18T01:25:26.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 >> 172.21.15.100:0/3871960396 conn(0x556b25710de0 msgr2=0x556b25800c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 shutdown_connections 2024-09-18T01:25:26.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.173+0000 7f7a0d463800 1 -- 172.21.15.100:0/3871960396 wait complete. 2024-09-18T01:25:26.184 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-18T01:25:26.185 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-18T01:25:26.185 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-18T01:25:26.185 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-18T01:25:26.229 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:26.229 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:26.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.228+0000 7fa369531800 1 Processor -- start 2024-09-18T01:25:26.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.228+0000 7fa369531800 1 -- start start 2024-09-18T01:25:26.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.228+0000 7fa369531800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5588cacf0d00 0x5588cacf30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.228+0000 7fa369531800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5588caba9b30 con 0x5588cac5ddf0 2024-09-18T01:25:26.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.228+0000 7fa369531800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5588cab8b360 con 0x5588cacf0d00 2024-09-18T01:25:26.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.229+0000 7fa35ca23640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5588cacf0d00 0x5588cacf30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.229+0000 7fa365224640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5588cac5ddf0 0x5588cacef5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59150/0 (socket says 172.21.15.100:59150) 2024-09-18T01:25:26.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.229+0000 7fa35ca23640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5588cacf0d00 0x5588cacf30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60716/0 (socket says 172.21.15.100:60716) 2024-09-18T01:25:26.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.229+0000 7fa365224640 1 -- 172.21.15.100:0/1831945694 learned_addr learned my addr 172.21.15.100:0/1831945694 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:26.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.229+0000 7fa35ca23640 1 -- 172.21.15.100:0/1831945694 >> v1:172.21.15.92:6789/0 conn(0x5588cac5ddf0 legacy=0x5588cacef5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.229+0000 7fa364a23640 1 -- 172.21.15.100:0/1831945694 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2391026744 0 0) 0x5588caba9b30 con 0x5588cac5ddf0 2024-09-18T01:25:26.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.229+0000 7fa35ca23640 1 -- 172.21.15.100:0/1831945694 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588cabb1e00 con 0x5588cacf0d00 2024-09-18T01:25:26.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.231+0000 7fa35ca23640 1 --2- 172.21.15.100:0/1831945694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cacf0d00 0x5588cacf30f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa35000a470 tx=0x7fa350045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6380351f60dbed server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.231+0000 7fa364a23640 1 -- 172.21.15.100:0/1831945694 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa350053570 con 0x5588cacf0d00 2024-09-18T01:25:26.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.231+0000 7fa364a23640 1 -- 172.21.15.100:0/1831945694 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa350058070 con 0x5588cacf0d00 2024-09-18T01:25:26.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.231+0000 7fa364a23640 1 -- 172.21.15.100:0/1831945694 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa350053880 con 0x5588cacf0d00 2024-09-18T01:25:26.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.231+0000 7fa369531800 1 -- 172.21.15.100:0/1831945694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cacf0d00 msgr2=0x5588cacf30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.231+0000 7fa369531800 1 --2- 172.21.15.100:0/1831945694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cacf0d00 0x5588cacf30f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa35000a470 tx=0x7fa350045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:26.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.232+0000 7fa369531800 1 -- 172.21.15.100:0/1831945694 shutdown_connections 2024-09-18T01:25:26.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.232+0000 7fa369531800 1 --2- 172.21.15.100:0/1831945694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cacf0d00 0x5588cacf30f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.232+0000 7fa369531800 1 -- 172.21.15.100:0/1831945694 >> 172.21.15.100:0/1831945694 conn(0x5588cace4df0 msgr2=0x5588cace7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.232+0000 7fa369531800 1 -- 172.21.15.100:0/1831945694 shutdown_connections 2024-09-18T01:25:26.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.232+0000 7fa369531800 1 -- 172.21.15.100:0/1831945694 wait complete. 2024-09-18T01:25:26.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.245+0000 7fa369531800 1 Processor -- start 2024-09-18T01:25:26.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.245+0000 7fa369531800 1 -- start start 2024-09-18T01:25:26.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.245+0000 7fa369531800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cac5ddf0 0x5588caddb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.245+0000 7fa369531800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5588cac36330 con 0x5588cac5ddf0 2024-09-18T01:25:26.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.246+0000 7fa365224640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cac5ddf0 0x5588caddb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.246+0000 7fa365224640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cac5ddf0 0x5588caddb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60718/0 (socket says 172.21.15.100:60718) 2024-09-18T01:25:26.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.246+0000 7fa365224640 1 -- 172.21.15.100:0/3822948759 learned_addr learned my addr 172.21.15.100:0/3822948759 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.246+0000 7fa365224640 1 -- 172.21.15.100:0/3822948759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588cab83bc0 con 0x5588cac5ddf0 2024-09-18T01:25:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.246+0000 7fa365224640 1 --2- 172.21.15.100:0/3822948759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cac5ddf0 0x5588caddb800 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa35800b240 tx=0x7fa35800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f79591211e8e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.246+0000 7fa253606640 1 -- 172.21.15.100:0/3822948759 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa358008070 con 0x5588cac5ddf0 2024-09-18T01:25:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.246+0000 7fa253606640 1 -- 172.21.15.100:0/3822948759 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa35800d500 con 0x5588cac5ddf0 2024-09-18T01:25:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.246+0000 7fa253606640 1 -- 172.21.15.100:0/3822948759 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa35800d860 con 0x5588cac5ddf0 2024-09-18T01:25:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.247+0000 7fa369531800 1 -- 172.21.15.100:0/3822948759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cac5ddf0 msgr2=0x5588caddb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.247+0000 7fa369531800 1 --2- 172.21.15.100:0/3822948759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cac5ddf0 0x5588caddb800 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa35800b240 tx=0x7fa35800b700 comp rx=0 tx=0).stop 2024-09-18T01:25:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.247+0000 7fa369531800 1 -- 172.21.15.100:0/3822948759 shutdown_connections 2024-09-18T01:25:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.247+0000 7fa369531800 1 --2- 172.21.15.100:0/3822948759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cac5ddf0 0x5588caddb800 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.247+0000 7fa369531800 1 -- 172.21.15.100:0/3822948759 >> 172.21.15.100:0/3822948759 conn(0x5588cace4df0 msgr2=0x5588cadd71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.247+0000 7fa369531800 1 -- 172.21.15.100:0/3822948759 shutdown_connections 2024-09-18T01:25:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.247+0000 7fa369531800 1 -- 172.21.15.100:0/3822948759 wait complete. 2024-09-18T01:25:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.248+0000 7fa369531800 1 Processor -- start 2024-09-18T01:25:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.248+0000 7fa369531800 1 -- start start 2024-09-18T01:25:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.248+0000 7fa369531800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cac5ddf0 0x5588cade3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.248+0000 7fa369531800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5588cacf3900 con 0x5588cac5ddf0 2024-09-18T01:25:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.248+0000 7fa365224640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cac5ddf0 0x5588cade3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.248+0000 7fa365224640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cac5ddf0 0x5588cade3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60730/0 (socket says 172.21.15.100:60730) 2024-09-18T01:25:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.248+0000 7fa365224640 1 -- 172.21.15.100:0/1052396216 learned_addr learned my addr 172.21.15.100:0/1052396216 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.248+0000 7fa365224640 1 -- 172.21.15.100:0/1052396216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588cab97fe0 con 0x5588cac5ddf0 2024-09-18T01:25:26.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.248+0000 7fa365224640 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cac5ddf0 0x5588cade3280 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x5588caddc660 tx=0x7fa358000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.249+0000 7fa251e03640 1 -- 172.21.15.100:0/1052396216 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa358019870 con 0x5588cac5ddf0 2024-09-18T01:25:26.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.249+0000 7fa251e03640 1 -- 172.21.15.100:0/1052396216 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa358019a10 con 0x5588cac5ddf0 2024-09-18T01:25:26.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.249+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588cade37c0 con 0x5588cac5ddf0 2024-09-18T01:25:26.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.249+0000 7fa251e03640 1 -- 172.21.15.100:0/1052396216 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa358019d30 con 0x5588cac5ddf0 2024-09-18T01:25:26.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.249+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588cade3ce0 con 0x5588cac5ddf0 2024-09-18T01:25:26.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.249+0000 7fa251e03640 1 -- 172.21.15.100:0/1052396216 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa358017040 con 0x5588cac5ddf0 2024-09-18T01:25:26.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.250+0000 7fa251e03640 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa24c036b90 0x7fa24c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.250+0000 7fa251e03640 1 -- 172.21.15.100:0/1052396216 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa358015020 con 0x5588cac5ddf0 2024-09-18T01:25:26.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.250+0000 7fa35ca23640 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa24c036b90 0x7fa24c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.250+0000 7fa369531800 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5588cacf0d00 0x5588cadea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.250+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cadea870 con 0x5588cacf0d00 2024-09-18T01:25:26.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.250+0000 7fa365a25640 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5588cacf0d00 0x5588cadea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.250+0000 7fa35ca23640 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa24c036b90 0x7fa24c039050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa350057000 tx=0x7fa350052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.250+0000 7fa365a25640 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5588cacf0d00 0x5588cadea2f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.250+0000 7fa365a25640 1 -- 172.21.15.100:0/1052396216 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cacf0d00 2024-09-18T01:25:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.251+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cade78c0 con 0x5588cacf0d00 2024-09-18T01:25:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.251+0000 7fa365a25640 1 -- 172.21.15.100:0/1052396216 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cacf0d00 2024-09-18T01:25:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.251+0000 7fa369531800 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5588cadecba0 0x5588cadeef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.251+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cadef630 con 0x5588cadecba0 2024-09-18T01:25:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.251+0000 7fa365224640 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5588cadecba0 0x5588cadeef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.251+0000 7fa365224640 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5588cadecba0 0x5588cadeef90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.251+0000 7fa365224640 1 -- 172.21.15.100:0/1052396216 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa35802d070 con 0x5588cadecba0 2024-09-18T01:25:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.251+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cadeba40 con 0x5588cacf0d00 2024-09-18T01:25:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.252+0000 7fa365a25640 1 -- 172.21.15.100:0/1052396216 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cacf0d00 2024-09-18T01:25:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.252+0000 7fa369531800 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5588cadf0a90 0x5588cadf2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.252+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cadf3580 con 0x5588cadf0a90 2024-09-18T01:25:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.252+0000 7fa35ca23640 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5588cadf0a90 0x5588cadf2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.252+0000 7fa35ca23640 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5588cadf0a90 0x5588cadf2e80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.253+0000 7fa35ca23640 1 -- 172.21.15.100:0/1052396216 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa350051070 con 0x5588cadf0a90 2024-09-18T01:25:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.253+0000 7fa369531800 1 Processor -- start 2024-09-18T01:25:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.253+0000 7fa369531800 1 -- start start 2024-09-18T01:25:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.253+0000 7fa369531800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae01330 0x5588cae01750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.253+0000 7fa369531800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5588cab85580 con 0x5588cae01330 2024-09-18T01:25:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.253+0000 7fa365224640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae01330 0x5588cae01750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.253+0000 7fa365224640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae01330 0x5588cae01750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60732/0 (socket says 172.21.15.100:60732) 2024-09-18T01:25:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.253+0000 7fa365224640 1 -- 172.21.15.100:0/276109023 learned_addr learned my addr 172.21.15.100:0/276109023 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.254+0000 7fa365224640 1 -- 172.21.15.100:0/276109023 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588cae01c90 con 0x5588cae01330 2024-09-18T01:25:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.254+0000 7fa365224640 1 --2- 172.21.15.100:0/276109023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae01330 0x5588cae01750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa35804b770 tx=0x7fa35801aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.254+0000 7fa24affd640 1 -- 172.21.15.100:0/276109023 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa35801a8c0 con 0x5588cae01330 2024-09-18T01:25:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.254+0000 7fa24affd640 1 -- 172.21.15.100:0/276109023 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa358034070 con 0x5588cae01330 2024-09-18T01:25:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.254+0000 7fa369531800 1 -- 172.21.15.100:0/276109023 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588cae01f20 con 0x5588cae01330 2024-09-18T01:25:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.254+0000 7fa24affd640 1 -- 172.21.15.100:0/276109023 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa35800eaa0 con 0x5588cae01330 2024-09-18T01:25:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.254+0000 7fa369531800 1 -- 172.21.15.100:0/276109023 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588cae04c00 con 0x5588cae01330 2024-09-18T01:25:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.254+0000 7fa24affd640 1 -- 172.21.15.100:0/276109023 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa35800ec40 con 0x5588cae01330 2024-09-18T01:25:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.255+0000 7fa24affd640 1 --2- 172.21.15.100:0/276109023 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa23c036b40 0x7fa23c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.255+0000 7fa24affd640 1 -- 172.21.15.100:0/276109023 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa35804ec80 con 0x5588cae01330 2024-09-18T01:25:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.255+0000 7fa35ca23640 1 --2- 172.21.15.100:0/276109023 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa23c036b40 0x7fa23c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.255+0000 7fa369531800 1 Processor -- start 2024-09-18T01:25:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.255+0000 7fa369531800 1 -- start start 2024-09-18T01:25:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.255+0000 7fa35ca23640 1 --2- 172.21.15.100:0/276109023 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa23c036b40 0x7fa23c039000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5588cade77e0 tx=0x7fa350005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.255+0000 7fa369531800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae0df10 0x5588cae0e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.255+0000 7fa369531800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5588caddbfb0 con 0x5588cae0df10 2024-09-18T01:25:26.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.255+0000 7fa365224640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae0df10 0x5588cae0e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.255+0000 7fa365224640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae0df10 0x5588cae0e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60740/0 (socket says 172.21.15.100:60740) 2024-09-18T01:25:26.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.255+0000 7fa365224640 1 -- 172.21.15.100:0/1136589053 learned_addr learned my addr 172.21.15.100:0/1136589053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.256+0000 7fa365224640 1 -- 172.21.15.100:0/1136589053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588cae0e850 con 0x5588cae0df10 2024-09-18T01:25:26.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.256+0000 7fa365224640 1 --2- 172.21.15.100:0/1136589053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae0df10 0x5588cae0e310 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa358001540 tx=0x7fa358008440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17f502b94d6c60b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.256+0000 7fa248ff9640 1 -- 172.21.15.100:0/1136589053 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa35805c020 con 0x5588cae0df10 2024-09-18T01:25:26.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.256+0000 7fa248ff9640 1 -- 172.21.15.100:0/1136589053 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa358010d10 con 0x5588cae0df10 2024-09-18T01:25:26.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.256+0000 7fa248ff9640 1 -- 172.21.15.100:0/1136589053 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa35803f7d0 con 0x5588cae0df10 2024-09-18T01:25:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.256+0000 7fa369531800 1 -- 172.21.15.100:0/1136589053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae0df10 msgr2=0x5588cae0e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.256+0000 7fa369531800 1 --2- 172.21.15.100:0/1136589053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae0df10 0x5588cae0e310 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa358001540 tx=0x7fa358008440 comp rx=0 tx=0).stop 2024-09-18T01:25:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.256+0000 7fa369531800 1 -- 172.21.15.100:0/1136589053 shutdown_connections 2024-09-18T01:25:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.256+0000 7fa369531800 1 --2- 172.21.15.100:0/1136589053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae0df10 0x5588cae0e310 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.256+0000 7fa369531800 1 -- 172.21.15.100:0/1136589053 >> 172.21.15.100:0/1136589053 conn(0x5588cae0a2c0 msgr2=0x5588cae083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.256+0000 7fa369531800 1 -- 172.21.15.100:0/1136589053 shutdown_connections 2024-09-18T01:25:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.256+0000 7fa369531800 1 -- 172.21.15.100:0/1136589053 wait complete. 2024-09-18T01:25:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.257+0000 7fa369531800 1 Processor -- start 2024-09-18T01:25:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.257+0000 7fa369531800 1 -- start start 2024-09-18T01:25:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.257+0000 7fa369531800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae0df10 0x5588cae151b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.257+0000 7fa369531800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5588cae0ed70 con 0x5588cae0df10 2024-09-18T01:25:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.257+0000 7fa365224640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae0df10 0x5588cae151b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.257+0000 7fa365224640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae0df10 0x5588cae151b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60746/0 (socket says 172.21.15.100:60746) 2024-09-18T01:25:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.257+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 learned_addr learned my addr 172.21.15.100:0/2243730539 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.257+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588cae156f0 con 0x5588cae0df10 2024-09-18T01:25:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.257+0000 7fa365224640 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae0df10 0x5588cae151b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa358001540 tx=0x7fa3580270a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.258+0000 7fa23affd640 1 -- 172.21.15.100:0/2243730539 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa358071070 con 0x5588cae0df10 2024-09-18T01:25:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.258+0000 7fa23affd640 1 -- 172.21.15.100:0/2243730539 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa35801fca0 con 0x5588cae0df10 2024-09-18T01:25:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.258+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588cae156f0 con 0x5588cae0df10 2024-09-18T01:25:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.258+0000 7fa23affd640 1 -- 172.21.15.100:0/2243730539 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa35800f470 con 0x5588cae0df10 2024-09-18T01:25:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.258+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588cae156f0 con 0x5588cae0df10 2024-09-18T01:25:26.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.258+0000 7fa23affd640 1 -- 172.21.15.100:0/2243730539 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa358074070 con 0x5588cae0df10 2024-09-18T01:25:26.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.259+0000 7fa23affd640 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa230036b40 0x7fa230039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.259+0000 7fa23affd640 1 -- 172.21.15.100:0/2243730539 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa358068030 con 0x5588cae0df10 2024-09-18T01:25:26.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.259+0000 7fa35ca23640 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa230036b40 0x7fa230039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.259+0000 7fa35ca23640 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa230036b40 0x7fa230039000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x5588cadf3980 tx=0x7fa35006b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.259+0000 7fa369531800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.259+0000 7fa369531800 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5588cae20930 0x5588cae22df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.259+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cae23540 con 0x5588cae20930 2024-09-18T01:25:26.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.259+0000 7fa365a25640 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5588cae20930 0x5588cae22df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa365a25640 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5588cae20930 0x5588cae22df0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa369531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa369531800 20 realm 2024-09-18T01:25:26.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa369531800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cae23950 con 0x5588cae20930 2024-09-18T01:25:26.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa369531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa369531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:26.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa369531800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cae24220 con 0x5588cae20930 2024-09-18T01:25:26.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa369531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa369531800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.260+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae20930 2024-09-18T01:25:26.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.261+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.261+0000 7fa369531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.261+0000 7fa369531800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.261+0000 7fa369531800 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5588cae25320 0x5588cae27710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.261+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cae27d20 con 0x5588cae25320 2024-09-18T01:25:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.261+0000 7fa365224640 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5588cae25320 0x5588cae27710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.261+0000 7fa365224640 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5588cae25320 0x5588cae27710 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.261+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.261+0000 7fa369531800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.261+0000 7fa369531800 20 searching for the correct realm 2024-09-18T01:25:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.261+0000 7fa369531800 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5588cae29cd0 0x5588cae2c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.261+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae2c860 con 0x5588cae29cd0 2024-09-18T01:25:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.261+0000 7fa35ca23640 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5588cae29cd0 0x5588cae2c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.262+0000 7fa35ca23640 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5588cae29cd0 0x5588cae2c190 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.262+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.262+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae2c860 con 0x5588cae25320 2024-09-18T01:25:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.262+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.262+0000 7fa365224640 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa358076060 0x7fa35801f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.262+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae2c860 con 0x7fa358076060 2024-09-18T01:25:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.262+0000 7fa365a25640 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa358076060 0x7fa35801f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.263+0000 7fa365a25640 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa358076060 0x7fa35801f140 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.263+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.263+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae20930 2024-09-18T01:25:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.263+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.263+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae20930 2024-09-18T01:25:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.263+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.263+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x7fa358076060 2024-09-18T01:25:26.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.264+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.264+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x7fa358076060 2024-09-18T01:25:26.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.264+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.264+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae25320 2024-09-18T01:25:26.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.264+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.264+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae29cd0 2024-09-18T01:25:26.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.264+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.264+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae20930 2024-09-18T01:25:26.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.265+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.265+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x7fa358076060 2024-09-18T01:25:26.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.265+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.265+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae20930 2024-09-18T01:25:26.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.265+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.265+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae25320 2024-09-18T01:25:26.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.265+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.265+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae29cd0 2024-09-18T01:25:26.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.266+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.266+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae29cd0 2024-09-18T01:25:26.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.266+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.266+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x7fa358076060 2024-09-18T01:25:26.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.266+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.266+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae29cd0 2024-09-18T01:25:26.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.266+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.266+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae29cd0 2024-09-18T01:25:26.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.266+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.267+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae20930 2024-09-18T01:25:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.267+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.267+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae20930 2024-09-18T01:25:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.267+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.267+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x7fa358076060 2024-09-18T01:25:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.267+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.267+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae29cd0 2024-09-18T01:25:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.267+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.267+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae25320 2024-09-18T01:25:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.268+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.268+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae20930 2024-09-18T01:25:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.268+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.268+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x7fa358076060 2024-09-18T01:25:26.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.268+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.268+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae29cd0 2024-09-18T01:25:26.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.268+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.268+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x7fa358076060 2024-09-18T01:25:26.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.269+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.269+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae25320 2024-09-18T01:25:26.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.269+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.269+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae29cd0 2024-09-18T01:25:26.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.269+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.269+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x7fa358076060 2024-09-18T01:25:26.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.269+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.269+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae20930 2024-09-18T01:25:26.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5588cae245c0 con 0x5588cae25320 2024-09-18T01:25:26.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa369531800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:26.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa369531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:26.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa369531800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:26.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa369531800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:26.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa369531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:26.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa369531800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:26.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa369531800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cae285e0 con 0x5588cae20930 2024-09-18T01:25:26.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa369531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa369531800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cae289d0 con 0x5588cae20930 2024-09-18T01:25:26.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa369531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:26.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa369531800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.270+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cae289d0 con 0x7fa358076060 2024-09-18T01:25:26.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:26.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 20 zone default found 2024-09-18T01:25:26.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 4 Realm: () 2024-09-18T01:25:26.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:26.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 20 zonegroup default 2024-09-18T01:25:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cae28220 con 0x7fa358076060 2024-09-18T01:25:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cae2e6c0 con 0x5588cae29cd0 2024-09-18T01:25:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.271+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cae2ea60 con 0x5588cae29cd0 2024-09-18T01:25:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.272+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.272+0000 7fa369531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.272+0000 7fa369531800 20 started sync module instance, tier type = 2024-09-18T01:25:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.272+0000 7fa369531800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.272+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae2db60 con 0x5588cae25320 2024-09-18T01:25:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.273+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.273+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94046007776944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae2ee00 con 0x5588cae25320 2024-09-18T01:25:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.273+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae2f6b0 con 0x5588cae20930 2024-09-18T01:25:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.274+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94046007776944] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.274+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.274+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94046007783840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae2faa0 con 0x5588cae20930 2024-09-18T01:25:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.274+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae304c0 con 0x5588cae29cd0 2024-09-18T01:25:26.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.275+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.275+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94046007787440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae30d60 con 0x5588cae29cd0 2024-09-18T01:25:26.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.275+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae31860 con 0x5588cae25320 2024-09-18T01:25:26.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.275+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94046007783840] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.277+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94046007787440] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.277+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.278+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94046007792464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae31c50 con 0x5588cae25320 2024-09-18T01:25:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.278+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae324a0 con 0x5588cae20930 2024-09-18T01:25:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.279+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.279+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94046007795280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae32930 con 0x5588cae20930 2024-09-18T01:25:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.279+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae33450 con 0x7fa358076060 2024-09-18T01:25:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.279+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94046007792464] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.280+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94046007795280] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.280+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.280+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94046007799584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae33410 con 0x7fa358076060 2024-09-18T01:25:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.280+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae33cf0 con 0x7fa358076060 2024-09-18T01:25:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.281+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94046007799584] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.281+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.281+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94046007779200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae33410 con 0x7fa358076060 2024-09-18T01:25:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.281+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae34310 con 0x7fa358076060 2024-09-18T01:25:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.282+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.282+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94046007779200] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.282+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94046007803488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae34730 con 0x7fa358076060 2024-09-18T01:25:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.282+0000 7fa369531800 20 add_watcher() i=0 2024-09-18T01:25:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.282+0000 7fa369531800 20 add_watcher() i=1 2024-09-18T01:25:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.282+0000 7fa369531800 20 add_watcher() i=2 2024-09-18T01:25:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.282+0000 7fa369531800 20 add_watcher() i=3 2024-09-18T01:25:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.282+0000 7fa369531800 20 add_watcher() i=4 2024-09-18T01:25:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.282+0000 7fa369531800 20 add_watcher() i=5 2024-09-18T01:25:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.282+0000 7fa369531800 20 add_watcher() i=6 2024-09-18T01:25:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.283+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94046007803488] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.283+0000 7fa369531800 20 add_watcher() i=7 2024-09-18T01:25:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.283+0000 7fa369531800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.283+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cae34730 con 0x5588cae20930 2024-09-18T01:25:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.283+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.283+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94046007804544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae34710 con 0x5588cae20930 2024-09-18T01:25:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.284+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94046007804544] v33'42 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.285+0000 7fa21bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.285+0000 7fa369531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.285+0000 7fa369531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.285+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae401b0 con 0x5588cae20930 2024-09-18T01:25:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.286+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'42 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.286+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae40880 con 0x7fa358076060 2024-09-18T01:25:26.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.287+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.287+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae40ca0 con 0x5588cae29cd0 2024-09-18T01:25:26.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.288+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.288+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae415b0 con 0x5588cae20930 2024-09-18T01:25:26.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.289+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'43 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.289+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae419d0 con 0x5588cae25320 2024-09-18T01:25:26.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.290+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.290+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae41b20 con 0x5588cae29cd0 2024-09-18T01:25:26.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.291+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'29 uv16 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.291+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae42130 con 0x5588cae20930 2024-09-18T01:25:26.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.292+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.292+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae425e0 con 0x7fa358076060 2024-09-18T01:25:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.293+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'23 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.293+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae425e0 con 0x5588cae25320 2024-09-18T01:25:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.294+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.294+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae425e0 con 0x5588cae29cd0 2024-09-18T01:25:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.295+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.295+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bed0 con 0x5588cae25320 2024-09-18T01:25:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.296+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.296+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bed0 con 0x7fa358076060 2024-09-18T01:25:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.297+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.297+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bed0 con 0x5588cae25320 2024-09-18T01:25:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.298+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.298+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x7fa358076060 2024-09-18T01:25:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.299+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.299+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae20930 2024-09-18T01:25:26.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.300+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'44 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.300+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae29cd0 2024-09-18T01:25:26.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.301+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.301+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae25320 2024-09-18T01:25:26.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.302+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'34 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.302+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae29cd0 2024-09-18T01:25:26.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.303+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'24 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.303+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae20930 2024-09-18T01:25:26.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.304+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.304+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae20930 2024-09-18T01:25:26.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.305+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'45 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.305+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae29cd0 2024-09-18T01:25:26.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.305+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.305+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae25320 2024-09-18T01:25:26.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.306+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.307+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae29cd0 2024-09-18T01:25:26.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.309+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.309+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae29cd0 2024-09-18T01:25:26.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.310+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'30 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.310+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae29cd0 2024-09-18T01:25:26.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.312+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.312+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae29cd0 2024-09-18T01:25:26.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.313+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.313+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x7fa358076060 2024-09-18T01:25:26.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.314+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.314+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae29cd0 2024-09-18T01:25:26.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.315+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.315+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x7fa358076060 2024-09-18T01:25:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.316+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.316+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae29cd0 2024-09-18T01:25:26.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.317+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.317+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x7fa358076060 2024-09-18T01:25:26.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.318+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'36 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.319+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3bd00 con 0x5588cae25320 2024-09-18T01:25:26.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.320+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.320+0000 7fa21afe5640 20 reqs_thread_entry: start 2024-09-18T01:25:26.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.320+0000 7fa369531800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:26.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.320+0000 7fa369531800 20 Filter name: none 2024-09-18T01:25:26.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.320+0000 7fa218fe1640 20 reqs_thread_entry: start 2024-09-18T01:25:26.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.320+0000 7fa369531800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:25:26.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.320+0000 7fa369531800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.320+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5588cae6dbe0 con 0x7fa358076060 2024-09-18T01:25:26.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.320+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.321+0000 7fa369531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.321+0000 7fa369531800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-18T01:25:26.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.321+0000 7fa369531800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:25:26.322 INFO:teuthology.orchestra.run.smithi100.stderr:could not remove user: unable to remove user, user does not exist 2024-09-18T01:25:26.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.321+0000 7fa21bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:26.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.321+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94046007804544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae3b3b0 con 0x5588cae20930 2024-09-18T01:25:26.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.322+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94046007804544] v33'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.322+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94046007776944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae34280 con 0x5588cae25320 2024-09-18T01:25:26.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.324+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94046007776944] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.324+0000 7fa369531800 20 remove_watcher() i=0 2024-09-18T01:25:26.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.324+0000 7fa369531800 2 removed watcher, disabling cache 2024-09-18T01:25:26.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.324+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94046007783840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae2d6b0 con 0x5588cae20930 2024-09-18T01:25:26.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.325+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94046007783840] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.325+0000 7fa369531800 20 remove_watcher() i=1 2024-09-18T01:25:26.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.325+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94046007787440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae2f1a0 con 0x5588cae29cd0 2024-09-18T01:25:26.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.326+0000 7fa35ca23640 1 -- 172.21.15.100:0/2243730539 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94046007787440] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa350051070 con 0x5588cae29cd0 2024-09-18T01:25:26.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.326+0000 7fa369531800 20 remove_watcher() i=2 2024-09-18T01:25:26.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.326+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94046007792464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae2f1a0 con 0x5588cae25320 2024-09-18T01:25:26.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.327+0000 7fa365224640 1 -- 172.21.15.100:0/2243730539 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94046007792464] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa358073030 con 0x5588cae25320 2024-09-18T01:25:26.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.327+0000 7fa369531800 20 remove_watcher() i=3 2024-09-18T01:25:26.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.327+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94046007795280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae2f1a0 con 0x5588cae20930 2024-09-18T01:25:26.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.330+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94046007795280] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x5588cae20930 2024-09-18T01:25:26.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.330+0000 7fa369531800 20 remove_watcher() i=4 2024-09-18T01:25:26.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.330+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94046007799584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae31e50 con 0x7fa358076060 2024-09-18T01:25:26.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.331+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94046007799584] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.331+0000 7fa369531800 20 remove_watcher() i=5 2024-09-18T01:25:26.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.331+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94046007779200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae2f1a0 con 0x7fa358076060 2024-09-18T01:25:26.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.333+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94046007779200] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.333+0000 7fa369531800 20 remove_watcher() i=6 2024-09-18T01:25:26.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.333+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94046007803488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5588cae31e50 con 0x7fa358076060 2024-09-18T01:25:26.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.333+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94046007803488] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36000a4a0 con 0x7fa358076060 2024-09-18T01:25:26.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.333+0000 7fa369531800 20 remove_watcher() i=7 2024-09-18T01:25:26.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa358076060 msgr2=0x7fa35801f140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa358076060 0x7fa35801f140 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5588cae20930 msgr2=0x5588cae22df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5588cae20930 0x5588cae22df0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5588cae25320 msgr2=0x5588cae27710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5588cae25320 0x5588cae27710 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5588cae29cd0 msgr2=0x5588cae2c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5588cae29cd0 0x5588cae2c190 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa230036b40 msgr2=0x7fa230039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa230036b40 0x7fa230039000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x5588cadf3980 tx=0x7fa35006b040 comp rx=0 tx=0).stop 2024-09-18T01:25:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae0df10 msgr2=0x5588cae151b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 --2- 172.21.15.100:0/2243730539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae0df10 0x5588cae151b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa358001540 tx=0x7fa3580270a0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 reap_dead start 2024-09-18T01:25:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa365a25640 1 -- 172.21.15.100:0/2243730539 reap_dead start 2024-09-18T01:25:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 shutdown_connections 2024-09-18T01:25:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 >> 172.21.15.100:0/2243730539 conn(0x5588cae0a2c0 msgr2=0x5588cae08390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 shutdown_connections 2024-09-18T01:25:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/2243730539 wait complete. 2024-09-18T01:25:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/276109023 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa23c036b40 msgr2=0x7fa23c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 --2- 172.21.15.100:0/276109023 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa23c036b40 0x7fa23c039000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5588cade77e0 tx=0x7fa350005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/276109023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae01330 msgr2=0x5588cae01750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 --2- 172.21.15.100:0/276109023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae01330 0x5588cae01750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa35804b770 tx=0x7fa35801aee0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/276109023 shutdown_connections 2024-09-18T01:25:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 --2- 172.21.15.100:0/276109023 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa23c036b40 0x7fa23c039000 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 --2- 172.21.15.100:0/276109023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cae01330 0x5588cae01750 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/276109023 >> 172.21.15.100:0/276109023 conn(0x5588cadf62c0 msgr2=0x5588cadf8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/276109023 shutdown_connections 2024-09-18T01:25:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.334+0000 7fa369531800 1 -- 172.21.15.100:0/276109023 wait complete. 2024-09-18T01:25:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5588cadf0a90 msgr2=0x5588cadf2e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa369531800 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5588cadf0a90 0x5588cadf2e80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5588cacf0d00 msgr2=0x5588cadea2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa369531800 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5588cacf0d00 0x5588cadea2f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5588cadecba0 msgr2=0x5588cadeef90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa369531800 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5588cadecba0 0x5588cadeef90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa24c036b90 msgr2=0x7fa24c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa369531800 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa24c036b90 0x7fa24c039050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa350057000 tx=0x7fa350052000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cac5ddf0 msgr2=0x5588cade3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa369531800 1 --2- 172.21.15.100:0/1052396216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cac5ddf0 0x5588cade3280 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x5588caddc660 tx=0x7fa358000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa365a25640 1 -- 172.21.15.100:0/1052396216 reap_dead start 2024-09-18T01:25:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 shutdown_connections 2024-09-18T01:25:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 >> 172.21.15.100:0/1052396216 conn(0x5588cace4df0 msgr2=0x5588cadd5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 shutdown_connections 2024-09-18T01:25:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.335+0000 7fa369531800 1 -- 172.21.15.100:0/1052396216 wait complete. 2024-09-18T01:25:26.344 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-18T01:25:26.344 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-18T01:25:26.344 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-18T01:25:26.345 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-18T01:25:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.388+0000 7f15e5d35800 1 Processor -- start 2024-09-18T01:25:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.388+0000 7f15e5d35800 1 -- start start 2024-09-18T01:25:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.388+0000 7f15e5d35800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5555be043570 0x5555be041d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.388+0000 7f15e5d35800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5555bdf8cb30 con 0x5555be043970 2024-09-18T01:25:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.388+0000 7f15e5d35800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5555bdf6e360 con 0x5555be043570 2024-09-18T01:25:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.389+0000 7f15e1a2b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5555be043570 0x5555be041d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.389+0000 7f15dbfff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5555be043970 0x5555be042330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59162/0 (socket says 172.21.15.100:59162) 2024-09-18T01:25:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.389+0000 7f15dbfff640 1 -- 172.21.15.100:0/1380219410 learned_addr learned my addr 172.21.15.100:0/1380219410 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.389+0000 7f15e122a640 1 -- 172.21.15.100:0/1380219410 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3537068052 0 0) 0x5555bdf8cb30 con 0x5555be043970 2024-09-18T01:25:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.389+0000 7f15e122a640 1 -- 172.21.15.100:0/1380219410 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15d0001e10 con 0x5555be043970 2024-09-18T01:25:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.389+0000 7f15e1a2b640 1 -- 172.21.15.100:0/1380219410 >> v1:172.21.15.92:6789/0 conn(0x5555be043970 legacy=0x5555be042330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.389+0000 7f15e1a2b640 1 -- 172.21.15.100:0/1380219410 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555bdf94e00 con 0x5555be043570 2024-09-18T01:25:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.391+0000 7f15e1a2b640 1 --2- 172.21.15.100:0/1380219410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 0x5555be041d50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f15d400a470 tx=0x7f15d4045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0fed082ee63a58 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.391+0000 7f15e122a640 1 -- 172.21.15.100:0/1380219410 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d4059070 con 0x5555be043570 2024-09-18T01:25:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.391+0000 7f15e122a640 1 -- 172.21.15.100:0/1380219410 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d4054570 con 0x5555be043570 2024-09-18T01:25:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.391+0000 7f15e122a640 1 -- 172.21.15.100:0/1380219410 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d4054850 con 0x5555be043570 2024-09-18T01:25:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.391+0000 7f15e5d35800 1 -- 172.21.15.100:0/1380219410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 msgr2=0x5555be041d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.391+0000 7f15e5d35800 1 --2- 172.21.15.100:0/1380219410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 0x5555be041d50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f15d400a470 tx=0x7f15d4045920 comp rx=0 tx=0).stop 2024-09-18T01:25:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.391+0000 7f15e5d35800 1 -- 172.21.15.100:0/1380219410 shutdown_connections 2024-09-18T01:25:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.391+0000 7f15e5d35800 1 --2- 172.21.15.100:0/1380219410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 0x5555be041d50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.391+0000 7f15e5d35800 1 -- 172.21.15.100:0/1380219410 >> 172.21.15.100:0/1380219410 conn(0x5555be0c8ff0 msgr2=0x5555be0cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.391+0000 7f15e5d35800 1 -- 172.21.15.100:0/1380219410 shutdown_connections 2024-09-18T01:25:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.391+0000 7f15e5d35800 1 -- 172.21.15.100:0/1380219410 wait complete. 2024-09-18T01:25:26.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.405+0000 7f15e5d35800 1 Processor -- start 2024-09-18T01:25:26.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.405+0000 7f15e5d35800 1 -- start start 2024-09-18T01:25:26.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.405+0000 7f15e5d35800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 0x5555be1be8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.405+0000 7f15e5d35800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5555be019330 con 0x5555be043570 2024-09-18T01:25:26.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.406+0000 7f15e1a2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 0x5555be1be8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.406+0000 7f15e1a2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 0x5555be1be8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60758/0 (socket says 172.21.15.100:60758) 2024-09-18T01:25:26.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.406+0000 7f15e1a2b640 1 -- 172.21.15.100:0/3181879336 learned_addr learned my addr 172.21.15.100:0/3181879336 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.406+0000 7f15e1a2b640 1 -- 172.21.15.100:0/3181879336 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555bdf66bc0 con 0x5555be043570 2024-09-18T01:25:26.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.406+0000 7f15e1a2b640 1 --2- 172.21.15.100:0/3181879336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 0x5555be1be8a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f15d4025b20 tx=0x7f15d404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc35ba2565ccd42e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.406+0000 7f14cfe07640 1 -- 172.21.15.100:0/3181879336 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d4062070 con 0x5555be043570 2024-09-18T01:25:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.406+0000 7f14cfe07640 1 -- 172.21.15.100:0/3181879336 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d400a230 con 0x5555be043570 2024-09-18T01:25:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.406+0000 7f14cfe07640 1 -- 172.21.15.100:0/3181879336 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d4059040 con 0x5555be043570 2024-09-18T01:25:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.407+0000 7f15e5d35800 1 -- 172.21.15.100:0/3181879336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 msgr2=0x5555be1be8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.407+0000 7f15e5d35800 1 --2- 172.21.15.100:0/3181879336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 0x5555be1be8a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f15d4025b20 tx=0x7f15d404e000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.407+0000 7f15e5d35800 1 -- 172.21.15.100:0/3181879336 shutdown_connections 2024-09-18T01:25:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.407+0000 7f15e5d35800 1 --2- 172.21.15.100:0/3181879336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 0x5555be1be8a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.407+0000 7f15e5d35800 1 -- 172.21.15.100:0/3181879336 >> 172.21.15.100:0/3181879336 conn(0x5555be0c8ff0 msgr2=0x5555be1ba260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.407+0000 7f15e5d35800 1 -- 172.21.15.100:0/3181879336 shutdown_connections 2024-09-18T01:25:26.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.407+0000 7f15e5d35800 1 -- 172.21.15.100:0/3181879336 wait complete. 2024-09-18T01:25:26.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.407+0000 7f15e5d35800 1 Processor -- start 2024-09-18T01:25:26.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.407+0000 7f15e5d35800 1 -- start start 2024-09-18T01:25:26.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.407+0000 7f15e5d35800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 0x5555be1c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.407+0000 7f15e5d35800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5555be0d6990 con 0x5555be043570 2024-09-18T01:25:26.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.407+0000 7f15e1a2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 0x5555be1c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.407+0000 7f15e1a2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 0x5555be1c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60772/0 (socket says 172.21.15.100:60772) 2024-09-18T01:25:26.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.407+0000 7f15e1a2b640 1 -- 172.21.15.100:0/1137991431 learned_addr learned my addr 172.21.15.100:0/1137991431 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.408+0000 7f15e1a2b640 1 -- 172.21.15.100:0/1137991431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555bdf7afe0 con 0x5555be043570 2024-09-18T01:25:26.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.408+0000 7f15e1a2b640 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 0x5555be1c6260 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f15d4045960 tx=0x7f15d4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.408+0000 7f14ce604640 1 -- 172.21.15.100:0/1137991431 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d4062070 con 0x5555be043570 2024-09-18T01:25:26.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.408+0000 7f14ce604640 1 -- 172.21.15.100:0/1137991431 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d4054910 con 0x5555be043570 2024-09-18T01:25:26.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.408+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555be1c67a0 con 0x5555be043570 2024-09-18T01:25:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.408+0000 7f14ce604640 1 -- 172.21.15.100:0/1137991431 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d4059040 con 0x5555be043570 2024-09-18T01:25:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.408+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555be1c6cc0 con 0x5555be043570 2024-09-18T01:25:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.409+0000 7f14ce604640 1 -- 172.21.15.100:0/1137991431 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f15d4065040 con 0x5555be043570 2024-09-18T01:25:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.409+0000 7f14ce604640 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14c8036b90 0x7f14c8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.409+0000 7f14ce604640 1 -- 172.21.15.100:0/1137991431 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f15d408fac0 con 0x5555be043570 2024-09-18T01:25:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.409+0000 7f15dbfff640 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14c8036b90 0x7f14c8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.409+0000 7f15e5d35800 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5555be043970 0x5555be1cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.409+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be1cd810 con 0x5555be043970 2024-09-18T01:25:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.409+0000 7f15e222c640 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5555be043970 0x5555be1cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.410+0000 7f15dbfff640 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14c8036b90 0x7f14c8039050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f15cc000f60 tx=0x7f15cc0010a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.410+0000 7f15e222c640 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5555be043970 0x5555be1cd2d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.410+0000 7f15e222c640 1 -- 172.21.15.100:0/1137991431 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be043970 2024-09-18T01:25:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.410+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be1ca880 con 0x5555be043970 2024-09-18T01:25:26.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.410+0000 7f15e222c640 1 -- 172.21.15.100:0/1137991431 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be043970 2024-09-18T01:25:26.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.410+0000 7f15e5d35800 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5555be1cfae0 0x5555be1d1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.410+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be1d2570 con 0x5555be1cfae0 2024-09-18T01:25:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.410+0000 7f15e1a2b640 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5555be1cfae0 0x5555be1d1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.411+0000 7f15e1a2b640 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5555be1cfae0 0x5555be1d1ed0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.411+0000 7f15e1a2b640 1 -- 172.21.15.100:0/1137991431 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f15d405c040 con 0x5555be1cfae0 2024-09-18T01:25:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.411+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be1ce980 con 0x5555be043970 2024-09-18T01:25:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.411+0000 7f15e222c640 1 -- 172.21.15.100:0/1137991431 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be043970 2024-09-18T01:25:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.411+0000 7f15e5d35800 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5555be1d39d0 0x5555be1d5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.411+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be1d64c0 con 0x5555be1d39d0 2024-09-18T01:25:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.411+0000 7f15dbfff640 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5555be1d39d0 0x5555be1d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.412+0000 7f15dbfff640 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5555be1d39d0 0x5555be1d5dc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.412+0000 7f15dbfff640 1 -- 172.21.15.100:0/1137991431 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f15cc009050 con 0x5555be1d39d0 2024-09-18T01:25:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.412+0000 7f15e5d35800 1 Processor -- start 2024-09-18T01:25:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.412+0000 7f15e5d35800 1 -- start start 2024-09-18T01:25:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.413+0000 7f15e5d35800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1e4270 0x5555be1e4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.413+0000 7f15e5d35800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5555bdf68580 con 0x5555be1e4270 2024-09-18T01:25:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.413+0000 7f15e1a2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1e4270 0x5555be1e4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.413+0000 7f15e1a2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1e4270 0x5555be1e4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60778/0 (socket says 172.21.15.100:60778) 2024-09-18T01:25:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.413+0000 7f15e1a2b640 1 -- 172.21.15.100:0/2405904533 learned_addr learned my addr 172.21.15.100:0/2405904533 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.413+0000 7f15e1a2b640 1 -- 172.21.15.100:0/2405904533 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555be1e4bd0 con 0x5555be1e4270 2024-09-18T01:25:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.413+0000 7f15e1a2b640 1 --2- 172.21.15.100:0/2405904533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1e4270 0x5555be1e4690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f15d4060040 tx=0x7f15d4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.413+0000 7f14c77fe640 1 -- 172.21.15.100:0/2405904533 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d4054bf0 con 0x5555be1e4270 2024-09-18T01:25:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.413+0000 7f14c77fe640 1 -- 172.21.15.100:0/2405904533 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d4054d90 con 0x5555be1e4270 2024-09-18T01:25:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.413+0000 7f15e5d35800 1 -- 172.21.15.100:0/2405904533 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555be1e4e60 con 0x5555be1e4270 2024-09-18T01:25:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.413+0000 7f14c77fe640 1 -- 172.21.15.100:0/2405904533 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d40098c0 con 0x5555be1e4270 2024-09-18T01:25:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.413+0000 7f15e5d35800 1 -- 172.21.15.100:0/2405904533 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555be1e7b40 con 0x5555be1e4270 2024-09-18T01:25:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.414+0000 7f14c77fe640 1 -- 172.21.15.100:0/2405904533 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f15d4056ad0 con 0x5555be1e4270 2024-09-18T01:25:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.414+0000 7f14c77fe640 1 --2- 172.21.15.100:0/2405904533 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14bc036b40 0x7f14bc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.414+0000 7f14c77fe640 1 -- 172.21.15.100:0/2405904533 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f15d4084050 con 0x5555be1e4270 2024-09-18T01:25:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.414+0000 7f15dbfff640 1 --2- 172.21.15.100:0/2405904533 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14bc036b40 0x7f14bc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.415+0000 7f15e5d35800 1 Processor -- start 2024-09-18T01:25:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.415+0000 7f15e5d35800 1 -- start start 2024-09-18T01:25:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.415+0000 7f15dbfff640 1 --2- 172.21.15.100:0/2405904533 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14bc036b40 0x7f14bc039000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00bf90 tx=0x7f15cc00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.415+0000 7f15e5d35800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1f0ce0 0x5555be1f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.415+0000 7f15e5d35800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5555be1bef90 con 0x5555be1f0ce0 2024-09-18T01:25:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.415+0000 7f15e1a2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1f0ce0 0x5555be1f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.415+0000 7f15e1a2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1f0ce0 0x5555be1f10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60794/0 (socket says 172.21.15.100:60794) 2024-09-18T01:25:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.415+0000 7f15e1a2b640 1 -- 172.21.15.100:0/1205038946 learned_addr learned my addr 172.21.15.100:0/1205038946 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.415+0000 7f15e1a2b640 1 -- 172.21.15.100:0/1205038946 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555be1f16b0 con 0x5555be1f0ce0 2024-09-18T01:25:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.415+0000 7f15e1a2b640 1 --2- 172.21.15.100:0/1205038946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1f0ce0 0x5555be1f10e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009dc0 tx=0x7f15d4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4d63327e21e1c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.416+0000 7f14c57fa640 1 -- 172.21.15.100:0/1205038946 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d408c130 con 0x5555be1f0ce0 2024-09-18T01:25:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.416+0000 7f14c57fa640 1 -- 172.21.15.100:0/1205038946 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d40787f0 con 0x5555be1f0ce0 2024-09-18T01:25:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.416+0000 7f14c57fa640 1 -- 172.21.15.100:0/1205038946 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d40910c0 con 0x5555be1f0ce0 2024-09-18T01:25:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.416+0000 7f15e5d35800 1 -- 172.21.15.100:0/1205038946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1f0ce0 msgr2=0x5555be1f10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.416+0000 7f15e5d35800 1 --2- 172.21.15.100:0/1205038946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1f0ce0 0x5555be1f10e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009dc0 tx=0x7f15d4009b60 comp rx=0 tx=0).stop 2024-09-18T01:25:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.416+0000 7f15e5d35800 1 -- 172.21.15.100:0/1205038946 shutdown_connections 2024-09-18T01:25:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.416+0000 7f15e5d35800 1 --2- 172.21.15.100:0/1205038946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1f0ce0 0x5555be1f10e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.416+0000 7f15e5d35800 1 -- 172.21.15.100:0/1205038946 >> 172.21.15.100:0/1205038946 conn(0x5555be1ed090 msgr2=0x5555be1eb190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.416+0000 7f15e5d35800 1 -- 172.21.15.100:0/1205038946 shutdown_connections 2024-09-18T01:25:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.416+0000 7f15e5d35800 1 -- 172.21.15.100:0/1205038946 wait complete. 2024-09-18T01:25:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.416+0000 7f15e5d35800 1 Processor -- start 2024-09-18T01:25:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.416+0000 7f15e5d35800 1 -- start start 2024-09-18T01:25:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.417+0000 7f15e5d35800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1f0ce0 0x5555be1f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.417+0000 7f15e5d35800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5555be1f1b40 con 0x5555be1f0ce0 2024-09-18T01:25:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.417+0000 7f15e1a2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1f0ce0 0x5555be1f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.417+0000 7f15e1a2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1f0ce0 0x5555be1f7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60798/0 (socket says 172.21.15.100:60798) 2024-09-18T01:25:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.417+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 learned_addr learned my addr 172.21.15.100:0/583829164 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.417+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555be1f84e0 con 0x5555be1f0ce0 2024-09-18T01:25:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.417+0000 7f15e1a2b640 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1f0ce0 0x5555be1f7fa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009dc0 tx=0x7f15d4086ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.417+0000 7f14b37fe640 1 -- 172.21.15.100:0/583829164 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d40b1040 con 0x5555be1f0ce0 2024-09-18T01:25:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.417+0000 7f14b37fe640 1 -- 172.21.15.100:0/583829164 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d406c680 con 0x5555be1f0ce0 2024-09-18T01:25:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.417+0000 7f14b37fe640 1 -- 172.21.15.100:0/583829164 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d4056080 con 0x5555be1f0ce0 2024-09-18T01:25:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.417+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555be1f84e0 con 0x5555be1f0ce0 2024-09-18T01:25:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.417+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555be1f84e0 con 0x5555be1f0ce0 2024-09-18T01:25:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.418+0000 7f14b37fe640 1 -- 172.21.15.100:0/583829164 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f15d40aa020 con 0x5555be1f0ce0 2024-09-18T01:25:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.418+0000 7f14b37fe640 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14ac036af0 0x7f14ac038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.418+0000 7f14b37fe640 1 -- 172.21.15.100:0/583829164 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f15d40738a0 con 0x5555be1f0ce0 2024-09-18T01:25:26.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.418+0000 7f15dbfff640 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14ac036af0 0x7f14ac038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.419+0000 7f15dbfff640 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14ac036af0 0x7f14ac038fb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x5555be1ca7c0 tx=0x7f15cc010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.419+0000 7f15e5d35800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.419+0000 7f15e5d35800 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5555be203700 0x5555be205bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.419+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be206310 con 0x5555be203700 2024-09-18T01:25:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.419+0000 7f15e222c640 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5555be203700 0x5555be205bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.419+0000 7f15e222c640 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5555be203700 0x5555be205bc0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 20 realm 2024-09-18T01:25:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be206720 con 0x5555be203700 2024-09-18T01:25:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be206ff0 con 0x5555be203700 2024-09-18T01:25:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be203700 2024-09-18T01:25:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5555be2080f0 0x5555be20a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.420+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be20aaf0 con 0x5555be2080f0 2024-09-18T01:25:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.421+0000 7f15e1a2b640 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5555be2080f0 0x5555be20a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.421+0000 7f15e1a2b640 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5555be2080f0 0x5555be20a4e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.421+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.421+0000 7f15e5d35800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.421+0000 7f15e5d35800 20 searching for the correct realm 2024-09-18T01:25:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.421+0000 7f15e5d35800 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5555be20caa0 0x5555be20ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.421+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be20f630 con 0x5555be20caa0 2024-09-18T01:25:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.421+0000 7f15dbfff640 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5555be20caa0 0x5555be20ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.422+0000 7f15dbfff640 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5555be20caa0 0x5555be20ef60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.422+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.422+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be20f630 con 0x5555be2080f0 2024-09-18T01:25:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.422+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.422+0000 7f15e1a2b640 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f15d40b7030 0x7f15d40b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.422+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be20f630 con 0x7f15d40b7030 2024-09-18T01:25:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.422+0000 7f15e222c640 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f15d40b7030 0x7f15d40b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.423+0000 7f15e222c640 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f15d40b7030 0x7f15d40b63b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.423+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.423+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be203700 2024-09-18T01:25:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.423+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.423+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be203700 2024-09-18T01:25:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.423+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.423+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x7f15d40b7030 2024-09-18T01:25:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.424+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.424+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x7f15d40b7030 2024-09-18T01:25:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.424+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.424+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be2080f0 2024-09-18T01:25:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.424+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.424+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be20caa0 2024-09-18T01:25:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.424+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.424+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be203700 2024-09-18T01:25:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.425+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.425+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x7f15d40b7030 2024-09-18T01:25:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.425+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.425+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be203700 2024-09-18T01:25:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.425+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.425+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be2080f0 2024-09-18T01:25:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.425+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.425+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be20caa0 2024-09-18T01:25:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.426+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.426+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be20caa0 2024-09-18T01:25:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.426+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.426+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x7f15d40b7030 2024-09-18T01:25:26.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.426+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.426+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be20caa0 2024-09-18T01:25:26.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.426+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.426+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be20caa0 2024-09-18T01:25:26.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.426+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.426+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be203700 2024-09-18T01:25:26.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.427+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.427+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be203700 2024-09-18T01:25:26.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.427+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.427+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x7f15d40b7030 2024-09-18T01:25:26.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.427+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.427+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be20caa0 2024-09-18T01:25:26.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.427+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.427+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be2080f0 2024-09-18T01:25:26.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.428+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.428+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be203700 2024-09-18T01:25:26.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.428+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.428+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x7f15d40b7030 2024-09-18T01:25:26.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.428+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.428+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be20caa0 2024-09-18T01:25:26.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.428+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.429+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x7f15d40b7030 2024-09-18T01:25:26.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.429+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.429+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be2080f0 2024-09-18T01:25:26.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.429+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.429+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be20caa0 2024-09-18T01:25:26.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.429+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.429+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x7f15d40b7030 2024-09-18T01:25:26.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be203700 2024-09-18T01:25:26.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555be207390 con 0x5555be2080f0 2024-09-18T01:25:26.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e5d35800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e5d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e5d35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e5d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e5d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e5d35800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e5d35800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be20b3b0 con 0x5555be203700 2024-09-18T01:25:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e5d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e5d35800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.430+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be20b7a0 con 0x5555be203700 2024-09-18T01:25:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be20b7a0 con 0x7f15d40b7030 2024-09-18T01:25:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 20 zone default found 2024-09-18T01:25:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 4 Realm: () 2024-09-18T01:25:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 20 zonegroup default 2024-09-18T01:25:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be20fab0 con 0x7f15d40b7030 2024-09-18T01:25:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.431+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be211490 con 0x5555be20caa0 2024-09-18T01:25:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.432+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.432+0000 7f15e5d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.432+0000 7f15e5d35800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.432+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be211830 con 0x5555be20caa0 2024-09-18T01:25:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.432+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.432+0000 7f15e5d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.432+0000 7f15e5d35800 20 started sync module instance, tier type = 2024-09-18T01:25:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.432+0000 7f15e5d35800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:26.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.432+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be210930 con 0x5555be2080f0 2024-09-18T01:25:26.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.433+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.433+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93826750418208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be212080 con 0x5555be2080f0 2024-09-18T01:25:26.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.433+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be2128d0 con 0x5555be203700 2024-09-18T01:25:26.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.434+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93826750418208] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.434+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.434+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93826750421968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be2128d0 con 0x5555be203700 2024-09-18T01:25:26.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.434+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be213370 con 0x5555be20caa0 2024-09-18T01:25:26.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.435+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93826750421968] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.435+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.435+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93826750424096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be212840 con 0x5555be20caa0 2024-09-18T01:25:26.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.435+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be214230 con 0x5555be2080f0 2024-09-18T01:25:26.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.436+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93826750424096] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.438+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.438+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93826750430592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be214650 con 0x5555be2080f0 2024-09-18T01:25:26.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.438+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be215010 con 0x5555be203700 2024-09-18T01:25:26.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.440+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.440+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93826750434144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be215430 con 0x5555be203700 2024-09-18T01:25:26.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.440+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be215f10 con 0x7f15d40b7030 2024-09-18T01:25:26.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.441+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.442+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93826750437920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be215f10 con 0x7f15d40b7030 2024-09-18T01:25:26.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.442+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be216e70 con 0x7f15d40b7030 2024-09-18T01:25:26.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.443+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93826750430592] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.444+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.444+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93826750431648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be216e70 con 0x7f15d40b7030 2024-09-18T01:25:26.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.444+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be217870 con 0x7f15d40b7030 2024-09-18T01:25:26.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.446+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93826750434144] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.447+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93826750437920] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.447+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.447+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93826750440192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be217380 con 0x7f15d40b7030 2024-09-18T01:25:26.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.447+0000 7f15e5d35800 20 add_watcher() i=0 2024-09-18T01:25:26.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.447+0000 7f15e5d35800 20 add_watcher() i=1 2024-09-18T01:25:26.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.447+0000 7f15e5d35800 20 add_watcher() i=2 2024-09-18T01:25:26.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.447+0000 7f15e5d35800 20 add_watcher() i=3 2024-09-18T01:25:26.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.447+0000 7f15e5d35800 20 add_watcher() i=4 2024-09-18T01:25:26.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.447+0000 7f15e5d35800 20 add_watcher() i=5 2024-09-18T01:25:26.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.447+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93826750431648] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.447+0000 7f15e5d35800 20 add_watcher() i=6 2024-09-18T01:25:26.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.448+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93826750440192] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.448+0000 7f15e5d35800 20 add_watcher() i=7 2024-09-18T01:25:26.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.448+0000 7f15e5d35800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:26.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.448+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be21a3b0 con 0x5555be203700 2024-09-18T01:25:26.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.448+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.448+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93826750441808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be217830 con 0x5555be203700 2024-09-18T01:25:26.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.450+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93826750441808] v33'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.450+0000 7f1493fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:26.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.450+0000 7f15e5d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:26.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.450+0000 7f15e5d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:26.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.450+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be222c70 con 0x5555be203700 2024-09-18T01:25:26.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.452+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'43 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.452+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be2232c0 con 0x7f15d40b7030 2024-09-18T01:25:26.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.453+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.453+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be223720 con 0x5555be20caa0 2024-09-18T01:25:26.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.454+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.454+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be224140 con 0x5555be203700 2024-09-18T01:25:26.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.457+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'48 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.457+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be21e9d0 con 0x5555be2080f0 2024-09-18T01:25:26.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.458+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.458+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be21e9a0 con 0x5555be20caa0 2024-09-18T01:25:26.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.460+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'31 uv16 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.460+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225150 con 0x5555be203700 2024-09-18T01:25:26.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.462+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.462+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225150 con 0x7f15d40b7030 2024-09-18T01:25:26.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.464+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.464+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225150 con 0x5555be2080f0 2024-09-18T01:25:26.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.465+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.465+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225320 con 0x5555be20caa0 2024-09-18T01:25:26.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.467+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.467+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225950 con 0x5555be2080f0 2024-09-18T01:25:26.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.468+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'36 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.468+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225950 con 0x7f15d40b7030 2024-09-18T01:25:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.470+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.470+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225950 con 0x5555be2080f0 2024-09-18T01:25:26.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.471+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.471+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225d10 con 0x7f15d40b7030 2024-09-18T01:25:26.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.472+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'37 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.472+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225d10 con 0x5555be203700 2024-09-18T01:25:26.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.473+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'49 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.473+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225950 con 0x5555be20caa0 2024-09-18T01:25:26.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.474+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'29 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.474+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225810 con 0x5555be2080f0 2024-09-18T01:25:26.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.475+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'37 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.475+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225810 con 0x5555be20caa0 2024-09-18T01:25:26.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.476+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'25 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.476+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225810 con 0x5555be203700 2024-09-18T01:25:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.477+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.477+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225f30 con 0x5555be203700 2024-09-18T01:25:26.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.478+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'50 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.478+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225f30 con 0x5555be20caa0 2024-09-18T01:25:26.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.479+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.479+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225f30 con 0x5555be2080f0 2024-09-18T01:25:26.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.480+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'29 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.480+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225d60 con 0x5555be20caa0 2024-09-18T01:25:26.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.481+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.481+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225d60 con 0x5555be20caa0 2024-09-18T01:25:26.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.484+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'31 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.484+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225d60 con 0x5555be20caa0 2024-09-18T01:25:26.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.485+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.485+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225f30 con 0x5555be20caa0 2024-09-18T01:25:26.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.486+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.486+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225f30 con 0x7f15d40b7030 2024-09-18T01:25:26.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.487+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.487+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225f30 con 0x5555be20caa0 2024-09-18T01:25:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.488+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.488+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225f30 con 0x7f15d40b7030 2024-09-18T01:25:26.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.489+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.489+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225f30 con 0x5555be20caa0 2024-09-18T01:25:26.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.490+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.490+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225f30 con 0x7f15d40b7030 2024-09-18T01:25:26.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.491+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'38 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.491+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be225f30 con 0x5555be2080f0 2024-09-18T01:25:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.492+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.492+0000 7f1492ffd640 20 reqs_thread_entry: start 2024-09-18T01:25:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.492+0000 7f15e5d35800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.492+0000 7f15e5d35800 20 Filter name: none 2024-09-18T01:25:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.492+0000 7f1490ff9640 20 reqs_thread_entry: start 2024-09-18T01:25:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.492+0000 7f15e5d35800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.492+0000 7f15e5d35800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.493+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555be250c40 con 0x5555be203700 2024-09-18T01:25:26.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.493+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.493+0000 7f15e5d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.493+0000 7f15e5d35800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-18T01:25:26.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.493+0000 7f15e5d35800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:26.495 INFO:teuthology.orchestra.run.smithi100.stderr:could not remove user: unable to remove user, user does not exist 2024-09-18T01:25:26.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.494+0000 7f1493fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:26.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.494+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93826750441808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be224140 con 0x5555be203700 2024-09-18T01:25:26.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.494+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93826750441808] v33'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.494+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93826750418208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be216950 con 0x5555be2080f0 2024-09-18T01:25:26.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.495+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93826750418208] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.495+0000 7f15e5d35800 20 remove_watcher() i=0 2024-09-18T01:25:26.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.495+0000 7f15e5d35800 2 removed watcher, disabling cache 2024-09-18T01:25:26.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.495+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93826750421968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be210d20 con 0x5555be203700 2024-09-18T01:25:26.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.496+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93826750421968] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.496+0000 7f15e5d35800 20 remove_watcher() i=1 2024-09-18T01:25:26.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.496+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93826750424096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be210d20 con 0x5555be20caa0 2024-09-18T01:25:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.498+0000 7f15dbfff640 1 -- 172.21.15.100:0/583829164 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93826750424096] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15cc009050 con 0x5555be20caa0 2024-09-18T01:25:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.498+0000 7f15e5d35800 20 remove_watcher() i=2 2024-09-18T01:25:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.498+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93826750430592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be212420 con 0x5555be2080f0 2024-09-18T01:25:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.499+0000 7f15e1a2b640 1 -- 172.21.15.100:0/583829164 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93826750430592] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d405c040 con 0x5555be2080f0 2024-09-18T01:25:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.499+0000 7f15e5d35800 20 remove_watcher() i=3 2024-09-18T01:25:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.499+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93826750434144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be213d80 con 0x5555be203700 2024-09-18T01:25:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.501+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93826750434144] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x5555be203700 2024-09-18T01:25:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.501+0000 7f15e5d35800 20 remove_watcher() i=4 2024-09-18T01:25:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.501+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93826750437920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be212420 con 0x7f15d40b7030 2024-09-18T01:25:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.502+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93826750437920] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.502+0000 7f15e5d35800 20 remove_watcher() i=5 2024-09-18T01:25:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.502+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93826750431648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be214b60 con 0x7f15d40b7030 2024-09-18T01:25:26.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.503+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93826750431648] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.503+0000 7f15e5d35800 20 remove_watcher() i=6 2024-09-18T01:25:26.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.503+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93826750440192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555be214230 con 0x7f15d40b7030 2024-09-18T01:25:26.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93826750440192] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15dc00a4a0 con 0x7f15d40b7030 2024-09-18T01:25:26.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 20 remove_watcher() i=7 2024-09-18T01:25:26.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f15d40b7030 msgr2=0x7f15d40b63b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f15d40b7030 0x7f15d40b63b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5555be203700 msgr2=0x5555be205bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5555be203700 0x5555be205bc0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5555be2080f0 msgr2=0x5555be20a4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5555be2080f0 0x5555be20a4e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5555be20caa0 msgr2=0x5555be20ef60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5555be20caa0 0x5555be20ef60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14ac036af0 msgr2=0x7f14ac038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14ac036af0 0x7f14ac038fb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x5555be1ca7c0 tx=0x7f15cc010000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1f0ce0 msgr2=0x5555be1f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 --2- 172.21.15.100:0/583829164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1f0ce0 0x5555be1f7fa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009dc0 tx=0x7f15d4086ea0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e222c640 1 -- 172.21.15.100:0/583829164 reap_dead start 2024-09-18T01:25:26.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 shutdown_connections 2024-09-18T01:25:26.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 >> 172.21.15.100:0/583829164 conn(0x5555be1ed090 msgr2=0x5555be1eb160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 shutdown_connections 2024-09-18T01:25:26.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 -- 172.21.15.100:0/583829164 wait complete. 2024-09-18T01:25:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 -- 172.21.15.100:0/2405904533 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14bc036b40 msgr2=0x7f14bc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 --2- 172.21.15.100:0/2405904533 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14bc036b40 0x7f14bc039000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00bf90 tx=0x7f15cc00f000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 -- 172.21.15.100:0/2405904533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1e4270 msgr2=0x5555be1e4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 --2- 172.21.15.100:0/2405904533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1e4270 0x5555be1e4690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f15d4060040 tx=0x7f15d4009f90 comp rx=0 tx=0).stop 2024-09-18T01:25:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 -- 172.21.15.100:0/2405904533 shutdown_connections 2024-09-18T01:25:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 --2- 172.21.15.100:0/2405904533 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14bc036b40 0x7f14bc039000 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 --2- 172.21.15.100:0/2405904533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be1e4270 0x5555be1e4690 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.504+0000 7f15e5d35800 1 -- 172.21.15.100:0/2405904533 >> 172.21.15.100:0/2405904533 conn(0x5555be1d9200 msgr2=0x5555be1dbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 -- 172.21.15.100:0/2405904533 shutdown_connections 2024-09-18T01:25:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 -- 172.21.15.100:0/2405904533 wait complete. 2024-09-18T01:25:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5555be1d39d0 msgr2=0x5555be1d5dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5555be1d39d0 0x5555be1d5dc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5555be043970 msgr2=0x5555be1cd2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5555be043970 0x5555be1cd2d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5555be1cfae0 msgr2=0x5555be1d1ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5555be1cfae0 0x5555be1d1ed0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14c8036b90 msgr2=0x7f14c8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14c8036b90 0x7f14c8039050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f15cc000f60 tx=0x7f15cc0010a0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 msgr2=0x5555be1c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 --2- 172.21.15.100:0/1137991431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555be043570 0x5555be1c6260 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f15d4045960 tx=0x7f15d4002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e222c640 1 -- 172.21.15.100:0/1137991431 reap_dead start 2024-09-18T01:25:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 shutdown_connections 2024-09-18T01:25:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 >> 172.21.15.100:0/1137991431 conn(0x5555be0c8ff0 msgr2=0x5555be1b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 shutdown_connections 2024-09-18T01:25:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.505+0000 7f15e5d35800 1 -- 172.21.15.100:0/1137991431 wait complete. 2024-09-18T01:25:26.514 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-18T01:25:26.515 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-18T01:25:26.515 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-18T01:25:26.515 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-18T01:25:26.601 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:26.601 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.601+0000 7f900ef08800 1 Processor -- start 2024-09-18T01:25:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.601+0000 7f900ef08800 1 -- start start 2024-09-18T01:25:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.601+0000 7f900ef08800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55a316e4fa20 0x55a316e51e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.601+0000 7f900ef08800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a316d0bb30 con 0x55a316e4b5e0 2024-09-18T01:25:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.601+0000 7f900ef08800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55a316ced360 con 0x55a316e4fa20 2024-09-18T01:25:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.602+0000 7f900c1fb640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55a316e4fa20 0x55a316e51e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.602+0000 7f900c9fc640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55a316e4b5e0 0x55a316e4b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59176/0 (socket says 172.21.15.100:59176) 2024-09-18T01:25:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.602+0000 7f900c9fc640 1 -- 172.21.15.100:0/2964472328 learned_addr learned my addr 172.21.15.100:0/2964472328 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.602+0000 7f900c1fb640 1 -- 172.21.15.100:0/2964472328 >> v1:172.21.15.92:6789/0 conn(0x55a316e4b5e0 legacy=0x55a316e4b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.602+0000 7f900c1fb640 1 -- 172.21.15.100:0/2964472328 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a316d13e00 con 0x55a316e4fa20 2024-09-18T01:25:26.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.604+0000 7f900c1fb640 1 --2- 172.21.15.100:0/2964472328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4fa20 0x55a316e51e10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f900000a470 tx=0x7f9000045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e0d31e9708f9ad server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.604+0000 7f900b9fa640 1 -- 172.21.15.100:0/2964472328 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9000053570 con 0x55a316e4fa20 2024-09-18T01:25:26.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.604+0000 7f900b9fa640 1 -- 172.21.15.100:0/2964472328 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9000058070 con 0x55a316e4fa20 2024-09-18T01:25:26.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.604+0000 7f900b9fa640 1 -- 172.21.15.100:0/2964472328 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9000053880 con 0x55a316e4fa20 2024-09-18T01:25:26.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.604+0000 7f900ef08800 1 -- 172.21.15.100:0/2964472328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4fa20 msgr2=0x55a316e51e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.604+0000 7f900ef08800 1 --2- 172.21.15.100:0/2964472328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4fa20 0x55a316e51e10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f900000a470 tx=0x7f9000045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:26.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.604+0000 7f900ef08800 1 -- 172.21.15.100:0/2964472328 shutdown_connections 2024-09-18T01:25:26.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.604+0000 7f900ef08800 1 --2- 172.21.15.100:0/2964472328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4fa20 0x55a316e51e10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.604+0000 7f900ef08800 1 -- 172.21.15.100:0/2964472328 >> 172.21.15.100:0/2964472328 conn(0x55a316e46e90 msgr2=0x55a316e492b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.604+0000 7f900ef08800 1 -- 172.21.15.100:0/2964472328 shutdown_connections 2024-09-18T01:25:26.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.604+0000 7f900ef08800 1 -- 172.21.15.100:0/2964472328 wait complete. 2024-09-18T01:25:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.618+0000 7f900ef08800 1 Processor -- start 2024-09-18T01:25:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.618+0000 7f900ef08800 1 -- start start 2024-09-18T01:25:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.618+0000 7f900ef08800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4b5e0 0x55a316f3a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.618+0000 7f900ef08800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a316d98350 con 0x55a316e4b5e0 2024-09-18T01:25:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.619+0000 7f900c9fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4b5e0 0x55a316f3a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.619+0000 7f900c9fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4b5e0 0x55a316f3a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60826/0 (socket says 172.21.15.100:60826) 2024-09-18T01:25:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.619+0000 7f900c9fc640 1 -- 172.21.15.100:0/6589104 learned_addr learned my addr 172.21.15.100:0/6589104 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.619+0000 7f900c9fc640 1 -- 172.21.15.100:0/6589104 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a316ce5bc0 con 0x55a316e4b5e0 2024-09-18T01:25:26.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.619+0000 7f900c9fc640 1 --2- 172.21.15.100:0/6589104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4b5e0 0x55a316f3a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0017a0 tx=0x7f8ffc001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc9de109cfd5696 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.619+0000 7f8efae0d640 1 -- 172.21.15.100:0/6589104 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ffc016070 con 0x55a316e4b5e0 2024-09-18T01:25:26.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.619+0000 7f8efae0d640 1 -- 172.21.15.100:0/6589104 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ffc004520 con 0x55a316e4b5e0 2024-09-18T01:25:26.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.619+0000 7f8efae0d640 1 -- 172.21.15.100:0/6589104 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ffc004820 con 0x55a316e4b5e0 2024-09-18T01:25:26.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.620+0000 7f900ef08800 1 -- 172.21.15.100:0/6589104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4b5e0 msgr2=0x55a316f3a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.620+0000 7f900ef08800 1 --2- 172.21.15.100:0/6589104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4b5e0 0x55a316f3a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0017a0 tx=0x7f8ffc001c60 comp rx=0 tx=0).stop 2024-09-18T01:25:26.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.620+0000 7f900ef08800 1 -- 172.21.15.100:0/6589104 shutdown_connections 2024-09-18T01:25:26.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.620+0000 7f900ef08800 1 --2- 172.21.15.100:0/6589104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4b5e0 0x55a316f3a840 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.620+0000 7f900ef08800 1 -- 172.21.15.100:0/6589104 >> 172.21.15.100:0/6589104 conn(0x55a316e46e90 msgr2=0x55a316f36200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.620+0000 7f900ef08800 1 -- 172.21.15.100:0/6589104 shutdown_connections 2024-09-18T01:25:26.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.620+0000 7f900ef08800 1 -- 172.21.15.100:0/6589104 wait complete. 2024-09-18T01:25:26.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.620+0000 7f900ef08800 1 Processor -- start 2024-09-18T01:25:26.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.621+0000 7f900ef08800 1 -- start start 2024-09-18T01:25:26.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.621+0000 7f900ef08800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4b5e0 0x55a316dc06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.621+0000 7f900ef08800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a316e52650 con 0x55a316e4b5e0 2024-09-18T01:25:26.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.621+0000 7f900c9fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4b5e0 0x55a316dc06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.621+0000 7f900c9fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4b5e0 0x55a316dc06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60834/0 (socket says 172.21.15.100:60834) 2024-09-18T01:25:26.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.621+0000 7f900c9fc640 1 -- 172.21.15.100:0/1110817389 learned_addr learned my addr 172.21.15.100:0/1110817389 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.621+0000 7f900c9fc640 1 -- 172.21.15.100:0/1110817389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a316cf9fe0 con 0x55a316e4b5e0 2024-09-18T01:25:26.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.621+0000 7f900c9fc640 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4b5e0 0x55a316dc06f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc000f80 tx=0x7f8ffc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.621+0000 7f8ef960a640 1 -- 172.21.15.100:0/1110817389 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ffc016040 con 0x55a316e4b5e0 2024-09-18T01:25:26.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.621+0000 7f8ef960a640 1 -- 172.21.15.100:0/1110817389 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ffc011530 con 0x55a316e4b5e0 2024-09-18T01:25:26.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.621+0000 7f900ef08800 1 -- 172.21.15.100:0/1110817389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a316f45fe0 con 0x55a316e4b5e0 2024-09-18T01:25:26.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.621+0000 7f8ef960a640 1 -- 172.21.15.100:0/1110817389 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ffc011890 con 0x55a316e4b5e0 2024-09-18T01:25:26.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.622+0000 7f900ef08800 1 -- 172.21.15.100:0/1110817389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a316f46560 con 0x55a316e4b5e0 2024-09-18T01:25:26.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.622+0000 7f900ef08800 1 Processor -- start 2024-09-18T01:25:26.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.622+0000 7f900ef08800 1 -- start start 2024-09-18T01:25:26.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.622+0000 7f900ef08800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f50140 0x55a316f50540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.622+0000 7f900ef08800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a316ce7580 con 0x55a316f50140 2024-09-18T01:25:26.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.622+0000 7f8ef960a640 1 -- 172.21.15.100:0/1110817389 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8ffc01c3f0 con 0x55a316e4b5e0 2024-09-18T01:25:26.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.622+0000 7f8ef960a640 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ef4036b90 0x7f8ef4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.623+0000 7f900d1fd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f50140 0x55a316f50540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.623+0000 7f8ef960a640 1 -- 172.21.15.100:0/1110817389 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8ffc04bbc0 con 0x55a316e4b5e0 2024-09-18T01:25:26.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.623+0000 7f900d1fd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f50140 0x55a316f50540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60840/0 (socket says 172.21.15.100:60840) 2024-09-18T01:25:26.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.623+0000 7f900d1fd640 1 -- 172.21.15.100:0/1152588942 learned_addr learned my addr 172.21.15.100:0/1152588942 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.623+0000 7f900c9fc640 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ef4036b90 0x7f8ef4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.623+0000 7f900d1fd640 1 -- 172.21.15.100:0/1152588942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a316f50a80 con 0x55a316f50140 2024-09-18T01:25:26.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.623+0000 7f900c9fc640 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ef4036b90 0x7f8ef4039050 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc019a40 tx=0x7f8ffc0198d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.623+0000 7f900d1fd640 1 --2- 172.21.15.100:0/1152588942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f50140 0x55a316f50540 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f900400a400 tx=0x7f900400a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2426f5f06359918 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.623+0000 7f8ef2ffd640 1 -- 172.21.15.100:0/1152588942 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90040087e0 con 0x55a316f50140 2024-09-18T01:25:26.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.623+0000 7f8ef2ffd640 1 -- 172.21.15.100:0/1152588942 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90040089a0 con 0x55a316f50140 2024-09-18T01:25:26.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.623+0000 7f8ef2ffd640 1 -- 172.21.15.100:0/1152588942 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9004008d00 con 0x55a316f50140 2024-09-18T01:25:26.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.624+0000 7f900ef08800 1 -- 172.21.15.100:0/1152588942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f50140 msgr2=0x55a316f50540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.624+0000 7f900ef08800 1 --2- 172.21.15.100:0/1152588942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f50140 0x55a316f50540 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f900400a400 tx=0x7f900400a8c0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.624+0000 7f900ef08800 1 -- 172.21.15.100:0/1152588942 shutdown_connections 2024-09-18T01:25:26.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.624+0000 7f900ef08800 1 --2- 172.21.15.100:0/1152588942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f50140 0x55a316f50540 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.624+0000 7f900ef08800 1 -- 172.21.15.100:0/1152588942 >> 172.21.15.100:0/1152588942 conn(0x55a316e4fa20 msgr2=0x55a316f4b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.624+0000 7f900ef08800 1 -- 172.21.15.100:0/1152588942 shutdown_connections 2024-09-18T01:25:26.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.624+0000 7f900ef08800 1 -- 172.21.15.100:0/1152588942 wait complete. 2024-09-18T01:25:26.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.624+0000 7f900ef08800 1 Processor -- start 2024-09-18T01:25:26.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.624+0000 7f900ef08800 1 -- start start 2024-09-18T01:25:26.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.624+0000 7f900ef08800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f50140 0x55a316f576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.624+0000 7f900ef08800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a316f51430 con 0x55a316f50140 2024-09-18T01:25:26.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.624+0000 7f900d1fd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f50140 0x55a316f576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.624+0000 7f900d1fd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f50140 0x55a316f576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60852/0 (socket says 172.21.15.100:60852) 2024-09-18T01:25:26.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.624+0000 7f900d1fd640 1 -- 172.21.15.100:0/1265093813 learned_addr learned my addr 172.21.15.100:0/1265093813 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.625+0000 7f900d1fd640 1 -- 172.21.15.100:0/1265093813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a316f57c20 con 0x55a316f50140 2024-09-18T01:25:26.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.625+0000 7f900d1fd640 1 --2- 172.21.15.100:0/1265093813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f50140 0x55a316f576e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f900400c010 tx=0x7f9004002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.625+0000 7f8ef17fa640 1 -- 172.21.15.100:0/1265093813 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9004022020 con 0x55a316f50140 2024-09-18T01:25:26.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.625+0000 7f8ef17fa640 1 -- 172.21.15.100:0/1265093813 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9004019040 con 0x55a316f50140 2024-09-18T01:25:26.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.625+0000 7f900ef08800 1 -- 172.21.15.100:0/1265093813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a316f57eb0 con 0x55a316f50140 2024-09-18T01:25:26.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.625+0000 7f8ef17fa640 1 -- 172.21.15.100:0/1265093813 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9004013a70 con 0x55a316f50140 2024-09-18T01:25:26.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.625+0000 7f900ef08800 1 -- 172.21.15.100:0/1265093813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a316f5ab60 con 0x55a316f50140 2024-09-18T01:25:26.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.626+0000 7f8ef17fa640 1 -- 172.21.15.100:0/1265093813 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9004025020 con 0x55a316f50140 2024-09-18T01:25:26.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.626+0000 7f8ef17fa640 1 --2- 172.21.15.100:0/1265093813 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ee4036b40 0x7f8ee4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.626+0000 7f8ef17fa640 1 -- 172.21.15.100:0/1265093813 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f900404c770 con 0x55a316f50140 2024-09-18T01:25:26.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.626+0000 7f900c1fb640 1 --2- 172.21.15.100:0/1265093813 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ee4036b40 0x7f8ee4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.626+0000 7f900ef08800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:26.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.626+0000 7f900ef08800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:26.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.627+0000 7f900c1fb640 1 --2- 172.21.15.100:0/1265093813 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ee4036b40 0x7f8ee4039000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9000057000 tx=0x7f9000052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.627+0000 7f900ef08800 1 Processor -- start 2024-09-18T01:25:26.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.627+0000 7f900ef08800 1 -- start start 2024-09-18T01:25:26.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.627+0000 7f900ef08800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f71650 0x55a316f71a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.627+0000 7f900ef08800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a316f3aff0 con 0x55a316f71650 2024-09-18T01:25:26.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.627+0000 7f900c9fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f71650 0x55a316f71a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.627+0000 7f900c9fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f71650 0x55a316f71a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60858/0 (socket says 172.21.15.100:60858) 2024-09-18T01:25:26.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.627+0000 7f900c9fc640 1 -- 172.21.15.100:0/52253172 learned_addr learned my addr 172.21.15.100:0/52253172 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.627+0000 7f900c9fc640 1 -- 172.21.15.100:0/52253172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a316f72040 con 0x55a316f71650 2024-09-18T01:25:26.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.627+0000 7f900c9fc640 1 --2- 172.21.15.100:0/52253172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f71650 0x55a316f71a70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00ffd0 tx=0x7f8ffc00fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.628+0000 7f8ed1fe3640 1 -- 172.21.15.100:0/52253172 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ffc046070 con 0x55a316f71650 2024-09-18T01:25:26.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.628+0000 7f8ed1fe3640 1 -- 172.21.15.100:0/52253172 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ffc01c8f0 con 0x55a316f71650 2024-09-18T01:25:26.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.628+0000 7f8ed1fe3640 1 -- 172.21.15.100:0/52253172 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ffc011a30 con 0x55a316f71650 2024-09-18T01:25:26.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.628+0000 7f900ef08800 1 -- 172.21.15.100:0/52253172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a316f74c90 con 0x55a316f71650 2024-09-18T01:25:26.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.628+0000 7f900ef08800 1 -- 172.21.15.100:0/52253172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a316f75070 con 0x55a316f71650 2024-09-18T01:25:26.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.628+0000 7f8ed1fe3640 1 -- 172.21.15.100:0/52253172 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8ffc049070 con 0x55a316f71650 2024-09-18T01:25:26.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.628+0000 7f8ed1fe3640 1 --2- 172.21.15.100:0/52253172 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8e44036b40 0x7f8e44039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.628+0000 7f8ed1fe3640 1 -- 172.21.15.100:0/52253172 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8ffc03e070 con 0x55a316f71650 2024-09-18T01:25:26.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.629+0000 7f900c1fb640 1 --2- 172.21.15.100:0/52253172 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8e44036b40 0x7f8e44039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.629+0000 7f8ecb7fe640 20 reqs_thread_entry: start 2024-09-18T01:25:26.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.629+0000 7f900ef08800 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a316f7f0b0 0x55a316f81500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.629+0000 7f900ef08800 1 -- 172.21.15.100:0/1110817389 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a316f81bd0 con 0x55a316f7f0b0 2024-09-18T01:25:26.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.629+0000 7f900c1fb640 1 --2- 172.21.15.100:0/52253172 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8e44036b40 0x7f8e44039000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55a316e4c3e0 tx=0x7f9000005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.629+0000 7f900d1fd640 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a316f7f0b0 0x55a316f81500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.629+0000 7f900d1fd640 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a316f7f0b0 0x55a316f81500 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.630+0000 7f900d1fd640 1 -- 172.21.15.100:0/1110817389 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f900401ecc0 con 0x55a316f7f0b0 2024-09-18T01:25:26.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.630+0000 7f900ef08800 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a316f839a0 0x55a316f85d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.630+0000 7f900ef08800 1 -- 172.21.15.100:0/1110817389 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:2 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a316f863f0 con 0x55a316f839a0 2024-09-18T01:25:26.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.630+0000 7f900c9fc640 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a316f839a0 0x55a316f85d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.630+0000 7f900c9fc640 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a316f839a0 0x55a316f85d90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.630+0000 7f900c9fc640 1 -- 172.21.15.100:0/1110817389 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(2 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8ffc048030 con 0x55a316f839a0 2024-09-18T01:25:26.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.630+0000 7f900ef08800 1 -- 172.21.15.100:0/1110817389 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a316f82e60 con 0x55a316f839a0 2024-09-18T01:25:26.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.631+0000 7f900c9fc640 1 -- 172.21.15.100:0/1110817389 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [stat,call,call,writefull 0~993] v33'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f8ffc048030 con 0x55a316f839a0 2024-09-18T01:25:26.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.632+0000 7f900ef08800 1 -- 172.21.15.100:0/1265093813 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ee4036b40 msgr2=0x7f8ee4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.632+0000 7f900ef08800 1 --2- 172.21.15.100:0/1265093813 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ee4036b40 0x7f8ee4039000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9000057000 tx=0x7f9000052000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.632+0000 7f900ef08800 1 -- 172.21.15.100:0/1265093813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f50140 msgr2=0x55a316f576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.632+0000 7f900ef08800 1 --2- 172.21.15.100:0/1265093813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f50140 0x55a316f576e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f900400c010 tx=0x7f9004002ff0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.632+0000 7f900ef08800 1 -- 172.21.15.100:0/1265093813 shutdown_connections 2024-09-18T01:25:26.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.632+0000 7f900ef08800 1 --2- 172.21.15.100:0/1265093813 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ee4036b40 0x7f8ee4039000 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.632+0000 7f900ef08800 1 --2- 172.21.15.100:0/1265093813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f50140 0x55a316f576e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.632+0000 7f900ef08800 1 -- 172.21.15.100:0/1265093813 >> 172.21.15.100:0/1265093813 conn(0x55a316e4fa20 msgr2=0x55a316f4b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.632+0000 7f900ef08800 1 -- 172.21.15.100:0/1265093813 shutdown_connections 2024-09-18T01:25:26.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.632+0000 7f900ef08800 1 -- 172.21.15.100:0/1265093813 wait complete. 2024-09-18T01:25:26.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 -- 172.21.15.100:0/52253172 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8e44036b40 msgr2=0x7f8e44039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 --2- 172.21.15.100:0/52253172 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8e44036b40 0x7f8e44039000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55a316e4c3e0 tx=0x7f9000005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:26.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 -- 172.21.15.100:0/52253172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f71650 msgr2=0x55a316f71a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 --2- 172.21.15.100:0/52253172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f71650 0x55a316f71a70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00ffd0 tx=0x7f8ffc00fcc0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 -- 172.21.15.100:0/52253172 shutdown_connections 2024-09-18T01:25:26.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 --2- 172.21.15.100:0/52253172 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8e44036b40 0x7f8e44039000 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 --2- 172.21.15.100:0/52253172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316f71650 0x55a316f71a70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 -- 172.21.15.100:0/52253172 >> 172.21.15.100:0/52253172 conn(0x55a316f665b0 msgr2=0x55a316f68e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 -- 172.21.15.100:0/52253172 shutdown_connections 2024-09-18T01:25:26.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 -- 172.21.15.100:0/52253172 wait complete. 2024-09-18T01:25:26.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 -- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a316f7f0b0 msgr2=0x55a316f81500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a316f7f0b0 0x55a316f81500 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 -- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a316f839a0 msgr2=0x55a316f85d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a316f839a0 0x55a316f85d90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 -- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ef4036b90 msgr2=0x7f8ef4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ef4036b90 0x7f8ef4039050 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc019a40 tx=0x7f8ffc0198d0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 -- 172.21.15.100:0/1110817389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4b5e0 msgr2=0x55a316dc06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4b5e0 0x55a316dc06f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc000f80 tx=0x7f8ffc001250 comp rx=0 tx=0).stop 2024-09-18T01:25:26.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 -- 172.21.15.100:0/1110817389 shutdown_connections 2024-09-18T01:25:26.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a316f839a0 0x55a316f85d90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a316f7f0b0 0x55a316f81500 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ef4036b90 0x7f8ef4039050 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 --2- 172.21.15.100:0/1110817389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a316e4b5e0 0x55a316dc06f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 -- 172.21.15.100:0/1110817389 >> 172.21.15.100:0/1110817389 conn(0x55a316e46e90 msgr2=0x55a316f34af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 -- 172.21.15.100:0/1110817389 shutdown_connections 2024-09-18T01:25:26.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.633+0000 7f900ef08800 1 -- 172.21.15.100:0/1110817389 wait complete. 2024-09-18T01:25:26.643 INFO:teuthology.orchestra.run.smithi100.stdout:{"id":"153b7754-209b-4898-8796-577da7c1273d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-18T01:25:26.644 DEBUG:tasks.util.rgw: json result: {'id': '153b7754-209b-4898-8796-577da7c1273d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-18T01:25:26.645 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-18T01:25:26.645 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-18T01:25:26.646 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-18T01:25:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:26.689 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:26.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.688+0000 7f2671415800 1 Processor -- start 2024-09-18T01:25:26.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.688+0000 7f2671415800 1 -- start start 2024-09-18T01:25:26.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.688+0000 7f2671415800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ddaf6d45c0 0x55ddaf7632a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.688+0000 7f2671415800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ddaf61fb30 con 0x55ddaf7637e0 2024-09-18T01:25:26.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.688+0000 7f2671415800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55ddaf601360 con 0x55ddaf6d45c0 2024-09-18T01:25:26.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.689+0000 7f266cb9c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ddaf6d45c0 0x55ddaf7632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.689+0000 7f266c39b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55ddaf7637e0 0x55ddaf765bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59190/0 (socket says 172.21.15.100:59190) 2024-09-18T01:25:26.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.689+0000 7f266cb9c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ddaf6d45c0 0x55ddaf7632a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60862/0 (socket says 172.21.15.100:60862) 2024-09-18T01:25:26.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.689+0000 7f266c39b640 1 -- 172.21.15.100:0/2462902957 learned_addr learned my addr 172.21.15.100:0/2462902957 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.689+0000 7f266cb9c640 1 -- 172.21.15.100:0/2462902957 >> v1:172.21.15.92:6789/0 conn(0x55ddaf7637e0 legacy=0x55ddaf765bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.689+0000 7f266cb9c640 1 -- 172.21.15.100:0/2462902957 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddaf627e00 con 0x55ddaf6d45c0 2024-09-18T01:25:26.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.691+0000 7f266cb9c640 1 --2- 172.21.15.100:0/2462902957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 0x55ddaf7632a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2664005fd0 tx=0x7f2664045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30848261d5068b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.691+0000 7f266bb9a640 1 -- 172.21.15.100:0/2462902957 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664058530 con 0x55ddaf6d45c0 2024-09-18T01:25:26.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.691+0000 7f266bb9a640 1 -- 172.21.15.100:0/2462902957 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26640586d0 con 0x55ddaf6d45c0 2024-09-18T01:25:26.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.691+0000 7f266bb9a640 1 -- 172.21.15.100:0/2462902957 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640589d0 con 0x55ddaf6d45c0 2024-09-18T01:25:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.691+0000 7f2671415800 1 -- 172.21.15.100:0/2462902957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 msgr2=0x55ddaf7632a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.691+0000 7f2671415800 1 --2- 172.21.15.100:0/2462902957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 0x55ddaf7632a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2664005fd0 tx=0x7f2664045c30 comp rx=0 tx=0).stop 2024-09-18T01:25:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.691+0000 7f2671415800 1 -- 172.21.15.100:0/2462902957 shutdown_connections 2024-09-18T01:25:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.691+0000 7f2671415800 1 --2- 172.21.15.100:0/2462902957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 0x55ddaf7632a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.691+0000 7f2671415800 1 -- 172.21.15.100:0/2462902957 >> 172.21.15.100:0/2462902957 conn(0x55ddaf75add0 msgr2=0x55ddaf75d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.691+0000 7f2671415800 1 -- 172.21.15.100:0/2462902957 shutdown_connections 2024-09-18T01:25:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.691+0000 7f2671415800 1 -- 172.21.15.100:0/2462902957 wait complete. 2024-09-18T01:25:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.705+0000 7f2671415800 1 Processor -- start 2024-09-18T01:25:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.705+0000 7f2671415800 1 -- start start 2024-09-18T01:25:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.705+0000 7f2671415800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 0x55ddaf84f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.705+0000 7f2671415800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ddaf6ac320 con 0x55ddaf6d45c0 2024-09-18T01:25:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.705+0000 7f266cb9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 0x55ddaf84f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.705+0000 7f266cb9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 0x55ddaf84f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60872/0 (socket says 172.21.15.100:60872) 2024-09-18T01:25:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.705+0000 7f266cb9c640 1 -- 172.21.15.100:0/1472705514 learned_addr learned my addr 172.21.15.100:0/1472705514 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.705+0000 7f266cb9c640 1 -- 172.21.15.100:0/1472705514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddaf5f9bc0 con 0x55ddaf6d45c0 2024-09-18T01:25:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.705+0000 7f266cb9c640 1 --2- 172.21.15.100:0/1472705514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 0x55ddaf84f8c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f266400a3f0 tx=0x7f2664051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518db1ad14e23d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.706+0000 7f255ae0d640 1 -- 172.21.15.100:0/1472705514 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640589b0 con 0x55ddaf6d45c0 2024-09-18T01:25:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.706+0000 7f255ae0d640 1 -- 172.21.15.100:0/1472705514 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2664068070 con 0x55ddaf6d45c0 2024-09-18T01:25:26.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.706+0000 7f255ae0d640 1 -- 172.21.15.100:0/1472705514 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664058c80 con 0x55ddaf6d45c0 2024-09-18T01:25:26.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.706+0000 7f2671415800 1 -- 172.21.15.100:0/1472705514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 msgr2=0x55ddaf84f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.706+0000 7f2671415800 1 --2- 172.21.15.100:0/1472705514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 0x55ddaf84f8c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f266400a3f0 tx=0x7f2664051000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.706+0000 7f2671415800 1 -- 172.21.15.100:0/1472705514 shutdown_connections 2024-09-18T01:25:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.706+0000 7f2671415800 1 --2- 172.21.15.100:0/1472705514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 0x55ddaf84f8c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.706+0000 7f2671415800 1 -- 172.21.15.100:0/1472705514 >> 172.21.15.100:0/1472705514 conn(0x55ddaf75add0 msgr2=0x55ddaf84b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.706+0000 7f2671415800 1 -- 172.21.15.100:0/1472705514 shutdown_connections 2024-09-18T01:25:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.706+0000 7f2671415800 1 -- 172.21.15.100:0/1472705514 wait complete. 2024-09-18T01:25:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.707+0000 7f2671415800 1 Processor -- start 2024-09-18T01:25:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.707+0000 7f2671415800 1 -- start start 2024-09-18T01:25:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.707+0000 7f2671415800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 0x55ddaf8571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.707+0000 7f2671415800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ddaf767680 con 0x55ddaf6d45c0 2024-09-18T01:25:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.707+0000 7f266cb9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 0x55ddaf8571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.707+0000 7f266cb9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 0x55ddaf8571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60878/0 (socket says 172.21.15.100:60878) 2024-09-18T01:25:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.707+0000 7f266cb9c640 1 -- 172.21.15.100:0/3921085051 learned_addr learned my addr 172.21.15.100:0/3921085051 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.708+0000 7f266cb9c640 1 -- 172.21.15.100:0/3921085051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddaf60dfe0 con 0x55ddaf6d45c0 2024-09-18T01:25:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.708+0000 7f266cb9c640 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 0x55ddaf8571e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2664065040 tx=0x7f2664003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.708+0000 7f255960a640 1 -- 172.21.15.100:0/3921085051 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664063650 con 0x55ddaf6d45c0 2024-09-18T01:25:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.708+0000 7f255960a640 1 -- 172.21.15.100:0/3921085051 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26640637f0 con 0x55ddaf6d45c0 2024-09-18T01:25:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.708+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddaf857720 con 0x55ddaf6d45c0 2024-09-18T01:25:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.708+0000 7f255960a640 1 -- 172.21.15.100:0/3921085051 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664063af0 con 0x55ddaf6d45c0 2024-09-18T01:25:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.708+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddaf857c40 con 0x55ddaf6d45c0 2024-09-18T01:25:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.709+0000 7f255960a640 1 -- 172.21.15.100:0/3921085051 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2664074020 con 0x55ddaf6d45c0 2024-09-18T01:25:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.709+0000 7f255960a640 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2554036b90 0x7f2554039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.709+0000 7f255960a640 1 -- 172.21.15.100:0/3921085051 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f2664090970 con 0x55ddaf6d45c0 2024-09-18T01:25:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.709+0000 7f266c39b640 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2554036b90 0x7f2554039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.709+0000 7f2671415800 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ddaf7637e0 0x55ddaf85e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.709+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf85e790 con 0x55ddaf7637e0 2024-09-18T01:25:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.709+0000 7f266d39d640 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ddaf7637e0 0x55ddaf85e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.709+0000 7f266c39b640 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2554036b90 0x7f2554039050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2654000f60 tx=0x7f26540012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.709+0000 7f266d39d640 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ddaf7637e0 0x55ddaf85e250 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.710+0000 7f266d39d640 1 -- 172.21.15.100:0/3921085051 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f265c0083e0 con 0x55ddaf7637e0 2024-09-18T01:25:26.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.710+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf85b800 con 0x55ddaf7637e0 2024-09-18T01:25:26.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.710+0000 7f266d39d640 1 -- 172.21.15.100:0/3921085051 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f265c0083e0 con 0x55ddaf7637e0 2024-09-18T01:25:26.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.710+0000 7f2671415800 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ddaf860a60 0x55ddaf862e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.710+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf863540 con 0x55ddaf860a60 2024-09-18T01:25:26.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.710+0000 7f266cb9c640 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ddaf860a60 0x55ddaf862e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.710+0000 7f266cb9c640 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ddaf860a60 0x55ddaf862e50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.711+0000 7f266cb9c640 1 -- 172.21.15.100:0/3921085051 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f266406c450 con 0x55ddaf860a60 2024-09-18T01:25:26.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.711+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf85f900 con 0x55ddaf7637e0 2024-09-18T01:25:26.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.711+0000 7f266d39d640 1 -- 172.21.15.100:0/3921085051 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f265c0083e0 con 0x55ddaf7637e0 2024-09-18T01:25:26.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.711+0000 7f2671415800 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ddaf8649a0 0x55ddaf866d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.711+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf867480 con 0x55ddaf8649a0 2024-09-18T01:25:26.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.711+0000 7f266c39b640 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ddaf8649a0 0x55ddaf866d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.712+0000 7f266c39b640 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ddaf8649a0 0x55ddaf866d90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.712+0000 7f266c39b640 1 -- 172.21.15.100:0/3921085051 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf8649a0 2024-09-18T01:25:26.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.712+0000 7f2671415800 1 Processor -- start 2024-09-18T01:25:26.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.712+0000 7f2671415800 1 -- start start 2024-09-18T01:25:26.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.712+0000 7f2671415800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf875230 0x55ddaf875650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.712+0000 7f2671415800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ddaf5fb580 con 0x55ddaf875230 2024-09-18T01:25:26.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.713+0000 7f266cb9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf875230 0x55ddaf875650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.713+0000 7f266cb9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf875230 0x55ddaf875650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60886/0 (socket says 172.21.15.100:60886) 2024-09-18T01:25:26.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.713+0000 7f266cb9c640 1 -- 172.21.15.100:0/2106474148 learned_addr learned my addr 172.21.15.100:0/2106474148 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.713+0000 7f266cb9c640 1 -- 172.21.15.100:0/2106474148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddaf875b90 con 0x55ddaf875230 2024-09-18T01:25:26.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.713+0000 7f266cb9c640 1 --2- 172.21.15.100:0/2106474148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf875230 0x55ddaf875650 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f266400a3f0 tx=0x7f26640653c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.713+0000 7f25527fc640 1 -- 172.21.15.100:0/2106474148 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664094020 con 0x55ddaf875230 2024-09-18T01:25:26.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.713+0000 7f25527fc640 1 -- 172.21.15.100:0/2106474148 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2664090050 con 0x55ddaf875230 2024-09-18T01:25:26.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.713+0000 7f25527fc640 1 -- 172.21.15.100:0/2106474148 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664090330 con 0x55ddaf875230 2024-09-18T01:25:26.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.713+0000 7f2671415800 1 -- 172.21.15.100:0/2106474148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddaf875e20 con 0x55ddaf875230 2024-09-18T01:25:26.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.713+0000 7f2671415800 1 -- 172.21.15.100:0/2106474148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddaf878b00 con 0x55ddaf875230 2024-09-18T01:25:26.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.714+0000 7f25527fc640 1 -- 172.21.15.100:0/2106474148 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f26640904d0 con 0x55ddaf875230 2024-09-18T01:25:26.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.714+0000 7f25527fc640 1 --2- 172.21.15.100:0/2106474148 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2544036b40 0x7f2544039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.714+0000 7f25527fc640 1 -- 172.21.15.100:0/2106474148 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f26640780c0 con 0x55ddaf875230 2024-09-18T01:25:26.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.714+0000 7f266c39b640 1 --2- 172.21.15.100:0/2106474148 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2544036b40 0x7f2544039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.714+0000 7f2671415800 1 Processor -- start 2024-09-18T01:25:26.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.714+0000 7f266c39b640 1 --2- 172.21.15.100:0/2106474148 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2544036b40 0x7f2544039000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f265400bf50 tx=0x7f265400f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.714+0000 7f2671415800 1 -- start start 2024-09-18T01:25:26.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.715+0000 7f2671415800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf881db0 0x55ddaf8821b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.715+0000 7f2671415800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ddaf84ffb0 con 0x55ddaf881db0 2024-09-18T01:25:26.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.715+0000 7f266cb9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf881db0 0x55ddaf8821b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.715+0000 7f266cb9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf881db0 0x55ddaf8821b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60896/0 (socket says 172.21.15.100:60896) 2024-09-18T01:25:26.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.715+0000 7f266cb9c640 1 -- 172.21.15.100:0/12478711 learned_addr learned my addr 172.21.15.100:0/12478711 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.715+0000 7f266cb9c640 1 -- 172.21.15.100:0/12478711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddaf882780 con 0x55ddaf881db0 2024-09-18T01:25:26.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.715+0000 7f266cb9c640 1 --2- 172.21.15.100:0/12478711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf881db0 0x55ddaf8821b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2664065fd0 tx=0x7f2664086a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d13a6721615191 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.715+0000 7f2543fff640 1 -- 172.21.15.100:0/12478711 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640a9070 con 0x55ddaf881db0 2024-09-18T01:25:26.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.715+0000 7f2543fff640 1 -- 172.21.15.100:0/12478711 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2664065720 con 0x55ddaf881db0 2024-09-18T01:25:26.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.715+0000 7f2543fff640 1 -- 172.21.15.100:0/12478711 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664086cd0 con 0x55ddaf881db0 2024-09-18T01:25:26.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.716+0000 7f2671415800 1 -- 172.21.15.100:0/12478711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf881db0 msgr2=0x55ddaf8821b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.716+0000 7f2671415800 1 --2- 172.21.15.100:0/12478711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf881db0 0x55ddaf8821b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2664065fd0 tx=0x7f2664086a50 comp rx=0 tx=0).stop 2024-09-18T01:25:26.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.716+0000 7f2671415800 1 -- 172.21.15.100:0/12478711 shutdown_connections 2024-09-18T01:25:26.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.716+0000 7f2671415800 1 --2- 172.21.15.100:0/12478711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf881db0 0x55ddaf8821b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.716+0000 7f2671415800 1 -- 172.21.15.100:0/12478711 >> 172.21.15.100:0/12478711 conn(0x55ddaf87e110 msgr2=0x55ddaf87c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.716+0000 7f2671415800 1 -- 172.21.15.100:0/12478711 shutdown_connections 2024-09-18T01:25:26.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.716+0000 7f2671415800 1 -- 172.21.15.100:0/12478711 wait complete. 2024-09-18T01:25:26.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.716+0000 7f2671415800 1 Processor -- start 2024-09-18T01:25:26.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.716+0000 7f2671415800 1 -- start start 2024-09-18T01:25:26.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.716+0000 7f2671415800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf881db0 0x55ddaf760bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.716+0000 7f2671415800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ddaf882d00 con 0x55ddaf881db0 2024-09-18T01:25:26.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.716+0000 7f266cb9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf881db0 0x55ddaf760bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.717+0000 7f266cb9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf881db0 0x55ddaf760bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60898/0 (socket says 172.21.15.100:60898) 2024-09-18T01:25:26.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.717+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 learned_addr learned my addr 172.21.15.100:0/2006873005 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.717+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddaf75f2c0 con 0x55ddaf881db0 2024-09-18T01:25:26.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.717+0000 7f266cb9c640 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf881db0 0x55ddaf760bd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2664066f10 tx=0x7f2664090820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.717+0000 7f25427fc640 1 -- 172.21.15.100:0/2006873005 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640be070 con 0x55ddaf881db0 2024-09-18T01:25:26.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.717+0000 7f25427fc640 1 -- 172.21.15.100:0/2006873005 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266404e970 con 0x55ddaf881db0 2024-09-18T01:25:26.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.717+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddaf75f2c0 con 0x55ddaf881db0 2024-09-18T01:25:26.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.717+0000 7f25427fc640 1 -- 172.21.15.100:0/2006873005 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640a9040 con 0x55ddaf881db0 2024-09-18T01:25:26.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.717+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddaf75f2c0 con 0x55ddaf881db0 2024-09-18T01:25:26.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.718+0000 7f25427fc640 1 -- 172.21.15.100:0/2006873005 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f26640c1070 con 0x55ddaf881db0 2024-09-18T01:25:26.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.718+0000 7f25427fc640 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2538036b40 0x7f2538039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.718+0000 7f25427fc640 1 -- 172.21.15.100:0/2006873005 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f26640b6070 con 0x55ddaf881db0 2024-09-18T01:25:26.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.718+0000 7f266c39b640 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2538036b40 0x7f2538039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.718+0000 7f2671415800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.718+0000 7f2671415800 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ddaf896900 0x55ddaf898dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.718+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf899510 con 0x55ddaf896900 2024-09-18T01:25:26.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.719+0000 7f266c39b640 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2538036b40 0x7f2538039000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f265400efd0 tx=0x7f2654010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.719+0000 7f266d39d640 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ddaf896900 0x55ddaf898dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.719+0000 7f266d39d640 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ddaf896900 0x55ddaf898dc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.719+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f265c0083e0 con 0x55ddaf896900 2024-09-18T01:25:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.719+0000 7f2671415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.719+0000 7f2671415800 20 realm 2024-09-18T01:25:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.719+0000 7f2671415800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.719+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf899920 con 0x55ddaf896900 2024-09-18T01:25:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.719+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f265c0083e0 con 0x55ddaf896900 2024-09-18T01:25:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.719+0000 7f2671415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.719+0000 7f2671415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.719+0000 7f2671415800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.719+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf896900 2024-09-18T01:25:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.720+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f265c0083e0 con 0x55ddaf896900 2024-09-18T01:25:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.720+0000 7f2671415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.720+0000 7f2671415800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.720+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a590 con 0x55ddaf896900 2024-09-18T01:25:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.720+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f265c0083e0 con 0x55ddaf896900 2024-09-18T01:25:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.720+0000 7f2671415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.720+0000 7f2671415800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.720+0000 7f2671415800 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ddaf89aca0 0x55ddaf89d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.720+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89d840 con 0x55ddaf89aca0 2024-09-18T01:25:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.720+0000 7f266cb9c640 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ddaf89aca0 0x55ddaf89d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.720+0000 7f266cb9c640 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ddaf89aca0 0x55ddaf89d0b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.721+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.721+0000 7f2671415800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.721+0000 7f2671415800 20 searching for the correct realm 2024-09-18T01:25:26.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.721+0000 7f2671415800 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ddaf89f930 0x55ddaf8a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.721+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a24c0 con 0x55ddaf89f930 2024-09-18T01:25:26.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.721+0000 7f266c39b640 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ddaf89f930 0x55ddaf8a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.721+0000 7f266c39b640 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ddaf89f930 0x55ddaf8a1df0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.721+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.721+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a24c0 con 0x55ddaf89aca0 2024-09-18T01:25:26.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.721+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.722+0000 7f266cb9c640 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f26640c3060 0x7f2664099630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.722+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a24c0 con 0x7f26640c3060 2024-09-18T01:25:26.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.722+0000 7f266d39d640 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f26640c3060 0x7f2664099630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.722+0000 7f266d39d640 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f26640c3060 0x7f2664099630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.722+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f265c0083e0 con 0x7f26640c3060 2024-09-18T01:25:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.722+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf896900 2024-09-18T01:25:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.722+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c0083e0 con 0x55ddaf896900 2024-09-18T01:25:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.722+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf896900 2024-09-18T01:25:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.723+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.723+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x7f26640c3060 2024-09-18T01:25:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.723+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.723+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x7f26640c3060 2024-09-18T01:25:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.723+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.723+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf89aca0 2024-09-18T01:25:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.723+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.723+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf89f930 2024-09-18T01:25:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.724+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.724+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf896900 2024-09-18T01:25:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.724+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.724+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x7f26640c3060 2024-09-18T01:25:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.724+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.724+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf896900 2024-09-18T01:25:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.724+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.724+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf89aca0 2024-09-18T01:25:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.724+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.725+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf89f930 2024-09-18T01:25:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.725+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.725+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf89f930 2024-09-18T01:25:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.725+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.725+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x7f26640c3060 2024-09-18T01:25:26.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.725+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.725+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf89f930 2024-09-18T01:25:26.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.725+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.725+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf89f930 2024-09-18T01:25:26.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.726+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.726+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf896900 2024-09-18T01:25:26.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.726+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.726+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf896900 2024-09-18T01:25:26.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.726+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.726+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x7f26640c3060 2024-09-18T01:25:26.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.726+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.726+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf89f930 2024-09-18T01:25:26.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.727+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.727+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf89aca0 2024-09-18T01:25:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.727+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.727+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf896900 2024-09-18T01:25:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.727+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.727+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x7f26640c3060 2024-09-18T01:25:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.727+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.727+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf89f930 2024-09-18T01:25:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.728+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.728+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x7f26640c3060 2024-09-18T01:25:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.728+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.728+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf89aca0 2024-09-18T01:25:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.728+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.728+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf89f930 2024-09-18T01:25:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.728+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.728+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x7f26640c3060 2024-09-18T01:25:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf896900 2024-09-18T01:25:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89a1f0 con 0x55ddaf89aca0 2024-09-18T01:25:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f2671415800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f2671415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f2671415800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f2671415800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f2671415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f2671415800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f2671415800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89e1f0 con 0x55ddaf896900 2024-09-18T01:25:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f2671415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f2671415800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89e5e0 con 0x55ddaf896900 2024-09-18T01:25:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.729+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89e5e0 con 0x7f26640c3060 2024-09-18T01:25:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 20 zone default found 2024-09-18T01:25:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 4 Realm: () 2024-09-18T01:25:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 20 zonegroup default 2024-09-18T01:25:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89ea00 con 0x7f26640c3060 2024-09-18T01:25:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf89ee40 con 0x55ddaf89f930 2024-09-18T01:25:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.730+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a4320 con 0x55ddaf89f930 2024-09-18T01:25:26.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.731+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.731+0000 7f2671415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.731+0000 7f2671415800 20 started sync module instance, tier type = 2024-09-18T01:25:26.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.731+0000 7f2671415800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:26.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.731+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a37c0 con 0x55ddaf89aca0 2024-09-18T01:25:26.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.732+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.732+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94410621205472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a3420 con 0x55ddaf89aca0 2024-09-18T01:25:26.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.732+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a5190 con 0x55ddaf896900 2024-09-18T01:25:26.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.733+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94410621205472] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.733+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.733+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410621209824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a55b0 con 0x55ddaf896900 2024-09-18T01:25:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.733+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a5f70 con 0x55ddaf89f930 2024-09-18T01:25:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.734+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.734+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94410621213376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a67c0 con 0x55ddaf89f930 2024-09-18T01:25:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.734+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a72a0 con 0x55ddaf89aca0 2024-09-18T01:25:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.734+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94410621209824] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.735+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.735+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94410621218224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a7690 con 0x55ddaf89aca0 2024-09-18T01:25:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.735+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a8090 con 0x55ddaf896900 2024-09-18T01:25:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.736+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94410621213376] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.736+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.736+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94410621215504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a8050 con 0x55ddaf896900 2024-09-18T01:25:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.736+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a8ae0 con 0x7f26640c3060 2024-09-18T01:25:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.737+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94410621218224] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.737+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.737+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94410621210880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a8aa0 con 0x7f26640c3060 2024-09-18T01:25:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.737+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a94f0 con 0x7f26640c3060 2024-09-18T01:25:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.737+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94410621215504] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.738+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94410621210880] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.739+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.739+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94410621221792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a9040 con 0x7f26640c3060 2024-09-18T01:25:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.739+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a9a00 con 0x7f26640c3060 2024-09-18T01:25:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.740+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.740+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94410621228368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a9e20 con 0x7f26640c3060 2024-09-18T01:25:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.740+0000 7f2671415800 20 add_watcher() i=0 2024-09-18T01:25:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.740+0000 7f2671415800 20 add_watcher() i=1 2024-09-18T01:25:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.740+0000 7f2671415800 20 add_watcher() i=2 2024-09-18T01:25:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.740+0000 7f2671415800 20 add_watcher() i=3 2024-09-18T01:25:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.740+0000 7f2671415800 20 add_watcher() i=4 2024-09-18T01:25:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.740+0000 7f2671415800 20 add_watcher() i=5 2024-09-18T01:25:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.740+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94410621221792] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.740+0000 7f2671415800 20 add_watcher() i=6 2024-09-18T01:25:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.741+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94410621228368] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.741+0000 7f2671415800 20 add_watcher() i=7 2024-09-18T01:25:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.741+0000 7f2671415800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.741+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a9e20 con 0x55ddaf896900 2024-09-18T01:25:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.741+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.741+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94410621229424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8a9d90 con 0x55ddaf896900 2024-09-18T01:25:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.742+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94410621229424] v33'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.742+0000 7f2522fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.742+0000 7f2671415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.742+0000 7f2671415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.742+0000 7f2671415800 5 note: GC not initialized 2024-09-18T01:25:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.742+0000 7f2521fe3640 20 reqs_thread_entry: start 2024-09-18T01:25:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.742+0000 7f2671415800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.743+0000 7f2671415800 20 Filter name: none 2024-09-18T01:25:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.743+0000 7f24937fe640 20 reqs_thread_entry: start 2024-09-18T01:25:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.743+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e05c0 con 0x55ddaf896900 2024-09-18T01:25:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.743+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.743+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e05c0 con 0x55ddaf89aca0 2024-09-18T01:25:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.743+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.743+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e05c0 con 0x55ddaf896900 2024-09-18T01:25:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.743+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.743+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0580 con 0x55ddaf89f930 2024-09-18T01:25:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.744+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.744+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0ad0 con 0x55ddaf89f930 2024-09-18T01:25:26.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.744+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.744+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0ed0 con 0x55ddaf89f930 2024-09-18T01:25:26.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.744+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.744+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0ed0 con 0x55ddaf896900 2024-09-18T01:25:26.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.744+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.744+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0ed0 con 0x55ddaf896900 2024-09-18T01:25:26.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.744+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.744+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0ed0 con 0x55ddaf89f930 2024-09-18T01:25:26.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.745+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.745+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0ed0 con 0x55ddaf89f930 2024-09-18T01:25:26.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.745+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.745+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0eb0 con 0x7f26640c3060 2024-09-18T01:25:26.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.745+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.745+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0eb0 con 0x55ddaf896900 2024-09-18T01:25:26.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.745+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.745+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf89aca0 2024-09-18T01:25:26.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.746+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.746+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf89f930 2024-09-18T01:25:26.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.746+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.746+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x7f26640c3060 2024-09-18T01:25:26.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.746+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.746+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x7f26640c3060 2024-09-18T01:25:26.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.746+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.746+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf89f930 2024-09-18T01:25:26.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.746+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.746+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x7f26640c3060 2024-09-18T01:25:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.747+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.747+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf896900 2024-09-18T01:25:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.747+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.747+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf89f930 2024-09-18T01:25:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.747+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.747+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x7f26640c3060 2024-09-18T01:25:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.747+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.747+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf89aca0 2024-09-18T01:25:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.747+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.747+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x7f26640c3060 2024-09-18T01:25:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.748+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.748+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf896900 2024-09-18T01:25:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.748+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.748+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf896900 2024-09-18T01:25:26.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.748+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.748+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf89f930 2024-09-18T01:25:26.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.748+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.748+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf896900 2024-09-18T01:25:26.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.748+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.748+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf896900 2024-09-18T01:25:26.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.749+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.749+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf89f930 2024-09-18T01:25:26.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.749+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.749+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf89f930 2024-09-18T01:25:26.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.749+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.749+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf89f930 2024-09-18T01:25:26.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.749+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.749+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x7f26640c3060 2024-09-18T01:25:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.750+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.750+0000 7f2522fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.750+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94410621229424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf896900 2024-09-18T01:25:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.751+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94410621229424] v33'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.751+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94410621205472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf89aca0 2024-09-18T01:25:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.752+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94410621205472] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.752+0000 7f2671415800 20 remove_watcher() i=0 2024-09-18T01:25:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.752+0000 7f2671415800 2 removed watcher, disabling cache 2024-09-18T01:25:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.752+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94410621209824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8dda90 con 0x55ddaf896900 2024-09-18T01:25:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.753+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94410621209824] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.753+0000 7f2671415800 20 remove_watcher() i=1 2024-09-18T01:25:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.753+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94410621213376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf89f930 2024-09-18T01:25:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.754+0000 7f266c39b640 1 -- 172.21.15.100:0/2006873005 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94410621213376] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654009050 con 0x55ddaf89f930 2024-09-18T01:25:26.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.754+0000 7f2671415800 20 remove_watcher() i=2 2024-09-18T01:25:26.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.754+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94410621218224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8dda90 con 0x55ddaf89aca0 2024-09-18T01:25:26.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.755+0000 7f266cb9c640 1 -- 172.21.15.100:0/2006873005 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94410621218224] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640c0030 con 0x55ddaf89aca0 2024-09-18T01:25:26.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.755+0000 7f2671415800 20 remove_watcher() i=3 2024-09-18T01:25:26.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.755+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94410621215504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x55ddaf896900 2024-09-18T01:25:26.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.756+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94410621215504] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x55ddaf896900 2024-09-18T01:25:26.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.756+0000 7f2671415800 20 remove_watcher() i=4 2024-09-18T01:25:26.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.756+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94410621210880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8dda90 con 0x7f26640c3060 2024-09-18T01:25:26.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.758+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94410621210880] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.758+0000 7f2671415800 20 remove_watcher() i=5 2024-09-18T01:25:26.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.758+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94410621221792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8e0e90 con 0x7f26640c3060 2024-09-18T01:25:26.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.759+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94410621221792] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.759+0000 7f2671415800 20 remove_watcher() i=6 2024-09-18T01:25:26.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.759+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94410621228368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ddaf8dda90 con 0x7f26640c3060 2024-09-18T01:25:26.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94410621228368] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c026040 con 0x7f26640c3060 2024-09-18T01:25:26.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 20 remove_watcher() i=7 2024-09-18T01:25:26.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f26640c3060 msgr2=0x7f2664099630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f26640c3060 0x7f2664099630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ddaf896900 msgr2=0x55ddaf898dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ddaf896900 0x55ddaf898dc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ddaf89aca0 msgr2=0x55ddaf89d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ddaf89aca0 0x55ddaf89d0b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ddaf89f930 msgr2=0x55ddaf8a1df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ddaf89f930 0x55ddaf8a1df0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2538036b40 msgr2=0x7f2538039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2538036b40 0x7f2538039000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f265400efd0 tx=0x7f2654010000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf881db0 msgr2=0x55ddaf760bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 --2- 172.21.15.100:0/2006873005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf881db0 0x55ddaf760bd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2664066f10 tx=0x7f2664090820 comp rx=0 tx=0).stop 2024-09-18T01:25:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 reap_dead start 2024-09-18T01:25:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f266d39d640 1 -- 172.21.15.100:0/2006873005 reap_dead start 2024-09-18T01:25:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 shutdown_connections 2024-09-18T01:25:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 >> 172.21.15.100:0/2006873005 conn(0x55ddaf87e110 msgr2=0x55ddaf87c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 shutdown_connections 2024-09-18T01:25:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 -- 172.21.15.100:0/2006873005 wait complete. 2024-09-18T01:25:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 -- 172.21.15.100:0/2106474148 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2544036b40 msgr2=0x7f2544039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 --2- 172.21.15.100:0/2106474148 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2544036b40 0x7f2544039000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f265400bf50 tx=0x7f265400f000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 -- 172.21.15.100:0/2106474148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf875230 msgr2=0x55ddaf875650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 --2- 172.21.15.100:0/2106474148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf875230 0x55ddaf875650 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f266400a3f0 tx=0x7f26640653c0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 -- 172.21.15.100:0/2106474148 shutdown_connections 2024-09-18T01:25:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 --2- 172.21.15.100:0/2106474148 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2544036b40 0x7f2544039000 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 --2- 172.21.15.100:0/2106474148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf875230 0x55ddaf875650 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.760+0000 7f2671415800 1 -- 172.21.15.100:0/2106474148 >> 172.21.15.100:0/2106474148 conn(0x55ddaf86a1c0 msgr2=0x55ddaf86cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 -- 172.21.15.100:0/2106474148 shutdown_connections 2024-09-18T01:25:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 -- 172.21.15.100:0/2106474148 wait complete. 2024-09-18T01:25:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ddaf8649a0 msgr2=0x55ddaf866d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ddaf8649a0 0x55ddaf866d90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ddaf7637e0 msgr2=0x55ddaf85e250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ddaf7637e0 0x55ddaf85e250 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ddaf860a60 msgr2=0x55ddaf862e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ddaf860a60 0x55ddaf862e50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2554036b90 msgr2=0x7f2554039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2554036b90 0x7f2554039050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2654000f60 tx=0x7f26540012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 msgr2=0x55ddaf8571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 --2- 172.21.15.100:0/3921085051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddaf6d45c0 0x55ddaf8571e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2664065040 tx=0x7f2664003330 comp rx=0 tx=0).stop 2024-09-18T01:25:26.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f266d39d640 1 -- 172.21.15.100:0/3921085051 reap_dead start 2024-09-18T01:25:26.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 shutdown_connections 2024-09-18T01:25:26.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 >> 172.21.15.100:0/3921085051 conn(0x55ddaf75add0 msgr2=0x55ddaf849af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 shutdown_connections 2024-09-18T01:25:26.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.761+0000 7f2671415800 1 -- 172.21.15.100:0/3921085051 wait complete. 2024-09-18T01:25:26.776 INFO:teuthology.orchestra.run.smithi100.stdout:{"entries":[],"summary":[]} 2024-09-18T01:25:26.776 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-18T01:25:26.776 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:25:26.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:25:26.776 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:25:26.860 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:26.860 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:26.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.860+0000 7f4bb9c13800 1 Processor -- start 2024-09-18T01:25:26.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.860+0000 7f4bb9c13800 1 -- start start 2024-09-18T01:25:26.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.860+0000 7f4bb9c13800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558f37f3d4c0 0x558f37f3d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.860+0000 7f4bb9c13800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558f37dfdb30 con 0x558f37f3de00 2024-09-18T01:25:26.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.860+0000 7f4bb9c13800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x558f37ddf360 con 0x558f37f3d4c0 2024-09-18T01:25:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.860+0000 7f4bb533d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558f37f3d4c0 0x558f37f3d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.860+0000 7f4baffff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x558f37f3de00 0x558f37f42980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59206/0 (socket says 172.21.15.100:59206) 2024-09-18T01:25:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.860+0000 7f4baffff640 1 -- 172.21.15.100:0/2431415836 learned_addr learned my addr 172.21.15.100:0/2431415836 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:26.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.861+0000 7f4bb4b3c640 1 -- 172.21.15.100:0/2431415836 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3264407639 0 0) 0x558f37dfdb30 con 0x558f37f3de00 2024-09-18T01:25:26.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.861+0000 7f4bb4b3c640 1 -- 172.21.15.100:0/2431415836 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ba4001e10 con 0x558f37f3de00 2024-09-18T01:25:26.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.861+0000 7f4bb533d640 1 -- 172.21.15.100:0/2431415836 >> v1:172.21.15.92:6789/0 conn(0x558f37f3de00 legacy=0x558f37f42980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.861+0000 7f4bb533d640 1 -- 172.21.15.100:0/2431415836 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f37e05e00 con 0x558f37f3d4c0 2024-09-18T01:25:26.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.862+0000 7f4bb533d640 1 --2- 172.21.15.100:0/2431415836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 0x558f37f3d8c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800a470 tx=0x7f4ba8045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8f12820bd68f69 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.863+0000 7f4bb4b3c640 1 -- 172.21.15.100:0/2431415836 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba8059070 con 0x558f37f3d4c0 2024-09-18T01:25:26.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.863+0000 7f4bb4b3c640 1 -- 172.21.15.100:0/2431415836 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba8054570 con 0x558f37f3d4c0 2024-09-18T01:25:26.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.863+0000 7f4bb4b3c640 1 -- 172.21.15.100:0/2431415836 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba8054870 con 0x558f37f3d4c0 2024-09-18T01:25:26.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.863+0000 7f4bb9c13800 1 -- 172.21.15.100:0/2431415836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 msgr2=0x558f37f3d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.863+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/2431415836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 0x558f37f3d8c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800a470 tx=0x7f4ba8045920 comp rx=0 tx=0).stop 2024-09-18T01:25:26.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.863+0000 7f4bb9c13800 1 -- 172.21.15.100:0/2431415836 shutdown_connections 2024-09-18T01:25:26.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.863+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/2431415836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 0x558f37f3d8c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.863+0000 7f4bb9c13800 1 -- 172.21.15.100:0/2431415836 >> 172.21.15.100:0/2431415836 conn(0x558f37f38df0 msgr2=0x558f37f3b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.863+0000 7f4bb9c13800 1 -- 172.21.15.100:0/2431415836 shutdown_connections 2024-09-18T01:25:26.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.863+0000 7f4bb9c13800 1 -- 172.21.15.100:0/2431415836 wait complete. 2024-09-18T01:25:26.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.877+0000 7f4bb9c13800 1 Processor -- start 2024-09-18T01:25:26.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.877+0000 7f4bb9c13800 1 -- start start 2024-09-18T01:25:26.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.877+0000 7f4bb9c13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 0x558f3802c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.877+0000 7f4bb9c13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558f37e8a330 con 0x558f37f3d4c0 2024-09-18T01:25:26.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.877+0000 7f4bb533d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 0x558f3802c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.877+0000 7f4bb533d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 0x558f3802c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60918/0 (socket says 172.21.15.100:60918) 2024-09-18T01:25:26.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.877+0000 7f4bb533d640 1 -- 172.21.15.100:0/3901561690 learned_addr learned my addr 172.21.15.100:0/3901561690 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.877+0000 7f4bb533d640 1 -- 172.21.15.100:0/3901561690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f37dd7bc0 con 0x558f37f3d4c0 2024-09-18T01:25:26.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.878+0000 7f4bb533d640 1 --2- 172.21.15.100:0/3901561690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 0x558f3802c5b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8025b20 tx=0x7f4ba804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f685e749c819f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.878+0000 7f4aa3606640 1 -- 172.21.15.100:0/3901561690 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba8062070 con 0x558f37f3d4c0 2024-09-18T01:25:26.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.878+0000 7f4aa3606640 1 -- 172.21.15.100:0/3901561690 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba800a170 con 0x558f37f3d4c0 2024-09-18T01:25:26.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.878+0000 7f4aa3606640 1 -- 172.21.15.100:0/3901561690 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba8059040 con 0x558f37f3d4c0 2024-09-18T01:25:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.878+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3901561690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 msgr2=0x558f3802c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.878+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/3901561690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 0x558f3802c5b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8025b20 tx=0x7f4ba804e000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.878+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3901561690 shutdown_connections 2024-09-18T01:25:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.878+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/3901561690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 0x558f3802c5b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.878+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3901561690 >> 172.21.15.100:0/3901561690 conn(0x558f37f38df0 msgr2=0x558f38027f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.879+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3901561690 shutdown_connections 2024-09-18T01:25:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.879+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3901561690 wait complete. 2024-09-18T01:25:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.879+0000 7f4bb9c13800 1 Processor -- start 2024-09-18T01:25:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.879+0000 7f4bb9c13800 1 -- start start 2024-09-18T01:25:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.879+0000 7f4bb9c13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 0x558f38034f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.879+0000 7f4bb9c13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558f37f444e0 con 0x558f37f3d4c0 2024-09-18T01:25:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.879+0000 7f4bb533d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 0x558f38034f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.879+0000 7f4bb533d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 0x558f38034f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60924/0 (socket says 172.21.15.100:60924) 2024-09-18T01:25:26.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.879+0000 7f4bb533d640 1 -- 172.21.15.100:0/3847014611 learned_addr learned my addr 172.21.15.100:0/3847014611 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.880+0000 7f4bb533d640 1 -- 172.21.15.100:0/3847014611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f37debfe0 con 0x558f37f3d4c0 2024-09-18T01:25:26.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.880+0000 7f4bb533d640 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 0x558f38034f70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8045960 tx=0x7f4ba8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.880+0000 7f4aa1e03640 1 -- 172.21.15.100:0/3847014611 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba806c070 con 0x558f37f3d4c0 2024-09-18T01:25:26.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.880+0000 7f4aa1e03640 1 -- 172.21.15.100:0/3847014611 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba8054c70 con 0x558f37f3d4c0 2024-09-18T01:25:26.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.880+0000 7f4aa1e03640 1 -- 172.21.15.100:0/3847014611 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba8062070 con 0x558f37f3d4c0 2024-09-18T01:25:26.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.880+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f380354b0 con 0x558f37f3d4c0 2024-09-18T01:25:26.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.880+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f380359d0 con 0x558f37f3d4c0 2024-09-18T01:25:26.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.881+0000 7f4aa1e03640 1 -- 172.21.15.100:0/3847014611 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4ba806f070 con 0x558f37f3d4c0 2024-09-18T01:25:26.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.881+0000 7f4aa1e03640 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a9c036b90 0x7f4a9c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.881+0000 7f4aa1e03640 1 -- 172.21.15.100:0/3847014611 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4ba808fd10 con 0x558f37f3d4c0 2024-09-18T01:25:26.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.881+0000 7f4baffff640 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a9c036b90 0x7f4a9c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.881+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558f37f3de00 0x558f3803bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.881+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f3803c560 con 0x558f37f3de00 2024-09-18T01:25:26.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.881+0000 7f4bb5b3e640 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558f37f3de00 0x558f3803bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.881+0000 7f4baffff640 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a9c036b90 0x7f4a9c039050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0000f60 tx=0x7f4ba00010a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.882+0000 7f4bb5b3e640 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558f37f3de00 0x558f3803bfe0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.882+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/3847014611 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f37f3de00 2024-09-18T01:25:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.882+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f38039590 con 0x558f37f3de00 2024-09-18T01:25:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.882+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/3847014611 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f37f3de00 2024-09-18T01:25:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.882+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558f3803e870 0x558f38040c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.882+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f38041300 con 0x558f3803e870 2024-09-18T01:25:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.882+0000 7f4bb533d640 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558f3803e870 0x558f38040c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.882+0000 7f4bb533d640 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558f3803e870 0x558f38040c60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.883+0000 7f4bb533d640 1 -- 172.21.15.100:0/3847014611 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4ba8078070 con 0x558f3803e870 2024-09-18T01:25:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.883+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f3803d6e0 con 0x558f37f3de00 2024-09-18T01:25:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.883+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/3847014611 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f37f3de00 2024-09-18T01:25:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.883+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558f38042760 0x558f38044b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.883+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f38045240 con 0x558f38042760 2024-09-18T01:25:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.883+0000 7f4baffff640 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558f38042760 0x558f38044b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.884+0000 7f4baffff640 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558f38042760 0x558f38044b50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.884+0000 7f4baffff640 1 -- 172.21.15.100:0/3847014611 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4ba0009050 con 0x558f38042760 2024-09-18T01:25:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.884+0000 7f4bb9c13800 1 Processor -- start 2024-09-18T01:25:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.884+0000 7f4bb9c13800 1 -- start start 2024-09-18T01:25:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.884+0000 7f4bb9c13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f380551b0 0x558f380555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.884+0000 7f4bb9c13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558f37dd9580 con 0x558f380551b0 2024-09-18T01:25:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.885+0000 7f4bb533d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f380551b0 0x558f380555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.885+0000 7f4bb533d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f380551b0 0x558f380555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60928/0 (socket says 172.21.15.100:60928) 2024-09-18T01:25:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.885+0000 7f4bb533d640 1 -- 172.21.15.100:0/643333681 learned_addr learned my addr 172.21.15.100:0/643333681 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.885+0000 7f4bb533d640 1 -- 172.21.15.100:0/643333681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f38055b10 con 0x558f380551b0 2024-09-18T01:25:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.885+0000 7f4bb533d640 1 --2- 172.21.15.100:0/643333681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f380551b0 0x558f380555d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8060040 tx=0x7f4ba80592a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.885+0000 7f4a9affd640 1 -- 172.21.15.100:0/643333681 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba8059040 con 0x558f380551b0 2024-09-18T01:25:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.885+0000 7f4a9affd640 1 -- 172.21.15.100:0/643333681 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba8068420 con 0x558f380551b0 2024-09-18T01:25:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.885+0000 7f4bb9c13800 1 -- 172.21.15.100:0/643333681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f38055da0 con 0x558f380551b0 2024-09-18T01:25:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.885+0000 7f4a9affd640 1 -- 172.21.15.100:0/643333681 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba8059420 con 0x558f380551b0 2024-09-18T01:25:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.885+0000 7f4bb9c13800 1 -- 172.21.15.100:0/643333681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f38058a80 con 0x558f380551b0 2024-09-18T01:25:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.886+0000 7f4a9affd640 1 -- 172.21.15.100:0/643333681 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4ba8065040 con 0x558f380551b0 2024-09-18T01:25:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.886+0000 7f4a9affd640 1 --2- 172.21.15.100:0/643333681 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a90036b40 0x7f4a90039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.886+0000 7f4a9affd640 1 -- 172.21.15.100:0/643333681 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4ba8089170 con 0x558f380551b0 2024-09-18T01:25:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.886+0000 7f4baffff640 1 --2- 172.21.15.100:0/643333681 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a90036b40 0x7f4a90039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.886+0000 7f4bb9c13800 1 Processor -- start 2024-09-18T01:25:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.886+0000 7f4bb9c13800 1 -- start start 2024-09-18T01:25:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.886+0000 7f4baffff640 1 --2- 172.21.15.100:0/643333681 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a90036b40 0x7f4a90039000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000bf90 tx=0x7f4ba000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.887+0000 7f4bb9c13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f38061cb0 0x558f380620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.887+0000 7f4bb9c13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558f3802cca0 con 0x558f38061cb0 2024-09-18T01:25:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.887+0000 7f4bb533d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f38061cb0 0x558f380620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.887+0000 7f4bb533d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f38061cb0 0x558f380620b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60942/0 (socket says 172.21.15.100:60942) 2024-09-18T01:25:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.887+0000 7f4bb533d640 1 -- 172.21.15.100:0/1572918422 learned_addr learned my addr 172.21.15.100:0/1572918422 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.887+0000 7f4bb533d640 1 -- 172.21.15.100:0/1572918422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f38062680 con 0x558f38061cb0 2024-09-18T01:25:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.887+0000 7f4bb533d640 1 --2- 172.21.15.100:0/1572918422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f38061cb0 0x558f380620b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8054a10 tx=0x7f4ba8089100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1854bb2b6445b7af server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.887+0000 7f4a98ff9640 1 -- 172.21.15.100:0/1572918422 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba80a8070 con 0x558f38061cb0 2024-09-18T01:25:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.887+0000 7f4a98ff9640 1 -- 172.21.15.100:0/1572918422 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba80665d0 con 0x558f38061cb0 2024-09-18T01:25:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.887+0000 7f4a98ff9640 1 -- 172.21.15.100:0/1572918422 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba808ec70 con 0x558f38061cb0 2024-09-18T01:25:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.888+0000 7f4bb9c13800 1 -- 172.21.15.100:0/1572918422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f38061cb0 msgr2=0x558f380620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.888+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/1572918422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f38061cb0 0x558f380620b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8054a10 tx=0x7f4ba8089100 comp rx=0 tx=0).stop 2024-09-18T01:25:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.888+0000 7f4bb9c13800 1 -- 172.21.15.100:0/1572918422 shutdown_connections 2024-09-18T01:25:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.888+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/1572918422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f38061cb0 0x558f380620b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.888+0000 7f4bb9c13800 1 -- 172.21.15.100:0/1572918422 >> 172.21.15.100:0/1572918422 conn(0x558f3805e010 msgr2=0x558f3805c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.888+0000 7f4bb9c13800 1 -- 172.21.15.100:0/1572918422 shutdown_connections 2024-09-18T01:25:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.888+0000 7f4bb9c13800 1 -- 172.21.15.100:0/1572918422 wait complete. 2024-09-18T01:25:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.888+0000 7f4bb9c13800 1 Processor -- start 2024-09-18T01:25:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.888+0000 7f4bb9c13800 1 -- start start 2024-09-18T01:25:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.888+0000 7f4bb9c13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f38061cb0 0x558f38068fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.888+0000 7f4bb9c13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558f38062c00 con 0x558f38061cb0 2024-09-18T01:25:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.888+0000 7f4bb533d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f38061cb0 0x558f38068fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.888+0000 7f4bb533d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f38061cb0 0x558f38068fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60950/0 (socket says 172.21.15.100:60950) 2024-09-18T01:25:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.888+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 learned_addr learned my addr 172.21.15.100:0/566477487 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.889+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f38069500 con 0x558f38061cb0 2024-09-18T01:25:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.889+0000 7f4bb533d640 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f38061cb0 0x558f38068fc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8067dd0 tx=0x7f4ba8052fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.889+0000 7f4a86ffd640 1 -- 172.21.15.100:0/566477487 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba80a8050 con 0x558f38061cb0 2024-09-18T01:25:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.889+0000 7f4a86ffd640 1 -- 172.21.15.100:0/566477487 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba80b4070 con 0x558f38061cb0 2024-09-18T01:25:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.889+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f38069500 con 0x558f38061cb0 2024-09-18T01:25:26.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.889+0000 7f4a86ffd640 1 -- 172.21.15.100:0/566477487 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba80856e0 con 0x558f38061cb0 2024-09-18T01:25:26.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.889+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f38069500 con 0x558f38061cb0 2024-09-18T01:25:26.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.890+0000 7f4a86ffd640 1 -- 172.21.15.100:0/566477487 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4ba8085880 con 0x558f38061cb0 2024-09-18T01:25:26.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.890+0000 7f4a86ffd640 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a80036b40 0x7f4a80039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.890+0000 7f4a86ffd640 1 -- 172.21.15.100:0/566477487 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4ba80a0070 con 0x558f38061cb0 2024-09-18T01:25:26.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.890+0000 7f4baffff640 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a80036b40 0x7f4a80039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.890+0000 7f4bb9c13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.890+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558f38074680 0x558f38076b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.890+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f38077290 con 0x558f38074680 2024-09-18T01:25:26.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.890+0000 7f4bb5b3e640 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558f38074680 0x558f38076b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4baffff640 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a80036b40 0x7f4a80039000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x558f380394d0 tx=0x7f4ba0010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb5b3e640 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558f38074680 0x558f38076b40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb9c13800 20 realm 2024-09-18T01:25:26.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb9c13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f380776a0 con 0x558f38074680 2024-09-18T01:25:26.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb9c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:26.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb9c13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f38077f70 con 0x558f38074680 2024-09-18T01:25:26.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb9c13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.891+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f38074680 2024-09-18T01:25:26.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.892+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.892+0000 7f4bb9c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:26.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.892+0000 7f4bb9c13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.892+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558f38078e00 0x558f3807b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.892+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f3807b950 con 0x558f38078e00 2024-09-18T01:25:26.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.892+0000 7f4bb533d640 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558f38078e00 0x558f3807b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.892+0000 7f4bb533d640 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558f38078e00 0x558f3807b1f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.892+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4ba80ab070 con 0x558f38078e00 2024-09-18T01:25:26.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.892+0000 7f4bb9c13800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:26.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.892+0000 7f4bb9c13800 20 searching for the correct realm 2024-09-18T01:25:26.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.892+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558f3807da00 0x558f3807fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.892+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38080590 con 0x558f3807da00 2024-09-18T01:25:26.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.893+0000 7f4baffff640 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558f3807da00 0x558f3807fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.893+0000 7f4baffff640 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558f3807da00 0x558f3807fec0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.893+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba0009050 con 0x558f3807da00 2024-09-18T01:25:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.893+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38080590 con 0x558f38078e00 2024-09-18T01:25:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.893+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba80ab070 con 0x558f38078e00 2024-09-18T01:25:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.893+0000 7f4bb533d640 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4ba80af070 0x7f4ba80b98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.893+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38080590 con 0x7f4ba80af070 2024-09-18T01:25:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.894+0000 7f4bb5b3e640 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4ba80af070 0x7f4ba80b98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.894+0000 7f4bb5b3e640 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4ba80af070 0x7f4ba80b98c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.894+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.894+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f38074680 2024-09-18T01:25:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.894+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.894+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f38074680 2024-09-18T01:25:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.895+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.895+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x7f4ba80af070 2024-09-18T01:25:26.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.895+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.895+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x7f4ba80af070 2024-09-18T01:25:26.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.895+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.895+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f38078e00 2024-09-18T01:25:26.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.895+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba80ab070 con 0x558f38078e00 2024-09-18T01:25:26.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.895+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f3807da00 2024-09-18T01:25:26.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.896+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba0009050 con 0x558f3807da00 2024-09-18T01:25:26.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.896+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f38074680 2024-09-18T01:25:26.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.896+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.896+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x7f4ba80af070 2024-09-18T01:25:26.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.896+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.896+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f38074680 2024-09-18T01:25:26.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.896+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.896+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f38078e00 2024-09-18T01:25:26.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.896+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4ba80ab070 con 0x558f38078e00 2024-09-18T01:25:26.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.896+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f3807da00 2024-09-18T01:25:26.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.897+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba0009050 con 0x558f3807da00 2024-09-18T01:25:26.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.897+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f3807da00 2024-09-18T01:25:26.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.897+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba0009050 con 0x558f3807da00 2024-09-18T01:25:26.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.897+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x7f4ba80af070 2024-09-18T01:25:26.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.897+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.897+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f3807da00 2024-09-18T01:25:26.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.897+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba0009050 con 0x558f3807da00 2024-09-18T01:25:26.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.897+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f3807da00 2024-09-18T01:25:26.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.898+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba0009050 con 0x558f3807da00 2024-09-18T01:25:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.898+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f38074680 2024-09-18T01:25:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.898+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.898+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f38074680 2024-09-18T01:25:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.898+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.898+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x7f4ba80af070 2024-09-18T01:25:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.899+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.899+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f3807da00 2024-09-18T01:25:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.899+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba0009050 con 0x558f3807da00 2024-09-18T01:25:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.899+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f38078e00 2024-09-18T01:25:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.899+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba80ab070 con 0x558f38078e00 2024-09-18T01:25:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.899+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f38074680 2024-09-18T01:25:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.899+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.899+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x7f4ba80af070 2024-09-18T01:25:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.900+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.900+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f3807da00 2024-09-18T01:25:26.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.900+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba0009050 con 0x558f3807da00 2024-09-18T01:25:26.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.900+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x7f4ba80af070 2024-09-18T01:25:26.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.900+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.900+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f38078e00 2024-09-18T01:25:26.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.900+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba80ab070 con 0x558f38078e00 2024-09-18T01:25:26.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.900+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f3807da00 2024-09-18T01:25:26.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba0009050 con 0x558f3807da00 2024-09-18T01:25:26.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x7f4ba80af070 2024-09-18T01:25:26.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f38074680 2024-09-18T01:25:26.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f38078310 con 0x558f38078e00 2024-09-18T01:25:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4ba80ab070 con 0x558f38078e00 2024-09-18T01:25:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4bb9c13800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4bb9c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4bb9c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4bb9c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4bb9c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4bb9c13800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4bb9c13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.901+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f3807c300 con 0x558f38074680 2024-09-18T01:25:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f3807c6f0 con 0x558f38074680 2024-09-18T01:25:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f3807c6f0 con 0x7f4ba80af070 2024-09-18T01:25:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 20 zone default found 2024-09-18T01:25:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 4 Realm: () 2024-09-18T01:25:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 20 zonegroup default 2024-09-18T01:25:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f3807cb10 con 0x7f4ba80af070 2024-09-18T01:25:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.902+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f3807cb10 con 0x558f3807da00 2024-09-18T01:25:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.903+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ba0009050 con 0x558f3807da00 2024-09-18T01:25:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.903+0000 7f4bb9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.903+0000 7f4bb9c13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.903+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f380823f0 con 0x558f3807da00 2024-09-18T01:25:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.903+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ba0009050 con 0x558f3807da00 2024-09-18T01:25:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.903+0000 7f4bb9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.903+0000 7f4bb9c13800 20 started sync module instance, tier type = 2024-09-18T01:25:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.903+0000 7f4bb9c13800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.903+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38081890 con 0x558f38078e00 2024-09-18T01:25:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.904+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba80ab070 con 0x558f38078e00 2024-09-18T01:25:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.904+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94073608740016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38082c90 con 0x558f38078e00 2024-09-18T01:25:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.904+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f380834e0 con 0x558f38074680 2024-09-18T01:25:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.905+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94073608740016] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba80ab070 con 0x558f38078e00 2024-09-18T01:25:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.905+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.905+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94073608745008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38083900 con 0x558f38074680 2024-09-18T01:25:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.905+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38084150 con 0x558f3807da00 2024-09-18T01:25:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.906+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94073608745008] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.906+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba0009050 con 0x558f3807da00 2024-09-18T01:25:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.906+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94073608746544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38084540 con 0x558f3807da00 2024-09-18T01:25:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.906+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38084f90 con 0x558f38078e00 2024-09-18T01:25:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.907+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94073608746544] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba0009050 con 0x558f3807da00 2024-09-18T01:25:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.907+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba80ab070 con 0x558f38078e00 2024-09-18T01:25:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.907+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94073608751744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38085380 con 0x558f38078e00 2024-09-18T01:25:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.907+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38085d80 con 0x558f38074680 2024-09-18T01:25:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.909+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94073608751744] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba80ab070 con 0x558f38078e00 2024-09-18T01:25:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.909+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.909+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94073608747728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38085d40 con 0x558f38074680 2024-09-18T01:25:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.909+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f380867c0 con 0x7f4ba80af070 2024-09-18T01:25:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.911+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.911+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94073608758032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38086730 con 0x7f4ba80af070 2024-09-18T01:25:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.911+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38087770 con 0x7f4ba80af070 2024-09-18T01:25:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.912+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94073608747728] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.912+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94073608758032] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.914+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.914+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94073608760240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38087250 con 0x7f4ba80af070 2024-09-18T01:25:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.914+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38087c20 con 0x7f4ba80af070 2024-09-18T01:25:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.915+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.915+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94073608763248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38088040 con 0x7f4ba80af070 2024-09-18T01:25:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.915+0000 7f4bb9c13800 20 add_watcher() i=0 2024-09-18T01:25:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.915+0000 7f4bb9c13800 20 add_watcher() i=1 2024-09-18T01:25:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.915+0000 7f4bb9c13800 20 add_watcher() i=2 2024-09-18T01:25:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.915+0000 7f4bb9c13800 20 add_watcher() i=3 2024-09-18T01:25:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.915+0000 7f4bb9c13800 20 add_watcher() i=4 2024-09-18T01:25:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.915+0000 7f4bb9c13800 20 add_watcher() i=5 2024-09-18T01:25:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.915+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94073608760240] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.915+0000 7f4bb9c13800 20 add_watcher() i=6 2024-09-18T01:25:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.916+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94073608763248] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.916+0000 7f4bb9c13800 20 add_watcher() i=7 2024-09-18T01:25:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.916+0000 7f4bb9c13800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.916+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f38088040 con 0x558f38074680 2024-09-18T01:25:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.916+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.916+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94073608764304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f38087fb0 con 0x558f38074680 2024-09-18T01:25:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.917+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94073608764304] v33'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.917+0000 7f4a6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.917+0000 7f4bb9c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.917+0000 7f4bb9c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.917+0000 7f4bb9c13800 5 note: GC not initialized 2024-09-18T01:25:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.918+0000 7f4a6a7e4640 20 reqs_thread_entry: start 2024-09-18T01:25:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.918+0000 7f4bb9c13800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.918+0000 7f4bb9c13800 20 Filter name: none 2024-09-18T01:25:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.918+0000 7f49dbfff640 20 reqs_thread_entry: start 2024-09-18T01:25:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.918+0000 7f4bb9c13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.918+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f380bdfe0 con 0x558f38074680 2024-09-18T01:25:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.918+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.918+0000 7f4bb9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:could not fetch user info: no user info saved 2024-09-18T01:25:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.919+0000 7f4a6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.919+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94073608764304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f380bdfa0 con 0x558f38074680 2024-09-18T01:25:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.920+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94073608764304] v33'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.920+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94073608740016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f380bbdb0 con 0x558f38078e00 2024-09-18T01:25:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.921+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94073608740016] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba80ab070 con 0x558f38078e00 2024-09-18T01:25:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.921+0000 7f4bb9c13800 20 remove_watcher() i=0 2024-09-18T01:25:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.921+0000 7f4bb9c13800 2 removed watcher, disabling cache 2024-09-18T01:25:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.921+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94073608745008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f380bbdb0 con 0x558f38074680 2024-09-18T01:25:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.922+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94073608745008] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.922+0000 7f4bb9c13800 20 remove_watcher() i=1 2024-09-18T01:25:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.922+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94073608746544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f380bbdb0 con 0x558f3807da00 2024-09-18T01:25:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.923+0000 7f4baffff640 1 -- 172.21.15.100:0/566477487 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94073608746544] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba0009050 con 0x558f3807da00 2024-09-18T01:25:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.923+0000 7f4bb9c13800 20 remove_watcher() i=2 2024-09-18T01:25:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.923+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94073608751744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f380bdfa0 con 0x558f38078e00 2024-09-18T01:25:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.924+0000 7f4bb533d640 1 -- 172.21.15.100:0/566477487 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94073608751744] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba80ab070 con 0x558f38078e00 2024-09-18T01:25:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.924+0000 7f4bb9c13800 20 remove_watcher() i=3 2024-09-18T01:25:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.924+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94073608747728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f380bdfa0 con 0x558f38074680 2024-09-18T01:25:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.925+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94073608747728] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x558f38074680 2024-09-18T01:25:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.925+0000 7f4bb9c13800 20 remove_watcher() i=4 2024-09-18T01:25:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.925+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94073608758032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f380bdfa0 con 0x7f4ba80af070 2024-09-18T01:25:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.926+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94073608758032] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.926+0000 7f4bb9c13800 20 remove_watcher() i=5 2024-09-18T01:25:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.926+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94073608760240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f380bdfa0 con 0x7f4ba80af070 2024-09-18T01:25:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.927+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94073608760240] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.927+0000 7f4bb9c13800 20 remove_watcher() i=6 2024-09-18T01:25:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.927+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94073608763248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f380bdfa0 con 0x7f4ba80af070 2024-09-18T01:25:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94073608763248] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb000a4a0 con 0x7f4ba80af070 2024-09-18T01:25:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 20 remove_watcher() i=7 2024-09-18T01:25:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4ba80af070 msgr2=0x7f4ba80b98c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4ba80af070 0x7f4ba80b98c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558f38074680 msgr2=0x558f38076b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558f38074680 0x558f38076b40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558f38078e00 msgr2=0x558f3807b1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558f38078e00 0x558f3807b1f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558f3807da00 msgr2=0x558f3807fec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558f3807da00 0x558f3807fec0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a80036b40 msgr2=0x7f4a80039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a80036b40 0x7f4a80039000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x558f380394d0 tx=0x7f4ba0010000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f38061cb0 msgr2=0x558f38068fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/566477487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f38061cb0 0x558f38068fc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8067dd0 tx=0x7f4ba8052fa0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 reap_dead start 2024-09-18T01:25:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/566477487 reap_dead start 2024-09-18T01:25:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 shutdown_connections 2024-09-18T01:25:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 >> 172.21.15.100:0/566477487 conn(0x558f3805e010 msgr2=0x558f3805c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 shutdown_connections 2024-09-18T01:25:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 -- 172.21.15.100:0/566477487 wait complete. 2024-09-18T01:25:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 -- 172.21.15.100:0/643333681 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a90036b40 msgr2=0x7f4a90039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/643333681 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a90036b40 0x7f4a90039000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000bf90 tx=0x7f4ba000f000 comp rx=0 tx=0).stop 2024-09-18T01:25:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 -- 172.21.15.100:0/643333681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f380551b0 msgr2=0x558f380555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.928+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/643333681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f380551b0 0x558f380555d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8060040 tx=0x7f4ba80592a0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 -- 172.21.15.100:0/643333681 shutdown_connections 2024-09-18T01:25:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/643333681 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a90036b40 0x7f4a90039000 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/643333681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f380551b0 0x558f380555d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 -- 172.21.15.100:0/643333681 >> 172.21.15.100:0/643333681 conn(0x558f3802fd80 msgr2=0x558f38030180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 -- 172.21.15.100:0/643333681 shutdown_connections 2024-09-18T01:25:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 -- 172.21.15.100:0/643333681 wait complete. 2024-09-18T01:25:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558f38042760 msgr2=0x558f38044b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558f38042760 0x558f38044b50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558f37f3de00 msgr2=0x558f3803bfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558f37f3de00 0x558f3803bfe0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558f3803e870 msgr2=0x558f38040c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558f3803e870 0x558f38040c60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a9c036b90 msgr2=0x7f4a9c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4a9c036b90 0x7f4a9c039050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0000f60 tx=0x7f4ba00010a0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 msgr2=0x558f38034f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 --2- 172.21.15.100:0/3847014611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f37f3d4c0 0x558f38034f70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8045960 tx=0x7f4ba8002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb5b3e640 1 -- 172.21.15.100:0/3847014611 reap_dead start 2024-09-18T01:25:26.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 shutdown_connections 2024-09-18T01:25:26.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 >> 172.21.15.100:0/3847014611 conn(0x558f37f38df0 msgr2=0x558f38026820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 shutdown_connections 2024-09-18T01:25:26.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.929+0000 7f4bb9c13800 1 -- 172.21.15.100:0/3847014611 wait complete. 2024-09-18T01:25:26.938 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T01:25:26.939 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-18T01:25:26.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-18T01:25:26.939 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-18T01:25:26.993 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:26.994 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:26.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.993+0000 7ff22b12a800 1 Processor -- start 2024-09-18T01:25:26.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.993+0000 7ff22b12a800 1 -- start start 2024-09-18T01:25:26.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.993+0000 7ff22b12a800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5568be44a510 0x5568be44a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:26.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.993+0000 7ff22b12a800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5568be30ab30 con 0x5568be44ae50 2024-09-18T01:25:26.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.993+0000 7ff22b12a800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5568be2ec360 con 0x5568be44a510 2024-09-18T01:25:26.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.993+0000 7ff226eb7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5568be44a510 0x5568be44a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:26.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.994+0000 7ff2266b6640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5568be44ae50 0x5568be44f9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59208/0 (socket says 172.21.15.100:59208) 2024-09-18T01:25:26.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.994+0000 7ff2266b6640 1 -- 172.21.15.100:0/914247793 learned_addr learned my addr 172.21.15.100:0/914247793 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:26.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.994+0000 7ff226eb7640 1 -- 172.21.15.100:0/914247793 >> v1:172.21.15.92:6789/0 conn(0x5568be44ae50 legacy=0x5568be44f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.994+0000 7ff226eb7640 1 -- 172.21.15.100:0/914247793 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568be312e00 con 0x5568be44a510 2024-09-18T01:25:26.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.995+0000 7ff226eb7640 1 --2- 172.21.15.100:0/914247793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 0x5568be44a910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff218005fd0 tx=0x7ff218045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db729722927a0ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:26.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.996+0000 7ff225eb5640 1 -- 172.21.15.100:0/914247793 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff218058530 con 0x5568be44a510 2024-09-18T01:25:26.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.996+0000 7ff225eb5640 1 -- 172.21.15.100:0/914247793 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2180586d0 con 0x5568be44a510 2024-09-18T01:25:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.996+0000 7ff225eb5640 1 -- 172.21.15.100:0/914247793 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2180589d0 con 0x5568be44a510 2024-09-18T01:25:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.996+0000 7ff22b12a800 1 -- 172.21.15.100:0/914247793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 msgr2=0x5568be44a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.996+0000 7ff22b12a800 1 --2- 172.21.15.100:0/914247793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 0x5568be44a910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff218005fd0 tx=0x7ff218045c30 comp rx=0 tx=0).stop 2024-09-18T01:25:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.996+0000 7ff22b12a800 1 -- 172.21.15.100:0/914247793 shutdown_connections 2024-09-18T01:25:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.996+0000 7ff22b12a800 1 --2- 172.21.15.100:0/914247793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 0x5568be44a910 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.996+0000 7ff22b12a800 1 -- 172.21.15.100:0/914247793 >> 172.21.15.100:0/914247793 conn(0x5568be445de0 msgr2=0x5568be448200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.996+0000 7ff22b12a800 1 -- 172.21.15.100:0/914247793 shutdown_connections 2024-09-18T01:25:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:26.996+0000 7ff22b12a800 1 -- 172.21.15.100:0/914247793 wait complete. 2024-09-18T01:25:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.010+0000 7ff22b12a800 1 Processor -- start 2024-09-18T01:25:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.010+0000 7ff22b12a800 1 -- start start 2024-09-18T01:25:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.010+0000 7ff22b12a800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 0x5568be3bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.010+0000 7ff22b12a800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5568be397450 con 0x5568be44a510 2024-09-18T01:25:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.010+0000 7ff226eb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 0x5568be3bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.010+0000 7ff226eb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 0x5568be3bf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60968/0 (socket says 172.21.15.100:60968) 2024-09-18T01:25:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.010+0000 7ff226eb7640 1 -- 172.21.15.100:0/3569614131 learned_addr learned my addr 172.21.15.100:0/3569614131 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.010+0000 7ff226eb7640 1 -- 172.21.15.100:0/3569614131 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568be2e4bc0 con 0x5568be44a510 2024-09-18T01:25:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.010+0000 7ff226eb7640 1 --2- 172.21.15.100:0/3569614131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 0x5568be3bf5f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff21800a3f0 tx=0x7ff218051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13af8c148595d5c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.011+0000 7ff114e09640 1 -- 172.21.15.100:0/3569614131 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2180589b0 con 0x5568be44a510 2024-09-18T01:25:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.011+0000 7ff114e09640 1 -- 172.21.15.100:0/3569614131 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff218068070 con 0x5568be44a510 2024-09-18T01:25:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.011+0000 7ff114e09640 1 -- 172.21.15.100:0/3569614131 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff218058c80 con 0x5568be44a510 2024-09-18T01:25:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.011+0000 7ff22b12a800 1 -- 172.21.15.100:0/3569614131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 msgr2=0x5568be3bf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.011+0000 7ff22b12a800 1 --2- 172.21.15.100:0/3569614131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 0x5568be3bf5f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff21800a3f0 tx=0x7ff218051000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.011+0000 7ff22b12a800 1 -- 172.21.15.100:0/3569614131 shutdown_connections 2024-09-18T01:25:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.011+0000 7ff22b12a800 1 --2- 172.21.15.100:0/3569614131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 0x5568be3bf5f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.011+0000 7ff22b12a800 1 -- 172.21.15.100:0/3569614131 >> 172.21.15.100:0/3569614131 conn(0x5568be445de0 msgr2=0x5568be5352a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.011+0000 7ff22b12a800 1 -- 172.21.15.100:0/3569614131 shutdown_connections 2024-09-18T01:25:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.011+0000 7ff22b12a800 1 -- 172.21.15.100:0/3569614131 wait complete. 2024-09-18T01:25:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.012+0000 7ff22b12a800 1 Processor -- start 2024-09-18T01:25:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.012+0000 7ff22b12a800 1 -- start start 2024-09-18T01:25:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.012+0000 7ff22b12a800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 0x5568be544520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.012+0000 7ff22b12a800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5568be451530 con 0x5568be44a510 2024-09-18T01:25:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.012+0000 7ff226eb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 0x5568be544520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.012+0000 7ff226eb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 0x5568be544520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60980/0 (socket says 172.21.15.100:60980) 2024-09-18T01:25:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.012+0000 7ff226eb7640 1 -- 172.21.15.100:0/1167752770 learned_addr learned my addr 172.21.15.100:0/1167752770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.012+0000 7ff226eb7640 1 -- 172.21.15.100:0/1167752770 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568be2f8fe0 con 0x5568be44a510 2024-09-18T01:25:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.013+0000 7ff226eb7640 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 0x5568be544520 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff218065040 tx=0x7ff218003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.013+0000 7ff113606640 1 -- 172.21.15.100:0/1167752770 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff218063650 con 0x5568be44a510 2024-09-18T01:25:27.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.013+0000 7ff113606640 1 -- 172.21.15.100:0/1167752770 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2180637f0 con 0x5568be44a510 2024-09-18T01:25:27.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.013+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568be544a60 con 0x5568be44a510 2024-09-18T01:25:27.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.013+0000 7ff113606640 1 -- 172.21.15.100:0/1167752770 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff218063af0 con 0x5568be44a510 2024-09-18T01:25:27.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.013+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568be544f80 con 0x5568be44a510 2024-09-18T01:25:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.014+0000 7ff113606640 1 -- 172.21.15.100:0/1167752770 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff218074020 con 0x5568be44a510 2024-09-18T01:25:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.014+0000 7ff113606640 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff10c036b40 0x7ff10c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.014+0000 7ff113606640 1 -- 172.21.15.100:0/1167752770 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff2180909f0 con 0x5568be44a510 2024-09-18T01:25:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.014+0000 7ff2266b6640 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff10c036b40 0x7ff10c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.014+0000 7ff22b12a800 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5568be44ae50 0x5568be54b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.014+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be54bad0 con 0x5568be44ae50 2024-09-18T01:25:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.014+0000 7ff2276b8640 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5568be44ae50 0x5568be54b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.014+0000 7ff2266b6640 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff10c036b40 0x7ff10c039000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff21c000f60 tx=0x7ff21c0012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.014+0000 7ff2276b8640 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5568be44ae50 0x5568be54b590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.015+0000 7ff2276b8640 1 -- 172.21.15.100:0/1167752770 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2200083e0 con 0x5568be44ae50 2024-09-18T01:25:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.015+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be548b40 con 0x5568be44ae50 2024-09-18T01:25:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.015+0000 7ff2276b8640 1 -- 172.21.15.100:0/1167752770 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2200083e0 con 0x5568be44ae50 2024-09-18T01:25:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.015+0000 7ff22b12a800 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5568be54dde0 0x5568be5501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.015+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be5508c0 con 0x5568be54dde0 2024-09-18T01:25:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.015+0000 7ff226eb7640 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5568be54dde0 0x5568be5501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.015+0000 7ff226eb7640 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5568be54dde0 0x5568be5501d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.016+0000 7ff226eb7640 1 -- 172.21.15.100:0/1167752770 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be54dde0 2024-09-18T01:25:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.016+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be54cc80 con 0x5568be44ae50 2024-09-18T01:25:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.016+0000 7ff2276b8640 1 -- 172.21.15.100:0/1167752770 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff2200083e0 con 0x5568be44ae50 2024-09-18T01:25:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.016+0000 7ff22b12a800 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5568be551d20 0x5568be554110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.016+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be554850 con 0x5568be551d20 2024-09-18T01:25:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.016+0000 7ff2266b6640 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5568be551d20 0x5568be554110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.017+0000 7ff2266b6640 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5568be551d20 0x5568be554110 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.017+0000 7ff2266b6640 1 -- 172.21.15.100:0/1167752770 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff21c009050 con 0x5568be551d20 2024-09-18T01:25:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.017+0000 7ff22b12a800 1 Processor -- start 2024-09-18T01:25:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.018+0000 7ff22b12a800 1 -- start start 2024-09-18T01:25:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.018+0000 7ff22b12a800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be5625d0 0x5568be5629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.018+0000 7ff22b12a800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5568be2e6580 con 0x5568be5625d0 2024-09-18T01:25:27.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.018+0000 7ff226eb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be5625d0 0x5568be5629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.018+0000 7ff226eb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be5625d0 0x5568be5629f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60986/0 (socket says 172.21.15.100:60986) 2024-09-18T01:25:27.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.018+0000 7ff226eb7640 1 -- 172.21.15.100:0/1617434366 learned_addr learned my addr 172.21.15.100:0/1617434366 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.018+0000 7ff226eb7640 1 -- 172.21.15.100:0/1617434366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568be562f30 con 0x5568be5625d0 2024-09-18T01:25:27.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.018+0000 7ff226eb7640 1 --2- 172.21.15.100:0/1617434366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be5625d0 0x5568be5629f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff21808ee80 tx=0x7ff21807ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.018+0000 7ff110e01640 1 -- 172.21.15.100:0/1617434366 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff21806b700 con 0x5568be5625d0 2024-09-18T01:25:27.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.018+0000 7ff110e01640 1 -- 172.21.15.100:0/1617434366 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21806b8a0 con 0x5568be5625d0 2024-09-18T01:25:27.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.018+0000 7ff22b12a800 1 -- 172.21.15.100:0/1617434366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568be5631c0 con 0x5568be5625d0 2024-09-18T01:25:27.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.018+0000 7ff110e01640 1 -- 172.21.15.100:0/1617434366 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2180901c0 con 0x5568be5625d0 2024-09-18T01:25:27.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.018+0000 7ff22b12a800 1 -- 172.21.15.100:0/1617434366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568be565ea0 con 0x5568be5625d0 2024-09-18T01:25:27.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.019+0000 7ff110e01640 1 -- 172.21.15.100:0/1617434366 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff218090d10 con 0x5568be5625d0 2024-09-18T01:25:27.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.019+0000 7ff110e01640 1 --2- 172.21.15.100:0/1617434366 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff100036b40 0x7ff100039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.019+0000 7ff110e01640 1 -- 172.21.15.100:0/1617434366 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff218086040 con 0x5568be5625d0 2024-09-18T01:25:27.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.019+0000 7ff2266b6640 1 --2- 172.21.15.100:0/1617434366 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff100036b40 0x7ff100039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.020+0000 7ff22b12a800 1 Processor -- start 2024-09-18T01:25:27.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.020+0000 7ff22b12a800 1 -- start start 2024-09-18T01:25:27.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.020+0000 7ff2266b6640 1 --2- 172.21.15.100:0/1617434366 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff100036b40 0x7ff100039000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00bf50 tx=0x7ff21c00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.020+0000 7ff22b12a800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be56f0d0 0x5568be56f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.020+0000 7ff22b12a800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5568be53fb10 con 0x5568be56f0d0 2024-09-18T01:25:27.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.020+0000 7ff226eb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be56f0d0 0x5568be56f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.020+0000 7ff226eb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be56f0d0 0x5568be56f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:60996/0 (socket says 172.21.15.100:60996) 2024-09-18T01:25:27.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.020+0000 7ff226eb7640 1 -- 172.21.15.100:0/3639332121 learned_addr learned my addr 172.21.15.100:0/3639332121 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.020+0000 7ff226eb7640 1 -- 172.21.15.100:0/3639332121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568be56faa0 con 0x5568be56f0d0 2024-09-18T01:25:27.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.020+0000 7ff226eb7640 1 --2- 172.21.15.100:0/3639332121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be56f0d0 0x5568be56f4d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff21808e970 tx=0x7ff21808e1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158f1b68f664ff1e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.021+0000 7ff10a7fc640 1 -- 172.21.15.100:0/3639332121 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff21807e4d0 con 0x5568be56f0d0 2024-09-18T01:25:27.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.021+0000 7ff10a7fc640 1 -- 172.21.15.100:0/3639332121 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21807e8c0 con 0x5568be56f0d0 2024-09-18T01:25:27.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.021+0000 7ff10a7fc640 1 -- 172.21.15.100:0/3639332121 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff21808e3b0 con 0x5568be56f0d0 2024-09-18T01:25:27.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.021+0000 7ff22b12a800 1 -- 172.21.15.100:0/3639332121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be56f0d0 msgr2=0x5568be56f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.021+0000 7ff22b12a800 1 --2- 172.21.15.100:0/3639332121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be56f0d0 0x5568be56f4d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff21808e970 tx=0x7ff21808e1d0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.021+0000 7ff22b12a800 1 -- 172.21.15.100:0/3639332121 shutdown_connections 2024-09-18T01:25:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.021+0000 7ff22b12a800 1 --2- 172.21.15.100:0/3639332121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be56f0d0 0x5568be56f4d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.021+0000 7ff22b12a800 1 -- 172.21.15.100:0/3639332121 >> 172.21.15.100:0/3639332121 conn(0x5568be56b430 msgr2=0x5568be569530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.021+0000 7ff22b12a800 1 -- 172.21.15.100:0/3639332121 shutdown_connections 2024-09-18T01:25:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.021+0000 7ff22b12a800 1 -- 172.21.15.100:0/3639332121 wait complete. 2024-09-18T01:25:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.021+0000 7ff22b12a800 1 Processor -- start 2024-09-18T01:25:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.021+0000 7ff22b12a800 1 -- start start 2024-09-18T01:25:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.022+0000 7ff22b12a800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be56f0d0 0x5568be5763c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.022+0000 7ff22b12a800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5568be570020 con 0x5568be56f0d0 2024-09-18T01:25:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.022+0000 7ff226eb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be56f0d0 0x5568be5763c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.022+0000 7ff226eb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be56f0d0 0x5568be5763c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32780/0 (socket says 172.21.15.100:32780) 2024-09-18T01:25:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.022+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 learned_addr learned my addr 172.21.15.100:0/298568518 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.022+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568be576900 con 0x5568be56f0d0 2024-09-18T01:25:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.022+0000 7ff226eb7640 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be56f0d0 0x5568be5763c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff21807bfd0 tx=0x7ff218051f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.022+0000 7ff108ff9640 1 -- 172.21.15.100:0/298568518 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff21804f7b0 con 0x5568be56f0d0 2024-09-18T01:25:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.022+0000 7ff108ff9640 1 -- 172.21.15.100:0/298568518 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff218090360 con 0x5568be56f0d0 2024-09-18T01:25:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.022+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568be576900 con 0x5568be56f0d0 2024-09-18T01:25:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.022+0000 7ff108ff9640 1 -- 172.21.15.100:0/298568518 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff218090680 con 0x5568be56f0d0 2024-09-18T01:25:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.023+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568be576900 con 0x5568be56f0d0 2024-09-18T01:25:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.023+0000 7ff108ff9640 1 -- 172.21.15.100:0/298568518 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff2180be020 con 0x5568be56f0d0 2024-09-18T01:25:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.023+0000 7ff108ff9640 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff0f0036b90 0x7ff0f0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.023+0000 7ff108ff9640 1 -- 172.21.15.100:0/298568518 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff2180bc020 con 0x5568be56f0d0 2024-09-18T01:25:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.023+0000 7ff2266b6640 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff0f0036b90 0x7ff0f0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.024+0000 7ff2266b6640 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff0f0036b90 0x7ff0f0039050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff21c001b60 tx=0x7ff21c010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.024+0000 7ff22b12a800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.024+0000 7ff22b12a800 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5568be581990 0x5568be583e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.024+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be5845a0 con 0x5568be581990 2024-09-18T01:25:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.024+0000 7ff2276b8640 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5568be581990 0x5568be583e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff2276b8640 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5568be581990 0x5568be583e50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2200083e0 con 0x5568be581990 2024-09-18T01:25:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 20 realm 2024-09-18T01:25:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be5849b0 con 0x5568be581990 2024-09-18T01:25:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2200083e0 con 0x5568be581990 2024-09-18T01:25:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be581990 2024-09-18T01:25:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2200083e0 con 0x5568be581990 2024-09-18T01:25:27.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be585620 con 0x5568be581990 2024-09-18T01:25:27.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2200083e0 con 0x5568be581990 2024-09-18T01:25:27.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:27.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5568be585fe0 0x5568be5883d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.025+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be588a20 con 0x5568be585fe0 2024-09-18T01:25:27.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.026+0000 7ff226eb7640 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5568be585fe0 0x5568be5883d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.026+0000 7ff226eb7640 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5568be585fe0 0x5568be5883d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.026+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.026+0000 7ff22b12a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:27.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.026+0000 7ff22b12a800 20 searching for the correct realm 2024-09-18T01:25:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.026+0000 7ff22b12a800 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5568be58a9b0 0x5568be58ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.026+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be58d540 con 0x5568be58a9b0 2024-09-18T01:25:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.026+0000 7ff2266b6640 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5568be58a9b0 0x5568be58ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.026+0000 7ff2266b6640 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5568be58a9b0 0x5568be58ce70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.027+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21c009050 con 0x5568be58a9b0 2024-09-18T01:25:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.027+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be58d540 con 0x5568be585fe0 2024-09-18T01:25:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.027+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.027+0000 7ff226eb7640 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff21809e970 0x7ff2180973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.027+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be58d540 con 0x7ff21809e970 2024-09-18T01:25:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.027+0000 7ff2276b8640 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff21809e970 0x7ff2180973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.027+0000 7ff2276b8640 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff21809e970 0x7ff2180973a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.028+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff2200083e0 con 0x7ff21809e970 2024-09-18T01:25:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.028+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be581990 2024-09-18T01:25:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.028+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2200083e0 con 0x5568be581990 2024-09-18T01:25:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.028+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be581990 2024-09-18T01:25:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.028+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.028+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x7ff21809e970 2024-09-18T01:25:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.028+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.028+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x7ff21809e970 2024-09-18T01:25:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.029+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.029+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be585fe0 2024-09-18T01:25:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.029+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.029+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be58a9b0 2024-09-18T01:25:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.029+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21c009050 con 0x5568be58a9b0 2024-09-18T01:25:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.029+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be581990 2024-09-18T01:25:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.029+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.029+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x7ff21809e970 2024-09-18T01:25:27.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.030+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.030+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be581990 2024-09-18T01:25:27.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.030+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.030+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be585fe0 2024-09-18T01:25:27.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.030+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.030+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be58a9b0 2024-09-18T01:25:27.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.030+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21c009050 con 0x5568be58a9b0 2024-09-18T01:25:27.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.030+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be58a9b0 2024-09-18T01:25:27.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.030+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21c009050 con 0x5568be58a9b0 2024-09-18T01:25:27.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.030+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x7ff21809e970 2024-09-18T01:25:27.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.031+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.031+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be58a9b0 2024-09-18T01:25:27.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.031+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21c009050 con 0x5568be58a9b0 2024-09-18T01:25:27.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.031+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be58a9b0 2024-09-18T01:25:27.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.031+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21c009050 con 0x5568be58a9b0 2024-09-18T01:25:27.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.031+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be581990 2024-09-18T01:25:27.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.031+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.031+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be581990 2024-09-18T01:25:27.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.032+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.032+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x7ff21809e970 2024-09-18T01:25:27.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.032+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.032+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be58a9b0 2024-09-18T01:25:27.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.032+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21c009050 con 0x5568be58a9b0 2024-09-18T01:25:27.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.032+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be585fe0 2024-09-18T01:25:27.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.032+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.032+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be581990 2024-09-18T01:25:27.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.033+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.033+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x7ff21809e970 2024-09-18T01:25:27.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.033+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.033+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be58a9b0 2024-09-18T01:25:27.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.033+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21c009050 con 0x5568be58a9b0 2024-09-18T01:25:27.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.033+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x7ff21809e970 2024-09-18T01:25:27.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.033+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.033+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be585fe0 2024-09-18T01:25:27.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.034+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.034+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be58a9b0 2024-09-18T01:25:27.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.034+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21c009050 con 0x5568be58a9b0 2024-09-18T01:25:27.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.034+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x7ff21809e970 2024-09-18T01:25:27.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.034+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.034+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be581990 2024-09-18T01:25:27.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.034+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.034+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568be585280 con 0x5568be585fe0 2024-09-18T01:25:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be588dc0 con 0x5568be581990 2024-09-18T01:25:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be5891b0 con 0x5568be581990 2024-09-18T01:25:27.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:27.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be5891b0 con 0x7ff21809e970 2024-09-18T01:25:27.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:27.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 zone default found 2024-09-18T01:25:27.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 4 Realm: () 2024-09-18T01:25:27.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:27.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:27.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:27.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 zonegroup default 2024-09-18T01:25:27.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.035+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be589ee0 con 0x7ff21809e970 2024-09-18T01:25:27.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.036+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.036+0000 7ff22b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.036+0000 7ff22b12a800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.036+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be589ee0 con 0x5568be58a9b0 2024-09-18T01:25:27.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.036+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff21c009050 con 0x5568be58a9b0 2024-09-18T01:25:27.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.036+0000 7ff22b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.036+0000 7ff22b12a800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.036+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be58f3f0 con 0x5568be58a9b0 2024-09-18T01:25:27.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.036+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff21c009050 con 0x5568be58a9b0 2024-09-18T01:25:27.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.036+0000 7ff22b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.036+0000 7ff22b12a800 20 started sync module instance, tier type = 2024-09-18T01:25:27.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.036+0000 7ff22b12a800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:27.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.036+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be58e840 con 0x5568be585fe0 2024-09-18T01:25:27.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.037+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.037+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93908358458416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be58e4a0 con 0x5568be585fe0 2024-09-18T01:25:27.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.037+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be590320 con 0x5568be581990 2024-09-18T01:25:27.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.038+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93908358458416] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.038+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.038+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93908358463088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be590290 con 0x5568be581990 2024-09-18T01:25:27.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.038+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be5911e0 con 0x5568be58a9b0 2024-09-18T01:25:27.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.040+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93908358463088] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.040+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21c009050 con 0x5568be58a9b0 2024-09-18T01:25:27.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.040+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93908358466864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be5915d0 con 0x5568be58a9b0 2024-09-18T01:25:27.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.040+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be591fd0 con 0x5568be585fe0 2024-09-18T01:25:27.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.041+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.041+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93908358470368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be5928a0 con 0x5568be585fe0 2024-09-18T01:25:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.041+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be593390 con 0x5568be581990 2024-09-18T01:25:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.041+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93908358466864] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21c009050 con 0x5568be58a9b0 2024-09-18T01:25:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.042+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93908358470368] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.042+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.042+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93908358475360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be5923f0 con 0x5568be581990 2024-09-18T01:25:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.042+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be593c30 con 0x7ff21809e970 2024-09-18T01:25:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.043+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93908358475360] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.044+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.044+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93908358465296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be5923f0 con 0x7ff21809e970 2024-09-18T01:25:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.044+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be594240 con 0x7ff21809e970 2024-09-18T01:25:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.045+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93908358465296] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.046+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.046+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93908358479136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be594240 con 0x7ff21809e970 2024-09-18T01:25:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.046+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be594c50 con 0x7ff21809e970 2024-09-18T01:25:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.047+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93908358479136] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.047+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.047+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93908358477360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be594c50 con 0x7ff21809e970 2024-09-18T01:25:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.047+0000 7ff22b12a800 20 add_watcher() i=0 2024-09-18T01:25:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.047+0000 7ff22b12a800 20 add_watcher() i=1 2024-09-18T01:25:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.047+0000 7ff22b12a800 20 add_watcher() i=2 2024-09-18T01:25:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.047+0000 7ff22b12a800 20 add_watcher() i=3 2024-09-18T01:25:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.047+0000 7ff22b12a800 20 add_watcher() i=4 2024-09-18T01:25:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.047+0000 7ff22b12a800 20 add_watcher() i=5 2024-09-18T01:25:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.047+0000 7ff22b12a800 20 add_watcher() i=6 2024-09-18T01:25:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.047+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93908358477360] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.047+0000 7ff22b12a800 20 add_watcher() i=7 2024-09-18T01:25:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.047+0000 7ff22b12a800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.047+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be598070 con 0x5568be581990 2024-09-18T01:25:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.048+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.048+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93908358482288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be595540 con 0x5568be581990 2024-09-18T01:25:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.049+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93908358482288] v33'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.049+0000 7ff0dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.049+0000 7ff22b12a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.049+0000 7ff22b12a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.049+0000 7ff22b12a800 5 note: GC not initialized 2024-09-18T01:25:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.049+0000 7ff057fff640 20 reqs_thread_entry: start 2024-09-18T01:25:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.049+0000 7ff22b12a800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.049+0000 7ff22b12a800 20 Filter name: none 2024-09-18T01:25:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.049+0000 7ff055ffb640 20 reqs_thread_entry: start 2024-09-18T01:25:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be5cb4f0 con 0x5568be581990 2024-09-18T01:25:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-18T01:25:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-18T01:25:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be5c9b30 con 0x5568be581990 2024-09-18T01:25:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-18T01:25:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-18T01:25:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-18T01:25:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.050+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be5c9b30 con 0x7ff21809e970 2024-09-18T01:25:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.051+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.051+0000 7ff22b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.051+0000 7ff22b12a800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-18T01:25:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.051+0000 7ff22b12a800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-18T01:25:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.051+0000 7ff22b12a800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-18T01:25:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.051+0000 7ff22b12a800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-18T01:25:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.051+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be5ca550 con 0x5568be581990 2024-09-18T01:25:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.052+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v33'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.052+0000 7ff22b12a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.052+0000 7ff22b12a800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.052+0000 7ff22b12a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.052+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 93908358700912 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be5cefa0 con 0x5568be581990 2024-09-18T01:25:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.052+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== watch-notify(notify (1) cookie 93908358475360 notify 141733920768 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5568be5ca8f0 con 0x5568be581990 2024-09-18T01:25:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.052+0000 7ff10a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 93908358475360 notifier 4300 bl.length()=567 2024-09-18T01:25:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.052+0000 7ff10a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.052+0000 7ff10a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.052+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(66 notify.4 [notify cookie 93908358700912 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.052+0000 7ff10a7fc640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff0ec003ea0 con 0x5568be581990 2024-09-18T01:25:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.052+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.052+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== watch-notify(notify_complete (2) cookie 93908358700912 notify 141733920768 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5568be5cb110 con 0x5568be581990 2024-09-18T01:25:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.053+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be5c9f20 con 0x5568be581990 2024-09-18T01:25:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.054+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.054+0000 7ff22b12a800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-18T01:25:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.054+0000 7ff22b12a800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-18T01:25:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.054+0000 7ff22b12a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-18T01:25:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.054+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 93908358700688 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be5cef40 con 0x5568be585fe0 2024-09-18T01:25:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.054+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== watch-notify(notify (1) cookie 93908358470368 notify 141733920768 ret 0) ==== 211+0+0 (crc 0 0 0) 0x5568be5631c0 con 0x5568be585fe0 2024-09-18T01:25:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.054+0000 7ff10a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 93908358470368 notifier 4300 bl.length()=169 2024-09-18T01:25:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.054+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(69 notify.3 [notify cookie 93908358700688 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.054+0000 7ff10a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-18T01:25:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.054+0000 7ff10a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-18T01:25:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.054+0000 7ff10a7fc640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff0ec003ea0 con 0x5568be585fe0 2024-09-18T01:25:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.054+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.054+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== watch-notify(notify_complete (2) cookie 93908358700688 notify 141733920768 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5568be562f30 con 0x5568be585fe0 2024-09-18T01:25:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.054+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be5ccf20 con 0x7ff21809e970 2024-09-18T01:25:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.056+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.056+0000 7ff22b12a800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-18T01:25:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.056+0000 7ff22b12a800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-18T01:25:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.056+0000 7ff22b12a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-18T01:25:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.056+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 93908358716032 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568be5cf3f0 con 0x5568be585fe0 2024-09-18T01:25:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.056+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== watch-notify(notify (1) cookie 93908358470368 notify 141733920769 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5568be562f30 con 0x5568be585fe0 2024-09-18T01:25:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.056+0000 7ff10a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 93908358470368 notifier 4300 bl.length()=177 2024-09-18T01:25:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.056+0000 7ff10a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-18T01:25:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.056+0000 7ff10a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-18T01:25:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.056+0000 7ff10a7fc640 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff0ec003ea0 con 0x5568be585fe0 2024-09-18T01:25:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.056+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(72 notify.3 [notify cookie 93908358716032 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.056+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.056+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== watch-notify(notify_complete (2) cookie 93908358716032 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5568be544f80 con 0x5568be585fe0 2024-09-18T01:25:27.067 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.057+0000 7ff0dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.057+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93908358482288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be5c91d0 con 0x5568be581990 2024-09-18T01:25:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.058+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 93908358482288] v33'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.058+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93908358458416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be5c91d0 con 0x5568be585fe0 2024-09-18T01:25:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.059+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 93908358458416] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.059+0000 7ff22b12a800 20 remove_watcher() i=0 2024-09-18T01:25:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.059+0000 7ff22b12a800 2 removed watcher, disabling cache 2024-09-18T01:25:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.059+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93908358463088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be5c91d0 con 0x5568be581990 2024-09-18T01:25:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.062+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 93908358463088] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.062+0000 7ff22b12a800 20 remove_watcher() i=1 2024-09-18T01:25:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.062+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93908358466864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be5c91d0 con 0x5568be58a9b0 2024-09-18T01:25:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.063+0000 7ff2266b6640 1 -- 172.21.15.100:0/298568518 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 93908358466864] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21c009050 con 0x5568be58a9b0 2024-09-18T01:25:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.063+0000 7ff22b12a800 20 remove_watcher() i=2 2024-09-18T01:25:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.063+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93908358470368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be590d30 con 0x5568be585fe0 2024-09-18T01:25:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.064+0000 7ff226eb7640 1 -- 172.21.15.100:0/298568518 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 93908358470368] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21806c3f0 con 0x5568be585fe0 2024-09-18T01:25:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.064+0000 7ff22b12a800 20 remove_watcher() i=3 2024-09-18T01:25:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.064+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93908358475360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be590d30 con 0x5568be581990 2024-09-18T01:25:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.065+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 93908358475360] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5568be581990 2024-09-18T01:25:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.065+0000 7ff22b12a800 20 remove_watcher() i=4 2024-09-18T01:25:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.065+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93908358465296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be592e60 con 0x7ff21809e970 2024-09-18T01:25:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.067+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 93908358465296] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.067+0000 7ff22b12a800 20 remove_watcher() i=5 2024-09-18T01:25:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.067+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93908358479136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be590d30 con 0x7ff21809e970 2024-09-18T01:25:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.068+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 93908358479136] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.068+0000 7ff22b12a800 20 remove_watcher() i=6 2024-09-18T01:25:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.068+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93908358477360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568be592e60 con 0x7ff21809e970 2024-09-18T01:25:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 93908358477360] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x7ff21809e970 2024-09-18T01:25:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 20 remove_watcher() i=7 2024-09-18T01:25:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff21809e970 msgr2=0x7ff2180973a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff21809e970 0x7ff2180973a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5568be581990 msgr2=0x5568be583e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5568be581990 0x5568be583e50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5568be585fe0 msgr2=0x5568be5883d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5568be585fe0 0x5568be5883d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5568be58a9b0 msgr2=0x5568be58ce70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5568be58a9b0 0x5568be58ce70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff0f0036b90 msgr2=0x7ff0f0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff0f0036b90 0x7ff0f0039050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff21c001b60 tx=0x7ff21c010000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff2276b8640 1 -- 172.21.15.100:0/298568518 reap_dead start 2024-09-18T01:25:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be56f0d0 msgr2=0x5568be5763c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be56f0d0 0x5568be5763c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff21807bfd0 tx=0x7ff218051f10 comp rx=0 tx=0).stop 2024-09-18T01:25:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 shutdown_connections 2024-09-18T01:25:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 --2- 172.21.15.100:0/298568518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be56f0d0 0x5568be5763c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 >> 172.21.15.100:0/298568518 conn(0x5568be56b430 msgr2=0x5568be569500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 shutdown_connections 2024-09-18T01:25:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.069+0000 7ff22b12a800 1 -- 172.21.15.100:0/298568518 wait complete. 2024-09-18T01:25:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1617434366 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff100036b40 msgr2=0x7ff100039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 --2- 172.21.15.100:0/1617434366 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff100036b40 0x7ff100039000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00bf50 tx=0x7ff21c00f000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1617434366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be5625d0 msgr2=0x5568be5629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 --2- 172.21.15.100:0/1617434366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be5625d0 0x5568be5629f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff21808ee80 tx=0x7ff21807ef90 comp rx=0 tx=0).stop 2024-09-18T01:25:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1617434366 shutdown_connections 2024-09-18T01:25:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 --2- 172.21.15.100:0/1617434366 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff100036b40 0x7ff100039000 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 --2- 172.21.15.100:0/1617434366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be5625d0 0x5568be5629f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1617434366 >> 172.21.15.100:0/1617434366 conn(0x5568be557560 msgr2=0x5568be55a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1617434366 shutdown_connections 2024-09-18T01:25:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1617434366 wait complete. 2024-09-18T01:25:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5568be551d20 msgr2=0x5568be554110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5568be551d20 0x5568be554110 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5568be44ae50 msgr2=0x5568be54b590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5568be44ae50 0x5568be54b590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5568be54dde0 msgr2=0x5568be5501d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5568be54dde0 0x5568be5501d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff10c036b40 msgr2=0x7ff10c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff10c036b40 0x7ff10c039000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff21c000f60 tx=0x7ff21c0012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 msgr2=0x5568be544520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 --2- 172.21.15.100:0/1167752770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568be44a510 0x5568be544520 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff218065040 tx=0x7ff218003330 comp rx=0 tx=0).stop 2024-09-18T01:25:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff2276b8640 1 -- 172.21.15.100:0/1167752770 reap_dead start 2024-09-18T01:25:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 shutdown_connections 2024-09-18T01:25:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 >> 172.21.15.100:0/1167752770 conn(0x5568be445de0 msgr2=0x5568be533b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 shutdown_connections 2024-09-18T01:25:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.070+0000 7ff22b12a800 1 -- 172.21.15.100:0/1167752770 wait complete. 2024-09-18T01:25:27.079 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:27.080 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-18T01:25:27.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-18T01:25:27.080 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-18T01:25:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:27.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.127+0000 7f0d1d92d800 1 Processor -- start 2024-09-18T01:25:27.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.128+0000 7f0d1d92d800 1 -- start start 2024-09-18T01:25:27.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.128+0000 7f0d1d92d800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x562395cd5570 0x562395cd5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.128+0000 7f0d1d92d800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562395b95b30 con 0x562395cd5eb0 2024-09-18T01:25:27.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.128+0000 7f0d1d92d800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x562395b77360 con 0x562395cd5570 2024-09-18T01:25:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.128+0000 7f0d19680640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x562395cd5570 0x562395cd5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.128+0000 7f0d18e7f640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x562395cd5eb0 0x562395cdaa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59210/0 (socket says 172.21.15.100:59210) 2024-09-18T01:25:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.128+0000 7f0d18e7f640 1 -- 172.21.15.100:0/794702814 learned_addr learned my addr 172.21.15.100:0/794702814 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.128+0000 7f0d19680640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x562395cd5570 0x562395cd5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32786/0 (socket says 172.21.15.100:32786) 2024-09-18T01:25:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.128+0000 7f0d19680640 1 -- 172.21.15.100:0/794702814 >> v1:172.21.15.92:6789/0 conn(0x562395cd5eb0 legacy=0x562395cdaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.128+0000 7f0d19680640 1 -- 172.21.15.100:0/794702814 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562395b9de00 con 0x562395cd5570 2024-09-18T01:25:27.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.130+0000 7f0d19680640 1 --2- 172.21.15.100:0/794702814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 0x562395cd5970 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00a470 tx=0x7f0d0c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa21851774cf5200 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.130+0000 7f0d0bfff640 1 -- 172.21.15.100:0/794702814 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c053570 con 0x562395cd5570 2024-09-18T01:25:27.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.130+0000 7f0d0bfff640 1 -- 172.21.15.100:0/794702814 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0c058070 con 0x562395cd5570 2024-09-18T01:25:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.130+0000 7f0d0bfff640 1 -- 172.21.15.100:0/794702814 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c053880 con 0x562395cd5570 2024-09-18T01:25:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.131+0000 7f0d1d92d800 1 -- 172.21.15.100:0/794702814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 msgr2=0x562395cd5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.131+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/794702814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 0x562395cd5970 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00a470 tx=0x7f0d0c045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.131+0000 7f0d1d92d800 1 -- 172.21.15.100:0/794702814 shutdown_connections 2024-09-18T01:25:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.131+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/794702814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 0x562395cd5970 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.131+0000 7f0d1d92d800 1 -- 172.21.15.100:0/794702814 >> 172.21.15.100:0/794702814 conn(0x562395cd0e00 msgr2=0x562395cd3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.131+0000 7f0d1d92d800 1 -- 172.21.15.100:0/794702814 shutdown_connections 2024-09-18T01:25:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.131+0000 7f0d1d92d800 1 -- 172.21.15.100:0/794702814 wait complete. 2024-09-18T01:25:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.144+0000 7f0d1d92d800 1 Processor -- start 2024-09-18T01:25:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.144+0000 7f0d1d92d800 1 -- start start 2024-09-18T01:25:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.145+0000 7f0d1d92d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 0x562395dc58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.145+0000 7f0d1d92d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562395c22350 con 0x562395cd5570 2024-09-18T01:25:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.145+0000 7f0d19680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 0x562395dc58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.145+0000 7f0d19680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 0x562395dc58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32794/0 (socket says 172.21.15.100:32794) 2024-09-18T01:25:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.145+0000 7f0d19680640 1 -- 172.21.15.100:0/2718105153 learned_addr learned my addr 172.21.15.100:0/2718105153 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.145+0000 7f0d19680640 1 -- 172.21.15.100:0/2718105153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562395b6fbc0 con 0x562395cd5570 2024-09-18T01:25:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.145+0000 7f0d19680640 1 --2- 172.21.15.100:0/2718105153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 0x562395dc58b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c025c20 tx=0x7f0d0c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6fd6ad992f1fedb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.145+0000 7f0c07606640 1 -- 172.21.15.100:0/2718105153 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c05c580 con 0x562395cd5570 2024-09-18T01:25:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.146+0000 7f0c07606640 1 -- 172.21.15.100:0/2718105153 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0c063030 con 0x562395cd5570 2024-09-18T01:25:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.146+0000 7f0c07606640 1 -- 172.21.15.100:0/2718105153 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c05c850 con 0x562395cd5570 2024-09-18T01:25:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.146+0000 7f0d1d92d800 1 -- 172.21.15.100:0/2718105153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 msgr2=0x562395dc58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.146+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/2718105153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 0x562395dc58b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c025c20 tx=0x7f0d0c051000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.146+0000 7f0d1d92d800 1 -- 172.21.15.100:0/2718105153 shutdown_connections 2024-09-18T01:25:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.146+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/2718105153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 0x562395dc58b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.146+0000 7f0d1d92d800 1 -- 172.21.15.100:0/2718105153 >> 172.21.15.100:0/2718105153 conn(0x562395cd0e00 msgr2=0x562395dc3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.146+0000 7f0d1d92d800 1 -- 172.21.15.100:0/2718105153 shutdown_connections 2024-09-18T01:25:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.146+0000 7f0d1d92d800 1 -- 172.21.15.100:0/2718105153 wait complete. 2024-09-18T01:25:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.147+0000 7f0d1d92d800 1 Processor -- start 2024-09-18T01:25:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.147+0000 7f0d1d92d800 1 -- start start 2024-09-18T01:25:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.147+0000 7f0d1d92d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 0x562395dc1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.147+0000 7f0d1d92d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562395cdc590 con 0x562395cd5570 2024-09-18T01:25:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.147+0000 7f0d19680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 0x562395dc1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.147+0000 7f0d19680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 0x562395dc1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32800/0 (socket says 172.21.15.100:32800) 2024-09-18T01:25:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.147+0000 7f0d19680640 1 -- 172.21.15.100:0/722610782 learned_addr learned my addr 172.21.15.100:0/722610782 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.147+0000 7f0d19680640 1 -- 172.21.15.100:0/722610782 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562395b83fe0 con 0x562395cd5570 2024-09-18T01:25:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.147+0000 7f0d19680640 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 0x562395dc1650 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x562395dc6710 tx=0x7f0d0c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.147+0000 7f0c05e03640 1 -- 172.21.15.100:0/722610782 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c054ad0 con 0x562395cd5570 2024-09-18T01:25:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.148+0000 7f0c05e03640 1 -- 172.21.15.100:0/722610782 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0c054c70 con 0x562395cd5570 2024-09-18T01:25:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.148+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562395dbfd40 con 0x562395cd5570 2024-09-18T01:25:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.148+0000 7f0c05e03640 1 -- 172.21.15.100:0/722610782 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c068420 con 0x562395cd5570 2024-09-18T01:25:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.148+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562395dc0260 con 0x562395cd5570 2024-09-18T01:25:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.148+0000 7f0c05e03640 1 -- 172.21.15.100:0/722610782 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0d0c0685c0 con 0x562395cd5570 2024-09-18T01:25:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.148+0000 7f0c05e03640 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0c00036b90 0x7f0c00039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.149+0000 7f0c05e03640 1 -- 172.21.15.100:0/722610782 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0d0c070030 con 0x562395cd5570 2024-09-18T01:25:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.149+0000 7f0d18e7f640 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0c00036b90 0x7f0c00039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.149+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562395cd5eb0 0x562395dd65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.149+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395dd6b30 con 0x562395cd5eb0 2024-09-18T01:25:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.149+0000 7f0d19e81640 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562395cd5eb0 0x562395dd65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.149+0000 7f0d18e7f640 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0c00036b90 0x7f0c00039050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0d10000f60 tx=0x7f0d100012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.149+0000 7f0d19e81640 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562395cd5eb0 0x562395dd65f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.149+0000 7f0d19e81640 1 -- 172.21.15.100:0/722610782 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395cd5eb0 2024-09-18T01:25:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.149+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395dd7380 con 0x562395cd5eb0 2024-09-18T01:25:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.150+0000 7f0d19e81640 1 -- 172.21.15.100:0/722610782 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395cd5eb0 2024-09-18T01:25:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.150+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562395dd8db0 0x562395ddb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.150+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395ddb950 con 0x562395dd8db0 2024-09-18T01:25:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.150+0000 7f0d19680640 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562395dd8db0 0x562395ddb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.150+0000 7f0d19680640 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562395dd8db0 0x562395ddb1c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.150+0000 7f0d19680640 1 -- 172.21.15.100:0/722610782 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0d0c051070 con 0x562395dd8db0 2024-09-18T01:25:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.150+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395dd7bd0 con 0x562395cd5eb0 2024-09-18T01:25:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.151+0000 7f0d19e81640 1 -- 172.21.15.100:0/722610782 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395cd5eb0 2024-09-18T01:25:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.151+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562395ddcdb0 0x562395ddf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.151+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395ddf860 con 0x562395ddcdb0 2024-09-18T01:25:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.151+0000 7f0d18e7f640 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562395ddcdb0 0x562395ddf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.151+0000 7f0d18e7f640 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562395ddcdb0 0x562395ddf1a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.152+0000 7f0d18e7f640 1 -- 172.21.15.100:0/722610782 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0d10009050 con 0x562395ddcdb0 2024-09-18T01:25:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.152+0000 7f0d1d92d800 1 Processor -- start 2024-09-18T01:25:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.152+0000 7f0d1d92d800 1 -- start start 2024-09-18T01:25:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.152+0000 7f0d1d92d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395ded610 0x562395deda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.152+0000 7f0d1d92d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562395dc1b90 con 0x562395ded610 2024-09-18T01:25:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.152+0000 7f0d19680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395ded610 0x562395deda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.152+0000 7f0d19680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395ded610 0x562395deda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32810/0 (socket says 172.21.15.100:32810) 2024-09-18T01:25:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.152+0000 7f0d19680640 1 -- 172.21.15.100:0/689377902 learned_addr learned my addr 172.21.15.100:0/689377902 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.152+0000 7f0d19680640 1 -- 172.21.15.100:0/689377902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562395dedf70 con 0x562395ded610 2024-09-18T01:25:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.153+0000 7f0d19680640 1 --2- 172.21.15.100:0/689377902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395ded610 0x562395deda30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c025c20 tx=0x7f0d0c05cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.153+0000 7f0bfeffd640 1 -- 172.21.15.100:0/689377902 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c05e730 con 0x562395ded610 2024-09-18T01:25:27.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.153+0000 7f0bfeffd640 1 -- 172.21.15.100:0/689377902 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0c05e8d0 con 0x562395ded610 2024-09-18T01:25:27.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.153+0000 7f0d1d92d800 1 -- 172.21.15.100:0/689377902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562395dee200 con 0x562395ded610 2024-09-18T01:25:27.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.153+0000 7f0bfeffd640 1 -- 172.21.15.100:0/689377902 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c07dc30 con 0x562395ded610 2024-09-18T01:25:27.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.153+0000 7f0d1d92d800 1 -- 172.21.15.100:0/689377902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562395df0ee0 con 0x562395ded610 2024-09-18T01:25:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.154+0000 7f0bfeffd640 1 -- 172.21.15.100:0/689377902 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0d0c089040 con 0x562395ded610 2024-09-18T01:25:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.154+0000 7f0bfeffd640 1 --2- 172.21.15.100:0/689377902 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0bf0036af0 0x7f0bf0038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.154+0000 7f0bfeffd640 1 -- 172.21.15.100:0/689377902 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0d0c09ea00 con 0x562395ded610 2024-09-18T01:25:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.154+0000 7f0d18e7f640 1 --2- 172.21.15.100:0/689377902 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0bf0036af0 0x7f0bf0038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.154+0000 7f0d1d92d800 1 Processor -- start 2024-09-18T01:25:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.154+0000 7f0d18e7f640 1 --2- 172.21.15.100:0/689377902 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0bf0036af0 0x7f0bf0038fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000bf50 tx=0x7f0d1000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.154+0000 7f0d1d92d800 1 -- start start 2024-09-18T01:25:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.154+0000 7f0d1d92d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395dfa170 0x562395dfa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.154+0000 7f0d1d92d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562395b71580 con 0x562395dfa170 2024-09-18T01:25:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.154+0000 7f0d19680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395dfa170 0x562395dfa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.154+0000 7f0d19680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395dfa170 0x562395dfa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32824/0 (socket says 172.21.15.100:32824) 2024-09-18T01:25:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.154+0000 7f0d19680640 1 -- 172.21.15.100:0/4129172546 learned_addr learned my addr 172.21.15.100:0/4129172546 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.155+0000 7f0d19680640 1 -- 172.21.15.100:0/4129172546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562395dfab40 con 0x562395dfa170 2024-09-18T01:25:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.155+0000 7f0d19680640 1 --2- 172.21.15.100:0/4129172546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395dfa170 0x562395dfa570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c07efd0 tx=0x7f0d0c07ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97f250c0eb89485 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.155+0000 7f0bfcff9640 1 -- 172.21.15.100:0/4129172546 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c08fd50 con 0x562395dfa170 2024-09-18T01:25:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.155+0000 7f0bfcff9640 1 -- 172.21.15.100:0/4129172546 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0c0ae070 con 0x562395dfa170 2024-09-18T01:25:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.155+0000 7f0bfcff9640 1 -- 172.21.15.100:0/4129172546 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c09eea0 con 0x562395dfa170 2024-09-18T01:25:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.155+0000 7f0d1d92d800 1 -- 172.21.15.100:0/4129172546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395dfa170 msgr2=0x562395dfa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.155+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/4129172546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395dfa170 0x562395dfa570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c07efd0 tx=0x7f0d0c07ab70 comp rx=0 tx=0).stop 2024-09-18T01:25:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.155+0000 7f0d1d92d800 1 -- 172.21.15.100:0/4129172546 shutdown_connections 2024-09-18T01:25:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.155+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/4129172546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395dfa170 0x562395dfa570 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.155+0000 7f0d1d92d800 1 -- 172.21.15.100:0/4129172546 >> 172.21.15.100:0/4129172546 conn(0x562395df64d0 msgr2=0x562395df45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.155+0000 7f0d1d92d800 1 -- 172.21.15.100:0/4129172546 shutdown_connections 2024-09-18T01:25:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.155+0000 7f0d1d92d800 1 -- 172.21.15.100:0/4129172546 wait complete. 2024-09-18T01:25:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.156+0000 7f0d1d92d800 1 Processor -- start 2024-09-18T01:25:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.156+0000 7f0d1d92d800 1 -- start start 2024-09-18T01:25:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.156+0000 7f0d1d92d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395dfa170 0x562395e01210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.156+0000 7f0d1d92d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562395dfab40 con 0x562395dfa170 2024-09-18T01:25:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.156+0000 7f0d19680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395dfa170 0x562395e01210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.156+0000 7f0d19680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395dfa170 0x562395e01210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32840/0 (socket says 172.21.15.100:32840) 2024-09-18T01:25:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.156+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 learned_addr learned my addr 172.21.15.100:0/3763249691 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.156+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562395e01750 con 0x562395dfa170 2024-09-18T01:25:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.157+0000 7f0d19680640 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395dfa170 0x562395e01210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0ab040 tx=0x7f0d0c04ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.157+0000 7f0beeffd640 1 -- 172.21.15.100:0/3763249691 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c0c1070 con 0x562395dfa170 2024-09-18T01:25:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.157+0000 7f0beeffd640 1 -- 172.21.15.100:0/3763249691 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0c05c590 con 0x562395dfa170 2024-09-18T01:25:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.157+0000 7f0beeffd640 1 -- 172.21.15.100:0/3763249691 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0c05fde0 con 0x562395dfa170 2024-09-18T01:25:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.157+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562395e01750 con 0x562395dfa170 2024-09-18T01:25:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.157+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562395e01750 con 0x562395dfa170 2024-09-18T01:25:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.158+0000 7f0beeffd640 1 -- 172.21.15.100:0/3763249691 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0d0c0c4070 con 0x562395dfa170 2024-09-18T01:25:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.158+0000 7f0beeffd640 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0be4036b40 0x7f0be4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.158+0000 7f0beeffd640 1 -- 172.21.15.100:0/3763249691 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0d0c0a4040 con 0x562395dfa170 2024-09-18T01:25:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.158+0000 7f0d18e7f640 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0be4036b40 0x7f0be4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.158+0000 7f0d18e7f640 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0be4036b40 0x7f0be4039000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d10001b60 tx=0x7f0d10010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.158+0000 7f0d1d92d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.158+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562395e0c800 0x562395e0ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.158+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e0f410 con 0x562395e0c800 2024-09-18T01:25:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d19e81640 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562395e0c800 0x562395e0ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d19e81640 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562395e0c800 0x562395e0ecc0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d1d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d1d92d800 20 realm 2024-09-18T01:25:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d1d92d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e0f820 con 0x562395e0c800 2024-09-18T01:25:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d1d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d1d92d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d1d92d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e100f0 con 0x562395e0c800 2024-09-18T01:25:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d1d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d1d92d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.159+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e0c800 2024-09-18T01:25:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.160+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.160+0000 7f0d1d92d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.160+0000 7f0d1d92d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.160+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562395e111f0 0x562395e135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.160+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e13ba0 con 0x562395e111f0 2024-09-18T01:25:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.160+0000 7f0d19680640 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562395e111f0 0x562395e135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.160+0000 7f0d19680640 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562395e111f0 0x562395e135e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.160+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0d0c0c3030 con 0x562395e111f0 2024-09-18T01:25:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.160+0000 7f0d1d92d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.160+0000 7f0d1d92d800 20 searching for the correct realm 2024-09-18T01:25:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.160+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562395e15b50 0x562395e18010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.160+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e186e0 con 0x562395e15b50 2024-09-18T01:25:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.160+0000 7f0d18e7f640 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562395e15b50 0x562395e18010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.161+0000 7f0d18e7f640 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562395e15b50 0x562395e18010 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.161+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d10009050 con 0x562395e15b50 2024-09-18T01:25:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.161+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e186e0 con 0x562395e111f0 2024-09-18T01:25:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.161+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c0c3030 con 0x562395e111f0 2024-09-18T01:25:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.161+0000 7f0d19680640 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0d0c0c6060 0x7f0d0c0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.161+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e186e0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.161+0000 7f0d19e81640 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0d0c0c6060 0x7f0d0c0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.162+0000 7f0d19e81640 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0d0c0c6060 0x7f0d0c0b2880 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.162+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.162+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e0c800 2024-09-18T01:25:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.162+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.162+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e0c800 2024-09-18T01:25:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.162+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.162+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x7f0d0c0c6060 2024-09-18T01:25:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.163+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.163+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x7f0d0c0c6060 2024-09-18T01:25:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.163+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.163+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e111f0 2024-09-18T01:25:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.163+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c0c3030 con 0x562395e111f0 2024-09-18T01:25:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.163+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e15b50 2024-09-18T01:25:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.163+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d10009050 con 0x562395e15b50 2024-09-18T01:25:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.163+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e0c800 2024-09-18T01:25:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.163+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.164+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x7f0d0c0c6060 2024-09-18T01:25:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.164+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.164+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e0c800 2024-09-18T01:25:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.164+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.164+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e111f0 2024-09-18T01:25:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.164+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0d0c0c3030 con 0x562395e111f0 2024-09-18T01:25:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.164+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e15b50 2024-09-18T01:25:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.164+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d10009050 con 0x562395e15b50 2024-09-18T01:25:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.164+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e15b50 2024-09-18T01:25:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.165+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d10009050 con 0x562395e15b50 2024-09-18T01:25:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.165+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x7f0d0c0c6060 2024-09-18T01:25:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.165+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.165+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e15b50 2024-09-18T01:25:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.165+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d10009050 con 0x562395e15b50 2024-09-18T01:25:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.165+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e15b50 2024-09-18T01:25:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.165+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d10009050 con 0x562395e15b50 2024-09-18T01:25:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.165+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e0c800 2024-09-18T01:25:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.166+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.166+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e0c800 2024-09-18T01:25:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.166+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.166+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x7f0d0c0c6060 2024-09-18T01:25:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.166+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.166+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e15b50 2024-09-18T01:25:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.166+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d10009050 con 0x562395e15b50 2024-09-18T01:25:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.166+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e111f0 2024-09-18T01:25:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.167+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c0c3030 con 0x562395e111f0 2024-09-18T01:25:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.167+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e0c800 2024-09-18T01:25:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.167+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.167+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x7f0d0c0c6060 2024-09-18T01:25:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.167+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.167+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e15b50 2024-09-18T01:25:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.167+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d10009050 con 0x562395e15b50 2024-09-18T01:25:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.167+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x7f0d0c0c6060 2024-09-18T01:25:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.168+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.168+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e111f0 2024-09-18T01:25:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.168+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c0c3030 con 0x562395e111f0 2024-09-18T01:25:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.168+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e15b50 2024-09-18T01:25:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.168+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d10009050 con 0x562395e15b50 2024-09-18T01:25:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.168+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x7f0d0c0c6060 2024-09-18T01:25:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e0c800 2024-09-18T01:25:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562395e10490 con 0x562395e111f0 2024-09-18T01:25:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0d0c0c3030 con 0x562395e111f0 2024-09-18T01:25:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d1d92d800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d1d92d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d1d92d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d1d92d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d1d92d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d1d92d800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d1d92d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e14460 con 0x562395e0c800 2024-09-18T01:25:27.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d1d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d1d92d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.169+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e14850 con 0x562395e0c800 2024-09-18T01:25:27.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:27.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e14850 con 0x7f0d0c0c6060 2024-09-18T01:25:27.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:27.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 20 zone default found 2024-09-18T01:25:27.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 4 Realm: () 2024-09-18T01:25:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 20 zonegroup default 2024-09-18T01:25:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e18b60 con 0x7f0d0c0c6060 2024-09-18T01:25:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e1a540 con 0x562395e15b50 2024-09-18T01:25:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d10009050 con 0x562395e15b50 2024-09-18T01:25:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.170+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e1a8e0 con 0x562395e15b50 2024-09-18T01:25:27.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.171+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d10009050 con 0x562395e15b50 2024-09-18T01:25:27.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.171+0000 7f0d1d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.171+0000 7f0d1d92d800 20 started sync module instance, tier type = 2024-09-18T01:25:27.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.171+0000 7f0d1d92d800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:27.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.171+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e199e0 con 0x562395e111f0 2024-09-18T01:25:27.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.172+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c0c3030 con 0x562395e111f0 2024-09-18T01:25:27.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.172+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94710838435328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e19640 con 0x562395e111f0 2024-09-18T01:25:27.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.172+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1b5e0 con 0x562395e0c800 2024-09-18T01:25:27.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.173+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.173+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94710838440720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1be80 con 0x562395e0c800 2024-09-18T01:25:27.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.173+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1c950 con 0x562395e15b50 2024-09-18T01:25:27.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.174+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94710838440720] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.174+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d10009050 con 0x562395e15b50 2024-09-18T01:25:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.174+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94710838435328] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c0c3030 con 0x562395e111f0 2024-09-18T01:25:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.175+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94710838439040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1be80 con 0x562395e15b50 2024-09-18T01:25:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.175+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1d250 con 0x562395e111f0 2024-09-18T01:25:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.176+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94710838439040] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d10009050 con 0x562395e15b50 2024-09-18T01:25:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.177+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c0c3030 con 0x562395e111f0 2024-09-18T01:25:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.177+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94710838442448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1daf0 con 0x562395e111f0 2024-09-18T01:25:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.177+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1e3c0 con 0x562395e0c800 2024-09-18T01:25:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.180+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94710838442448] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c0c3030 con 0x562395e111f0 2024-09-18T01:25:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.180+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.180+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94710838451856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1e7b0 con 0x562395e0c800 2024-09-18T01:25:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.180+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1f1b0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.181+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94710838451856] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.183+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.183+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94710838449728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1f170 con 0x7f0d0c0c6060 2024-09-18T01:25:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.183+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1fbc0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.186+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.186+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94710838458128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1ffe0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.186+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e20ae0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.188+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.188+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94710838461904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e20f50 con 0x7f0d0c0c6060 2024-09-18T01:25:27.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.188+0000 7f0d1d92d800 20 add_watcher() i=0 2024-09-18T01:25:27.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.188+0000 7f0d1d92d800 20 add_watcher() i=1 2024-09-18T01:25:27.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.188+0000 7f0d1d92d800 20 add_watcher() i=2 2024-09-18T01:25:27.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.188+0000 7f0d1d92d800 20 add_watcher() i=3 2024-09-18T01:25:27.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.188+0000 7f0d1d92d800 20 add_watcher() i=4 2024-09-18T01:25:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.191+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94710838461904] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.191+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(55 notify.5 [watch watch cookie 94710838449728] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.191+0000 7f0d1d92d800 20 add_watcher() i=5 2024-09-18T01:25:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.191+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(57 notify.6 [watch watch cookie 94710838458128] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.191+0000 7f0d1d92d800 20 add_watcher() i=6 2024-09-18T01:25:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.191+0000 7f0d1d92d800 20 add_watcher() i=7 2024-09-18T01:25:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.191+0000 7f0d1d92d800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.191+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e20aa0 con 0x562395e0c800 2024-09-18T01:25:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.192+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.192+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94710838464208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e20aa0 con 0x562395e0c800 2024-09-18T01:25:27.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.193+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94710838464208] v33'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.193+0000 7f0bcf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:27.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.193+0000 7f0d1d92d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:27.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.193+0000 7f0d1d92d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:27.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.193+0000 7f0d1d92d800 5 note: GC not initialized 2024-09-18T01:25:27.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.193+0000 7f0bce7e4640 20 reqs_thread_entry: start 2024-09-18T01:25:27.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.193+0000 7f0d1d92d800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:27.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.193+0000 7f0d1d92d800 20 Filter name: none 2024-09-18T01:25:27.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.193+0000 7f0b3ffff640 20 reqs_thread_entry: start 2024-09-18T01:25:27.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.193+0000 7f0d1d92d800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:25:27.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.193+0000 7f0d1d92d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.193+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e56e20 con 0x7f0d0c0c6060 2024-09-18T01:25:27.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d1d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d1d92d800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-18T01:25:27.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d1d92d800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:25:27.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d1d92d800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-18T01:25:27.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d1d92d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e55460 con 0x562395e0c800 2024-09-18T01:25:27.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d1d92d800 20 rados_obj.operate() r=0 bl.length=7 2024-09-18T01:25:27.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d1d92d800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-18T01:25:27.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d1d92d800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-18T01:25:27.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d1d92d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:27.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d1d92d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562395e55850 con 0x562395e0c800 2024-09-18T01:25:27.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.194+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.195+0000 7f0d1d92d800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:27.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.195+0000 7f0d1d92d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:27.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.195+0000 7f0d1d92d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.195+0000 7f0d1d92d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.195+0000 7f0d1d92d800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-18T01:25:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.195+0000 7f0d1d92d800 20 get_user_info_from_index found 0 xattrs 2024-09-18T01:25:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-18T01:25:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.195+0000 7f0bcf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.195+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94710838464208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e08f20 con 0x562395e0c800 2024-09-18T01:25:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.196+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94710838464208] v33'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.196+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94710838435328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e54b70 con 0x562395e111f0 2024-09-18T01:25:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.197+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94710838435328] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c0c3030 con 0x562395e111f0 2024-09-18T01:25:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.197+0000 7f0d1d92d800 20 remove_watcher() i=0 2024-09-18T01:25:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.197+0000 7f0d1d92d800 2 removed watcher, disabling cache 2024-09-18T01:25:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.197+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94710838440720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e54b70 con 0x562395e0c800 2024-09-18T01:25:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.198+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94710838440720] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.198+0000 7f0d1d92d800 20 remove_watcher() i=1 2024-09-18T01:25:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.198+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94710838439040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e54b70 con 0x562395e15b50 2024-09-18T01:25:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.199+0000 7f0d18e7f640 1 -- 172.21.15.100:0/3763249691 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94710838439040] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d10009050 con 0x562395e15b50 2024-09-18T01:25:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.199+0000 7f0d1d92d800 20 remove_watcher() i=2 2024-09-18T01:25:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.199+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94710838442448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1ac80 con 0x562395e111f0 2024-09-18T01:25:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.203+0000 7f0d19680640 1 -- 172.21.15.100:0/3763249691 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94710838442448] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c0c3030 con 0x562395e111f0 2024-09-18T01:25:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.203+0000 7f0d1d92d800 20 remove_watcher() i=3 2024-09-18T01:25:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.203+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94710838451856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1ac80 con 0x562395e0c800 2024-09-18T01:25:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.204+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94710838451856] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x562395e0c800 2024-09-18T01:25:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.204+0000 7f0d1d92d800 20 remove_watcher() i=4 2024-09-18T01:25:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.204+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94710838449728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1de90 con 0x7f0d0c0c6060 2024-09-18T01:25:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.205+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94710838449728] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.205+0000 7f0d1d92d800 20 remove_watcher() i=5 2024-09-18T01:25:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.205+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94710838458128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1ac80 con 0x7f0d0c0c6060 2024-09-18T01:25:27.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.208+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94710838458128] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.208+0000 7f0d1d92d800 20 remove_watcher() i=6 2024-09-18T01:25:27.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.208+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94710838461904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562395e1ac80 con 0x7f0d0c0c6060 2024-09-18T01:25:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.209+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94710838461904] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1400a4a0 con 0x7f0d0c0c6060 2024-09-18T01:25:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.209+0000 7f0d1d92d800 20 remove_watcher() i=7 2024-09-18T01:25:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0d0c0c6060 msgr2=0x7f0d0c0b2880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0d0c0c6060 0x7f0d0c0b2880 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562395e0c800 msgr2=0x562395e0ecc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562395e0c800 0x562395e0ecc0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562395e111f0 msgr2=0x562395e135e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562395e111f0 0x562395e135e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562395e15b50 msgr2=0x562395e18010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562395e15b50 0x562395e18010 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0be4036b40 msgr2=0x7f0be4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0be4036b40 0x7f0be4039000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d10001b60 tx=0x7f0d10010000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395dfa170 msgr2=0x562395e01210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d19e81640 1 -- 172.21.15.100:0/3763249691 reap_dead start 2024-09-18T01:25:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395dfa170 0x562395e01210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0ab040 tx=0x7f0d0c04ff20 comp rx=0 tx=0).stop 2024-09-18T01:25:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 shutdown_connections 2024-09-18T01:25:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/3763249691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395dfa170 0x562395e01210 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 >> 172.21.15.100:0/3763249691 conn(0x562395df64d0 msgr2=0x562395df45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 shutdown_connections 2024-09-18T01:25:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/3763249691 wait complete. 2024-09-18T01:25:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/689377902 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0bf0036af0 msgr2=0x7f0bf0038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/689377902 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0bf0036af0 0x7f0bf0038fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000bf50 tx=0x7f0d1000f000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/689377902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395ded610 msgr2=0x562395deda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/689377902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395ded610 0x562395deda30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c025c20 tx=0x7f0d0c05cca0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/689377902 shutdown_connections 2024-09-18T01:25:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/689377902 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0bf0036af0 0x7f0bf0038fb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/689377902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395ded610 0x562395deda30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/689377902 >> 172.21.15.100:0/689377902 conn(0x562395de25a0 msgr2=0x562395de5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/689377902 shutdown_connections 2024-09-18T01:25:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.210+0000 7f0d1d92d800 1 -- 172.21.15.100:0/689377902 wait complete. 2024-09-18T01:25:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562395ddcdb0 msgr2=0x562395ddf1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562395ddcdb0 0x562395ddf1a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562395cd5eb0 msgr2=0x562395dd65f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562395cd5eb0 0x562395dd65f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562395dd8db0 msgr2=0x562395ddb1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562395dd8db0 0x562395ddb1c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0c00036b90 msgr2=0x7f0c00039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0c00036b90 0x7f0c00039050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0d10000f60 tx=0x7f0d100012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 msgr2=0x562395dc1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d1d92d800 1 --2- 172.21.15.100:0/722610782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562395cd5570 0x562395dc1650 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x562395dc6710 tx=0x7f0d0c002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d19e81640 1 -- 172.21.15.100:0/722610782 reap_dead start 2024-09-18T01:25:27.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 shutdown_connections 2024-09-18T01:25:27.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 >> 172.21.15.100:0/722610782 conn(0x562395cd0e00 msgr2=0x562395dbf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 shutdown_connections 2024-09-18T01:25:27.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.211+0000 7f0d1d92d800 1 -- 172.21.15.100:0/722610782 wait complete. 2024-09-18T01:25:27.220 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-18T01:25:27.220 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:25:27.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:25:27.221 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:25:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:27.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.265+0000 7f2f72a0f800 1 Processor -- start 2024-09-18T01:25:27.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.265+0000 7f2f72a0f800 1 -- start start 2024-09-18T01:25:27.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.265+0000 7f2f72a0f800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55a70a4d3d90 0x55a70a563240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.265+0000 7f2f72a0f800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a70a41fb30 con 0x55a70a563780 2024-09-18T01:25:27.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.265+0000 7f2f72a0f800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55a70a401360 con 0x55a70a4d3d90 2024-09-18T01:25:27.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.265+0000 7f2f70503640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55a70a4d3d90 0x55a70a563240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.265+0000 7f2f67fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55a70a563780 0x55a70a565b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59224/0 (socket says 172.21.15.100:59224) 2024-09-18T01:25:27.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.265+0000 7f2f67fff640 1 -- 172.21.15.100:0/2893221894 learned_addr learned my addr 172.21.15.100:0/2893221894 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:27.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.266+0000 7f2f70503640 1 -- 172.21.15.100:0/2893221894 >> v1:172.21.15.92:6789/0 conn(0x55a70a563780 legacy=0x55a70a565b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.266+0000 7f2f70503640 1 -- 172.21.15.100:0/2893221894 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70a427e00 con 0x55a70a4d3d90 2024-09-18T01:25:27.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.267+0000 7f2f70503640 1 --2- 172.21.15.100:0/2893221894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 0x55a70a563240 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000a470 tx=0x7f2f60045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbe3b98d17ddb92 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.268+0000 7f2f6fd02640 1 -- 172.21.15.100:0/2893221894 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f60053570 con 0x55a70a4d3d90 2024-09-18T01:25:27.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.268+0000 7f2f6fd02640 1 -- 172.21.15.100:0/2893221894 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f60058070 con 0x55a70a4d3d90 2024-09-18T01:25:27.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.268+0000 7f2f6fd02640 1 -- 172.21.15.100:0/2893221894 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f60053880 con 0x55a70a4d3d90 2024-09-18T01:25:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.268+0000 7f2f72a0f800 1 -- 172.21.15.100:0/2893221894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 msgr2=0x55a70a563240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.268+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/2893221894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 0x55a70a563240 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000a470 tx=0x7f2f60045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.268+0000 7f2f72a0f800 1 -- 172.21.15.100:0/2893221894 shutdown_connections 2024-09-18T01:25:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.268+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/2893221894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 0x55a70a563240 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.268+0000 7f2f72a0f800 1 -- 172.21.15.100:0/2893221894 >> 172.21.15.100:0/2893221894 conn(0x55a70a55adf0 msgr2=0x55a70a55d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.268+0000 7f2f72a0f800 1 -- 172.21.15.100:0/2893221894 shutdown_connections 2024-09-18T01:25:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.268+0000 7f2f72a0f800 1 -- 172.21.15.100:0/2893221894 wait complete. 2024-09-18T01:25:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.282+0000 7f2f72a0f800 1 Processor -- start 2024-09-18T01:25:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.282+0000 7f2f72a0f800 1 -- start start 2024-09-18T01:25:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.282+0000 7f2f72a0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 0x55a70a64f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.282+0000 7f2f72a0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a70a4ac330 con 0x55a70a4d3d90 2024-09-18T01:25:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.282+0000 7f2f70503640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 0x55a70a64f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.282+0000 7f2f70503640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 0x55a70a64f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32852/0 (socket says 172.21.15.100:32852) 2024-09-18T01:25:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.282+0000 7f2f70503640 1 -- 172.21.15.100:0/280844284 learned_addr learned my addr 172.21.15.100:0/280844284 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.282+0000 7f2f70503640 1 -- 172.21.15.100:0/280844284 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70a3f9bc0 con 0x55a70a4d3d90 2024-09-18T01:25:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.283+0000 7f2f70503640 1 --2- 172.21.15.100:0/280844284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 0x55a70a64f850 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2f60025c20 tx=0x7f2f60051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb45833794411802 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.283+0000 7f2e5e60c640 1 -- 172.21.15.100:0/280844284 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f6005c580 con 0x55a70a4d3d90 2024-09-18T01:25:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.283+0000 7f2e5e60c640 1 -- 172.21.15.100:0/280844284 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f60063030 con 0x55a70a4d3d90 2024-09-18T01:25:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.283+0000 7f2e5e60c640 1 -- 172.21.15.100:0/280844284 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f6005c850 con 0x55a70a4d3d90 2024-09-18T01:25:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.283+0000 7f2f72a0f800 1 -- 172.21.15.100:0/280844284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 msgr2=0x55a70a64f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.283+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/280844284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 0x55a70a64f850 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2f60025c20 tx=0x7f2f60051000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.284+0000 7f2f72a0f800 1 -- 172.21.15.100:0/280844284 shutdown_connections 2024-09-18T01:25:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.284+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/280844284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 0x55a70a64f850 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.284+0000 7f2f72a0f800 1 -- 172.21.15.100:0/280844284 >> 172.21.15.100:0/280844284 conn(0x55a70a55adf0 msgr2=0x55a70a64b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.284+0000 7f2f72a0f800 1 -- 172.21.15.100:0/280844284 shutdown_connections 2024-09-18T01:25:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.284+0000 7f2f72a0f800 1 -- 172.21.15.100:0/280844284 wait complete. 2024-09-18T01:25:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.284+0000 7f2f72a0f800 1 Processor -- start 2024-09-18T01:25:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.284+0000 7f2f72a0f800 1 -- start start 2024-09-18T01:25:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.284+0000 7f2f72a0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 0x55a70a6571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.284+0000 7f2f72a0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a70a567620 con 0x55a70a4d3d90 2024-09-18T01:25:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.284+0000 7f2f70503640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 0x55a70a6571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.284+0000 7f2f70503640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 0x55a70a6571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32854/0 (socket says 172.21.15.100:32854) 2024-09-18T01:25:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.284+0000 7f2f70503640 1 -- 172.21.15.100:0/257652741 learned_addr learned my addr 172.21.15.100:0/257652741 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.285+0000 7f2f70503640 1 -- 172.21.15.100:0/257652741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70a40dfe0 con 0x55a70a4d3d90 2024-09-18T01:25:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.285+0000 7f2f70503640 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 0x55a70a6571c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55a70a6506b0 tx=0x7f2f60002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.285+0000 7f2e5ce09640 1 -- 172.21.15.100:0/257652741 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f60054ad0 con 0x55a70a4d3d90 2024-09-18T01:25:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.285+0000 7f2e5ce09640 1 -- 172.21.15.100:0/257652741 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f60054c70 con 0x55a70a4d3d90 2024-09-18T01:25:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.285+0000 7f2e5ce09640 1 -- 172.21.15.100:0/257652741 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f60068420 con 0x55a70a4d3d90 2024-09-18T01:25:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.285+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a70a657700 con 0x55a70a4d3d90 2024-09-18T01:25:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.285+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a70a657c20 con 0x55a70a4d3d90 2024-09-18T01:25:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.286+0000 7f2e5ce09640 1 -- 172.21.15.100:0/257652741 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2f600685c0 con 0x55a70a4d3d90 2024-09-18T01:25:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.286+0000 7f2e5ce09640 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e58036b90 0x7f2e58039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.286+0000 7f2e5ce09640 1 -- 172.21.15.100:0/257652741 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f2f60070030 con 0x55a70a4d3d90 2024-09-18T01:25:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.286+0000 7f2f67fff640 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e58036b90 0x7f2e58039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.286+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a70a563780 0x55a70a65e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.286+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a65e7b0 con 0x55a70a563780 2024-09-18T01:25:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.286+0000 7f2f70d04640 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a70a563780 0x55a70a65e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.286+0000 7f2f67fff640 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e58036b90 0x7f2e58039050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2f58000f60 tx=0x7f2f580012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.286+0000 7f2f70d04640 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a70a563780 0x55a70a65e230 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.287+0000 7f2f70d04640 1 -- 172.21.15.100:0/257652741 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a563780 2024-09-18T01:25:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.287+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a65b800 con 0x55a70a563780 2024-09-18T01:25:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.287+0000 7f2f70d04640 1 -- 172.21.15.100:0/257652741 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a563780 2024-09-18T01:25:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.287+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a70a660b10 0x55a70a662f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.287+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6635f0 con 0x55a70a660b10 2024-09-18T01:25:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.287+0000 7f2f70503640 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a70a660b10 0x55a70a662f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.287+0000 7f2f70503640 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a70a660b10 0x55a70a662f00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.288+0000 7f2f70503640 1 -- 172.21.15.100:0/257652741 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f60051070 con 0x55a70a660b10 2024-09-18T01:25:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.288+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a65f9b0 con 0x55a70a563780 2024-09-18T01:25:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.288+0000 7f2f70d04640 1 -- 172.21.15.100:0/257652741 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a563780 2024-09-18T01:25:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.288+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a70a664a50 0x55a70a666e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.288+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a667540 con 0x55a70a664a50 2024-09-18T01:25:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.288+0000 7f2f67fff640 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a70a664a50 0x55a70a666e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.288+0000 7f2f67fff640 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a70a664a50 0x55a70a666e40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.289+0000 7f2f67fff640 1 -- 172.21.15.100:0/257652741 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a664a50 2024-09-18T01:25:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.289+0000 7f2f72a0f800 1 Processor -- start 2024-09-18T01:25:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.289+0000 7f2f72a0f800 1 -- start start 2024-09-18T01:25:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.289+0000 7f2f72a0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a6752f0 0x55a70a675710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.289+0000 7f2f72a0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a70a3fb580 con 0x55a70a6752f0 2024-09-18T01:25:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.289+0000 7f2f70503640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a6752f0 0x55a70a675710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.289+0000 7f2f70503640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a6752f0 0x55a70a675710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32870/0 (socket says 172.21.15.100:32870) 2024-09-18T01:25:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.289+0000 7f2f70503640 1 -- 172.21.15.100:0/2221974919 learned_addr learned my addr 172.21.15.100:0/2221974919 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.290+0000 7f2f70503640 1 -- 172.21.15.100:0/2221974919 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70a675c50 con 0x55a70a6752f0 2024-09-18T01:25:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.290+0000 7f2f70503640 1 --2- 172.21.15.100:0/2221974919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a6752f0 0x55a70a675710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2f6008f010 tx=0x7f2f600747a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.290+0000 7f2e55ffb640 1 -- 172.21.15.100:0/2221974919 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f6005e810 con 0x55a70a6752f0 2024-09-18T01:25:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.290+0000 7f2e55ffb640 1 -- 172.21.15.100:0/2221974919 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6007db00 con 0x55a70a6752f0 2024-09-18T01:25:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.290+0000 7f2f72a0f800 1 -- 172.21.15.100:0/2221974919 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a70a675ee0 con 0x55a70a6752f0 2024-09-18T01:25:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.290+0000 7f2e55ffb640 1 -- 172.21.15.100:0/2221974919 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f6007de20 con 0x55a70a6752f0 2024-09-18T01:25:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.290+0000 7f2f72a0f800 1 -- 172.21.15.100:0/2221974919 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a70a678bc0 con 0x55a70a6752f0 2024-09-18T01:25:27.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.291+0000 7f2e55ffb640 1 -- 172.21.15.100:0/2221974919 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2f6007d3f0 con 0x55a70a6752f0 2024-09-18T01:25:27.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.291+0000 7f2e55ffb640 1 --2- 172.21.15.100:0/2221974919 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e48036b40 0x7f2e48039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.291+0000 7f2e55ffb640 1 -- 172.21.15.100:0/2221974919 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f2f60099c50 con 0x55a70a6752f0 2024-09-18T01:25:27.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.291+0000 7f2f67fff640 1 --2- 172.21.15.100:0/2221974919 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e48036b40 0x7f2e48039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.291+0000 7f2f72a0f800 1 Processor -- start 2024-09-18T01:25:27.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.291+0000 7f2f67fff640 1 --2- 172.21.15.100:0/2221974919 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e48036b40 0x7f2e48039000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800bf50 tx=0x7f2f5800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.291+0000 7f2f72a0f800 1 -- start start 2024-09-18T01:25:27.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.292+0000 7f2f72a0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a681df0 0x55a70a6821f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.292+0000 7f2f72a0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a70a64ffa0 con 0x55a70a681df0 2024-09-18T01:25:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.292+0000 7f2f70503640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a681df0 0x55a70a6821f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.292+0000 7f2f70503640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a681df0 0x55a70a6821f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32882/0 (socket says 172.21.15.100:32882) 2024-09-18T01:25:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.292+0000 7f2f70503640 1 -- 172.21.15.100:0/1862053226 learned_addr learned my addr 172.21.15.100:0/1862053226 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.292+0000 7f2f70503640 1 -- 172.21.15.100:0/1862053226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70a6827c0 con 0x55a70a681df0 2024-09-18T01:25:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.292+0000 7f2f70503640 1 --2- 172.21.15.100:0/1862053226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a681df0 0x55a70a6821f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2f60074ab0 tx=0x7f2f60090560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af2168aeb8464f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.292+0000 7f2e4f7fe640 1 -- 172.21.15.100:0/1862053226 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f600880a0 con 0x55a70a681df0 2024-09-18T01:25:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.292+0000 7f2e4f7fe640 1 -- 172.21.15.100:0/1862053226 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f60086840 con 0x55a70a681df0 2024-09-18T01:25:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.292+0000 7f2e4f7fe640 1 -- 172.21.15.100:0/1862053226 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f6009bd90 con 0x55a70a681df0 2024-09-18T01:25:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.293+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1862053226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a681df0 msgr2=0x55a70a6821f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.293+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/1862053226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a681df0 0x55a70a6821f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2f60074ab0 tx=0x7f2f60090560 comp rx=0 tx=0).stop 2024-09-18T01:25:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.293+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1862053226 shutdown_connections 2024-09-18T01:25:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.293+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/1862053226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a681df0 0x55a70a6821f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.293+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1862053226 >> 172.21.15.100:0/1862053226 conn(0x55a70a67e150 msgr2=0x55a70a67c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.293+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1862053226 shutdown_connections 2024-09-18T01:25:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.293+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1862053226 wait complete. 2024-09-18T01:25:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.293+0000 7f2f72a0f800 1 Processor -- start 2024-09-18T01:25:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.293+0000 7f2f72a0f800 1 -- start start 2024-09-18T01:25:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.293+0000 7f2f72a0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a681df0 0x55a70a689080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.293+0000 7f2f72a0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a70a682d40 con 0x55a70a681df0 2024-09-18T01:25:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.293+0000 7f2f70503640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a681df0 0x55a70a689080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.293+0000 7f2f70503640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a681df0 0x55a70a689080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32886/0 (socket says 172.21.15.100:32886) 2024-09-18T01:25:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.293+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 learned_addr learned my addr 172.21.15.100:0/1045381667 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.294+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70a6895c0 con 0x55a70a681df0 2024-09-18T01:25:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.294+0000 7f2f70503640 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a681df0 0x55a70a689080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2f60097040 tx=0x7f2f6007bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.294+0000 7f2e4dffb640 1 -- 172.21.15.100:0/1045381667 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f600689e0 con 0x55a70a681df0 2024-09-18T01:25:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.294+0000 7f2e4dffb640 1 -- 172.21.15.100:0/1045381667 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6005aa20 con 0x55a70a681df0 2024-09-18T01:25:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.294+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a70a6895c0 con 0x55a70a681df0 2024-09-18T01:25:27.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.294+0000 7f2e4dffb640 1 -- 172.21.15.100:0/1045381667 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f6007a480 con 0x55a70a681df0 2024-09-18T01:25:27.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.294+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a70a6895c0 con 0x55a70a681df0 2024-09-18T01:25:27.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.295+0000 7f2e4dffb640 1 -- 172.21.15.100:0/1045381667 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2f6007a620 con 0x55a70a681df0 2024-09-18T01:25:27.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.295+0000 7f2e4dffb640 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e40036b40 0x7f2e40039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.295+0000 7f2e4dffb640 1 -- 172.21.15.100:0/1045381667 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f2f600a9030 con 0x55a70a681df0 2024-09-18T01:25:27.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.295+0000 7f2f67fff640 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e40036b40 0x7f2e40039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.295+0000 7f2f72a0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.295+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a70a6945f0 0x55a70a696ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.295+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a697200 con 0x55a70a6945f0 2024-09-18T01:25:27.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.295+0000 7f2f70d04640 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a70a6945f0 0x55a70a696ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f67fff640 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e40036b40 0x7f2e40039000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2f58001b60 tx=0x7f2f58010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f70d04640 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a70a6945f0 0x55a70a696ab0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f72a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f72a0f800 20 realm 2024-09-18T01:25:27.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f72a0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a697610 con 0x55a70a6945f0 2024-09-18T01:25:27.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f72a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f72a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:27.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f72a0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a697ee0 con 0x55a70a6945f0 2024-09-18T01:25:27.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f72a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f72a0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.296+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a6945f0 2024-09-18T01:25:27.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.297+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.297+0000 7f2f72a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:27.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.297+0000 7f2f72a0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.297+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a70a698d70 0x55a70a69b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.297+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a69b8c0 con 0x55a70a698d70 2024-09-18T01:25:27.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.297+0000 7f2f70503640 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a70a698d70 0x55a70a69b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.297+0000 7f2f70503640 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a70a698d70 0x55a70a69b160 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.297+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f6009f070 con 0x55a70a698d70 2024-09-18T01:25:27.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.297+0000 7f2f72a0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:27.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.297+0000 7f2f72a0f800 20 searching for the correct realm 2024-09-18T01:25:27.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.297+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a70a69d970 0x55a70a69fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.297+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a0500 con 0x55a70a69d970 2024-09-18T01:25:27.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.297+0000 7f2f67fff640 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a70a69d970 0x55a70a69fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.298+0000 7f2f67fff640 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a70a69d970 0x55a70a69fe30 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.298+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a69d970 2024-09-18T01:25:27.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.298+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a0500 con 0x55a70a698d70 2024-09-18T01:25:27.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.298+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6009f070 con 0x55a70a698d70 2024-09-18T01:25:27.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.298+0000 7f2f70503640 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2f6005c070 0x7f2f6005a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.298+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a0500 con 0x7f2f6005c070 2024-09-18T01:25:27.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.299+0000 7f2f70d04640 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2f6005c070 0x7f2f6005a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.299+0000 7f2f70d04640 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2f6005c070 0x7f2f6005a310 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.299+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.299+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a6945f0 2024-09-18T01:25:27.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.299+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.299+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a6945f0 2024-09-18T01:25:27.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.300+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.300+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x7f2f6005c070 2024-09-18T01:25:27.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.300+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.300+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x7f2f6005c070 2024-09-18T01:25:27.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.300+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.300+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a698d70 2024-09-18T01:25:27.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.300+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6009f070 con 0x55a70a698d70 2024-09-18T01:25:27.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.300+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a69d970 2024-09-18T01:25:27.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.300+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a69d970 2024-09-18T01:25:27.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.300+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a6945f0 2024-09-18T01:25:27.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.301+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.301+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x7f2f6005c070 2024-09-18T01:25:27.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.301+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.301+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a6945f0 2024-09-18T01:25:27.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.301+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.301+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a698d70 2024-09-18T01:25:27.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.301+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2f6009f070 con 0x55a70a698d70 2024-09-18T01:25:27.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.301+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a69d970 2024-09-18T01:25:27.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.302+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a69d970 2024-09-18T01:25:27.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.302+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a69d970 2024-09-18T01:25:27.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.302+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a69d970 2024-09-18T01:25:27.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.302+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x7f2f6005c070 2024-09-18T01:25:27.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.302+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.302+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a69d970 2024-09-18T01:25:27.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.302+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a69d970 2024-09-18T01:25:27.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.302+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a69d970 2024-09-18T01:25:27.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.302+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a69d970 2024-09-18T01:25:27.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.302+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a6945f0 2024-09-18T01:25:27.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.303+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.303+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a6945f0 2024-09-18T01:25:27.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.303+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.303+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x7f2f6005c070 2024-09-18T01:25:27.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.303+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.303+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a69d970 2024-09-18T01:25:27.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.304+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a69d970 2024-09-18T01:25:27.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.304+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a698d70 2024-09-18T01:25:27.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.304+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6009f070 con 0x55a70a698d70 2024-09-18T01:25:27.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.304+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a6945f0 2024-09-18T01:25:27.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.304+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.304+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x7f2f6005c070 2024-09-18T01:25:27.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.304+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.304+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a69d970 2024-09-18T01:25:27.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.304+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a69d970 2024-09-18T01:25:27.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.304+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x7f2f6005c070 2024-09-18T01:25:27.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.305+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.305+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a698d70 2024-09-18T01:25:27.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.305+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6009f070 con 0x55a70a698d70 2024-09-18T01:25:27.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.305+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a69d970 2024-09-18T01:25:27.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.305+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a69d970 2024-09-18T01:25:27.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.305+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x7f2f6005c070 2024-09-18T01:25:27.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a6945f0 2024-09-18T01:25:27.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a70a698280 con 0x55a70a698d70 2024-09-18T01:25:27.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2f6009f070 con 0x55a70a698d70 2024-09-18T01:25:27.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f72a0f800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:27.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f72a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:27.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f72a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:27.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f72a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:27.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f72a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:27.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f72a0f800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:27.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f72a0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a69c270 con 0x55a70a6945f0 2024-09-18T01:25:27.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f72a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f72a0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.306+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a69c660 con 0x55a70a6945f0 2024-09-18T01:25:27.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a69c660 con 0x7f2f6005c070 2024-09-18T01:25:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 20 zone default found 2024-09-18T01:25:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 4 Realm: () 2024-09-18T01:25:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 20 zonegroup default 2024-09-18T01:25:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a69ca80 con 0x7f2f6005c070 2024-09-18T01:25:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.307+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a69ca80 con 0x55a70a69d970 2024-09-18T01:25:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.308+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a69d970 2024-09-18T01:25:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.308+0000 7f2f72a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.308+0000 7f2f72a0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.308+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a2360 con 0x55a70a69d970 2024-09-18T01:25:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.308+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a69d970 2024-09-18T01:25:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.308+0000 7f2f72a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.308+0000 7f2f72a0f800 20 started sync module instance, tier type = 2024-09-18T01:25:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.308+0000 7f2f72a0f800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.308+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a1800 con 0x55a70a698d70 2024-09-18T01:25:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.309+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6009f070 con 0x55a70a698d70 2024-09-18T01:25:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.309+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94175922625568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a2bb0 con 0x55a70a698d70 2024-09-18T01:25:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.309+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a3400 con 0x55a70a6945f0 2024-09-18T01:25:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.312+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.312+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94175922630480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a3a00 con 0x55a70a6945f0 2024-09-18T01:25:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.312+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a4520 con 0x55a70a69d970 2024-09-18T01:25:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.314+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94175922625568] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6009f070 con 0x55a70a698d70 2024-09-18T01:25:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.314+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a69d970 2024-09-18T01:25:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.314+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94175922634736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a4910 con 0x55a70a69d970 2024-09-18T01:25:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.314+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a5360 con 0x55a70a698d70 2024-09-18T01:25:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.315+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6009f070 con 0x55a70a698d70 2024-09-18T01:25:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.315+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94175922640720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a6020 con 0x55a70a698d70 2024-09-18T01:25:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.315+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a6a60 con 0x55a70a6945f0 2024-09-18T01:25:27.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.316+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94175922630480] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.316+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94175922634736] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a69d970 2024-09-18T01:25:27.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.317+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94175922640720] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6009f070 con 0x55a70a698d70 2024-09-18T01:25:27.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.320+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.320+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94175922628352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a3450 con 0x55a70a6945f0 2024-09-18T01:25:27.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.320+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a6020 con 0x7f2f6005c070 2024-09-18T01:25:27.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.323+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94175922628352] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.323+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.323+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94175922644272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a6020 con 0x7f2f6005c070 2024-09-18T01:25:27.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.323+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a7420 con 0x7f2f6005c070 2024-09-18T01:25:27.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.324+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94175922644272] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.324+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.324+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94175922642256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a7420 con 0x7f2f6005c070 2024-09-18T01:25:27.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.324+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a7de0 con 0x7f2f6005c070 2024-09-18T01:25:27.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.325+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.325+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94175922649392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a8200 con 0x7f2f6005c070 2024-09-18T01:25:27.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.325+0000 7f2f72a0f800 20 add_watcher() i=0 2024-09-18T01:25:27.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.325+0000 7f2f72a0f800 20 add_watcher() i=1 2024-09-18T01:25:27.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.325+0000 7f2f72a0f800 20 add_watcher() i=2 2024-09-18T01:25:27.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.325+0000 7f2f72a0f800 20 add_watcher() i=3 2024-09-18T01:25:27.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.325+0000 7f2f72a0f800 20 add_watcher() i=4 2024-09-18T01:25:27.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.325+0000 7f2f72a0f800 20 add_watcher() i=5 2024-09-18T01:25:27.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.325+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94175922642256] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.325+0000 7f2f72a0f800 20 add_watcher() i=6 2024-09-18T01:25:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.326+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94175922649392] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.326+0000 7f2f72a0f800 20 add_watcher() i=7 2024-09-18T01:25:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.326+0000 7f2f72a0f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.326+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a6f70 con 0x55a70a6945f0 2024-09-18T01:25:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.326+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.326+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94175922650448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a6f70 con 0x55a70a6945f0 2024-09-18T01:25:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.327+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94175922650448] v33'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.328+0000 7f2e267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.328+0000 7f2f72a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.328+0000 7f2f72a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.328+0000 7f2f72a0f800 5 note: GC not initialized 2024-09-18T01:25:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.328+0000 7f2e257e2640 20 reqs_thread_entry: start 2024-09-18T01:25:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.328+0000 7f2f72a0f800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.328+0000 7f2f72a0f800 20 Filter name: none 2024-09-18T01:25:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.328+0000 7f2d96ffd640 20 reqs_thread_entry: start 2024-09-18T01:25:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.328+0000 7f2f72a0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.328+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6de0c0 con 0x55a70a6945f0 2024-09-18T01:25:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.329+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.329+0000 7f2f72a0f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:27.332 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:27.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.330+0000 7f2e267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:27.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.330+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94175922650448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6dceb0 con 0x55a70a6945f0 2024-09-18T01:25:27.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.331+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94175922650448] v33'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.331+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94175922625568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a7d50 con 0x55a70a698d70 2024-09-18T01:25:27.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.331+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94175922625568] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6009f070 con 0x55a70a698d70 2024-09-18T01:25:27.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.331+0000 7f2f72a0f800 20 remove_watcher() i=0 2024-09-18T01:25:27.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.331+0000 7f2f72a0f800 2 removed watcher, disabling cache 2024-09-18T01:25:27.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.331+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94175922630480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a1c20 con 0x55a70a6945f0 2024-09-18T01:25:27.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.333+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94175922630480] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.333+0000 7f2f72a0f800 20 remove_watcher() i=1 2024-09-18T01:25:27.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.333+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94175922634736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a1c20 con 0x55a70a69d970 2024-09-18T01:25:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.334+0000 7f2f67fff640 1 -- 172.21.15.100:0/1045381667 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94175922634736] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f58009050 con 0x55a70a69d970 2024-09-18T01:25:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.334+0000 7f2f72a0f800 20 remove_watcher() i=2 2024-09-18T01:25:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.334+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94175922640720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a3ff0 con 0x55a70a698d70 2024-09-18T01:25:27.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.336+0000 7f2f70503640 1 -- 172.21.15.100:0/1045381667 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94175922640720] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6009f070 con 0x55a70a698d70 2024-09-18T01:25:27.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.336+0000 7f2f72a0f800 20 remove_watcher() i=3 2024-09-18T01:25:27.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.336+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94175922628352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a3ff0 con 0x55a70a6945f0 2024-09-18T01:25:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.338+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94175922628352] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x55a70a6945f0 2024-09-18T01:25:27.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.338+0000 7f2f72a0f800 20 remove_watcher() i=4 2024-09-18T01:25:27.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.338+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94175922644272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a2700 con 0x7f2f6005c070 2024-09-18T01:25:27.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.340+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94175922644272] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.340+0000 7f2f72a0f800 20 remove_watcher() i=5 2024-09-18T01:25:27.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.340+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94175922642256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a3ff0 con 0x7f2f6005c070 2024-09-18T01:25:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.342+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94175922642256] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.342+0000 7f2f72a0f800 20 remove_watcher() i=6 2024-09-18T01:25:27.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.342+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94175922649392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a70a6a5d50 con 0x7f2f6005c070 2024-09-18T01:25:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94175922649392] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f6800a4a0 con 0x7f2f6005c070 2024-09-18T01:25:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 20 remove_watcher() i=7 2024-09-18T01:25:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2f6005c070 msgr2=0x7f2f6005a310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2f6005c070 0x7f2f6005a310 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a70a6945f0 msgr2=0x55a70a696ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a70a6945f0 0x55a70a696ab0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a70a698d70 msgr2=0x55a70a69b160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a70a698d70 0x55a70a69b160 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a70a69d970 msgr2=0x55a70a69fe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a70a69d970 0x55a70a69fe30 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e40036b40 msgr2=0x7f2e40039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e40036b40 0x7f2e40039000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2f58001b60 tx=0x7f2f58010000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a681df0 msgr2=0x55a70a689080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f70d04640 1 -- 172.21.15.100:0/1045381667 reap_dead start 2024-09-18T01:25:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a681df0 0x55a70a689080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2f60097040 tx=0x7f2f6007bfc0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 shutdown_connections 2024-09-18T01:25:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/1045381667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a681df0 0x55a70a689080 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 >> 172.21.15.100:0/1045381667 conn(0x55a70a67e150 msgr2=0x55a70a67c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 shutdown_connections 2024-09-18T01:25:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 -- 172.21.15.100:0/1045381667 wait complete. 2024-09-18T01:25:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 -- 172.21.15.100:0/2221974919 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e48036b40 msgr2=0x7f2e48039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/2221974919 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e48036b40 0x7f2e48039000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800bf50 tx=0x7f2f5800f000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 -- 172.21.15.100:0/2221974919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a6752f0 msgr2=0x55a70a675710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/2221974919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a6752f0 0x55a70a675710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2f6008f010 tx=0x7f2f600747a0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 -- 172.21.15.100:0/2221974919 shutdown_connections 2024-09-18T01:25:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/2221974919 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e48036b40 0x7f2e48039000 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/2221974919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a6752f0 0x55a70a675710 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.344+0000 7f2f72a0f800 1 -- 172.21.15.100:0/2221974919 >> 172.21.15.100:0/2221974919 conn(0x55a70a66a280 msgr2=0x55a70a66ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 -- 172.21.15.100:0/2221974919 shutdown_connections 2024-09-18T01:25:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 -- 172.21.15.100:0/2221974919 wait complete. 2024-09-18T01:25:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a70a664a50 msgr2=0x55a70a666e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a70a664a50 0x55a70a666e40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a70a563780 msgr2=0x55a70a65e230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a70a563780 0x55a70a65e230 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a70a660b10 msgr2=0x55a70a662f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a70a660b10 0x55a70a662f00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e58036b90 msgr2=0x7f2e58039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2e58036b90 0x7f2e58039050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2f58000f60 tx=0x7f2f580012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 msgr2=0x55a70a6571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 --2- 172.21.15.100:0/257652741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a70a4d3d90 0x55a70a6571c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55a70a6506b0 tx=0x7f2f60002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f70d04640 1 -- 172.21.15.100:0/257652741 reap_dead start 2024-09-18T01:25:27.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 shutdown_connections 2024-09-18T01:25:27.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 >> 172.21.15.100:0/257652741 conn(0x55a70a55adf0 msgr2=0x55a70a649ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 shutdown_connections 2024-09-18T01:25:27.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.345+0000 7f2f72a0f800 1 -- 172.21.15.100:0/257652741 wait complete. 2024-09-18T01:25:27.355 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:27.355 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-18T01:25:27.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-18T01:25:27.355 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-18T01:25:27.399 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:27.399 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:27.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.399+0000 7f10b0126800 1 Processor -- start 2024-09-18T01:25:27.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.399+0000 7f10b0126800 1 -- start start 2024-09-18T01:25:27.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.399+0000 7f10b0126800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55c763ff7900 0x55c763ff9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.399+0000 7f10b0126800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c763eb3b30 con 0x55c763ff34c0 2024-09-18T01:25:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.399+0000 7f10b0126800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55c763e95360 con 0x55c763ff7900 2024-09-18T01:25:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.399+0000 7f10ab61c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55c763ff7900 0x55c763ff9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.399+0000 7f10abe1d640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55c763ff34c0 0x55c763ff38c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59226/0 (socket says 172.21.15.100:59226) 2024-09-18T01:25:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.399+0000 7f10ab61c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55c763ff7900 0x55c763ff9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32898/0 (socket says 172.21.15.100:32898) 2024-09-18T01:25:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.399+0000 7f10abe1d640 1 -- 172.21.15.100:0/2402130779 learned_addr learned my addr 172.21.15.100:0/2402130779 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.399+0000 7f10ab61c640 1 -- 172.21.15.100:0/2402130779 >> v1:172.21.15.92:6789/0 conn(0x55c763ff34c0 legacy=0x55c763ff38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.399+0000 7f10ab61c640 1 -- 172.21.15.100:0/2402130779 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c763ebbe00 con 0x55c763ff7900 2024-09-18T01:25:27.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.401+0000 7f10ab61c640 1 --2- 172.21.15.100:0/2402130779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff7900 0x55c763ff9cf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f109400a470 tx=0x7f1094045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5b0e67b6b2c558 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.401+0000 7f10aae1b640 1 -- 172.21.15.100:0/2402130779 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1094053570 con 0x55c763ff7900 2024-09-18T01:25:27.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.401+0000 7f10aae1b640 1 -- 172.21.15.100:0/2402130779 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1094058070 con 0x55c763ff7900 2024-09-18T01:25:27.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.401+0000 7f10aae1b640 1 -- 172.21.15.100:0/2402130779 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1094053880 con 0x55c763ff7900 2024-09-18T01:25:27.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.402+0000 7f10b0126800 1 -- 172.21.15.100:0/2402130779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff7900 msgr2=0x55c763ff9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.402+0000 7f10b0126800 1 --2- 172.21.15.100:0/2402130779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff7900 0x55c763ff9cf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f109400a470 tx=0x7f1094045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:27.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.402+0000 7f10b0126800 1 -- 172.21.15.100:0/2402130779 shutdown_connections 2024-09-18T01:25:27.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.402+0000 7f10b0126800 1 --2- 172.21.15.100:0/2402130779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff7900 0x55c763ff9cf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.402+0000 7f10b0126800 1 -- 172.21.15.100:0/2402130779 >> 172.21.15.100:0/2402130779 conn(0x55c763feedf0 msgr2=0x55c763ff1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.402+0000 7f10b0126800 1 -- 172.21.15.100:0/2402130779 shutdown_connections 2024-09-18T01:25:27.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.402+0000 7f10b0126800 1 -- 172.21.15.100:0/2402130779 wait complete. 2024-09-18T01:25:27.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.415+0000 7f10b0126800 1 Processor -- start 2024-09-18T01:25:27.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.415+0000 7f10b0126800 1 -- start start 2024-09-18T01:25:27.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.416+0000 7f10b0126800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff34c0 0x55c763f67d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.416+0000 7f10b0126800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c763f40330 con 0x55c763ff34c0 2024-09-18T01:25:27.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.416+0000 7f10abe1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff34c0 0x55c763f67d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.416+0000 7f10abe1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff34c0 0x55c763f67d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32910/0 (socket says 172.21.15.100:32910) 2024-09-18T01:25:27.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.416+0000 7f10abe1d640 1 -- 172.21.15.100:0/3623383076 learned_addr learned my addr 172.21.15.100:0/3623383076 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.416+0000 7f10abe1d640 1 -- 172.21.15.100:0/3623383076 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c763e8dbc0 con 0x55c763ff34c0 2024-09-18T01:25:27.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.416+0000 7f10abe1d640 1 --2- 172.21.15.100:0/3623383076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff34c0 0x55c763f67d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f109c0017a0 tx=0x7f109c001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a70683649d3357 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.417+0000 7f0f99e0b640 1 -- 172.21.15.100:0/3623383076 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109c016070 con 0x55c763ff34c0 2024-09-18T01:25:27.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.417+0000 7f0f99e0b640 1 -- 172.21.15.100:0/3623383076 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109c004520 con 0x55c763ff34c0 2024-09-18T01:25:27.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.417+0000 7f0f99e0b640 1 -- 172.21.15.100:0/3623383076 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109c004820 con 0x55c763ff34c0 2024-09-18T01:25:27.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.417+0000 7f10b0126800 1 -- 172.21.15.100:0/3623383076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff34c0 msgr2=0x55c763f67d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.417+0000 7f10b0126800 1 --2- 172.21.15.100:0/3623383076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff34c0 0x55c763f67d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f109c0017a0 tx=0x7f109c001c60 comp rx=0 tx=0).stop 2024-09-18T01:25:27.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.417+0000 7f10b0126800 1 -- 172.21.15.100:0/3623383076 shutdown_connections 2024-09-18T01:25:27.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.417+0000 7f10b0126800 1 --2- 172.21.15.100:0/3623383076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff34c0 0x55c763f67d80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.417+0000 7f10b0126800 1 -- 172.21.15.100:0/3623383076 >> 172.21.15.100:0/3623383076 conn(0x55c763feedf0 msgr2=0x55c7640de110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.417+0000 7f10b0126800 1 -- 172.21.15.100:0/3623383076 shutdown_connections 2024-09-18T01:25:27.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.418+0000 7f10b0126800 1 -- 172.21.15.100:0/3623383076 wait complete. 2024-09-18T01:25:27.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.418+0000 7f10b0126800 1 Processor -- start 2024-09-18T01:25:27.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.418+0000 7f10b0126800 1 -- start start 2024-09-18T01:25:27.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.418+0000 7f10b0126800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff34c0 0x55c7640eb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.418+0000 7f10b0126800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c763ffa530 con 0x55c763ff34c0 2024-09-18T01:25:27.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.418+0000 7f10abe1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff34c0 0x55c7640eb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.418+0000 7f10abe1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff34c0 0x55c7640eb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32920/0 (socket says 172.21.15.100:32920) 2024-09-18T01:25:27.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.418+0000 7f10abe1d640 1 -- 172.21.15.100:0/3242156362 learned_addr learned my addr 172.21.15.100:0/3242156362 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.419+0000 7f10abe1d640 1 -- 172.21.15.100:0/3242156362 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c763ea1fe0 con 0x55c763ff34c0 2024-09-18T01:25:27.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.419+0000 7f10abe1d640 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff34c0 0x55c7640eb290 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f109c000f80 tx=0x7f109c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.419+0000 7f0f93fff640 1 -- 172.21.15.100:0/3242156362 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109c016040 con 0x55c763ff34c0 2024-09-18T01:25:27.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.419+0000 7f0f93fff640 1 -- 172.21.15.100:0/3242156362 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109c011530 con 0x55c763ff34c0 2024-09-18T01:25:27.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.419+0000 7f0f93fff640 1 -- 172.21.15.100:0/3242156362 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109c011890 con 0x55c763ff34c0 2024-09-18T01:25:27.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.419+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7640eb7d0 con 0x55c763ff34c0 2024-09-18T01:25:27.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.419+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7640ebd50 con 0x55c763ff34c0 2024-09-18T01:25:27.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.420+0000 7f0f93fff640 1 -- 172.21.15.100:0/3242156362 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f109c01c3f0 con 0x55c763ff34c0 2024-09-18T01:25:27.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.420+0000 7f0f93fff640 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f94036be0 0x7f0f940390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.420+0000 7f0f93fff640 1 -- 172.21.15.100:0/3242156362 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f109c04bc80 con 0x55c763ff34c0 2024-09-18T01:25:27.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.420+0000 7f10ab61c640 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f94036be0 0x7f0f940390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.420+0000 7f10b0126800 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c763ff7900 0x55c7640f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.420+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c7640f2880 con 0x55c763ff7900 2024-09-18T01:25:27.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.420+0000 7f10ac61e640 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c763ff7900 0x55c7640f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.420+0000 7f10ab61c640 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f94036be0 0x7f0f940390a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1094057000 tx=0x7f1094052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.421+0000 7f10ac61e640 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c763ff7900 0x55c7640f2210 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.421+0000 7f10ac61e640 1 -- 172.21.15.100:0/3242156362 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10a40083e0 con 0x55c763ff7900 2024-09-18T01:25:27.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.421+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c7640ef8b0 con 0x55c763ff7900 2024-09-18T01:25:27.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.421+0000 7f10ac61e640 1 -- 172.21.15.100:0/3242156362 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f10a40083e0 con 0x55c763ff7900 2024-09-18T01:25:27.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.421+0000 7f10b0126800 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c7640f4bb0 0x55c7640f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.421+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c7640f7690 con 0x55c7640f4bb0 2024-09-18T01:25:27.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.421+0000 7f10abe1d640 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c7640f4bb0 0x55c7640f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.422+0000 7f10abe1d640 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c7640f4bb0 0x55c7640f6fa0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.422+0000 7f10abe1d640 1 -- 172.21.15.100:0/3242156362 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f109c019050 con 0x55c7640f4bb0 2024-09-18T01:25:27.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.422+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c7640f3a50 con 0x55c763ff7900 2024-09-18T01:25:27.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.422+0000 7f10ac61e640 1 -- 172.21.15.100:0/3242156362 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f10a40083e0 con 0x55c763ff7900 2024-09-18T01:25:27.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.422+0000 7f10b0126800 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55c7640f8af0 0x55c7640faee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.422+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c7640fb620 con 0x55c7640f8af0 2024-09-18T01:25:27.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.422+0000 7f10ab61c640 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55c7640f8af0 0x55c7640faee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.423+0000 7f10ab61c640 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55c7640f8af0 0x55c7640faee0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.423+0000 7f10ab61c640 1 -- 172.21.15.100:0/3242156362 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1094051070 con 0x55c7640f8af0 2024-09-18T01:25:27.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.423+0000 7f10b0126800 1 Processor -- start 2024-09-18T01:25:27.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.423+0000 7f10b0126800 1 -- start start 2024-09-18T01:25:27.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.423+0000 7f10b0126800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764109370 0x55c764109790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.423+0000 7f10b0126800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c763e8f580 con 0x55c764109370 2024-09-18T01:25:27.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.424+0000 7f10abe1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764109370 0x55c764109790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.424+0000 7f10abe1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764109370 0x55c764109790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32928/0 (socket says 172.21.15.100:32928) 2024-09-18T01:25:27.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.424+0000 7f10abe1d640 1 -- 172.21.15.100:0/962980893 learned_addr learned my addr 172.21.15.100:0/962980893 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.424+0000 7f10abe1d640 1 -- 172.21.15.100:0/962980893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c764109cd0 con 0x55c764109370 2024-09-18T01:25:27.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.424+0000 7f10abe1d640 1 --2- 172.21.15.100:0/962980893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764109370 0x55c764109790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f109c019770 tx=0x7f109c019df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.424+0000 7f0f917fa640 1 -- 172.21.15.100:0/962980893 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109c0432a0 con 0x55c764109370 2024-09-18T01:25:27.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.424+0000 7f10b0126800 1 -- 172.21.15.100:0/962980893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c764109f60 con 0x55c764109370 2024-09-18T01:25:27.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.424+0000 7f0f917fa640 1 -- 172.21.15.100:0/962980893 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109c043440 con 0x55c764109370 2024-09-18T01:25:27.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.424+0000 7f0f917fa640 1 -- 172.21.15.100:0/962980893 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109c00fbb0 con 0x55c764109370 2024-09-18T01:25:27.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.424+0000 7f10b0126800 1 -- 172.21.15.100:0/962980893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c76410cc40 con 0x55c764109370 2024-09-18T01:25:27.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.425+0000 7f0f917fa640 1 -- 172.21.15.100:0/962980893 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f109c03d1a0 con 0x55c764109370 2024-09-18T01:25:27.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.425+0000 7f0f917fa640 1 --2- 172.21.15.100:0/962980893 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f84036b40 0x7f0f84039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.425+0000 7f0f917fa640 1 -- 172.21.15.100:0/962980893 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f109c0038e0 con 0x55c764109370 2024-09-18T01:25:27.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.425+0000 7f10ab61c640 1 --2- 172.21.15.100:0/962980893 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f84036b40 0x7f0f84039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.426+0000 7f10b0126800 1 Processor -- start 2024-09-18T01:25:27.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.426+0000 7f10b0126800 1 -- start start 2024-09-18T01:25:27.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.426+0000 7f10ab61c640 1 --2- 172.21.15.100:0/962980893 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f84036b40 0x7f0f84039000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55c7640f2d50 tx=0x7f1094005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.426+0000 7f10b0126800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764115e30 0x55c764116230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.426+0000 7f10b0126800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c7640e6730 con 0x55c764115e30 2024-09-18T01:25:27.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.426+0000 7f10abe1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764115e30 0x55c764116230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.426+0000 7f10abe1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764115e30 0x55c764116230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32932/0 (socket says 172.21.15.100:32932) 2024-09-18T01:25:27.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.426+0000 7f10abe1d640 1 -- 172.21.15.100:0/2887187197 learned_addr learned my addr 172.21.15.100:0/2887187197 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.426+0000 7f10abe1d640 1 -- 172.21.15.100:0/2887187197 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c764116800 con 0x55c764115e30 2024-09-18T01:25:27.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.427+0000 7f10abe1d640 1 --2- 172.21.15.100:0/2887187197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764115e30 0x55c764116230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f109c002200 tx=0x7f109c03ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200ca6c03cfd17ac server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.427+0000 7f0f8affd640 1 -- 172.21.15.100:0/2887187197 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109c03e4b0 con 0x55c764115e30 2024-09-18T01:25:27.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.427+0000 7f0f8affd640 1 -- 172.21.15.100:0/2887187197 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109c04b5d0 con 0x55c764115e30 2024-09-18T01:25:27.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.427+0000 7f0f8affd640 1 -- 172.21.15.100:0/2887187197 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109c01d070 con 0x55c764115e30 2024-09-18T01:25:27.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.427+0000 7f10b0126800 1 -- 172.21.15.100:0/2887187197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764115e30 msgr2=0x55c764116230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.427+0000 7f10b0126800 1 --2- 172.21.15.100:0/2887187197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764115e30 0x55c764116230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f109c002200 tx=0x7f109c03ea60 comp rx=0 tx=0).stop 2024-09-18T01:25:27.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.427+0000 7f10b0126800 1 -- 172.21.15.100:0/2887187197 shutdown_connections 2024-09-18T01:25:27.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.427+0000 7f10b0126800 1 --2- 172.21.15.100:0/2887187197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764115e30 0x55c764116230 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.427+0000 7f10b0126800 1 -- 172.21.15.100:0/2887187197 >> 172.21.15.100:0/2887187197 conn(0x55c764112190 msgr2=0x55c764110290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.427+0000 7f10b0126800 1 -- 172.21.15.100:0/2887187197 shutdown_connections 2024-09-18T01:25:27.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.427+0000 7f10b0126800 1 -- 172.21.15.100:0/2887187197 wait complete. 2024-09-18T01:25:27.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.427+0000 7f10b0126800 1 Processor -- start 2024-09-18T01:25:27.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.428+0000 7f10b0126800 1 -- start start 2024-09-18T01:25:27.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.428+0000 7f10b0126800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764115e30 0x55c76411d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.428+0000 7f10b0126800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c764116dc0 con 0x55c764115e30 2024-09-18T01:25:27.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.428+0000 7f10abe1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764115e30 0x55c76411d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.428+0000 7f10abe1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764115e30 0x55c76411d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32940/0 (socket says 172.21.15.100:32940) 2024-09-18T01:25:27.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.428+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 learned_addr learned my addr 172.21.15.100:0/3683684426 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.428+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c76411d5d0 con 0x55c764115e30 2024-09-18T01:25:27.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.428+0000 7f10abe1d640 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764115e30 0x55c76411d090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f109c03eb30 tx=0x7f109c003550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.428+0000 7f0f897fa640 1 -- 172.21.15.100:0/3683684426 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109c065070 con 0x55c764115e30 2024-09-18T01:25:27.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.428+0000 7f0f897fa640 1 -- 172.21.15.100:0/3683684426 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109c00f300 con 0x55c764115e30 2024-09-18T01:25:27.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.428+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c76411d5d0 con 0x55c764115e30 2024-09-18T01:25:27.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.428+0000 7f0f897fa640 1 -- 172.21.15.100:0/3683684426 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109c03d490 con 0x55c764115e30 2024-09-18T01:25:27.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.429+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c76411d5d0 con 0x55c764115e30 2024-09-18T01:25:27.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.429+0000 7f0f897fa640 1 -- 172.21.15.100:0/3683684426 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f109c068070 con 0x55c764115e30 2024-09-18T01:25:27.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.429+0000 7f0f897fa640 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f74036b40 0x7f0f74039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.429+0000 7f0f897fa640 1 -- 172.21.15.100:0/3683684426 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f109c05b030 con 0x55c764115e30 2024-09-18T01:25:27.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.429+0000 7f10ab61c640 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f74036b40 0x7f0f74039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.430+0000 7f10ab61c640 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f74036b40 0x7f0f74039000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1094053570 tx=0x7f1094053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.430+0000 7f10b0126800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.430+0000 7f10b0126800 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c764128880 0x55c76412ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.430+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c76412b490 con 0x55c764128880 2024-09-18T01:25:27.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.430+0000 7f10ac61e640 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c764128880 0x55c76412ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.430+0000 7f10ac61e640 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c764128880 0x55c76412ad40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10a40083e0 con 0x55c764128880 2024-09-18T01:25:27.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 20 realm 2024-09-18T01:25:27.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c76412b8a0 con 0x55c764128880 2024-09-18T01:25:27.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10a40083e0 con 0x55c764128880 2024-09-18T01:25:27.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:27.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c764128880 2024-09-18T01:25:27.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10a40083e0 con 0x55c764128880 2024-09-18T01:25:27.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c510 con 0x55c764128880 2024-09-18T01:25:27.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f10a40083e0 con 0x55c764128880 2024-09-18T01:25:27.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:27.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c76412ced0 0x55c76412f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.431+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c76412f910 con 0x55c76412ced0 2024-09-18T01:25:27.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.432+0000 7f10abe1d640 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c76412ced0 0x55c76412f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.432+0000 7f10abe1d640 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c76412ced0 0x55c76412f2c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.432+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f109c071070 con 0x55c76412ced0 2024-09-18T01:25:27.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.432+0000 7f10b0126800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:27.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.432+0000 7f10b0126800 20 searching for the correct realm 2024-09-18T01:25:27.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.432+0000 7f10b0126800 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55c7641318a0 0x55c764133d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.432+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c764134430 con 0x55c7641318a0 2024-09-18T01:25:27.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.432+0000 7f10ab61c640 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55c7641318a0 0x55c764133d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.432+0000 7f10ab61c640 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55c7641318a0 0x55c764133d60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.433+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1094051070 con 0x55c7641318a0 2024-09-18T01:25:27.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.433+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c764134430 con 0x55c76412ced0 2024-09-18T01:25:27.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.433+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109c071070 con 0x55c76412ced0 2024-09-18T01:25:27.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.433+0000 7f10abe1d640 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f109c06a070 0x7f109c010500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.433+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c764134430 con 0x7f109c06a070 2024-09-18T01:25:27.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.433+0000 7f10ac61e640 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f109c06a070 0x7f109c010500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.434+0000 7f10ac61e640 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f109c06a070 0x7f109c010500 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.434+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f10a40083e0 con 0x7f109c06a070 2024-09-18T01:25:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.434+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c764128880 2024-09-18T01:25:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.434+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a40083e0 con 0x55c764128880 2024-09-18T01:25:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.434+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c764128880 2024-09-18T01:25:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.434+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.434+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x7f109c06a070 2024-09-18T01:25:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.434+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.434+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x7f109c06a070 2024-09-18T01:25:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.435+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.435+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c76412ced0 2024-09-18T01:25:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.435+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109c071070 con 0x55c76412ced0 2024-09-18T01:25:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.435+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c7641318a0 2024-09-18T01:25:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.435+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1094051070 con 0x55c7641318a0 2024-09-18T01:25:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.435+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c764128880 2024-09-18T01:25:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.435+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.435+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x7f109c06a070 2024-09-18T01:25:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.436+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.436+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c764128880 2024-09-18T01:25:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.436+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.436+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c76412ced0 2024-09-18T01:25:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.436+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f109c071070 con 0x55c76412ced0 2024-09-18T01:25:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.436+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c7641318a0 2024-09-18T01:25:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.436+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1094051070 con 0x55c7641318a0 2024-09-18T01:25:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.436+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c7641318a0 2024-09-18T01:25:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.437+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1094051070 con 0x55c7641318a0 2024-09-18T01:25:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.437+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x7f109c06a070 2024-09-18T01:25:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.437+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.437+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c7641318a0 2024-09-18T01:25:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.437+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1094051070 con 0x55c7641318a0 2024-09-18T01:25:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.437+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c7641318a0 2024-09-18T01:25:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.437+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1094051070 con 0x55c7641318a0 2024-09-18T01:25:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.437+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c764128880 2024-09-18T01:25:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.437+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.437+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c764128880 2024-09-18T01:25:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.438+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.438+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x7f109c06a070 2024-09-18T01:25:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.438+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.438+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c7641318a0 2024-09-18T01:25:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.438+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1094051070 con 0x55c7641318a0 2024-09-18T01:25:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.438+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c76412ced0 2024-09-18T01:25:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.438+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109c071070 con 0x55c76412ced0 2024-09-18T01:25:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.438+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c764128880 2024-09-18T01:25:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.439+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.439+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x7f109c06a070 2024-09-18T01:25:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.439+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.439+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c7641318a0 2024-09-18T01:25:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.439+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1094051070 con 0x55c7641318a0 2024-09-18T01:25:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.439+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x7f109c06a070 2024-09-18T01:25:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.439+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.439+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c76412ced0 2024-09-18T01:25:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.440+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109c071070 con 0x55c76412ced0 2024-09-18T01:25:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.440+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c7641318a0 2024-09-18T01:25:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.440+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1094051070 con 0x55c7641318a0 2024-09-18T01:25:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.440+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x7f109c06a070 2024-09-18T01:25:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.440+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.440+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c764128880 2024-09-18T01:25:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.440+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.440+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c76412c170 con 0x55c76412ced0 2024-09-18T01:25:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f109c071070 con 0x55c76412ced0 2024-09-18T01:25:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c76412fcb0 con 0x55c764128880 2024-09-18T01:25:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c7641300a0 con 0x55c764128880 2024-09-18T01:25:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c7641300a0 con 0x7f109c06a070 2024-09-18T01:25:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 zone default found 2024-09-18T01:25:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 4 Realm: () 2024-09-18T01:25:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 zonegroup default 2024-09-18T01:25:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.441+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c764130df0 con 0x7f109c06a070 2024-09-18T01:25:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.442+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.442+0000 7f10b0126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.442+0000 7f10b0126800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.442+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c764136290 con 0x55c7641318a0 2024-09-18T01:25:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.442+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1094051070 con 0x55c7641318a0 2024-09-18T01:25:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.442+0000 7f10b0126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.442+0000 7f10b0126800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.442+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c764136740 con 0x55c7641318a0 2024-09-18T01:25:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.442+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1094051070 con 0x55c7641318a0 2024-09-18T01:25:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.442+0000 7f10b0126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.442+0000 7f10b0126800 20 started sync module instance, tier type = 2024-09-18T01:25:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.442+0000 7f10b0126800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.442+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764135730 con 0x55c76412ced0 2024-09-18T01:25:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.443+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109c071070 con 0x55c76412ced0 2024-09-18T01:25:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.443+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94314865842976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764137050 con 0x55c76412ced0 2024-09-18T01:25:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.443+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c7641378a0 con 0x55c764128880 2024-09-18T01:25:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.444+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.444+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94314865849328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764137dc0 con 0x55c764128880 2024-09-18T01:25:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.444+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c7641388e0 con 0x55c7641318a0 2024-09-18T01:25:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.446+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94314865849328] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.448+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94314865842976] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109c071070 con 0x55c76412ced0 2024-09-18T01:25:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.448+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1094051070 con 0x55c7641318a0 2024-09-18T01:25:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.449+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94314865847200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764137850 con 0x55c7641318a0 2024-09-18T01:25:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.449+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c7641392f0 con 0x55c76412ced0 2024-09-18T01:25:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.451+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109c071070 con 0x55c76412ced0 2024-09-18T01:25:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.451+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94314865858192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764139f60 con 0x55c76412ced0 2024-09-18T01:25:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.451+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c76413a920 con 0x55c764128880 2024-09-18T01:25:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.451+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94314865847200] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1094051070 con 0x55c7641318a0 2024-09-18T01:25:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.452+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.452+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94314865861744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c76413ad40 con 0x55c764128880 2024-09-18T01:25:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.452+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c76413b700 con 0x7f109c06a070 2024-09-18T01:25:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.454+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.454+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94314865865296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c76413bb20 con 0x7f109c06a070 2024-09-18T01:25:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.454+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c76413c5c0 con 0x7f109c06a070 2024-09-18T01:25:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.456+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94314865858192] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109c071070 con 0x55c76412ced0 2024-09-18T01:25:27.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.457+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94314865861744] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.457+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94314865865296] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.459+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.459+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94314865862800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764139ab0 con 0x7f109c06a070 2024-09-18T01:25:27.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.460+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c76413c7a0 con 0x7f109c06a070 2024-09-18T01:25:27.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.460+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94314865862800] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.460+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.460+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94314865868976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c76413c7a0 con 0x7f109c06a070 2024-09-18T01:25:27.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.460+0000 7f10b0126800 20 add_watcher() i=0 2024-09-18T01:25:27.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.460+0000 7f10b0126800 20 add_watcher() i=1 2024-09-18T01:25:27.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.460+0000 7f10b0126800 20 add_watcher() i=2 2024-09-18T01:25:27.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.460+0000 7f10b0126800 20 add_watcher() i=3 2024-09-18T01:25:27.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.460+0000 7f10b0126800 20 add_watcher() i=4 2024-09-18T01:25:27.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.460+0000 7f10b0126800 20 add_watcher() i=5 2024-09-18T01:25:27.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.460+0000 7f10b0126800 20 add_watcher() i=6 2024-09-18T01:25:27.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.461+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94314865868976] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.461+0000 7f10b0126800 20 add_watcher() i=7 2024-09-18T01:25:27.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.461+0000 7f10b0126800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:27.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.461+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c76413f860 con 0x55c764128880 2024-09-18T01:25:27.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.462+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.462+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94314865867184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c76413cc50 con 0x55c764128880 2024-09-18T01:25:27.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.463+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94314865867184] v33'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.463+0000 7f0f61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:27.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.463+0000 7f10b0126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:27.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.463+0000 7f10b0126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:27.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.463+0000 7f10b0126800 5 note: GC not initialized 2024-09-18T01:25:27.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.463+0000 7f0f60fe1640 20 reqs_thread_entry: start 2024-09-18T01:25:27.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.463+0000 7f10b0126800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:27.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.463+0000 7f10b0126800 20 Filter name: none 2024-09-18T01:25:27.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.463+0000 7f0eda7fc640 20 reqs_thread_entry: start 2024-09-18T01:25:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.463+0000 7f10b0126800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.463+0000 7f10b0126800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.463+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c764172d00 con 0x55c764128880 2024-09-18T01:25:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.464+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.464+0000 7f10b0126800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.464+0000 7f10b0126800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.464+0000 7f10b0126800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.464+0000 7f10b0126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.464+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c764175790 con 0x55c76412ced0 2024-09-18T01:25:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.464+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f109c071070 con 0x55c76412ced0 2024-09-18T01:25:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.464+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764179000 con 0x55c764128880 2024-09-18T01:25:27.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.465+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v33'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.465+0000 7f10b0126800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.465+0000 7f10b0126800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.465+0000 7f10b0126800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.465+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94314866117056 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c764174780 con 0x55c764128880 2024-09-18T01:25:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.466+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== watch-notify(notify (1) cookie 94314865861744 notify 141733920769 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f10a4010040 con 0x55c764128880 2024-09-18T01:25:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.466+0000 7f0f8affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94314865861744 notifier 4321 bl.length()=567 2024-09-18T01:25:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.466+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(65 notify.4 [notify cookie 94314866117056 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.466+0000 7f0f8affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.466+0000 7f0f8affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.466+0000 7f0f8affd640 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0f70003ea0 con 0x55c764128880 2024-09-18T01:25:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.466+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.466+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== watch-notify(notify_complete (2) cookie 94314866117056 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f10a400a8b0 con 0x55c764128880 2024-09-18T01:25:27.470 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.467+0000 7f0f61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.467+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94314865867184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764170a50 con 0x55c764128880 2024-09-18T01:25:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.468+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94314865867184] v33'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.468+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94314865842976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764170a50 con 0x55c76412ced0 2024-09-18T01:25:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.469+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94314865842976] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109c071070 con 0x55c76412ced0 2024-09-18T01:25:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.469+0000 7f10b0126800 20 remove_watcher() i=0 2024-09-18T01:25:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.469+0000 7f10b0126800 2 removed watcher, disabling cache 2024-09-18T01:25:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.469+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94314865849328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764170a50 con 0x55c764128880 2024-09-18T01:25:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.470+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94314865849328] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.470+0000 7f10b0126800 20 remove_watcher() i=1 2024-09-18T01:25:27.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.470+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94314865847200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764170a50 con 0x55c7641318a0 2024-09-18T01:25:27.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.471+0000 7f10ab61c640 1 -- 172.21.15.100:0/3683684426 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94314865847200] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1094051070 con 0x55c7641318a0 2024-09-18T01:25:27.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.471+0000 7f10b0126800 20 remove_watcher() i=2 2024-09-18T01:25:27.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.471+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94314865858192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764136ba0 con 0x55c76412ced0 2024-09-18T01:25:27.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.472+0000 7f10abe1d640 1 -- 172.21.15.100:0/3683684426 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94314865858192] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109c071070 con 0x55c76412ced0 2024-09-18T01:25:27.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.472+0000 7f10b0126800 20 remove_watcher() i=3 2024-09-18T01:25:27.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.472+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94314865861744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764139690 con 0x55c764128880 2024-09-18T01:25:27.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.473+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94314865861744] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x55c764128880 2024-09-18T01:25:27.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.473+0000 7f10b0126800 20 remove_watcher() i=4 2024-09-18T01:25:27.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.473+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94314865865296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764136ba0 con 0x7f109c06a070 2024-09-18T01:25:27.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.474+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94314865865296] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.474+0000 7f10b0126800 20 remove_watcher() i=5 2024-09-18T01:25:27.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.474+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94314865862800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c76413a470 con 0x7f109c06a070 2024-09-18T01:25:27.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.475+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94314865862800] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.475+0000 7f10b0126800 20 remove_watcher() i=6 2024-09-18T01:25:27.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.475+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94314865868976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c764139690 con 0x7f109c06a070 2024-09-18T01:25:27.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94314865868976] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a4026040 con 0x7f109c06a070 2024-09-18T01:25:27.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 20 remove_watcher() i=7 2024-09-18T01:25:27.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f109c06a070 msgr2=0x7f109c010500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f109c06a070 0x7f109c010500 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c764128880 msgr2=0x55c76412ad40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c764128880 0x55c76412ad40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c76412ced0 msgr2=0x55c76412f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c76412ced0 0x55c76412f2c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55c7641318a0 msgr2=0x55c764133d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55c7641318a0 0x55c764133d60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f74036b40 msgr2=0x7f0f74039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f74036b40 0x7f0f74039000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1094053570 tx=0x7f1094053000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764115e30 msgr2=0x55c76411d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10ac61e640 1 -- 172.21.15.100:0/3683684426 reap_dead start 2024-09-18T01:25:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764115e30 0x55c76411d090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f109c03eb30 tx=0x7f109c003550 comp rx=0 tx=0).stop 2024-09-18T01:25:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 shutdown_connections 2024-09-18T01:25:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 --2- 172.21.15.100:0/3683684426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764115e30 0x55c76411d090 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 >> 172.21.15.100:0/3683684426 conn(0x55c764112190 msgr2=0x55c764110260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 shutdown_connections 2024-09-18T01:25:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.476+0000 7f10b0126800 1 -- 172.21.15.100:0/3683684426 wait complete. 2024-09-18T01:25:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/962980893 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f84036b40 msgr2=0x7f0f84039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 --2- 172.21.15.100:0/962980893 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f84036b40 0x7f0f84039000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55c7640f2d50 tx=0x7f1094005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/962980893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764109370 msgr2=0x55c764109790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 --2- 172.21.15.100:0/962980893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764109370 0x55c764109790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f109c019770 tx=0x7f109c019df0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/962980893 shutdown_connections 2024-09-18T01:25:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 --2- 172.21.15.100:0/962980893 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f84036b40 0x7f0f84039000 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 --2- 172.21.15.100:0/962980893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c764109370 0x55c764109790 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/962980893 >> 172.21.15.100:0/962980893 conn(0x55c7640fe300 msgr2=0x55c764100e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/962980893 shutdown_connections 2024-09-18T01:25:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/962980893 wait complete. 2024-09-18T01:25:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55c7640f8af0 msgr2=0x55c7640faee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55c7640f8af0 0x55c7640faee0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c763ff7900 msgr2=0x55c7640f2210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c763ff7900 0x55c7640f2210 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c7640f4bb0 msgr2=0x55c7640f6fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c7640f4bb0 0x55c7640f6fa0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f94036be0 msgr2=0x7f0f940390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0f94036be0 0x7f0f940390a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1094057000 tx=0x7f1094052000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff34c0 msgr2=0x55c7640eb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 --2- 172.21.15.100:0/3242156362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c763ff34c0 0x55c7640eb290 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f109c000f80 tx=0x7f109c001250 comp rx=0 tx=0).stop 2024-09-18T01:25:27.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10ac61e640 1 -- 172.21.15.100:0/3242156362 reap_dead start 2024-09-18T01:25:27.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 shutdown_connections 2024-09-18T01:25:27.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 >> 172.21.15.100:0/3242156362 conn(0x55c763feedf0 msgr2=0x55c7640dca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 shutdown_connections 2024-09-18T01:25:27.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.477+0000 7f10b0126800 1 -- 172.21.15.100:0/3242156362 wait complete. 2024-09-18T01:25:27.487 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:27.487 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:25:27.487 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:25:27.487 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:25:27.531 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:27.531 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:27.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.531+0000 7fe97fe2f800 1 Processor -- start 2024-09-18T01:25:27.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.531+0000 7fe97fe2f800 1 -- start start 2024-09-18T01:25:27.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.531+0000 7fe97fe2f800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5573acb6f860 0x5573acb71c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.531+0000 7fe97fe2f800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5573aca2ab30 con 0x5573acadee90 2024-09-18T01:25:27.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.531+0000 7fe97fe2f800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5573aca0c360 con 0x5573acb6f860 2024-09-18T01:25:27.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.531+0000 7fe97d129640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5573acb6f860 0x5573acb71c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.531+0000 7fe97d92a640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5573acadee90 0x5573acb6e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59234/0 (socket says 172.21.15.100:59234) 2024-09-18T01:25:27.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.531+0000 7fe97d92a640 1 -- 172.21.15.100:0/127527781 learned_addr learned my addr 172.21.15.100:0/127527781 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:27.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.532+0000 7fe97d129640 1 -- 172.21.15.100:0/127527781 >> v1:172.21.15.92:6789/0 conn(0x5573acadee90 legacy=0x5573acb6e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.532+0000 7fe97d129640 1 -- 172.21.15.100:0/127527781 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573aca32e00 con 0x5573acb6f860 2024-09-18T01:25:27.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.532+0000 7fe97c928640 1 -- 172.21.15.100:0/127527781 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3317536685 0 0) 0x5573aca2ab30 con 0x5573acadee90 2024-09-18T01:25:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.533+0000 7fe97d129640 1 --2- 172.21.15.100:0/127527781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acb6f860 0x5573acb71c70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe97400a470 tx=0x7fe974045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6801363aaf47ef server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.534+0000 7fe97c928640 1 -- 172.21.15.100:0/127527781 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe974053570 con 0x5573acb6f860 2024-09-18T01:25:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.534+0000 7fe97c928640 1 -- 172.21.15.100:0/127527781 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe974058070 con 0x5573acb6f860 2024-09-18T01:25:27.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.534+0000 7fe97c928640 1 -- 172.21.15.100:0/127527781 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe974053880 con 0x5573acb6f860 2024-09-18T01:25:27.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.534+0000 7fe97fe2f800 1 -- 172.21.15.100:0/127527781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acb6f860 msgr2=0x5573acb71c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.534+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/127527781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acb6f860 0x5573acb71c70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe97400a470 tx=0x7fe974045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:27.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.534+0000 7fe97fe2f800 1 -- 172.21.15.100:0/127527781 shutdown_connections 2024-09-18T01:25:27.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.534+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/127527781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acb6f860 0x5573acb71c70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.534+0000 7fe97fe2f800 1 -- 172.21.15.100:0/127527781 >> 172.21.15.100:0/127527781 conn(0x5573acb65df0 msgr2=0x5573acb68210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.534+0000 7fe97fe2f800 1 -- 172.21.15.100:0/127527781 shutdown_connections 2024-09-18T01:25:27.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.534+0000 7fe97fe2f800 1 -- 172.21.15.100:0/127527781 wait complete. 2024-09-18T01:25:27.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.548+0000 7fe97fe2f800 1 Processor -- start 2024-09-18T01:25:27.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.548+0000 7fe97fe2f800 1 -- start start 2024-09-18T01:25:27.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.548+0000 7fe97fe2f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acadee90 0x5573acc5a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.548+0000 7fe97fe2f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5573acab7330 con 0x5573acadee90 2024-09-18T01:25:27.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.548+0000 7fe97d92a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acadee90 0x5573acc5a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.548+0000 7fe97d92a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acadee90 0x5573acc5a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32966/0 (socket says 172.21.15.100:32966) 2024-09-18T01:25:27.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.548+0000 7fe97d92a640 1 -- 172.21.15.100:0/94289320 learned_addr learned my addr 172.21.15.100:0/94289320 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.548+0000 7fe97d92a640 1 -- 172.21.15.100:0/94289320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573aca04bc0 con 0x5573acadee90 2024-09-18T01:25:27.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.549+0000 7fe97d92a640 1 --2- 172.21.15.100:0/94289320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acadee90 0x5573acc5a630 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe97000b240 tx=0x7fe97000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b55f20c01e7d35 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.549+0000 7fe86be07640 1 -- 172.21.15.100:0/94289320 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe970008070 con 0x5573acadee90 2024-09-18T01:25:27.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.549+0000 7fe86be07640 1 -- 172.21.15.100:0/94289320 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97000d500 con 0x5573acadee90 2024-09-18T01:25:27.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.549+0000 7fe86be07640 1 -- 172.21.15.100:0/94289320 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97000d860 con 0x5573acadee90 2024-09-18T01:25:27.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.549+0000 7fe97fe2f800 1 -- 172.21.15.100:0/94289320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acadee90 msgr2=0x5573acc5a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.549+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/94289320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acadee90 0x5573acc5a630 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe97000b240 tx=0x7fe97000b700 comp rx=0 tx=0).stop 2024-09-18T01:25:27.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.549+0000 7fe97fe2f800 1 -- 172.21.15.100:0/94289320 shutdown_connections 2024-09-18T01:25:27.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.549+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/94289320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acadee90 0x5573acc5a630 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.549+0000 7fe97fe2f800 1 -- 172.21.15.100:0/94289320 >> 172.21.15.100:0/94289320 conn(0x5573acb65df0 msgr2=0x5573acc55ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.550+0000 7fe97fe2f800 1 -- 172.21.15.100:0/94289320 shutdown_connections 2024-09-18T01:25:27.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.550+0000 7fe97fe2f800 1 -- 172.21.15.100:0/94289320 wait complete. 2024-09-18T01:25:27.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.550+0000 7fe97fe2f800 1 Processor -- start 2024-09-18T01:25:27.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.550+0000 7fe97fe2f800 1 -- start start 2024-09-18T01:25:27.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.550+0000 7fe97fe2f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acadee90 0x5573acc620b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.550+0000 7fe97fe2f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5573acb725f0 con 0x5573acadee90 2024-09-18T01:25:27.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.550+0000 7fe97d92a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acadee90 0x5573acc620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.550+0000 7fe97d92a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acadee90 0x5573acc620b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32982/0 (socket says 172.21.15.100:32982) 2024-09-18T01:25:27.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.550+0000 7fe97d92a640 1 -- 172.21.15.100:0/2711295333 learned_addr learned my addr 172.21.15.100:0/2711295333 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.551+0000 7fe97d92a640 1 -- 172.21.15.100:0/2711295333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573aca18fe0 con 0x5573acadee90 2024-09-18T01:25:27.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.551+0000 7fe97d92a640 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acadee90 0x5573acc620b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x5573acc5b490 tx=0x7fe970000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.551+0000 7fe86a604640 1 -- 172.21.15.100:0/2711295333 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe970019870 con 0x5573acadee90 2024-09-18T01:25:27.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.551+0000 7fe86a604640 1 -- 172.21.15.100:0/2711295333 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe970019a10 con 0x5573acadee90 2024-09-18T01:25:27.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.551+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573acc625f0 con 0x5573acadee90 2024-09-18T01:25:27.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.551+0000 7fe86a604640 1 -- 172.21.15.100:0/2711295333 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe970019d30 con 0x5573acadee90 2024-09-18T01:25:27.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.551+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573acc62b10 con 0x5573acadee90 2024-09-18T01:25:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.552+0000 7fe86a604640 1 -- 172.21.15.100:0/2711295333 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe970017040 con 0x5573acadee90 2024-09-18T01:25:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.552+0000 7fe86a604640 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe864036b90 0x7fe864039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.552+0000 7fe86a604640 1 -- 172.21.15.100:0/2711295333 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fe970015020 con 0x5573acadee90 2024-09-18T01:25:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.552+0000 7fe97d129640 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe864036b90 0x7fe864039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.552+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5573acb6f860 0x5573acc69120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.552+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acc696a0 con 0x5573acb6f860 2024-09-18T01:25:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.552+0000 7fe97e12b640 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5573acb6f860 0x5573acc69120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.553+0000 7fe97d129640 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe864036b90 0x7fe864039050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe974057000 tx=0x7fe974052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.553+0000 7fe97e12b640 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5573acb6f860 0x5573acc69120 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.553+0000 7fe97e12b640 1 -- 172.21.15.100:0/2711295333 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acb6f860 2024-09-18T01:25:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.553+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acc666f0 con 0x5573acb6f860 2024-09-18T01:25:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.553+0000 7fe97e12b640 1 -- 172.21.15.100:0/2711295333 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acb6f860 2024-09-18T01:25:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.553+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5573acc6b9d0 0x5573acc6ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.553+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acc6e460 con 0x5573acc6b9d0 2024-09-18T01:25:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.553+0000 7fe97d92a640 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5573acc6b9d0 0x5573acc6ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.554+0000 7fe97d92a640 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5573acc6b9d0 0x5573acc6ddc0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.554+0000 7fe97d92a640 1 -- 172.21.15.100:0/2711295333 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe97002d070 con 0x5573acc6b9d0 2024-09-18T01:25:27.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.554+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acc6a870 con 0x5573acb6f860 2024-09-18T01:25:27.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.554+0000 7fe97e12b640 1 -- 172.21.15.100:0/2711295333 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acb6f860 2024-09-18T01:25:27.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.554+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5573acc6f8c0 0x5573acc71cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.554+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acc723b0 con 0x5573acc6f8c0 2024-09-18T01:25:27.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.555+0000 7fe97d129640 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5573acc6f8c0 0x5573acc71cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.555+0000 7fe97d129640 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5573acc6f8c0 0x5573acc71cb0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.555+0000 7fe97d129640 1 -- 172.21.15.100:0/2711295333 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe974051070 con 0x5573acc6f8c0 2024-09-18T01:25:27.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.555+0000 7fe97fe2f800 1 Processor -- start 2024-09-18T01:25:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.556+0000 7fe97fe2f800 1 -- start start 2024-09-18T01:25:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.556+0000 7fe97fe2f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc80160 0x5573acc80580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.556+0000 7fe97fe2f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5573aca06580 con 0x5573acc80160 2024-09-18T01:25:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.556+0000 7fe97d92a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc80160 0x5573acc80580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.556+0000 7fe97d92a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc80160 0x5573acc80580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:32994/0 (socket says 172.21.15.100:32994) 2024-09-18T01:25:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.556+0000 7fe97d92a640 1 -- 172.21.15.100:0/3366545153 learned_addr learned my addr 172.21.15.100:0/3366545153 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.556+0000 7fe97d92a640 1 -- 172.21.15.100:0/3366545153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573acc80ac0 con 0x5573acc80160 2024-09-18T01:25:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.556+0000 7fe97d92a640 1 --2- 172.21.15.100:0/3366545153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc80160 0x5573acc80580 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe97004b770 tx=0x7fe97001aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.556+0000 7fe8637fe640 1 -- 172.21.15.100:0/3366545153 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97001a8c0 con 0x5573acc80160 2024-09-18T01:25:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.556+0000 7fe8637fe640 1 -- 172.21.15.100:0/3366545153 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe970034070 con 0x5573acc80160 2024-09-18T01:25:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.556+0000 7fe8637fe640 1 -- 172.21.15.100:0/3366545153 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97000eaa0 con 0x5573acc80160 2024-09-18T01:25:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.556+0000 7fe97fe2f800 1 -- 172.21.15.100:0/3366545153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573acc80d50 con 0x5573acc80160 2024-09-18T01:25:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.557+0000 7fe97fe2f800 1 -- 172.21.15.100:0/3366545153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573acc83a30 con 0x5573acc80160 2024-09-18T01:25:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.557+0000 7fe8637fe640 1 -- 172.21.15.100:0/3366545153 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe97000ec40 con 0x5573acc80160 2024-09-18T01:25:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.557+0000 7fe8637fe640 1 --2- 172.21.15.100:0/3366545153 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe858036b40 0x7fe858039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.557+0000 7fe8637fe640 1 -- 172.21.15.100:0/3366545153 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fe97004ec80 con 0x5573acc80160 2024-09-18T01:25:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.557+0000 7fe97d129640 1 --2- 172.21.15.100:0/3366545153 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe858036b40 0x7fe858039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.558+0000 7fe97fe2f800 1 Processor -- start 2024-09-18T01:25:27.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.558+0000 7fe97fe2f800 1 -- start start 2024-09-18T01:25:27.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.558+0000 7fe97d129640 1 --2- 172.21.15.100:0/3366545153 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe858036b40 0x7fe858039000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x5573acc66610 tx=0x7fe974005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.558+0000 7fe97fe2f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc8cd40 0x5573acc8d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.558+0000 7fe97fe2f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5573acc5ade0 con 0x5573acc8cd40 2024-09-18T01:25:27.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.558+0000 7fe97d92a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc8cd40 0x5573acc8d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.558+0000 7fe97d92a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc8cd40 0x5573acc8d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33008/0 (socket says 172.21.15.100:33008) 2024-09-18T01:25:27.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.558+0000 7fe97d92a640 1 -- 172.21.15.100:0/1085513878 learned_addr learned my addr 172.21.15.100:0/1085513878 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.558+0000 7fe97d92a640 1 -- 172.21.15.100:0/1085513878 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573acc8d680 con 0x5573acc8cd40 2024-09-18T01:25:27.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.559+0000 7fe97d92a640 1 --2- 172.21.15.100:0/1085513878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc8cd40 0x5573acc8d140 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe970001540 tx=0x7fe970008440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e5c3ddbda6a644 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.559+0000 7fe8617fa640 1 -- 172.21.15.100:0/1085513878 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97005c020 con 0x5573acc8cd40 2024-09-18T01:25:27.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.559+0000 7fe8617fa640 1 -- 172.21.15.100:0/1085513878 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe970010d10 con 0x5573acc8cd40 2024-09-18T01:25:27.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.559+0000 7fe8617fa640 1 -- 172.21.15.100:0/1085513878 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97003f7d0 con 0x5573acc8cd40 2024-09-18T01:25:27.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.559+0000 7fe97fe2f800 1 -- 172.21.15.100:0/1085513878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc8cd40 msgr2=0x5573acc8d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.559+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/1085513878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc8cd40 0x5573acc8d140 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe970001540 tx=0x7fe970008440 comp rx=0 tx=0).stop 2024-09-18T01:25:27.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.559+0000 7fe97fe2f800 1 -- 172.21.15.100:0/1085513878 shutdown_connections 2024-09-18T01:25:27.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.559+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/1085513878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc8cd40 0x5573acc8d140 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.559+0000 7fe97fe2f800 1 -- 172.21.15.100:0/1085513878 >> 172.21.15.100:0/1085513878 conn(0x5573acc890f0 msgr2=0x5573acc871f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.559+0000 7fe97fe2f800 1 -- 172.21.15.100:0/1085513878 shutdown_connections 2024-09-18T01:25:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.559+0000 7fe97fe2f800 1 -- 172.21.15.100:0/1085513878 wait complete. 2024-09-18T01:25:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.559+0000 7fe97fe2f800 1 Processor -- start 2024-09-18T01:25:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.560+0000 7fe97fe2f800 1 -- start start 2024-09-18T01:25:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.560+0000 7fe97fe2f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc8cd40 0x5573acc93fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.560+0000 7fe97fe2f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5573acc8dba0 con 0x5573acc8cd40 2024-09-18T01:25:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.560+0000 7fe97d92a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc8cd40 0x5573acc93fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.560+0000 7fe97d92a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc8cd40 0x5573acc93fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33010/0 (socket says 172.21.15.100:33010) 2024-09-18T01:25:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.560+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 learned_addr learned my addr 172.21.15.100:0/2146921136 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.560+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573acc94500 con 0x5573acc8cd40 2024-09-18T01:25:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.560+0000 7fe97d92a640 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc8cd40 0x5573acc93fc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe970001540 tx=0x7fe97004a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.560+0000 7fe84f7fe640 1 -- 172.21.15.100:0/2146921136 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe970071070 con 0x5573acc8cd40 2024-09-18T01:25:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.560+0000 7fe84f7fe640 1 -- 172.21.15.100:0/2146921136 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97001fbc0 con 0x5573acc8cd40 2024-09-18T01:25:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.561+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573acc94500 con 0x5573acc8cd40 2024-09-18T01:25:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.561+0000 7fe84f7fe640 1 -- 172.21.15.100:0/2146921136 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97001fea0 con 0x5573acc8cd40 2024-09-18T01:25:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.561+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573acc949a0 con 0x5573acc8cd40 2024-09-18T01:25:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.561+0000 7fe84f7fe640 1 -- 172.21.15.100:0/2146921136 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe970074070 con 0x5573acc8cd40 2024-09-18T01:25:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.561+0000 7fe84f7fe640 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe848036b40 0x7fe848039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.561+0000 7fe84f7fe640 1 -- 172.21.15.100:0/2146921136 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fe970067030 con 0x5573acc8cd40 2024-09-18T01:25:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.562+0000 7fe97d129640 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe848036b40 0x7fe848039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.562+0000 7fe97fe2f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.562+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5573acc9f720 0x5573acca1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.562+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acca2330 con 0x5573acc9f720 2024-09-18T01:25:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.562+0000 7fe97e12b640 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5573acc9f720 0x5573acca1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.562+0000 7fe97d129640 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe848036b40 0x7fe848039000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5573acc727b0 tx=0x7fe97406b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.562+0000 7fe97e12b640 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5573acc9f720 0x5573acca1be0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.562+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.562+0000 7fe97fe2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.562+0000 7fe97fe2f800 20 realm 2024-09-18T01:25:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.562+0000 7fe97fe2f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.562+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acca2740 con 0x5573acc9f720 2024-09-18T01:25:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97fe2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97fe2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97fe2f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acca3010 con 0x5573acc9f720 2024-09-18T01:25:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97fe2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97fe2f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acc9f720 2024-09-18T01:25:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97fe2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97fe2f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5573acca3ea0 0x5573acca6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acca69f0 con 0x5573acca3ea0 2024-09-18T01:25:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.563+0000 7fe97d92a640 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5573acca3ea0 0x5573acca6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.564+0000 7fe97d92a640 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5573acca3ea0 0x5573acca6290 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.564+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe970073030 con 0x5573acca3ea0 2024-09-18T01:25:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.564+0000 7fe97fe2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.564+0000 7fe97fe2f800 20 searching for the correct realm 2024-09-18T01:25:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.564+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5573acca8aa0 0x5573accaaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.564+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573accab630 con 0x5573acca8aa0 2024-09-18T01:25:27.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.564+0000 7fe97d129640 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5573acca8aa0 0x5573accaaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.564+0000 7fe97d129640 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5573acca8aa0 0x5573accaaf60 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.565+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974051070 con 0x5573acca8aa0 2024-09-18T01:25:27.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.565+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573accab630 con 0x5573acca3ea0 2024-09-18T01:25:27.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.565+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970073030 con 0x5573acca3ea0 2024-09-18T01:25:27.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.565+0000 7fe97d92a640 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe970076060 0x7fe97000f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.565+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573accab630 con 0x7fe970076060 2024-09-18T01:25:27.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.565+0000 7fe97e12b640 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe970076060 0x7fe97000f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.565+0000 7fe97e12b640 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe970076060 0x7fe97000f470 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.566+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.566+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acc9f720 2024-09-18T01:25:27.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.566+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.566+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acc9f720 2024-09-18T01:25:27.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.566+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.566+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x7fe970076060 2024-09-18T01:25:27.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.566+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.566+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x7fe970076060 2024-09-18T01:25:27.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.566+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.566+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acca3ea0 2024-09-18T01:25:27.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.567+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970073030 con 0x5573acca3ea0 2024-09-18T01:25:27.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.567+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acca8aa0 2024-09-18T01:25:27.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.567+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974051070 con 0x5573acca8aa0 2024-09-18T01:25:27.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.567+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acc9f720 2024-09-18T01:25:27.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.567+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.567+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x7fe970076060 2024-09-18T01:25:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.567+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.567+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acc9f720 2024-09-18T01:25:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.568+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.568+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acca3ea0 2024-09-18T01:25:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.568+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe970073030 con 0x5573acca3ea0 2024-09-18T01:25:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.568+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acca8aa0 2024-09-18T01:25:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.568+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974051070 con 0x5573acca8aa0 2024-09-18T01:25:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.568+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acca8aa0 2024-09-18T01:25:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.568+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974051070 con 0x5573acca8aa0 2024-09-18T01:25:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.568+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x7fe970076060 2024-09-18T01:25:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.569+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.569+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acca8aa0 2024-09-18T01:25:27.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.569+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974051070 con 0x5573acca8aa0 2024-09-18T01:25:27.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.569+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acca8aa0 2024-09-18T01:25:27.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.569+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974051070 con 0x5573acca8aa0 2024-09-18T01:25:27.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.569+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acc9f720 2024-09-18T01:25:27.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.569+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.569+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acc9f720 2024-09-18T01:25:27.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.569+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.570+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x7fe970076060 2024-09-18T01:25:27.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.570+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.570+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acca8aa0 2024-09-18T01:25:27.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.570+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974051070 con 0x5573acca8aa0 2024-09-18T01:25:27.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.570+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acca3ea0 2024-09-18T01:25:27.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.570+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970073030 con 0x5573acca3ea0 2024-09-18T01:25:27.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.570+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acc9f720 2024-09-18T01:25:27.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.570+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.570+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x7fe970076060 2024-09-18T01:25:27.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.571+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.571+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acca8aa0 2024-09-18T01:25:27.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.571+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974051070 con 0x5573acca8aa0 2024-09-18T01:25:27.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.571+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x7fe970076060 2024-09-18T01:25:27.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.571+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.571+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acca3ea0 2024-09-18T01:25:27.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.571+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970073030 con 0x5573acca3ea0 2024-09-18T01:25:27.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.571+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acca8aa0 2024-09-18T01:25:27.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974051070 con 0x5573acca8aa0 2024-09-18T01:25:27.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x7fe970076060 2024-09-18T01:25:27.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acc9f720 2024-09-18T01:25:27.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5573acca33b0 con 0x5573acca3ea0 2024-09-18T01:25:27.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe970073030 con 0x5573acca3ea0 2024-09-18T01:25:27.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97fe2f800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:27.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97fe2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:27.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97fe2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:27.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97fe2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:27.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97fe2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:27.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97fe2f800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:27.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97fe2f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.572+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acca73a0 con 0x5573acc9f720 2024-09-18T01:25:27.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acca7790 con 0x5573acc9f720 2024-09-18T01:25:27.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:27.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acca7790 con 0x7fe970076060 2024-09-18T01:25:27.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:27.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 20 zone default found 2024-09-18T01:25:27.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 4 Realm: () 2024-09-18T01:25:27.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:27.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:27.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:27.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 20 zonegroup default 2024-09-18T01:25:27.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.573+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acca7bb0 con 0x7fe970076060 2024-09-18T01:25:27.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.574+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.574+0000 7fe97fe2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.574+0000 7fe97fe2f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.574+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acca7bb0 con 0x5573acca8aa0 2024-09-18T01:25:27.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.574+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe974051070 con 0x5573acca8aa0 2024-09-18T01:25:27.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.574+0000 7fe97fe2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.574+0000 7fe97fe2f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.574+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573accad490 con 0x5573acca8aa0 2024-09-18T01:25:27.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.574+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe974051070 con 0x5573acca8aa0 2024-09-18T01:25:27.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.574+0000 7fe97fe2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.574+0000 7fe97fe2f800 20 started sync module instance, tier type = 2024-09-18T01:25:27.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.574+0000 7fe97fe2f800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:27.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.574+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accac930 con 0x5573acca3ea0 2024-09-18T01:25:27.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.575+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970073030 con 0x5573acca3ea0 2024-09-18T01:25:27.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.575+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93955308571936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accadce0 con 0x5573acca3ea0 2024-09-18T01:25:27.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.575+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accae530 con 0x5573acc9f720 2024-09-18T01:25:27.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.576+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93955308571936] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970073030 con 0x5573acca3ea0 2024-09-18T01:25:27.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.576+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.576+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93955308574768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accae5b0 con 0x5573acc9f720 2024-09-18T01:25:27.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.576+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accaf070 con 0x5573acca8aa0 2024-09-18T01:25:27.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.577+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe974051070 con 0x5573acca8aa0 2024-09-18T01:25:27.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.577+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93955308579648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accaf910 con 0x5573acca8aa0 2024-09-18T01:25:27.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.577+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accb03f0 con 0x5573acca3ea0 2024-09-18T01:25:27.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.577+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93955308574768] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.578+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970073030 con 0x5573acca3ea0 2024-09-18T01:25:27.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.578+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93955308576896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accb0c90 con 0x5573acca3ea0 2024-09-18T01:25:27.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.578+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accb1540 con 0x5573acc9f720 2024-09-18T01:25:27.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.578+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93955308579648] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe974051070 con 0x5573acca8aa0 2024-09-18T01:25:27.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.579+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.579+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93955308589104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accb1930 con 0x5573acc9f720 2024-09-18T01:25:27.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.579+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accb22f0 con 0x7fe970076060 2024-09-18T01:25:27.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.580+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93955308576896] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970073030 con 0x5573acca3ea0 2024-09-18T01:25:27.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.581+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93955308589104] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.581+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.581+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93955308581984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accb1e40 con 0x7fe970076060 2024-09-18T01:25:27.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.581+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accb2b90 con 0x7fe970076060 2024-09-18T01:25:27.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.582+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.582+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93955308594912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accb1e40 con 0x7fe970076060 2024-09-18T01:25:27.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.582+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accb36f0 con 0x7fe970076060 2024-09-18T01:25:27.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.582+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93955308581984] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.583+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.583+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93955308597760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accb36f0 con 0x7fe970076060 2024-09-18T01:25:27.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.583+0000 7fe97fe2f800 20 add_watcher() i=0 2024-09-18T01:25:27.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.583+0000 7fe97fe2f800 20 add_watcher() i=1 2024-09-18T01:25:27.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.583+0000 7fe97fe2f800 20 add_watcher() i=2 2024-09-18T01:25:27.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.583+0000 7fe97fe2f800 20 add_watcher() i=3 2024-09-18T01:25:27.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.583+0000 7fe97fe2f800 20 add_watcher() i=4 2024-09-18T01:25:27.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.583+0000 7fe97fe2f800 20 add_watcher() i=5 2024-09-18T01:25:27.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.583+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93955308594912] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.583+0000 7fe97fe2f800 20 add_watcher() i=6 2024-09-18T01:25:27.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.584+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93955308597760] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.584+0000 7fe97fe2f800 20 add_watcher() i=7 2024-09-18T01:25:27.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.584+0000 7fe97fe2f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:27.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.584+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573accb6720 con 0x5573acc9f720 2024-09-18T01:25:27.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.584+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.584+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93955308586976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accb3ba0 con 0x5573acc9f720 2024-09-18T01:25:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.585+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93955308586976] v33'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.585+0000 7fe82f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.585+0000 7fe97fe2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.585+0000 7fe97fe2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.585+0000 7fe97fe2f800 5 note: GC not initialized 2024-09-18T01:25:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.585+0000 7fe82e7fc640 20 reqs_thread_entry: start 2024-09-18T01:25:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.585+0000 7fe97fe2f800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.586+0000 7fe97fe2f800 20 Filter name: none 2024-09-18T01:25:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.586+0000 7fe79ffff640 20 reqs_thread_entry: start 2024-09-18T01:25:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.586+0000 7fe97fe2f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.586+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5573acce9500 con 0x5573acc9f720 2024-09-18T01:25:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.586+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.586+0000 7fe97fe2f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:27.600 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:27.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.587+0000 7fe82f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:27.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.587+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93955308586976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573acce8310 con 0x5573acc9f720 2024-09-18T01:25:27.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.588+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93955308586976] v33'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.588+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93955308571936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accb07e0 con 0x5573acca3ea0 2024-09-18T01:25:27.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.589+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93955308571936] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970073030 con 0x5573acca3ea0 2024-09-18T01:25:27.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.589+0000 7fe97fe2f800 20 remove_watcher() i=0 2024-09-18T01:25:27.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.589+0000 7fe97fe2f800 2 removed watcher, disabling cache 2024-09-18T01:25:27.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.589+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93955308574768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accacd20 con 0x5573acc9f720 2024-09-18T01:25:27.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.590+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93955308574768] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.590+0000 7fe97fe2f800 20 remove_watcher() i=1 2024-09-18T01:25:27.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.590+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93955308579648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accacd20 con 0x5573acca8aa0 2024-09-18T01:25:27.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.591+0000 7fe97d129640 1 -- 172.21.15.100:0/2146921136 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93955308579648] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe974051070 con 0x5573acca8aa0 2024-09-18T01:25:27.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.591+0000 7fe97fe2f800 20 remove_watcher() i=2 2024-09-18T01:25:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.591+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93955308576896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accad830 con 0x5573acca3ea0 2024-09-18T01:25:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.592+0000 7fe97d92a640 1 -- 172.21.15.100:0/2146921136 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93955308576896] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970073030 con 0x5573acca3ea0 2024-09-18T01:25:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.592+0000 7fe97fe2f800 20 remove_watcher() i=3 2024-09-18T01:25:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.592+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93955308589104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accad830 con 0x5573acc9f720 2024-09-18T01:25:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.593+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93955308589104] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x5573acc9f720 2024-09-18T01:25:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.593+0000 7fe97fe2f800 20 remove_watcher() i=4 2024-09-18T01:25:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.593+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93955308581984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accb1030 con 0x7fe970076060 2024-09-18T01:25:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.594+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93955308581984] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.594+0000 7fe97fe2f800 20 remove_watcher() i=5 2024-09-18T01:25:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.594+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93955308594912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accad830 con 0x7fe970076060 2024-09-18T01:25:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.595+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93955308594912] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.595+0000 7fe97fe2f800 20 remove_watcher() i=6 2024-09-18T01:25:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.595+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93955308597760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5573accaf460 con 0x7fe970076060 2024-09-18T01:25:27.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93955308597760] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x7fe970076060 2024-09-18T01:25:27.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 20 remove_watcher() i=7 2024-09-18T01:25:27.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe970076060 msgr2=0x7fe97000f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe970076060 0x7fe97000f470 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5573acc9f720 msgr2=0x5573acca1be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5573acc9f720 0x5573acca1be0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5573acca3ea0 msgr2=0x5573acca6290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5573acca3ea0 0x5573acca6290 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5573acca8aa0 msgr2=0x5573accaaf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5573acca8aa0 0x5573accaaf60 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe848036b40 msgr2=0x7fe848039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe848036b40 0x7fe848039000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5573acc727b0 tx=0x7fe97406b040 comp rx=0 tx=0).stop 2024-09-18T01:25:27.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc8cd40 msgr2=0x5573acc93fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97e12b640 1 -- 172.21.15.100:0/2146921136 reap_dead start 2024-09-18T01:25:27.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc8cd40 0x5573acc93fc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe970001540 tx=0x7fe97004a6b0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 shutdown_connections 2024-09-18T01:25:27.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2146921136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc8cd40 0x5573acc93fc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 >> 172.21.15.100:0/2146921136 conn(0x5573acc890f0 msgr2=0x5573acc871c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 shutdown_connections 2024-09-18T01:25:27.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.596+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2146921136 wait complete. 2024-09-18T01:25:27.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/3366545153 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe858036b40 msgr2=0x7fe858039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/3366545153 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe858036b40 0x7fe858039000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x5573acc66610 tx=0x7fe974005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:27.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/3366545153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc80160 msgr2=0x5573acc80580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/3366545153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc80160 0x5573acc80580 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe97004b770 tx=0x7fe97001aee0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/3366545153 shutdown_connections 2024-09-18T01:25:27.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/3366545153 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe858036b40 0x7fe858039000 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/3366545153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acc80160 0x5573acc80580 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/3366545153 >> 172.21.15.100:0/3366545153 conn(0x5573acc750f0 msgr2=0x5573acc77c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/3366545153 shutdown_connections 2024-09-18T01:25:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/3366545153 wait complete. 2024-09-18T01:25:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5573acc6f8c0 msgr2=0x5573acc71cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5573acc6f8c0 0x5573acc71cb0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5573acb6f860 msgr2=0x5573acc69120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5573acb6f860 0x5573acc69120 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5573acc6b9d0 msgr2=0x5573acc6ddc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5573acc6b9d0 0x5573acc6ddc0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe864036b90 msgr2=0x7fe864039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe864036b90 0x7fe864039050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe974057000 tx=0x7fe974052000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acadee90 msgr2=0x5573acc620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 --2- 172.21.15.100:0/2711295333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573acadee90 0x5573acc620b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x5573acc5b490 tx=0x7fe970000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97e12b640 1 -- 172.21.15.100:0/2711295333 reap_dead start 2024-09-18T01:25:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 shutdown_connections 2024-09-18T01:25:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 >> 172.21.15.100:0/2711295333 conn(0x5573acb65df0 msgr2=0x5573acc548e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 shutdown_connections 2024-09-18T01:25:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.597+0000 7fe97fe2f800 1 -- 172.21.15.100:0/2711295333 wait complete. 2024-09-18T01:25:27.611 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:27.611 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-18T01:25:27.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-18T01:25:27.611 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-18T01:25:27.695 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:27.695 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.695+0000 7f9def80e800 1 Processor -- start 2024-09-18T01:25:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.695+0000 7f9def80e800 1 -- start start 2024-09-18T01:25:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.695+0000 7f9def80e800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55596473fe90 0x5559647cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.695+0000 7f9def80e800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55596468bb30 con 0x5559647cf680 2024-09-18T01:25:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.695+0000 7f9def80e800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55596466d360 con 0x55596473fe90 2024-09-18T01:25:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.695+0000 7f9deaf75640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55596473fe90 0x5559647cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.695+0000 7f9deaf75640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55596473fe90 0x5559647cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33018/0 (socket says 172.21.15.100:33018) 2024-09-18T01:25:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.695+0000 7f9de3fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5559647cf680 0x5559647d1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59242/0 (socket says 172.21.15.100:59242) 2024-09-18T01:25:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.695+0000 7f9deaf75640 1 -- 172.21.15.100:0/1183723286 learned_addr learned my addr 172.21.15.100:0/1183723286 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.696+0000 7f9deaf75640 1 -- 172.21.15.100:0/1183723286 >> v1:172.21.15.92:6789/0 conn(0x5559647cf680 legacy=0x5559647d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.696+0000 7f9deaf75640 1 -- 172.21.15.100:0/1183723286 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555964693e00 con 0x55596473fe90 2024-09-18T01:25:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.696+0000 7f9dea774640 1 -- 172.21.15.100:0/1183723286 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 556917112 0 0) 0x55596468bb30 con 0x5559647cf680 2024-09-18T01:25:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.697+0000 7f9deaf75640 1 --2- 172.21.15.100:0/1183723286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 0x5559647cf140 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00a520 tx=0x7f9ddc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835e606fc4a34106 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.698+0000 7f9dea774640 1 -- 172.21.15.100:0/1183723286 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc055070 con 0x55596473fe90 2024-09-18T01:25:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.698+0000 7f9dea774640 1 -- 172.21.15.100:0/1183723286 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ddc0515b0 con 0x55596473fe90 2024-09-18T01:25:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.698+0000 7f9dea774640 1 -- 172.21.15.100:0/1183723286 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc0518d0 con 0x55596473fe90 2024-09-18T01:25:27.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.698+0000 7f9def80e800 1 -- 172.21.15.100:0/1183723286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 msgr2=0x5559647cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.698+0000 7f9def80e800 1 --2- 172.21.15.100:0/1183723286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 0x5559647cf140 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00a520 tx=0x7f9ddc045ba0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.698+0000 7f9def80e800 1 -- 172.21.15.100:0/1183723286 shutdown_connections 2024-09-18T01:25:27.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.698+0000 7f9def80e800 1 --2- 172.21.15.100:0/1183723286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 0x5559647cf140 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.698+0000 7f9def80e800 1 -- 172.21.15.100:0/1183723286 >> 172.21.15.100:0/1183723286 conn(0x5559647c6df0 msgr2=0x5559647c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.698+0000 7f9def80e800 1 -- 172.21.15.100:0/1183723286 shutdown_connections 2024-09-18T01:25:27.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.698+0000 7f9def80e800 1 -- 172.21.15.100:0/1183723286 wait complete. 2024-09-18T01:25:27.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.712+0000 7f9def80e800 1 Processor -- start 2024-09-18T01:25:27.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.712+0000 7f9def80e800 1 -- start start 2024-09-18T01:25:27.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.712+0000 7f9def80e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 0x5559647cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.712+0000 7f9def80e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555964718330 con 0x55596473fe90 2024-09-18T01:25:27.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.712+0000 7f9deaf75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 0x5559647cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.712+0000 7f9deaf75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 0x5559647cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33034/0 (socket says 172.21.15.100:33034) 2024-09-18T01:25:27.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.712+0000 7f9deaf75640 1 -- 172.21.15.100:0/3031715853 learned_addr learned my addr 172.21.15.100:0/3031715853 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.713+0000 7f9deaf75640 1 -- 172.21.15.100:0/3031715853 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555964665bc0 con 0x55596473fe90 2024-09-18T01:25:27.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.713+0000 7f9deaf75640 1 --2- 172.21.15.100:0/3031715853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 0x5559647cca70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc000c00 tx=0x7f9ddc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b153700cf47d722 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.713+0000 7f9cd8e09640 1 -- 172.21.15.100:0/3031715853 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc0519d0 con 0x55596473fe90 2024-09-18T01:25:27.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.713+0000 7f9cd8e09640 1 -- 172.21.15.100:0/3031715853 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ddc051b70 con 0x55596473fe90 2024-09-18T01:25:27.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.713+0000 7f9cd8e09640 1 -- 172.21.15.100:0/3031715853 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc051e50 con 0x55596473fe90 2024-09-18T01:25:27.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.714+0000 7f9def80e800 1 -- 172.21.15.100:0/3031715853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 msgr2=0x5559647cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.714+0000 7f9def80e800 1 --2- 172.21.15.100:0/3031715853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 0x5559647cca70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc000c00 tx=0x7f9ddc051000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.714+0000 7f9def80e800 1 -- 172.21.15.100:0/3031715853 shutdown_connections 2024-09-18T01:25:27.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.714+0000 7f9def80e800 1 --2- 172.21.15.100:0/3031715853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 0x5559647cca70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.714+0000 7f9def80e800 1 -- 172.21.15.100:0/3031715853 >> 172.21.15.100:0/3031715853 conn(0x5559647c6df0 msgr2=0x5559648b7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.714+0000 7f9def80e800 1 -- 172.21.15.100:0/3031715853 shutdown_connections 2024-09-18T01:25:27.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.714+0000 7f9def80e800 1 -- 172.21.15.100:0/3031715853 wait complete. 2024-09-18T01:25:27.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.714+0000 7f9def80e800 1 Processor -- start 2024-09-18T01:25:27.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.714+0000 7f9def80e800 1 -- start start 2024-09-18T01:25:27.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.714+0000 7f9def80e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 0x5559648c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.714+0000 7f9def80e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5559647d35f0 con 0x55596473fe90 2024-09-18T01:25:27.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.714+0000 7f9deaf75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 0x5559648c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.714+0000 7f9deaf75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 0x5559648c5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33044/0 (socket says 172.21.15.100:33044) 2024-09-18T01:25:27.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.714+0000 7f9deaf75640 1 -- 172.21.15.100:0/1236467743 learned_addr learned my addr 172.21.15.100:0/1236467743 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.715+0000 7f9deaf75640 1 -- 172.21.15.100:0/1236467743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555964679fe0 con 0x55596473fe90 2024-09-18T01:25:27.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.715+0000 7f9deaf75640 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 0x5559648c5120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc005570 tx=0x7f9ddc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.715+0000 7f9cd7606640 1 -- 172.21.15.100:0/1236467743 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc073070 con 0x55596473fe90 2024-09-18T01:25:27.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.715+0000 7f9cd7606640 1 -- 172.21.15.100:0/1236467743 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ddc05a580 con 0x55596473fe90 2024-09-18T01:25:27.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.715+0000 7f9cd7606640 1 -- 172.21.15.100:0/1236467743 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc05a8a0 con 0x55596473fe90 2024-09-18T01:25:27.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.715+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559648c5660 con 0x55596473fe90 2024-09-18T01:25:27.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.715+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559648c5be0 con 0x55596473fe90 2024-09-18T01:25:27.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.716+0000 7f9cd7606640 1 -- 172.21.15.100:0/1236467743 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9ddc076070 con 0x55596473fe90 2024-09-18T01:25:27.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.716+0000 7f9cd7606640 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cd0036b90 0x7f9cd0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.716+0000 7f9cd7606640 1 -- 172.21.15.100:0/1236467743 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9ddc062070 con 0x55596473fe90 2024-09-18T01:25:27.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.716+0000 7f9de3fff640 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cd0036b90 0x7f9cd0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.716+0000 7f9def80e800 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5559647cf680 0x5559648cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.716+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5559648cc7b0 con 0x5559647cf680 2024-09-18T01:25:27.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.716+0000 7f9deb776640 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5559647cf680 0x5559648cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.716+0000 7f9de3fff640 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cd0036b90 0x7f9cd0039050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4000c00 tx=0x7f9dd40013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.716+0000 7f9deb776640 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5559647cf680 0x5559648cc190 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.717+0000 7f9deb776640 1 -- 172.21.15.100:0/1236467743 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559647cf680 2024-09-18T01:25:27.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.717+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5559648c9740 con 0x5559647cf680 2024-09-18T01:25:27.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.717+0000 7f9deb776640 1 -- 172.21.15.100:0/1236467743 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559647cf680 2024-09-18T01:25:27.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.717+0000 7f9def80e800 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5559648ceaa0 0x5559648d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.717+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5559648d1530 con 0x5559648ceaa0 2024-09-18T01:25:27.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.717+0000 7f9deaf75640 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5559648ceaa0 0x5559648d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.717+0000 7f9deaf75640 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5559648ceaa0 0x5559648d0e90 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.718+0000 7f9deaf75640 1 -- 172.21.15.100:0/1236467743 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9ddc07f070 con 0x5559648ceaa0 2024-09-18T01:25:27.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.718+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5559648cd940 con 0x5559647cf680 2024-09-18T01:25:27.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.718+0000 7f9deb776640 1 -- 172.21.15.100:0/1236467743 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559647cf680 2024-09-18T01:25:27.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.718+0000 7f9def80e800 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5559648d2990 0x5559648d4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.718+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5559648d5480 con 0x5559648d2990 2024-09-18T01:25:27.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.718+0000 7f9de3fff640 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5559648d2990 0x5559648d4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.719+0000 7f9de3fff640 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5559648d2990 0x5559648d4d80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.719+0000 7f9de3fff640 1 -- 172.21.15.100:0/1236467743 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9dd400f620 con 0x5559648d2990 2024-09-18T01:25:27.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.719+0000 7f9def80e800 1 Processor -- start 2024-09-18T01:25:27.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.719+0000 7f9def80e800 1 -- start start 2024-09-18T01:25:27.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.719+0000 7f9def80e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648e3230 0x5559648e3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.719+0000 7f9def80e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555964667580 con 0x5559648e3230 2024-09-18T01:25:27.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.720+0000 7f9deaf75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648e3230 0x5559648e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.720+0000 7f9deaf75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648e3230 0x5559648e3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33056/0 (socket says 172.21.15.100:33056) 2024-09-18T01:25:27.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.720+0000 7f9deaf75640 1 -- 172.21.15.100:0/142731595 learned_addr learned my addr 172.21.15.100:0/142731595 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.720+0000 7f9deaf75640 1 -- 172.21.15.100:0/142731595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559648e3b90 con 0x5559648e3230 2024-09-18T01:25:27.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.720+0000 7f9deaf75640 1 --2- 172.21.15.100:0/142731595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648e3230 0x5559648e3650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc08f220 tx=0x7f9ddc06f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.720+0000 7f9cd4e01640 1 -- 172.21.15.100:0/142731595 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc065dc0 con 0x5559648e3230 2024-09-18T01:25:27.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.720+0000 7f9cd4e01640 1 -- 172.21.15.100:0/142731595 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ddc05aa40 con 0x5559648e3230 2024-09-18T01:25:27.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.720+0000 7f9def80e800 1 -- 172.21.15.100:0/142731595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559648e3e20 con 0x5559648e3230 2024-09-18T01:25:27.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.720+0000 7f9cd4e01640 1 -- 172.21.15.100:0/142731595 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc05ad20 con 0x5559648e3230 2024-09-18T01:25:27.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.720+0000 7f9def80e800 1 -- 172.21.15.100:0/142731595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559648e6b00 con 0x5559648e3230 2024-09-18T01:25:27.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.721+0000 7f9cd4e01640 1 -- 172.21.15.100:0/142731595 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9ddc058070 con 0x5559648e3230 2024-09-18T01:25:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.721+0000 7f9cd4e01640 1 --2- 172.21.15.100:0/142731595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cc4036b90 0x7f9cc4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.721+0000 7f9cd4e01640 1 -- 172.21.15.100:0/142731595 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9ddc099c50 con 0x5559648e3230 2024-09-18T01:25:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.721+0000 7f9de3fff640 1 --2- 172.21.15.100:0/142731595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cc4036b90 0x7f9cc4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.721+0000 7f9def80e800 1 Processor -- start 2024-09-18T01:25:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.721+0000 7f9de3fff640 1 --2- 172.21.15.100:0/142731595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cc4036b90 0x7f9cc4039050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x5559648c9680 tx=0x7f9dd4006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.721+0000 7f9def80e800 1 -- start start 2024-09-18T01:25:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.722+0000 7f9def80e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648efd30 0x5559648f0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.722+0000 7f9def80e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5559647cb050 con 0x5559648efd30 2024-09-18T01:25:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.722+0000 7f9deaf75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648efd30 0x5559648f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.722+0000 7f9deaf75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648efd30 0x5559648f0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33058/0 (socket says 172.21.15.100:33058) 2024-09-18T01:25:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.722+0000 7f9deaf75640 1 -- 172.21.15.100:0/1370116706 learned_addr learned my addr 172.21.15.100:0/1370116706 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.722+0000 7f9deaf75640 1 -- 172.21.15.100:0/1370116706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559648f0700 con 0x5559648efd30 2024-09-18T01:25:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.722+0000 7f9deaf75640 1 --2- 172.21.15.100:0/1370116706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648efd30 0x5559648f0130 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc08f510 tx=0x7f9ddc00a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9394143f6f6088d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.722+0000 7f9cce7fc640 1 -- 172.21.15.100:0/1370116706 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc0643b0 con 0x5559648efd30 2024-09-18T01:25:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.722+0000 7f9cce7fc640 1 -- 172.21.15.100:0/1370116706 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ddc063b30 con 0x5559648efd30 2024-09-18T01:25:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.722+0000 7f9cce7fc640 1 -- 172.21.15.100:0/1370116706 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc064550 con 0x5559648efd30 2024-09-18T01:25:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.723+0000 7f9def80e800 1 -- 172.21.15.100:0/1370116706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648efd30 msgr2=0x5559648f0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.723+0000 7f9def80e800 1 --2- 172.21.15.100:0/1370116706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648efd30 0x5559648f0130 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc08f510 tx=0x7f9ddc00a0d0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.723+0000 7f9def80e800 1 -- 172.21.15.100:0/1370116706 shutdown_connections 2024-09-18T01:25:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.723+0000 7f9def80e800 1 --2- 172.21.15.100:0/1370116706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648efd30 0x5559648f0130 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.723+0000 7f9def80e800 1 -- 172.21.15.100:0/1370116706 >> 172.21.15.100:0/1370116706 conn(0x5559648ec0e0 msgr2=0x5559648ea1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.723+0000 7f9def80e800 1 -- 172.21.15.100:0/1370116706 shutdown_connections 2024-09-18T01:25:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.723+0000 7f9def80e800 1 -- 172.21.15.100:0/1370116706 wait complete. 2024-09-18T01:25:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.723+0000 7f9def80e800 1 Processor -- start 2024-09-18T01:25:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.723+0000 7f9def80e800 1 -- start start 2024-09-18T01:25:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.723+0000 7f9def80e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648efd30 0x5559648f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.723+0000 7f9def80e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5559648f0b50 con 0x5559648efd30 2024-09-18T01:25:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.724+0000 7f9deaf75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648efd30 0x5559648f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.724+0000 7f9deaf75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648efd30 0x5559648f7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33074/0 (socket says 172.21.15.100:33074) 2024-09-18T01:25:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.724+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 learned_addr learned my addr 172.21.15.100:0/2276781241 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.724+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559648f7570 con 0x5559648efd30 2024-09-18T01:25:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.724+0000 7f9deaf75640 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648efd30 0x5559648f7030 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc002ce0 tx=0x7f9ddc064a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.724+0000 7f9cccff9640 1 -- 172.21.15.100:0/2276781241 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc060130 con 0x5559648efd30 2024-09-18T01:25:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.724+0000 7f9cccff9640 1 -- 172.21.15.100:0/2276781241 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ddc0602d0 con 0x5559648efd30 2024-09-18T01:25:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.724+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559648f7570 con 0x5559648efd30 2024-09-18T01:25:27.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.724+0000 7f9cccff9640 1 -- 172.21.15.100:0/2276781241 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc0605b0 con 0x5559648efd30 2024-09-18T01:25:27.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.724+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559648f7570 con 0x5559648efd30 2024-09-18T01:25:27.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.725+0000 7f9cccff9640 1 -- 172.21.15.100:0/2276781241 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9ddc04f070 con 0x5559648efd30 2024-09-18T01:25:27.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.725+0000 7f9cccff9640 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cb4036b40 0x7f9cb4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.725+0000 7f9cccff9640 1 -- 172.21.15.100:0/2276781241 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9ddc0a9030 con 0x5559648efd30 2024-09-18T01:25:27.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.725+0000 7f9de3fff640 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cb4036b40 0x7f9cb4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.726+0000 7f9de3fff640 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cb4036b40 0x7f9cb4039000 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x5559648d5880 tx=0x7f9dd4023040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.726+0000 7f9def80e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.726+0000 7f9def80e800 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5559649027c0 0x555964904c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.726+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5559649053d0 con 0x5559649027c0 2024-09-18T01:25:27.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.726+0000 7f9deb776640 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5559649027c0 0x555964904c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.726+0000 7f9deb776640 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5559649027c0 0x555964904c80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 20 realm 2024-09-18T01:25:27.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5559649057e0 con 0x5559649027c0 2024-09-18T01:25:27.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:27.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5559649060b0 con 0x5559649027c0 2024-09-18T01:25:27.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x5559649027c0 2024-09-18T01:25:27.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:27.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5559649071b0 0x5559649095a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.727+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555964909bb0 con 0x5559649071b0 2024-09-18T01:25:27.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.728+0000 7f9deaf75640 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5559649071b0 0x5559649095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.728+0000 7f9deaf75640 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5559649071b0 0x5559649095a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.728+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9ddc0c3070 con 0x5559649071b0 2024-09-18T01:25:27.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.728+0000 7f9def80e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:27.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.728+0000 7f9def80e800 20 searching for the correct realm 2024-09-18T01:25:27.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.728+0000 7f9def80e800 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55596490bb60 0x55596490e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.728+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55596490e6f0 con 0x55596490bb60 2024-09-18T01:25:27.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.728+0000 7f9de3fff640 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55596490bb60 0x55596490e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.729+0000 7f9de3fff640 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55596490bb60 0x55596490e020 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.729+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dd4037040 con 0x55596490bb60 2024-09-18T01:25:27.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.729+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55596490e6f0 con 0x5559649071b0 2024-09-18T01:25:27.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.729+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ddc0c3070 con 0x5559649071b0 2024-09-18T01:25:27.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.729+0000 7f9deaf75640 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9ddc078070 0x7f9ddc0a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.729+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55596490e6f0 con 0x7f9ddc078070 2024-09-18T01:25:27.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.729+0000 7f9deb776640 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9ddc078070 0x7f9ddc0a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.730+0000 7f9deb776640 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9ddc078070 0x7f9ddc0a2620 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.730+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.730+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x5559649027c0 2024-09-18T01:25:27.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.730+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.730+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x5559649027c0 2024-09-18T01:25:27.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.730+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.730+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x7f9ddc078070 2024-09-18T01:25:27.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.731+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.731+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x7f9ddc078070 2024-09-18T01:25:27.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.731+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.731+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x5559649071b0 2024-09-18T01:25:27.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.731+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ddc0c3070 con 0x5559649071b0 2024-09-18T01:25:27.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.731+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x55596490bb60 2024-09-18T01:25:27.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.731+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dd4037040 con 0x55596490bb60 2024-09-18T01:25:27.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.731+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x5559649027c0 2024-09-18T01:25:27.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.731+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.731+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x7f9ddc078070 2024-09-18T01:25:27.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.732+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.732+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x5559649027c0 2024-09-18T01:25:27.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.732+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.732+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x5559649071b0 2024-09-18T01:25:27.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.732+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9ddc0c3070 con 0x5559649071b0 2024-09-18T01:25:27.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.732+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x55596490bb60 2024-09-18T01:25:27.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.732+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dd4037040 con 0x55596490bb60 2024-09-18T01:25:27.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.732+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x55596490bb60 2024-09-18T01:25:27.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.733+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dd4037040 con 0x55596490bb60 2024-09-18T01:25:27.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.733+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x7f9ddc078070 2024-09-18T01:25:27.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.733+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.733+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x55596490bb60 2024-09-18T01:25:27.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.733+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dd4037040 con 0x55596490bb60 2024-09-18T01:25:27.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.733+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x55596490bb60 2024-09-18T01:25:27.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.733+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dd4037040 con 0x55596490bb60 2024-09-18T01:25:27.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.733+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x5559649027c0 2024-09-18T01:25:27.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.734+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.734+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x5559649027c0 2024-09-18T01:25:27.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.734+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.734+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x7f9ddc078070 2024-09-18T01:25:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.734+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.734+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x55596490bb60 2024-09-18T01:25:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.734+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dd4037040 con 0x55596490bb60 2024-09-18T01:25:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.734+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x5559649071b0 2024-09-18T01:25:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.735+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ddc0c3070 con 0x5559649071b0 2024-09-18T01:25:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.735+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x5559649027c0 2024-09-18T01:25:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.735+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.735+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x7f9ddc078070 2024-09-18T01:25:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.735+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.735+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x55596490bb60 2024-09-18T01:25:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.735+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dd4037040 con 0x55596490bb60 2024-09-18T01:25:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.735+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x7f9ddc078070 2024-09-18T01:25:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.736+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.736+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x5559649071b0 2024-09-18T01:25:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.736+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ddc0c3070 con 0x5559649071b0 2024-09-18T01:25:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.736+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x55596490bb60 2024-09-18T01:25:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.736+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dd4037040 con 0x55596490bb60 2024-09-18T01:25:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.736+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x7f9ddc078070 2024-09-18T01:25:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.736+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.736+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x5559649027c0 2024-09-18T01:25:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555964906450 con 0x5559649071b0 2024-09-18T01:25:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9ddc0c3070 con 0x5559649071b0 2024-09-18T01:25:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9def80e800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9def80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9def80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9def80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9def80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9def80e800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9def80e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55596490a470 con 0x5559649027c0 2024-09-18T01:25:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9def80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9def80e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55596490a860 con 0x5559649027c0 2024-09-18T01:25:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9def80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9def80e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.737+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55596490a860 con 0x7f9ddc078070 2024-09-18T01:25:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 20 zone default found 2024-09-18T01:25:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 4 Realm: () 2024-09-18T01:25:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 20 zonegroup default 2024-09-18T01:25:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55596490eb70 con 0x7f9ddc078070 2024-09-18T01:25:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555964910550 con 0x55596490bb60 2024-09-18T01:25:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9dd4037040 con 0x55596490bb60 2024-09-18T01:25:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5559649108f0 con 0x55596490bb60 2024-09-18T01:25:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9dd4037040 con 0x55596490bb60 2024-09-18T01:25:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 20 started sync module instance, tier type = 2024-09-18T01:25:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.738+0000 7f9def80e800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.739+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55596490f9f0 con 0x5559649071b0 2024-09-18T01:25:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.740+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ddc0c3070 con 0x5559649071b0 2024-09-18T01:25:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.740+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93842427674080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55596490f650 con 0x5559649071b0 2024-09-18T01:25:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.740+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5559649115f0 con 0x5559649027c0 2024-09-18T01:25:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.741+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93842427674080] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ddc0c3070 con 0x5559649071b0 2024-09-18T01:25:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.741+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.741+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93842427678320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5559649119e0 con 0x5559649027c0 2024-09-18T01:25:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.741+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555964912400 con 0x55596490bb60 2024-09-18T01:25:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.742+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dd4037040 con 0x55596490bb60 2024-09-18T01:25:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.742+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93842427682544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555964912ca0 con 0x55596490bb60 2024-09-18T01:25:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.742+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555964913780 con 0x5559649071b0 2024-09-18T01:25:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.743+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93842427678320] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.743+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93842427682544] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dd4037040 con 0x55596490bb60 2024-09-18T01:25:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.744+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ddc0c3070 con 0x5559649071b0 2024-09-18T01:25:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.744+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93842427687568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555964913b70 con 0x5559649071b0 2024-09-18T01:25:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.744+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5559649143c0 con 0x5559649027c0 2024-09-18T01:25:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.745+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.745+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93842427691248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555964914c60 con 0x5559649027c0 2024-09-18T01:25:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.745+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5559649156b0 con 0x7f9ddc078070 2024-09-18T01:25:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.745+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93842427687568] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ddc0c3070 con 0x5559649071b0 2024-09-18T01:25:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.746+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.746+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93842427695520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555964915670 con 0x7f9ddc078070 2024-09-18T01:25:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.746+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5559649160f0 con 0x7f9ddc078070 2024-09-18T01:25:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.746+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93842427691248] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.747+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.747+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93842427692976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5559649160f0 con 0x7f9ddc078070 2024-09-18T01:25:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.747+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555964916b00 con 0x7f9ddc078070 2024-09-18T01:25:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93842427695520] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93842427679440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555964916b00 con 0x7f9ddc078070 2024-09-18T01:25:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9def80e800 20 add_watcher() i=0 2024-09-18T01:25:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9def80e800 20 add_watcher() i=1 2024-09-18T01:25:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9def80e800 20 add_watcher() i=2 2024-09-18T01:25:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9def80e800 20 add_watcher() i=3 2024-09-18T01:25:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9def80e800 20 add_watcher() i=4 2024-09-18T01:25:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9def80e800 20 add_watcher() i=5 2024-09-18T01:25:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93842427692976] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9def80e800 20 add_watcher() i=6 2024-09-18T01:25:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93842427679440] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9def80e800 20 add_watcher() i=7 2024-09-18T01:25:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9def80e800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.748+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555964919b30 con 0x5559649027c0 2024-09-18T01:25:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.749+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.749+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93842427700816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555964916f20 con 0x5559649027c0 2024-09-18T01:25:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.750+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93842427700816] v33'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.750+0000 7f9ca17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.750+0000 7f9def80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.750+0000 7f9def80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.750+0000 7f9def80e800 5 note: GC not initialized 2024-09-18T01:25:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.750+0000 7f9c1bfff640 20 reqs_thread_entry: start 2024-09-18T01:25:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.750+0000 7f9def80e800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.751+0000 7f9def80e800 20 Filter name: none 2024-09-18T01:25:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.751+0000 7f9c19ffb640 20 reqs_thread_entry: start 2024-09-18T01:25:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.751+0000 7f9def80e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.751+0000 7f9def80e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.751+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55596494cdb0 con 0x5559649027c0 2024-09-18T01:25:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.751+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.751+0000 7f9def80e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.751+0000 7f9def80e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.751+0000 7f9def80e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.751+0000 7f9def80e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.751+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55596494c8d0 con 0x5559649071b0 2024-09-18T01:25:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.751+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f9ddc0c3070 con 0x5559649071b0 2024-09-18T01:25:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.751+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555964953090 con 0x5559649027c0 2024-09-18T01:25:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.752+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v33'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.753+0000 7f9def80e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.753+0000 7f9def80e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.753+0000 7f9def80e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:27.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.753+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93842427947936 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55596494fd70 con 0x5559649027c0 2024-09-18T01:25:27.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.753+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== watch-notify(notify (1) cookie 93842427691248 notify 141733920770 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f9de40437c0 con 0x5559649027c0 2024-09-18T01:25:27.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.753+0000 7f9cce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 93842427691248 notifier 4335 bl.length()=567 2024-09-18T01:25:27.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.753+0000 7f9cce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:27.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.753+0000 7f9cce7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:27.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.753+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(65 notify.4 [notify cookie 93842427947936 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.753+0000 7f9cce7fc640 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f9cb0003ea0 con 0x5559649027c0 2024-09-18T01:25:27.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.753+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.753+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== watch-notify(notify_complete (2) cookie 93842427947936 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9de4018db0 con 0x5559649027c0 2024-09-18T01:25:27.765 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:27.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.754+0000 7f9ca17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:27.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.754+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93842427700816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55596494ab00 con 0x5559649027c0 2024-09-18T01:25:27.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.755+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93842427700816] v33'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.755+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93842427674080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55596494ab00 con 0x5559649071b0 2024-09-18T01:25:27.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.756+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93842427674080] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ddc0c3070 con 0x5559649071b0 2024-09-18T01:25:27.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.756+0000 7f9def80e800 20 remove_watcher() i=0 2024-09-18T01:25:27.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.756+0000 7f9def80e800 2 removed watcher, disabling cache 2024-09-18T01:25:27.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.756+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93842427678320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55596494ab00 con 0x5559649027c0 2024-09-18T01:25:27.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.757+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93842427678320] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.757+0000 7f9def80e800 20 remove_watcher() i=1 2024-09-18T01:25:27.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.757+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93842427682544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55596494ab00 con 0x55596490bb60 2024-09-18T01:25:27.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.758+0000 7f9de3fff640 1 -- 172.21.15.100:0/2276781241 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93842427682544] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dd4037040 con 0x55596490bb60 2024-09-18T01:25:27.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.758+0000 7f9def80e800 20 remove_watcher() i=2 2024-09-18T01:25:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.758+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93842427687568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55596490fde0 con 0x5559649071b0 2024-09-18T01:25:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.759+0000 7f9deaf75640 1 -- 172.21.15.100:0/2276781241 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93842427687568] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ddc0c3070 con 0x5559649071b0 2024-09-18T01:25:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.759+0000 7f9def80e800 20 remove_watcher() i=3 2024-09-18T01:25:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.759+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93842427691248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55596490fde0 con 0x5559649027c0 2024-09-18T01:25:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.760+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93842427691248] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x5559649027c0 2024-09-18T01:25:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.760+0000 7f9def80e800 20 remove_watcher() i=4 2024-09-18T01:25:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.760+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93842427695520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55596490fde0 con 0x7f9ddc078070 2024-09-18T01:25:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.761+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93842427695520] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.761+0000 7f9def80e800 20 remove_watcher() i=5 2024-09-18T01:25:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.761+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93842427692976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5559649151a0 con 0x7f9ddc078070 2024-09-18T01:25:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.762+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93842427692976] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.762+0000 7f9def80e800 20 remove_watcher() i=6 2024-09-18T01:25:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.762+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93842427679440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55596490fde0 con 0x7f9ddc078070 2024-09-18T01:25:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93842427679440] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4a0 con 0x7f9ddc078070 2024-09-18T01:25:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9def80e800 20 remove_watcher() i=7 2024-09-18T01:25:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9ddc078070 msgr2=0x7f9ddc0a2620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9def80e800 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9ddc078070 0x7f9ddc0a2620 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5559649027c0 msgr2=0x555964904c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9def80e800 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5559649027c0 0x555964904c80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5559649071b0 msgr2=0x5559649095a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9def80e800 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5559649071b0 0x5559649095a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55596490bb60 msgr2=0x55596490e020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9def80e800 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55596490bb60 0x55596490e020 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cb4036b40 msgr2=0x7f9cb4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9def80e800 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cb4036b40 0x7f9cb4039000 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x5559648d5880 tx=0x7f9dd4023040 comp rx=0 tx=0).stop 2024-09-18T01:25:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9deb776640 1 -- 172.21.15.100:0/2276781241 reap_dead start 2024-09-18T01:25:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648efd30 msgr2=0x5559648f7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.763+0000 7f9def80e800 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648efd30 0x5559648f7030 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc002ce0 tx=0x7f9ddc064a30 comp rx=0 tx=0).stop 2024-09-18T01:25:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 shutdown_connections 2024-09-18T01:25:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 --2- 172.21.15.100:0/2276781241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648efd30 0x5559648f7030 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 >> 172.21.15.100:0/2276781241 conn(0x5559648ec0e0 msgr2=0x5559648ea1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 shutdown_connections 2024-09-18T01:25:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/2276781241 wait complete. 2024-09-18T01:25:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/142731595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cc4036b90 msgr2=0x7f9cc4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 --2- 172.21.15.100:0/142731595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cc4036b90 0x7f9cc4039050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x5559648c9680 tx=0x7f9dd4006000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/142731595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648e3230 msgr2=0x5559648e3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 --2- 172.21.15.100:0/142731595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648e3230 0x5559648e3650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc08f220 tx=0x7f9ddc06f7a0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/142731595 shutdown_connections 2024-09-18T01:25:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 --2- 172.21.15.100:0/142731595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cc4036b90 0x7f9cc4039050 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 --2- 172.21.15.100:0/142731595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559648e3230 0x5559648e3650 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/142731595 >> 172.21.15.100:0/142731595 conn(0x5559648d81c0 msgr2=0x5559648dad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/142731595 shutdown_connections 2024-09-18T01:25:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/142731595 wait complete. 2024-09-18T01:25:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5559648d2990 msgr2=0x5559648d4d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5559648d2990 0x5559648d4d80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5559647cf680 msgr2=0x5559648cc190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5559647cf680 0x5559648cc190 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5559648ceaa0 msgr2=0x5559648d0e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5559648ceaa0 0x5559648d0e90 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cd0036b90 msgr2=0x7f9cd0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9cd0036b90 0x7f9cd0039050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4000c00 tx=0x7f9dd40013b0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 msgr2=0x5559648c5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9def80e800 1 --2- 172.21.15.100:0/1236467743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55596473fe90 0x5559648c5120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc005570 tx=0x7f9ddc002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.764+0000 7f9deb776640 1 -- 172.21.15.100:0/1236467743 reap_dead start 2024-09-18T01:25:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.765+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 shutdown_connections 2024-09-18T01:25:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.765+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 >> 172.21.15.100:0/1236467743 conn(0x5559647c6df0 msgr2=0x5559647cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.765+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 shutdown_connections 2024-09-18T01:25:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.765+0000 7f9def80e800 1 -- 172.21.15.100:0/1236467743 wait complete. 2024-09-18T01:25:27.777 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:27.777 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:25:27.777 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:25:27.778 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:25:27.821 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:27.822 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:27.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.821+0000 7fdb16c30800 1 Processor -- start 2024-09-18T01:25:27.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.821+0000 7fdb16c30800 1 -- start start 2024-09-18T01:25:27.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.821+0000 7fdb16c30800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x564e9063dd90 0x564e906cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.821+0000 7fdb16c30800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564e90589b30 con 0x564e906cd780 2024-09-18T01:25:27.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.821+0000 7fdb16c30800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x564e9056b360 con 0x564e9063dd90 2024-09-18T01:25:27.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.822+0000 7fdb11f67640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x564e9063dd90 0x564e906cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.822+0000 7fdb11f67640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x564e9063dd90 0x564e906cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33088/0 (socket says 172.21.15.100:33088) 2024-09-18T01:25:27.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.822+0000 7fdb11f67640 1 -- 172.21.15.100:0/1754880987 learned_addr learned my addr 172.21.15.100:0/1754880987 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.822+0000 7fdb09766640 1 --1- 172.21.15.100:0/1754880987 >> v1:172.21.15.92:6789/0 conn(0x564e906cd780 0x564e906cfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59252/0 (socket says 172.21.15.100:59252) 2024-09-18T01:25:27.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.822+0000 7fdb11f67640 1 -- 172.21.15.100:0/1754880987 >> v1:172.21.15.92:6789/0 conn(0x564e906cd780 legacy=0x564e906cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.822+0000 7fdb11766640 1 -- 172.21.15.100:0/1754880987 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414603077 0 0) 0x564e90589b30 con 0x564e906cd780 2024-09-18T01:25:27.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.822+0000 7fdb11f67640 1 -- 172.21.15.100:0/1754880987 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e90591e00 con 0x564e9063dd90 2024-09-18T01:25:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.824+0000 7fdb11f67640 1 --2- 172.21.15.100:0/1754880987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 0x564e906cd240 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400a520 tx=0x7fdb04045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6f93769cb89d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.824+0000 7fdb11766640 1 -- 172.21.15.100:0/1754880987 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04055070 con 0x564e9063dd90 2024-09-18T01:25:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.824+0000 7fdb11766640 1 -- 172.21.15.100:0/1754880987 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb040515b0 con 0x564e9063dd90 2024-09-18T01:25:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.824+0000 7fdb11766640 1 -- 172.21.15.100:0/1754880987 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb040518d0 con 0x564e9063dd90 2024-09-18T01:25:27.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.825+0000 7fdb16c30800 1 -- 172.21.15.100:0/1754880987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 msgr2=0x564e906cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.825+0000 7fdb16c30800 1 --2- 172.21.15.100:0/1754880987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 0x564e906cd240 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400a520 tx=0x7fdb04045ba0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.825+0000 7fdb16c30800 1 -- 172.21.15.100:0/1754880987 shutdown_connections 2024-09-18T01:25:27.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.825+0000 7fdb16c30800 1 --2- 172.21.15.100:0/1754880987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 0x564e906cd240 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.825+0000 7fdb16c30800 1 -- 172.21.15.100:0/1754880987 >> 172.21.15.100:0/1754880987 conn(0x564e906c4df0 msgr2=0x564e906c7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.825+0000 7fdb16c30800 1 -- 172.21.15.100:0/1754880987 shutdown_connections 2024-09-18T01:25:27.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.825+0000 7fdb16c30800 1 -- 172.21.15.100:0/1754880987 wait complete. 2024-09-18T01:25:27.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.838+0000 7fdb16c30800 1 Processor -- start 2024-09-18T01:25:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.838+0000 7fdb16c30800 1 -- start start 2024-09-18T01:25:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.839+0000 7fdb16c30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 0x564e907b9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.839+0000 7fdb16c30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e90616330 con 0x564e9063dd90 2024-09-18T01:25:27.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.839+0000 7fdb11f67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 0x564e907b9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.839+0000 7fdb11f67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 0x564e907b9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33092/0 (socket says 172.21.15.100:33092) 2024-09-18T01:25:27.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.839+0000 7fdb11f67640 1 -- 172.21.15.100:0/85941640 learned_addr learned my addr 172.21.15.100:0/85941640 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.839+0000 7fdb11f67640 1 -- 172.21.15.100:0/85941640 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e90563bc0 con 0x564e9063dd90 2024-09-18T01:25:27.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.839+0000 7fdb11f67640 1 --2- 172.21.15.100:0/85941640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 0x564e907b9620 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdb04025da0 tx=0x7fdb04051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536a62678d1cc494 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.840+0000 7fd9ffe07640 1 -- 172.21.15.100:0/85941640 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04051ac0 con 0x564e9063dd90 2024-09-18T01:25:27.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.840+0000 7fd9ffe07640 1 -- 172.21.15.100:0/85941640 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb04051c60 con 0x564e9063dd90 2024-09-18T01:25:27.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.840+0000 7fd9ffe07640 1 -- 172.21.15.100:0/85941640 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04066460 con 0x564e9063dd90 2024-09-18T01:25:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.840+0000 7fdb16c30800 1 -- 172.21.15.100:0/85941640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 msgr2=0x564e907b9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.840+0000 7fdb16c30800 1 --2- 172.21.15.100:0/85941640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 0x564e907b9620 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdb04025da0 tx=0x7fdb04051000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.840+0000 7fdb16c30800 1 -- 172.21.15.100:0/85941640 shutdown_connections 2024-09-18T01:25:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.840+0000 7fdb16c30800 1 --2- 172.21.15.100:0/85941640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 0x564e907b9620 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.840+0000 7fdb16c30800 1 -- 172.21.15.100:0/85941640 >> 172.21.15.100:0/85941640 conn(0x564e906c4df0 msgr2=0x564e907b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.840+0000 7fdb16c30800 1 -- 172.21.15.100:0/85941640 shutdown_connections 2024-09-18T01:25:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.840+0000 7fdb16c30800 1 -- 172.21.15.100:0/85941640 wait complete. 2024-09-18T01:25:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.841+0000 7fdb16c30800 1 Processor -- start 2024-09-18T01:25:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.841+0000 7fdb16c30800 1 -- start start 2024-09-18T01:25:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.841+0000 7fdb16c30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 0x564e906cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.841+0000 7fdb16c30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e906d1620 con 0x564e9063dd90 2024-09-18T01:25:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.841+0000 7fdb11f67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 0x564e906cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.841+0000 7fdb11f67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 0x564e906cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33098/0 (socket says 172.21.15.100:33098) 2024-09-18T01:25:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.841+0000 7fdb11f67640 1 -- 172.21.15.100:0/3922516836 learned_addr learned my addr 172.21.15.100:0/3922516836 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.841+0000 7fdb11f67640 1 -- 172.21.15.100:0/3922516836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e90577fe0 con 0x564e9063dd90 2024-09-18T01:25:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.842+0000 7fdb11f67640 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 0x564e906cab70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdb040460a0 tx=0x7fdb04003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.842+0000 7fd9fe604640 1 -- 172.21.15.100:0/3922516836 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04066650 con 0x564e9063dd90 2024-09-18T01:25:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.842+0000 7fd9fe604640 1 -- 172.21.15.100:0/3922516836 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb04066810 con 0x564e9063dd90 2024-09-18T01:25:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.842+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e906c9260 con 0x564e9063dd90 2024-09-18T01:25:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.842+0000 7fd9fe604640 1 -- 172.21.15.100:0/3922516836 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04066b30 con 0x564e9063dd90 2024-09-18T01:25:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.842+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e906c9780 con 0x564e9063dd90 2024-09-18T01:25:27.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.842+0000 7fd9fe604640 1 -- 172.21.15.100:0/3922516836 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb04079060 con 0x564e9063dd90 2024-09-18T01:25:27.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.843+0000 7fd9fe604640 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9f8036b90 0x7fd9f8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.843+0000 7fd9fe604640 1 -- 172.21.15.100:0/3922516836 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fdb04062070 con 0x564e9063dd90 2024-09-18T01:25:27.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.843+0000 7fdb09766640 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9f8036b90 0x7fd9f8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.843+0000 7fdb16c30800 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e906cd780 0x564e907ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.843+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e907ca8d0 con 0x564e906cd780 2024-09-18T01:25:27.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.843+0000 7fdb12768640 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e906cd780 0x564e907ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.843+0000 7fdb09766640 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9f8036b90 0x7fd9f8039050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdafc000c00 tx=0x7fdafc0013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.843+0000 7fdb12768640 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e906cd780 0x564e907ca390 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.843+0000 7fdb12768640 1 -- 172.21.15.100:0/3922516836 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e906cd780 2024-09-18T01:25:27.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.844+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e907cb120 con 0x564e906cd780 2024-09-18T01:25:27.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.844+0000 7fdb12768640 1 -- 172.21.15.100:0/3922516836 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e906cd780 2024-09-18T01:25:27.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.844+0000 7fdb16c30800 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e907ccb50 0x564e907cef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.844+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e907cf6d0 con 0x564e907ccb50 2024-09-18T01:25:27.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.844+0000 7fdb11f67640 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e907ccb50 0x564e907cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.844+0000 7fdb11f67640 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e907ccb50 0x564e907cef40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.844+0000 7fdb11f67640 1 -- 172.21.15.100:0/3922516836 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb04057030 con 0x564e907ccb50 2024-09-18T01:25:27.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.845+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e907cb970 con 0x564e906cd780 2024-09-18T01:25:27.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.845+0000 7fdb12768640 1 -- 172.21.15.100:0/3922516836 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e906cd780 2024-09-18T01:25:27.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.845+0000 7fdb16c30800 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564e907d0b30 0x564e907d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.845+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e907d3610 con 0x564e907d0b30 2024-09-18T01:25:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.845+0000 7fdb09766640 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564e907d0b30 0x564e907d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.845+0000 7fdb09766640 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564e907d0b30 0x564e907d2f20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.846+0000 7fdb09766640 1 -- 172.21.15.100:0/3922516836 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdafc00f670 con 0x564e907d0b30 2024-09-18T01:25:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.846+0000 7fdb16c30800 1 Processor -- start 2024-09-18T01:25:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.846+0000 7fdb16c30800 1 -- start start 2024-09-18T01:25:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.846+0000 7fdb16c30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907e13c0 0x564e907e17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.846+0000 7fdb16c30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e906cb0b0 con 0x564e907e13c0 2024-09-18T01:25:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.846+0000 7fdb11f67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907e13c0 0x564e907e17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.846+0000 7fdb11f67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907e13c0 0x564e907e17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33108/0 (socket says 172.21.15.100:33108) 2024-09-18T01:25:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.846+0000 7fdb11f67640 1 -- 172.21.15.100:0/3064318033 learned_addr learned my addr 172.21.15.100:0/3064318033 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.847+0000 7fdb11f67640 1 -- 172.21.15.100:0/3064318033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e907e1d20 con 0x564e907e13c0 2024-09-18T01:25:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.847+0000 7fdb11f67640 1 --2- 172.21.15.100:0/3064318033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907e13c0 0x564e907e17e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdb04065950 tx=0x7fdb040648f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.847+0000 7fd9f77fe640 1 -- 172.21.15.100:0/3064318033 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb0408b020 con 0x564e907e13c0 2024-09-18T01:25:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.847+0000 7fd9f77fe640 1 -- 172.21.15.100:0/3064318033 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0405ba40 con 0x564e907e13c0 2024-09-18T01:25:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.847+0000 7fd9f77fe640 1 -- 172.21.15.100:0/3064318033 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb0405bd40 con 0x564e907e13c0 2024-09-18T01:25:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.847+0000 7fdb16c30800 1 -- 172.21.15.100:0/3064318033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e907e1f50 con 0x564e907e13c0 2024-09-18T01:25:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.847+0000 7fdb16c30800 1 -- 172.21.15.100:0/3064318033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e907e1f50 con 0x564e907e13c0 2024-09-18T01:25:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.848+0000 7fd9f77fe640 1 -- 172.21.15.100:0/3064318033 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb04058070 con 0x564e907e13c0 2024-09-18T01:25:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.848+0000 7fd9f77fe640 1 --2- 172.21.15.100:0/3064318033 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9ec036b90 0x7fd9ec039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.848+0000 7fd9f77fe640 1 -- 172.21.15.100:0/3064318033 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fdb04092c60 con 0x564e907e13c0 2024-09-18T01:25:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.848+0000 7fdb09766640 1 --2- 172.21.15.100:0/3064318033 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9ec036b90 0x7fd9ec039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.848+0000 7fdb16c30800 1 Processor -- start 2024-09-18T01:25:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.848+0000 7fdb09766640 1 --2- 172.21.15.100:0/3064318033 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9ec036b90 0x7fd9ec039050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x564e906c9bd0 tx=0x7fdafc006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.848+0000 7fdb16c30800 1 -- start start 2024-09-18T01:25:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.848+0000 7fdb16c30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907eda60 0x564e907ede60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.848+0000 7fdb16c30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e90565580 con 0x564e907eda60 2024-09-18T01:25:27.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.849+0000 7fdb11f67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907eda60 0x564e907ede60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.849+0000 7fdb11f67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907eda60 0x564e907ede60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33124/0 (socket says 172.21.15.100:33124) 2024-09-18T01:25:27.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.849+0000 7fdb11f67640 1 -- 172.21.15.100:0/2360908159 learned_addr learned my addr 172.21.15.100:0/2360908159 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.849+0000 7fdb11f67640 1 -- 172.21.15.100:0/2360908159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e907ee430 con 0x564e907eda60 2024-09-18T01:25:27.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.849+0000 7fdb11f67640 1 --2- 172.21.15.100:0/2360908159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907eda60 0x564e907ede60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdb0404efb0 tx=0x7fdb04061fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537f65c1d3e70c53 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.849+0000 7fd9f57fa640 1 -- 172.21.15.100:0/2360908159 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb0409f070 con 0x564e907eda60 2024-09-18T01:25:27.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.849+0000 7fd9f57fa640 1 -- 172.21.15.100:0/2360908159 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0404ecd0 con 0x564e907eda60 2024-09-18T01:25:27.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.849+0000 7fd9f57fa640 1 -- 172.21.15.100:0/2360908159 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04096070 con 0x564e907eda60 2024-09-18T01:25:27.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.849+0000 7fdb16c30800 1 -- 172.21.15.100:0/2360908159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907eda60 msgr2=0x564e907ede60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.849+0000 7fdb16c30800 1 --2- 172.21.15.100:0/2360908159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907eda60 0x564e907ede60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdb0404efb0 tx=0x7fdb04061fc0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.849+0000 7fdb16c30800 1 -- 172.21.15.100:0/2360908159 shutdown_connections 2024-09-18T01:25:27.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.849+0000 7fdb16c30800 1 --2- 172.21.15.100:0/2360908159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907eda60 0x564e907ede60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.849+0000 7fdb16c30800 1 -- 172.21.15.100:0/2360908159 >> 172.21.15.100:0/2360908159 conn(0x564e907e9e00 msgr2=0x564e907e7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.850+0000 7fdb16c30800 1 -- 172.21.15.100:0/2360908159 shutdown_connections 2024-09-18T01:25:27.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.850+0000 7fdb16c30800 1 -- 172.21.15.100:0/2360908159 wait complete. 2024-09-18T01:25:27.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.850+0000 7fdb16c30800 1 Processor -- start 2024-09-18T01:25:27.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.850+0000 7fdb16c30800 1 -- start start 2024-09-18T01:25:27.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.850+0000 7fdb16c30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907eda60 0x564e907f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.850+0000 7fdb16c30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e907ee810 con 0x564e907eda60 2024-09-18T01:25:27.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.850+0000 7fdb11f67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907eda60 0x564e907f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.850+0000 7fdb11f67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907eda60 0x564e907f4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33138/0 (socket says 172.21.15.100:33138) 2024-09-18T01:25:27.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.850+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 learned_addr learned my addr 172.21.15.100:0/1809081450 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.850+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e907f5090 con 0x564e907eda60 2024-09-18T01:25:27.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.851+0000 7fdb11f67640 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907eda60 0x564e907f4b50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdb04006530 tx=0x7fdb0405ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.851+0000 7fd9e37fe640 1 -- 172.21.15.100:0/1809081450 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb0405b5a0 con 0x564e907eda60 2024-09-18T01:25:27.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.851+0000 7fd9e37fe640 1 -- 172.21.15.100:0/1809081450 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0405b740 con 0x564e907eda60 2024-09-18T01:25:27.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.851+0000 7fd9e37fe640 1 -- 172.21.15.100:0/1809081450 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb040879c0 con 0x564e907eda60 2024-09-18T01:25:27.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.851+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e907f5090 con 0x564e907eda60 2024-09-18T01:25:27.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.851+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e907f5090 con 0x564e907eda60 2024-09-18T01:25:27.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.852+0000 7fd9e37fe640 1 -- 172.21.15.100:0/1809081450 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb0404f070 con 0x564e907eda60 2024-09-18T01:25:27.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.852+0000 7fdb16c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.852+0000 7fd9e37fe640 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9dc036b40 0x7fd9dc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.852+0000 7fd9e37fe640 1 -- 172.21.15.100:0/1809081450 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fdb040ae070 con 0x564e907eda60 2024-09-18T01:25:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.852+0000 7fdb09766640 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9dc036b40 0x7fd9dc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.852+0000 7fdb16c30800 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e908002c0 0x564e90802760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.852+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e90802eb0 con 0x564e908002c0 2024-09-18T01:25:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.852+0000 7fdb12768640 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e908002c0 0x564e90802760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb09766640 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9dc036b40 0x7fd9dc039000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00ffd0 tx=0x7fdafc023040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb12768640 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e908002c0 0x564e90802760 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb16c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb16c30800 20 realm 2024-09-18T01:25:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb16c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e908032c0 con 0x564e908002c0 2024-09-18T01:25:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb16c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb16c30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb16c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e90803b60 con 0x564e908002c0 2024-09-18T01:25:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb16c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb16c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.853+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e908002c0 2024-09-18T01:25:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.854+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.854+0000 7fdb16c30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.854+0000 7fdb16c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.854+0000 7fdb16c30800 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e90804c60 0x564e90807050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.854+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e90807590 con 0x564e90804c60 2024-09-18T01:25:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.854+0000 7fdb11f67640 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e90804c60 0x564e90807050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.854+0000 7fdb11f67640 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e90804c60 0x564e90807050 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.854+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb040b7020 con 0x564e90804c60 2024-09-18T01:25:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.854+0000 7fdb16c30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.854+0000 7fdb16c30800 20 searching for the correct realm 2024-09-18T01:25:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.854+0000 7fdb16c30800 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564e90809610 0x564e9080bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.854+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e9080c1a0 con 0x564e90809610 2024-09-18T01:25:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.854+0000 7fdb09766640 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564e90809610 0x564e9080bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.855+0000 7fdb09766640 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564e90809610 0x564e9080bad0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.855+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc037040 con 0x564e90809610 2024-09-18T01:25:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.855+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e9080c1a0 con 0x564e90804c60 2024-09-18T01:25:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.855+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb040b7020 con 0x564e90804c60 2024-09-18T01:25:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.855+0000 7fdb11f67640 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fdb040b1030 0x7fdb040c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.855+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e9080c1a0 con 0x7fdb040b1030 2024-09-18T01:25:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.855+0000 7fdb12768640 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fdb040b1030 0x7fdb040c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.856+0000 7fdb12768640 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fdb040b1030 0x7fdb040c36e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.856+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.856+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e908002c0 2024-09-18T01:25:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.856+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.857+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e908002c0 2024-09-18T01:25:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.857+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.857+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x7fdb040b1030 2024-09-18T01:25:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.857+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.857+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x7fdb040b1030 2024-09-18T01:25:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.857+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.857+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e90804c60 2024-09-18T01:25:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.858+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb040b7020 con 0x564e90804c60 2024-09-18T01:25:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.858+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e90809610 2024-09-18T01:25:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.858+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc037040 con 0x564e90809610 2024-09-18T01:25:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.858+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e908002c0 2024-09-18T01:25:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.858+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.858+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x7fdb040b1030 2024-09-18T01:25:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.858+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.858+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e908002c0 2024-09-18T01:25:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.859+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.859+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e90804c60 2024-09-18T01:25:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.859+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb040b7020 con 0x564e90804c60 2024-09-18T01:25:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.859+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e90809610 2024-09-18T01:25:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.859+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc037040 con 0x564e90809610 2024-09-18T01:25:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.859+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e90809610 2024-09-18T01:25:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.859+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc037040 con 0x564e90809610 2024-09-18T01:25:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.859+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x7fdb040b1030 2024-09-18T01:25:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.860+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.860+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e90809610 2024-09-18T01:25:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.860+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc037040 con 0x564e90809610 2024-09-18T01:25:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.860+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e90809610 2024-09-18T01:25:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.860+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc037040 con 0x564e90809610 2024-09-18T01:25:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.860+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e908002c0 2024-09-18T01:25:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.860+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.860+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e908002c0 2024-09-18T01:25:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.861+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.861+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x7fdb040b1030 2024-09-18T01:25:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.861+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.861+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e90809610 2024-09-18T01:25:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.861+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc037040 con 0x564e90809610 2024-09-18T01:25:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.861+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e90804c60 2024-09-18T01:25:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.861+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb040b7020 con 0x564e90804c60 2024-09-18T01:25:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.861+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e908002c0 2024-09-18T01:25:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.862+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.862+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x7fdb040b1030 2024-09-18T01:25:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.862+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.862+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e90809610 2024-09-18T01:25:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.862+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc037040 con 0x564e90809610 2024-09-18T01:25:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.862+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x7fdb040b1030 2024-09-18T01:25:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.862+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.862+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e90804c60 2024-09-18T01:25:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.863+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb040b7020 con 0x564e90804c60 2024-09-18T01:25:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.863+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e90809610 2024-09-18T01:25:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.863+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc037040 con 0x564e90809610 2024-09-18T01:25:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.863+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x7fdb040b1030 2024-09-18T01:25:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.863+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.863+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e908002c0 2024-09-18T01:25:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.863+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.863+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e90803f00 con 0x564e90804c60 2024-09-18T01:25:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdb040b7020 con 0x564e90804c60 2024-09-18T01:25:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e90807f10 con 0x564e908002c0 2024-09-18T01:25:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e90808300 con 0x564e908002c0 2024-09-18T01:25:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e90808300 con 0x7fdb040b1030 2024-09-18T01:25:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.864+0000 7fdb16c30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 20 zone default found 2024-09-18T01:25:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 4 Realm: () 2024-09-18T01:25:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 20 zonegroup default 2024-09-18T01:25:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e90808720 con 0x7fdb040b1030 2024-09-18T01:25:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e90808720 con 0x564e90809610 2024-09-18T01:25:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdafc037040 con 0x564e90809610 2024-09-18T01:25:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e9080e000 con 0x564e90809610 2024-09-18T01:25:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdafc037040 con 0x564e90809610 2024-09-18T01:25:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 20 started sync module instance, tier type = 2024-09-18T01:25:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.865+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e9080d4a0 con 0x564e90804c60 2024-09-18T01:25:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.866+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb040b7020 con 0x564e90804c60 2024-09-18T01:25:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.866+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94895431800976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e9080d100 con 0x564e90804c60 2024-09-18T01:25:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.866+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e9080eee0 con 0x564e908002c0 2024-09-18T01:25:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.867+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94895431800976] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb040b7020 con 0x564e90804c60 2024-09-18T01:25:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.868+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.868+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94895431805488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e9080f300 con 0x564e908002c0 2024-09-18T01:25:27.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.868+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e9080fcc0 con 0x564e90809610 2024-09-18T01:25:27.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.869+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94895431805488] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.869+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc037040 con 0x564e90809610 2024-09-18T01:25:27.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.869+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94895431806544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e9080f270 con 0x564e90809610 2024-09-18T01:25:27.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.869+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90810b80 con 0x564e90804c60 2024-09-18T01:25:27.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.870+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb040b7020 con 0x564e90804c60 2024-09-18T01:25:27.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.870+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94895431815024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90811840 con 0x564e90804c60 2024-09-18T01:25:27.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.870+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94895431806544] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc037040 con 0x564e90809610 2024-09-18T01:25:27.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.870+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90812240 con 0x564e908002c0 2024-09-18T01:25:27.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.871+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.871+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94895431811248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90812630 con 0x564e908002c0 2024-09-18T01:25:27.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.871+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90812ff0 con 0x7fdb040b1030 2024-09-18T01:25:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.871+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94895431815024] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb040b7020 con 0x564e90804c60 2024-09-18T01:25:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.872+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94895431811248] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.873+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.873+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94895431818576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90812b40 con 0x7fdb040b1030 2024-09-18T01:25:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.873+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90813500 con 0x7fdb040b1030 2024-09-18T01:25:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.874+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94895431818576] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.875+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.875+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94895431816080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90813500 con 0x7fdb040b1030 2024-09-18T01:25:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.875+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90813ec0 con 0x7fdb040b1030 2024-09-18T01:25:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.876+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.876+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94895431825936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e908142e0 con 0x7fdb040b1030 2024-09-18T01:25:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.876+0000 7fdb16c30800 20 add_watcher() i=0 2024-09-18T01:25:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.876+0000 7fdb16c30800 20 add_watcher() i=1 2024-09-18T01:25:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.876+0000 7fdb16c30800 20 add_watcher() i=2 2024-09-18T01:25:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.876+0000 7fdb16c30800 20 add_watcher() i=3 2024-09-18T01:25:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.876+0000 7fdb16c30800 20 add_watcher() i=4 2024-09-18T01:25:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.876+0000 7fdb16c30800 20 add_watcher() i=5 2024-09-18T01:25:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.876+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94895431816080] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.876+0000 7fdb16c30800 20 add_watcher() i=6 2024-09-18T01:25:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.876+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94895431825936] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.876+0000 7fdb16c30800 20 add_watcher() i=7 2024-09-18T01:25:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.876+0000 7fdb16c30800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.877+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e90813050 con 0x564e908002c0 2024-09-18T01:25:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.877+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.877+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94895431826992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90813050 con 0x564e908002c0 2024-09-18T01:25:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.878+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94895431826992] v33'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.878+0000 7fd9c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:27.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.878+0000 7fdb16c30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:27.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.878+0000 7fdb16c30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:27.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.878+0000 7fdb16c30800 5 note: GC not initialized 2024-09-18T01:25:27.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.878+0000 7fd9c27fc640 20 reqs_thread_entry: start 2024-09-18T01:25:27.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.878+0000 7fdb16c30800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:27.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.878+0000 7fdb16c30800 20 Filter name: none 2024-09-18T01:25:27.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.879+0000 7fd933fff640 20 reqs_thread_entry: start 2024-09-18T01:25:27.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.879+0000 7fdb16c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:27.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.879+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e9084a230 con 0x564e908002c0 2024-09-18T01:25:27.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.879+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.879+0000 7fdb16c30800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:27.890 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.880+0000 7fd9c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.880+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94895431826992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90849020 con 0x564e908002c0 2024-09-18T01:25:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.881+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94895431826992] v33'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.881+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94895431800976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90813e30 con 0x564e90804c60 2024-09-18T01:25:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.882+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94895431800976] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb040b7020 con 0x564e90804c60 2024-09-18T01:25:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.882+0000 7fdb16c30800 20 remove_watcher() i=0 2024-09-18T01:25:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.882+0000 7fdb16c30800 2 removed watcher, disabling cache 2024-09-18T01:25:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.882+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94895431805488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90813e30 con 0x564e908002c0 2024-09-18T01:25:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.883+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94895431805488] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.883+0000 7fdb16c30800 20 remove_watcher() i=1 2024-09-18T01:25:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.883+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94895431806544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e9080ea30 con 0x564e90809610 2024-09-18T01:25:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.884+0000 7fdb09766640 1 -- 172.21.15.100:0/1809081450 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94895431806544] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc037040 con 0x564e90809610 2024-09-18T01:25:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.884+0000 7fdb16c30800 20 remove_watcher() i=2 2024-09-18T01:25:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.884+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94895431815024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90813e30 con 0x564e90804c60 2024-09-18T01:25:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.885+0000 7fdb11f67640 1 -- 172.21.15.100:0/1809081450 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94895431815024] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb040b7020 con 0x564e90804c60 2024-09-18T01:25:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.885+0000 7fdb16c30800 20 remove_watcher() i=3 2024-09-18T01:25:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.885+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94895431811248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90813e30 con 0x564e908002c0 2024-09-18T01:25:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.886+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94895431811248] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x564e908002c0 2024-09-18T01:25:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.886+0000 7fdb16c30800 20 remove_watcher() i=4 2024-09-18T01:25:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.886+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94895431818576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90813e30 con 0x7fdb040b1030 2024-09-18T01:25:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.887+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94895431818576] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.887+0000 7fdb16c30800 20 remove_watcher() i=5 2024-09-18T01:25:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.887+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94895431816080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e90811d50 con 0x7fdb040b1030 2024-09-18T01:25:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.888+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94895431816080] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.888+0000 7fdb16c30800 20 remove_watcher() i=6 2024-09-18T01:25:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.888+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94895431825936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e908113d0 con 0x7fdb040b1030 2024-09-18T01:25:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94895431825936] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4a0 con 0x7fdb040b1030 2024-09-18T01:25:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 20 remove_watcher() i=7 2024-09-18T01:25:27.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fdb040b1030 msgr2=0x7fdb040c36e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fdb040b1030 0x7fdb040c36e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e908002c0 msgr2=0x564e90802760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e908002c0 0x564e90802760 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e90804c60 msgr2=0x564e90807050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e90804c60 0x564e90807050 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564e90809610 msgr2=0x564e9080bad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564e90809610 0x564e9080bad0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9dc036b40 msgr2=0x7fd9dc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9dc036b40 0x7fd9dc039000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00ffd0 tx=0x7fdafc023040 comp rx=0 tx=0).stop 2024-09-18T01:25:27.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb12768640 1 -- 172.21.15.100:0/1809081450 reap_dead start 2024-09-18T01:25:27.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907eda60 msgr2=0x564e907f4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907eda60 0x564e907f4b50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdb04006530 tx=0x7fdb0405ce40 comp rx=0 tx=0).stop 2024-09-18T01:25:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 shutdown_connections 2024-09-18T01:25:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 --2- 172.21.15.100:0/1809081450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907eda60 0x564e907f4b50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.889+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 >> 172.21.15.100:0/1809081450 conn(0x564e907e9e00 msgr2=0x564e907e7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 shutdown_connections 2024-09-18T01:25:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/1809081450 wait complete. 2024-09-18T01:25:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3064318033 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9ec036b90 msgr2=0x7fd9ec039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 --2- 172.21.15.100:0/3064318033 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9ec036b90 0x7fd9ec039050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x564e906c9bd0 tx=0x7fdafc006000 comp rx=0 tx=0).stop 2024-09-18T01:25:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3064318033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907e13c0 msgr2=0x564e907e17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 --2- 172.21.15.100:0/3064318033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907e13c0 0x564e907e17e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdb04065950 tx=0x7fdb040648f0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3064318033 shutdown_connections 2024-09-18T01:25:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 --2- 172.21.15.100:0/3064318033 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9ec036b90 0x7fd9ec039050 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 --2- 172.21.15.100:0/3064318033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e907e13c0 0x564e907e17e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3064318033 >> 172.21.15.100:0/3064318033 conn(0x564e907d6350 msgr2=0x564e907d8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3064318033 shutdown_connections 2024-09-18T01:25:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3064318033 wait complete. 2024-09-18T01:25:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564e907d0b30 msgr2=0x564e907d2f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564e907d0b30 0x564e907d2f20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e906cd780 msgr2=0x564e907ca390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e906cd780 0x564e907ca390 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e907ccb50 msgr2=0x564e907cef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e907ccb50 0x564e907cef40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9f8036b90 msgr2=0x7fd9f8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd9f8036b90 0x7fd9f8039050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdafc000c00 tx=0x7fdafc0013b0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 msgr2=0x564e906cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 --2- 172.21.15.100:0/3922516836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9063dd90 0x564e906cab70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdb040460a0 tx=0x7fdb04003020 comp rx=0 tx=0).stop 2024-09-18T01:25:27.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb12768640 1 -- 172.21.15.100:0/3922516836 reap_dead start 2024-09-18T01:25:27.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 shutdown_connections 2024-09-18T01:25:27.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 >> 172.21.15.100:0/3922516836 conn(0x564e906c4df0 msgr2=0x564e907b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 shutdown_connections 2024-09-18T01:25:27.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.890+0000 7fdb16c30800 1 -- 172.21.15.100:0/3922516836 wait complete. 2024-09-18T01:25:27.902 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:27.902 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-18T01:25:27.902 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-18T01:25:27.902 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-18T01:25:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.950+0000 7f2c66526800 1 Processor -- start 2024-09-18T01:25:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.950+0000 7f2c66526800 1 -- start start 2024-09-18T01:25:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.950+0000 7f2c66526800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560968d5f920 0x560968d61d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.950+0000 7f2c66526800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560968c1bb30 con 0x560968d5b4e0 2024-09-18T01:25:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.950+0000 7f2c66526800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x560968bfd360 con 0x560968d5f920 2024-09-18T01:25:27.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.951+0000 7f2c619e2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560968d5f920 0x560968d61d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.951+0000 7f2c621e3640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x560968d5b4e0 0x560968d5b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59254/0 (socket says 172.21.15.100:59254) 2024-09-18T01:25:27.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.951+0000 7f2c621e3640 1 -- 172.21.15.100:0/3033769342 learned_addr learned my addr 172.21.15.100:0/3033769342 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:27.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.951+0000 7f2c619e2640 1 -- 172.21.15.100:0/3033769342 >> v1:172.21.15.92:6789/0 conn(0x560968d5b4e0 legacy=0x560968d5b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.951+0000 7f2c619e2640 1 -- 172.21.15.100:0/3033769342 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560968c23e00 con 0x560968d5f920 2024-09-18T01:25:27.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.953+0000 7f2c619e2640 1 --2- 172.21.15.100:0/3033769342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5f920 0x560968d61d10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800a470 tx=0x7f2c58045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3c6923dd4536a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.953+0000 7f2c611e1640 1 -- 172.21.15.100:0/3033769342 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c58053570 con 0x560968d5f920 2024-09-18T01:25:27.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.953+0000 7f2c611e1640 1 -- 172.21.15.100:0/3033769342 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c58058070 con 0x560968d5f920 2024-09-18T01:25:27.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.953+0000 7f2c611e1640 1 -- 172.21.15.100:0/3033769342 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c58053880 con 0x560968d5f920 2024-09-18T01:25:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.953+0000 7f2c66526800 1 -- 172.21.15.100:0/3033769342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5f920 msgr2=0x560968d61d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.953+0000 7f2c66526800 1 --2- 172.21.15.100:0/3033769342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5f920 0x560968d61d10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800a470 tx=0x7f2c58045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.953+0000 7f2c66526800 1 -- 172.21.15.100:0/3033769342 shutdown_connections 2024-09-18T01:25:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.953+0000 7f2c66526800 1 --2- 172.21.15.100:0/3033769342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5f920 0x560968d61d10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.953+0000 7f2c66526800 1 -- 172.21.15.100:0/3033769342 >> 172.21.15.100:0/3033769342 conn(0x560968d56e10 msgr2=0x560968d59230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.953+0000 7f2c66526800 1 -- 172.21.15.100:0/3033769342 shutdown_connections 2024-09-18T01:25:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.953+0000 7f2c66526800 1 -- 172.21.15.100:0/3033769342 wait complete. 2024-09-18T01:25:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.967+0000 7f2c66526800 1 Processor -- start 2024-09-18T01:25:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.967+0000 7f2c66526800 1 -- start start 2024-09-18T01:25:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.967+0000 7f2c66526800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5b4e0 0x560968e4a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.967+0000 7f2c66526800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560968ca8350 con 0x560968d5b4e0 2024-09-18T01:25:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.967+0000 7f2c621e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5b4e0 0x560968e4a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.967+0000 7f2c621e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5b4e0 0x560968e4a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33164/0 (socket says 172.21.15.100:33164) 2024-09-18T01:25:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.967+0000 7f2c621e3640 1 -- 172.21.15.100:0/1799777484 learned_addr learned my addr 172.21.15.100:0/1799777484 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.968+0000 7f2c621e3640 1 -- 172.21.15.100:0/1799777484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560968bf5bc0 con 0x560968d5b4e0 2024-09-18T01:25:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.968+0000 7f2c621e3640 1 --2- 172.21.15.100:0/1799777484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5b4e0 0x560968e4a820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2c54001e10 tx=0x7f2c5400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32059125cee31d98 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.968+0000 7f2b50608640 1 -- 172.21.15.100:0/1799777484 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c54012020 con 0x560968d5b4e0 2024-09-18T01:25:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.968+0000 7f2b50608640 1 -- 172.21.15.100:0/1799777484 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5400e5a0 con 0x560968d5b4e0 2024-09-18T01:25:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.968+0000 7f2b50608640 1 -- 172.21.15.100:0/1799777484 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c5400e8e0 con 0x560968d5b4e0 2024-09-18T01:25:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.969+0000 7f2c66526800 1 -- 172.21.15.100:0/1799777484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5b4e0 msgr2=0x560968e4a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.969+0000 7f2c66526800 1 --2- 172.21.15.100:0/1799777484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5b4e0 0x560968e4a820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2c54001e10 tx=0x7f2c5400b780 comp rx=0 tx=0).stop 2024-09-18T01:25:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.969+0000 7f2c66526800 1 -- 172.21.15.100:0/1799777484 shutdown_connections 2024-09-18T01:25:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.969+0000 7f2c66526800 1 --2- 172.21.15.100:0/1799777484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5b4e0 0x560968e4a820 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.969+0000 7f2c66526800 1 -- 172.21.15.100:0/1799777484 >> 172.21.15.100:0/1799777484 conn(0x560968d56e10 msgr2=0x560968e461e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.969+0000 7f2c66526800 1 -- 172.21.15.100:0/1799777484 shutdown_connections 2024-09-18T01:25:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.969+0000 7f2c66526800 1 -- 172.21.15.100:0/1799777484 wait complete. 2024-09-18T01:25:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.969+0000 7f2c66526800 1 Processor -- start 2024-09-18T01:25:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.969+0000 7f2c66526800 1 -- start start 2024-09-18T01:25:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.969+0000 7f2c66526800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5b4e0 0x560968e52200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.969+0000 7f2c66526800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560968d62550 con 0x560968d5b4e0 2024-09-18T01:25:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.970+0000 7f2c621e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5b4e0 0x560968e52200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.970+0000 7f2c621e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5b4e0 0x560968e52200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33178/0 (socket says 172.21.15.100:33178) 2024-09-18T01:25:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.970+0000 7f2c621e3640 1 -- 172.21.15.100:0/211981875 learned_addr learned my addr 172.21.15.100:0/211981875 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.970+0000 7f2c621e3640 1 -- 172.21.15.100:0/211981875 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560968c09fe0 con 0x560968d5b4e0 2024-09-18T01:25:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.970+0000 7f2c621e3640 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5b4e0 0x560968e52200 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2c54001e10 tx=0x7f2c54000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.970+0000 7f2b4ee05640 1 -- 172.21.15.100:0/211981875 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c54012030 con 0x560968d5b4e0 2024-09-18T01:25:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.970+0000 7f2b4ee05640 1 -- 172.21.15.100:0/211981875 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5401c320 con 0x560968d5b4e0 2024-09-18T01:25:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.970+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560968e52740 con 0x560968d5b4e0 2024-09-18T01:25:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.970+0000 7f2b4ee05640 1 -- 172.21.15.100:0/211981875 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c5401c9b0 con 0x560968d5b4e0 2024-09-18T01:25:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.970+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560968e52c60 con 0x560968d5b4e0 2024-09-18T01:25:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.971+0000 7f2b4ee05640 1 -- 172.21.15.100:0/211981875 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2c54015020 con 0x560968d5b4e0 2024-09-18T01:25:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.971+0000 7f2b4ee05640 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b48036b40 0x7f2b48039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.971+0000 7f2b4ee05640 1 -- 172.21.15.100:0/211981875 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f2c54022030 con 0x560968d5b4e0 2024-09-18T01:25:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.971+0000 7f2c619e2640 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b48036b40 0x7f2b48039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.972+0000 7f2c66526800 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560968d5f920 0x560968e581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.972+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968e58700 con 0x560968d5f920 2024-09-18T01:25:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.972+0000 7f2c629e4640 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560968d5f920 0x560968e581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.972+0000 7f2c619e2640 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b48036b40 0x7f2b48039000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2c58057000 tx=0x7f2c58052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.972+0000 7f2c629e4640 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560968d5f920 0x560968e581c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.972+0000 7f2c629e4640 1 -- 172.21.15.100:0/211981875 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968d5f920 2024-09-18T01:25:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.972+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968e55750 con 0x560968d5f920 2024-09-18T01:25:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.972+0000 7f2c629e4640 1 -- 172.21.15.100:0/211981875 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968d5f920 2024-09-18T01:25:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.973+0000 7f2c66526800 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560968e5a9d0 0x560968e5cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.973+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968e5d460 con 0x560968e5a9d0 2024-09-18T01:25:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.973+0000 7f2c621e3640 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560968e5a9d0 0x560968e5cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.973+0000 7f2c621e3640 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560968e5a9d0 0x560968e5cdc0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.973+0000 7f2c621e3640 1 -- 172.21.15.100:0/211981875 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2c5401cd30 con 0x560968e5a9d0 2024-09-18T01:25:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.973+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968e59870 con 0x560968d5f920 2024-09-18T01:25:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.973+0000 7f2c629e4640 1 -- 172.21.15.100:0/211981875 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968d5f920 2024-09-18T01:25:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.974+0000 7f2c66526800 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560968e5e8a0 0x560968e60c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.974+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968e613d0 con 0x560968e5e8a0 2024-09-18T01:25:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.974+0000 7f2c619e2640 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560968e5e8a0 0x560968e60c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.974+0000 7f2c619e2640 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560968e5e8a0 0x560968e60c90 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.974+0000 7f2c619e2640 1 -- 172.21.15.100:0/211981875 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2c58051070 con 0x560968e5e8a0 2024-09-18T01:25:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.975+0000 7f2c66526800 1 Processor -- start 2024-09-18T01:25:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.975+0000 7f2c66526800 1 -- start start 2024-09-18T01:25:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.975+0000 7f2c66526800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e6f140 0x560968e6f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.975+0000 7f2c66526800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560968bf7580 con 0x560968e6f140 2024-09-18T01:25:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.975+0000 7f2c621e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e6f140 0x560968e6f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.975+0000 7f2c621e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e6f140 0x560968e6f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33192/0 (socket says 172.21.15.100:33192) 2024-09-18T01:25:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.975+0000 7f2c621e3640 1 -- 172.21.15.100:0/1283184631 learned_addr learned my addr 172.21.15.100:0/1283184631 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.975+0000 7f2c621e3640 1 -- 172.21.15.100:0/1283184631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560968e6faa0 con 0x560968e6f140 2024-09-18T01:25:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.975+0000 7f2c621e3640 1 --2- 172.21.15.100:0/1283184631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e6f140 0x560968e6f560 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2c5404d1e0 tx=0x7f2c5402ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.976+0000 7f2b47fff640 1 -- 172.21.15.100:0/1283184631 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c54033070 con 0x560968e6f140 2024-09-18T01:25:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.976+0000 7f2b47fff640 1 -- 172.21.15.100:0/1283184631 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5402c3d0 con 0x560968e6f140 2024-09-18T01:25:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.976+0000 7f2c66526800 1 -- 172.21.15.100:0/1283184631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560968e6fd30 con 0x560968e6f140 2024-09-18T01:25:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.976+0000 7f2b47fff640 1 -- 172.21.15.100:0/1283184631 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c5402c6b0 con 0x560968e6f140 2024-09-18T01:25:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.976+0000 7f2c66526800 1 -- 172.21.15.100:0/1283184631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560968e72a10 con 0x560968e6f140 2024-09-18T01:25:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.976+0000 7f2b47fff640 1 -- 172.21.15.100:0/1283184631 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2c54041020 con 0x560968e6f140 2024-09-18T01:25:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.976+0000 7f2b47fff640 1 --2- 172.21.15.100:0/1283184631 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b3c036b40 0x7f2b3c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.976+0000 7f2b47fff640 1 -- 172.21.15.100:0/1283184631 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f2c54038c60 con 0x560968e6f140 2024-09-18T01:25:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.977+0000 7f2c619e2640 1 --2- 172.21.15.100:0/1283184631 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b3c036b40 0x7f2b3c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.977+0000 7f2c66526800 1 Processor -- start 2024-09-18T01:25:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.977+0000 7f2c66526800 1 -- start start 2024-09-18T01:25:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.977+0000 7f2c619e2640 1 --2- 172.21.15.100:0/1283184631 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b3c036b40 0x7f2b3c039000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x560968e556b0 tx=0x7f2c58005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.977+0000 7f2c66526800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e80150 0x560968e80550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.977+0000 7f2c66526800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560968e4afd0 con 0x560968e80150 2024-09-18T01:25:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.977+0000 7f2c621e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e80150 0x560968e80550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.977+0000 7f2c621e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e80150 0x560968e80550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33208/0 (socket says 172.21.15.100:33208) 2024-09-18T01:25:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.977+0000 7f2c621e3640 1 -- 172.21.15.100:0/609429174 learned_addr learned my addr 172.21.15.100:0/609429174 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.977+0000 7f2c621e3640 1 -- 172.21.15.100:0/609429174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560968e80b20 con 0x560968e80150 2024-09-18T01:25:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.978+0000 7f2c621e3640 1 --2- 172.21.15.100:0/609429174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e80150 0x560968e80550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2c54040440 tx=0x7f2c54040530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bdc1c291012e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.978+0000 7f2b45ffb640 1 -- 172.21.15.100:0/609429174 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c54055040 con 0x560968e80150 2024-09-18T01:25:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.978+0000 7f2b45ffb640 1 -- 172.21.15.100:0/609429174 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c54041310 con 0x560968e80150 2024-09-18T01:25:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.978+0000 7f2b45ffb640 1 -- 172.21.15.100:0/609429174 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c54046b90 con 0x560968e80150 2024-09-18T01:25:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.978+0000 7f2c66526800 1 -- 172.21.15.100:0/609429174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e80150 msgr2=0x560968e80550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.978+0000 7f2c66526800 1 --2- 172.21.15.100:0/609429174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e80150 0x560968e80550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2c54040440 tx=0x7f2c54040530 comp rx=0 tx=0).stop 2024-09-18T01:25:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.978+0000 7f2c66526800 1 -- 172.21.15.100:0/609429174 shutdown_connections 2024-09-18T01:25:27.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.978+0000 7f2c66526800 1 --2- 172.21.15.100:0/609429174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e80150 0x560968e80550 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:27.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.978+0000 7f2c66526800 1 -- 172.21.15.100:0/609429174 >> 172.21.15.100:0/609429174 conn(0x560968e77ff0 msgr2=0x560968e760f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:27.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.978+0000 7f2c66526800 1 -- 172.21.15.100:0/609429174 shutdown_connections 2024-09-18T01:25:27.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.978+0000 7f2c66526800 1 -- 172.21.15.100:0/609429174 wait complete. 2024-09-18T01:25:27.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.978+0000 7f2c66526800 1 Processor -- start 2024-09-18T01:25:27.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.979+0000 7f2c66526800 1 -- start start 2024-09-18T01:25:27.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.979+0000 7f2c66526800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e80150 0x560968e87300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:27.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.979+0000 7f2c66526800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560968e80ff0 con 0x560968e80150 2024-09-18T01:25:27.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.979+0000 7f2c621e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e80150 0x560968e87300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:27.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.979+0000 7f2c621e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e80150 0x560968e87300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33216/0 (socket says 172.21.15.100:33216) 2024-09-18T01:25:27.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.979+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 learned_addr learned my addr 172.21.15.100:0/3906852037 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:27.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.979+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560968e87840 con 0x560968e80150 2024-09-18T01:25:27.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.979+0000 7f2c621e3640 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e80150 0x560968e87300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2c5404dc10 tx=0x7f2c5402ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:27.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.979+0000 7f2b33fff640 1 -- 172.21.15.100:0/3906852037 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c540418b0 con 0x560968e80150 2024-09-18T01:25:27.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.979+0000 7f2b33fff640 1 -- 172.21.15.100:0/3906852037 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5404d7a0 con 0x560968e80150 2024-09-18T01:25:27.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.979+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560968e87840 con 0x560968e80150 2024-09-18T01:25:27.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.979+0000 7f2b33fff640 1 -- 172.21.15.100:0/3906852037 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c540480b0 con 0x560968e80150 2024-09-18T01:25:27.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.979+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560968e87840 con 0x560968e80150 2024-09-18T01:25:28.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.980+0000 7f2b33fff640 1 -- 172.21.15.100:0/3906852037 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2c54041ab0 con 0x560968e80150 2024-09-18T01:25:28.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.980+0000 7f2b33fff640 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b2c036b90 0x7f2b2c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.980+0000 7f2b33fff640 1 -- 172.21.15.100:0/3906852037 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f2c54062070 con 0x560968e80150 2024-09-18T01:25:28.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.980+0000 7f2c619e2640 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b2c036b90 0x7f2b2c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.981+0000 7f2c619e2640 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b2c036b90 0x7f2b2c039050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2c58053570 tx=0x7f2c58053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.981+0000 7f2c66526800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.981+0000 7f2c66526800 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560968e92a80 0x560968e94f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.981+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968e95690 con 0x560968e92a80 2024-09-18T01:25:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.981+0000 7f2c629e4640 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560968e92a80 0x560968e94f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.981+0000 7f2c629e4640 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560968e92a80 0x560968e94f40 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 20 realm 2024-09-18T01:25:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968e95aa0 con 0x560968e92a80 2024-09-18T01:25:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968e96370 con 0x560968e92a80 2024-09-18T01:25:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e92a80 2024-09-18T01:25:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560968e97470 0x560968e99860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968e99e70 con 0x560968e97470 2024-09-18T01:25:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.982+0000 7f2c621e3640 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560968e97470 0x560968e99860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.983+0000 7f2c621e3640 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560968e97470 0x560968e99860 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.983+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2c5406c020 con 0x560968e97470 2024-09-18T01:25:28.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.983+0000 7f2c66526800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:28.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.983+0000 7f2c66526800 20 searching for the correct realm 2024-09-18T01:25:28.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.983+0000 7f2c66526800 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560968e9bdb0 0x560968e9e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.983+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e9e8f0 con 0x560968e9bdb0 2024-09-18T01:25:28.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.983+0000 7f2c619e2640 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560968e9bdb0 0x560968e9e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.983+0000 7f2c619e2640 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560968e9bdb0 0x560968e9e270 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.984+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.984+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e9e8f0 con 0x560968e97470 2024-09-18T01:25:28.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.984+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5406c020 con 0x560968e97470 2024-09-18T01:25:28.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.984+0000 7f2c621e3640 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2c54017050 0x7f2c5400d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.984+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e9e8f0 con 0x7f2c54017050 2024-09-18T01:25:28.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.984+0000 7f2c629e4640 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2c54017050 0x7f2c5400d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.984+0000 7f2c629e4640 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2c54017050 0x7f2c5400d7d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.985+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.985+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e92a80 2024-09-18T01:25:28.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.985+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.985+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e92a80 2024-09-18T01:25:28.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.985+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.985+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x7f2c54017050 2024-09-18T01:25:28.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.985+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.985+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x7f2c54017050 2024-09-18T01:25:28.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.986+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.986+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e97470 2024-09-18T01:25:28.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.986+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5406c020 con 0x560968e97470 2024-09-18T01:25:28.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.986+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e9bdb0 2024-09-18T01:25:28.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.986+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.986+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e92a80 2024-09-18T01:25:28.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.986+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.986+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x7f2c54017050 2024-09-18T01:25:28.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.987+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.987+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e92a80 2024-09-18T01:25:28.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.987+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.987+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e97470 2024-09-18T01:25:28.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.987+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2c5406c020 con 0x560968e97470 2024-09-18T01:25:28.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.987+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e9bdb0 2024-09-18T01:25:28.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.987+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.987+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e9bdb0 2024-09-18T01:25:28.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.987+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.987+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x7f2c54017050 2024-09-18T01:25:28.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.988+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.988+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e9bdb0 2024-09-18T01:25:28.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.988+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.988+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e9bdb0 2024-09-18T01:25:28.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.988+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.988+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e92a80 2024-09-18T01:25:28.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.988+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.988+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e92a80 2024-09-18T01:25:28.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.989+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.989+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x7f2c54017050 2024-09-18T01:25:28.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.989+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.989+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e9bdb0 2024-09-18T01:25:28.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.989+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.989+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e97470 2024-09-18T01:25:28.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.989+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5406c020 con 0x560968e97470 2024-09-18T01:25:28.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.989+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e92a80 2024-09-18T01:25:28.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.990+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.990+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x7f2c54017050 2024-09-18T01:25:28.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.990+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.990+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e9bdb0 2024-09-18T01:25:28.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.990+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.990+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x7f2c54017050 2024-09-18T01:25:28.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.990+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.990+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e97470 2024-09-18T01:25:28.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.991+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5406c020 con 0x560968e97470 2024-09-18T01:25:28.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.991+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e9bdb0 2024-09-18T01:25:28.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.991+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.991+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x7f2c54017050 2024-09-18T01:25:28.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.991+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.991+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e92a80 2024-09-18T01:25:28.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.991+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.991+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560968e96710 con 0x560968e97470 2024-09-18T01:25:28.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.991+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2c5406c020 con 0x560968e97470 2024-09-18T01:25:28.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:28.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:28.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:28.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:28.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:28.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:28.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968e9a6c0 con 0x560968e92a80 2024-09-18T01:25:28.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968e9aab0 con 0x560968e92a80 2024-09-18T01:25:28.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968e9aab0 con 0x7f2c54017050 2024-09-18T01:25:28.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:28.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 zone default found 2024-09-18T01:25:28.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 4 Realm: () 2024-09-18T01:25:28.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:28.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:28.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:28.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 zonegroup default 2024-09-18T01:25:28.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.992+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968e9a2c0 con 0x7f2c54017050 2024-09-18T01:25:28.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.993+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.993+0000 7f2c66526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.993+0000 7f2c66526800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.993+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968ea0750 con 0x560968e9bdb0 2024-09-18T01:25:28.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.993+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.993+0000 7f2c66526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.993+0000 7f2c66526800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.993+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968ea0af0 con 0x560968e9bdb0 2024-09-18T01:25:28.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.993+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.993+0000 7f2c66526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.993+0000 7f2c66526800 20 started sync module instance, tier type = 2024-09-18T01:25:28.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.993+0000 7f2c66526800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:28.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.993+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968e9fbf0 con 0x560968e97470 2024-09-18T01:25:28.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.994+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5406c020 con 0x560968e97470 2024-09-18T01:25:28.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.994+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94598414860304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea1340 con 0x560968e97470 2024-09-18T01:25:28.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.994+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea1b90 con 0x560968e92a80 2024-09-18T01:25:28.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.995+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94598414860304] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5406c020 con 0x560968e97470 2024-09-18T01:25:28.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.995+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.995+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94598414864016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea1b90 con 0x560968e92a80 2024-09-18T01:25:28.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.996+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea25b0 con 0x560968e9bdb0 2024-09-18T01:25:28.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.998+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.998+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94598414868640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea2e80 con 0x560968e9bdb0 2024-09-18T01:25:28.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.998+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea3960 con 0x560968e97470 2024-09-18T01:25:28.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.998+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94598414864016] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:27.999+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94598414868640] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.001+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5406c020 con 0x560968e97470 2024-09-18T01:25:28.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.001+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94598414870992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea16e0 con 0x560968e97470 2024-09-18T01:25:28.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.001+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea4240 con 0x560968e92a80 2024-09-18T01:25:28.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.002+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.002+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94598414875984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea41b0 con 0x560968e92a80 2024-09-18T01:25:28.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.002+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea51a0 con 0x7f2c54017050 2024-09-18T01:25:28.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.002+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94598414870992] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5406c020 con 0x560968e97470 2024-09-18T01:25:28.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.004+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94598414875984] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.005+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.005+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94598414873712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea51a0 con 0x7f2c54017050 2024-09-18T01:25:28.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.005+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea4710 con 0x7f2c54017050 2024-09-18T01:25:28.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.007+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.007+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94598414873712] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.007+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94598414882192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea4710 con 0x7f2c54017050 2024-09-18T01:25:28.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.007+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea6010 con 0x7f2c54017050 2024-09-18T01:25:28.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.008+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.008+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94598414883616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea6430 con 0x7f2c54017050 2024-09-18T01:25:28.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.008+0000 7f2c66526800 20 add_watcher() i=0 2024-09-18T01:25:28.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.008+0000 7f2c66526800 20 add_watcher() i=1 2024-09-18T01:25:28.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.008+0000 7f2c66526800 20 add_watcher() i=2 2024-09-18T01:25:28.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.008+0000 7f2c66526800 20 add_watcher() i=3 2024-09-18T01:25:28.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.008+0000 7f2c66526800 20 add_watcher() i=4 2024-09-18T01:25:28.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.008+0000 7f2c66526800 20 add_watcher() i=5 2024-09-18T01:25:28.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.008+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94598414882192] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.008+0000 7f2c66526800 20 add_watcher() i=6 2024-09-18T01:25:28.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.009+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94598414883616] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.009+0000 7f2c66526800 20 add_watcher() i=7 2024-09-18T01:25:28.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.009+0000 7f2c66526800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:28.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.009+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968ea4c80 con 0x560968e92a80 2024-09-18T01:25:28.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.009+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.009+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94598414884672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ea4c80 con 0x560968e92a80 2024-09-18T01:25:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.010+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94598414884672] v33'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.010+0000 7f2b18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2c66526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2c66526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2c66526800 5 note: GC not initialized 2024-09-18T01:25:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2a937fe640 20 reqs_thread_entry: start 2024-09-18T01:25:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2c66526800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2c66526800 20 Filter name: none 2024-09-18T01:25:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2a917fa640 20 reqs_thread_entry: start 2024-09-18T01:25:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2c66526800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2c66526800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968edc980 con 0x560968e92a80 2024-09-18T01:25:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2c66526800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:28.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2c66526800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:28.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2c66526800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.011+0000 7f2c66526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:28.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.012+0000 7f2c66526800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-18T01:25:28.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.012+0000 7f2c66526800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.012+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968edd3f0 con 0x7f2c54017050 2024-09-18T01:25:28.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.012+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.012+0000 7f2c66526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.012+0000 7f2c66526800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-18T01:25:28.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.012+0000 7f2c66526800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:25:28.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.012+0000 7f2c66526800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T01:25:28.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.012+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ee2db0 con 0x560968e92a80 2024-09-18T01:25:28.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.013+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v33'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.013+0000 7f2c66526800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:28.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.013+0000 7f2c66526800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.013+0000 7f2c66526800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:28.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.013+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94598415132528 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968ede430 con 0x560968e92a80 2024-09-18T01:25:28.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.013+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== watch-notify(notify (1) cookie 94598414875984 notify 141733920771 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7f2c5c018d40 con 0x560968e92a80 2024-09-18T01:25:28.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.013+0000 7f2b45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 94598414875984 notifier 4349 bl.length()=678 2024-09-18T01:25:28.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.013+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(65 notify.4 [notify cookie 94598415132528 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.013+0000 7f2b45ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:28.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.013+0000 7f2b45ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.013+0000 7f2b45ffb640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f2b28003ea0 con 0x560968e92a80 2024-09-18T01:25:28.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.014+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.014+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== watch-notify(notify_complete (2) cookie 94598415132528 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2c5c0434f0 con 0x560968e92a80 2024-09-18T01:25:28.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.014+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ee2770 con 0x7f2c54017050 2024-09-18T01:25:28.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.015+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.015+0000 7f2c66526800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:25:28.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.015+0000 7f2c66526800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:25:28.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.015+0000 7f2c66526800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:25:28.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.015+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94598415132528 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560968eddf80 con 0x560968e9bdb0 2024-09-18T01:25:28.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.015+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== watch-notify(notify (1) cookie 94598414868640 notify 141733920768 ret 0) ==== 219+0+0 (crc 0 0 0) 0x560968c23e00 con 0x560968e9bdb0 2024-09-18T01:25:28.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.015+0000 7f2b45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 94598414868640 notifier 4349 bl.length()=177 2024-09-18T01:25:28.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.015+0000 7f2b45ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:25:28.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.015+0000 7f2b45ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:25:28.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.015+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(68 notify.2 [notify cookie 94598415132528 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.015+0000 7f2b45ffb640 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f2b28003ea0 con 0x560968e9bdb0 2024-09-18T01:25:28.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.016+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== watch-notify(notify_complete (2) cookie 94598415132528 notify 141733920768 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2c58076c60 con 0x560968e9bdb0 2024-09-18T01:25:28.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.016+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.025 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T01:25:28.013317Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:28.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.016+0000 7f2b18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.016+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94598414884672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968ede860 con 0x560968e92a80 2024-09-18T01:25:28.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.017+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94598414884672] v33'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.017+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94598414860304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968eda640 con 0x560968e97470 2024-09-18T01:25:28.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.020+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94598414860304] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5406c020 con 0x560968e97470 2024-09-18T01:25:28.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.020+0000 7f2c66526800 20 remove_watcher() i=0 2024-09-18T01:25:28.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.020+0000 7f2c66526800 2 removed watcher, disabling cache 2024-09-18T01:25:28.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.020+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94598414864016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968eda640 con 0x560968e92a80 2024-09-18T01:25:28.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.021+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94598414864016] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.021+0000 7f2c66526800 20 remove_watcher() i=1 2024-09-18T01:25:28.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.021+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94598414868640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968eda640 con 0x560968e9bdb0 2024-09-18T01:25:28.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.023+0000 7f2c619e2640 1 -- 172.21.15.100:0/3906852037 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94598414868640] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c58051070 con 0x560968e9bdb0 2024-09-18T01:25:28.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.023+0000 7f2c66526800 20 remove_watcher() i=2 2024-09-18T01:25:28.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.023+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94598414870992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968eda640 con 0x560968e97470 2024-09-18T01:25:28.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.024+0000 7f2c621e3640 1 -- 172.21.15.100:0/3906852037 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94598414870992] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5406c020 con 0x560968e97470 2024-09-18T01:25:28.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.024+0000 7f2c66526800 20 remove_watcher() i=3 2024-09-18T01:25:28.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.024+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94598414875984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968eda640 con 0x560968e92a80 2024-09-18T01:25:28.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.025+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94598414875984] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x560968e92a80 2024-09-18T01:25:28.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.025+0000 7f2c66526800 20 remove_watcher() i=4 2024-09-18T01:25:28.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.025+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94598414873712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968eda640 con 0x7f2c54017050 2024-09-18T01:25:28.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.026+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94598414873712] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.026+0000 7f2c66526800 20 remove_watcher() i=5 2024-09-18T01:25:28.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.026+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94598414882192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968eda640 con 0x7f2c54017050 2024-09-18T01:25:28.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.027+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94598414882192] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.027+0000 7f2c66526800 20 remove_watcher() i=6 2024-09-18T01:25:28.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.027+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94598414883616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560968eda640 con 0x7f2c54017050 2024-09-18T01:25:28.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94598414883616] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x7f2c54017050 2024-09-18T01:25:28.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 20 remove_watcher() i=7 2024-09-18T01:25:28.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2c54017050 msgr2=0x7f2c5400d7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2c54017050 0x7f2c5400d7d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560968e92a80 msgr2=0x560968e94f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560968e92a80 0x560968e94f40 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560968e97470 msgr2=0x560968e99860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560968e97470 0x560968e99860 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560968e9bdb0 msgr2=0x560968e9e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560968e9bdb0 0x560968e9e270 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b2c036b90 msgr2=0x7f2b2c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b2c036b90 0x7f2b2c039050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2c58053570 tx=0x7f2c58053000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e80150 msgr2=0x560968e87300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c629e4640 1 -- 172.21.15.100:0/3906852037 reap_dead start 2024-09-18T01:25:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e80150 0x560968e87300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2c5404dc10 tx=0x7f2c5402ed20 comp rx=0 tx=0).stop 2024-09-18T01:25:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 shutdown_connections 2024-09-18T01:25:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 --2- 172.21.15.100:0/3906852037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e80150 0x560968e87300 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 >> 172.21.15.100:0/3906852037 conn(0x560968e77ff0 msgr2=0x560968e760c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 shutdown_connections 2024-09-18T01:25:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.028+0000 7f2c66526800 1 -- 172.21.15.100:0/3906852037 wait complete. 2024-09-18T01:25:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/1283184631 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b3c036b40 msgr2=0x7f2b3c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 --2- 172.21.15.100:0/1283184631 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b3c036b40 0x7f2b3c039000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x560968e556b0 tx=0x7f2c58005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/1283184631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e6f140 msgr2=0x560968e6f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 --2- 172.21.15.100:0/1283184631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e6f140 0x560968e6f560 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2c5404d1e0 tx=0x7f2c5402ff70 comp rx=0 tx=0).stop 2024-09-18T01:25:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/1283184631 shutdown_connections 2024-09-18T01:25:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 --2- 172.21.15.100:0/1283184631 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b3c036b40 0x7f2b3c039000 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 --2- 172.21.15.100:0/1283184631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968e6f140 0x560968e6f560 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/1283184631 >> 172.21.15.100:0/1283184631 conn(0x560968e640d0 msgr2=0x560968e66c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/1283184631 shutdown_connections 2024-09-18T01:25:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/1283184631 wait complete. 2024-09-18T01:25:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560968e5e8a0 msgr2=0x560968e60c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560968e5e8a0 0x560968e60c90 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560968d5f920 msgr2=0x560968e581c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560968d5f920 0x560968e581c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560968e5a9d0 msgr2=0x560968e5cdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560968e5a9d0 0x560968e5cdc0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b48036b40 msgr2=0x7f2b48039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2b48036b40 0x7f2b48039000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2c58057000 tx=0x7f2c58052000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5b4e0 msgr2=0x560968e52200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 --2- 172.21.15.100:0/211981875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560968d5b4e0 0x560968e52200 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2c54001e10 tx=0x7f2c54000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c629e4640 1 -- 172.21.15.100:0/211981875 reap_dead start 2024-09-18T01:25:28.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 shutdown_connections 2024-09-18T01:25:28.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 >> 172.21.15.100:0/211981875 conn(0x560968d56e10 msgr2=0x560968e44ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 shutdown_connections 2024-09-18T01:25:28.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.029+0000 7f2c66526800 1 -- 172.21.15.100:0/211981875 wait complete. 2024-09-18T01:25:28.040 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T01:25:28.013317Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:28.040 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:25:28.041 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:25:28.041 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:25:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.084+0000 7fbf41e13800 1 Processor -- start 2024-09-18T01:25:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.084+0000 7fbf41e13800 1 -- start start 2024-09-18T01:25:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.084+0000 7fbf41e13800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560244c8c610 0x560244d1b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.084+0000 7fbf41e13800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560244bd7b30 con 0x560244d1b7b0 2024-09-18T01:25:28.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.084+0000 7fbf41e13800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x560244bb9360 con 0x560244c8c610 2024-09-18T01:25:28.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.085+0000 7fbf3d46e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560244c8c610 0x560244d1b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.085+0000 7fbf34c6d640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x560244d1b7b0 0x560244d1dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:59260/0 (socket says 172.21.15.100:59260) 2024-09-18T01:25:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.085+0000 7fbf34c6d640 1 -- 172.21.15.100:0/2740358673 learned_addr learned my addr 172.21.15.100:0/2740358673 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.085+0000 7fbf3cc6d640 1 -- 172.21.15.100:0/2740358673 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220471110 0 0) 0x560244bd7b30 con 0x560244d1b7b0 2024-09-18T01:25:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.085+0000 7fbf3cc6d640 1 -- 172.21.15.100:0/2740358673 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf2c001e10 con 0x560244d1b7b0 2024-09-18T01:25:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.085+0000 7fbf3d46e640 1 -- 172.21.15.100:0/2740358673 >> v1:172.21.15.92:6789/0 conn(0x560244d1b7b0 legacy=0x560244d1dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.085+0000 7fbf3d46e640 1 -- 172.21.15.100:0/2740358673 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560244bdfe00 con 0x560244c8c610 2024-09-18T01:25:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.087+0000 7fbf3d46e640 1 --2- 172.21.15.100:0/2740358673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 0x560244d1b270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000a470 tx=0x7fbf30045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc159efdee9ebd8a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.087+0000 7fbf3cc6d640 1 -- 172.21.15.100:0/2740358673 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf30059070 con 0x560244c8c610 2024-09-18T01:25:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.087+0000 7fbf3cc6d640 1 -- 172.21.15.100:0/2740358673 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf30054570 con 0x560244c8c610 2024-09-18T01:25:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.087+0000 7fbf3cc6d640 1 -- 172.21.15.100:0/2740358673 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf30054870 con 0x560244c8c610 2024-09-18T01:25:28.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.087+0000 7fbf41e13800 1 -- 172.21.15.100:0/2740358673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 msgr2=0x560244d1b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.087+0000 7fbf41e13800 1 --2- 172.21.15.100:0/2740358673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 0x560244d1b270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000a470 tx=0x7fbf30045920 comp rx=0 tx=0).stop 2024-09-18T01:25:28.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.088+0000 7fbf41e13800 1 -- 172.21.15.100:0/2740358673 shutdown_connections 2024-09-18T01:25:28.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.088+0000 7fbf41e13800 1 --2- 172.21.15.100:0/2740358673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 0x560244d1b270 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.088+0000 7fbf41e13800 1 -- 172.21.15.100:0/2740358673 >> 172.21.15.100:0/2740358673 conn(0x560244d12de0 msgr2=0x560244d15200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.088+0000 7fbf41e13800 1 -- 172.21.15.100:0/2740358673 shutdown_connections 2024-09-18T01:25:28.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.088+0000 7fbf41e13800 1 -- 172.21.15.100:0/2740358673 wait complete. 2024-09-18T01:25:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.101+0000 7fbf41e13800 1 Processor -- start 2024-09-18T01:25:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.101+0000 7fbf41e13800 1 -- start start 2024-09-18T01:25:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.102+0000 7fbf41e13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 0x560244e076c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.102+0000 7fbf41e13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560244c64330 con 0x560244c8c610 2024-09-18T01:25:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.102+0000 7fbf3d46e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 0x560244e076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.102+0000 7fbf3d46e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 0x560244e076c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33234/0 (socket says 172.21.15.100:33234) 2024-09-18T01:25:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.102+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3239450681 learned_addr learned my addr 172.21.15.100:0/3239450681 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.102+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3239450681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560244bb1bc0 con 0x560244c8c610 2024-09-18T01:25:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.102+0000 7fbf3d46e640 1 --2- 172.21.15.100:0/3239450681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 0x560244e076c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbf30025b20 tx=0x7fbf3004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7586bad36a8dfc6f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.103+0000 7fbe2b606640 1 -- 172.21.15.100:0/3239450681 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf30062070 con 0x560244c8c610 2024-09-18T01:25:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.103+0000 7fbe2b606640 1 -- 172.21.15.100:0/3239450681 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3000a170 con 0x560244c8c610 2024-09-18T01:25:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.103+0000 7fbe2b606640 1 -- 172.21.15.100:0/3239450681 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf30059040 con 0x560244c8c610 2024-09-18T01:25:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.103+0000 7fbf41e13800 1 -- 172.21.15.100:0/3239450681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 msgr2=0x560244e076c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.103+0000 7fbf41e13800 1 --2- 172.21.15.100:0/3239450681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 0x560244e076c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbf30025b20 tx=0x7fbf3004e000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.103+0000 7fbf41e13800 1 -- 172.21.15.100:0/3239450681 shutdown_connections 2024-09-18T01:25:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.103+0000 7fbf41e13800 1 --2- 172.21.15.100:0/3239450681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 0x560244e076c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.103+0000 7fbf41e13800 1 -- 172.21.15.100:0/3239450681 >> 172.21.15.100:0/3239450681 conn(0x560244d12de0 msgr2=0x560244e03080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.103+0000 7fbf41e13800 1 -- 172.21.15.100:0/3239450681 shutdown_connections 2024-09-18T01:25:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.103+0000 7fbf41e13800 1 -- 172.21.15.100:0/3239450681 wait complete. 2024-09-18T01:25:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.104+0000 7fbf41e13800 1 Processor -- start 2024-09-18T01:25:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.104+0000 7fbf41e13800 1 -- start start 2024-09-18T01:25:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.104+0000 7fbf41e13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 0x560244e0f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.104+0000 7fbf41e13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560244d1f680 con 0x560244c8c610 2024-09-18T01:25:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.104+0000 7fbf3d46e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 0x560244e0f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.104+0000 7fbf3d46e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 0x560244e0f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33248/0 (socket says 172.21.15.100:33248) 2024-09-18T01:25:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.104+0000 7fbf3d46e640 1 -- 172.21.15.100:0/2090468594 learned_addr learned my addr 172.21.15.100:0/2090468594 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.104+0000 7fbf3d46e640 1 -- 172.21.15.100:0/2090468594 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560244bc5fe0 con 0x560244c8c610 2024-09-18T01:25:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.104+0000 7fbf3d46e640 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 0x560244e0f100 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbf30045960 tx=0x7fbf30002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.105+0000 7fbe29e03640 1 -- 172.21.15.100:0/2090468594 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3006c070 con 0x560244c8c610 2024-09-18T01:25:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.105+0000 7fbe29e03640 1 -- 172.21.15.100:0/2090468594 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf30054bf0 con 0x560244c8c610 2024-09-18T01:25:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.105+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560244e0f640 con 0x560244c8c610 2024-09-18T01:25:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.105+0000 7fbe29e03640 1 -- 172.21.15.100:0/2090468594 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf30062070 con 0x560244c8c610 2024-09-18T01:25:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.105+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560244e0fb60 con 0x560244c8c610 2024-09-18T01:25:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.105+0000 7fbe29e03640 1 -- 172.21.15.100:0/2090468594 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbf30065040 con 0x560244c8c610 2024-09-18T01:25:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.106+0000 7fbe29e03640 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe24036b90 0x7fbe24039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.106+0000 7fbe29e03640 1 -- 172.21.15.100:0/2090468594 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fbf3008f290 con 0x560244c8c610 2024-09-18T01:25:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.106+0000 7fbf34c6d640 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe24036b90 0x7fbe24039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.106+0000 7fbf41e13800 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560244d1b7b0 0x560244e16170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.106+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e166b0 con 0x560244d1b7b0 2024-09-18T01:25:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.106+0000 7fbf3dc6f640 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560244d1b7b0 0x560244e16170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.106+0000 7fbf34c6d640 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe24036b90 0x7fbe24039050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbf28000f60 tx=0x7fbf280010a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.106+0000 7fbf3dc6f640 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560244d1b7b0 0x560244e16170 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.106+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/2090468594 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244d1b7b0 2024-09-18T01:25:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.107+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e13720 con 0x560244d1b7b0 2024-09-18T01:25:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.107+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/2090468594 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244d1b7b0 2024-09-18T01:25:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.107+0000 7fbf41e13800 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560244e189a0 0x560244e1ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.107+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e1b430 con 0x560244e189a0 2024-09-18T01:25:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.107+0000 7fbf3d46e640 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560244e189a0 0x560244e1ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.107+0000 7fbf3d46e640 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560244e189a0 0x560244e1ad90 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.108+0000 7fbf3d46e640 1 -- 172.21.15.100:0/2090468594 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbf3005c040 con 0x560244e189a0 2024-09-18T01:25:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.108+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e17840 con 0x560244d1b7b0 2024-09-18T01:25:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.108+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/2090468594 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244d1b7b0 2024-09-18T01:25:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.108+0000 7fbf41e13800 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560244e1c890 0x560244e1ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.108+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e1f380 con 0x560244e1c890 2024-09-18T01:25:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.108+0000 7fbf34c6d640 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560244e1c890 0x560244e1ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.108+0000 7fbf34c6d640 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560244e1c890 0x560244e1ec80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.109+0000 7fbf34c6d640 1 -- 172.21.15.100:0/2090468594 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbf28009050 con 0x560244e1c890 2024-09-18T01:25:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.109+0000 7fbf41e13800 1 Processor -- start 2024-09-18T01:25:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.109+0000 7fbf41e13800 1 -- start start 2024-09-18T01:25:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.109+0000 7fbf41e13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e2d0b0 0x560244e2d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.109+0000 7fbf41e13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560244bb3580 con 0x560244e2d0b0 2024-09-18T01:25:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.109+0000 7fbf3d46e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e2d0b0 0x560244e2d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.109+0000 7fbf3d46e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e2d0b0 0x560244e2d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33254/0 (socket says 172.21.15.100:33254) 2024-09-18T01:25:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.109+0000 7fbf3d46e640 1 -- 172.21.15.100:0/2569055228 learned_addr learned my addr 172.21.15.100:0/2569055228 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.110+0000 7fbf3d46e640 1 -- 172.21.15.100:0/2569055228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560244e2da10 con 0x560244e2d0b0 2024-09-18T01:25:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.110+0000 7fbf3d46e640 1 --2- 172.21.15.100:0/2569055228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e2d0b0 0x560244e2d4d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbf3006ffd0 tx=0x7fbf3005d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.110+0000 7fbe22ffd640 1 -- 172.21.15.100:0/2569055228 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf30059040 con 0x560244e2d0b0 2024-09-18T01:25:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.110+0000 7fbe22ffd640 1 -- 172.21.15.100:0/2569055228 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf30073450 con 0x560244e2d0b0 2024-09-18T01:25:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.110+0000 7fbf41e13800 1 -- 172.21.15.100:0/2569055228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560244e2dca0 con 0x560244e2d0b0 2024-09-18T01:25:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.110+0000 7fbe22ffd640 1 -- 172.21.15.100:0/2569055228 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf30086d10 con 0x560244e2d0b0 2024-09-18T01:25:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.110+0000 7fbf41e13800 1 -- 172.21.15.100:0/2569055228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560244e30980 con 0x560244e2d0b0 2024-09-18T01:25:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.111+0000 7fbe22ffd640 1 -- 172.21.15.100:0/2569055228 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbf30086eb0 con 0x560244e2d0b0 2024-09-18T01:25:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.111+0000 7fbe22ffd640 1 --2- 172.21.15.100:0/2569055228 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe14036b90 0x7fbe14039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.111+0000 7fbe22ffd640 1 -- 172.21.15.100:0/2569055228 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fbf30000ed0 con 0x560244e2d0b0 2024-09-18T01:25:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.111+0000 7fbf34c6d640 1 --2- 172.21.15.100:0/2569055228 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe14036b90 0x7fbe14039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.111+0000 7fbf41e13800 1 Processor -- start 2024-09-18T01:25:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.111+0000 7fbf41e13800 1 -- start start 2024-09-18T01:25:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.111+0000 7fbf34c6d640 1 --2- 172.21.15.100:0/2569055228 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe14036b90 0x7fbe14039050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800bf90 tx=0x7fbf2800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.111+0000 7fbf41e13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e39b70 0x560244e39f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.111+0000 7fbf41e13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560244e07db0 con 0x560244e39b70 2024-09-18T01:25:28.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.112+0000 7fbf3d46e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e39b70 0x560244e39f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.112+0000 7fbf3d46e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e39b70 0x560244e39f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33266/0 (socket says 172.21.15.100:33266) 2024-09-18T01:25:28.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.112+0000 7fbf3d46e640 1 -- 172.21.15.100:0/4247971782 learned_addr learned my addr 172.21.15.100:0/4247971782 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.112+0000 7fbf3d46e640 1 -- 172.21.15.100:0/4247971782 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560244e3a540 con 0x560244e39b70 2024-09-18T01:25:28.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.112+0000 7fbf3d46e640 1 --2- 172.21.15.100:0/4247971782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e39b70 0x560244e39f70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbf30065470 tx=0x7fbf30065630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11e2c4f2367feb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.112+0000 7fbe20ff9640 1 -- 172.21.15.100:0/4247971782 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf30067790 con 0x560244e39b70 2024-09-18T01:25:28.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.112+0000 7fbe20ff9640 1 -- 172.21.15.100:0/4247971782 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3009f070 con 0x560244e39b70 2024-09-18T01:25:28.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.112+0000 7fbe20ff9640 1 -- 172.21.15.100:0/4247971782 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf300871a0 con 0x560244e39b70 2024-09-18T01:25:28.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.113+0000 7fbf41e13800 1 -- 172.21.15.100:0/4247971782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e39b70 msgr2=0x560244e39f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.113+0000 7fbf41e13800 1 --2- 172.21.15.100:0/4247971782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e39b70 0x560244e39f70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbf30065470 tx=0x7fbf30065630 comp rx=0 tx=0).stop 2024-09-18T01:25:28.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.113+0000 7fbf41e13800 1 -- 172.21.15.100:0/4247971782 shutdown_connections 2024-09-18T01:25:28.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.113+0000 7fbf41e13800 1 --2- 172.21.15.100:0/4247971782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e39b70 0x560244e39f70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.113+0000 7fbf41e13800 1 -- 172.21.15.100:0/4247971782 >> 172.21.15.100:0/4247971782 conn(0x560244e35ed0 msgr2=0x560244e33fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.113+0000 7fbf41e13800 1 -- 172.21.15.100:0/4247971782 shutdown_connections 2024-09-18T01:25:28.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.113+0000 7fbf41e13800 1 -- 172.21.15.100:0/4247971782 wait complete. 2024-09-18T01:25:28.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.113+0000 7fbf41e13800 1 Processor -- start 2024-09-18T01:25:28.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.113+0000 7fbf41e13800 1 -- start start 2024-09-18T01:25:28.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.113+0000 7fbf41e13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e39b70 0x560244e40e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.113+0000 7fbf41e13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560244e3aac0 con 0x560244e39b70 2024-09-18T01:25:28.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.113+0000 7fbf3d46e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e39b70 0x560244e40e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.113+0000 7fbf3d46e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e39b70 0x560244e40e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:33282/0 (socket says 172.21.15.100:33282) 2024-09-18T01:25:28.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.113+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 learned_addr learned my addr 172.21.15.100:0/3456635491 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.114+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560244e413c0 con 0x560244e39b70 2024-09-18T01:25:28.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.114+0000 7fbf3d46e640 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e39b70 0x560244e40e80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbf30065470 tx=0x7fbf30077f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.114+0000 7fbe12ffd640 1 -- 172.21.15.100:0/3456635491 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf30067a50 con 0x560244e39b70 2024-09-18T01:25:28.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.114+0000 7fbe12ffd640 1 -- 172.21.15.100:0/3456635491 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf300aa070 con 0x560244e39b70 2024-09-18T01:25:28.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.114+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560244e413c0 con 0x560244e39b70 2024-09-18T01:25:28.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.114+0000 7fbe12ffd640 1 -- 172.21.15.100:0/3456635491 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf30067d40 con 0x560244e39b70 2024-09-18T01:25:28.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.114+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560244e413c0 con 0x560244e39b70 2024-09-18T01:25:28.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.115+0000 7fbe12ffd640 1 -- 172.21.15.100:0/3456635491 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbf300b5060 con 0x560244e39b70 2024-09-18T01:25:28.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.115+0000 7fbe12ffd640 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe08036b90 0x7fbe08039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.115+0000 7fbe12ffd640 1 -- 172.21.15.100:0/3456635491 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fbf300afc70 con 0x560244e39b70 2024-09-18T01:25:28.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.115+0000 7fbf34c6d640 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe08036b90 0x7fbe08039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.115+0000 7fbf41e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.115+0000 7fbf41e13800 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560244e4c4b0 0x560244e4e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.115+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e4f0c0 con 0x560244e4c4b0 2024-09-18T01:25:28.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf3dc6f640 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560244e4c4b0 0x560244e4e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf34c6d640 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe08036b90 0x7fbe08039050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x560244e13660 tx=0x7fbf28010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf3dc6f640 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560244e4c4b0 0x560244e4e970 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf41e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf41e13800 20 realm 2024-09-18T01:25:28.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf41e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e4f4d0 con 0x560244e4c4b0 2024-09-18T01:25:28.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf41e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf41e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:28.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf41e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e4fda0 con 0x560244e4c4b0 2024-09-18T01:25:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf41e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf41e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.116+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e4c4b0 2024-09-18T01:25:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.117+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.117+0000 7fbf41e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.117+0000 7fbf41e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.117+0000 7fbf41e13800 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560244e50c30 0x560244e53020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.117+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e53780 con 0x560244e50c30 2024-09-18T01:25:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.117+0000 7fbf3d46e640 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560244e50c30 0x560244e53020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.117+0000 7fbf3d46e640 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560244e50c30 0x560244e53020 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.117+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbf3005c040 con 0x560244e50c30 2024-09-18T01:25:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.117+0000 7fbf41e13800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.117+0000 7fbf41e13800 20 searching for the correct realm 2024-09-18T01:25:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.117+0000 7fbf41e13800 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560244e55830 0x560244e57cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.117+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e583c0 con 0x560244e55830 2024-09-18T01:25:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.118+0000 7fbf34c6d640 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560244e55830 0x560244e57cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.118+0000 7fbf34c6d640 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560244e55830 0x560244e57cf0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.118+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf28009050 con 0x560244e55830 2024-09-18T01:25:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.118+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e583c0 con 0x560244e50c30 2024-09-18T01:25:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.118+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3005c040 con 0x560244e50c30 2024-09-18T01:25:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.118+0000 7fbf3d46e640 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbf300b7070 0x7fbf300b7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.118+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e583c0 con 0x7fbf300b7070 2024-09-18T01:25:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.119+0000 7fbf3dc6f640 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbf300b7070 0x7fbf300b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.119+0000 7fbf3dc6f640 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbf300b7070 0x7fbf300b7670 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.119+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.119+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e4c4b0 2024-09-18T01:25:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.120+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.120+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e4c4b0 2024-09-18T01:25:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.120+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.120+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x7fbf300b7070 2024-09-18T01:25:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.120+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.120+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x7fbf300b7070 2024-09-18T01:25:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.120+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.120+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e50c30 2024-09-18T01:25:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.120+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3005c040 con 0x560244e50c30 2024-09-18T01:25:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.120+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e55830 2024-09-18T01:25:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.121+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf28009050 con 0x560244e55830 2024-09-18T01:25:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.121+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e4c4b0 2024-09-18T01:25:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.121+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.121+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x7fbf300b7070 2024-09-18T01:25:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.121+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.121+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e4c4b0 2024-09-18T01:25:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.121+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.121+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e50c30 2024-09-18T01:25:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.122+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbf3005c040 con 0x560244e50c30 2024-09-18T01:25:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.122+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e55830 2024-09-18T01:25:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.122+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf28009050 con 0x560244e55830 2024-09-18T01:25:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.122+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e55830 2024-09-18T01:25:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.122+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf28009050 con 0x560244e55830 2024-09-18T01:25:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.122+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x7fbf300b7070 2024-09-18T01:25:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.122+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.122+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e55830 2024-09-18T01:25:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.123+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf28009050 con 0x560244e55830 2024-09-18T01:25:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.123+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e55830 2024-09-18T01:25:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.123+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf28009050 con 0x560244e55830 2024-09-18T01:25:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.123+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e4c4b0 2024-09-18T01:25:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.123+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.123+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e4c4b0 2024-09-18T01:25:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.123+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.123+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x7fbf300b7070 2024-09-18T01:25:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.123+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.123+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e55830 2024-09-18T01:25:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.124+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf28009050 con 0x560244e55830 2024-09-18T01:25:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.124+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e50c30 2024-09-18T01:25:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.124+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3005c040 con 0x560244e50c30 2024-09-18T01:25:28.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.124+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e4c4b0 2024-09-18T01:25:28.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.124+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.124+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x7fbf300b7070 2024-09-18T01:25:28.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.125+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.125+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e55830 2024-09-18T01:25:28.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.125+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf28009050 con 0x560244e55830 2024-09-18T01:25:28.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.125+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x7fbf300b7070 2024-09-18T01:25:28.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.125+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.125+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e50c30 2024-09-18T01:25:28.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.125+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3005c040 con 0x560244e50c30 2024-09-18T01:25:28.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.125+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e55830 2024-09-18T01:25:28.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.125+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf28009050 con 0x560244e55830 2024-09-18T01:25:28.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.125+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x7fbf300b7070 2024-09-18T01:25:28.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.126+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.126+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e4c4b0 2024-09-18T01:25:28.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.126+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.126+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560244e50140 con 0x560244e50c30 2024-09-18T01:25:28.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.126+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbf3005c040 con 0x560244e50c30 2024-09-18T01:25:28.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.126+0000 7fbf41e13800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:28.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.126+0000 7fbf41e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:28.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.126+0000 7fbf41e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:28.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.126+0000 7fbf41e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:28.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.126+0000 7fbf41e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:28.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.126+0000 7fbf41e13800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:28.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.126+0000 7fbf41e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.126+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e54130 con 0x560244e4c4b0 2024-09-18T01:25:28.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e54520 con 0x560244e4c4b0 2024-09-18T01:25:28.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e54520 con 0x7fbf300b7070 2024-09-18T01:25:28.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:28.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 20 zone default found 2024-09-18T01:25:28.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 4 Realm: () 2024-09-18T01:25:28.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:28.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:28.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:28.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 20 zonegroup default 2024-09-18T01:25:28.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e54940 con 0x7fbf300b7070 2024-09-18T01:25:28.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.127+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e54940 con 0x560244e55830 2024-09-18T01:25:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.128+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf28009050 con 0x560244e55830 2024-09-18T01:25:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.128+0000 7fbf41e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.128+0000 7fbf41e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.128+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e5a220 con 0x560244e55830 2024-09-18T01:25:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.128+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf28009050 con 0x560244e55830 2024-09-18T01:25:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.128+0000 7fbf41e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.128+0000 7fbf41e13800 20 started sync module instance, tier type = 2024-09-18T01:25:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.128+0000 7fbf41e13800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.128+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e596c0 con 0x560244e50c30 2024-09-18T01:25:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.129+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3005c040 con 0x560244e50c30 2024-09-18T01:25:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.129+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94567745821664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e596c0 con 0x560244e50c30 2024-09-18T01:25:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.129+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5ad60 con 0x560244e4c4b0 2024-09-18T01:25:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.130+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94567745821664] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3005c040 con 0x560244e50c30 2024-09-18T01:25:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.130+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.130+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94567745824816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e596c0 con 0x560244e4c4b0 2024-09-18T01:25:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.130+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5b810 con 0x560244e55830 2024-09-18T01:25:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.131+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf28009050 con 0x560244e55830 2024-09-18T01:25:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.131+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94567745827568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5c0b0 con 0x560244e55830 2024-09-18T01:25:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.131+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5cb90 con 0x560244e50c30 2024-09-18T01:25:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.131+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94567745824816] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.133+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94567745827568] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf28009050 con 0x560244e55830 2024-09-18T01:25:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.133+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3005c040 con 0x560244e50c30 2024-09-18T01:25:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.133+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94567745829888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e59210 con 0x560244e50c30 2024-09-18T01:25:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.133+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5d430 con 0x560244e4c4b0 2024-09-18T01:25:28.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.134+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.134+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94567745834880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5d3a0 con 0x560244e4c4b0 2024-09-18T01:25:28.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.134+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5e3d0 con 0x7fbf300b7070 2024-09-18T01:25:28.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.135+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94567745829888] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3005c040 con 0x560244e50c30 2024-09-18T01:25:28.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.135+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.135+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94567745834880] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.135+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94567745838752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5e390 con 0x7fbf300b7070 2024-09-18T01:25:28.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.135+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5d840 con 0x7fbf300b7070 2024-09-18T01:25:28.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.136+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94567745838752] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.136+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.136+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94567745837120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5e960 con 0x7fbf300b7070 2024-09-18T01:25:28.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.137+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5f320 con 0x7fbf300b7070 2024-09-18T01:25:28.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.137+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94567745837120] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.137+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.137+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94567745832608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5f320 con 0x7fbf300b7070 2024-09-18T01:25:28.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.137+0000 7fbf41e13800 20 add_watcher() i=0 2024-09-18T01:25:28.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.137+0000 7fbf41e13800 20 add_watcher() i=1 2024-09-18T01:25:28.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.137+0000 7fbf41e13800 20 add_watcher() i=2 2024-09-18T01:25:28.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.137+0000 7fbf41e13800 20 add_watcher() i=3 2024-09-18T01:25:28.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.137+0000 7fbf41e13800 20 add_watcher() i=4 2024-09-18T01:25:28.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.137+0000 7fbf41e13800 20 add_watcher() i=5 2024-09-18T01:25:28.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.137+0000 7fbf41e13800 20 add_watcher() i=6 2024-09-18T01:25:28.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.138+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94567745832608] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.138+0000 7fbf41e13800 20 add_watcher() i=7 2024-09-18T01:25:28.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.138+0000 7fbf41e13800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:28.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.138+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e62640 con 0x560244e4c4b0 2024-09-18T01:25:28.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.139+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.139+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94567745843168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5f8b0 con 0x560244e4c4b0 2024-09-18T01:25:28.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.140+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94567745843168] v33'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.140+0000 7fbdf37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.140+0000 7fbf41e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:28.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.140+0000 7fbf41e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:28.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.140+0000 7fbf41e13800 5 note: GC not initialized 2024-09-18T01:25:28.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.140+0000 7fbdf27e4640 20 reqs_thread_entry: start 2024-09-18T01:25:28.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.140+0000 7fbf41e13800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:28.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.140+0000 7fbf41e13800 20 Filter name: none 2024-09-18T01:25:28.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.140+0000 7fbd63fff640 20 reqs_thread_entry: start 2024-09-18T01:25:28.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.140+0000 7fbf41e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.140+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560244e95590 con 0x560244e4c4b0 2024-09-18T01:25:28.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.141+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.141+0000 7fbf41e13800 20 rados_obj.operate() r=0 bl.length=502 2024-09-18T01:25:28.152 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T01:25:28.013317Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:28.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.142+0000 7fbdf37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.142+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94567745843168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e94000 con 0x560244e4c4b0 2024-09-18T01:25:28.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.143+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94567745843168] v33'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.143+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94567745821664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e93380 con 0x560244e50c30 2024-09-18T01:25:28.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.143+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94567745821664] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3005c040 con 0x560244e50c30 2024-09-18T01:25:28.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.143+0000 7fbf41e13800 20 remove_watcher() i=0 2024-09-18T01:25:28.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.143+0000 7fbf41e13800 2 removed watcher, disabling cache 2024-09-18T01:25:28.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.143+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94567745824816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e93380 con 0x560244e4c4b0 2024-09-18T01:25:28.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.144+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94567745824816] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.144+0000 7fbf41e13800 20 remove_watcher() i=1 2024-09-18T01:25:28.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.144+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94567745827568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e93380 con 0x560244e55830 2024-09-18T01:25:28.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.145+0000 7fbf34c6d640 1 -- 172.21.15.100:0/3456635491 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94567745827568] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf28009050 con 0x560244e55830 2024-09-18T01:25:28.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.145+0000 7fbf41e13800 20 remove_watcher() i=2 2024-09-18T01:25:28.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.145+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94567745829888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e59be0 con 0x560244e50c30 2024-09-18T01:25:28.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.146+0000 7fbf3d46e640 1 -- 172.21.15.100:0/3456635491 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94567745829888] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3005c040 con 0x560244e50c30 2024-09-18T01:25:28.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.146+0000 7fbf41e13800 20 remove_watcher() i=3 2024-09-18T01:25:28.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.146+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94567745834880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5b2f0 con 0x560244e4c4b0 2024-09-18T01:25:28.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.147+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94567745834880] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x560244e4c4b0 2024-09-18T01:25:28.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.147+0000 7fbf41e13800 20 remove_watcher() i=4 2024-09-18T01:25:28.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.147+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94567745838752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5bc00 con 0x7fbf300b7070 2024-09-18T01:25:28.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.148+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94567745838752] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.148+0000 7fbf41e13800 20 remove_watcher() i=5 2024-09-18T01:25:28.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.148+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94567745837120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e59be0 con 0x7fbf300b7070 2024-09-18T01:25:28.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.149+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94567745837120] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.149+0000 7fbf41e13800 20 remove_watcher() i=6 2024-09-18T01:25:28.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.149+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94567745832608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560244e5b2f0 con 0x7fbf300b7070 2024-09-18T01:25:28.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94567745832608] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3800a4a0 con 0x7fbf300b7070 2024-09-18T01:25:28.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 20 remove_watcher() i=7 2024-09-18T01:25:28.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbf300b7070 msgr2=0x7fbf300b7670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbf300b7070 0x7fbf300b7670 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560244e4c4b0 msgr2=0x560244e4e970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560244e4c4b0 0x560244e4e970 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560244e50c30 msgr2=0x560244e53020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560244e50c30 0x560244e53020 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560244e55830 msgr2=0x560244e57cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560244e55830 0x560244e57cf0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe08036b90 msgr2=0x7fbe08039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe08036b90 0x7fbe08039050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x560244e13660 tx=0x7fbf28010000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e39b70 msgr2=0x560244e40e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 --2- 172.21.15.100:0/3456635491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e39b70 0x560244e40e80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbf30065470 tx=0x7fbf30077f10 comp rx=0 tx=0).stop 2024-09-18T01:25:28.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 reap_dead start 2024-09-18T01:25:28.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/3456635491 reap_dead start 2024-09-18T01:25:28.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 shutdown_connections 2024-09-18T01:25:28.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 >> 172.21.15.100:0/3456635491 conn(0x560244e35ed0 msgr2=0x560244e33fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 shutdown_connections 2024-09-18T01:25:28.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.150+0000 7fbf41e13800 1 -- 172.21.15.100:0/3456635491 wait complete. 2024-09-18T01:25:28.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2569055228 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe14036b90 msgr2=0x7fbe14039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 --2- 172.21.15.100:0/2569055228 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe14036b90 0x7fbe14039050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800bf90 tx=0x7fbf2800f000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2569055228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e2d0b0 msgr2=0x560244e2d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 --2- 172.21.15.100:0/2569055228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e2d0b0 0x560244e2d4d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbf3006ffd0 tx=0x7fbf3005d9e0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2569055228 shutdown_connections 2024-09-18T01:25:28.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 --2- 172.21.15.100:0/2569055228 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe14036b90 0x7fbe14039050 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 --2- 172.21.15.100:0/2569055228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244e2d0b0 0x560244e2d4d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2569055228 >> 172.21.15.100:0/2569055228 conn(0x560244e22040 msgr2=0x560244e24bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2569055228 shutdown_connections 2024-09-18T01:25:28.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2569055228 wait complete. 2024-09-18T01:25:28.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560244e1c890 msgr2=0x560244e1ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560244e1c890 0x560244e1ec80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560244d1b7b0 msgr2=0x560244e16170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560244d1b7b0 0x560244e16170 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560244e189a0 msgr2=0x560244e1ad90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560244e189a0 0x560244e1ad90 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe24036b90 msgr2=0x7fbe24039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbe24036b90 0x7fbe24039050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbf28000f60 tx=0x7fbf280010a0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 msgr2=0x560244e0f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 --2- 172.21.15.100:0/2090468594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560244c8c610 0x560244e0f100 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbf30045960 tx=0x7fbf30002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf3dc6f640 1 -- 172.21.15.100:0/2090468594 reap_dead start 2024-09-18T01:25:28.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 shutdown_connections 2024-09-18T01:25:28.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 >> 172.21.15.100:0/2090468594 conn(0x560244d12de0 msgr2=0x560244e018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 shutdown_connections 2024-09-18T01:25:28.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.151+0000 7fbf41e13800 1 -- 172.21.15.100:0/2090468594 wait complete. 2024-09-18T01:25:28.163 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T01:25:28.013317Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:28.163 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-18T01:25:28.163 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-18T01:25:28.163 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-18T01:25:28.251 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:28.251 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:28.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.251+0000 7fbbea72f800 1 Processor -- start 2024-09-18T01:25:28.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.251+0000 7fbbea72f800 1 -- start start 2024-09-18T01:25:28.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.251+0000 7fbbea72f800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56367d1dda40 0x56367d1dfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.251+0000 7fbbea72f800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56367d098b30 con 0x56367d1d7960 2024-09-18T01:25:28.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.251+0000 7fbbea72f800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x56367d07a360 con 0x56367d1dda40 2024-09-18T01:25:28.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.251+0000 7fbbe5c23640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56367d1dda40 0x56367d1dfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.251+0000 7fbbe6424640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x56367d1d7960 0x56367d1d7d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37140/0 (socket says 172.21.15.100:37140) 2024-09-18T01:25:28.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.251+0000 7fbbe6424640 1 -- 172.21.15.100:0/2430686258 learned_addr learned my addr 172.21.15.100:0/2430686258 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:28.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.252+0000 7fbbe5c23640 1 -- 172.21.15.100:0/2430686258 >> v1:172.21.15.92:6789/0 conn(0x56367d1d7960 legacy=0x56367d1d7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.252+0000 7fbbe5422640 1 -- 172.21.15.100:0/2430686258 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187503572 0 0) 0x56367d098b30 con 0x56367d1d7960 2024-09-18T01:25:28.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.252+0000 7fbbe5c23640 1 -- 172.21.15.100:0/2430686258 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56367d0a0e00 con 0x56367d1dda40 2024-09-18T01:25:28.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.253+0000 7fbbe5c23640 1 --2- 172.21.15.100:0/2430686258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1dda40 0x56367d1dfe30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000a470 tx=0x7fbbd0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773d8be1f660d7e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.254+0000 7fbbe5422640 1 -- 172.21.15.100:0/2430686258 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbd0053570 con 0x56367d1dda40 2024-09-18T01:25:28.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.254+0000 7fbbe5422640 1 -- 172.21.15.100:0/2430686258 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd0058070 con 0x56367d1dda40 2024-09-18T01:25:28.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.254+0000 7fbbe5422640 1 -- 172.21.15.100:0/2430686258 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbd0053880 con 0x56367d1dda40 2024-09-18T01:25:28.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.254+0000 7fbbea72f800 1 -- 172.21.15.100:0/2430686258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1dda40 msgr2=0x56367d1dfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.254+0000 7fbbea72f800 1 --2- 172.21.15.100:0/2430686258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1dda40 0x56367d1dfe30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000a470 tx=0x7fbbd0045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:28.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.254+0000 7fbbea72f800 1 -- 172.21.15.100:0/2430686258 shutdown_connections 2024-09-18T01:25:28.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.254+0000 7fbbea72f800 1 --2- 172.21.15.100:0/2430686258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1dda40 0x56367d1dfe30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.254+0000 7fbbea72f800 1 -- 172.21.15.100:0/2430686258 >> 172.21.15.100:0/2430686258 conn(0x56367d1d3550 msgr2=0x56367d1d5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.254+0000 7fbbea72f800 1 -- 172.21.15.100:0/2430686258 shutdown_connections 2024-09-18T01:25:28.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.254+0000 7fbbea72f800 1 -- 172.21.15.100:0/2430686258 wait complete. 2024-09-18T01:25:28.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.268+0000 7fbbea72f800 1 Processor -- start 2024-09-18T01:25:28.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.268+0000 7fbbea72f800 1 -- start start 2024-09-18T01:25:28.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.268+0000 7fbbea72f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1d7960 0x56367d1da320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.268+0000 7fbbea72f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56367d125360 con 0x56367d1d7960 2024-09-18T01:25:28.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.268+0000 7fbbe6424640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1d7960 0x56367d1da320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.268+0000 7fbbe6424640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1d7960 0x56367d1da320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37106/0 (socket says 172.21.15.100:37106) 2024-09-18T01:25:28.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.268+0000 7fbbe6424640 1 -- 172.21.15.100:0/3478749613 learned_addr learned my addr 172.21.15.100:0/3478749613 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.269+0000 7fbbe6424640 1 -- 172.21.15.100:0/3478749613 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56367d072bc0 con 0x56367d1d7960 2024-09-18T01:25:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.269+0000 7fbbe6424640 1 --2- 172.21.15.100:0/3478749613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1d7960 0x56367d1da320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0001660 tx=0x7fbbe0001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28df0ff3f5e334b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.269+0000 7fbad4608640 1 -- 172.21.15.100:0/3478749613 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe0003450 con 0x56367d1d7960 2024-09-18T01:25:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.269+0000 7fbad4608640 1 -- 172.21.15.100:0/3478749613 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe0003610 con 0x56367d1d7960 2024-09-18T01:25:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.269+0000 7fbad4608640 1 -- 172.21.15.100:0/3478749613 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe00039b0 con 0x56367d1d7960 2024-09-18T01:25:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.270+0000 7fbbea72f800 1 -- 172.21.15.100:0/3478749613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1d7960 msgr2=0x56367d1da320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.270+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3478749613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1d7960 0x56367d1da320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0001660 tx=0x7fbbe0001b20 comp rx=0 tx=0).stop 2024-09-18T01:25:28.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.270+0000 7fbbea72f800 1 -- 172.21.15.100:0/3478749613 shutdown_connections 2024-09-18T01:25:28.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.270+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3478749613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1d7960 0x56367d1da320 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.270+0000 7fbbea72f800 1 -- 172.21.15.100:0/3478749613 >> 172.21.15.100:0/3478749613 conn(0x56367d1d3550 msgr2=0x56367d2c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.270+0000 7fbbea72f800 1 -- 172.21.15.100:0/3478749613 shutdown_connections 2024-09-18T01:25:28.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.270+0000 7fbbea72f800 1 -- 172.21.15.100:0/3478749613 wait complete. 2024-09-18T01:25:28.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.270+0000 7fbbea72f800 1 Processor -- start 2024-09-18T01:25:28.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.270+0000 7fbbea72f800 1 -- start start 2024-09-18T01:25:28.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.270+0000 7fbbea72f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1d7960 0x56367d2d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.270+0000 7fbbea72f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56367d1e0670 con 0x56367d1d7960 2024-09-18T01:25:28.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.270+0000 7fbbe6424640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1d7960 0x56367d2d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.270+0000 7fbbe6424640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1d7960 0x56367d2d22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37122/0 (socket says 172.21.15.100:37122) 2024-09-18T01:25:28.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.270+0000 7fbbe6424640 1 -- 172.21.15.100:0/3935547947 learned_addr learned my addr 172.21.15.100:0/3935547947 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.271+0000 7fbbe6424640 1 -- 172.21.15.100:0/3935547947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56367d086fe0 con 0x56367d1d7960 2024-09-18T01:25:28.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.271+0000 7fbbe6424640 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1d7960 0x56367d2d22c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x56367d1d9a20 tx=0x7fbbe0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.271+0000 7fbad2e05640 1 -- 172.21.15.100:0/3935547947 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe0025070 con 0x56367d1d7960 2024-09-18T01:25:28.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.271+0000 7fbad2e05640 1 -- 172.21.15.100:0/3935547947 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe0019040 con 0x56367d1d7960 2024-09-18T01:25:28.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.271+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56367d2d2800 con 0x56367d1d7960 2024-09-18T01:25:28.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.271+0000 7fbad2e05640 1 -- 172.21.15.100:0/3935547947 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe0013950 con 0x56367d1d7960 2024-09-18T01:25:28.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.271+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56367d2d2d80 con 0x56367d1d7960 2024-09-18T01:25:28.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.272+0000 7fbad2e05640 1 -- 172.21.15.100:0/3935547947 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbbe0010070 con 0x56367d1d7960 2024-09-18T01:25:28.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.272+0000 7fbad2e05640 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbacc036b40 0x7fbacc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.272+0000 7fbad2e05640 1 -- 172.21.15.100:0/3935547947 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fbbe004c130 con 0x56367d1d7960 2024-09-18T01:25:28.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.272+0000 7fbbe5c23640 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbacc036b40 0x7fbacc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.272+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56367d1dda40 0x56367d2d9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.272+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d2d9900 con 0x56367d1dda40 2024-09-18T01:25:28.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.272+0000 7fbbe6c25640 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56367d1dda40 0x56367d2d9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.273+0000 7fbbe5c23640 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbacc036b40 0x7fbacc039000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0057000 tx=0x7fbbd0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.273+0000 7fbbe6c25640 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56367d1dda40 0x56367d2d9330 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.273+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3935547947 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbd80083e0 con 0x56367d1dda40 2024-09-18T01:25:28.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.273+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d2d68e0 con 0x56367d1dda40 2024-09-18T01:25:28.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.273+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3935547947 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbbd80083e0 con 0x56367d1dda40 2024-09-18T01:25:28.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.273+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56367d2dbc30 0x56367d2de020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.273+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d2de710 con 0x56367d2dbc30 2024-09-18T01:25:28.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.273+0000 7fbbe6424640 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56367d2dbc30 0x56367d2de020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.274+0000 7fbbe6424640 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56367d2dbc30 0x56367d2de020 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.274+0000 7fbbe6424640 1 -- 172.21.15.100:0/3935547947 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbbe000f030 con 0x56367d2dbc30 2024-09-18T01:25:28.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.274+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d2daad0 con 0x56367d1dda40 2024-09-18T01:25:28.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.274+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3935547947 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbbd80083e0 con 0x56367d1dda40 2024-09-18T01:25:28.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.274+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56367d2dfb70 0x56367d2e1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.274+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d2e26a0 con 0x56367d2dfb70 2024-09-18T01:25:28.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.275+0000 7fbbe5c23640 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56367d2dfb70 0x56367d2e1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.275+0000 7fbbe5c23640 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56367d2dfb70 0x56367d2e1f60 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.275+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3935547947 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbbd0051070 con 0x56367d2dfb70 2024-09-18T01:25:28.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.275+0000 7fbbea72f800 1 Processor -- start 2024-09-18T01:25:28.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.275+0000 7fbbea72f800 1 -- start start 2024-09-18T01:25:28.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.276+0000 7fbbea72f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2f0410 0x56367d2f0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.276+0000 7fbbea72f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56367d074580 con 0x56367d2f0410 2024-09-18T01:25:28.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.276+0000 7fbbe6424640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2f0410 0x56367d2f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.276+0000 7fbbe6424640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2f0410 0x56367d2f0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37138/0 (socket says 172.21.15.100:37138) 2024-09-18T01:25:28.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.276+0000 7fbbe6424640 1 -- 172.21.15.100:0/3043524203 learned_addr learned my addr 172.21.15.100:0/3043524203 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.276+0000 7fbbe6424640 1 -- 172.21.15.100:0/3043524203 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56367d2f0d70 con 0x56367d2f0410 2024-09-18T01:25:28.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.276+0000 7fbbe6424640 1 --2- 172.21.15.100:0/3043524203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2f0410 0x56367d2f0830 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbbe004a4c0 tx=0x7fbbe0013e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.276+0000 7fbacbfff640 1 -- 172.21.15.100:0/3043524203 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe0042070 con 0x56367d2f0410 2024-09-18T01:25:28.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.276+0000 7fbacbfff640 1 -- 172.21.15.100:0/3043524203 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe001ddb0 con 0x56367d2f0410 2024-09-18T01:25:28.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.276+0000 7fbbea72f800 1 -- 172.21.15.100:0/3043524203 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56367d2f1000 con 0x56367d2f0410 2024-09-18T01:25:28.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.276+0000 7fbacbfff640 1 -- 172.21.15.100:0/3043524203 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe00124f0 con 0x56367d2f0410 2024-09-18T01:25:28.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.276+0000 7fbbea72f800 1 -- 172.21.15.100:0/3043524203 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56367d2f3ce0 con 0x56367d2f0410 2024-09-18T01:25:28.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.277+0000 7fbacbfff640 1 -- 172.21.15.100:0/3043524203 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbbe0030020 con 0x56367d2f0410 2024-09-18T01:25:28.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.277+0000 7fbacbfff640 1 --2- 172.21.15.100:0/3043524203 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbac0036b90 0x7fbac0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.277+0000 7fbacbfff640 1 -- 172.21.15.100:0/3043524203 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fbbe0034c80 con 0x56367d2f0410 2024-09-18T01:25:28.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.277+0000 7fbbe5c23640 1 --2- 172.21.15.100:0/3043524203 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbac0036b90 0x7fbac0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.277+0000 7fbbea72f800 1 Processor -- start 2024-09-18T01:25:28.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.278+0000 7fbbea72f800 1 -- start start 2024-09-18T01:25:28.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.278+0000 7fbbe5c23640 1 --2- 172.21.15.100:0/3043524203 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbac0036b90 0x7fbac0039050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x56367d2d9dd0 tx=0x7fbbd0005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.278+0000 7fbbea72f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2fd040 0x56367d2fd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.278+0000 7fbbea72f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56367d1d8990 con 0x56367d2fd040 2024-09-18T01:25:28.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.278+0000 7fbbe6424640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2fd040 0x56367d2fd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.278+0000 7fbbe6424640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2fd040 0x56367d2fd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37150/0 (socket says 172.21.15.100:37150) 2024-09-18T01:25:28.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.278+0000 7fbbe6424640 1 -- 172.21.15.100:0/1561133559 learned_addr learned my addr 172.21.15.100:0/1561133559 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.278+0000 7fbbe6424640 1 -- 172.21.15.100:0/1561133559 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56367d2fda10 con 0x56367d2fd040 2024-09-18T01:25:28.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.278+0000 7fbbe6424640 1 --2- 172.21.15.100:0/1561133559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2fd040 0x56367d2fd440 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbbe004afd0 tx=0x7fbbe0022450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5406cec2c5c6ea28 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.278+0000 7fbac9ffb640 1 -- 172.21.15.100:0/1561133559 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe001f640 con 0x56367d2fd040 2024-09-18T01:25:28.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.278+0000 7fbac9ffb640 1 -- 172.21.15.100:0/1561133559 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe002a400 con 0x56367d2fd040 2024-09-18T01:25:28.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.278+0000 7fbac9ffb640 1 -- 172.21.15.100:0/1561133559 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe0014e20 con 0x56367d2fd040 2024-09-18T01:25:28.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.279+0000 7fbbea72f800 1 -- 172.21.15.100:0/1561133559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2fd040 msgr2=0x56367d2fd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.279+0000 7fbbea72f800 1 --2- 172.21.15.100:0/1561133559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2fd040 0x56367d2fd440 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbbe004afd0 tx=0x7fbbe0022450 comp rx=0 tx=0).stop 2024-09-18T01:25:28.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.279+0000 7fbbea72f800 1 -- 172.21.15.100:0/1561133559 shutdown_connections 2024-09-18T01:25:28.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.279+0000 7fbbea72f800 1 --2- 172.21.15.100:0/1561133559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2fd040 0x56367d2fd440 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.279+0000 7fbbea72f800 1 -- 172.21.15.100:0/1561133559 >> 172.21.15.100:0/1561133559 conn(0x56367d2f93f0 msgr2=0x56367d2f74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.279+0000 7fbbea72f800 1 -- 172.21.15.100:0/1561133559 shutdown_connections 2024-09-18T01:25:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.279+0000 7fbbea72f800 1 -- 172.21.15.100:0/1561133559 wait complete. 2024-09-18T01:25:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.279+0000 7fbbea72f800 1 Processor -- start 2024-09-18T01:25:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.279+0000 7fbbea72f800 1 -- start start 2024-09-18T01:25:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.279+0000 7fbbea72f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2fd040 0x56367d304310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.279+0000 7fbbea72f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56367d2fdea0 con 0x56367d2fd040 2024-09-18T01:25:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.279+0000 7fbbe6424640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2fd040 0x56367d304310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.279+0000 7fbbe6424640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2fd040 0x56367d304310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37160/0 (socket says 172.21.15.100:37160) 2024-09-18T01:25:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.279+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 learned_addr learned my addr 172.21.15.100:0/3277093064 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.280+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56367d304850 con 0x56367d2fd040 2024-09-18T01:25:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.280+0000 7fbbe6424640 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2fd040 0x56367d304310 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbbe001f830 tx=0x7fbbe001ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.280+0000 7fbab7fff640 1 -- 172.21.15.100:0/3277093064 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe001d6c0 con 0x56367d2fd040 2024-09-18T01:25:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.280+0000 7fbab7fff640 1 -- 172.21.15.100:0/3277093064 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe001f8a0 con 0x56367d2fd040 2024-09-18T01:25:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.280+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56367d304850 con 0x56367d2fd040 2024-09-18T01:25:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.280+0000 7fbab7fff640 1 -- 172.21.15.100:0/3277093064 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe001fb80 con 0x56367d2fd040 2024-09-18T01:25:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.280+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56367d304850 con 0x56367d2fd040 2024-09-18T01:25:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.281+0000 7fbab7fff640 1 -- 172.21.15.100:0/3277093064 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbbe0064070 con 0x56367d2fd040 2024-09-18T01:25:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.281+0000 7fbab7fff640 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbab0036b40 0x7fbab0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.281+0000 7fbab7fff640 1 -- 172.21.15.100:0/3277093064 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fbbe0068ca0 con 0x56367d2fd040 2024-09-18T01:25:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.281+0000 7fbbe5c23640 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbab0036b40 0x7fbab0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.282+0000 7fbbe5c23640 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbab0036b40 0x7fbab0039000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x56367d2e2a80 tx=0x7fbbd0053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.282+0000 7fbbea72f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.282+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56367d30f920 0x56367d311de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.282+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d312530 con 0x56367d30f920 2024-09-18T01:25:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.282+0000 7fbbe6c25640 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56367d30f920 0x56367d311de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.282+0000 7fbbe6c25640 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56367d30f920 0x56367d311de0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.282+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbd80083e0 con 0x56367d30f920 2024-09-18T01:25:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 20 realm 2024-09-18T01:25:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d312940 con 0x56367d30f920 2024-09-18T01:25:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbd80083e0 con 0x56367d30f920 2024-09-18T01:25:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d30f920 2024-09-18T01:25:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbd80083e0 con 0x56367d30f920 2024-09-18T01:25:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d3135b0 con 0x56367d30f920 2024-09-18T01:25:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbbd80083e0 con 0x56367d30f920 2024-09-18T01:25:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56367d313f70 0x56367d316360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d3169b0 con 0x56367d313f70 2024-09-18T01:25:28.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.283+0000 7fbbe6424640 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56367d313f70 0x56367d316360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.284+0000 7fbbe6424640 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56367d313f70 0x56367d316360 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.284+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbbe006d020 con 0x56367d313f70 2024-09-18T01:25:28.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.284+0000 7fbbea72f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:28.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.284+0000 7fbbea72f800 20 searching for the correct realm 2024-09-18T01:25:28.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.284+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56367d318940 0x56367d31ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.284+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d31b4d0 con 0x56367d318940 2024-09-18T01:25:28.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.284+0000 7fbbe5c23640 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56367d318940 0x56367d31ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.284+0000 7fbbe5c23640 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56367d318940 0x56367d31ae00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.285+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.285+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d31b4d0 con 0x56367d313f70 2024-09-18T01:25:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.285+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbe006d020 con 0x56367d313f70 2024-09-18T01:25:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.285+0000 7fbbe6424640 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbbe003db70 0x7fbbe00430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.285+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d31b4d0 con 0x7fbbe003db70 2024-09-18T01:25:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.285+0000 7fbbe6c25640 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbbe003db70 0x7fbbe00430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.285+0000 7fbbe6c25640 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbbe003db70 0x7fbbe00430c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.286+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbbd80083e0 con 0x7fbbe003db70 2024-09-18T01:25:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.286+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d30f920 2024-09-18T01:25:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.286+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd80083e0 con 0x56367d30f920 2024-09-18T01:25:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.286+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d30f920 2024-09-18T01:25:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.286+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.286+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x7fbbe003db70 2024-09-18T01:25:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.286+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.286+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x7fbbe003db70 2024-09-18T01:25:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.286+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.286+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d313f70 2024-09-18T01:25:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.287+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbe006d020 con 0x56367d313f70 2024-09-18T01:25:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.287+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d318940 2024-09-18T01:25:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.287+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.287+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d30f920 2024-09-18T01:25:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.287+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.287+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x7fbbe003db70 2024-09-18T01:25:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.288+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.288+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d30f920 2024-09-18T01:25:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.288+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.288+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d313f70 2024-09-18T01:25:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.288+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbbe006d020 con 0x56367d313f70 2024-09-18T01:25:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.288+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d318940 2024-09-18T01:25:28.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.288+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.288+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d318940 2024-09-18T01:25:28.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.288+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.288+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x7fbbe003db70 2024-09-18T01:25:28.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.289+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.289+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d318940 2024-09-18T01:25:28.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.289+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.289+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d318940 2024-09-18T01:25:28.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.289+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.289+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d30f920 2024-09-18T01:25:28.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.289+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.289+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d30f920 2024-09-18T01:25:28.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.290+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.290+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x7fbbe003db70 2024-09-18T01:25:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.290+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.290+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d318940 2024-09-18T01:25:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.290+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.290+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d313f70 2024-09-18T01:25:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.290+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbe006d020 con 0x56367d313f70 2024-09-18T01:25:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.290+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d30f920 2024-09-18T01:25:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.291+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.291+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x7fbbe003db70 2024-09-18T01:25:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.291+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.291+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d318940 2024-09-18T01:25:28.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.291+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.291+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x7fbbe003db70 2024-09-18T01:25:28.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.291+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.291+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d313f70 2024-09-18T01:25:28.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.292+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbe0084040 con 0x56367d313f70 2024-09-18T01:25:28.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.292+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d318940 2024-09-18T01:25:28.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.292+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.292+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x7fbbe003db70 2024-09-18T01:25:28.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.292+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.292+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d30f920 2024-09-18T01:25:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.292+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.292+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56367d313210 con 0x56367d313f70 2024-09-18T01:25:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbbe0084040 con 0x56367d313f70 2024-09-18T01:25:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbea72f800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbea72f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbea72f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbea72f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbea72f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbea72f800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbea72f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d316d50 con 0x56367d30f920 2024-09-18T01:25:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbea72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbea72f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d317140 con 0x56367d30f920 2024-09-18T01:25:28.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbea72f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbea72f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.293+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d317140 con 0x7fbbe003db70 2024-09-18T01:25:28.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:28.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 20 zone default found 2024-09-18T01:25:28.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 4 Realm: () 2024-09-18T01:25:28.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:28.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:28.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:28.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 20 zonegroup default 2024-09-18T01:25:28.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d317e90 con 0x7fbbe003db70 2024-09-18T01:25:28.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d31d330 con 0x56367d318940 2024-09-18T01:25:28.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d31d7a0 con 0x56367d318940 2024-09-18T01:25:28.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 20 started sync module instance, tier type = 2024-09-18T01:25:28.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:28.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.294+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d31c7d0 con 0x56367d313f70 2024-09-18T01:25:28.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.295+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbe0084040 con 0x56367d313f70 2024-09-18T01:25:28.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.295+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94792028638144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d31c430 con 0x56367d313f70 2024-09-18T01:25:28.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.295+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d31e6d0 con 0x56367d30f920 2024-09-18T01:25:28.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.296+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94792028638144] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbe0084040 con 0x56367d313f70 2024-09-18T01:25:28.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.296+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.296+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94792028643872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d31eaf0 con 0x56367d30f920 2024-09-18T01:25:28.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.297+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d31f4b0 con 0x56367d318940 2024-09-18T01:25:28.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.298+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.298+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94792028647424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d31fd50 con 0x56367d318940 2024-09-18T01:25:28.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.298+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d320810 con 0x56367d313f70 2024-09-18T01:25:28.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.298+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94792028643872] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.298+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94792028647424] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.299+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbe0084040 con 0x56367d313f70 2024-09-18T01:25:28.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.299+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94792028649632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d31e640 con 0x56367d313f70 2024-09-18T01:25:28.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.299+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d3210e0 con 0x56367d30f920 2024-09-18T01:25:28.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.300+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94792028649632] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbe0084040 con 0x56367d313f70 2024-09-18T01:25:28.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.300+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.300+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94792028652256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d3210e0 con 0x56367d30f920 2024-09-18T01:25:28.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.300+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d321af0 con 0x7fbbe003db70 2024-09-18T01:25:28.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.301+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.301+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94792028657216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d321a60 con 0x7fbbe003db70 2024-09-18T01:25:28.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.301+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d322a50 con 0x7fbbe003db70 2024-09-18T01:25:28.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.301+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94792028652256] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.302+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.302+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94792028654640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d322a10 con 0x7fbbe003db70 2024-09-18T01:25:28.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.302+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d323470 con 0x7fbbe003db70 2024-09-18T01:25:28.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.302+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94792028657216] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.303+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.303+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94792028654640] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.303+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94792028663632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d323470 con 0x7fbbe003db70 2024-09-18T01:25:28.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.303+0000 7fbbea72f800 20 add_watcher() i=0 2024-09-18T01:25:28.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.303+0000 7fbbea72f800 20 add_watcher() i=1 2024-09-18T01:25:28.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.303+0000 7fbbea72f800 20 add_watcher() i=2 2024-09-18T01:25:28.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.303+0000 7fbbea72f800 20 add_watcher() i=3 2024-09-18T01:25:28.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.303+0000 7fbbea72f800 20 add_watcher() i=4 2024-09-18T01:25:28.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.303+0000 7fbbea72f800 20 add_watcher() i=5 2024-09-18T01:25:28.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.303+0000 7fbbea72f800 20 add_watcher() i=6 2024-09-18T01:25:28.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.303+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94792028663632] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.303+0000 7fbbea72f800 20 add_watcher() i=7 2024-09-18T01:25:28.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.303+0000 7fbbea72f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:28.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.303+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d3264a0 con 0x56367d30f920 2024-09-18T01:25:28.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.304+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.304+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94792028659344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d323920 con 0x56367d30f920 2024-09-18T01:25:28.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.305+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94792028659344] v33'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.305+0000 7fba9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.305+0000 7fbbea72f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:28.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.305+0000 7fbbea72f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:28.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.305+0000 7fbbea72f800 5 note: GC not initialized 2024-09-18T01:25:28.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.306+0000 7fba177fe640 20 reqs_thread_entry: start 2024-09-18T01:25:28.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.306+0000 7fbbea72f800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:28.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.306+0000 7fbbea72f800 20 Filter name: none 2024-09-18T01:25:28.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.306+0000 7fba157fa640 20 reqs_thread_entry: start 2024-09-18T01:25:28.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.306+0000 7fbbea72f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:28.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.306+0000 7fbbea72f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.306+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d359790 con 0x56367d30f920 2024-09-18T01:25:28.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.306+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.306+0000 7fbbea72f800 20 rados_obj.operate() r=0 bl.length=502 2024-09-18T01:25:28.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.306+0000 7fbbea72f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:28.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.306+0000 7fbbea72f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.306+0000 7fbbea72f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:28.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.306+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d35fef0 con 0x56367d30f920 2024-09-18T01:25:28.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.307+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v33'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.307+0000 7fbbea72f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:28.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.307+0000 7fbbea72f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.307+0000 7fbbea72f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:28.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.307+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94792028911792 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d35b530 con 0x56367d30f920 2024-09-18T01:25:28.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.308+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== watch-notify(notify (1) cookie 94792028652256 notify 141733920772 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fbbd8010040 con 0x56367d30f920 2024-09-18T01:25:28.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.308+0000 7fbac9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94792028652256 notifier 4363 bl.length()=567 2024-09-18T01:25:28.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.308+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(64 notify.4 [notify cookie 94792028911792 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.308+0000 7fbac9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:28.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.308+0000 7fbac9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.308+0000 7fbac9ffb640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fbaac003ea0 con 0x56367d30f920 2024-09-18T01:25:28.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.308+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.308+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== watch-notify(notify_complete (2) cookie 94792028911792 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbbd803c480 con 0x56367d30f920 2024-09-18T01:25:28.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.308+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d35f8b0 con 0x7fbbe003db70 2024-09-18T01:25:28.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.309+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v33'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.309+0000 7fbbea72f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:25:28.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.309+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94792028911792 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56367d35b080 con 0x56367d318940 2024-09-18T01:25:28.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.310+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== watch-notify(notify (1) cookie 94792028647424 notify 141733920769 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56367d0a0e00 con 0x56367d318940 2024-09-18T01:25:28.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.310+0000 7fbac9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94792028647424 notifier 4363 bl.length()=170 2024-09-18T01:25:28.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.310+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 notify.2 [notify cookie 94792028911792 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.310+0000 7fbac9ffb640 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fbaac003ea0 con 0x56367d318940 2024-09-18T01:25:28.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.310+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== watch-notify(notify_complete (2) cookie 94792028911792 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbbd00807e0 con 0x56367d318940 2024-09-18T01:25:28.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.310+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.322 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:28.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.311+0000 7fba9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.311+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94792028659344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d357490 con 0x56367d30f920 2024-09-18T01:25:28.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.312+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94792028659344] v33'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.312+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94792028638144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d357490 con 0x56367d313f70 2024-09-18T01:25:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.315+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94792028638144] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbe0084040 con 0x56367d313f70 2024-09-18T01:25:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.315+0000 7fbbea72f800 20 remove_watcher() i=0 2024-09-18T01:25:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.315+0000 7fbbea72f800 2 removed watcher, disabling cache 2024-09-18T01:25:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.315+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94792028643872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d357490 con 0x56367d30f920 2024-09-18T01:25:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.316+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94792028643872] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.316+0000 7fbbea72f800 20 remove_watcher() i=1 2024-09-18T01:25:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.316+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94792028647424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d357490 con 0x56367d318940 2024-09-18T01:25:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.317+0000 7fbbe5c23640 1 -- 172.21.15.100:0/3277093064 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94792028647424] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd007c040 con 0x56367d318940 2024-09-18T01:25:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.317+0000 7fbbea72f800 20 remove_watcher() i=2 2024-09-18T01:25:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.317+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94792028649632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d357490 con 0x56367d313f70 2024-09-18T01:25:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.318+0000 7fbbe6424640 1 -- 172.21.15.100:0/3277093064 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94792028649632] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbe0084040 con 0x56367d313f70 2024-09-18T01:25:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.318+0000 7fbbea72f800 20 remove_watcher() i=3 2024-09-18T01:25:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.318+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94792028652256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d357490 con 0x56367d30f920 2024-09-18T01:25:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.319+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94792028652256] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x56367d30f920 2024-09-18T01:25:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.319+0000 7fbbea72f800 20 remove_watcher() i=4 2024-09-18T01:25:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.319+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94792028657216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d357490 con 0x7fbbe003db70 2024-09-18T01:25:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.321+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94792028657216] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.321+0000 7fbbea72f800 20 remove_watcher() i=5 2024-09-18T01:25:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.321+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94792028654640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d357490 con 0x7fbbe003db70 2024-09-18T01:25:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.321+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94792028654640] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.322+0000 7fbbea72f800 20 remove_watcher() i=6 2024-09-18T01:25:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.322+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94792028663632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56367d357490 con 0x7fbbe003db70 2024-09-18T01:25:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.322+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94792028663632] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd8026040 con 0x7fbbe003db70 2024-09-18T01:25:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.322+0000 7fbbea72f800 20 remove_watcher() i=7 2024-09-18T01:25:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbbe003db70 msgr2=0x7fbbe00430c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbbe003db70 0x7fbbe00430c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56367d30f920 msgr2=0x56367d311de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56367d30f920 0x56367d311de0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56367d313f70 msgr2=0x56367d316360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56367d313f70 0x56367d316360 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56367d318940 msgr2=0x56367d31ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56367d318940 0x56367d31ae00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbab0036b40 msgr2=0x7fbab0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbab0036b40 0x7fbab0039000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x56367d2e2a80 tx=0x7fbbd0053000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2fd040 msgr2=0x56367d304310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3277093064 reap_dead start 2024-09-18T01:25:28.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2fd040 0x56367d304310 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbbe001f830 tx=0x7fbbe001ff20 comp rx=0 tx=0).stop 2024-09-18T01:25:28.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 shutdown_connections 2024-09-18T01:25:28.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3277093064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2fd040 0x56367d304310 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 >> 172.21.15.100:0/3277093064 conn(0x56367d2f93f0 msgr2=0x56367d2f74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 shutdown_connections 2024-09-18T01:25:28.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3277093064 wait complete. 2024-09-18T01:25:28.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3043524203 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbac0036b90 msgr2=0x7fbac0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3043524203 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbac0036b90 0x7fbac0039050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x56367d2d9dd0 tx=0x7fbbd0005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:28.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3043524203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2f0410 msgr2=0x56367d2f0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3043524203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2f0410 0x56367d2f0830 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbbe004a4c0 tx=0x7fbbe0013e10 comp rx=0 tx=0).stop 2024-09-18T01:25:28.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3043524203 shutdown_connections 2024-09-18T01:25:28.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3043524203 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbac0036b90 0x7fbac0039050 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3043524203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d2f0410 0x56367d2f0830 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3043524203 >> 172.21.15.100:0/3043524203 conn(0x56367d2e53a0 msgr2=0x56367d2e7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3043524203 shutdown_connections 2024-09-18T01:25:28.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.323+0000 7fbbea72f800 1 -- 172.21.15.100:0/3043524203 wait complete. 2024-09-18T01:25:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56367d2dfb70 msgr2=0x56367d2e1f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56367d2dfb70 0x56367d2e1f60 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56367d1dda40 msgr2=0x56367d2d9330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56367d1dda40 0x56367d2d9330 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56367d2dbc30 msgr2=0x56367d2de020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56367d2dbc30 0x56367d2de020 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbacc036b40 msgr2=0x7fbacc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fbacc036b40 0x7fbacc039000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0057000 tx=0x7fbbd0052000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1d7960 msgr2=0x56367d2d22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbea72f800 1 --2- 172.21.15.100:0/3935547947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56367d1d7960 0x56367d2d22c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x56367d1d9a20 tx=0x7fbbe0001250 comp rx=0 tx=0).stop 2024-09-18T01:25:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbe6c25640 1 -- 172.21.15.100:0/3935547947 reap_dead start 2024-09-18T01:25:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 shutdown_connections 2024-09-18T01:25:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 >> 172.21.15.100:0/3935547947 conn(0x56367d1d3550 msgr2=0x56367d2c3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 shutdown_connections 2024-09-18T01:25:28.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.324+0000 7fbbea72f800 1 -- 172.21.15.100:0/3935547947 wait complete. 2024-09-18T01:25:28.333 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:28.334 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-18T01:25:28.334 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-18T01:25:28.334 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-18T01:25:28.380 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:28.380 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:28.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.379+0000 7f6e70213800 1 Processor -- start 2024-09-18T01:25:28.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.379+0000 7f6e70213800 1 -- start start 2024-09-18T01:25:28.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.380+0000 7f6e70213800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55bd4923f4e0 0x55bd4923f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.380+0000 7f6e70213800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bd490ffb30 con 0x55bd4923fe20 2024-09-18T01:25:28.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.380+0000 7f6e70213800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55bd490e1360 con 0x55bd4923f4e0 2024-09-18T01:25:28.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.380+0000 7f6e6b867640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55bd4923f4e0 0x55bd4923f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.380+0000 7f6e6b066640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55bd4923fe20 0x55bd492449a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37156/0 (socket says 172.21.15.100:37156) 2024-09-18T01:25:28.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.380+0000 7f6e6b066640 1 -- 172.21.15.100:0/1583784381 learned_addr learned my addr 172.21.15.100:0/1583784381 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:28.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.380+0000 7f6e6b867640 1 -- 172.21.15.100:0/1583784381 >> v1:172.21.15.92:6789/0 conn(0x55bd4923fe20 legacy=0x55bd492449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.380+0000 7f6e6b867640 1 -- 172.21.15.100:0/1583784381 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd49107e00 con 0x55bd4923f4e0 2024-09-18T01:25:28.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.380+0000 7f6e6a865640 1 -- 172.21.15.100:0/1583784381 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3450163084 0 0) 0x55bd490ffb30 con 0x55bd4923fe20 2024-09-18T01:25:28.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.382+0000 7f6e6b867640 1 --2- 172.21.15.100:0/1583784381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 0x55bd4923f8e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c005fd0 tx=0x7f6e5c045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ac1b3455ac128f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.382+0000 7f6e6a865640 1 -- 172.21.15.100:0/1583784381 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5c058530 con 0x55bd4923f4e0 2024-09-18T01:25:28.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.382+0000 7f6e6a865640 1 -- 172.21.15.100:0/1583784381 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5c0586d0 con 0x55bd4923f4e0 2024-09-18T01:25:28.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.382+0000 7f6e6a865640 1 -- 172.21.15.100:0/1583784381 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5c0589d0 con 0x55bd4923f4e0 2024-09-18T01:25:28.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.383+0000 7f6e70213800 1 -- 172.21.15.100:0/1583784381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 msgr2=0x55bd4923f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.383+0000 7f6e70213800 1 --2- 172.21.15.100:0/1583784381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 0x55bd4923f8e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c005fd0 tx=0x7f6e5c045c30 comp rx=0 tx=0).stop 2024-09-18T01:25:28.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.383+0000 7f6e70213800 1 -- 172.21.15.100:0/1583784381 shutdown_connections 2024-09-18T01:25:28.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.383+0000 7f6e70213800 1 --2- 172.21.15.100:0/1583784381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 0x55bd4923f8e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.383+0000 7f6e70213800 1 -- 172.21.15.100:0/1583784381 >> 172.21.15.100:0/1583784381 conn(0x55bd4923add0 msgr2=0x55bd4923d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.383+0000 7f6e70213800 1 -- 172.21.15.100:0/1583784381 shutdown_connections 2024-09-18T01:25:28.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.383+0000 7f6e70213800 1 -- 172.21.15.100:0/1583784381 wait complete. 2024-09-18T01:25:28.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.396+0000 7f6e70213800 1 Processor -- start 2024-09-18T01:25:28.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.396+0000 7f6e70213800 1 -- start start 2024-09-18T01:25:28.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.397+0000 7f6e70213800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 0x55bd4932e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.397+0000 7f6e70213800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bd4918c360 con 0x55bd4923f4e0 2024-09-18T01:25:28.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.397+0000 7f6e6b867640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 0x55bd4932e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.397+0000 7f6e6b867640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 0x55bd4932e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37182/0 (socket says 172.21.15.100:37182) 2024-09-18T01:25:28.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.397+0000 7f6e6b867640 1 -- 172.21.15.100:0/2060154795 learned_addr learned my addr 172.21.15.100:0/2060154795 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.397+0000 7f6e6b867640 1 -- 172.21.15.100:0/2060154795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd490d9bc0 con 0x55bd4923f4e0 2024-09-18T01:25:28.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.397+0000 7f6e6b867640 1 --2- 172.21.15.100:0/2060154795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 0x55bd4932e600 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00a3f0 tx=0x7f6e5c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7457766c63be9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.398+0000 7f6d59e0b640 1 -- 172.21.15.100:0/2060154795 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5c065070 con 0x55bd4923f4e0 2024-09-18T01:25:28.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.398+0000 7f6d59e0b640 1 -- 172.21.15.100:0/2060154795 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5c0589b0 con 0x55bd4923f4e0 2024-09-18T01:25:28.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.398+0000 7f6d59e0b640 1 -- 172.21.15.100:0/2060154795 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5c058c90 con 0x55bd4923f4e0 2024-09-18T01:25:28.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.398+0000 7f6e70213800 1 -- 172.21.15.100:0/2060154795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 msgr2=0x55bd4932e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.398+0000 7f6e70213800 1 --2- 172.21.15.100:0/2060154795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 0x55bd4932e600 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00a3f0 tx=0x7f6e5c051000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.398+0000 7f6e70213800 1 -- 172.21.15.100:0/2060154795 shutdown_connections 2024-09-18T01:25:28.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.398+0000 7f6e70213800 1 --2- 172.21.15.100:0/2060154795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 0x55bd4932e600 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.398+0000 7f6e70213800 1 -- 172.21.15.100:0/2060154795 >> 172.21.15.100:0/2060154795 conn(0x55bd4923add0 msgr2=0x55bd49329fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.399+0000 7f6e70213800 1 -- 172.21.15.100:0/2060154795 shutdown_connections 2024-09-18T01:25:28.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.399+0000 7f6e70213800 1 -- 172.21.15.100:0/2060154795 wait complete. 2024-09-18T01:25:28.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.399+0000 7f6e70213800 1 Processor -- start 2024-09-18T01:25:28.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.399+0000 7f6e70213800 1 -- start start 2024-09-18T01:25:28.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.399+0000 7f6e70213800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 0x55bd49334cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.399+0000 7f6e70213800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bd49246500 con 0x55bd4923f4e0 2024-09-18T01:25:28.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.399+0000 7f6e6b867640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 0x55bd49334cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.399+0000 7f6e6b867640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 0x55bd49334cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37196/0 (socket says 172.21.15.100:37196) 2024-09-18T01:25:28.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.399+0000 7f6e6b867640 1 -- 172.21.15.100:0/2178801945 learned_addr learned my addr 172.21.15.100:0/2178801945 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.399+0000 7f6e6b867640 1 -- 172.21.15.100:0/2178801945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd490edfe0 con 0x55bd4923f4e0 2024-09-18T01:25:28.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.400+0000 7f6e6b867640 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 0x55bd49334cc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00a3f0 tx=0x7f6e5c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.400+0000 7f6d53fff640 1 -- 172.21.15.100:0/2178801945 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5c077070 con 0x55bd4923f4e0 2024-09-18T01:25:28.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.400+0000 7f6d53fff640 1 -- 172.21.15.100:0/2178801945 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5c061810 con 0x55bd4923f4e0 2024-09-18T01:25:28.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.400+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd49335200 con 0x55bd4923f4e0 2024-09-18T01:25:28.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.400+0000 7f6d53fff640 1 -- 172.21.15.100:0/2178801945 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5c065050 con 0x55bd4923f4e0 2024-09-18T01:25:28.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.400+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd49335720 con 0x55bd4923f4e0 2024-09-18T01:25:28.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.401+0000 7f6d53fff640 1 -- 172.21.15.100:0/2178801945 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6e5c07a070 con 0x55bd4923f4e0 2024-09-18T01:25:28.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.401+0000 7f6d53fff640 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d54036b40 0x7f6d54039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.401+0000 7f6d53fff640 1 -- 172.21.15.100:0/2178801945 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6e5c092920 con 0x55bd4923f4e0 2024-09-18T01:25:28.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.401+0000 7f6e6b066640 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d54036b40 0x7f6d54039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.401+0000 7f6e70213800 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55bd4923fe20 0x55bd4933bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.401+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd4933c300 con 0x55bd4923fe20 2024-09-18T01:25:28.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.401+0000 7f6e6c068640 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55bd4923fe20 0x55bd4933bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.402+0000 7f6e6c068640 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55bd4923fe20 0x55bd4933bd30 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.402+0000 7f6e6b066640 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d54036b40 0x7f6d54039000 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6e60000c00 tx=0x7f6e600013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.402+0000 7f6e6c068640 1 -- 172.21.15.100:0/2178801945 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e640083e0 con 0x55bd4923fe20 2024-09-18T01:25:28.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.402+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd493392c0 con 0x55bd4923fe20 2024-09-18T01:25:28.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.402+0000 7f6e6c068640 1 -- 172.21.15.100:0/2178801945 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e640083e0 con 0x55bd4923fe20 2024-09-18T01:25:28.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.402+0000 7f6e70213800 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55bd4933e660 0x55bd49340a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.402+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd493410f0 con 0x55bd4933e660 2024-09-18T01:25:28.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.402+0000 7f6e6b867640 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55bd4933e660 0x55bd49340a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.403+0000 7f6e6b867640 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55bd4933e660 0x55bd49340a50 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.403+0000 7f6e6b867640 1 -- 172.21.15.100:0/2178801945 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e5c079030 con 0x55bd4933e660 2024-09-18T01:25:28.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.403+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd4933d500 con 0x55bd4923fe20 2024-09-18T01:25:28.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.403+0000 7f6e6c068640 1 -- 172.21.15.100:0/2178801945 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e640083e0 con 0x55bd4923fe20 2024-09-18T01:25:28.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.403+0000 7f6e70213800 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55bd49342550 0x55bd49344940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.403+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd49345080 con 0x55bd49342550 2024-09-18T01:25:28.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.403+0000 7f6e6b066640 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55bd49342550 0x55bd49344940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.404+0000 7f6e6b066640 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55bd49342550 0x55bd49344940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.404+0000 7f6e6b066640 1 -- 172.21.15.100:0/2178801945 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e6000f670 con 0x55bd49342550 2024-09-18T01:25:28.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.404+0000 7f6e70213800 1 Processor -- start 2024-09-18T01:25:28.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.404+0000 7f6e70213800 1 -- start start 2024-09-18T01:25:28.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.405+0000 7f6e70213800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49357210 0x55bd49357630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.405+0000 7f6e70213800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bd490db580 con 0x55bd49357210 2024-09-18T01:25:28.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.405+0000 7f6e6b867640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49357210 0x55bd49357630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.405+0000 7f6e6b867640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49357210 0x55bd49357630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37204/0 (socket says 172.21.15.100:37204) 2024-09-18T01:25:28.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.405+0000 7f6e6b867640 1 -- 172.21.15.100:0/2875977793 learned_addr learned my addr 172.21.15.100:0/2875977793 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.405+0000 7f6e6b867640 1 -- 172.21.15.100:0/2875977793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd49357b70 con 0x55bd49357210 2024-09-18T01:25:28.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.405+0000 7f6e6b867640 1 --2- 172.21.15.100:0/2875977793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49357210 0x55bd49357630 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c05a010 tx=0x7f6e5c060d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.405+0000 7f6d517fa640 1 -- 172.21.15.100:0/2875977793 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5c061e30 con 0x55bd49357210 2024-09-18T01:25:28.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.405+0000 7f6d517fa640 1 -- 172.21.15.100:0/2875977793 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5c051a90 con 0x55bd49357210 2024-09-18T01:25:28.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.405+0000 7f6d517fa640 1 -- 172.21.15.100:0/2875977793 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5c051d70 con 0x55bd49357210 2024-09-18T01:25:28.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.405+0000 7f6e70213800 1 -- 172.21.15.100:0/2875977793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd49357da0 con 0x55bd49357210 2024-09-18T01:25:28.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.405+0000 7f6e70213800 1 -- 172.21.15.100:0/2875977793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd4935aa80 con 0x55bd49357210 2024-09-18T01:25:28.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.406+0000 7f6d517fa640 1 -- 172.21.15.100:0/2875977793 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6e5c0529a0 con 0x55bd49357210 2024-09-18T01:25:28.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.406+0000 7f6d517fa640 1 --2- 172.21.15.100:0/2875977793 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d44036b90 0x7f6d44039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.406+0000 7f6d517fa640 1 -- 172.21.15.100:0/2875977793 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6e5c09cc50 con 0x55bd49357210 2024-09-18T01:25:28.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.406+0000 7f6e6b066640 1 --2- 172.21.15.100:0/2875977793 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d44036b90 0x7f6d44039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.407+0000 7f6e70213800 1 Processor -- start 2024-09-18T01:25:28.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.407+0000 7f6e70213800 1 -- start start 2024-09-18T01:25:28.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.407+0000 7f6e6b066640 1 --2- 172.21.15.100:0/2875977793 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d44036b90 0x7f6d44039050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55bd493414c0 tx=0x7f6e60006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.407+0000 7f6e70213800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49363d20 0x55bd49364120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.407+0000 7f6e70213800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bd4932ecc0 con 0x55bd49363d20 2024-09-18T01:25:28.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.407+0000 7f6e6b867640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49363d20 0x55bd49364120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.407+0000 7f6e6b867640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49363d20 0x55bd49364120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37210/0 (socket says 172.21.15.100:37210) 2024-09-18T01:25:28.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.407+0000 7f6e6b867640 1 -- 172.21.15.100:0/3519102099 learned_addr learned my addr 172.21.15.100:0/3519102099 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.407+0000 7f6e6b867640 1 -- 172.21.15.100:0/3519102099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd493646f0 con 0x55bd49363d20 2024-09-18T01:25:28.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.407+0000 7f6e6b867640 1 --2- 172.21.15.100:0/3519102099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49363d20 0x55bd49364120 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c087bc0 tx=0x7f6e5c087a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f113e3685d21ff21 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.408+0000 7f6d4affd640 1 -- 172.21.15.100:0/3519102099 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5c08f380 con 0x55bd49363d20 2024-09-18T01:25:28.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.408+0000 7f6d4affd640 1 -- 172.21.15.100:0/3519102099 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5c051030 con 0x55bd49363d20 2024-09-18T01:25:28.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.408+0000 7f6d4affd640 1 -- 172.21.15.100:0/3519102099 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5c08f520 con 0x55bd49363d20 2024-09-18T01:25:28.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.408+0000 7f6e70213800 1 -- 172.21.15.100:0/3519102099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49363d20 msgr2=0x55bd49364120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.408+0000 7f6e70213800 1 --2- 172.21.15.100:0/3519102099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49363d20 0x55bd49364120 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c087bc0 tx=0x7f6e5c087a50 comp rx=0 tx=0).stop 2024-09-18T01:25:28.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.408+0000 7f6e70213800 1 -- 172.21.15.100:0/3519102099 shutdown_connections 2024-09-18T01:25:28.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.408+0000 7f6e70213800 1 --2- 172.21.15.100:0/3519102099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49363d20 0x55bd49364120 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.408+0000 7f6e70213800 1 -- 172.21.15.100:0/3519102099 >> 172.21.15.100:0/3519102099 conn(0x55bd49360080 msgr2=0x55bd4935e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.408+0000 7f6e70213800 1 -- 172.21.15.100:0/3519102099 shutdown_connections 2024-09-18T01:25:28.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.408+0000 7f6e70213800 1 -- 172.21.15.100:0/3519102099 wait complete. 2024-09-18T01:25:28.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.408+0000 7f6e70213800 1 Processor -- start 2024-09-18T01:25:28.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.409+0000 7f6e70213800 1 -- start start 2024-09-18T01:25:28.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.409+0000 7f6e70213800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49363d20 0x55bd4936ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.409+0000 7f6e70213800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bd49364af0 con 0x55bd49363d20 2024-09-18T01:25:28.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.409+0000 7f6e6b867640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49363d20 0x55bd4936ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.409+0000 7f6e6b867640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49363d20 0x55bd4936ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37216/0 (socket says 172.21.15.100:37216) 2024-09-18T01:25:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.409+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 learned_addr learned my addr 172.21.15.100:0/3857008403 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.409+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd4936b350 con 0x55bd49363d20 2024-09-18T01:25:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.409+0000 7f6e6b867640 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49363d20 0x55bd4936ae10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c087bc0 tx=0x7f6e5c05bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.409+0000 7f6d497fa640 1 -- 172.21.15.100:0/3857008403 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5c0511e0 con 0x55bd49363d20 2024-09-18T01:25:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.409+0000 7f6d497fa640 1 -- 172.21.15.100:0/3857008403 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5c0603a0 con 0x55bd49363d20 2024-09-18T01:25:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.409+0000 7f6d497fa640 1 -- 172.21.15.100:0/3857008403 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5c052dc0 con 0x55bd49363d20 2024-09-18T01:25:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.409+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd4936b350 con 0x55bd49363d20 2024-09-18T01:25:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.410+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd4936b350 con 0x55bd49363d20 2024-09-18T01:25:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.410+0000 7f6d497fa640 1 -- 172.21.15.100:0/3857008403 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6e5c072620 con 0x55bd49363d20 2024-09-18T01:25:28.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.410+0000 7f6d497fa640 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d34036b90 0x7f6d34039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.410+0000 7f6d497fa640 1 -- 172.21.15.100:0/3857008403 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6e5c0bdcb0 con 0x55bd49363d20 2024-09-18T01:25:28.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.411+0000 7f6e6b066640 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d34036b90 0x7f6d34039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.411+0000 7f6e6b066640 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d34036b90 0x7f6d34039050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000ffd0 tx=0x7f6e60023040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.411+0000 7f6e70213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.411+0000 7f6e70213800 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55bd49376440 0x55bd49378900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.411+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379050 con 0x55bd49376440 2024-09-18T01:25:28.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.411+0000 7f6e6c068640 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55bd49376440 0x55bd49378900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.411+0000 7f6e6c068640 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55bd49376440 0x55bd49378900 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e640083e0 con 0x55bd49376440 2024-09-18T01:25:28.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 20 realm 2024-09-18T01:25:28.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379460 con 0x55bd49376440 2024-09-18T01:25:28.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e640083e0 con 0x55bd49376440 2024-09-18T01:25:28.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:28.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd49376440 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e640083e0 con 0x55bd49376440 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd4937a0d0 con 0x55bd49376440 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e640083e0 con 0x55bd49376440 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55bd4937aa90 0x55bd4937ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.412+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd4937d490 con 0x55bd4937aa90 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.413+0000 7f6e6b867640 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55bd4937aa90 0x55bd4937ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.413+0000 7f6e6b867640 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55bd4937aa90 0x55bd4937ce80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.413+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.413+0000 7f6e70213800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.413+0000 7f6e70213800 20 searching for the correct realm 2024-09-18T01:25:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.413+0000 7f6e70213800 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55bd4937f420 0x55bd493818e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.413+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49381fb0 con 0x55bd4937f420 2024-09-18T01:25:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.413+0000 7f6e6b066640 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55bd4937f420 0x55bd493818e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.413+0000 7f6e6b066640 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55bd4937f420 0x55bd493818e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.414+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60037040 con 0x55bd4937f420 2024-09-18T01:25:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.414+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49381fb0 con 0x55bd4937aa90 2024-09-18T01:25:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.414+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.414+0000 7f6e6b867640 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f6e5c0b3040 0x7f6e5c066710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.414+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49381fb0 con 0x7f6e5c0b3040 2024-09-18T01:25:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.414+0000 7f6e6c068640 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f6e5c0b3040 0x7f6e5c066710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.414+0000 7f6e6c068640 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f6e5c0b3040 0x7f6e5c066710 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.415+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6e640083e0 con 0x7f6e5c0b3040 2024-09-18T01:25:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.415+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd49376440 2024-09-18T01:25:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.415+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e640083e0 con 0x55bd49376440 2024-09-18T01:25:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.415+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd49376440 2024-09-18T01:25:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.415+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.415+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x7f6e5c0b3040 2024-09-18T01:25:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.415+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.415+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x7f6e5c0b3040 2024-09-18T01:25:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.416+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.416+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd4937aa90 2024-09-18T01:25:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.416+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.416+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd4937f420 2024-09-18T01:25:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.416+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60037040 con 0x55bd4937f420 2024-09-18T01:25:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.416+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd49376440 2024-09-18T01:25:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.416+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.416+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x7f6e5c0b3040 2024-09-18T01:25:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.416+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.416+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd49376440 2024-09-18T01:25:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.417+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.417+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd4937aa90 2024-09-18T01:25:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.417+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.417+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd4937f420 2024-09-18T01:25:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.417+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60037040 con 0x55bd4937f420 2024-09-18T01:25:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.417+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd4937f420 2024-09-18T01:25:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.417+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60037040 con 0x55bd4937f420 2024-09-18T01:25:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.417+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x7f6e5c0b3040 2024-09-18T01:25:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.418+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.418+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd4937f420 2024-09-18T01:25:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.418+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60037040 con 0x55bd4937f420 2024-09-18T01:25:28.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.418+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd4937f420 2024-09-18T01:25:28.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.418+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60037040 con 0x55bd4937f420 2024-09-18T01:25:28.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.418+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd49376440 2024-09-18T01:25:28.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.418+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.418+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd49376440 2024-09-18T01:25:28.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.418+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.419+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x7f6e5c0b3040 2024-09-18T01:25:28.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.419+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.419+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd4937f420 2024-09-18T01:25:28.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.419+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60037040 con 0x55bd4937f420 2024-09-18T01:25:28.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.419+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd4937aa90 2024-09-18T01:25:28.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.419+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.419+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd49376440 2024-09-18T01:25:28.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.420+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.420+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x7f6e5c0b3040 2024-09-18T01:25:28.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.420+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.420+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd4937f420 2024-09-18T01:25:28.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.420+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60037040 con 0x55bd4937f420 2024-09-18T01:25:28.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.420+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x7f6e5c0b3040 2024-09-18T01:25:28.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.420+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.420+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd4937aa90 2024-09-18T01:25:28.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.421+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.421+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd4937f420 2024-09-18T01:25:28.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.421+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60037040 con 0x55bd4937f420 2024-09-18T01:25:28.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.421+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x7f6e5c0b3040 2024-09-18T01:25:28.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.421+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.421+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd49376440 2024-09-18T01:25:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.421+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.421+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd49379d30 con 0x55bd4937aa90 2024-09-18T01:25:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd4937dd50 con 0x55bd49376440 2024-09-18T01:25:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd4937e140 con 0x55bd49376440 2024-09-18T01:25:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd4937e140 con 0x7f6e5c0b3040 2024-09-18T01:25:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 zone default found 2024-09-18T01:25:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 4 Realm: () 2024-09-18T01:25:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 zonegroup default 2024-09-18T01:25:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.422+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd4937d980 con 0x7f6e5c0b3040 2024-09-18T01:25:28.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.423+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.423+0000 7f6e70213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.423+0000 7f6e70213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.423+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd4937d9b0 con 0x55bd4937f420 2024-09-18T01:25:28.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.423+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e60037040 con 0x55bd4937f420 2024-09-18T01:25:28.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.423+0000 7f6e70213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.423+0000 7f6e70213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.423+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd49383f60 con 0x55bd4937f420 2024-09-18T01:25:28.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.423+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e60037040 con 0x55bd4937f420 2024-09-18T01:25:28.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.423+0000 7f6e70213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.423+0000 7f6e70213800 20 started sync module instance, tier type = 2024-09-18T01:25:28.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.423+0000 7f6e70213800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:28.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.423+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd493832b0 con 0x55bd4937aa90 2024-09-18T01:25:28.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.424+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.424+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94271465600672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd49382f10 con 0x55bd4937aa90 2024-09-18T01:25:28.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.424+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd49384e90 con 0x55bd49376440 2024-09-18T01:25:28.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.425+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94271465600672] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.425+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.426+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94271465605600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd493852b0 con 0x55bd49376440 2024-09-18T01:25:28.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.426+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd49385c70 con 0x55bd4937f420 2024-09-18T01:25:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.428+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60037040 con 0x55bd4937f420 2024-09-18T01:25:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.428+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94271465605600] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.428+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94271465609152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd49386510 con 0x55bd4937f420 2024-09-18T01:25:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.428+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd49384e20 con 0x55bd4937aa90 2024-09-18T01:25:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.430+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94271465609152] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60037040 con 0x55bd4937f420 2024-09-18T01:25:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.430+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.430+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94271465614080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd493873d0 con 0x55bd4937aa90 2024-09-18T01:25:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.430+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd49387c60 con 0x55bd49376440 2024-09-18T01:25:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.431+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.431+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94271465617264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd49388500 con 0x55bd49376440 2024-09-18T01:25:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.431+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd49388f80 con 0x7f6e5c0b3040 2024-09-18T01:25:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.432+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94271465614080] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.432+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94271465617264] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.433+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.433+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94271465622128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd49388000 con 0x7f6e5c0b3040 2024-09-18T01:25:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.433+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd49389850 con 0x7f6e5c0b3040 2024-09-18T01:25:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.433+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94271465622128] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.433+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.434+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94271465619264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd493893a0 con 0x7f6e5c0b3040 2024-09-18T01:25:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.434+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd49389de0 con 0x7f6e5c0b3040 2024-09-18T01:25:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.434+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.434+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94271465625776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd4938a250 con 0x7f6e5c0b3040 2024-09-18T01:25:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.434+0000 7f6e70213800 20 add_watcher() i=0 2024-09-18T01:25:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.434+0000 7f6e70213800 20 add_watcher() i=1 2024-09-18T01:25:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.434+0000 7f6e70213800 20 add_watcher() i=2 2024-09-18T01:25:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.434+0000 7f6e70213800 20 add_watcher() i=3 2024-09-18T01:25:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.434+0000 7f6e70213800 20 add_watcher() i=4 2024-09-18T01:25:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.434+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94271465619264] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.434+0000 7f6e70213800 20 add_watcher() i=5 2024-09-18T01:25:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.434+0000 7f6e70213800 20 add_watcher() i=6 2024-09-18T01:25:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.435+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94271465625776] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.435+0000 7f6e70213800 20 add_watcher() i=7 2024-09-18T01:25:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.435+0000 7f6e70213800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.435+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd4938a250 con 0x55bd49376440 2024-09-18T01:25:28.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.436+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.436+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94271465627040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd4938a1c0 con 0x55bd49376440 2024-09-18T01:25:28.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.437+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94271465627040] v33'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.437+0000 7f6d21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.437+0000 7f6e70213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:28.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.437+0000 7f6e70213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:28.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.437+0000 7f6e70213800 5 note: GC not initialized 2024-09-18T01:25:28.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.437+0000 7f6d20fe1640 20 reqs_thread_entry: start 2024-09-18T01:25:28.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.437+0000 7f6e70213800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:28.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.437+0000 7f6e70213800 20 Filter name: none 2024-09-18T01:25:28.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.437+0000 7f6c9a7fc640 20 reqs_thread_entry: start 2024-09-18T01:25:28.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.437+0000 7f6e70213800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:28.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.437+0000 7f6e70213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.437+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd493c0690 con 0x55bd49376440 2024-09-18T01:25:28.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.438+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.438+0000 7f6e70213800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:28.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.438+0000 7f6e70213800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:28.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.438+0000 7f6e70213800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.438+0000 7f6e70213800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:28.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.438+0000 7f6e70213800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-18T01:25:28.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.438+0000 7f6e70213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.438+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd493c1100 con 0x55bd49376440 2024-09-18T01:25:28.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.438+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.438+0000 7f6e70213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.438+0000 7f6e70213800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-18T01:25:28.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.438+0000 7f6e70213800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-18T01:25:28.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.438+0000 7f6e70213800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-18T01:25:28.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.438+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd493c6ba0 con 0x55bd49376440 2024-09-18T01:25:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.439+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v33'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.439+0000 7f6e70213800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.439+0000 7f6e70213800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.439+0000 7f6e70213800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.439+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94271465874784 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd493c2110 con 0x55bd49376440 2024-09-18T01:25:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.440+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== watch-notify(notify (1) cookie 94271465617264 notify 141733920773 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f6e64010040 con 0x55bd49376440 2024-09-18T01:25:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.440+0000 7f6d4affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 94271465617264 notifier 4370 bl.length()=732 2024-09-18T01:25:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.440+0000 7f6d4affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.440+0000 7f6d4affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.440+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(65 notify.4 [notify cookie 94271465874784 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.440+0000 7f6d4affd640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f6d30003ea0 con 0x55bd49376440 2024-09-18T01:25:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.440+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.440+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== watch-notify(notify_complete (2) cookie 94271465874784 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6e6403c480 con 0x55bd49376440 2024-09-18T01:25:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.440+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd493c6560 con 0x55bd49376440 2024-09-18T01:25:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.441+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.441+0000 7f6e70213800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-18T01:25:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.441+0000 7f6e70213800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-18T01:25:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.441+0000 7f6e70213800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-18T01:25:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.441+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94271465874784 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd493c1c60 con 0x55bd4937aa90 2024-09-18T01:25:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.441+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== watch-notify(notify (1) cookie 94271465600672 notify 141733920770 ret 0) ==== 208+0+0 (crc 0 0 0) 0x55bd49357da0 con 0x55bd4937aa90 2024-09-18T01:25:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.441+0000 7f6d4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 94271465600672 notifier 4370 bl.length()=166 2024-09-18T01:25:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.442+0000 7f6d4a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-18T01:25:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.442+0000 7f6d4a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-18T01:25:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.442+0000 7f6d4a7fc640 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f6ca0003400 con 0x55bd4937aa90 2024-09-18T01:25:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.442+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(68 notify.0 [notify cookie 94271465874784 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.442+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.442+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== watch-notify(notify_complete (2) cookie 94271465874784 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bd49357b70 con 0x55bd4937aa90 2024-09-18T01:25:28.451 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"nYwpluPKgZK3e4xDZfXBPtFAwf0eG1HqoKJO3zZd","active":true,"create_date":"2024-09-18T01:25:28.439554Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:28.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.443+0000 7f6d21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.443+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94271465627040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd493be3e0 con 0x55bd49376440 2024-09-18T01:25:28.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.444+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94271465627040] v33'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.444+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94271465600672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd493be3e0 con 0x55bd4937aa90 2024-09-18T01:25:28.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.445+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94271465600672] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.445+0000 7f6e70213800 20 remove_watcher() i=0 2024-09-18T01:25:28.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.445+0000 7f6e70213800 2 removed watcher, disabling cache 2024-09-18T01:25:28.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.445+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94271465605600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd493be3e0 con 0x55bd49376440 2024-09-18T01:25:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.446+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94271465605600] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.446+0000 7f6e70213800 20 remove_watcher() i=1 2024-09-18T01:25:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.446+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94271465609152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd493be3e0 con 0x55bd4937f420 2024-09-18T01:25:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.447+0000 7f6e6b066640 1 -- 172.21.15.100:0/3857008403 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94271465609152] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60037040 con 0x55bd4937f420 2024-09-18T01:25:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.447+0000 7f6e70213800 20 remove_watcher() i=2 2024-09-18T01:25:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.448+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94271465614080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd493836a0 con 0x55bd4937aa90 2024-09-18T01:25:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.449+0000 7f6e6b867640 1 -- 172.21.15.100:0/3857008403 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94271465614080] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e5c0c2020 con 0x55bd4937aa90 2024-09-18T01:25:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.449+0000 7f6e70213800 20 remove_watcher() i=3 2024-09-18T01:25:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.449+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94271465617264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd493c6690 con 0x55bd49376440 2024-09-18T01:25:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.450+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94271465617264] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x55bd49376440 2024-09-18T01:25:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.450+0000 7f6e70213800 20 remove_watcher() i=4 2024-09-18T01:25:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.450+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94271465622128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd493849e0 con 0x7f6e5c0b3040 2024-09-18T01:25:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.451+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94271465622128] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.451+0000 7f6e70213800 20 remove_watcher() i=5 2024-09-18T01:25:28.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.451+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94271465619264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd49386b00 con 0x7f6e5c0b3040 2024-09-18T01:25:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.452+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94271465619264] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.452+0000 7f6e70213800 20 remove_watcher() i=6 2024-09-18T01:25:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.452+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94271465625776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd493836a0 con 0x7f6e5c0b3040 2024-09-18T01:25:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.453+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94271465625776] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e64026040 con 0x7f6e5c0b3040 2024-09-18T01:25:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.453+0000 7f6e70213800 20 remove_watcher() i=7 2024-09-18T01:25:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.453+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f6e5c0b3040 msgr2=0x7f6e5c066710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.453+0000 7f6e70213800 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f6e5c0b3040 0x7f6e5c066710 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.453+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55bd49376440 msgr2=0x55bd49378900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.453+0000 7f6e70213800 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55bd49376440 0x55bd49378900 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.453+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55bd4937aa90 msgr2=0x55bd4937ce80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.453+0000 7f6e70213800 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55bd4937aa90 0x55bd4937ce80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.453+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55bd4937f420 msgr2=0x55bd493818e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.453+0000 7f6e70213800 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55bd4937f420 0x55bd493818e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.453+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d34036b90 msgr2=0x7f6d34039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.453+0000 7f6e70213800 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d34036b90 0x7f6d34039050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000ffd0 tx=0x7f6e60023040 comp rx=0 tx=0).stop 2024-09-18T01:25:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49363d20 msgr2=0x55bd4936ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49363d20 0x55bd4936ae10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c087bc0 tx=0x7f6e5c05bf60 comp rx=0 tx=0).stop 2024-09-18T01:25:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e6c068640 1 -- 172.21.15.100:0/3857008403 reap_dead start 2024-09-18T01:25:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 shutdown_connections 2024-09-18T01:25:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 --2- 172.21.15.100:0/3857008403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49363d20 0x55bd4936ae10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 >> 172.21.15.100:0/3857008403 conn(0x55bd49360080 msgr2=0x55bd4935e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 shutdown_connections 2024-09-18T01:25:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/3857008403 wait complete. 2024-09-18T01:25:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/2875977793 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d44036b90 msgr2=0x7f6d44039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 --2- 172.21.15.100:0/2875977793 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d44036b90 0x7f6d44039050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55bd493414c0 tx=0x7f6e60006000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/2875977793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49357210 msgr2=0x55bd49357630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 --2- 172.21.15.100:0/2875977793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49357210 0x55bd49357630 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c05a010 tx=0x7f6e5c060d60 comp rx=0 tx=0).stop 2024-09-18T01:25:28.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/2875977793 shutdown_connections 2024-09-18T01:25:28.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 --2- 172.21.15.100:0/2875977793 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d44036b90 0x7f6d44039050 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 --2- 172.21.15.100:0/2875977793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd49357210 0x55bd49357630 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/2875977793 >> 172.21.15.100:0/2875977793 conn(0x55bd49347d90 msgr2=0x55bd4934a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/2875977793 shutdown_connections 2024-09-18T01:25:28.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/2875977793 wait complete. 2024-09-18T01:25:28.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55bd49342550 msgr2=0x55bd49344940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55bd49342550 0x55bd49344940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55bd4923fe20 msgr2=0x55bd4933bd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55bd4923fe20 0x55bd4933bd30 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55bd4933e660 msgr2=0x55bd49340a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55bd4933e660 0x55bd49340a50 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d54036b40 msgr2=0x7f6d54039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6d54036b40 0x7f6d54039000 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6e60000c00 tx=0x7f6e600013b0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 msgr2=0x55bd49334cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e70213800 1 --2- 172.21.15.100:0/2178801945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4923f4e0 0x55bd49334cc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00a3f0 tx=0x7f6e5c003330 comp rx=0 tx=0).stop 2024-09-18T01:25:28.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.454+0000 7f6e6c068640 1 -- 172.21.15.100:0/2178801945 reap_dead start 2024-09-18T01:25:28.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.455+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 shutdown_connections 2024-09-18T01:25:28.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.455+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 >> 172.21.15.100:0/2178801945 conn(0x55bd4923add0 msgr2=0x55bd49328890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.455+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 shutdown_connections 2024-09-18T01:25:28.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.455+0000 7f6e70213800 1 -- 172.21.15.100:0/2178801945 wait complete. 2024-09-18T01:25:28.464 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'nYwpluPKgZK3e4xDZfXBPtFAwf0eG1HqoKJO3zZd', 'active': True, 'create_date': '2024-09-18T01:25:28.439554Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:28.464 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-18T01:25:28.464 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-18T01:25:28.464 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-18T01:25:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:28.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.512+0000 7f07a6a30800 1 Processor -- start 2024-09-18T01:25:28.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.513+0000 7f07a6a30800 1 -- start start 2024-09-18T01:25:28.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.513+0000 7f07a6a30800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x563107b21e10 0x563107bb1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.513+0000 7f07a6a30800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563107a6db30 con 0x563107bb1740 2024-09-18T01:25:28.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.513+0000 7f07a6a30800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x563107a4f360 con 0x563107b21e10 2024-09-18T01:25:28.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.513+0000 7f07a1d60640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x563107b21e10 0x563107bb1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.513+0000 7f079bfff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x563107bb1740 0x563107bb3b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37164/0 (socket says 172.21.15.100:37164) 2024-09-18T01:25:28.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.513+0000 7f079bfff640 1 -- 172.21.15.100:0/919168868 learned_addr learned my addr 172.21.15.100:0/919168868 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:28.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.513+0000 7f07a1d60640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x563107b21e10 0x563107bb1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37230/0 (socket says 172.21.15.100:37230) 2024-09-18T01:25:28.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.513+0000 7f07a1d60640 1 -- 172.21.15.100:0/919168868 >> v1:172.21.15.92:6789/0 conn(0x563107bb1740 legacy=0x563107bb3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.513+0000 7f07a1d60640 1 -- 172.21.15.100:0/919168868 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563107a75e00 con 0x563107b21e10 2024-09-18T01:25:28.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.513+0000 7f07a155f640 1 -- 172.21.15.100:0/919168868 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054363640 0 0) 0x563107a6db30 con 0x563107bb1740 2024-09-18T01:25:28.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.515+0000 7f07a1d60640 1 --2- 172.21.15.100:0/919168868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 0x563107bb1200 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f079400a470 tx=0x7f0794045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c59b5ba39ee6d26 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.515+0000 7f07a155f640 1 -- 172.21.15.100:0/919168868 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0794053570 con 0x563107b21e10 2024-09-18T01:25:28.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.515+0000 7f07a155f640 1 -- 172.21.15.100:0/919168868 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0794058070 con 0x563107b21e10 2024-09-18T01:25:28.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.515+0000 7f07a155f640 1 -- 172.21.15.100:0/919168868 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0794053880 con 0x563107b21e10 2024-09-18T01:25:28.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.516+0000 7f07a6a30800 1 -- 172.21.15.100:0/919168868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 msgr2=0x563107bb1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.516+0000 7f07a6a30800 1 --2- 172.21.15.100:0/919168868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 0x563107bb1200 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f079400a470 tx=0x7f0794045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:28.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.516+0000 7f07a6a30800 1 -- 172.21.15.100:0/919168868 shutdown_connections 2024-09-18T01:25:28.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.516+0000 7f07a6a30800 1 --2- 172.21.15.100:0/919168868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 0x563107bb1200 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.516+0000 7f07a6a30800 1 -- 172.21.15.100:0/919168868 >> 172.21.15.100:0/919168868 conn(0x563107ba8e10 msgr2=0x563107bab230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.516+0000 7f07a6a30800 1 -- 172.21.15.100:0/919168868 shutdown_connections 2024-09-18T01:25:28.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.516+0000 7f07a6a30800 1 -- 172.21.15.100:0/919168868 wait complete. 2024-09-18T01:25:28.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.530+0000 7f07a6a30800 1 Processor -- start 2024-09-18T01:25:28.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.530+0000 7f07a6a30800 1 -- start start 2024-09-18T01:25:28.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.530+0000 7f07a6a30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 0x563107baeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.530+0000 7f07a6a30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563107afa350 con 0x563107b21e10 2024-09-18T01:25:28.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.530+0000 7f07a1d60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 0x563107baeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.530+0000 7f07a1d60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 0x563107baeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37242/0 (socket says 172.21.15.100:37242) 2024-09-18T01:25:28.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.530+0000 7f07a1d60640 1 -- 172.21.15.100:0/2460099982 learned_addr learned my addr 172.21.15.100:0/2460099982 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.531+0000 7f07a1d60640 1 -- 172.21.15.100:0/2460099982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563107a47bc0 con 0x563107b21e10 2024-09-18T01:25:28.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.531+0000 7f07a1d60640 1 --2- 172.21.15.100:0/2460099982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 0x563107baeb30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0794005870 tx=0x7f0794051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69298900a753636 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.531+0000 7f068fe07640 1 -- 172.21.15.100:0/2460099982 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f079405c580 con 0x563107b21e10 2024-09-18T01:25:28.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.531+0000 7f068fe07640 1 -- 172.21.15.100:0/2460099982 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0794063030 con 0x563107b21e10 2024-09-18T01:25:28.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.531+0000 7f068fe07640 1 -- 172.21.15.100:0/2460099982 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f079405c850 con 0x563107b21e10 2024-09-18T01:25:28.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.532+0000 7f07a6a30800 1 -- 172.21.15.100:0/2460099982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 msgr2=0x563107baeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.532+0000 7f07a6a30800 1 --2- 172.21.15.100:0/2460099982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 0x563107baeb30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0794005870 tx=0x7f0794051000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.532+0000 7f07a6a30800 1 -- 172.21.15.100:0/2460099982 shutdown_connections 2024-09-18T01:25:28.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.532+0000 7f07a6a30800 1 --2- 172.21.15.100:0/2460099982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 0x563107baeb30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.532+0000 7f07a6a30800 1 -- 172.21.15.100:0/2460099982 >> 172.21.15.100:0/2460099982 conn(0x563107ba8e10 msgr2=0x563107c99070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.532+0000 7f07a6a30800 1 -- 172.21.15.100:0/2460099982 shutdown_connections 2024-09-18T01:25:28.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.532+0000 7f07a6a30800 1 -- 172.21.15.100:0/2460099982 wait complete. 2024-09-18T01:25:28.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.532+0000 7f07a6a30800 1 Processor -- start 2024-09-18T01:25:28.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.532+0000 7f07a6a30800 1 -- start start 2024-09-18T01:25:28.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.532+0000 7f07a6a30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 0x563107ca71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.532+0000 7f07a6a30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563107bb5610 con 0x563107b21e10 2024-09-18T01:25:28.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.532+0000 7f07a1d60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 0x563107ca71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.532+0000 7f07a1d60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 0x563107ca71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37246/0 (socket says 172.21.15.100:37246) 2024-09-18T01:25:28.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.532+0000 7f07a1d60640 1 -- 172.21.15.100:0/2620330625 learned_addr learned my addr 172.21.15.100:0/2620330625 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.533+0000 7f07a1d60640 1 -- 172.21.15.100:0/2620330625 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563107a5bfe0 con 0x563107b21e10 2024-09-18T01:25:28.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.533+0000 7f07a1d60640 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 0x563107ca71d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0794045f50 tx=0x7f0794002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.533+0000 7f068e604640 1 -- 172.21.15.100:0/2620330625 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0794078070 con 0x563107b21e10 2024-09-18T01:25:28.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.533+0000 7f068e604640 1 -- 172.21.15.100:0/2620330625 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0794054a70 con 0x563107b21e10 2024-09-18T01:25:28.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.533+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563107ca7710 con 0x563107b21e10 2024-09-18T01:25:28.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.533+0000 7f068e604640 1 -- 172.21.15.100:0/2620330625 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0794054d50 con 0x563107b21e10 2024-09-18T01:25:28.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.533+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563107ca7c90 con 0x563107b21e10 2024-09-18T01:25:28.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.534+0000 7f068e604640 1 -- 172.21.15.100:0/2620330625 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f079407b070 con 0x563107b21e10 2024-09-18T01:25:28.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.534+0000 7f068e604640 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0688036b90 0x7f0688039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.534+0000 7f068e604640 1 -- 172.21.15.100:0/2620330625 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0794070070 con 0x563107b21e10 2024-09-18T01:25:28.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.534+0000 7f079bfff640 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0688036b90 0x7f0688039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.534+0000 7f07a6a30800 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563107bb1740 0x563107cae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.534+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107cae870 con 0x563107bb1740 2024-09-18T01:25:28.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.534+0000 7f07a2561640 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563107bb1740 0x563107cae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.534+0000 7f079bfff640 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0688036b90 0x7f0688039050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f078c000c00 tx=0x7f078c0013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.535+0000 7f07a2561640 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563107bb1740 0x563107cae2a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.535+0000 7f07a2561640 1 -- 172.21.15.100:0/2620330625 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107bb1740 2024-09-18T01:25:28.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.535+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107cab850 con 0x563107bb1740 2024-09-18T01:25:28.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.535+0000 7f07a2561640 1 -- 172.21.15.100:0/2620330625 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107bb1740 2024-09-18T01:25:28.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.535+0000 7f07a6a30800 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563107cb0bb0 0x563107cb2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.535+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107cb3690 con 0x563107cb0bb0 2024-09-18T01:25:28.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.535+0000 7f07a1d60640 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563107cb0bb0 0x563107cb2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.535+0000 7f07a1d60640 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563107cb0bb0 0x563107cb2fa0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.536+0000 7f07a1d60640 1 -- 172.21.15.100:0/2620330625 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f079407a030 con 0x563107cb0bb0 2024-09-18T01:25:28.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.536+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107cafa50 con 0x563107bb1740 2024-09-18T01:25:28.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.536+0000 7f07a2561640 1 -- 172.21.15.100:0/2620330625 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107bb1740 2024-09-18T01:25:28.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.536+0000 7f07a6a30800 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563107cb4af0 0x563107cb6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.536+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107cb75b0 con 0x563107cb4af0 2024-09-18T01:25:28.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.536+0000 7f079bfff640 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563107cb4af0 0x563107cb6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.537+0000 7f079bfff640 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563107cb4af0 0x563107cb6ee0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.537+0000 7f079bfff640 1 -- 172.21.15.100:0/2620330625 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f078c00f670 con 0x563107cb4af0 2024-09-18T01:25:28.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.537+0000 7f07a6a30800 1 Processor -- start 2024-09-18T01:25:28.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.537+0000 7f07a6a30800 1 -- start start 2024-09-18T01:25:28.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.537+0000 7f07a6a30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cc5320 0x563107cc5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.537+0000 7f07a6a30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563107a49580 con 0x563107cc5320 2024-09-18T01:25:28.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.538+0000 7f07a1d60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cc5320 0x563107cc5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.538+0000 7f07a1d60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cc5320 0x563107cc5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37254/0 (socket says 172.21.15.100:37254) 2024-09-18T01:25:28.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.538+0000 7f07a1d60640 1 -- 172.21.15.100:0/984368062 learned_addr learned my addr 172.21.15.100:0/984368062 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.538+0000 7f07a1d60640 1 -- 172.21.15.100:0/984368062 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563107cc5c80 con 0x563107cc5320 2024-09-18T01:25:28.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.538+0000 7f07a1d60640 1 --2- 172.21.15.100:0/984368062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cc5320 0x563107cc5740 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f07940883f0 tx=0x7f0794061c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.538+0000 7f06877fe640 1 -- 172.21.15.100:0/984368062 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f079405e920 con 0x563107cc5320 2024-09-18T01:25:28.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.538+0000 7f06877fe640 1 -- 172.21.15.100:0/984368062 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0794094070 con 0x563107cc5320 2024-09-18T01:25:28.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.538+0000 7f07a6a30800 1 -- 172.21.15.100:0/984368062 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563107cc5f10 con 0x563107cc5320 2024-09-18T01:25:28.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.538+0000 7f06877fe640 1 -- 172.21.15.100:0/984368062 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0794009b80 con 0x563107cc5320 2024-09-18T01:25:28.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.538+0000 7f07a6a30800 1 -- 172.21.15.100:0/984368062 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563107cc8bf0 con 0x563107cc5320 2024-09-18T01:25:28.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.539+0000 7f06877fe640 1 -- 172.21.15.100:0/984368062 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0794009d20 con 0x563107cc5320 2024-09-18T01:25:28.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.539+0000 7f06877fe640 1 --2- 172.21.15.100:0/984368062 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f067c036b90 0x7f067c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.539+0000 7f06877fe640 1 -- 172.21.15.100:0/984368062 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f079409b0c0 con 0x563107cc5320 2024-09-18T01:25:28.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.539+0000 7f079bfff640 1 --2- 172.21.15.100:0/984368062 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f067c036b90 0x7f067c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.539+0000 7f07a6a30800 1 Processor -- start 2024-09-18T01:25:28.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.539+0000 7f07a6a30800 1 -- start start 2024-09-18T01:25:28.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.539+0000 7f079bfff640 1 --2- 172.21.15.100:0/984368062 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f067c036b90 0x7f067c039050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x563107caf160 tx=0x7f078c006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.540+0000 7f07a6a30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cd1df0 0x563107cd21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.540+0000 7f07a6a30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563107bad1a0 con 0x563107cd1df0 2024-09-18T01:25:28.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.540+0000 7f07a1d60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cd1df0 0x563107cd21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.540+0000 7f07a1d60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cd1df0 0x563107cd21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37260/0 (socket says 172.21.15.100:37260) 2024-09-18T01:25:28.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.540+0000 7f07a1d60640 1 -- 172.21.15.100:0/1419139962 learned_addr learned my addr 172.21.15.100:0/1419139962 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.540+0000 7f07a1d60640 1 -- 172.21.15.100:0/1419139962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563107cd27c0 con 0x563107cd1df0 2024-09-18T01:25:28.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.540+0000 7f07a1d60640 1 --2- 172.21.15.100:0/1419139962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cd1df0 0x563107cd21f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0794058ff0 tx=0x7f079408fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16a139f70b6bbb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.540+0000 7f06857fa640 1 -- 172.21.15.100:0/1419139962 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0794002160 con 0x563107cd1df0 2024-09-18T01:25:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.540+0000 7f06857fa640 1 -- 172.21.15.100:0/1419139962 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0794099c90 con 0x563107cd1df0 2024-09-18T01:25:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.540+0000 7f06857fa640 1 -- 172.21.15.100:0/1419139962 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07940669f0 con 0x563107cd1df0 2024-09-18T01:25:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.541+0000 7f07a6a30800 1 -- 172.21.15.100:0/1419139962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cd1df0 msgr2=0x563107cd21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.541+0000 7f07a6a30800 1 --2- 172.21.15.100:0/1419139962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cd1df0 0x563107cd21f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0794058ff0 tx=0x7f079408fc60 comp rx=0 tx=0).stop 2024-09-18T01:25:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.541+0000 7f07a6a30800 1 -- 172.21.15.100:0/1419139962 shutdown_connections 2024-09-18T01:25:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.541+0000 7f07a6a30800 1 --2- 172.21.15.100:0/1419139962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cd1df0 0x563107cd21f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.541+0000 7f07a6a30800 1 -- 172.21.15.100:0/1419139962 >> 172.21.15.100:0/1419139962 conn(0x563107cce150 msgr2=0x563107ccc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.541+0000 7f07a6a30800 1 -- 172.21.15.100:0/1419139962 shutdown_connections 2024-09-18T01:25:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.541+0000 7f07a6a30800 1 -- 172.21.15.100:0/1419139962 wait complete. 2024-09-18T01:25:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.541+0000 7f07a6a30800 1 Processor -- start 2024-09-18T01:25:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.541+0000 7f07a6a30800 1 -- start start 2024-09-18T01:25:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.541+0000 7f07a6a30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cd1df0 0x563107cd9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.541+0000 7f07a6a30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563107cd2d40 con 0x563107cd1df0 2024-09-18T01:25:28.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.541+0000 7f07a1d60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cd1df0 0x563107cd9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.542+0000 7f07a1d60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cd1df0 0x563107cd9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37268/0 (socket says 172.21.15.100:37268) 2024-09-18T01:25:28.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.542+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 learned_addr learned my addr 172.21.15.100:0/1965374173 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.542+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563107cd95a0 con 0x563107cd1df0 2024-09-18T01:25:28.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.542+0000 7f07a1d60640 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cd1df0 0x563107cd9060 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0794058f60 tx=0x7f0794077e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.542+0000 7f06737fe640 1 -- 172.21.15.100:0/1965374173 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07940c0070 con 0x563107cd1df0 2024-09-18T01:25:28.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.542+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563107cd95a0 con 0x563107cd1df0 2024-09-18T01:25:28.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.542+0000 7f06737fe640 1 -- 172.21.15.100:0/1965374173 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07940b7070 con 0x563107cd1df0 2024-09-18T01:25:28.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.542+0000 7f06737fe640 1 -- 172.21.15.100:0/1965374173 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0794066590 con 0x563107cd1df0 2024-09-18T01:25:28.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.542+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563107cd95a0 con 0x563107cd1df0 2024-09-18T01:25:28.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.543+0000 7f06737fe640 1 -- 172.21.15.100:0/1965374173 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f07940c3070 con 0x563107cd1df0 2024-09-18T01:25:28.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.543+0000 7f06737fe640 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f066c036b40 0x7f066c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.543+0000 7f06737fe640 1 -- 172.21.15.100:0/1965374173 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f07940c6ca0 con 0x563107cd1df0 2024-09-18T01:25:28.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.543+0000 7f079bfff640 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f066c036b40 0x7f066c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.544+0000 7f079bfff640 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f066c036b40 0x7f066c039000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f078c00ffd0 tx=0x7f078c023040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.544+0000 7f07a6a30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.544+0000 7f07a6a30800 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563107ce4800 0x563107ce6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.544+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107ce7410 con 0x563107ce4800 2024-09-18T01:25:28.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.544+0000 7f07a2561640 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563107ce4800 0x563107ce6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.544+0000 7f07a2561640 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563107ce4800 0x563107ce6cc0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.544+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.544+0000 7f07a6a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.544+0000 7f07a6a30800 20 realm 2024-09-18T01:25:28.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.544+0000 7f07a6a30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.544+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107ce7820 con 0x563107ce4800 2024-09-18T01:25:28.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a6a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a6a30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:28.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a6a30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107ce80f0 con 0x563107ce4800 2024-09-18T01:25:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a6a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a6a30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107ce4800 2024-09-18T01:25:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a6a30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a6a30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a6a30800 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563107ce91f0 0x563107ceb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107cebba0 con 0x563107ce91f0 2024-09-18T01:25:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a1d60640 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563107ce91f0 0x563107ceb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.545+0000 7f07a1d60640 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563107ce91f0 0x563107ceb5e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.546+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f07940c2030 con 0x563107ce91f0 2024-09-18T01:25:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.546+0000 7f07a6a30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.546+0000 7f07a6a30800 20 searching for the correct realm 2024-09-18T01:25:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.546+0000 7f07a6a30800 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563107cedb50 0x563107cf0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.546+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107cf06e0 con 0x563107cedb50 2024-09-18T01:25:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.546+0000 7f079bfff640 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563107cedb50 0x563107cf0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.546+0000 7f079bfff640 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563107cedb50 0x563107cf0010 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.546+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c037040 con 0x563107cedb50 2024-09-18T01:25:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.546+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107cf06e0 con 0x563107ce91f0 2024-09-18T01:25:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.547+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940c2030 con 0x563107ce91f0 2024-09-18T01:25:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.547+0000 7f07a1d60640 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f07940c5060 0x7f07940c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.547+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107cf06e0 con 0x7f07940c5060 2024-09-18T01:25:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.547+0000 7f07a2561640 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f07940c5060 0x7f07940c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.547+0000 7f07a2561640 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f07940c5060 0x7f07940c9640 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.547+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.547+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107ce4800 2024-09-18T01:25:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.548+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.548+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107ce4800 2024-09-18T01:25:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.548+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.548+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x7f07940c5060 2024-09-18T01:25:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.548+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.548+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x7f07940c5060 2024-09-18T01:25:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.548+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.548+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107ce91f0 2024-09-18T01:25:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.549+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940c2030 con 0x563107ce91f0 2024-09-18T01:25:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.549+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107cedb50 2024-09-18T01:25:28.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.549+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c037040 con 0x563107cedb50 2024-09-18T01:25:28.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.549+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107ce4800 2024-09-18T01:25:28.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.549+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.549+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x7f07940c5060 2024-09-18T01:25:28.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.549+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.549+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107ce4800 2024-09-18T01:25:28.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.550+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.550+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107ce91f0 2024-09-18T01:25:28.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.550+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f07940c2030 con 0x563107ce91f0 2024-09-18T01:25:28.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.550+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107cedb50 2024-09-18T01:25:28.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.550+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c037040 con 0x563107cedb50 2024-09-18T01:25:28.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.550+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107cedb50 2024-09-18T01:25:28.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.550+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c037040 con 0x563107cedb50 2024-09-18T01:25:28.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.550+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x7f07940c5060 2024-09-18T01:25:28.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.551+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.551+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107cedb50 2024-09-18T01:25:28.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.551+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c037040 con 0x563107cedb50 2024-09-18T01:25:28.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.551+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107cedb50 2024-09-18T01:25:28.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.551+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c037040 con 0x563107cedb50 2024-09-18T01:25:28.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.551+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107ce4800 2024-09-18T01:25:28.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.551+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.551+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107ce4800 2024-09-18T01:25:28.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.552+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.552+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x7f07940c5060 2024-09-18T01:25:28.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.552+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.552+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107cedb50 2024-09-18T01:25:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.552+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c037040 con 0x563107cedb50 2024-09-18T01:25:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.552+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107ce91f0 2024-09-18T01:25:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.552+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940c2030 con 0x563107ce91f0 2024-09-18T01:25:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.552+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107ce4800 2024-09-18T01:25:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.553+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.553+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x7f07940c5060 2024-09-18T01:25:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.553+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.553+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107cedb50 2024-09-18T01:25:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.553+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c037040 con 0x563107cedb50 2024-09-18T01:25:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.553+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x7f07940c5060 2024-09-18T01:25:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.553+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.553+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107ce91f0 2024-09-18T01:25:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.554+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940c2030 con 0x563107ce91f0 2024-09-18T01:25:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.554+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107cedb50 2024-09-18T01:25:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.554+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c037040 con 0x563107cedb50 2024-09-18T01:25:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.554+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x7f07940c5060 2024-09-18T01:25:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.554+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.554+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107ce4800 2024-09-18T01:25:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563107ce8490 con 0x563107ce91f0 2024-09-18T01:25:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f07940c2030 con 0x563107ce91f0 2024-09-18T01:25:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a6a30800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a6a30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a6a30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a6a30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a6a30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a6a30800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a6a30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107cec460 con 0x563107ce4800 2024-09-18T01:25:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a6a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a6a30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107cec850 con 0x563107ce4800 2024-09-18T01:25:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a6a30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a6a30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.555+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107cec850 con 0x7f07940c5060 2024-09-18T01:25:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 20 zone default found 2024-09-18T01:25:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 4 Realm: () 2024-09-18T01:25:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 20 zonegroup default 2024-09-18T01:25:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107cf0b60 con 0x7f07940c5060 2024-09-18T01:25:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107cf2540 con 0x563107cedb50 2024-09-18T01:25:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f078c037040 con 0x563107cedb50 2024-09-18T01:25:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.556+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107cf28e0 con 0x563107cedb50 2024-09-18T01:25:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.557+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f078c037040 con 0x563107cedb50 2024-09-18T01:25:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.557+0000 7f07a6a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.557+0000 7f07a6a30800 20 started sync module instance, tier type = 2024-09-18T01:25:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.557+0000 7f07a6a30800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.557+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf19e0 con 0x563107ce91f0 2024-09-18T01:25:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.558+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940c2030 con 0x563107ce91f0 2024-09-18T01:25:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.558+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94768584400336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf1640 con 0x563107ce91f0 2024-09-18T01:25:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.558+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf35e0 con 0x563107ce4800 2024-09-18T01:25:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.558+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94768584400336] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940c2030 con 0x563107ce91f0 2024-09-18T01:25:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.559+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.559+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94768584404576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf39d0 con 0x563107ce4800 2024-09-18T01:25:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.559+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf4410 con 0x563107cedb50 2024-09-18T01:25:28.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.560+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94768584404576] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.560+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f078c037040 con 0x563107cedb50 2024-09-18T01:25:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.560+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94768584408800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf4800 con 0x563107cedb50 2024-09-18T01:25:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.560+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf5260 con 0x563107ce91f0 2024-09-18T01:25:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.561+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940c2030 con 0x563107ce91f0 2024-09-18T01:25:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.561+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94768584412480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf5b00 con 0x563107ce91f0 2024-09-18T01:25:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.561+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf6580 con 0x563107ce4800 2024-09-18T01:25:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.561+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94768584408800] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f078c037040 con 0x563107cedb50 2024-09-18T01:25:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.562+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94768584412480] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940c2030 con 0x563107ce91f0 2024-09-18T01:25:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.562+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.562+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94768584417392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf5650 con 0x563107ce4800 2024-09-18T01:25:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.562+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf6e50 con 0x7f07940c5060 2024-09-18T01:25:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.563+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94768584417392] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.563+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.564+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94768584405728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf5650 con 0x7f07940c5060 2024-09-18T01:25:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.564+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf74a0 con 0x7f07940c5060 2024-09-18T01:25:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.564+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94768584405728] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.564+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.565+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94768584421264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf7460 con 0x7f07940c5060 2024-09-18T01:25:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.565+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf7e60 con 0x7f07940c5060 2024-09-18T01:25:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.565+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.565+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94768584423792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf82c0 con 0x7f07940c5060 2024-09-18T01:25:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.565+0000 7f07a6a30800 20 add_watcher() i=0 2024-09-18T01:25:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.565+0000 7f07a6a30800 20 add_watcher() i=1 2024-09-18T01:25:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.565+0000 7f07a6a30800 20 add_watcher() i=2 2024-09-18T01:25:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.565+0000 7f07a6a30800 20 add_watcher() i=3 2024-09-18T01:25:28.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.565+0000 7f07a6a30800 20 add_watcher() i=4 2024-09-18T01:25:28.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.565+0000 7f07a6a30800 20 add_watcher() i=5 2024-09-18T01:25:28.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.565+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94768584421264] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.565+0000 7f07a6a30800 20 add_watcher() i=6 2024-09-18T01:25:28.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.566+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94768584423792] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.566+0000 7f07a6a30800 20 add_watcher() i=7 2024-09-18T01:25:28.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.566+0000 7f07a6a30800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:28.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.566+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107cf6890 con 0x563107ce4800 2024-09-18T01:25:28.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.567+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.567+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94768584424848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107cf6840 con 0x563107ce4800 2024-09-18T01:25:28.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.568+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94768584424848] v33'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.568+0000 7f06537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.568+0000 7f07a6a30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.568+0000 7f07a6a30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.568+0000 7f07a6a30800 5 note: GC not initialized 2024-09-18T01:25:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.568+0000 7f06527fc640 20 reqs_thread_entry: start 2024-09-18T01:25:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.568+0000 7f07a6a30800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.568+0000 7f07a6a30800 20 Filter name: none 2024-09-18T01:25:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.568+0000 7f05c3fff640 20 reqs_thread_entry: start 2024-09-18T01:25:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.568+0000 7f07a6a30800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.568+0000 7f07a6a30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.568+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107d2e700 con 0x563107ce4800 2024-09-18T01:25:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.569+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.569+0000 7f07a6a30800 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T01:25:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.569+0000 7f07a6a30800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.569+0000 7f07a6a30800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.569+0000 7f07a6a30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.569+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107d34f20 con 0x563107ce4800 2024-09-18T01:25:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.570+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v33'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.570+0000 7f07a6a30800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.570+0000 7f07a6a30800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.570+0000 7f07a6a30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.570+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94768584673504 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563107d305a0 con 0x563107ce4800 2024-09-18T01:25:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.570+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== watch-notify(notify (1) cookie 94768584417392 notify 141733920774 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f079c043860 con 0x563107ce4800 2024-09-18T01:25:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.570+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(64 notify.4 [notify cookie 94768584673504 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.570+0000 7f0684ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94768584417392 notifier 4377 bl.length()=732 2024-09-18T01:25:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.570+0000 7f0684ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.570+0000 7f0684ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.570+0000 7f0684ff9640 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f05cc003430 con 0x563107ce4800 2024-09-18T01:25:28.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.571+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== watch-notify(notify_complete (2) cookie 94768584673504 notify 141733920774 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f079c018dd0 con 0x563107ce4800 2024-09-18T01:25:28.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.571+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.582 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:28.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.572+0000 7f06537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.572+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94768584424848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107d300f0 con 0x563107ce4800 2024-09-18T01:25:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.572+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94768584424848] v33'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.572+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94768584400336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107d2c410 con 0x563107ce91f0 2024-09-18T01:25:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.573+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94768584400336] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940c2030 con 0x563107ce91f0 2024-09-18T01:25:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.573+0000 7f07a6a30800 20 remove_watcher() i=0 2024-09-18T01:25:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.573+0000 7f07a6a30800 2 removed watcher, disabling cache 2024-09-18T01:25:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.573+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94768584404576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107d2c410 con 0x563107ce4800 2024-09-18T01:25:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.574+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94768584404576] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.574+0000 7f07a6a30800 20 remove_watcher() i=1 2024-09-18T01:25:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.575+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94768584408800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107d2c410 con 0x563107cedb50 2024-09-18T01:25:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.575+0000 7f079bfff640 1 -- 172.21.15.100:0/1965374173 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94768584408800] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f078c037040 con 0x563107cedb50 2024-09-18T01:25:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.576+0000 7f07a6a30800 20 remove_watcher() i=2 2024-09-18T01:25:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.576+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94768584412480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107d305a0 con 0x563107ce91f0 2024-09-18T01:25:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.576+0000 7f07a1d60640 1 -- 172.21.15.100:0/1965374173 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94768584412480] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940c2030 con 0x563107ce91f0 2024-09-18T01:25:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.576+0000 7f07a6a30800 20 remove_watcher() i=3 2024-09-18T01:25:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.576+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94768584417392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107d305a0 con 0x563107ce4800 2024-09-18T01:25:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.578+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94768584417392] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x563107ce4800 2024-09-18T01:25:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.578+0000 7f07a6a30800 20 remove_watcher() i=4 2024-09-18T01:25:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.578+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94768584405728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107d305a0 con 0x7f07940c5060 2024-09-18T01:25:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.579+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94768584405728] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.579+0000 7f07a6a30800 20 remove_watcher() i=5 2024-09-18T01:25:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.579+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94768584421264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107d305a0 con 0x7f07940c5060 2024-09-18T01:25:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.580+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94768584421264] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.580+0000 7f07a6a30800 20 remove_watcher() i=6 2024-09-18T01:25:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.580+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94768584423792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563107d305a0 con 0x7f07940c5060 2024-09-18T01:25:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94768584423792] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f07940c5060 2024-09-18T01:25:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 20 remove_watcher() i=7 2024-09-18T01:25:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f07940c5060 msgr2=0x7f07940c9640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f07940c5060 0x7f07940c9640 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563107ce4800 msgr2=0x563107ce6cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563107ce4800 0x563107ce6cc0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563107ce91f0 msgr2=0x563107ceb5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563107ce91f0 0x563107ceb5e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563107cedb50 msgr2=0x563107cf0010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563107cedb50 0x563107cf0010 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f066c036b40 msgr2=0x7f066c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f066c036b40 0x7f066c039000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f078c00ffd0 tx=0x7f078c023040 comp rx=0 tx=0).stop 2024-09-18T01:25:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cd1df0 msgr2=0x563107cd9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a2561640 1 -- 172.21.15.100:0/1965374173 reap_dead start 2024-09-18T01:25:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cd1df0 0x563107cd9060 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0794058f60 tx=0x7f0794077e40 comp rx=0 tx=0).stop 2024-09-18T01:25:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 shutdown_connections 2024-09-18T01:25:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 --2- 172.21.15.100:0/1965374173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cd1df0 0x563107cd9060 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 >> 172.21.15.100:0/1965374173 conn(0x563107cce150 msgr2=0x563107ccc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 shutdown_connections 2024-09-18T01:25:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.581+0000 7f07a6a30800 1 -- 172.21.15.100:0/1965374173 wait complete. 2024-09-18T01:25:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/984368062 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f067c036b90 msgr2=0x7f067c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 --2- 172.21.15.100:0/984368062 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f067c036b90 0x7f067c039050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x563107caf160 tx=0x7f078c006000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/984368062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cc5320 msgr2=0x563107cc5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 --2- 172.21.15.100:0/984368062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cc5320 0x563107cc5740 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f07940883f0 tx=0x7f0794061c30 comp rx=0 tx=0).stop 2024-09-18T01:25:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/984368062 shutdown_connections 2024-09-18T01:25:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 --2- 172.21.15.100:0/984368062 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f067c036b90 0x7f067c039050 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 --2- 172.21.15.100:0/984368062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107cc5320 0x563107cc5740 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/984368062 >> 172.21.15.100:0/984368062 conn(0x563107cba2b0 msgr2=0x563107cbce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/984368062 shutdown_connections 2024-09-18T01:25:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/984368062 wait complete. 2024-09-18T01:25:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563107cb4af0 msgr2=0x563107cb6ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563107cb4af0 0x563107cb6ee0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563107bb1740 msgr2=0x563107cae2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563107bb1740 0x563107cae2a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563107cb0bb0 msgr2=0x563107cb2fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563107cb0bb0 0x563107cb2fa0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0688036b90 msgr2=0x7f0688039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0688036b90 0x7f0688039050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f078c000c00 tx=0x7f078c0013b0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 msgr2=0x563107ca71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 --2- 172.21.15.100:0/2620330625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563107b21e10 0x563107ca71d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0794045f50 tx=0x7f0794002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a2561640 1 -- 172.21.15.100:0/2620330625 reap_dead start 2024-09-18T01:25:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 shutdown_connections 2024-09-18T01:25:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 >> 172.21.15.100:0/2620330625 conn(0x563107ba8e10 msgr2=0x563107c98c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 shutdown_connections 2024-09-18T01:25:28.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.582+0000 7f07a6a30800 1 -- 172.21.15.100:0/2620330625 wait complete. 2024-09-18T01:25:28.593 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:28.593 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:25:28.593 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:25:28.593 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:25:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.636+0000 7fa74a60e800 1 Processor -- start 2024-09-18T01:25:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.636+0000 7fa74a60e800 1 -- start start 2024-09-18T01:25:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.637+0000 7fa74a60e800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x559075b6b860 0x559075b6dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.637+0000 7fa74a60e800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559075a26b30 con 0x559075adae90 2024-09-18T01:25:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.637+0000 7fa74a60e800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x559075a08360 con 0x559075b6b860 2024-09-18T01:25:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.637+0000 7fa7455c5640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x559075b6b860 0x559075b6dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.637+0000 7fa745dc6640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x559075adae90 0x559075b6a140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37166/0 (socket says 172.21.15.100:37166) 2024-09-18T01:25:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.637+0000 7fa745dc6640 1 -- 172.21.15.100:0/2126890649 learned_addr learned my addr 172.21.15.100:0/2126890649 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.637+0000 7fa744dc4640 1 -- 172.21.15.100:0/2126890649 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1610570060 0 0) 0x559075a26b30 con 0x559075adae90 2024-09-18T01:25:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.637+0000 7fa744dc4640 1 -- 172.21.15.100:0/2126890649 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa730001e10 con 0x559075adae90 2024-09-18T01:25:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.637+0000 7fa7455c5640 1 -- 172.21.15.100:0/2126890649 >> v1:172.21.15.92:6789/0 conn(0x559075adae90 legacy=0x559075b6a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.637+0000 7fa7455c5640 1 -- 172.21.15.100:0/2126890649 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559075a2ee00 con 0x559075b6b860 2024-09-18T01:25:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.639+0000 7fa7455c5640 1 --2- 172.21.15.100:0/2126890649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075b6b860 0x559075b6dc70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00a470 tx=0x7fa73c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785fcbbf50f5a793 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.639+0000 7fa744dc4640 1 -- 172.21.15.100:0/2126890649 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73c059070 con 0x559075b6b860 2024-09-18T01:25:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.639+0000 7fa744dc4640 1 -- 172.21.15.100:0/2126890649 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73c054570 con 0x559075b6b860 2024-09-18T01:25:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.639+0000 7fa744dc4640 1 -- 172.21.15.100:0/2126890649 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73c054870 con 0x559075b6b860 2024-09-18T01:25:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.640+0000 7fa74a60e800 1 -- 172.21.15.100:0/2126890649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075b6b860 msgr2=0x559075b6dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.640+0000 7fa74a60e800 1 --2- 172.21.15.100:0/2126890649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075b6b860 0x559075b6dc70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00a470 tx=0x7fa73c045920 comp rx=0 tx=0).stop 2024-09-18T01:25:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.640+0000 7fa74a60e800 1 -- 172.21.15.100:0/2126890649 shutdown_connections 2024-09-18T01:25:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.640+0000 7fa74a60e800 1 --2- 172.21.15.100:0/2126890649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075b6b860 0x559075b6dc70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.640+0000 7fa74a60e800 1 -- 172.21.15.100:0/2126890649 >> 172.21.15.100:0/2126890649 conn(0x559075b61df0 msgr2=0x559075b64210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.640+0000 7fa74a60e800 1 -- 172.21.15.100:0/2126890649 shutdown_connections 2024-09-18T01:25:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.640+0000 7fa74a60e800 1 -- 172.21.15.100:0/2126890649 wait complete. 2024-09-18T01:25:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.653+0000 7fa74a60e800 1 Processor -- start 2024-09-18T01:25:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.653+0000 7fa74a60e800 1 -- start start 2024-09-18T01:25:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.653+0000 7fa74a60e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075adae90 0x559075c566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.653+0000 7fa74a60e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559075ab3330 con 0x559075adae90 2024-09-18T01:25:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.654+0000 7fa745dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075adae90 0x559075c566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.654+0000 7fa745dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075adae90 0x559075c566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37294/0 (socket says 172.21.15.100:37294) 2024-09-18T01:25:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.654+0000 7fa745dc6640 1 -- 172.21.15.100:0/3960888331 learned_addr learned my addr 172.21.15.100:0/3960888331 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.654+0000 7fa745dc6640 1 -- 172.21.15.100:0/3960888331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559075a00bc0 con 0x559075adae90 2024-09-18T01:25:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.654+0000 7fa745dc6640 1 --2- 172.21.15.100:0/3960888331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075adae90 0x559075c566a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa738001e30 tx=0x7fa73800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2047a8f00060240 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.655+0000 7fa633e07640 1 -- 172.21.15.100:0/3960888331 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738012020 con 0x559075adae90 2024-09-18T01:25:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.655+0000 7fa633e07640 1 -- 172.21.15.100:0/3960888331 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73800e5a0 con 0x559075adae90 2024-09-18T01:25:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.655+0000 7fa633e07640 1 -- 172.21.15.100:0/3960888331 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73800e8e0 con 0x559075adae90 2024-09-18T01:25:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.655+0000 7fa74a60e800 1 -- 172.21.15.100:0/3960888331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075adae90 msgr2=0x559075c566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.655+0000 7fa74a60e800 1 --2- 172.21.15.100:0/3960888331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075adae90 0x559075c566a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa738001e30 tx=0x7fa73800b780 comp rx=0 tx=0).stop 2024-09-18T01:25:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.655+0000 7fa74a60e800 1 -- 172.21.15.100:0/3960888331 shutdown_connections 2024-09-18T01:25:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.655+0000 7fa74a60e800 1 --2- 172.21.15.100:0/3960888331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075adae90 0x559075c566a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.655+0000 7fa74a60e800 1 -- 172.21.15.100:0/3960888331 >> 172.21.15.100:0/3960888331 conn(0x559075b61df0 msgr2=0x559075c52060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.655+0000 7fa74a60e800 1 -- 172.21.15.100:0/3960888331 shutdown_connections 2024-09-18T01:25:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.655+0000 7fa74a60e800 1 -- 172.21.15.100:0/3960888331 wait complete. 2024-09-18T01:25:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.656+0000 7fa74a60e800 1 Processor -- start 2024-09-18T01:25:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.656+0000 7fa74a60e800 1 -- start start 2024-09-18T01:25:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.656+0000 7fa74a60e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075adae90 0x559075c5e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.656+0000 7fa74a60e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559075b6e5f0 con 0x559075adae90 2024-09-18T01:25:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.656+0000 7fa745dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075adae90 0x559075c5e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.656+0000 7fa745dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075adae90 0x559075c5e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37296/0 (socket says 172.21.15.100:37296) 2024-09-18T01:25:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.656+0000 7fa745dc6640 1 -- 172.21.15.100:0/551874203 learned_addr learned my addr 172.21.15.100:0/551874203 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.656+0000 7fa745dc6640 1 -- 172.21.15.100:0/551874203 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559075a14fe0 con 0x559075adae90 2024-09-18T01:25:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.657+0000 7fa745dc6640 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075adae90 0x559075c5e0b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa738001e30 tx=0x7fa738000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.657+0000 7fa632604640 1 -- 172.21.15.100:0/551874203 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738012030 con 0x559075adae90 2024-09-18T01:25:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.657+0000 7fa632604640 1 -- 172.21.15.100:0/551874203 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73801a7a0 con 0x559075adae90 2024-09-18T01:25:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.657+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559075c5e5f0 con 0x559075adae90 2024-09-18T01:25:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.657+0000 7fa632604640 1 -- 172.21.15.100:0/551874203 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73801aaa0 con 0x559075adae90 2024-09-18T01:25:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.657+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559075c5eb10 con 0x559075adae90 2024-09-18T01:25:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.657+0000 7fa632604640 1 -- 172.21.15.100:0/551874203 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa738015020 con 0x559075adae90 2024-09-18T01:25:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.658+0000 7fa632604640 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa62c036b90 0x7fa62c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.658+0000 7fa632604640 1 -- 172.21.15.100:0/551874203 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa738020030 con 0x559075adae90 2024-09-18T01:25:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.658+0000 7fa7455c5640 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa62c036b90 0x7fa62c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.658+0000 7fa74a60e800 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559075b6b860 0x559075c65120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.658+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075c65660 con 0x559075b6b860 2024-09-18T01:25:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.658+0000 7fa7465c7640 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559075b6b860 0x559075c65120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.658+0000 7fa7455c5640 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa62c036b90 0x7fa62c039050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x559075ada5d0 tx=0x7fa73c050000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.658+0000 7fa7465c7640 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559075b6b860 0x559075c65120 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.659+0000 7fa7465c7640 1 -- 172.21.15.100:0/551874203 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075b6b860 2024-09-18T01:25:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.659+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075c626f0 con 0x559075b6b860 2024-09-18T01:25:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.659+0000 7fa7465c7640 1 -- 172.21.15.100:0/551874203 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075b6b860 2024-09-18T01:25:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.659+0000 7fa74a60e800 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559075c67950 0x559075c69d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.659+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075c6a430 con 0x559075c67950 2024-09-18T01:25:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.659+0000 7fa745dc6640 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559075c67950 0x559075c69d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.659+0000 7fa745dc6640 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559075c67950 0x559075c69d40 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.660+0000 7fa745dc6640 1 -- 172.21.15.100:0/551874203 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa738018970 con 0x559075c67950 2024-09-18T01:25:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.660+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075c667f0 con 0x559075b6b860 2024-09-18T01:25:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.660+0000 7fa7465c7640 1 -- 172.21.15.100:0/551874203 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075b6b860 2024-09-18T01:25:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.660+0000 7fa74a60e800 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559075c6b890 0x559075c6dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.660+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075c6e380 con 0x559075c6b890 2024-09-18T01:25:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.660+0000 7fa7455c5640 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559075c6b890 0x559075c6dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.660+0000 7fa7455c5640 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559075c6b890 0x559075c6dc80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.661+0000 7fa7455c5640 1 -- 172.21.15.100:0/551874203 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa73c05c040 con 0x559075c6b890 2024-09-18T01:25:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.661+0000 7fa74a60e800 1 Processor -- start 2024-09-18T01:25:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.661+0000 7fa74a60e800 1 -- start start 2024-09-18T01:25:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.661+0000 7fa74a60e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075b67b10 0x559075b66160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.661+0000 7fa74a60e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559075a02580 con 0x559075b67b10 2024-09-18T01:25:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.661+0000 7fa745dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075b67b10 0x559075b66160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.661+0000 7fa745dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075b67b10 0x559075b66160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37298/0 (socket says 172.21.15.100:37298) 2024-09-18T01:25:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.661+0000 7fa745dc6640 1 -- 172.21.15.100:0/934821627 learned_addr learned my addr 172.21.15.100:0/934821627 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.662+0000 7fa745dc6640 1 -- 172.21.15.100:0/934821627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559075b67f30 con 0x559075b67b10 2024-09-18T01:25:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.662+0000 7fa745dc6640 1 --2- 172.21.15.100:0/934821627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075b67b10 0x559075b66160 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa73804af70 tx=0x7fa73802de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.662+0000 7fa62b7fe640 1 -- 172.21.15.100:0/934821627 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738049180 con 0x559075b67b10 2024-09-18T01:25:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.662+0000 7fa62b7fe640 1 -- 172.21.15.100:0/934821627 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73804c350 con 0x559075b67b10 2024-09-18T01:25:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.662+0000 7fa62b7fe640 1 -- 172.21.15.100:0/934821627 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73804c630 con 0x559075b67b10 2024-09-18T01:25:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.662+0000 7fa74a60e800 1 -- 172.21.15.100:0/934821627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559075b66760 con 0x559075b67b10 2024-09-18T01:25:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.662+0000 7fa74a60e800 1 -- 172.21.15.100:0/934821627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559075b66c60 con 0x559075b67b10 2024-09-18T01:25:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.663+0000 7fa62b7fe640 1 -- 172.21.15.100:0/934821627 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa73803c060 con 0x559075b67b10 2024-09-18T01:25:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.663+0000 7fa62b7fe640 1 --2- 172.21.15.100:0/934821627 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa620036b90 0x7fa620039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.663+0000 7fa62b7fe640 1 -- 172.21.15.100:0/934821627 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa738036c50 con 0x559075b67b10 2024-09-18T01:25:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.663+0000 7fa7455c5640 1 --2- 172.21.15.100:0/934821627 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa620036b90 0x7fa620039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.663+0000 7fa74a60e800 1 Processor -- start 2024-09-18T01:25:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.663+0000 7fa74a60e800 1 -- start start 2024-09-18T01:25:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.663+0000 7fa7455c5640 1 --2- 172.21.15.100:0/934821627 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa620036b90 0x7fa620039050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x559075c65f00 tx=0x7fa73c005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.664+0000 7fa74a60e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075c8ad50 0x559075c8b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.664+0000 7fa74a60e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559075c56e50 con 0x559075c8ad50 2024-09-18T01:25:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.664+0000 7fa745dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075c8ad50 0x559075c8b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.664+0000 7fa745dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075c8ad50 0x559075c8b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37300/0 (socket says 172.21.15.100:37300) 2024-09-18T01:25:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.664+0000 7fa745dc6640 1 -- 172.21.15.100:0/1059430732 learned_addr learned my addr 172.21.15.100:0/1059430732 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.664+0000 7fa745dc6640 1 -- 172.21.15.100:0/1059430732 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559075c8b720 con 0x559075c8ad50 2024-09-18T01:25:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.664+0000 7fa745dc6640 1 --2- 172.21.15.100:0/1059430732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075c8ad50 0x559075c8b150 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa738044530 tx=0x7fa738024600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca839303de46eb60 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.664+0000 7fa6297fa640 1 -- 172.21.15.100:0/1059430732 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73805d070 con 0x559075c8ad50 2024-09-18T01:25:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.664+0000 7fa6297fa640 1 -- 172.21.15.100:0/1059430732 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73802d3f0 con 0x559075c8ad50 2024-09-18T01:25:28.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.664+0000 7fa6297fa640 1 -- 172.21.15.100:0/1059430732 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73800c360 con 0x559075c8ad50 2024-09-18T01:25:28.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.665+0000 7fa74a60e800 1 -- 172.21.15.100:0/1059430732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075c8ad50 msgr2=0x559075c8b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.665+0000 7fa74a60e800 1 --2- 172.21.15.100:0/1059430732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075c8ad50 0x559075c8b150 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa738044530 tx=0x7fa738024600 comp rx=0 tx=0).stop 2024-09-18T01:25:28.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.665+0000 7fa74a60e800 1 -- 172.21.15.100:0/1059430732 shutdown_connections 2024-09-18T01:25:28.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.665+0000 7fa74a60e800 1 --2- 172.21.15.100:0/1059430732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075c8ad50 0x559075c8b150 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.665+0000 7fa74a60e800 1 -- 172.21.15.100:0/1059430732 >> 172.21.15.100:0/1059430732 conn(0x559075c87150 msgr2=0x559075c85250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.665+0000 7fa74a60e800 1 -- 172.21.15.100:0/1059430732 shutdown_connections 2024-09-18T01:25:28.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.665+0000 7fa74a60e800 1 -- 172.21.15.100:0/1059430732 wait complete. 2024-09-18T01:25:28.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.665+0000 7fa74a60e800 1 Processor -- start 2024-09-18T01:25:28.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.665+0000 7fa74a60e800 1 -- start start 2024-09-18T01:25:28.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.665+0000 7fa74a60e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075c8ad50 0x559075c91ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.665+0000 7fa74a60e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559075c8bc00 con 0x559075c8ad50 2024-09-18T01:25:28.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.665+0000 7fa745dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075c8ad50 0x559075c91ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.665+0000 7fa745dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075c8ad50 0x559075c91ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37306/0 (socket says 172.21.15.100:37306) 2024-09-18T01:25:28.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.665+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 learned_addr learned my addr 172.21.15.100:0/2281804391 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.666+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559075c92530 con 0x559075c8ad50 2024-09-18T01:25:28.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.666+0000 7fa745dc6640 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075c8ad50 0x559075c91ff0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa73805b040 tx=0x7fa738003220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.666+0000 7fa6177fe640 1 -- 172.21.15.100:0/2281804391 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738067030 con 0x559075c8ad50 2024-09-18T01:25:28.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.666+0000 7fa6177fe640 1 -- 172.21.15.100:0/2281804391 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73800cac0 con 0x559075c8ad50 2024-09-18T01:25:28.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.666+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559075c92530 con 0x559075c8ad50 2024-09-18T01:25:28.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.666+0000 7fa6177fe640 1 -- 172.21.15.100:0/2281804391 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73805d040 con 0x559075c8ad50 2024-09-18T01:25:28.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.666+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559075c92530 con 0x559075c8ad50 2024-09-18T01:25:28.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.667+0000 7fa6177fe640 1 -- 172.21.15.100:0/2281804391 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa73806a030 con 0x559075c8ad50 2024-09-18T01:25:28.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.667+0000 7fa6177fe640 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa610036b90 0x7fa610039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.667+0000 7fa6177fe640 1 -- 172.21.15.100:0/2281804391 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa738068070 con 0x559075c8ad50 2024-09-18T01:25:28.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.667+0000 7fa7455c5640 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa610036b90 0x7fa610039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.667+0000 7fa74a60e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.667+0000 7fa74a60e800 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559075c9d700 0x559075c9fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.667+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075ca0310 con 0x559075c9d700 2024-09-18T01:25:28.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.667+0000 7fa7465c7640 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559075c9d700 0x559075c9fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa7455c5640 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa610036b90 0x7fa610039050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa73c054fd0 tx=0x7fa73c062040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa7465c7640 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559075c9d700 0x559075c9fbc0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa74a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa74a60e800 20 realm 2024-09-18T01:25:28.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa74a60e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075ca0720 con 0x559075c9d700 2024-09-18T01:25:28.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa74a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa74a60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:28.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa74a60e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075ca0ff0 con 0x559075c9d700 2024-09-18T01:25:28.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa74a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa74a60e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.668+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075c9d700 2024-09-18T01:25:28.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.669+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.669+0000 7fa74a60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.669+0000 7fa74a60e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.669+0000 7fa74a60e800 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559075ca1e80 0x559075ca4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.669+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075ca49d0 con 0x559075ca1e80 2024-09-18T01:25:28.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.669+0000 7fa745dc6640 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559075ca1e80 0x559075ca4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.669+0000 7fa745dc6640 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559075ca1e80 0x559075ca4270 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.669+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa738073070 con 0x559075ca1e80 2024-09-18T01:25:28.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.669+0000 7fa74a60e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:28.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.669+0000 7fa74a60e800 20 searching for the correct realm 2024-09-18T01:25:28.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.669+0000 7fa74a60e800 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559075ca6a80 0x559075ca8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.669+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca9610 con 0x559075ca6a80 2024-09-18T01:25:28.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.670+0000 7fa7455c5640 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559075ca6a80 0x559075ca8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.670+0000 7fa7455c5640 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559075ca6a80 0x559075ca8f40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.670+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c072030 con 0x559075ca6a80 2024-09-18T01:25:28.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.670+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca9610 con 0x559075ca1e80 2024-09-18T01:25:28.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.670+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa738073070 con 0x559075ca1e80 2024-09-18T01:25:28.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.670+0000 7fa745dc6640 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa73803e070 0x7fa7380163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.670+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca9610 con 0x7fa73803e070 2024-09-18T01:25:28.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.671+0000 7fa7465c7640 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa73803e070 0x7fa7380163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.671+0000 7fa7465c7640 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa73803e070 0x7fa7380163b0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.671+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.671+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075c9d700 2024-09-18T01:25:28.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.671+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.671+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075c9d700 2024-09-18T01:25:28.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.671+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.672+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x7fa73803e070 2024-09-18T01:25:28.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.672+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.672+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x7fa73803e070 2024-09-18T01:25:28.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.672+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.672+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075ca1e80 2024-09-18T01:25:28.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.672+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa738073070 con 0x559075ca1e80 2024-09-18T01:25:28.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.672+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075ca6a80 2024-09-18T01:25:28.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.672+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c072030 con 0x559075ca6a80 2024-09-18T01:25:28.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.672+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075c9d700 2024-09-18T01:25:28.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.673+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.673+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x7fa73803e070 2024-09-18T01:25:28.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.673+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.673+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075c9d700 2024-09-18T01:25:28.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.673+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.673+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075ca1e80 2024-09-18T01:25:28.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.673+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa738073070 con 0x559075ca1e80 2024-09-18T01:25:28.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.673+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075ca6a80 2024-09-18T01:25:28.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.674+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c072030 con 0x559075ca6a80 2024-09-18T01:25:28.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.674+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075ca6a80 2024-09-18T01:25:28.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.674+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c072030 con 0x559075ca6a80 2024-09-18T01:25:28.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.674+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x7fa73803e070 2024-09-18T01:25:28.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.674+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.674+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075ca6a80 2024-09-18T01:25:28.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.674+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c072030 con 0x559075ca6a80 2024-09-18T01:25:28.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.674+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075ca6a80 2024-09-18T01:25:28.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.674+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c072030 con 0x559075ca6a80 2024-09-18T01:25:28.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.674+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075c9d700 2024-09-18T01:25:28.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.675+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.675+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075c9d700 2024-09-18T01:25:28.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.675+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.675+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x7fa73803e070 2024-09-18T01:25:28.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.675+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.675+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075ca6a80 2024-09-18T01:25:28.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.675+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c072030 con 0x559075ca6a80 2024-09-18T01:25:28.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.675+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075ca1e80 2024-09-18T01:25:28.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.675+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa738073070 con 0x559075ca1e80 2024-09-18T01:25:28.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.675+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075c9d700 2024-09-18T01:25:28.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.676+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.676+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x7fa73803e070 2024-09-18T01:25:28.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.676+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.676+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075ca6a80 2024-09-18T01:25:28.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.676+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c072030 con 0x559075ca6a80 2024-09-18T01:25:28.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.676+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x7fa73803e070 2024-09-18T01:25:28.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.676+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.676+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075ca1e80 2024-09-18T01:25:28.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.677+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa738073070 con 0x559075ca1e80 2024-09-18T01:25:28.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.677+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075ca6a80 2024-09-18T01:25:28.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.677+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c072030 con 0x559075ca6a80 2024-09-18T01:25:28.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.677+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x7fa73803e070 2024-09-18T01:25:28.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.677+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.677+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075c9d700 2024-09-18T01:25:28.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.677+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.677+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559075ca1390 con 0x559075ca1e80 2024-09-18T01:25:28.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa738073070 con 0x559075ca1e80 2024-09-18T01:25:28.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:28.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:28.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:28.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:28.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:28.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:28.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075ca5380 con 0x559075c9d700 2024-09-18T01:25:28.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075ca5770 con 0x559075c9d700 2024-09-18T01:25:28.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075ca5770 con 0x7fa73803e070 2024-09-18T01:25:28.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:28.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 zone default found 2024-09-18T01:25:28.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 4 Realm: () 2024-09-18T01:25:28.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:28.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:28.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:28.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 zonegroup default 2024-09-18T01:25:28.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.678+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075ca5b90 con 0x7fa73803e070 2024-09-18T01:25:28.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.679+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.679+0000 7fa74a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.679+0000 7fa74a60e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.679+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075ca5b90 con 0x559075ca6a80 2024-09-18T01:25:28.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.679+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa73c072030 con 0x559075ca6a80 2024-09-18T01:25:28.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.679+0000 7fa74a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.679+0000 7fa74a60e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.679+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075cab470 con 0x559075ca6a80 2024-09-18T01:25:28.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.679+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa73c072030 con 0x559075ca6a80 2024-09-18T01:25:28.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.679+0000 7fa74a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.679+0000 7fa74a60e800 20 started sync module instance, tier type = 2024-09-18T01:25:28.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.679+0000 7fa74a60e800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:28.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.679+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075caa910 con 0x559075ca1e80 2024-09-18T01:25:28.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.680+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa738073070 con 0x559075ca1e80 2024-09-18T01:25:28.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.680+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94078939868464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cabcc0 con 0x559075ca1e80 2024-09-18T01:25:28.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.680+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cac510 con 0x559075c9d700 2024-09-18T01:25:28.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.681+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94078939868464] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa738073070 con 0x559075ca1e80 2024-09-18T01:25:28.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.681+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.681+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94078939871248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cac510 con 0x559075c9d700 2024-09-18T01:25:28.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.681+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cacff0 con 0x559075ca6a80 2024-09-18T01:25:28.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.682+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c072030 con 0x559075ca6a80 2024-09-18T01:25:28.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.682+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94078939876096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cad8c0 con 0x559075ca6a80 2024-09-18T01:25:28.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.682+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cae3c0 con 0x559075ca1e80 2024-09-18T01:25:28.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.682+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94078939871248] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.683+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94078939876096] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c072030 con 0x559075ca6a80 2024-09-18T01:25:28.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.683+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa738073070 con 0x559075ca1e80 2024-09-18T01:25:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.683+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94078939881136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cae7b0 con 0x559075ca1e80 2024-09-18T01:25:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.683+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075caf000 con 0x559075c9d700 2024-09-18T01:25:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.684+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.684+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94078939883920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075caf480 con 0x559075c9d700 2024-09-18T01:25:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.684+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075caff90 con 0x7fa73803e070 2024-09-18T01:25:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.684+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94078939881136] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa738073070 con 0x559075ca1e80 2024-09-18T01:25:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.685+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.685+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94078939888192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075caff50 con 0x7fa73803e070 2024-09-18T01:25:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.685+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cb0950 con 0x7fa73803e070 2024-09-18T01:25:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.685+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94078939883920] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.686+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94078939888192] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.686+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.686+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94078939873376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cb0460 con 0x7fa73803e070 2024-09-18T01:25:28.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.686+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cb0e20 con 0x7fa73803e070 2024-09-18T01:25:28.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.687+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.687+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94078939892080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cb1240 con 0x7fa73803e070 2024-09-18T01:25:28.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.687+0000 7fa74a60e800 20 add_watcher() i=0 2024-09-18T01:25:28.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.687+0000 7fa74a60e800 20 add_watcher() i=1 2024-09-18T01:25:28.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.687+0000 7fa74a60e800 20 add_watcher() i=2 2024-09-18T01:25:28.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.687+0000 7fa74a60e800 20 add_watcher() i=3 2024-09-18T01:25:28.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.687+0000 7fa74a60e800 20 add_watcher() i=4 2024-09-18T01:25:28.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.687+0000 7fa74a60e800 20 add_watcher() i=5 2024-09-18T01:25:28.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.687+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94078939873376] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.687+0000 7fa74a60e800 20 add_watcher() i=6 2024-09-18T01:25:28.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.688+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94078939892080] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.688+0000 7fa74a60e800 20 add_watcher() i=7 2024-09-18T01:25:28.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.688+0000 7fa74a60e800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:28.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.688+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075cb1240 con 0x559075c9d700 2024-09-18T01:25:28.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.688+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.688+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94078939893136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cb11b0 con 0x559075c9d700 2024-09-18T01:25:28.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.689+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94078939893136] v33'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.689+0000 7fa5f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.690+0000 7fa74a60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:28.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.690+0000 7fa74a60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:28.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.690+0000 7fa74a60e800 5 note: GC not initialized 2024-09-18T01:25:28.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.690+0000 7fa5f67fc640 20 reqs_thread_entry: start 2024-09-18T01:25:28.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.690+0000 7fa74a60e800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:28.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.690+0000 7fa74a60e800 20 Filter name: none 2024-09-18T01:25:28.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.690+0000 7fa567fff640 20 reqs_thread_entry: start 2024-09-18T01:25:28.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.690+0000 7fa74a60e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.690+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559075ce7130 con 0x559075c9d700 2024-09-18T01:25:28.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.691+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.691+0000 7fa74a60e800 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T01:25:28.706 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:28.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.692+0000 7fa5f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.692+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94078939893136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075ce5b80 con 0x559075c9d700 2024-09-18T01:25:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.693+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94078939893136] v33'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.693+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94078939868464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cb0d90 con 0x559075ca1e80 2024-09-18T01:25:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.694+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94078939868464] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa738073070 con 0x559075ca1e80 2024-09-18T01:25:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.694+0000 7fa74a60e800 20 remove_watcher() i=0 2024-09-18T01:25:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.694+0000 7fa74a60e800 2 removed watcher, disabling cache 2024-09-18T01:25:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.694+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94078939871248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cb0d90 con 0x559075c9d700 2024-09-18T01:25:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.695+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94078939871248] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.695+0000 7fa74a60e800 20 remove_watcher() i=1 2024-09-18T01:25:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.695+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94078939876096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cab810 con 0x559075ca6a80 2024-09-18T01:25:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.696+0000 7fa7455c5640 1 -- 172.21.15.100:0/2281804391 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94078939876096] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c072030 con 0x559075ca6a80 2024-09-18T01:25:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.696+0000 7fa74a60e800 20 remove_watcher() i=2 2024-09-18T01:25:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.696+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94078939881136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cb0d90 con 0x559075ca1e80 2024-09-18T01:25:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.697+0000 7fa745dc6640 1 -- 172.21.15.100:0/2281804391 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94078939881136] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa738073070 con 0x559075ca1e80 2024-09-18T01:25:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.697+0000 7fa74a60e800 20 remove_watcher() i=3 2024-09-18T01:25:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.697+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94078939883920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cadeb0 con 0x559075c9d700 2024-09-18T01:25:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.698+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94078939883920] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x559075c9d700 2024-09-18T01:25:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.698+0000 7fa74a60e800 20 remove_watcher() i=4 2024-09-18T01:25:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.698+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94078939888192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cb0d90 con 0x7fa73803e070 2024-09-18T01:25:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.699+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94078939888192] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.699+0000 7fa74a60e800 20 remove_watcher() i=5 2024-09-18T01:25:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.699+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94078939873376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cae990 con 0x7fa73803e070 2024-09-18T01:25:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.700+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94078939873376] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.700+0000 7fa74a60e800 20 remove_watcher() i=6 2024-09-18T01:25:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.700+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94078939892080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559075cadeb0 con 0x7fa73803e070 2024-09-18T01:25:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94078939892080] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x7fa73803e070 2024-09-18T01:25:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 20 remove_watcher() i=7 2024-09-18T01:25:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa73803e070 msgr2=0x7fa7380163b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa73803e070 0x7fa7380163b0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559075c9d700 msgr2=0x559075c9fbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559075c9d700 0x559075c9fbc0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559075ca1e80 msgr2=0x559075ca4270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559075ca1e80 0x559075ca4270 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559075ca6a80 msgr2=0x559075ca8f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559075ca6a80 0x559075ca8f40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa610036b90 msgr2=0x7fa610039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa610036b90 0x7fa610039050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa73c054fd0 tx=0x7fa73c062040 comp rx=0 tx=0).stop 2024-09-18T01:25:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075c8ad50 msgr2=0x559075c91ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 --2- 172.21.15.100:0/2281804391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075c8ad50 0x559075c91ff0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa73805b040 tx=0x7fa738003220 comp rx=0 tx=0).stop 2024-09-18T01:25:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 reap_dead start 2024-09-18T01:25:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa7465c7640 1 -- 172.21.15.100:0/2281804391 reap_dead start 2024-09-18T01:25:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 shutdown_connections 2024-09-18T01:25:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 >> 172.21.15.100:0/2281804391 conn(0x559075c87150 msgr2=0x559075c85220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 shutdown_connections 2024-09-18T01:25:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.701+0000 7fa74a60e800 1 -- 172.21.15.100:0/2281804391 wait complete. 2024-09-18T01:25:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/934821627 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa620036b90 msgr2=0x7fa620039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 --2- 172.21.15.100:0/934821627 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa620036b90 0x7fa620039050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x559075c65f00 tx=0x7fa73c005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/934821627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075b67b10 msgr2=0x559075b66160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 --2- 172.21.15.100:0/934821627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075b67b10 0x559075b66160 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa73804af70 tx=0x7fa73802de90 comp rx=0 tx=0).stop 2024-09-18T01:25:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/934821627 shutdown_connections 2024-09-18T01:25:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 --2- 172.21.15.100:0/934821627 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa620036b90 0x7fa620039050 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 --2- 172.21.15.100:0/934821627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075b67b10 0x559075b66160 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/934821627 >> 172.21.15.100:0/934821627 conn(0x559075c710c0 msgr2=0x559075c73c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/934821627 shutdown_connections 2024-09-18T01:25:28.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/934821627 wait complete. 2024-09-18T01:25:28.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559075c6b890 msgr2=0x559075c6dc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559075c6b890 0x559075c6dc80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559075b6b860 msgr2=0x559075c65120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559075b6b860 0x559075c65120 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559075c67950 msgr2=0x559075c69d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559075c67950 0x559075c69d40 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa62c036b90 msgr2=0x7fa62c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa62c036b90 0x7fa62c039050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x559075ada5d0 tx=0x7fa73c050000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075adae90 msgr2=0x559075c5e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 --2- 172.21.15.100:0/551874203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559075adae90 0x559075c5e0b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa738001e30 tx=0x7fa738000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa7465c7640 1 -- 172.21.15.100:0/551874203 reap_dead start 2024-09-18T01:25:28.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 shutdown_connections 2024-09-18T01:25:28.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 >> 172.21.15.100:0/551874203 conn(0x559075b61df0 msgr2=0x559075c50910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 shutdown_connections 2024-09-18T01:25:28.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.702+0000 7fa74a60e800 1 -- 172.21.15.100:0/551874203 wait complete. 2024-09-18T01:25:28.717 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:28.717 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:25:28.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:25:28.717 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:25:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:28.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.760+0000 7f88ab211800 1 Processor -- start 2024-09-18T01:25:28.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.760+0000 7f88ab211800 1 -- start start 2024-09-18T01:25:28.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.761+0000 7f88ab211800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55792f6685f0 0x55792f6f9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.761+0000 7f88ab211800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55792f5b3b30 con 0x55792f6f9bd0 2024-09-18T01:25:28.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.761+0000 7f88ab211800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55792f595360 con 0x55792f6685f0 2024-09-18T01:25:28.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.761+0000 7f88a693d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55792f6685f0 0x55792f6f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.761+0000 7f88a613c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55792f6f9bd0 0x55792f6fbfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37180/0 (socket says 172.21.15.100:37180) 2024-09-18T01:25:28.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.761+0000 7f88a693d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55792f6685f0 0x55792f6f9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37310/0 (socket says 172.21.15.100:37310) 2024-09-18T01:25:28.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.761+0000 7f88a613c640 1 -- 172.21.15.100:0/621637743 learned_addr learned my addr 172.21.15.100:0/621637743 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:28.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.761+0000 7f88a693d640 1 -- 172.21.15.100:0/621637743 >> v1:172.21.15.92:6789/0 conn(0x55792f6f9bd0 legacy=0x55792f6fbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.761+0000 7f88a693d640 1 -- 172.21.15.100:0/621637743 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55792f5bbe00 con 0x55792f6685f0 2024-09-18T01:25:28.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.763+0000 7f88a693d640 1 --2- 172.21.15.100:0/621637743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 0x55792f6f9690 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8898005fd0 tx=0x7f8898045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c655f890530ee58e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.763+0000 7f88a593b640 1 -- 172.21.15.100:0/621637743 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8898058530 con 0x55792f6685f0 2024-09-18T01:25:28.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.763+0000 7f88a593b640 1 -- 172.21.15.100:0/621637743 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88980586d0 con 0x55792f6685f0 2024-09-18T01:25:28.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.763+0000 7f88a593b640 1 -- 172.21.15.100:0/621637743 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88980589d0 con 0x55792f6685f0 2024-09-18T01:25:28.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.764+0000 7f88ab211800 1 -- 172.21.15.100:0/621637743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 msgr2=0x55792f6f9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.764+0000 7f88ab211800 1 --2- 172.21.15.100:0/621637743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 0x55792f6f9690 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8898005fd0 tx=0x7f8898045c30 comp rx=0 tx=0).stop 2024-09-18T01:25:28.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.764+0000 7f88ab211800 1 -- 172.21.15.100:0/621637743 shutdown_connections 2024-09-18T01:25:28.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.764+0000 7f88ab211800 1 --2- 172.21.15.100:0/621637743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 0x55792f6f9690 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.764+0000 7f88ab211800 1 -- 172.21.15.100:0/621637743 >> 172.21.15.100:0/621637743 conn(0x55792f6eede0 msgr2=0x55792f6f1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.764+0000 7f88ab211800 1 -- 172.21.15.100:0/621637743 shutdown_connections 2024-09-18T01:25:28.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.764+0000 7f88ab211800 1 -- 172.21.15.100:0/621637743 wait complete. 2024-09-18T01:25:28.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.777+0000 7f88ab211800 1 Processor -- start 2024-09-18T01:25:28.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.778+0000 7f88ab211800 1 -- start start 2024-09-18T01:25:28.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.778+0000 7f88ab211800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 0x55792f7e5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.778+0000 7f88ab211800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55792f640330 con 0x55792f6685f0 2024-09-18T01:25:28.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.778+0000 7f88a693d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 0x55792f7e5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.778+0000 7f88a693d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 0x55792f7e5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37320/0 (socket says 172.21.15.100:37320) 2024-09-18T01:25:28.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.778+0000 7f88a693d640 1 -- 172.21.15.100:0/617745924 learned_addr learned my addr 172.21.15.100:0/617745924 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.778+0000 7f88a693d640 1 -- 172.21.15.100:0/617745924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55792f58dbc0 con 0x55792f6685f0 2024-09-18T01:25:28.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.779+0000 7f88a693d640 1 --2- 172.21.15.100:0/617745924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 0x55792f7e5ac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f889800a3f0 tx=0x7f8898051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f7891f72bbd662 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.779+0000 7f8794e09640 1 -- 172.21.15.100:0/617745924 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88980589b0 con 0x55792f6685f0 2024-09-18T01:25:28.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.779+0000 7f8794e09640 1 -- 172.21.15.100:0/617745924 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8898068070 con 0x55792f6685f0 2024-09-18T01:25:28.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.779+0000 7f8794e09640 1 -- 172.21.15.100:0/617745924 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8898058c80 con 0x55792f6685f0 2024-09-18T01:25:28.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.779+0000 7f88ab211800 1 -- 172.21.15.100:0/617745924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 msgr2=0x55792f7e5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.779+0000 7f88ab211800 1 --2- 172.21.15.100:0/617745924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 0x55792f7e5ac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f889800a3f0 tx=0x7f8898051000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.779+0000 7f88ab211800 1 -- 172.21.15.100:0/617745924 shutdown_connections 2024-09-18T01:25:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.779+0000 7f88ab211800 1 --2- 172.21.15.100:0/617745924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 0x55792f7e5ac0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.779+0000 7f88ab211800 1 -- 172.21.15.100:0/617745924 >> 172.21.15.100:0/617745924 conn(0x55792f6eede0 msgr2=0x55792f7e1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.779+0000 7f88ab211800 1 -- 172.21.15.100:0/617745924 shutdown_connections 2024-09-18T01:25:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.779+0000 7f88ab211800 1 -- 172.21.15.100:0/617745924 wait complete. 2024-09-18T01:25:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.780+0000 7f88ab211800 1 Processor -- start 2024-09-18T01:25:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.780+0000 7f88ab211800 1 -- start start 2024-09-18T01:25:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.780+0000 7f88ab211800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 0x55792f7ed320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.780+0000 7f88ab211800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55792f6fd980 con 0x55792f6685f0 2024-09-18T01:25:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.780+0000 7f88a693d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 0x55792f7ed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.780+0000 7f88a693d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 0x55792f7ed320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37330/0 (socket says 172.21.15.100:37330) 2024-09-18T01:25:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.780+0000 7f88a693d640 1 -- 172.21.15.100:0/2762895282 learned_addr learned my addr 172.21.15.100:0/2762895282 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.781+0000 7f88a693d640 1 -- 172.21.15.100:0/2762895282 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55792f5a1fe0 con 0x55792f6685f0 2024-09-18T01:25:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.781+0000 7f88a693d640 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 0x55792f7ed320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8898065040 tx=0x7f8898003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.781+0000 7f8793606640 1 -- 172.21.15.100:0/2762895282 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8898063570 con 0x55792f6685f0 2024-09-18T01:25:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.781+0000 7f8793606640 1 -- 172.21.15.100:0/2762895282 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8898063710 con 0x55792f6685f0 2024-09-18T01:25:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.781+0000 7f8793606640 1 -- 172.21.15.100:0/2762895282 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8898063a10 con 0x55792f6685f0 2024-09-18T01:25:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.781+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55792f7ed860 con 0x55792f6685f0 2024-09-18T01:25:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.781+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55792f7edd80 con 0x55792f6685f0 2024-09-18T01:25:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.782+0000 7f8793606640 1 -- 172.21.15.100:0/2762895282 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8898075020 con 0x55792f6685f0 2024-09-18T01:25:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.782+0000 7f8793606640 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f878c036b40 0x7f878c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.782+0000 7f8793606640 1 -- 172.21.15.100:0/2762895282 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8898090d30 con 0x55792f6685f0 2024-09-18T01:25:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.782+0000 7f88a613c640 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f878c036b40 0x7f878c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.782+0000 7f88ab211800 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55792f6f9bd0 0x55792f7f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.782+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f7f48d0 con 0x55792f6f9bd0 2024-09-18T01:25:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.782+0000 7f88a713e640 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55792f6f9bd0 0x55792f7f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.782+0000 7f88a613c640 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f878c036b40 0x7f878c039000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8890000f60 tx=0x7f88900012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.783+0000 7f88a713e640 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55792f6f9bd0 0x55792f7f4390 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.783+0000 7f88a713e640 1 -- 172.21.15.100:0/2762895282 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88a00083e0 con 0x55792f6f9bd0 2024-09-18T01:25:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.783+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f7f1940 con 0x55792f6f9bd0 2024-09-18T01:25:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.783+0000 7f88a713e640 1 -- 172.21.15.100:0/2762895282 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88a00083e0 con 0x55792f6f9bd0 2024-09-18T01:25:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.783+0000 7f88ab211800 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55792f7f6c00 0x55792f7f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.783+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f7f96e0 con 0x55792f7f6c00 2024-09-18T01:25:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.783+0000 7f88a693d640 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55792f7f6c00 0x55792f7f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.783+0000 7f88a693d640 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55792f7f6c00 0x55792f7f8ff0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.784+0000 7f88a693d640 1 -- 172.21.15.100:0/2762895282 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8898077930 con 0x55792f7f6c00 2024-09-18T01:25:28.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.784+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f7f5aa0 con 0x55792f6f9bd0 2024-09-18T01:25:28.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.784+0000 7f88a713e640 1 -- 172.21.15.100:0/2762895282 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88a00083e0 con 0x55792f6f9bd0 2024-09-18T01:25:28.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.784+0000 7f88ab211800 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55792f7fab40 0x55792f7fcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.784+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f7fd5f0 con 0x55792f7fab40 2024-09-18T01:25:28.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.784+0000 7f88a613c640 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55792f7fab40 0x55792f7fcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.785+0000 7f88a613c640 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55792f7fab40 0x55792f7fcf30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.785+0000 7f88a613c640 1 -- 172.21.15.100:0/2762895282 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8890009050 con 0x55792f7fab40 2024-09-18T01:25:28.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.785+0000 7f88ab211800 1 Processor -- start 2024-09-18T01:25:28.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.785+0000 7f88ab211800 1 -- start start 2024-09-18T01:25:28.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.785+0000 7f88ab211800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f80b3a0 0x55792f80b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.786+0000 7f88ab211800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55792f58f580 con 0x55792f80b3a0 2024-09-18T01:25:28.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.786+0000 7f88a693d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f80b3a0 0x55792f80b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.786+0000 7f88a693d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f80b3a0 0x55792f80b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37340/0 (socket says 172.21.15.100:37340) 2024-09-18T01:25:28.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.786+0000 7f88a693d640 1 -- 172.21.15.100:0/934345749 learned_addr learned my addr 172.21.15.100:0/934345749 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.786+0000 7f88a693d640 1 -- 172.21.15.100:0/934345749 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55792f80bd00 con 0x55792f80b3a0 2024-09-18T01:25:28.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.786+0000 7f88a693d640 1 --2- 172.21.15.100:0/934345749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f80b3a0 0x55792f80b7c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f889804ffd0 tx=0x7f8898063ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.786+0000 7f8790e01640 1 -- 172.21.15.100:0/934345749 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88980803f0 con 0x55792f80b3a0 2024-09-18T01:25:28.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.786+0000 7f8790e01640 1 -- 172.21.15.100:0/934345749 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8898080590 con 0x55792f80b3a0 2024-09-18T01:25:28.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.786+0000 7f88ab211800 1 -- 172.21.15.100:0/934345749 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55792f80bf90 con 0x55792f80b3a0 2024-09-18T01:25:28.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.786+0000 7f8790e01640 1 -- 172.21.15.100:0/934345749 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88980808b0 con 0x55792f80b3a0 2024-09-18T01:25:28.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.786+0000 7f88ab211800 1 -- 172.21.15.100:0/934345749 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55792f80ec70 con 0x55792f80b3a0 2024-09-18T01:25:28.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.787+0000 7f8790e01640 1 -- 172.21.15.100:0/934345749 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f889808c050 con 0x55792f80b3a0 2024-09-18T01:25:28.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.787+0000 7f8790e01640 1 --2- 172.21.15.100:0/934345749 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8780036b90 0x7f8780039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.787+0000 7f8790e01640 1 -- 172.21.15.100:0/934345749 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8898086150 con 0x55792f80b3a0 2024-09-18T01:25:28.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.787+0000 7f88a613c640 1 --2- 172.21.15.100:0/934345749 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8780036b90 0x7f8780039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.788+0000 7f88ab211800 1 Processor -- start 2024-09-18T01:25:28.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.788+0000 7f88ab211800 1 -- start start 2024-09-18T01:25:28.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.788+0000 7f88a613c640 1 --2- 172.21.15.100:0/934345749 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8780036b90 0x7f8780039050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f889000bf50 tx=0x7f889000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.788+0000 7f88ab211800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f817eb0 0x55792f8182b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.788+0000 7f88ab211800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55792f7e61b0 con 0x55792f817eb0 2024-09-18T01:25:28.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.788+0000 7f88a693d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f817eb0 0x55792f8182b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.788+0000 7f88a693d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f817eb0 0x55792f8182b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37356/0 (socket says 172.21.15.100:37356) 2024-09-18T01:25:28.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.788+0000 7f88a693d640 1 -- 172.21.15.100:0/961833613 learned_addr learned my addr 172.21.15.100:0/961833613 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.788+0000 7f88a693d640 1 -- 172.21.15.100:0/961833613 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55792f818880 con 0x55792f817eb0 2024-09-18T01:25:28.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.788+0000 7f88a693d640 1 --2- 172.21.15.100:0/961833613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f817eb0 0x55792f8182b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8898059fe0 tx=0x7f8898061b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2e88ca4b76abc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.788+0000 7f878a7fc640 1 -- 172.21.15.100:0/961833613 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88980b2070 con 0x55792f817eb0 2024-09-18T01:25:28.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.789+0000 7f878a7fc640 1 -- 172.21.15.100:0/961833613 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889804f3f0 con 0x55792f817eb0 2024-09-18T01:25:28.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.789+0000 7f878a7fc640 1 -- 172.21.15.100:0/961833613 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8898061300 con 0x55792f817eb0 2024-09-18T01:25:28.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.789+0000 7f88ab211800 1 -- 172.21.15.100:0/961833613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f817eb0 msgr2=0x55792f8182b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.789+0000 7f88ab211800 1 --2- 172.21.15.100:0/961833613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f817eb0 0x55792f8182b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8898059fe0 tx=0x7f8898061b90 comp rx=0 tx=0).stop 2024-09-18T01:25:28.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.789+0000 7f88ab211800 1 -- 172.21.15.100:0/961833613 shutdown_connections 2024-09-18T01:25:28.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.789+0000 7f88ab211800 1 --2- 172.21.15.100:0/961833613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f817eb0 0x55792f8182b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.789+0000 7f88ab211800 1 -- 172.21.15.100:0/961833613 >> 172.21.15.100:0/961833613 conn(0x55792f814210 msgr2=0x55792f812310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.789+0000 7f88ab211800 1 -- 172.21.15.100:0/961833613 shutdown_connections 2024-09-18T01:25:28.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.789+0000 7f88ab211800 1 -- 172.21.15.100:0/961833613 wait complete. 2024-09-18T01:25:28.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.789+0000 7f88ab211800 1 Processor -- start 2024-09-18T01:25:28.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.789+0000 7f88ab211800 1 -- start start 2024-09-18T01:25:28.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.789+0000 7f88ab211800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f817eb0 0x55792f81f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.789+0000 7f88ab211800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55792f818e00 con 0x55792f817eb0 2024-09-18T01:25:28.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.790+0000 7f88a693d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f817eb0 0x55792f81f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.790+0000 7f88a693d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f817eb0 0x55792f81f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37370/0 (socket says 172.21.15.100:37370) 2024-09-18T01:25:28.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.790+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 learned_addr learned my addr 172.21.15.100:0/629798070 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.790+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55792f81f6e0 con 0x55792f817eb0 2024-09-18T01:25:28.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.790+0000 7f88a693d640 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f817eb0 0x55792f81f1a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f88980b0040 tx=0x7f8898053f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.790+0000 7f8788ff9640 1 -- 172.21.15.100:0/629798070 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88980bb070 con 0x55792f817eb0 2024-09-18T01:25:28.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.790+0000 7f8788ff9640 1 -- 172.21.15.100:0/629798070 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8898061930 con 0x55792f817eb0 2024-09-18T01:25:28.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.790+0000 7f8788ff9640 1 -- 172.21.15.100:0/629798070 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88980b2040 con 0x55792f817eb0 2024-09-18T01:25:28.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.790+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55792f81f6e0 con 0x55792f817eb0 2024-09-18T01:25:28.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.790+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55792f81f6e0 con 0x55792f817eb0 2024-09-18T01:25:28.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.791+0000 7f8788ff9640 1 -- 172.21.15.100:0/629798070 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f88980be070 con 0x55792f817eb0 2024-09-18T01:25:28.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.791+0000 7f8788ff9640 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8770036b90 0x7f8770039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.791+0000 7f8788ff9640 1 -- 172.21.15.100:0/629798070 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f88980c1cb0 con 0x55792f817eb0 2024-09-18T01:25:28.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.791+0000 7f88a613c640 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8770036b90 0x7f8770039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.792+0000 7f88ab211800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.792+0000 7f88ab211800 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55792f82a6e0 0x55792f82cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.792+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f82d2f0 con 0x55792f82a6e0 2024-09-18T01:25:28.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.792+0000 7f88a713e640 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55792f82a6e0 0x55792f82cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.792+0000 7f88a613c640 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8770036b90 0x7f8770039050 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8890001b60 tx=0x7f8890010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.792+0000 7f88a713e640 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55792f82a6e0 0x55792f82cba0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.792+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88a00083e0 con 0x55792f82a6e0 2024-09-18T01:25:28.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.792+0000 7f88ab211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.792+0000 7f88ab211800 20 realm 2024-09-18T01:25:28.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.792+0000 7f88ab211800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.792+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f82d720 con 0x55792f82a6e0 2024-09-18T01:25:28.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88a00083e0 con 0x55792f82a6e0 2024-09-18T01:25:28.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88ab211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88ab211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88ab211800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f82a6e0 2024-09-18T01:25:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88a00083e0 con 0x55792f82a6e0 2024-09-18T01:25:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88ab211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88ab211800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f82e390 con 0x55792f82a6e0 2024-09-18T01:25:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88a00083e0 con 0x55792f82a6e0 2024-09-18T01:25:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88ab211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88ab211800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88ab211800 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55792f82ed50 0x55792f831140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f831680 con 0x55792f82ed50 2024-09-18T01:25:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88a693d640 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55792f82ed50 0x55792f831140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.793+0000 7f88a693d640 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55792f82ed50 0x55792f831140 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.794+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f88980c7070 con 0x55792f82ed50 2024-09-18T01:25:28.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.794+0000 7f88ab211800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:28.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.794+0000 7f88ab211800 20 searching for the correct realm 2024-09-18T01:25:28.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.794+0000 7f88ab211800 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55792f8336e0 0x55792f835ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.794+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f836270 con 0x55792f8336e0 2024-09-18T01:25:28.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.794+0000 7f88a613c640 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55792f8336e0 0x55792f835ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.794+0000 7f88a613c640 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55792f8336e0 0x55792f835ba0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.794+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8890009050 con 0x55792f8336e0 2024-09-18T01:25:28.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.794+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f836270 con 0x55792f82ed50 2024-09-18T01:25:28.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.795+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88980c7070 con 0x55792f82ed50 2024-09-18T01:25:28.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.795+0000 7f88a693d640 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88980c0070 0x7f8898075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.795+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f836270 con 0x7f88980c0070 2024-09-18T01:25:28.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.795+0000 7f88a713e640 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88980c0070 0x7f8898075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.795+0000 7f88a713e640 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88980c0070 0x7f8898075530 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.795+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f88a00083e0 con 0x7f88980c0070 2024-09-18T01:25:28.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.795+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f82a6e0 2024-09-18T01:25:28.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.796+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a00083e0 con 0x55792f82a6e0 2024-09-18T01:25:28.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.796+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f82a6e0 2024-09-18T01:25:28.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.796+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.796+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x7f88980c0070 2024-09-18T01:25:28.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.796+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.796+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x7f88980c0070 2024-09-18T01:25:28.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.796+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.796+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f82ed50 2024-09-18T01:25:28.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.797+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88980c7070 con 0x55792f82ed50 2024-09-18T01:25:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.797+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f8336e0 2024-09-18T01:25:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.797+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8890009050 con 0x55792f8336e0 2024-09-18T01:25:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.797+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f82a6e0 2024-09-18T01:25:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.797+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.797+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x7f88980c0070 2024-09-18T01:25:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.797+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.797+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f82a6e0 2024-09-18T01:25:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.797+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.797+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f82ed50 2024-09-18T01:25:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.798+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f88980c7070 con 0x55792f82ed50 2024-09-18T01:25:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.798+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f8336e0 2024-09-18T01:25:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.798+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8890009050 con 0x55792f8336e0 2024-09-18T01:25:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.798+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f8336e0 2024-09-18T01:25:28.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.798+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8890009050 con 0x55792f8336e0 2024-09-18T01:25:28.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.798+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x7f88980c0070 2024-09-18T01:25:28.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.798+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.798+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f8336e0 2024-09-18T01:25:28.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.799+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8890009050 con 0x55792f8336e0 2024-09-18T01:25:28.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.799+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f8336e0 2024-09-18T01:25:28.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.799+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8890009050 con 0x55792f8336e0 2024-09-18T01:25:28.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.799+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f82a6e0 2024-09-18T01:25:28.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.799+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.799+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f82a6e0 2024-09-18T01:25:28.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.799+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.799+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x7f88980c0070 2024-09-18T01:25:28.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.799+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.800+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f8336e0 2024-09-18T01:25:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.800+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8890009050 con 0x55792f8336e0 2024-09-18T01:25:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.800+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f82ed50 2024-09-18T01:25:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.800+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88980c7070 con 0x55792f82ed50 2024-09-18T01:25:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.800+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f82a6e0 2024-09-18T01:25:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.800+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.800+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x7f88980c0070 2024-09-18T01:25:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.800+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.801+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f8336e0 2024-09-18T01:25:28.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.801+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8890009050 con 0x55792f8336e0 2024-09-18T01:25:28.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.801+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x7f88980c0070 2024-09-18T01:25:28.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.801+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.801+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f82ed50 2024-09-18T01:25:28.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.801+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88980c7070 con 0x55792f82ed50 2024-09-18T01:25:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.801+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f8336e0 2024-09-18T01:25:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.801+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8890009050 con 0x55792f8336e0 2024-09-18T01:25:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.801+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x7f88980c0070 2024-09-18T01:25:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f82a6e0 2024-09-18T01:25:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55792f82dff0 con 0x55792f82ed50 2024-09-18T01:25:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f88980c7070 con 0x55792f82ed50 2024-09-18T01:25:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88ab211800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88ab211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88ab211800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88ab211800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88ab211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88ab211800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88ab211800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f831fe0 con 0x55792f82a6e0 2024-09-18T01:25:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88ab211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88ab211800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.802+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f8323d0 con 0x55792f82a6e0 2024-09-18T01:25:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f8323d0 con 0x7f88980c0070 2024-09-18T01:25:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 20 zone default found 2024-09-18T01:25:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 4 Realm: () 2024-09-18T01:25:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 20 zonegroup default 2024-09-18T01:25:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f8327f0 con 0x7f88980c0070 2024-09-18T01:25:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.803+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f8327f0 con 0x55792f8336e0 2024-09-18T01:25:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.804+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8890009050 con 0x55792f8336e0 2024-09-18T01:25:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.804+0000 7f88ab211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.804+0000 7f88ab211800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.804+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f8380d0 con 0x55792f8336e0 2024-09-18T01:25:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.804+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8890009050 con 0x55792f8336e0 2024-09-18T01:25:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.804+0000 7f88ab211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.804+0000 7f88ab211800 20 started sync module instance, tier type = 2024-09-18T01:25:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.804+0000 7f88ab211800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.804+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f837570 con 0x55792f82ed50 2024-09-18T01:25:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.805+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88980c7070 con 0x55792f82ed50 2024-09-18T01:25:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.805+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93978976549264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f838920 con 0x55792f82ed50 2024-09-18T01:25:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.805+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f839170 con 0x55792f82a6e0 2024-09-18T01:25:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.806+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93978976549264] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88980c7070 con 0x55792f82ed50 2024-09-18T01:25:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.806+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.806+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93978976554176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f839590 con 0x55792f82a6e0 2024-09-18T01:25:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.806+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f839de0 con 0x55792f8336e0 2024-09-18T01:25:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.807+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8890009050 con 0x55792f8336e0 2024-09-18T01:25:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.807+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93978976556912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83a630 con 0x55792f8336e0 2024-09-18T01:25:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.807+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83b0a0 con 0x55792f82ed50 2024-09-18T01:25:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.807+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93978976554176] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.808+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88980c7070 con 0x55792f82ed50 2024-09-18T01:25:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.808+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93978976556912] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8890009050 con 0x55792f8336e0 2024-09-18T01:25:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.808+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93978976562032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f8390e0 con 0x55792f82ed50 2024-09-18T01:25:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.808+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83b940 con 0x55792f82a6e0 2024-09-18T01:25:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.809+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.809+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93978976564368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83b8b0 con 0x55792f82a6e0 2024-09-18T01:25:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.809+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83c930 con 0x7f88980c0070 2024-09-18T01:25:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.809+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93978976562032] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88980c7070 con 0x55792f82ed50 2024-09-18T01:25:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.810+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.810+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93978976568320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83c8f0 con 0x7f88980c0070 2024-09-18T01:25:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.810+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83d340 con 0x7f88980c0070 2024-09-18T01:25:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.810+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93978976564368] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.811+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93978976568320] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.811+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.811+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93978976559488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83ce90 con 0x7f88980c0070 2024-09-18T01:25:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.811+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83d850 con 0x7f88980c0070 2024-09-18T01:25:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.812+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93978976559488] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.812+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.812+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93978976566576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83d850 con 0x7f88980c0070 2024-09-18T01:25:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.812+0000 7f88ab211800 20 add_watcher() i=0 2024-09-18T01:25:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.812+0000 7f88ab211800 20 add_watcher() i=1 2024-09-18T01:25:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.812+0000 7f88ab211800 20 add_watcher() i=2 2024-09-18T01:25:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.812+0000 7f88ab211800 20 add_watcher() i=3 2024-09-18T01:25:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.812+0000 7f88ab211800 20 add_watcher() i=4 2024-09-18T01:25:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.812+0000 7f88ab211800 20 add_watcher() i=5 2024-09-18T01:25:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.812+0000 7f88ab211800 20 add_watcher() i=6 2024-09-18T01:25:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.813+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93978976566576] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.813+0000 7f88ab211800 20 add_watcher() i=7 2024-09-18T01:25:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.813+0000 7f88ab211800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.813+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f840b50 con 0x55792f82a6e0 2024-09-18T01:25:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.813+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.813+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93978976572688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83dde0 con 0x55792f82a6e0 2024-09-18T01:25:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.814+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93978976572688] v33'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.814+0000 7f875d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.814+0000 7f88ab211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:28.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.814+0000 7f88ab211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:28.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.814+0000 7f88ab211800 5 note: GC not initialized 2024-09-18T01:25:28.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.815+0000 7f86d7fff640 20 reqs_thread_entry: start 2024-09-18T01:25:28.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.815+0000 7f88ab211800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:28.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.815+0000 7f88ab211800 20 Filter name: none 2024-09-18T01:25:28.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.815+0000 7f86d5ffb640 20 reqs_thread_entry: start 2024-09-18T01:25:28.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.815+0000 7f88ab211800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.815+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55792f873bd0 con 0x55792f82a6e0 2024-09-18T01:25:28.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.815+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.815+0000 7f88ab211800 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T01:25:28.828 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.816+0000 7f875d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.816+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93978976572688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f872640 con 0x55792f82a6e0 2024-09-18T01:25:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.817+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93978976572688] v33'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.817+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93978976549264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83d510 con 0x55792f82ed50 2024-09-18T01:25:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.818+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93978976549264] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88980c7070 con 0x55792f82ed50 2024-09-18T01:25:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.818+0000 7f88ab211800 20 remove_watcher() i=0 2024-09-18T01:25:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.818+0000 7f88ab211800 2 removed watcher, disabling cache 2024-09-18T01:25:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.818+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93978976554176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83d510 con 0x55792f82a6e0 2024-09-18T01:25:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.819+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93978976554176] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.819+0000 7f88ab211800 20 remove_watcher() i=1 2024-09-18T01:25:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.819+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93978976556912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f838cc0 con 0x55792f8336e0 2024-09-18T01:25:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.820+0000 7f88a613c640 1 -- 172.21.15.100:0/629798070 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93978976556912] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8890009050 con 0x55792f8336e0 2024-09-18T01:25:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.820+0000 7f88ab211800 20 remove_watcher() i=2 2024-09-18T01:25:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.820+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93978976562032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83d510 con 0x55792f82ed50 2024-09-18T01:25:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.821+0000 7f88a693d640 1 -- 172.21.15.100:0/629798070 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93978976562032] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88980c7070 con 0x55792f82ed50 2024-09-18T01:25:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.821+0000 7f88ab211800 20 remove_watcher() i=3 2024-09-18T01:25:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.821+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93978976564368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f839770 con 0x55792f82a6e0 2024-09-18T01:25:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.822+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93978976564368] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x55792f82a6e0 2024-09-18T01:25:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.822+0000 7f88ab211800 20 remove_watcher() i=4 2024-09-18T01:25:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.822+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93978976568320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83ab70 con 0x7f88980c0070 2024-09-18T01:25:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.823+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93978976568320] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.823+0000 7f88ab211800 20 remove_watcher() i=5 2024-09-18T01:25:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.823+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93978976559488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83d510 con 0x7f88980c0070 2024-09-18T01:25:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.824+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93978976559488] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.824+0000 7f88ab211800 20 remove_watcher() i=6 2024-09-18T01:25:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.824+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93978976566576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55792f83b490 con 0x7f88980c0070 2024-09-18T01:25:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93978976566576] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a0026040 con 0x7f88980c0070 2024-09-18T01:25:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 20 remove_watcher() i=7 2024-09-18T01:25:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88980c0070 msgr2=0x7f8898075530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88980c0070 0x7f8898075530 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55792f82a6e0 msgr2=0x55792f82cba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55792f82a6e0 0x55792f82cba0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55792f82ed50 msgr2=0x55792f831140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55792f82ed50 0x55792f831140 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55792f8336e0 msgr2=0x55792f835ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55792f8336e0 0x55792f835ba0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8770036b90 msgr2=0x7f8770039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8770036b90 0x7f8770039050 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8890001b60 tx=0x7f8890010000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f817eb0 msgr2=0x55792f81f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88a713e640 1 -- 172.21.15.100:0/629798070 reap_dead start 2024-09-18T01:25:28.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f817eb0 0x55792f81f1a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f88980b0040 tx=0x7f8898053f50 comp rx=0 tx=0).stop 2024-09-18T01:25:28.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 shutdown_connections 2024-09-18T01:25:28.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 --2- 172.21.15.100:0/629798070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f817eb0 0x55792f81f1a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 >> 172.21.15.100:0/629798070 conn(0x55792f814210 msgr2=0x55792f8122e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 shutdown_connections 2024-09-18T01:25:28.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 -- 172.21.15.100:0/629798070 wait complete. 2024-09-18T01:25:28.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 -- 172.21.15.100:0/934345749 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8780036b90 msgr2=0x7f8780039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.825+0000 7f88ab211800 1 --2- 172.21.15.100:0/934345749 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8780036b90 0x7f8780039050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f889000bf50 tx=0x7f889000f000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 -- 172.21.15.100:0/934345749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f80b3a0 msgr2=0x55792f80b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 --2- 172.21.15.100:0/934345749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f80b3a0 0x55792f80b7c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f889804ffd0 tx=0x7f8898063ea0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 -- 172.21.15.100:0/934345749 shutdown_connections 2024-09-18T01:25:28.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 --2- 172.21.15.100:0/934345749 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8780036b90 0x7f8780039050 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 --2- 172.21.15.100:0/934345749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f80b3a0 0x55792f80b7c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 -- 172.21.15.100:0/934345749 >> 172.21.15.100:0/934345749 conn(0x55792f800330 msgr2=0x55792f802eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 -- 172.21.15.100:0/934345749 shutdown_connections 2024-09-18T01:25:28.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 -- 172.21.15.100:0/934345749 wait complete. 2024-09-18T01:25:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55792f7fab40 msgr2=0x55792f7fcf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55792f7fab40 0x55792f7fcf30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55792f6f9bd0 msgr2=0x55792f7f4390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55792f6f9bd0 0x55792f7f4390 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55792f7f6c00 msgr2=0x55792f7f8ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55792f7f6c00 0x55792f7f8ff0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f878c036b40 msgr2=0x7f878c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f878c036b40 0x7f878c039000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8890000f60 tx=0x7f88900012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 msgr2=0x55792f7ed320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 --2- 172.21.15.100:0/2762895282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55792f6685f0 0x55792f7ed320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8898065040 tx=0x7f8898003330 comp rx=0 tx=0).stop 2024-09-18T01:25:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88a713e640 1 -- 172.21.15.100:0/2762895282 reap_dead start 2024-09-18T01:25:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 shutdown_connections 2024-09-18T01:25:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 >> 172.21.15.100:0/2762895282 conn(0x55792f6eede0 msgr2=0x55792f7dfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 shutdown_connections 2024-09-18T01:25:28.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.826+0000 7f88ab211800 1 -- 172.21.15.100:0/2762895282 wait complete. 2024-09-18T01:25:28.838 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:28.839 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-18T01:25:28.839 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-18T01:25:28.839 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-18T01:25:28.887 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:28.887 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:28.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.887+0000 7f95bc72e800 1 Processor -- start 2024-09-18T01:25:28.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.887+0000 7f95bc72e800 1 -- start start 2024-09-18T01:25:28.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.887+0000 7f95bc72e800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5582a07f5d40 0x5582a07f8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.887+0000 7f95bc72e800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5582a06aeb30 con 0x5582a0762df0 2024-09-18T01:25:28.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.887+0000 7f95bc72e800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5582a0690360 con 0x5582a07f5d40 2024-09-18T01:25:28.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.887+0000 7f95affff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5582a07f5d40 0x5582a07f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.887+0000 7f95b845c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5582a0762df0 0x5582a07f4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37194/0 (socket says 172.21.15.100:37194) 2024-09-18T01:25:28.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.887+0000 7f95b845c640 1 -- 172.21.15.100:0/78731659 learned_addr learned my addr 172.21.15.100:0/78731659 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:28.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.888+0000 7f95affff640 1 -- 172.21.15.100:0/78731659 >> v1:172.21.15.92:6789/0 conn(0x5582a0762df0 legacy=0x5582a07f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.888+0000 7f95affff640 1 -- 172.21.15.100:0/78731659 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582a06b6e00 con 0x5582a07f5d40 2024-09-18T01:25:28.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.890+0000 7f95affff640 1 --2- 172.21.15.100:0/78731659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a07f5d40 0x5582a07f8130 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f95a000a470 tx=0x7f95a0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b237258abc29bf2d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.890+0000 7f95b7c5b640 1 -- 172.21.15.100:0/78731659 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a0053570 con 0x5582a07f5d40 2024-09-18T01:25:28.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.890+0000 7f95b7c5b640 1 -- 172.21.15.100:0/78731659 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a0058070 con 0x5582a07f5d40 2024-09-18T01:25:28.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.890+0000 7f95b7c5b640 1 -- 172.21.15.100:0/78731659 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a0053880 con 0x5582a07f5d40 2024-09-18T01:25:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.890+0000 7f95bc72e800 1 -- 172.21.15.100:0/78731659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a07f5d40 msgr2=0x5582a07f8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.890+0000 7f95bc72e800 1 --2- 172.21.15.100:0/78731659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a07f5d40 0x5582a07f8130 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f95a000a470 tx=0x7f95a0045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.890+0000 7f95bc72e800 1 -- 172.21.15.100:0/78731659 shutdown_connections 2024-09-18T01:25:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.890+0000 7f95bc72e800 1 --2- 172.21.15.100:0/78731659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a07f5d40 0x5582a07f8130 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.890+0000 7f95bc72e800 1 -- 172.21.15.100:0/78731659 >> 172.21.15.100:0/78731659 conn(0x5582a07e9e10 msgr2=0x5582a07ec230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.891+0000 7f95bc72e800 1 -- 172.21.15.100:0/78731659 shutdown_connections 2024-09-18T01:25:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.891+0000 7f95bc72e800 1 -- 172.21.15.100:0/78731659 wait complete. 2024-09-18T01:25:28.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.904+0000 7f95bc72e800 1 Processor -- start 2024-09-18T01:25:28.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.904+0000 7f95bc72e800 1 -- start start 2024-09-18T01:25:28.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.904+0000 7f95bc72e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0762df0 0x5582a08e0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.904+0000 7f95bc72e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5582a073b350 con 0x5582a0762df0 2024-09-18T01:25:28.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.904+0000 7f95b845c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0762df0 0x5582a08e0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.905+0000 7f95b845c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0762df0 0x5582a08e0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37380/0 (socket says 172.21.15.100:37380) 2024-09-18T01:25:28.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.905+0000 7f95b845c640 1 -- 172.21.15.100:0/2436609206 learned_addr learned my addr 172.21.15.100:0/2436609206 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.905+0000 7f95b845c640 1 -- 172.21.15.100:0/2436609206 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582a0688bc0 con 0x5582a0762df0 2024-09-18T01:25:28.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.905+0000 7f95b845c640 1 --2- 172.21.15.100:0/2436609206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0762df0 0x5582a08e0b00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f95a8001e10 tx=0x7f95a800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3431e8a6a07b2c77 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.905+0000 7f94a660c640 1 -- 172.21.15.100:0/2436609206 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a8012020 con 0x5582a0762df0 2024-09-18T01:25:28.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.905+0000 7f94a660c640 1 -- 172.21.15.100:0/2436609206 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a800e5a0 con 0x5582a0762df0 2024-09-18T01:25:28.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.905+0000 7f94a660c640 1 -- 172.21.15.100:0/2436609206 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a800e8e0 con 0x5582a0762df0 2024-09-18T01:25:28.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.906+0000 7f95bc72e800 1 -- 172.21.15.100:0/2436609206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0762df0 msgr2=0x5582a08e0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.906+0000 7f95bc72e800 1 --2- 172.21.15.100:0/2436609206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0762df0 0x5582a08e0b00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f95a8001e10 tx=0x7f95a800b780 comp rx=0 tx=0).stop 2024-09-18T01:25:28.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.906+0000 7f95bc72e800 1 -- 172.21.15.100:0/2436609206 shutdown_connections 2024-09-18T01:25:28.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.906+0000 7f95bc72e800 1 --2- 172.21.15.100:0/2436609206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0762df0 0x5582a08e0b00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.906+0000 7f95bc72e800 1 -- 172.21.15.100:0/2436609206 >> 172.21.15.100:0/2436609206 conn(0x5582a07e9e10 msgr2=0x5582a08dc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.906+0000 7f95bc72e800 1 -- 172.21.15.100:0/2436609206 shutdown_connections 2024-09-18T01:25:28.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.906+0000 7f95bc72e800 1 -- 172.21.15.100:0/2436609206 wait complete. 2024-09-18T01:25:28.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.906+0000 7f95bc72e800 1 Processor -- start 2024-09-18T01:25:28.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.906+0000 7f95bc72e800 1 -- start start 2024-09-18T01:25:28.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.906+0000 7f95bc72e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0762df0 0x5582a08e84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.906+0000 7f95bc72e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5582a07f8910 con 0x5582a0762df0 2024-09-18T01:25:28.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.907+0000 7f95b845c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0762df0 0x5582a08e84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.907+0000 7f95b845c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0762df0 0x5582a08e84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37386/0 (socket says 172.21.15.100:37386) 2024-09-18T01:25:28.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.907+0000 7f95b845c640 1 -- 172.21.15.100:0/3450922194 learned_addr learned my addr 172.21.15.100:0/3450922194 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.907+0000 7f95b845c640 1 -- 172.21.15.100:0/3450922194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582a069cfe0 con 0x5582a0762df0 2024-09-18T01:25:28.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.907+0000 7f95b845c640 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0762df0 0x5582a08e84e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f95a8001e10 tx=0x7f95a8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.907+0000 7f94a4e09640 1 -- 172.21.15.100:0/3450922194 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a8012030 con 0x5582a0762df0 2024-09-18T01:25:28.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.907+0000 7f94a4e09640 1 -- 172.21.15.100:0/3450922194 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a801a7a0 con 0x5582a0762df0 2024-09-18T01:25:28.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.907+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582a08e8a20 con 0x5582a0762df0 2024-09-18T01:25:28.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.907+0000 7f94a4e09640 1 -- 172.21.15.100:0/3450922194 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a801aac0 con 0x5582a0762df0 2024-09-18T01:25:28.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.907+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582a08e8f40 con 0x5582a0762df0 2024-09-18T01:25:28.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.908+0000 7f94a4e09640 1 -- 172.21.15.100:0/3450922194 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f95a8015020 con 0x5582a0762df0 2024-09-18T01:25:28.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.908+0000 7f94a4e09640 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f94a0036b40 0x7f94a0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.908+0000 7f94a4e09640 1 -- 172.21.15.100:0/3450922194 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f95a8020030 con 0x5582a0762df0 2024-09-18T01:25:28.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.908+0000 7f95affff640 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f94a0036b40 0x7f94a0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.908+0000 7f95bc72e800 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5582a07f5d40 0x5582a08ef550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.908+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a08efa90 con 0x5582a07f5d40 2024-09-18T01:25:28.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.909+0000 7f95b8c5d640 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5582a07f5d40 0x5582a08ef550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.909+0000 7f95affff640 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f94a0036b40 0x7f94a0039000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f95a0057000 tx=0x7f95a0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.909+0000 7f95b8c5d640 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5582a07f5d40 0x5582a08ef550 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.909+0000 7f95b8c5d640 1 -- 172.21.15.100:0/3450922194 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a07f5d40 2024-09-18T01:25:28.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.909+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a08ecb00 con 0x5582a07f5d40 2024-09-18T01:25:28.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.909+0000 7f95b8c5d640 1 -- 172.21.15.100:0/3450922194 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a07f5d40 2024-09-18T01:25:28.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.909+0000 7f95bc72e800 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5582a08f1da0 0x5582a08f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.910+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a08f4830 con 0x5582a08f1da0 2024-09-18T01:25:28.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.910+0000 7f95b845c640 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5582a08f1da0 0x5582a08f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.910+0000 7f95b845c640 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5582a08f1da0 0x5582a08f4190 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.910+0000 7f95b845c640 1 -- 172.21.15.100:0/3450922194 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f95a800dcd0 con 0x5582a08f1da0 2024-09-18T01:25:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.910+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a08f0c40 con 0x5582a07f5d40 2024-09-18T01:25:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.910+0000 7f95b8c5d640 1 -- 172.21.15.100:0/3450922194 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a07f5d40 2024-09-18T01:25:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.910+0000 7f95bc72e800 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5582a08f5c90 0x5582a08f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.910+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a08f8780 con 0x5582a08f5c90 2024-09-18T01:25:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.911+0000 7f95affff640 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5582a08f5c90 0x5582a08f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.911+0000 7f95affff640 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5582a08f5c90 0x5582a08f8080 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.911+0000 7f95affff640 1 -- 172.21.15.100:0/3450922194 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f95a0051070 con 0x5582a08f5c90 2024-09-18T01:25:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.912+0000 7f95bc72e800 1 Processor -- start 2024-09-18T01:25:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.912+0000 7f95bc72e800 1 -- start start 2024-09-18T01:25:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.912+0000 7f95bc72e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0906530 0x5582a0906950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.912+0000 7f95bc72e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5582a068a580 con 0x5582a0906530 2024-09-18T01:25:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.912+0000 7f95b845c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0906530 0x5582a0906950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.912+0000 7f95b845c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0906530 0x5582a0906950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37402/0 (socket says 172.21.15.100:37402) 2024-09-18T01:25:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.912+0000 7f95b845c640 1 -- 172.21.15.100:0/4211821625 learned_addr learned my addr 172.21.15.100:0/4211821625 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.912+0000 7f95b845c640 1 -- 172.21.15.100:0/4211821625 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582a0906e90 con 0x5582a0906530 2024-09-18T01:25:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.913+0000 7f95b845c640 1 --2- 172.21.15.100:0/4211821625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0906530 0x5582a0906950 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f95a8001750 tx=0x7f95a802c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.913+0000 7f949dffb640 1 -- 172.21.15.100:0/4211821625 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a80490c0 con 0x5582a0906530 2024-09-18T01:25:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.913+0000 7f949dffb640 1 -- 172.21.15.100:0/4211821625 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a8049260 con 0x5582a0906530 2024-09-18T01:25:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.913+0000 7f95bc72e800 1 -- 172.21.15.100:0/4211821625 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582a0907120 con 0x5582a0906530 2024-09-18T01:25:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.913+0000 7f949dffb640 1 -- 172.21.15.100:0/4211821625 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a8017c50 con 0x5582a0906530 2024-09-18T01:25:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.913+0000 7f95bc72e800 1 -- 172.21.15.100:0/4211821625 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582a0909e00 con 0x5582a0906530 2024-09-18T01:25:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.913+0000 7f949dffb640 1 -- 172.21.15.100:0/4211821625 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f95a803c060 con 0x5582a0906530 2024-09-18T01:25:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.914+0000 7f949dffb640 1 --2- 172.21.15.100:0/4211821625 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9490036b90 0x7f9490039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.914+0000 7f949dffb640 1 -- 172.21.15.100:0/4211821625 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f95a8036c70 con 0x5582a0906530 2024-09-18T01:25:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.914+0000 7f95affff640 1 --2- 172.21.15.100:0/4211821625 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9490036b90 0x7f9490039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.914+0000 7f95bc72e800 1 Processor -- start 2024-09-18T01:25:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.914+0000 7f95bc72e800 1 -- start start 2024-09-18T01:25:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.914+0000 7f95affff640 1 --2- 172.21.15.100:0/4211821625 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9490036b90 0x7f9490039050 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5582a08eca40 tx=0x7f95a0005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.914+0000 7f95bc72e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0912fd0 0x5582a09133d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.914+0000 7f95bc72e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5582a08e12b0 con 0x5582a0912fd0 2024-09-18T01:25:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.914+0000 7f95b845c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0912fd0 0x5582a09133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.914+0000 7f95b845c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0912fd0 0x5582a09133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37410/0 (socket says 172.21.15.100:37410) 2024-09-18T01:25:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.914+0000 7f95b845c640 1 -- 172.21.15.100:0/3644056767 learned_addr learned my addr 172.21.15.100:0/3644056767 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.915+0000 7f95b845c640 1 -- 172.21.15.100:0/3644056767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582a09139a0 con 0x5582a0912fd0 2024-09-18T01:25:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.915+0000 7f95b845c640 1 --2- 172.21.15.100:0/3644056767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0912fd0 0x5582a09133d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f95a803f410 tx=0x7f95a803fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257e687285ffc14 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.915+0000 7f94977fe640 1 -- 172.21.15.100:0/3644056767 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a805b020 con 0x5582a0912fd0 2024-09-18T01:25:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.915+0000 7f94977fe640 1 -- 172.21.15.100:0/3644056767 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a800dab0 con 0x5582a0912fd0 2024-09-18T01:25:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.915+0000 7f94977fe640 1 -- 172.21.15.100:0/3644056767 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a800d590 con 0x5582a0912fd0 2024-09-18T01:25:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.915+0000 7f95bc72e800 1 -- 172.21.15.100:0/3644056767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0912fd0 msgr2=0x5582a09133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.915+0000 7f95bc72e800 1 --2- 172.21.15.100:0/3644056767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0912fd0 0x5582a09133d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f95a803f410 tx=0x7f95a803fd10 comp rx=0 tx=0).stop 2024-09-18T01:25:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.915+0000 7f95bc72e800 1 -- 172.21.15.100:0/3644056767 shutdown_connections 2024-09-18T01:25:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.915+0000 7f95bc72e800 1 --2- 172.21.15.100:0/3644056767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0912fd0 0x5582a09133d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.915+0000 7f95bc72e800 1 -- 172.21.15.100:0/3644056767 >> 172.21.15.100:0/3644056767 conn(0x5582a090f380 msgr2=0x5582a090d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.915+0000 7f95bc72e800 1 -- 172.21.15.100:0/3644056767 shutdown_connections 2024-09-18T01:25:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.915+0000 7f95bc72e800 1 -- 172.21.15.100:0/3644056767 wait complete. 2024-09-18T01:25:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.916+0000 7f95bc72e800 1 Processor -- start 2024-09-18T01:25:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.916+0000 7f95bc72e800 1 -- start start 2024-09-18T01:25:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.916+0000 7f95bc72e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0912fd0 0x5582a091a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.916+0000 7f95bc72e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5582a0913df0 con 0x5582a0912fd0 2024-09-18T01:25:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.916+0000 7f95b845c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0912fd0 0x5582a091a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.916+0000 7f95b845c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0912fd0 0x5582a091a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37422/0 (socket says 172.21.15.100:37422) 2024-09-18T01:25:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.916+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 learned_addr learned my addr 172.21.15.100:0/436873388 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.916+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582a091a810 con 0x5582a0912fd0 2024-09-18T01:25:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.917+0000 7f95b845c640 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0912fd0 0x5582a091a2d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f95a8044780 tx=0x7f95a8004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.917+0000 7f9495ffb640 1 -- 172.21.15.100:0/436873388 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a8044990 con 0x5582a0912fd0 2024-09-18T01:25:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.917+0000 7f9495ffb640 1 -- 172.21.15.100:0/436873388 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a803f480 con 0x5582a0912fd0 2024-09-18T01:25:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.917+0000 7f9495ffb640 1 -- 172.21.15.100:0/436873388 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a8044b30 con 0x5582a0912fd0 2024-09-18T01:25:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.917+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582a091a810 con 0x5582a0912fd0 2024-09-18T01:25:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.917+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582a091a810 con 0x5582a0912fd0 2024-09-18T01:25:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.917+0000 7f9495ffb640 1 -- 172.21.15.100:0/436873388 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f95a8072060 con 0x5582a0912fd0 2024-09-18T01:25:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.918+0000 7f9495ffb640 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9488036b90 0x7f9488039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.918+0000 7f9495ffb640 1 -- 172.21.15.100:0/436873388 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f95a8052050 con 0x5582a0912fd0 2024-09-18T01:25:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.918+0000 7f95affff640 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9488036b90 0x7f9488039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.918+0000 7f95affff640 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9488036b90 0x7f9488039050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f95a0053570 tx=0x7f95a0053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95bc72e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95bc72e800 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5582a0925a80 0x5582a0927f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a0928690 con 0x5582a0925a80 2024-09-18T01:25:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95b8c5d640 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5582a0925a80 0x5582a0927f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95b8c5d640 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5582a0925a80 0x5582a0927f40 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95bc72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95bc72e800 20 realm 2024-09-18T01:25:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95bc72e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a0928aa0 con 0x5582a0925a80 2024-09-18T01:25:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95bc72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95bc72e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95bc72e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.919+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929370 con 0x5582a0925a80 2024-09-18T01:25:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.920+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.920+0000 7f95bc72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.920+0000 7f95bc72e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.920+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a0925a80 2024-09-18T01:25:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.920+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.920+0000 7f95bc72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.920+0000 7f95bc72e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.920+0000 7f95bc72e800 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5582a092a470 0x5582a092c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.920+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a092ce70 con 0x5582a092a470 2024-09-18T01:25:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.920+0000 7f95b845c640 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5582a092a470 0x5582a092c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.920+0000 7f95b845c640 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5582a092a470 0x5582a092c860 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.920+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.921+0000 7f95bc72e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.921+0000 7f95bc72e800 20 searching for the correct realm 2024-09-18T01:25:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.921+0000 7f95bc72e800 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5582a092ee20 0x5582a09312e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.921+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a09319b0 con 0x5582a092ee20 2024-09-18T01:25:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.921+0000 7f95affff640 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5582a092ee20 0x5582a09312e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.921+0000 7f95affff640 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5582a092ee20 0x5582a09312e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.921+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a0051070 con 0x5582a092ee20 2024-09-18T01:25:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.921+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a09319b0 con 0x5582a092a470 2024-09-18T01:25:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.921+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.921+0000 7f95b845c640 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f95a8060040 0x7f95a803c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:28.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.921+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a09319b0 con 0x7f95a8060040 2024-09-18T01:25:28.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.922+0000 7f95b8c5d640 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f95a8060040 0x7f95a803c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:28.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.922+0000 7f95b8c5d640 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f95a8060040 0x7f95a803c350 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:28.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.922+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.922+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a0925a80 2024-09-18T01:25:28.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.922+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.922+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a0925a80 2024-09-18T01:25:28.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.923+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.923+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x7f95a8060040 2024-09-18T01:25:28.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.923+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.923+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x7f95a8060040 2024-09-18T01:25:28.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.923+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.923+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a092a470 2024-09-18T01:25:28.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.923+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.923+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a092ee20 2024-09-18T01:25:28.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.924+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a0051070 con 0x5582a092ee20 2024-09-18T01:25:28.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.924+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a0925a80 2024-09-18T01:25:28.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.924+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.924+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x7f95a8060040 2024-09-18T01:25:28.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.924+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.924+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a0925a80 2024-09-18T01:25:28.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.924+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.924+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a092a470 2024-09-18T01:25:28.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.925+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.925+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a092ee20 2024-09-18T01:25:28.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.925+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a0051070 con 0x5582a092ee20 2024-09-18T01:25:28.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.925+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a092ee20 2024-09-18T01:25:28.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.925+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a0051070 con 0x5582a092ee20 2024-09-18T01:25:28.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.925+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x7f95a8060040 2024-09-18T01:25:28.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.925+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.925+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a092ee20 2024-09-18T01:25:28.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.925+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a0051070 con 0x5582a092ee20 2024-09-18T01:25:28.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.925+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a092ee20 2024-09-18T01:25:28.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.926+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a0051070 con 0x5582a092ee20 2024-09-18T01:25:28.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.926+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a0925a80 2024-09-18T01:25:28.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.926+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.926+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a0925a80 2024-09-18T01:25:28.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.926+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.926+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x7f95a8060040 2024-09-18T01:25:28.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.926+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.926+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a092ee20 2024-09-18T01:25:28.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.927+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a0051070 con 0x5582a092ee20 2024-09-18T01:25:28.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.927+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a092a470 2024-09-18T01:25:28.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.927+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.927+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a0925a80 2024-09-18T01:25:28.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.927+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.927+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x7f95a8060040 2024-09-18T01:25:28.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.927+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.927+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a092ee20 2024-09-18T01:25:28.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.928+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a0051070 con 0x5582a092ee20 2024-09-18T01:25:28.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.928+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x7f95a8060040 2024-09-18T01:25:28.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.928+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.928+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a092a470 2024-09-18T01:25:28.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.928+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.928+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a092ee20 2024-09-18T01:25:28.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.928+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a0051070 con 0x5582a092ee20 2024-09-18T01:25:28.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.928+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x7f95a8060040 2024-09-18T01:25:28.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a0925a80 2024-09-18T01:25:28.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5582a0929710 con 0x5582a092a470 2024-09-18T01:25:28.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95bc72e800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:28.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95bc72e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:28.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95bc72e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:28.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95bc72e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:28.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95bc72e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:28.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95bc72e800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:28.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95bc72e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a092d730 con 0x5582a0925a80 2024-09-18T01:25:28.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95bc72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95bc72e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a092db20 con 0x5582a0925a80 2024-09-18T01:25:28.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95bc72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:28.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95bc72e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.929+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a092db20 con 0x7f95a8060040 2024-09-18T01:25:28.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:28.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 20 zone default found 2024-09-18T01:25:28.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 4 Realm: () 2024-09-18T01:25:28.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:28.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:28.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:28.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 20 zonegroup default 2024-09-18T01:25:28.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a0931e30 con 0x7f95a8060040 2024-09-18T01:25:28.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a0933810 con 0x5582a092ee20 2024-09-18T01:25:28.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f95a0051070 con 0x5582a092ee20 2024-09-18T01:25:28.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a0933bb0 con 0x5582a092ee20 2024-09-18T01:25:28.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.930+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f95a0051070 con 0x5582a092ee20 2024-09-18T01:25:28.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.931+0000 7f95bc72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.931+0000 7f95bc72e800 20 started sync module instance, tier type = 2024-09-18T01:25:28.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.931+0000 7f95bc72e800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:28.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.931+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0932cb0 con 0x5582a092a470 2024-09-18T01:25:28.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.931+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.932+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94019528108032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0933f50 con 0x5582a092a470 2024-09-18T01:25:28.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.932+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0934800 con 0x5582a0925a80 2024-09-18T01:25:28.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.932+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94019528108032] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.933+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.933+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94019528114928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0934bf0 con 0x5582a0925a80 2024-09-18T01:25:28.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.933+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a09355f0 con 0x5582a092ee20 2024-09-18T01:25:28.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.934+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94019528114928] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.934+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a0051070 con 0x5582a092ee20 2024-09-18T01:25:28.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.934+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94019528110240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0935a10 con 0x5582a092ee20 2024-09-18T01:25:28.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.934+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0936410 con 0x5582a092a470 2024-09-18T01:25:28.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.935+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94019528110240] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a0051070 con 0x5582a092ee20 2024-09-18T01:25:28.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.935+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.935+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94019528118528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0936cb0 con 0x5582a092a470 2024-09-18T01:25:28.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.935+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0937670 con 0x5582a0925a80 2024-09-18T01:25:28.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.936+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94019528118528] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.936+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.936+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94019528126912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0937a90 con 0x5582a0925a80 2024-09-18T01:25:28.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.936+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0938450 con 0x7f95a8060040 2024-09-18T01:25:28.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.937+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.937+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94019528130464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0938870 con 0x7f95a8060040 2024-09-18T01:25:28.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.937+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0939310 con 0x7f95a8060040 2024-09-18T01:25:28.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.937+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94019528126912] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.938+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.938+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94019528134112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a09392d0 con 0x7f95a8060040 2024-09-18T01:25:28.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.938+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0939cf0 con 0x7f95a8060040 2024-09-18T01:25:28.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.938+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94019528130464] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.939+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94019528134112] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.939+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.939+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94019528127968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a09383c0 con 0x7f95a8060040 2024-09-18T01:25:28.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.939+0000 7f95bc72e800 20 add_watcher() i=0 2024-09-18T01:25:28.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.939+0000 7f95bc72e800 20 add_watcher() i=1 2024-09-18T01:25:28.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.939+0000 7f95bc72e800 20 add_watcher() i=2 2024-09-18T01:25:28.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.939+0000 7f95bc72e800 20 add_watcher() i=3 2024-09-18T01:25:28.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.939+0000 7f95bc72e800 20 add_watcher() i=4 2024-09-18T01:25:28.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.939+0000 7f95bc72e800 20 add_watcher() i=5 2024-09-18T01:25:28.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.939+0000 7f95bc72e800 20 add_watcher() i=6 2024-09-18T01:25:28.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.940+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94019528127968] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.940+0000 7f95bc72e800 20 add_watcher() i=7 2024-09-18T01:25:28.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.940+0000 7f95bc72e800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:28.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.940+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a093cce0 con 0x5582a0925a80 2024-09-18T01:25:28.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.940+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.940+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94019528136672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a093a160 con 0x5582a0925a80 2024-09-18T01:25:28.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.941+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94019528136672] v33'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.941+0000 7f946e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.941+0000 7f95bc72e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:28.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.941+0000 7f95bc72e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:28.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.941+0000 7f95bc72e800 5 note: GC not initialized 2024-09-18T01:25:28.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.941+0000 7f946d7e2640 20 reqs_thread_entry: start 2024-09-18T01:25:28.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:28.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 20 Filter name: none 2024-09-18T01:25:28.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f93deffd640 20 reqs_thread_entry: start 2024-09-18T01:25:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a0970030 con 0x5582a0925a80 2024-09-18T01:25:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T01:25:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-18T01:25:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a0970d90 con 0x5582a092a470 2024-09-18T01:25:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-18T01:25:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-18T01:25:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.942+0000 7f95bc72e800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-18T01:25:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.943+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0976ba0 con 0x5582a0925a80 2024-09-18T01:25:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.944+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v33'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.944+0000 7f95bc72e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.944+0000 7f95bc72e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.944+0000 7f95bc72e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.944+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94019528385920 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a0973680 con 0x5582a0925a80 2024-09-18T01:25:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.944+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== watch-notify(notify (1) cookie 94019528126912 notify 141733920775 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7f95b00438d0 con 0x5582a0925a80 2024-09-18T01:25:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.944+0000 7f94977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 94019528126912 notifier 4398 bl.length()=849 2024-09-18T01:25:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.944+0000 7f94977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.944+0000 7f94977fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.944+0000 7f94977fe640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f947c003ea0 con 0x5582a0925a80 2024-09-18T01:25:28.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.944+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(65 notify.4 [notify cookie 94019528385920 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.944+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.944+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== watch-notify(notify_complete (2) cookie 94019528385920 notify 141733920775 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f95b0018d90 con 0x5582a0925a80 2024-09-18T01:25:28.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.944+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0976580 con 0x5582a092a470 2024-09-18T01:25:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.946+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.946+0000 7f95bc72e800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-18T01:25:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.946+0000 7f95bc72e800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-18T01:25:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.946+0000 7f95bc72e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-18T01:25:28.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.946+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94019528385920 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5582a0973680 con 0x5582a092a470 2024-09-18T01:25:28.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.946+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== watch-notify(notify (1) cookie 94019528108032 notify 141733920771 ret 0) ==== 208+0+0 (crc 0 0 0) 0x5582a0907120 con 0x5582a092a470 2024-09-18T01:25:28.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.946+0000 7f9496ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 94019528108032 notifier 4398 bl.length()=166 2024-09-18T01:25:28.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.946+0000 7f9496ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-18T01:25:28.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.946+0000 7f9496ffd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-18T01:25:28.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.946+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(68 notify.0 [notify cookie 94019528385920 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.946+0000 7f9496ffd640 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f93ec003400 con 0x5582a092a470 2024-09-18T01:25:28.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.946+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.947+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== watch-notify(notify_complete (2) cookie 94019528385920 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5582a0906e90 con 0x5582a092a470 2024-09-18T01:25:28.963 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-18T01:25:28.943847Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:28.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.947+0000 7f946e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:28.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.947+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94019528136672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a096dd40 con 0x5582a0925a80 2024-09-18T01:25:28.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.948+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94019528136672] v33'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.948+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94019528108032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a096dd40 con 0x5582a092a470 2024-09-18T01:25:28.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.949+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94019528108032] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.949+0000 7f95bc72e800 20 remove_watcher() i=0 2024-09-18T01:25:28.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.949+0000 7f95bc72e800 2 removed watcher, disabling cache 2024-09-18T01:25:28.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.949+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94019528114928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a096dd40 con 0x5582a0925a80 2024-09-18T01:25:28.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.950+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94019528114928] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.950+0000 7f95bc72e800 20 remove_watcher() i=1 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.950+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94019528110240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a096dd40 con 0x5582a092ee20 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.951+0000 7f95affff640 1 -- 172.21.15.100:0/436873388 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94019528110240] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a0051070 con 0x5582a092ee20 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.951+0000 7f95bc72e800 20 remove_watcher() i=2 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.951+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94019528118528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a09330a0 con 0x5582a092a470 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.952+0000 7f95b845c640 1 -- 172.21.15.100:0/436873388 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94019528118528] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a804cd70 con 0x5582a092a470 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.952+0000 7f95bc72e800 20 remove_watcher() i=3 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.952+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94019528126912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0935100 con 0x5582a0925a80 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.953+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94019528126912] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x5582a0925a80 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.953+0000 7f95bc72e800 20 remove_watcher() i=4 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.953+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94019528130464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a09330a0 con 0x7f95a8060040 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.954+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94019528130464] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.954+0000 7f95bc72e800 20 remove_watcher() i=5 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.954+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94019528134112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a09371c0 con 0x7f95a8060040 2024-09-18T01:25:28.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.955+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94019528134112] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.955+0000 7f95bc72e800 20 remove_watcher() i=6 2024-09-18T01:25:28.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.955+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94019528127968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5582a0935100 con 0x7f95a8060040 2024-09-18T01:25:28.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94019528127968] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95b000a4a0 con 0x7f95a8060040 2024-09-18T01:25:28.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 20 remove_watcher() i=7 2024-09-18T01:25:28.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f95a8060040 msgr2=0x7f95a803c350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f95a8060040 0x7f95a803c350 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5582a0925a80 msgr2=0x5582a0927f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5582a0925a80 0x5582a0927f40 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5582a092a470 msgr2=0x5582a092c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5582a092a470 0x5582a092c860 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5582a092ee20 msgr2=0x5582a09312e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5582a092ee20 0x5582a09312e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9488036b90 msgr2=0x7f9488039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9488036b90 0x7f9488039050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f95a0053570 tx=0x7f95a0053000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0912fd0 msgr2=0x5582a091a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95b8c5d640 1 -- 172.21.15.100:0/436873388 reap_dead start 2024-09-18T01:25:28.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0912fd0 0x5582a091a2d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f95a8044780 tx=0x7f95a8004e70 comp rx=0 tx=0).stop 2024-09-18T01:25:28.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 shutdown_connections 2024-09-18T01:25:28.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 --2- 172.21.15.100:0/436873388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0912fd0 0x5582a091a2d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 >> 172.21.15.100:0/436873388 conn(0x5582a090f380 msgr2=0x5582a090d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 shutdown_connections 2024-09-18T01:25:28.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.956+0000 7f95bc72e800 1 -- 172.21.15.100:0/436873388 wait complete. 2024-09-18T01:25:28.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/4211821625 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9490036b90 msgr2=0x7f9490039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 --2- 172.21.15.100:0/4211821625 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9490036b90 0x7f9490039050 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5582a08eca40 tx=0x7f95a0005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:28.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/4211821625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0906530 msgr2=0x5582a0906950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 --2- 172.21.15.100:0/4211821625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0906530 0x5582a0906950 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f95a8001750 tx=0x7f95a802c4e0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/4211821625 shutdown_connections 2024-09-18T01:25:28.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 --2- 172.21.15.100:0/4211821625 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9490036b90 0x7f9490039050 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 --2- 172.21.15.100:0/4211821625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0906530 0x5582a0906950 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/4211821625 >> 172.21.15.100:0/4211821625 conn(0x5582a08fb4c0 msgr2=0x5582a08fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/4211821625 shutdown_connections 2024-09-18T01:25:28.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/4211821625 wait complete. 2024-09-18T01:25:28.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5582a08f5c90 msgr2=0x5582a08f8080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5582a08f5c90 0x5582a08f8080 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5582a07f5d40 msgr2=0x5582a08ef550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5582a07f5d40 0x5582a08ef550 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5582a08f1da0 msgr2=0x5582a08f4190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5582a08f1da0 0x5582a08f4190 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f94a0036b40 msgr2=0x7f94a0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f94a0036b40 0x7f94a0039000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f95a0057000 tx=0x7f95a0052000 comp rx=0 tx=0).stop 2024-09-18T01:25:28.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0762df0 msgr2=0x5582a08e84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:28.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 --2- 172.21.15.100:0/3450922194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582a0762df0 0x5582a08e84e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f95a8001e10 tx=0x7f95a8000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:28.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95b8c5d640 1 -- 172.21.15.100:0/3450922194 reap_dead start 2024-09-18T01:25:28.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 shutdown_connections 2024-09-18T01:25:28.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 >> 172.21.15.100:0/3450922194 conn(0x5582a07e9e10 msgr2=0x5582a08dadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:28.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 shutdown_connections 2024-09-18T01:25:28.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:28.957+0000 7f95bc72e800 1 -- 172.21.15.100:0/3450922194 wait complete. 2024-09-18T01:25:28.974 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-18T01:25:28.943847Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:28.975 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:25:28.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:25:28.975 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:25:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.019+0000 7ff7a8040800 1 Processor -- start 2024-09-18T01:25:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.019+0000 7ff7a8040800 1 -- start start 2024-09-18T01:25:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.019+0000 7ff7a8040800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5589be0e3e10 0x5589be1731c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.019+0000 7ff7a8040800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5589be02fb30 con 0x5589be173700 2024-09-18T01:25:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.019+0000 7ff7a8040800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5589be011360 con 0x5589be0e3e10 2024-09-18T01:25:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.019+0000 7ff7a5b34640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5589be0e3e10 0x5589be1731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.019+0000 7ff79ffff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5589be173700 0x5589be175af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37208/0 (socket says 172.21.15.100:37208) 2024-09-18T01:25:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.019+0000 7ff79ffff640 1 -- 172.21.15.100:0/137610111 learned_addr learned my addr 172.21.15.100:0/137610111 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.020+0000 7ff7a5b34640 1 -- 172.21.15.100:0/137610111 >> v1:172.21.15.92:6789/0 conn(0x5589be173700 legacy=0x5589be175af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.020+0000 7ff7a5b34640 1 -- 172.21.15.100:0/137610111 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589be037e00 con 0x5589be0e3e10 2024-09-18T01:25:29.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.021+0000 7ff7a5b34640 1 --2- 172.21.15.100:0/137610111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 0x5589be1731c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff79800a470 tx=0x7ff798045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c90a1b4e4b608f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.022+0000 7ff7a5333640 1 -- 172.21.15.100:0/137610111 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff798053570 con 0x5589be0e3e10 2024-09-18T01:25:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.022+0000 7ff7a5333640 1 -- 172.21.15.100:0/137610111 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff798058070 con 0x5589be0e3e10 2024-09-18T01:25:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.022+0000 7ff7a5333640 1 -- 172.21.15.100:0/137610111 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff798053880 con 0x5589be0e3e10 2024-09-18T01:25:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.022+0000 7ff7a8040800 1 -- 172.21.15.100:0/137610111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 msgr2=0x5589be1731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.022+0000 7ff7a8040800 1 --2- 172.21.15.100:0/137610111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 0x5589be1731c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff79800a470 tx=0x7ff798045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.022+0000 7ff7a8040800 1 -- 172.21.15.100:0/137610111 shutdown_connections 2024-09-18T01:25:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.022+0000 7ff7a8040800 1 --2- 172.21.15.100:0/137610111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 0x5589be1731c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.022+0000 7ff7a8040800 1 -- 172.21.15.100:0/137610111 >> 172.21.15.100:0/137610111 conn(0x5589be16adf0 msgr2=0x5589be16d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.022+0000 7ff7a8040800 1 -- 172.21.15.100:0/137610111 shutdown_connections 2024-09-18T01:25:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.022+0000 7ff7a8040800 1 -- 172.21.15.100:0/137610111 wait complete. 2024-09-18T01:25:29.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.036+0000 7ff7a8040800 1 Processor -- start 2024-09-18T01:25:29.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.036+0000 7ff7a8040800 1 -- start start 2024-09-18T01:25:29.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.036+0000 7ff7a8040800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 0x5589be25f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.036+0000 7ff7a8040800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5589be0bc330 con 0x5589be0e3e10 2024-09-18T01:25:29.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.036+0000 7ff7a5b34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 0x5589be25f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.036+0000 7ff7a5b34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 0x5589be25f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37444/0 (socket says 172.21.15.100:37444) 2024-09-18T01:25:29.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.036+0000 7ff7a5b34640 1 -- 172.21.15.100:0/1033847333 learned_addr learned my addr 172.21.15.100:0/1033847333 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.036+0000 7ff7a5b34640 1 -- 172.21.15.100:0/1033847333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589be009bc0 con 0x5589be0e3e10 2024-09-18T01:25:29.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.037+0000 7ff7a5b34640 1 --2- 172.21.15.100:0/1033847333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 0x5589be25f860 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff798025c20 tx=0x7ff798051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5033dbaeb86924ce server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.037+0000 7ff693e07640 1 -- 172.21.15.100:0/1033847333 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff79805c580 con 0x5589be0e3e10 2024-09-18T01:25:29.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.037+0000 7ff693e07640 1 -- 172.21.15.100:0/1033847333 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff798063030 con 0x5589be0e3e10 2024-09-18T01:25:29.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.037+0000 7ff693e07640 1 -- 172.21.15.100:0/1033847333 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff79805c850 con 0x5589be0e3e10 2024-09-18T01:25:29.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.038+0000 7ff7a8040800 1 -- 172.21.15.100:0/1033847333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 msgr2=0x5589be25f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.038+0000 7ff7a8040800 1 --2- 172.21.15.100:0/1033847333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 0x5589be25f860 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff798025c20 tx=0x7ff798051000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.038+0000 7ff7a8040800 1 -- 172.21.15.100:0/1033847333 shutdown_connections 2024-09-18T01:25:29.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.038+0000 7ff7a8040800 1 --2- 172.21.15.100:0/1033847333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 0x5589be25f860 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.038+0000 7ff7a8040800 1 -- 172.21.15.100:0/1033847333 >> 172.21.15.100:0/1033847333 conn(0x5589be16adf0 msgr2=0x5589be25b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.038+0000 7ff7a8040800 1 -- 172.21.15.100:0/1033847333 shutdown_connections 2024-09-18T01:25:29.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.038+0000 7ff7a8040800 1 -- 172.21.15.100:0/1033847333 wait complete. 2024-09-18T01:25:29.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.038+0000 7ff7a8040800 1 Processor -- start 2024-09-18T01:25:29.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.038+0000 7ff7a8040800 1 -- start start 2024-09-18T01:25:29.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.038+0000 7ff7a8040800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 0x5589be2671a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.038+0000 7ff7a8040800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5589be177600 con 0x5589be0e3e10 2024-09-18T01:25:29.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.038+0000 7ff7a5b34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 0x5589be2671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.038+0000 7ff7a5b34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 0x5589be2671a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37448/0 (socket says 172.21.15.100:37448) 2024-09-18T01:25:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.038+0000 7ff7a5b34640 1 -- 172.21.15.100:0/3538858407 learned_addr learned my addr 172.21.15.100:0/3538858407 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.039+0000 7ff7a5b34640 1 -- 172.21.15.100:0/3538858407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589be01dfe0 con 0x5589be0e3e10 2024-09-18T01:25:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.039+0000 7ff7a5b34640 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 0x5589be2671a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff79800a330 tx=0x7ff798002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.039+0000 7ff692604640 1 -- 172.21.15.100:0/3538858407 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff79806c030 con 0x5589be0e3e10 2024-09-18T01:25:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.039+0000 7ff692604640 1 -- 172.21.15.100:0/3538858407 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79805c580 con 0x5589be0e3e10 2024-09-18T01:25:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.039+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589be2676e0 con 0x5589be0e3e10 2024-09-18T01:25:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.039+0000 7ff692604640 1 -- 172.21.15.100:0/3538858407 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff79805c860 con 0x5589be0e3e10 2024-09-18T01:25:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.039+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589be267c60 con 0x5589be0e3e10 2024-09-18T01:25:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.040+0000 7ff692604640 1 -- 172.21.15.100:0/3538858407 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff798053440 con 0x5589be0e3e10 2024-09-18T01:25:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.040+0000 7ff692604640 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff68c036b40 0x7ff68c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.040+0000 7ff692604640 1 -- 172.21.15.100:0/3538858407 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff798070020 con 0x5589be0e3e10 2024-09-18T01:25:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.040+0000 7ff79ffff640 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff68c036b40 0x7ff68c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.040+0000 7ff7a8040800 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5589be173700 0x5589be26e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.040+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be26e790 con 0x5589be173700 2024-09-18T01:25:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.040+0000 7ff7a6335640 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5589be173700 0x5589be26e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.040+0000 7ff79ffff640 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff68c036b40 0x7ff68c039000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff790000f60 tx=0x7ff7900012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.040+0000 7ff7a6335640 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5589be173700 0x5589be26e210 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.041+0000 7ff7a6335640 1 -- 172.21.15.100:0/3538858407 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be173700 2024-09-18T01:25:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.041+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be26b7c0 con 0x5589be173700 2024-09-18T01:25:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.041+0000 7ff7a6335640 1 -- 172.21.15.100:0/3538858407 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be173700 2024-09-18T01:25:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.041+0000 7ff7a8040800 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5589be270b10 0x5589be272f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.041+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be2735f0 con 0x5589be270b10 2024-09-18T01:25:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.041+0000 7ff7a5b34640 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5589be270b10 0x5589be272f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.041+0000 7ff7a5b34640 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5589be270b10 0x5589be272f00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.042+0000 7ff7a5b34640 1 -- 172.21.15.100:0/3538858407 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff79807b070 con 0x5589be270b10 2024-09-18T01:25:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.042+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be26f9b0 con 0x5589be173700 2024-09-18T01:25:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.042+0000 7ff7a6335640 1 -- 172.21.15.100:0/3538858407 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be173700 2024-09-18T01:25:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.042+0000 7ff7a8040800 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5589be274a50 0x5589be276e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.042+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be277540 con 0x5589be274a50 2024-09-18T01:25:29.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.042+0000 7ff79ffff640 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5589be274a50 0x5589be276e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.042+0000 7ff79ffff640 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5589be274a50 0x5589be276e40 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.043+0000 7ff79ffff640 1 -- 172.21.15.100:0/3538858407 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff790009050 con 0x5589be274a50 2024-09-18T01:25:29.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.043+0000 7ff7a8040800 1 Processor -- start 2024-09-18T01:25:29.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.043+0000 7ff7a8040800 1 -- start start 2024-09-18T01:25:29.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.043+0000 7ff7a8040800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be285270 0x5589be285690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.043+0000 7ff7a8040800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5589be00b580 con 0x5589be285270 2024-09-18T01:25:29.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.043+0000 7ff7a5b34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be285270 0x5589be285690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.043+0000 7ff7a5b34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be285270 0x5589be285690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37452/0 (socket says 172.21.15.100:37452) 2024-09-18T01:25:29.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.043+0000 7ff7a5b34640 1 -- 172.21.15.100:0/569964558 learned_addr learned my addr 172.21.15.100:0/569964558 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.044+0000 7ff7a5b34640 1 -- 172.21.15.100:0/569964558 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589be285bd0 con 0x5589be285270 2024-09-18T01:25:29.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.044+0000 7ff7a5b34640 1 --2- 172.21.15.100:0/569964558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be285270 0x5589be285690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff79808ef20 tx=0x7ff798009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.044+0000 7ff68b7fe640 1 -- 172.21.15.100:0/569964558 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff798095070 con 0x5589be285270 2024-09-18T01:25:29.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.044+0000 7ff68b7fe640 1 -- 172.21.15.100:0/569964558 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79805eac0 con 0x5589be285270 2024-09-18T01:25:29.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.044+0000 7ff7a8040800 1 -- 172.21.15.100:0/569964558 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589be285e60 con 0x5589be285270 2024-09-18T01:25:29.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.044+0000 7ff68b7fe640 1 -- 172.21.15.100:0/569964558 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff79805ede0 con 0x5589be285270 2024-09-18T01:25:29.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.044+0000 7ff7a8040800 1 -- 172.21.15.100:0/569964558 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589be288b40 con 0x5589be285270 2024-09-18T01:25:29.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.045+0000 7ff68b7fe640 1 -- 172.21.15.100:0/569964558 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff798098070 con 0x5589be285270 2024-09-18T01:25:29.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.045+0000 7ff68b7fe640 1 --2- 172.21.15.100:0/569964558 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff680036b90 0x7ff680039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.045+0000 7ff68b7fe640 1 -- 172.21.15.100:0/569964558 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff798085070 con 0x5589be285270 2024-09-18T01:25:29.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.045+0000 7ff79ffff640 1 --2- 172.21.15.100:0/569964558 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff680036b90 0x7ff680039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.045+0000 7ff7a8040800 1 Processor -- start 2024-09-18T01:25:29.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.045+0000 7ff7a8040800 1 -- start start 2024-09-18T01:25:29.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.045+0000 7ff79ffff640 1 --2- 172.21.15.100:0/569964558 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff680036b90 0x7ff680039050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff79000bf50 tx=0x7ff79000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.045+0000 7ff7a8040800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be291d20 0x5589be292120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.045+0000 7ff7a8040800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5589be25ffb0 con 0x5589be291d20 2024-09-18T01:25:29.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.046+0000 7ff7a5b34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be291d20 0x5589be292120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.046+0000 7ff7a5b34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be291d20 0x5589be292120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37460/0 (socket says 172.21.15.100:37460) 2024-09-18T01:25:29.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.046+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2621054767 learned_addr learned my addr 172.21.15.100:0/2621054767 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.046+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2621054767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589be2926f0 con 0x5589be291d20 2024-09-18T01:25:29.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.046+0000 7ff7a5b34640 1 --2- 172.21.15.100:0/2621054767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be291d20 0x5589be292120 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff798009cc0 tx=0x7ff79805e590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf3c3af659cd363 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.046+0000 7ff6897fa640 1 -- 172.21.15.100:0/2621054767 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7980551a0 con 0x5589be291d20 2024-09-18T01:25:29.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.046+0000 7ff6897fa640 1 -- 172.21.15.100:0/2621054767 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7980ac070 con 0x5589be291d20 2024-09-18T01:25:29.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.046+0000 7ff6897fa640 1 -- 172.21.15.100:0/2621054767 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7980524d0 con 0x5589be291d20 2024-09-18T01:25:29.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.047+0000 7ff7a8040800 1 -- 172.21.15.100:0/2621054767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be291d20 msgr2=0x5589be292120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.047+0000 7ff7a8040800 1 --2- 172.21.15.100:0/2621054767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be291d20 0x5589be292120 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff798009cc0 tx=0x7ff79805e590 comp rx=0 tx=0).stop 2024-09-18T01:25:29.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.047+0000 7ff7a8040800 1 -- 172.21.15.100:0/2621054767 shutdown_connections 2024-09-18T01:25:29.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.047+0000 7ff7a8040800 1 --2- 172.21.15.100:0/2621054767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be291d20 0x5589be292120 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.047+0000 7ff7a8040800 1 -- 172.21.15.100:0/2621054767 >> 172.21.15.100:0/2621054767 conn(0x5589be28e080 msgr2=0x5589be28c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.047+0000 7ff7a8040800 1 -- 172.21.15.100:0/2621054767 shutdown_connections 2024-09-18T01:25:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.047+0000 7ff7a8040800 1 -- 172.21.15.100:0/2621054767 wait complete. 2024-09-18T01:25:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.047+0000 7ff7a8040800 1 Processor -- start 2024-09-18T01:25:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.047+0000 7ff7a8040800 1 -- start start 2024-09-18T01:25:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.047+0000 7ff7a8040800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be291d20 0x5589be298fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.047+0000 7ff7a8040800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5589be292c70 con 0x5589be291d20 2024-09-18T01:25:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.047+0000 7ff7a5b34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be291d20 0x5589be298fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.047+0000 7ff7a5b34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be291d20 0x5589be298fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37476/0 (socket says 172.21.15.100:37476) 2024-09-18T01:25:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.047+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 learned_addr learned my addr 172.21.15.100:0/2574085785 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.048+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589be2994f0 con 0x5589be291d20 2024-09-18T01:25:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.048+0000 7ff7a5b34640 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be291d20 0x5589be298fb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff798000c00 tx=0x7ff798097f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.048+0000 7ff6777fe640 1 -- 172.21.15.100:0/2574085785 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7980b9070 con 0x5589be291d20 2024-09-18T01:25:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.048+0000 7ff6777fe640 1 -- 172.21.15.100:0/2574085785 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff798060e40 con 0x5589be291d20 2024-09-18T01:25:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.048+0000 7ff6777fe640 1 -- 172.21.15.100:0/2574085785 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7980900b0 con 0x5589be291d20 2024-09-18T01:25:29.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.048+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589be2994f0 con 0x5589be291d20 2024-09-18T01:25:29.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.048+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589be2994f0 con 0x5589be291d20 2024-09-18T01:25:29.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.049+0000 7ff6777fe640 1 -- 172.21.15.100:0/2574085785 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff7980a6070 con 0x5589be291d20 2024-09-18T01:25:29.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.049+0000 7ff6777fe640 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff670036b90 0x7ff670039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.049+0000 7ff6777fe640 1 -- 172.21.15.100:0/2574085785 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff798088040 con 0x5589be291d20 2024-09-18T01:25:29.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.049+0000 7ff79ffff640 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff670036b90 0x7ff670039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.049+0000 7ff7a8040800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.049+0000 7ff7a8040800 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5589be2a4570 0x5589be2a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.049+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a7180 con 0x5589be2a4570 2024-09-18T01:25:29.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.050+0000 7ff79ffff640 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff670036b90 0x7ff670039050 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff790001b60 tx=0x7ff790010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.050+0000 7ff7a6335640 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5589be2a4570 0x5589be2a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.050+0000 7ff7a6335640 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5589be2a4570 0x5589be2a6a30 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.050+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.050+0000 7ff7a8040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.050+0000 7ff7a8040800 20 realm 2024-09-18T01:25:29.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.050+0000 7ff7a8040800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.050+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a7590 con 0x5589be2a4570 2024-09-18T01:25:29.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.050+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.050+0000 7ff7a8040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.050+0000 7ff7a8040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:29.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.050+0000 7ff7a8040800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.050+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a7e60 con 0x5589be2a4570 2024-09-18T01:25:29.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.050+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.051+0000 7ff7a8040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.051+0000 7ff7a8040800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.051+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2a4570 2024-09-18T01:25:29.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.051+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.051+0000 7ff7a8040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:29.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.051+0000 7ff7a8040800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.051+0000 7ff7a8040800 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5589be2a8cf0 0x5589be2ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.051+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be2ab840 con 0x5589be2a8cf0 2024-09-18T01:25:29.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.051+0000 7ff7a5b34640 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5589be2a8cf0 0x5589be2ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.051+0000 7ff7a5b34640 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5589be2a8cf0 0x5589be2ab0e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.052+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff7980c4070 con 0x5589be2a8cf0 2024-09-18T01:25:29.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.052+0000 7ff7a8040800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:29.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.052+0000 7ff7a8040800 20 searching for the correct realm 2024-09-18T01:25:29.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.052+0000 7ff7a8040800 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5589be2ad8f0 0x5589be2afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.052+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b0480 con 0x5589be2ad8f0 2024-09-18T01:25:29.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.052+0000 7ff79ffff640 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5589be2ad8f0 0x5589be2afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.052+0000 7ff79ffff640 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5589be2ad8f0 0x5589be2afdb0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.052+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff790009050 con 0x5589be2ad8f0 2024-09-18T01:25:29.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.052+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b0480 con 0x5589be2a8cf0 2024-09-18T01:25:29.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.052+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980c4070 con 0x5589be2a8cf0 2024-09-18T01:25:29.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.052+0000 7ff7a5b34640 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff798060590 0x7ff79809a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.052+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b0480 con 0x7ff798060590 2024-09-18T01:25:29.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.053+0000 7ff7a6335640 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff798060590 0x7ff79809a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.053+0000 7ff7a6335640 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff798060590 0x7ff79809a920 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.053+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.053+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2a4570 2024-09-18T01:25:29.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.054+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.054+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2a4570 2024-09-18T01:25:29.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.054+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.054+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x7ff798060590 2024-09-18T01:25:29.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.054+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.054+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x7ff798060590 2024-09-18T01:25:29.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.054+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.054+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2a8cf0 2024-09-18T01:25:29.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.055+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980c4070 con 0x5589be2a8cf0 2024-09-18T01:25:29.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.055+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2ad8f0 2024-09-18T01:25:29.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.055+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff790009050 con 0x5589be2ad8f0 2024-09-18T01:25:29.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.055+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2a4570 2024-09-18T01:25:29.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.055+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.055+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x7ff798060590 2024-09-18T01:25:29.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.055+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.055+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2a4570 2024-09-18T01:25:29.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.055+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.055+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2a8cf0 2024-09-18T01:25:29.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.056+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff7980c4070 con 0x5589be2a8cf0 2024-09-18T01:25:29.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.056+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2ad8f0 2024-09-18T01:25:29.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.056+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff790009050 con 0x5589be2ad8f0 2024-09-18T01:25:29.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.056+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2ad8f0 2024-09-18T01:25:29.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.056+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff790009050 con 0x5589be2ad8f0 2024-09-18T01:25:29.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.056+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x7ff798060590 2024-09-18T01:25:29.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.056+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.056+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2ad8f0 2024-09-18T01:25:29.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.057+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff790009050 con 0x5589be2ad8f0 2024-09-18T01:25:29.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.057+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2ad8f0 2024-09-18T01:25:29.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.057+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff790009050 con 0x5589be2ad8f0 2024-09-18T01:25:29.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.057+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2a4570 2024-09-18T01:25:29.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.057+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.057+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2a4570 2024-09-18T01:25:29.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.057+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.057+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x7ff798060590 2024-09-18T01:25:29.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.058+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.058+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2ad8f0 2024-09-18T01:25:29.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.058+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff790009050 con 0x5589be2ad8f0 2024-09-18T01:25:29.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.058+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2a8cf0 2024-09-18T01:25:29.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.058+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980c4070 con 0x5589be2a8cf0 2024-09-18T01:25:29.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.058+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2a4570 2024-09-18T01:25:29.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.058+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.058+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x7ff798060590 2024-09-18T01:25:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.058+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.059+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2ad8f0 2024-09-18T01:25:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.059+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff790009050 con 0x5589be2ad8f0 2024-09-18T01:25:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.059+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x7ff798060590 2024-09-18T01:25:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.059+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.059+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2a8cf0 2024-09-18T01:25:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.059+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980c4070 con 0x5589be2a8cf0 2024-09-18T01:25:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.059+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2ad8f0 2024-09-18T01:25:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.059+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff790009050 con 0x5589be2ad8f0 2024-09-18T01:25:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.059+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x7ff798060590 2024-09-18T01:25:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2a4570 2024-09-18T01:25:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589be2a8200 con 0x5589be2a8cf0 2024-09-18T01:25:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff7980c4070 con 0x5589be2a8cf0 2024-09-18T01:25:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a8040800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a8040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a8040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a8040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a8040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a8040800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a8040800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be2ac1f0 con 0x5589be2a4570 2024-09-18T01:25:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a8040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a8040800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.060+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be2ac5e0 con 0x5589be2a4570 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.061+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.061+0000 7ff7a8040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.061+0000 7ff7a8040800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.061+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be2ac5e0 con 0x7ff798060590 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.061+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.061+0000 7ff7a8040800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.061+0000 7ff7a8040800 20 zone default found 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.061+0000 7ff7a8040800 4 Realm: () 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.061+0000 7ff7a8040800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.061+0000 7ff7a8040800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.061+0000 7ff7a8040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.061+0000 7ff7a8040800 20 zonegroup default 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.061+0000 7ff7a8040800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.061+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be2aca00 con 0x7ff798060590 2024-09-18T01:25:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.062+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.062+0000 7ff7a8040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.062+0000 7ff7a8040800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.062+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be2aca00 con 0x5589be2ad8f0 2024-09-18T01:25:29.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.062+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff790009050 con 0x5589be2ad8f0 2024-09-18T01:25:29.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.062+0000 7ff7a8040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.062+0000 7ff7a8040800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.062+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b22e0 con 0x5589be2ad8f0 2024-09-18T01:25:29.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.062+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff790009050 con 0x5589be2ad8f0 2024-09-18T01:25:29.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.062+0000 7ff7a8040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.062+0000 7ff7a8040800 20 started sync module instance, tier type = 2024-09-18T01:25:29.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.062+0000 7ff7a8040800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:29.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.062+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b1780 con 0x5589be2a8cf0 2024-09-18T01:25:29.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.063+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980c4070 con 0x5589be2a8cf0 2024-09-18T01:25:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.063+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94050089376672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b2b30 con 0x5589be2a8cf0 2024-09-18T01:25:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.063+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b3380 con 0x5589be2a4570 2024-09-18T01:25:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.064+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94050089376672] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980c4070 con 0x5589be2a8cf0 2024-09-18T01:25:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.065+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.065+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94050089379456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b3460 con 0x5589be2a4570 2024-09-18T01:25:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.065+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b3f50 con 0x5589be2ad8f0 2024-09-18T01:25:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.065+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff790009050 con 0x5589be2ad8f0 2024-09-18T01:25:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.066+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94050089384480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b47f0 con 0x5589be2ad8f0 2024-09-18T01:25:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.066+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b52f0 con 0x5589be2a8cf0 2024-09-18T01:25:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.066+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94050089379456] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.066+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94050089384480] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff790009050 con 0x5589be2ad8f0 2024-09-18T01:25:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.067+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980c4070 con 0x5589be2a8cf0 2024-09-18T01:25:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.067+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94050089389536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b56e0 con 0x5589be2a8cf0 2024-09-18T01:25:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.067+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b5f30 con 0x5589be2a4570 2024-09-18T01:25:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.068+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.068+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94050089392320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b6350 con 0x5589be2a4570 2024-09-18T01:25:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.068+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b6e70 con 0x7ff798060590 2024-09-18T01:25:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.068+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94050089389536] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980c4070 con 0x5589be2a8cf0 2024-09-18T01:25:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.069+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94050089392320] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.069+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.069+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94050089396544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b6e30 con 0x7ff798060590 2024-09-18T01:25:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.069+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b7710 con 0x7ff798060590 2024-09-18T01:25:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.070+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94050089396544] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.070+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.070+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94050089381584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b6e30 con 0x7ff798060590 2024-09-18T01:25:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.070+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b7d30 con 0x7ff798060590 2024-09-18T01:25:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.071+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94050089381584] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.071+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.071+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94050089398800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b7d30 con 0x7ff798060590 2024-09-18T01:25:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.071+0000 7ff7a8040800 20 add_watcher() i=0 2024-09-18T01:25:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.071+0000 7ff7a8040800 20 add_watcher() i=1 2024-09-18T01:25:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.071+0000 7ff7a8040800 20 add_watcher() i=2 2024-09-18T01:25:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.071+0000 7ff7a8040800 20 add_watcher() i=3 2024-09-18T01:25:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.071+0000 7ff7a8040800 20 add_watcher() i=4 2024-09-18T01:25:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.071+0000 7ff7a8040800 20 add_watcher() i=5 2024-09-18T01:25:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.071+0000 7ff7a8040800 20 add_watcher() i=6 2024-09-18T01:25:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.072+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94050089398800] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.072+0000 7ff7a8040800 20 add_watcher() i=7 2024-09-18T01:25:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.072+0000 7ff7a8040800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.072+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be2bb070 con 0x5589be2a4570 2024-09-18T01:25:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.072+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.072+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94050089413264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b7ea0 con 0x5589be2a4570 2024-09-18T01:25:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.073+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94050089413264] v33'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.073+0000 7ff6577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.073+0000 7ff7a8040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.073+0000 7ff7a8040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.073+0000 7ff7a8040800 5 note: GC not initialized 2024-09-18T01:25:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.073+0000 7ff6567fc640 20 reqs_thread_entry: start 2024-09-18T01:25:29.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.073+0000 7ff7a8040800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:29.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.073+0000 7ff7a8040800 20 Filter name: none 2024-09-18T01:25:29.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.074+0000 7ff5c7fff640 20 reqs_thread_entry: start 2024-09-18T01:25:29.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.074+0000 7ff7a8040800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.074+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589be2f0270 con 0x5589be2a4570 2024-09-18T01:25:29.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.074+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.074+0000 7ff7a8040800 20 rados_obj.operate() r=0 bl.length=673 2024-09-18T01:25:29.088 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-18T01:25:28.943847Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:29.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.075+0000 7ff6577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:29.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.075+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94050089413264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2f07b0 con 0x5589be2a4570 2024-09-18T01:25:29.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.076+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94050089413264] v33'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.076+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94050089376672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2f07b0 con 0x5589be2a8cf0 2024-09-18T01:25:29.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.077+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94050089376672] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980c4070 con 0x5589be2a8cf0 2024-09-18T01:25:29.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.077+0000 7ff7a8040800 20 remove_watcher() i=0 2024-09-18T01:25:29.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.077+0000 7ff7a8040800 2 removed watcher, disabling cache 2024-09-18T01:25:29.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.077+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94050089379456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b1ba0 con 0x5589be2a4570 2024-09-18T01:25:29.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.078+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94050089379456] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.078+0000 7ff7a8040800 20 remove_watcher() i=1 2024-09-18T01:25:29.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.078+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94050089384480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b1ba0 con 0x5589be2ad8f0 2024-09-18T01:25:29.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.079+0000 7ff79ffff640 1 -- 172.21.15.100:0/2574085785 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94050089384480] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff790009050 con 0x5589be2ad8f0 2024-09-18T01:25:29.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.079+0000 7ff7a8040800 20 remove_watcher() i=2 2024-09-18T01:25:29.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.079+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94050089389536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b2680 con 0x5589be2a8cf0 2024-09-18T01:25:29.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.080+0000 7ff7a5b34640 1 -- 172.21.15.100:0/2574085785 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94050089389536] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980c4070 con 0x5589be2a8cf0 2024-09-18T01:25:29.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.080+0000 7ff7a8040800 20 remove_watcher() i=3 2024-09-18T01:25:29.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.080+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94050089392320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b2680 con 0x5589be2a4570 2024-09-18T01:25:29.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.081+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94050089392320] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x5589be2a4570 2024-09-18T01:25:29.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.081+0000 7ff7a8040800 20 remove_watcher() i=4 2024-09-18T01:25:29.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.081+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94050089396544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b58c0 con 0x7ff798060590 2024-09-18T01:25:29.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.082+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94050089396544] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.082+0000 7ff7a8040800 20 remove_watcher() i=5 2024-09-18T01:25:29.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.082+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94050089381584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b2680 con 0x7ff798060590 2024-09-18T01:25:29.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.083+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94050089381584] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.083+0000 7ff7a8040800 20 remove_watcher() i=6 2024-09-18T01:25:29.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.083+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94050089398800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589be2b58c0 con 0x7ff798060590 2024-09-18T01:25:29.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94050089398800] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a000a4a0 con 0x7ff798060590 2024-09-18T01:25:29.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 20 remove_watcher() i=7 2024-09-18T01:25:29.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff798060590 msgr2=0x7ff79809a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff798060590 0x7ff79809a920 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5589be2a4570 msgr2=0x5589be2a6a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5589be2a4570 0x5589be2a6a30 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5589be2a8cf0 msgr2=0x5589be2ab0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5589be2a8cf0 0x5589be2ab0e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5589be2ad8f0 msgr2=0x5589be2afdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5589be2ad8f0 0x5589be2afdb0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff670036b90 msgr2=0x7ff670039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff670036b90 0x7ff670039050 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff790001b60 tx=0x7ff790010000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be291d20 msgr2=0x5589be298fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a6335640 1 -- 172.21.15.100:0/2574085785 reap_dead start 2024-09-18T01:25:29.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be291d20 0x5589be298fb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff798000c00 tx=0x7ff798097f50 comp rx=0 tx=0).stop 2024-09-18T01:25:29.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 shutdown_connections 2024-09-18T01:25:29.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 --2- 172.21.15.100:0/2574085785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be291d20 0x5589be298fb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 >> 172.21.15.100:0/2574085785 conn(0x5589be28e080 msgr2=0x5589be28c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 shutdown_connections 2024-09-18T01:25:29.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.084+0000 7ff7a8040800 1 -- 172.21.15.100:0/2574085785 wait complete. 2024-09-18T01:25:29.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/569964558 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff680036b90 msgr2=0x7ff680039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 --2- 172.21.15.100:0/569964558 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff680036b90 0x7ff680039050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff79000bf50 tx=0x7ff79000f000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/569964558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be285270 msgr2=0x5589be285690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 --2- 172.21.15.100:0/569964558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be285270 0x5589be285690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff79808ef20 tx=0x7ff798009710 comp rx=0 tx=0).stop 2024-09-18T01:25:29.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/569964558 shutdown_connections 2024-09-18T01:25:29.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 --2- 172.21.15.100:0/569964558 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff680036b90 0x7ff680039050 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 --2- 172.21.15.100:0/569964558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be285270 0x5589be285690 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/569964558 >> 172.21.15.100:0/569964558 conn(0x5589be27a200 msgr2=0x5589be27cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/569964558 shutdown_connections 2024-09-18T01:25:29.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/569964558 wait complete. 2024-09-18T01:25:29.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5589be274a50 msgr2=0x5589be276e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5589be274a50 0x5589be276e40 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5589be173700 msgr2=0x5589be26e210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5589be173700 0x5589be26e210 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5589be270b10 msgr2=0x5589be272f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5589be270b10 0x5589be272f00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff68c036b40 msgr2=0x7ff68c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff68c036b40 0x7ff68c039000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff790000f60 tx=0x7ff7900012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 msgr2=0x5589be2671a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 --2- 172.21.15.100:0/3538858407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589be0e3e10 0x5589be2671a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff79800a330 tx=0x7ff798002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a6335640 1 -- 172.21.15.100:0/3538858407 reap_dead start 2024-09-18T01:25:29.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 shutdown_connections 2024-09-18T01:25:29.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 >> 172.21.15.100:0/3538858407 conn(0x5589be16adf0 msgr2=0x5589be259ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 shutdown_connections 2024-09-18T01:25:29.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.085+0000 7ff7a8040800 1 -- 172.21.15.100:0/3538858407 wait complete. 2024-09-18T01:25:29.100 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-18T01:25:28.943847Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:29.100 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-18T01:25:29.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-18T01:25:29.100 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-18T01:25:29.146 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:29.146 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.146+0000 7f67efa0d800 1 Processor -- start 2024-09-18T01:25:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.146+0000 7f67efa0d800 1 -- start start 2024-09-18T01:25:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.146+0000 7f67efa0d800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x564e96bc8920 0x564e96bcad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.146+0000 7f67efa0d800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564e96a84b30 con 0x564e96bc44e0 2024-09-18T01:25:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.146+0000 7f67efa0d800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x564e96a66360 con 0x564e96bc8920 2024-09-18T01:25:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.146+0000 7f67ecd00640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x564e96bc8920 0x564e96bcad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.146+0000 7f67ed501640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x564e96bc44e0 0x564e96bc48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37218/0 (socket says 172.21.15.100:37218) 2024-09-18T01:25:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.146+0000 7f67ecd00640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x564e96bc8920 0x564e96bcad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37482/0 (socket says 172.21.15.100:37482) 2024-09-18T01:25:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.146+0000 7f67ed501640 1 -- 172.21.15.100:0/3818737755 learned_addr learned my addr 172.21.15.100:0/3818737755 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.147+0000 7f67ecd00640 1 -- 172.21.15.100:0/3818737755 >> v1:172.21.15.92:6789/0 conn(0x564e96bc44e0 legacy=0x564e96bc48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.147+0000 7f67ecd00640 1 -- 172.21.15.100:0/3818737755 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e96a8ce00 con 0x564e96bc8920 2024-09-18T01:25:29.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.148+0000 7f67ecd00640 1 --2- 172.21.15.100:0/3818737755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc8920 0x564e96bcad10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f67e400a470 tx=0x7f67e4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea47910a57ec0efc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.149+0000 7f67dffff640 1 -- 172.21.15.100:0/3818737755 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e4053570 con 0x564e96bc8920 2024-09-18T01:25:29.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.149+0000 7f67dffff640 1 -- 172.21.15.100:0/3818737755 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e4058070 con 0x564e96bc8920 2024-09-18T01:25:29.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.149+0000 7f67dffff640 1 -- 172.21.15.100:0/3818737755 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e4053880 con 0x564e96bc8920 2024-09-18T01:25:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.149+0000 7f67efa0d800 1 -- 172.21.15.100:0/3818737755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc8920 msgr2=0x564e96bcad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.149+0000 7f67efa0d800 1 --2- 172.21.15.100:0/3818737755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc8920 0x564e96bcad10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f67e400a470 tx=0x7f67e4045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.149+0000 7f67efa0d800 1 -- 172.21.15.100:0/3818737755 shutdown_connections 2024-09-18T01:25:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.149+0000 7f67efa0d800 1 --2- 172.21.15.100:0/3818737755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc8920 0x564e96bcad10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.149+0000 7f67efa0d800 1 -- 172.21.15.100:0/3818737755 >> 172.21.15.100:0/3818737755 conn(0x564e96bbfdd0 msgr2=0x564e96bc21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.149+0000 7f67efa0d800 1 -- 172.21.15.100:0/3818737755 shutdown_connections 2024-09-18T01:25:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.149+0000 7f67efa0d800 1 -- 172.21.15.100:0/3818737755 wait complete. 2024-09-18T01:25:29.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.163+0000 7f67efa0d800 1 Processor -- start 2024-09-18T01:25:29.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.163+0000 7f67efa0d800 1 -- start start 2024-09-18T01:25:29.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.163+0000 7f67efa0d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc44e0 0x564e96cb3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.163+0000 7f67efa0d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e96b11360 con 0x564e96bc44e0 2024-09-18T01:25:29.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.163+0000 7f67ed501640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc44e0 0x564e96cb3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.163+0000 7f67ed501640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc44e0 0x564e96cb3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37486/0 (socket says 172.21.15.100:37486) 2024-09-18T01:25:29.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.163+0000 7f67ed501640 1 -- 172.21.15.100:0/2601635490 learned_addr learned my addr 172.21.15.100:0/2601635490 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.164+0000 7f67ed501640 1 -- 172.21.15.100:0/2601635490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e96a5ebc0 con 0x564e96bc44e0 2024-09-18T01:25:29.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.164+0000 7f67ed501640 1 --2- 172.21.15.100:0/2601635490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc44e0 0x564e96cb3770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f67e0001e10 tx=0x7f67e000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d40c3ba991636b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.164+0000 7f66db606640 1 -- 172.21.15.100:0/2601635490 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e000b200 con 0x564e96bc44e0 2024-09-18T01:25:29.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.164+0000 7f66db606640 1 -- 172.21.15.100:0/2601635490 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e0009460 con 0x564e96bc44e0 2024-09-18T01:25:29.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.164+0000 7f66db606640 1 -- 172.21.15.100:0/2601635490 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e0009760 con 0x564e96bc44e0 2024-09-18T01:25:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.165+0000 7f67efa0d800 1 -- 172.21.15.100:0/2601635490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc44e0 msgr2=0x564e96cb3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.165+0000 7f67efa0d800 1 --2- 172.21.15.100:0/2601635490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc44e0 0x564e96cb3770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f67e0001e10 tx=0x7f67e000b910 comp rx=0 tx=0).stop 2024-09-18T01:25:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.165+0000 7f67efa0d800 1 -- 172.21.15.100:0/2601635490 shutdown_connections 2024-09-18T01:25:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.165+0000 7f67efa0d800 1 --2- 172.21.15.100:0/2601635490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc44e0 0x564e96cb3770 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.165+0000 7f67efa0d800 1 -- 172.21.15.100:0/2601635490 >> 172.21.15.100:0/2601635490 conn(0x564e96bbfdd0 msgr2=0x564e96caf130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.165+0000 7f67efa0d800 1 -- 172.21.15.100:0/2601635490 shutdown_connections 2024-09-18T01:25:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.165+0000 7f67efa0d800 1 -- 172.21.15.100:0/2601635490 wait complete. 2024-09-18T01:25:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.165+0000 7f67efa0d800 1 Processor -- start 2024-09-18T01:25:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.165+0000 7f67efa0d800 1 -- start start 2024-09-18T01:25:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.165+0000 7f67efa0d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc44e0 0x564e96cba060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.165+0000 7f67efa0d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e96bcb550 con 0x564e96bc44e0 2024-09-18T01:25:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.166+0000 7f67ed501640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc44e0 0x564e96cba060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.166+0000 7f67ed501640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc44e0 0x564e96cba060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37494/0 (socket says 172.21.15.100:37494) 2024-09-18T01:25:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.166+0000 7f67ed501640 1 -- 172.21.15.100:0/690208372 learned_addr learned my addr 172.21.15.100:0/690208372 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.166+0000 7f67ed501640 1 -- 172.21.15.100:0/690208372 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e96a72fe0 con 0x564e96bc44e0 2024-09-18T01:25:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.166+0000 7f67ed501640 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc44e0 0x564e96cba060 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f67e000cfd0 tx=0x7f67e0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.166+0000 7f66d9e03640 1 -- 172.21.15.100:0/690208372 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e001b040 con 0x564e96bc44e0 2024-09-18T01:25:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.166+0000 7f66d9e03640 1 -- 172.21.15.100:0/690208372 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e0025070 con 0x564e96bc44e0 2024-09-18T01:25:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.166+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e96cba5a0 con 0x564e96bc44e0 2024-09-18T01:25:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.167+0000 7f66d9e03640 1 -- 172.21.15.100:0/690208372 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e0016430 con 0x564e96bc44e0 2024-09-18T01:25:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.167+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e96cbaac0 con 0x564e96bc44e0 2024-09-18T01:25:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.167+0000 7f66d9e03640 1 -- 172.21.15.100:0/690208372 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f67e00165d0 con 0x564e96bc44e0 2024-09-18T01:25:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.168+0000 7f66d9e03640 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66d4036b40 0x7f66d4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.168+0000 7f66d9e03640 1 -- 172.21.15.100:0/690208372 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f67e0011070 con 0x564e96bc44e0 2024-09-18T01:25:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.168+0000 7f67ecd00640 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66d4036b40 0x7f66d4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.168+0000 7f67efa0d800 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e96bc8920 0x564e96cc10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.168+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cc1650 con 0x564e96bc8920 2024-09-18T01:25:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.168+0000 7f67edd02640 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e96bc8920 0x564e96cc10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.168+0000 7f67ecd00640 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66d4036b40 0x7f66d4039000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f67e4057000 tx=0x7f67e4052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.168+0000 7f67edd02640 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e96bc8920 0x564e96cc10d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.168+0000 7f67edd02640 1 -- 172.21.15.100:0/690208372 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96bc8920 2024-09-18T01:25:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.168+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cbe6a0 con 0x564e96bc8920 2024-09-18T01:25:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.169+0000 7f67edd02640 1 -- 172.21.15.100:0/690208372 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96bc8920 2024-09-18T01:25:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.169+0000 7f67efa0d800 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e96cc3980 0x564e96cc5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.169+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cc6410 con 0x564e96cc3980 2024-09-18T01:25:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.169+0000 7f67ed501640 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e96cc3980 0x564e96cc5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.169+0000 7f67ed501640 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e96cc3980 0x564e96cc5d70 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.169+0000 7f67ed501640 1 -- 172.21.15.100:0/690208372 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f67e001e040 con 0x564e96cc3980 2024-09-18T01:25:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.169+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cc2820 con 0x564e96bc8920 2024-09-18T01:25:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.170+0000 7f67edd02640 1 -- 172.21.15.100:0/690208372 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96bc8920 2024-09-18T01:25:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.170+0000 7f67efa0d800 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564e96cc7870 0x564e96cc9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.170+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cca360 con 0x564e96cc7870 2024-09-18T01:25:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.170+0000 7f67ecd00640 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564e96cc7870 0x564e96cc9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.170+0000 7f67ecd00640 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564e96cc7870 0x564e96cc9c60 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.170+0000 7f67ecd00640 1 -- 172.21.15.100:0/690208372 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f67e4051070 con 0x564e96cc7870 2024-09-18T01:25:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.171+0000 7f67efa0d800 1 Processor -- start 2024-09-18T01:25:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.171+0000 7f67efa0d800 1 -- start start 2024-09-18T01:25:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.171+0000 7f67efa0d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96cd8110 0x564e96cd8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.171+0000 7f67efa0d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e96a60580 con 0x564e96cd8110 2024-09-18T01:25:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.171+0000 7f67ed501640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96cd8110 0x564e96cd8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.171+0000 7f67ed501640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96cd8110 0x564e96cd8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37506/0 (socket says 172.21.15.100:37506) 2024-09-18T01:25:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.171+0000 7f67ed501640 1 -- 172.21.15.100:0/1564001269 learned_addr learned my addr 172.21.15.100:0/1564001269 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.172+0000 7f67ed501640 1 -- 172.21.15.100:0/1564001269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e96cd8a70 con 0x564e96cd8110 2024-09-18T01:25:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.172+0000 7f67ed501640 1 --2- 172.21.15.100:0/1564001269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96cd8110 0x564e96cd8530 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f67e0014ff0 tx=0x7f67e00146b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.172+0000 7f66d2ffd640 1 -- 172.21.15.100:0/1564001269 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e0016aa0 con 0x564e96cd8110 2024-09-18T01:25:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.172+0000 7f66d2ffd640 1 -- 172.21.15.100:0/1564001269 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e0016c40 con 0x564e96cd8110 2024-09-18T01:25:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.172+0000 7f67efa0d800 1 -- 172.21.15.100:0/1564001269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e96cd8d00 con 0x564e96cd8110 2024-09-18T01:25:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.172+0000 7f66d2ffd640 1 -- 172.21.15.100:0/1564001269 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e0016df0 con 0x564e96cd8110 2024-09-18T01:25:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.172+0000 7f67efa0d800 1 -- 172.21.15.100:0/1564001269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e96cdb9e0 con 0x564e96cd8110 2024-09-18T01:25:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.173+0000 7f66d2ffd640 1 -- 172.21.15.100:0/1564001269 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f67e004c900 con 0x564e96cd8110 2024-09-18T01:25:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.173+0000 7f66d2ffd640 1 --2- 172.21.15.100:0/1564001269 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66c4036b90 0x7f66c4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.173+0000 7f66d2ffd640 1 -- 172.21.15.100:0/1564001269 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f67e0021030 con 0x564e96cd8110 2024-09-18T01:25:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.173+0000 7f67ecd00640 1 --2- 172.21.15.100:0/1564001269 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66c4036b90 0x7f66c4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.173+0000 7f67efa0d800 1 Processor -- start 2024-09-18T01:25:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.173+0000 7f67ecd00640 1 --2- 172.21.15.100:0/1564001269 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66c4036b90 0x7f66c4039050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x564e96cbe5c0 tx=0x7f67e4005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.173+0000 7f67efa0d800 1 -- start start 2024-09-18T01:25:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.173+0000 7f67efa0d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96ce4c50 0x564e96ce5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.173+0000 7f67efa0d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e96cb3f20 con 0x564e96ce4c50 2024-09-18T01:25:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.173+0000 7f67ed501640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96ce4c50 0x564e96ce5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.174+0000 7f67ed501640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96ce4c50 0x564e96ce5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37514/0 (socket says 172.21.15.100:37514) 2024-09-18T01:25:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.174+0000 7f67ed501640 1 -- 172.21.15.100:0/997564762 learned_addr learned my addr 172.21.15.100:0/997564762 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.174+0000 7f67ed501640 1 -- 172.21.15.100:0/997564762 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e96ce5620 con 0x564e96ce4c50 2024-09-18T01:25:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.174+0000 7f67ed501640 1 --2- 172.21.15.100:0/997564762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96ce4c50 0x564e96ce5050 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f67e00061b0 tx=0x7f67e0013430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3325d05f22c6f45 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.174+0000 7f66d0ff9640 1 -- 172.21.15.100:0/997564762 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e0046e10 con 0x564e96ce4c50 2024-09-18T01:25:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.174+0000 7f66d0ff9640 1 -- 172.21.15.100:0/997564762 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e005e070 con 0x564e96ce4c50 2024-09-18T01:25:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.174+0000 7f66d0ff9640 1 -- 172.21.15.100:0/997564762 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e0045fc0 con 0x564e96ce4c50 2024-09-18T01:25:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.174+0000 7f67efa0d800 1 -- 172.21.15.100:0/997564762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96ce4c50 msgr2=0x564e96ce5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.174+0000 7f67efa0d800 1 --2- 172.21.15.100:0/997564762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96ce4c50 0x564e96ce5050 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f67e00061b0 tx=0x7f67e0013430 comp rx=0 tx=0).stop 2024-09-18T01:25:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.175+0000 7f67efa0d800 1 -- 172.21.15.100:0/997564762 shutdown_connections 2024-09-18T01:25:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.175+0000 7f67efa0d800 1 --2- 172.21.15.100:0/997564762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96ce4c50 0x564e96ce5050 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.175+0000 7f67efa0d800 1 -- 172.21.15.100:0/997564762 >> 172.21.15.100:0/997564762 conn(0x564e96ce0ff0 msgr2=0x564e96cdf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.175+0000 7f67efa0d800 1 -- 172.21.15.100:0/997564762 shutdown_connections 2024-09-18T01:25:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.175+0000 7f67efa0d800 1 -- 172.21.15.100:0/997564762 wait complete. 2024-09-18T01:25:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.175+0000 7f67efa0d800 1 Processor -- start 2024-09-18T01:25:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.175+0000 7f67efa0d800 1 -- start start 2024-09-18T01:25:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.175+0000 7f67efa0d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96ce4c50 0x564e96cebee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.175+0000 7f67efa0d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e96ce5a00 con 0x564e96ce4c50 2024-09-18T01:25:29.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.175+0000 7f67ed501640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96ce4c50 0x564e96cebee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.175+0000 7f67ed501640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96ce4c50 0x564e96cebee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37528/0 (socket says 172.21.15.100:37528) 2024-09-18T01:25:29.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.175+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 learned_addr learned my addr 172.21.15.100:0/4011047865 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.175+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e96cec420 con 0x564e96ce4c50 2024-09-18T01:25:29.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.176+0000 7f67ed501640 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96ce4c50 0x564e96cebee0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f67e0013470 tx=0x7f67e004ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.176+0000 7f66c2ffd640 1 -- 172.21.15.100:0/4011047865 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e004eca0 con 0x564e96ce4c50 2024-09-18T01:25:29.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.176+0000 7f66c2ffd640 1 -- 172.21.15.100:0/4011047865 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e0036b10 con 0x564e96ce4c50 2024-09-18T01:25:29.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.176+0000 7f66c2ffd640 1 -- 172.21.15.100:0/4011047865 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e0036e30 con 0x564e96ce4c50 2024-09-18T01:25:29.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.176+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e96cec420 con 0x564e96ce4c50 2024-09-18T01:25:29.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.176+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e96cec420 con 0x564e96ce4c50 2024-09-18T01:25:29.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.176+0000 7f66c2ffd640 1 -- 172.21.15.100:0/4011047865 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f67e0060020 con 0x564e96ce4c50 2024-09-18T01:25:29.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.177+0000 7f66c2ffd640 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66b8036b40 0x7f66b8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.177+0000 7f66c2ffd640 1 -- 172.21.15.100:0/4011047865 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f67e006a070 con 0x564e96ce4c50 2024-09-18T01:25:29.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.177+0000 7f67ecd00640 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66b8036b40 0x7f66b8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.177+0000 7f67ecd00640 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66b8036b40 0x7f66b8039000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f67e4053570 tx=0x7f67e4053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.177+0000 7f67efa0d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.178+0000 7f67efa0d800 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e96cf7690 0x564e96cf9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.178+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfa2a0 con 0x564e96cf7690 2024-09-18T01:25:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.178+0000 7f67edd02640 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e96cf7690 0x564e96cf9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.178+0000 7f67edd02640 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e96cf7690 0x564e96cf9b50 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.178+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.178+0000 7f67efa0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.178+0000 7f67efa0d800 20 realm 2024-09-18T01:25:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.178+0000 7f67efa0d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.178+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfa6b0 con 0x564e96cf7690 2024-09-18T01:25:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.178+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.178+0000 7f67efa0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.178+0000 7f67efa0d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.178+0000 7f67efa0d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.178+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfaf80 con 0x564e96cf7690 2024-09-18T01:25:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.179+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.179+0000 7f67efa0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.179+0000 7f67efa0d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.179+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96cf7690 2024-09-18T01:25:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.179+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.179+0000 7f67efa0d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.179+0000 7f67efa0d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.179+0000 7f67efa0d800 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e96cfc080 0x564e96cfe470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.179+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfea80 con 0x564e96cfc080 2024-09-18T01:25:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.179+0000 7f67ed501640 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e96cfc080 0x564e96cfe470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.179+0000 7f67ed501640 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e96cfc080 0x564e96cfe470 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.180+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.180+0000 7f67efa0d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.180+0000 7f67efa0d800 20 searching for the correct realm 2024-09-18T01:25:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.180+0000 7f67efa0d800 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564e96d00a30 0x564e96d02ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.180+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96d035c0 con 0x564e96d00a30 2024-09-18T01:25:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.180+0000 7f67ecd00640 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564e96d00a30 0x564e96d02ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.180+0000 7f67ecd00640 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564e96d00a30 0x564e96d02ef0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.180+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e4051070 con 0x564e96d00a30 2024-09-18T01:25:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.180+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96d035c0 con 0x564e96cfc080 2024-09-18T01:25:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.180+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.181+0000 7f67ed501640 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f67e0028580 0x7f67e0062610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.181+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfea80 con 0x7f67e0028580 2024-09-18T01:25:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.181+0000 7f67edd02640 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f67e0028580 0x7f67e0062610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.181+0000 7f67edd02640 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f67e0028580 0x7f67e0062610 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.181+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.181+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96cf7690 2024-09-18T01:25:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.182+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.182+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96cf7690 2024-09-18T01:25:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.182+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.182+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x7f67e0028580 2024-09-18T01:25:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.182+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.182+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x7f67e0028580 2024-09-18T01:25:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.182+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.182+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96cfc080 2024-09-18T01:25:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.183+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.183+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96d00a30 2024-09-18T01:25:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.183+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e4051070 con 0x564e96d00a30 2024-09-18T01:25:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.183+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96cf7690 2024-09-18T01:25:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.183+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.183+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x7f67e0028580 2024-09-18T01:25:29.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.183+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.183+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96cf7690 2024-09-18T01:25:29.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.184+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.184+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96cfc080 2024-09-18T01:25:29.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.184+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.184+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96d00a30 2024-09-18T01:25:29.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.184+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e4051070 con 0x564e96d00a30 2024-09-18T01:25:29.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.184+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96d00a30 2024-09-18T01:25:29.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.184+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e4051070 con 0x564e96d00a30 2024-09-18T01:25:29.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.184+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x7f67e0028580 2024-09-18T01:25:29.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.185+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.185+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96d00a30 2024-09-18T01:25:29.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.185+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e4051070 con 0x564e96d00a30 2024-09-18T01:25:29.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.185+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96d00a30 2024-09-18T01:25:29.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.185+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e4051070 con 0x564e96d00a30 2024-09-18T01:25:29.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.185+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96cf7690 2024-09-18T01:25:29.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.185+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.185+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96cf7690 2024-09-18T01:25:29.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.185+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.186+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x7f67e0028580 2024-09-18T01:25:29.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.186+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.186+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96d00a30 2024-09-18T01:25:29.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.186+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e4051070 con 0x564e96d00a30 2024-09-18T01:25:29.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.186+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96cfc080 2024-09-18T01:25:29.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.186+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.186+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96cf7690 2024-09-18T01:25:29.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.187+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.187+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x7f67e0028580 2024-09-18T01:25:29.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.187+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.187+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96d00a30 2024-09-18T01:25:29.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.187+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e4051070 con 0x564e96d00a30 2024-09-18T01:25:29.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.187+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x7f67e0028580 2024-09-18T01:25:29.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.187+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.187+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96cfc080 2024-09-18T01:25:29.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.188+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.188+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96d00a30 2024-09-18T01:25:29.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.188+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e4051070 con 0x564e96d00a30 2024-09-18T01:25:29.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.188+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x7f67e0028580 2024-09-18T01:25:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.188+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.188+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96cf7690 2024-09-18T01:25:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfb320 con 0x564e96cfc080 2024-09-18T01:25:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67efa0d800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67efa0d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67efa0d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67efa0d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67efa0d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67efa0d800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67efa0d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cfea80 con 0x564e96cf7690 2024-09-18T01:25:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67efa0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67efa0d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cff340 con 0x564e96cf7690 2024-09-18T01:25:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67efa0d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67efa0d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.189+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cff760 con 0x7f67e0028580 2024-09-18T01:25:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 20 zone default found 2024-09-18T01:25:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 4 Realm: () 2024-09-18T01:25:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 20 zonegroup default 2024-09-18T01:25:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cffb90 con 0x7f67e0028580 2024-09-18T01:25:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96cffb90 con 0x564e96d00a30 2024-09-18T01:25:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f67e4051070 con 0x564e96d00a30 2024-09-18T01:25:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.190+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96d05420 con 0x564e96d00a30 2024-09-18T01:25:29.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.191+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f67e4051070 con 0x564e96d00a30 2024-09-18T01:25:29.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.191+0000 7f67efa0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.191+0000 7f67efa0d800 20 started sync module instance, tier type = 2024-09-18T01:25:29.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.191+0000 7f67efa0d800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:29.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.191+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d048c0 con 0x564e96cfc080 2024-09-18T01:25:29.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.192+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.192+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94895537671344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d048c0 con 0x564e96cfc080 2024-09-18T01:25:29.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.192+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d05cd0 con 0x564e96cf7690 2024-09-18T01:25:29.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.193+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94895537671344] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.193+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.193+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94895537674176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d048c0 con 0x564e96cf7690 2024-09-18T01:25:29.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.193+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d06760 con 0x564e96d00a30 2024-09-18T01:25:29.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.194+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e4051070 con 0x564e96d00a30 2024-09-18T01:25:29.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.194+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94895537676848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d07000 con 0x564e96d00a30 2024-09-18T01:25:29.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.194+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d07ac0 con 0x564e96cfc080 2024-09-18T01:25:29.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.194+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94895537674176] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.195+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94895537676848] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e4051070 con 0x564e96d00a30 2024-09-18T01:25:29.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.195+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.195+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94895537679184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d04410 con 0x564e96cfc080 2024-09-18T01:25:29.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.195+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d08390 con 0x564e96cf7690 2024-09-18T01:25:29.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.196+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94895537679184] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.196+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.196+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94895537681904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d08390 con 0x564e96cf7690 2024-09-18T01:25:29.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.196+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d08da0 con 0x7f67e0028580 2024-09-18T01:25:29.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.197+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94895537681904] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.197+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.197+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94895537684672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d08da0 con 0x7f67e0028580 2024-09-18T01:25:29.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.197+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d09760 con 0x7f67e0028580 2024-09-18T01:25:29.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.198+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94895537684672] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.198+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.198+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94895537686768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d09940 con 0x7f67e0028580 2024-09-18T01:25:29.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.198+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d0a190 con 0x7f67e0028580 2024-09-18T01:25:29.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.199+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.199+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94895537686768] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.199+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94895537691424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d0a5b0 con 0x7f67e0028580 2024-09-18T01:25:29.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.199+0000 7f67efa0d800 20 add_watcher() i=0 2024-09-18T01:25:29.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.199+0000 7f67efa0d800 20 add_watcher() i=1 2024-09-18T01:25:29.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.199+0000 7f67efa0d800 20 add_watcher() i=2 2024-09-18T01:25:29.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.199+0000 7f67efa0d800 20 add_watcher() i=3 2024-09-18T01:25:29.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.199+0000 7f67efa0d800 20 add_watcher() i=4 2024-09-18T01:25:29.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.199+0000 7f67efa0d800 20 add_watcher() i=5 2024-09-18T01:25:29.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.199+0000 7f67efa0d800 20 add_watcher() i=6 2024-09-18T01:25:29.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.200+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94895537691424] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.200+0000 7f67efa0d800 20 add_watcher() i=7 2024-09-18T01:25:29.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.200+0000 7f67efa0d800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:29.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.200+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96d0da00 con 0x564e96cf7690 2024-09-18T01:25:29.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.200+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.200+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94895537692736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d0ae80 con 0x564e96cf7690 2024-09-18T01:25:29.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.201+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94895537692736] v33'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.202+0000 7f66a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:29.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.202+0000 7f67efa0d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:29.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.202+0000 7f67efa0d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:29.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.202+0000 7f67efa0d800 5 note: GC not initialized 2024-09-18T01:25:29.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.202+0000 7f66a27e4640 20 reqs_thread_entry: start 2024-09-18T01:25:29.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.202+0000 7f67efa0d800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:29.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.202+0000 7f67efa0d800 20 Filter name: none 2024-09-18T01:25:29.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.202+0000 7f6613fff640 20 reqs_thread_entry: start 2024-09-18T01:25:29.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.202+0000 7f67efa0d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:29.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.202+0000 7f67efa0d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.202+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96d40a20 con 0x564e96cf7690 2024-09-18T01:25:29.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.203+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.203+0000 7f67efa0d800 20 rados_obj.operate() r=0 bl.length=673 2024-09-18T01:25:29.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.203+0000 7f67efa0d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:29.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.203+0000 7f67efa0d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:29.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.203+0000 7f67efa0d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:29.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.203+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d47690 con 0x564e96cf7690 2024-09-18T01:25:29.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.204+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v33'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.204+0000 7f67efa0d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:29.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.204+0000 7f67efa0d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:29.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.204+0000 7f67efa0d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:29.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.204+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94895537942608 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96d42d30 con 0x564e96cf7690 2024-09-18T01:25:29.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.204+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== watch-notify(notify (1) cookie 94895537681904 notify 141733920776 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f67e8018db0 con 0x564e96cf7690 2024-09-18T01:25:29.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.204+0000 7f66d0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 94895537681904 notifier 4412 bl.length()=758 2024-09-18T01:25:29.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.204+0000 7f66d0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:29.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.204+0000 7f66d0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:29.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.204+0000 7f66d0ff9640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f66b0003ea0 con 0x564e96cf7690 2024-09-18T01:25:29.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.204+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(64 notify.4 [notify cookie 94895537942608 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.204+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.205+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== watch-notify(notify_complete (2) cookie 94895537942608 notify 141733920776 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f67e80434f0 con 0x564e96cf7690 2024-09-18T01:25:29.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.205+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d47050 con 0x564e96cf7690 2024-09-18T01:25:29.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.206+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(66 foo:foo1 [delete] v33'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.206+0000 7f67efa0d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-18T01:25:29.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.206+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94895537942608 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564e96d42880 con 0x564e96cfc080 2024-09-18T01:25:29.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.206+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== watch-notify(notify (1) cookie 94895537671344 notify 141733920772 ret 0) ==== 201+0+0 (crc 0 0 0) 0x564e96cd8d00 con 0x564e96cfc080 2024-09-18T01:25:29.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.206+0000 7f66c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94895537671344 notifier 4412 bl.length()=159 2024-09-18T01:25:29.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.206+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(67 notify.0 [notify cookie 94895537942608 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.206+0000 7f66c3fff640 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f66200032c0 con 0x564e96cfc080 2024-09-18T01:25:29.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.206+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.206+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== watch-notify(notify_complete (2) cookie 94895537942608 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564e96cd8a70 con 0x564e96cfc080 2024-09-18T01:25:29.218 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-18T01:25:28.943847Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:29.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.207+0000 7f66a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.207+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94895537692736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d42880 con 0x564e96cf7690 2024-09-18T01:25:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.208+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94895537692736] v33'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.208+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94895537671344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d3e770 con 0x564e96cfc080 2024-09-18T01:25:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.209+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94895537671344] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.209+0000 7f67efa0d800 20 remove_watcher() i=0 2024-09-18T01:25:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.209+0000 7f67efa0d800 2 removed watcher, disabling cache 2024-09-18T01:25:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.209+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94895537674176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d42880 con 0x564e96cf7690 2024-09-18T01:25:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.210+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94895537674176] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.210+0000 7f67efa0d800 20 remove_watcher() i=1 2024-09-18T01:25:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.210+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94895537676848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d3e770 con 0x564e96d00a30 2024-09-18T01:25:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.211+0000 7f67ecd00640 1 -- 172.21.15.100:0/4011047865 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94895537676848] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e4051070 con 0x564e96d00a30 2024-09-18T01:25:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.211+0000 7f67efa0d800 20 remove_watcher() i=2 2024-09-18T01:25:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.211+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94895537679184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d42880 con 0x564e96cfc080 2024-09-18T01:25:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.212+0000 7f67ed501640 1 -- 172.21.15.100:0/4011047865 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94895537679184] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e0080040 con 0x564e96cfc080 2024-09-18T01:25:29.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.212+0000 7f67efa0d800 20 remove_watcher() i=3 2024-09-18T01:25:29.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.212+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94895537681904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d42880 con 0x564e96cf7690 2024-09-18T01:25:29.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.213+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94895537681904] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x564e96cf7690 2024-09-18T01:25:29.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.213+0000 7f67efa0d800 20 remove_watcher() i=4 2024-09-18T01:25:29.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.213+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94895537684672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d42880 con 0x7f67e0028580 2024-09-18T01:25:29.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.214+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94895537684672] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.214+0000 7f67efa0d800 20 remove_watcher() i=5 2024-09-18T01:25:29.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.214+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94895537686768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d42880 con 0x7f67e0028580 2024-09-18T01:25:29.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.215+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94895537686768] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.215+0000 7f67efa0d800 20 remove_watcher() i=6 2024-09-18T01:25:29.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.215+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94895537691424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564e96d42880 con 0x7f67e0028580 2024-09-18T01:25:29.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94895537691424] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67e800a4a0 con 0x7f67e0028580 2024-09-18T01:25:29.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 20 remove_watcher() i=7 2024-09-18T01:25:29.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f67e0028580 msgr2=0x7f67e0062610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f67e0028580 0x7f67e0062610 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e96cf7690 msgr2=0x564e96cf9b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e96cf7690 0x564e96cf9b50 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e96cfc080 msgr2=0x564e96cfe470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e96cfc080 0x564e96cfe470 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564e96d00a30 msgr2=0x564e96d02ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564e96d00a30 0x564e96d02ef0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66b8036b40 msgr2=0x7f66b8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66b8036b40 0x7f66b8039000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f67e4053570 tx=0x7f67e4053000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96ce4c50 msgr2=0x564e96cebee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96ce4c50 0x564e96cebee0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f67e0013470 tx=0x7f67e004ee90 comp rx=0 tx=0).stop 2024-09-18T01:25:29.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67edd02640 1 -- 172.21.15.100:0/4011047865 reap_dead start 2024-09-18T01:25:29.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 shutdown_connections 2024-09-18T01:25:29.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 --2- 172.21.15.100:0/4011047865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96ce4c50 0x564e96cebee0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 >> 172.21.15.100:0/4011047865 conn(0x564e96ce0ff0 msgr2=0x564e96cdf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 shutdown_connections 2024-09-18T01:25:29.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.216+0000 7f67efa0d800 1 -- 172.21.15.100:0/4011047865 wait complete. 2024-09-18T01:25:29.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/1564001269 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66c4036b90 msgr2=0x7f66c4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 --2- 172.21.15.100:0/1564001269 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66c4036b90 0x7f66c4039050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x564e96cbe5c0 tx=0x7f67e4005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:29.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/1564001269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96cd8110 msgr2=0x564e96cd8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 --2- 172.21.15.100:0/1564001269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96cd8110 0x564e96cd8530 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f67e0014ff0 tx=0x7f67e00146b0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/1564001269 shutdown_connections 2024-09-18T01:25:29.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 --2- 172.21.15.100:0/1564001269 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66c4036b90 0x7f66c4039050 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 --2- 172.21.15.100:0/1564001269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96cd8110 0x564e96cd8530 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/1564001269 >> 172.21.15.100:0/1564001269 conn(0x564e96ccd0a0 msgr2=0x564e96ccfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/1564001269 shutdown_connections 2024-09-18T01:25:29.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/1564001269 wait complete. 2024-09-18T01:25:29.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564e96cc7870 msgr2=0x564e96cc9c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564e96cc7870 0x564e96cc9c60 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e96bc8920 msgr2=0x564e96cc10d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564e96bc8920 0x564e96cc10d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e96cc3980 msgr2=0x564e96cc5d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564e96cc3980 0x564e96cc5d70 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66d4036b40 msgr2=0x7f66d4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f66d4036b40 0x7f66d4039000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f67e4057000 tx=0x7f67e4052000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc44e0 msgr2=0x564e96cba060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 --2- 172.21.15.100:0/690208372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e96bc44e0 0x564e96cba060 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f67e000cfd0 tx=0x7f67e0000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67edd02640 1 -- 172.21.15.100:0/690208372 reap_dead start 2024-09-18T01:25:29.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 shutdown_connections 2024-09-18T01:25:29.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 >> 172.21.15.100:0/690208372 conn(0x564e96bbfdd0 msgr2=0x564e96cada00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 shutdown_connections 2024-09-18T01:25:29.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.217+0000 7f67efa0d800 1 -- 172.21.15.100:0/690208372 wait complete. 2024-09-18T01:25:29.229 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-18T01:25:28.943847Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:29.229 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-18T01:25:29.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-18T01:25:29.229 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-18T01:25:29.273 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:29.274 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:29.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.273+0000 7f1e51934800 1 Processor -- start 2024-09-18T01:25:29.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.273+0000 7f1e51934800 1 -- start start 2024-09-18T01:25:29.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.273+0000 7f1e51934800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558510516900 0x558510518cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.273+0000 7f1e51934800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5585103d2b30 con 0x5585105124c0 2024-09-18T01:25:29.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.273+0000 7f1e51934800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5585103b4360 con 0x558510516900 2024-09-18T01:25:29.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.274+0000 7f1e47fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558510516900 0x558510518cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.274+0000 7f1e4d663640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5585105124c0 0x5585105128c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37220/0 (socket says 172.21.15.100:37220) 2024-09-18T01:25:29.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.274+0000 7f1e47fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558510516900 0x558510518cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37542/0 (socket says 172.21.15.100:37542) 2024-09-18T01:25:29.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.274+0000 7f1e4d663640 1 -- 172.21.15.100:0/1378800321 learned_addr learned my addr 172.21.15.100:0/1378800321 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:29.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.274+0000 7f1e47fff640 1 -- 172.21.15.100:0/1378800321 >> v1:172.21.15.92:6789/0 conn(0x5585105124c0 legacy=0x5585105128c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.274+0000 7f1e47fff640 1 -- 172.21.15.100:0/1378800321 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585103dae00 con 0x558510516900 2024-09-18T01:25:29.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.276+0000 7f1e47fff640 1 --2- 172.21.15.100:0/1378800321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558510516900 0x558510518cf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800a470 tx=0x7f1e38045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bbeb60dfc7c194 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.276+0000 7f1e4ce62640 1 -- 172.21.15.100:0/1378800321 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e38053570 con 0x558510516900 2024-09-18T01:25:29.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.276+0000 7f1e4ce62640 1 -- 172.21.15.100:0/1378800321 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e38058070 con 0x558510516900 2024-09-18T01:25:29.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.276+0000 7f1e4ce62640 1 -- 172.21.15.100:0/1378800321 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e38053880 con 0x558510516900 2024-09-18T01:25:29.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.276+0000 7f1e51934800 1 -- 172.21.15.100:0/1378800321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558510516900 msgr2=0x558510518cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.276+0000 7f1e51934800 1 --2- 172.21.15.100:0/1378800321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558510516900 0x558510518cf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800a470 tx=0x7f1e38045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:29.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.276+0000 7f1e51934800 1 -- 172.21.15.100:0/1378800321 shutdown_connections 2024-09-18T01:25:29.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.276+0000 7f1e51934800 1 --2- 172.21.15.100:0/1378800321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558510516900 0x558510518cf0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.276+0000 7f1e51934800 1 -- 172.21.15.100:0/1378800321 >> 172.21.15.100:0/1378800321 conn(0x55851050ddf0 msgr2=0x558510510210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.276+0000 7f1e51934800 1 -- 172.21.15.100:0/1378800321 shutdown_connections 2024-09-18T01:25:29.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.277+0000 7f1e51934800 1 -- 172.21.15.100:0/1378800321 wait complete. 2024-09-18T01:25:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.290+0000 7f1e51934800 1 Processor -- start 2024-09-18T01:25:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.290+0000 7f1e51934800 1 -- start start 2024-09-18T01:25:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.290+0000 7f1e51934800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105124c0 0x558510601750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.290+0000 7f1e51934800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55851045f330 con 0x5585105124c0 2024-09-18T01:25:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.291+0000 7f1e4d663640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105124c0 0x558510601750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.291+0000 7f1e4d663640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105124c0 0x558510601750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37546/0 (socket says 172.21.15.100:37546) 2024-09-18T01:25:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.291+0000 7f1e4d663640 1 -- 172.21.15.100:0/1127438090 learned_addr learned my addr 172.21.15.100:0/1127438090 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.291+0000 7f1e4d663640 1 -- 172.21.15.100:0/1127438090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585103acbc0 con 0x5585105124c0 2024-09-18T01:25:29.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.291+0000 7f1e4d663640 1 --2- 172.21.15.100:0/1127438090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105124c0 0x558510601750 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1e40001d80 tx=0x7f1e40001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92182e3b9aa83119 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.291+0000 7f1d3b606640 1 -- 172.21.15.100:0/1127438090 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e40013030 con 0x5585105124c0 2024-09-18T01:25:29.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.291+0000 7f1d3b606640 1 -- 172.21.15.100:0/1127438090 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4000e470 con 0x5585105124c0 2024-09-18T01:25:29.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.291+0000 7f1d3b606640 1 -- 172.21.15.100:0/1127438090 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e4000e810 con 0x5585105124c0 2024-09-18T01:25:29.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.292+0000 7f1e51934800 1 -- 172.21.15.100:0/1127438090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105124c0 msgr2=0x558510601750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.292+0000 7f1e51934800 1 --2- 172.21.15.100:0/1127438090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105124c0 0x558510601750 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1e40001d80 tx=0x7f1e40001e70 comp rx=0 tx=0).stop 2024-09-18T01:25:29.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.292+0000 7f1e51934800 1 -- 172.21.15.100:0/1127438090 shutdown_connections 2024-09-18T01:25:29.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.292+0000 7f1e51934800 1 --2- 172.21.15.100:0/1127438090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105124c0 0x558510601750 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.292+0000 7f1e51934800 1 -- 172.21.15.100:0/1127438090 >> 172.21.15.100:0/1127438090 conn(0x55851050ddf0 msgr2=0x5585105fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.292+0000 7f1e51934800 1 -- 172.21.15.100:0/1127438090 shutdown_connections 2024-09-18T01:25:29.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.292+0000 7f1e51934800 1 -- 172.21.15.100:0/1127438090 wait complete. 2024-09-18T01:25:29.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.292+0000 7f1e51934800 1 Processor -- start 2024-09-18T01:25:29.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.292+0000 7f1e51934800 1 -- start start 2024-09-18T01:25:29.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.293+0000 7f1e51934800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105124c0 0x55851060a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.293+0000 7f1e51934800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558510519530 con 0x5585105124c0 2024-09-18T01:25:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.293+0000 7f1e4d663640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105124c0 0x55851060a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.293+0000 7f1e4d663640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105124c0 0x55851060a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37548/0 (socket says 172.21.15.100:37548) 2024-09-18T01:25:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.293+0000 7f1e4d663640 1 -- 172.21.15.100:0/3214821977 learned_addr learned my addr 172.21.15.100:0/3214821977 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.293+0000 7f1e4d663640 1 -- 172.21.15.100:0/3214821977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585103c0fe0 con 0x5585105124c0 2024-09-18T01:25:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.293+0000 7f1e4d663640 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105124c0 0x55851060a270 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1e40004000 tx=0x7f1e40000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.293+0000 7f1d39e03640 1 -- 172.21.15.100:0/3214821977 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e40027070 con 0x5585105124c0 2024-09-18T01:25:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.293+0000 7f1d39e03640 1 -- 172.21.15.100:0/3214821977 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e40019900 con 0x5585105124c0 2024-09-18T01:25:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.293+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55851060a7b0 con 0x5585105124c0 2024-09-18T01:25:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.293+0000 7f1d39e03640 1 -- 172.21.15.100:0/3214821977 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e40019c60 con 0x5585105124c0 2024-09-18T01:25:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.293+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55851060acd0 con 0x5585105124c0 2024-09-18T01:25:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.294+0000 7f1d39e03640 1 -- 172.21.15.100:0/3214821977 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1e4002a070 con 0x5585105124c0 2024-09-18T01:25:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.294+0000 7f1d39e03640 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d34036b40 0x7f1d34039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.294+0000 7f1d39e03640 1 -- 172.21.15.100:0/3214821977 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f1e4001f070 con 0x5585105124c0 2024-09-18T01:25:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.294+0000 7f1e47fff640 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d34036b40 0x7f1d34039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.294+0000 7f1e51934800 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558510516900 0x5585106112e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.294+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5585106118b0 con 0x558510516900 2024-09-18T01:25:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.295+0000 7f1e4de64640 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558510516900 0x5585106112e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.295+0000 7f1e47fff640 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d34036b40 0x7f1d34039000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1e38057000 tx=0x7f1e38052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.295+0000 7f1e4de64640 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558510516900 0x5585106112e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.295+0000 7f1e4de64640 1 -- 172.21.15.100:0/3214821977 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x558510516900 2024-09-18T01:25:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.295+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851060e8b0 con 0x558510516900 2024-09-18T01:25:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.295+0000 7f1e4de64640 1 -- 172.21.15.100:0/3214821977 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e4800a4a0 con 0x558510516900 2024-09-18T01:25:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.295+0000 7f1e51934800 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558510613bc0 0x558510615fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.296+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558510616650 con 0x558510613bc0 2024-09-18T01:25:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.296+0000 7f1e4d663640 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558510613bc0 0x558510615fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.296+0000 7f1e4d663640 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558510613bc0 0x558510615fb0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.296+0000 7f1e4d663640 1 -- 172.21.15.100:0/3214821977 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1e40029030 con 0x558510613bc0 2024-09-18T01:25:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.296+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558510612a60 con 0x558510516900 2024-09-18T01:25:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.296+0000 7f1e4de64640 1 -- 172.21.15.100:0/3214821977 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e4800a4a0 con 0x558510516900 2024-09-18T01:25:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.296+0000 7f1e51934800 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558510617ab0 0x558510619ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.296+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851061a5a0 con 0x558510617ab0 2024-09-18T01:25:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.297+0000 7f1e47fff640 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558510617ab0 0x558510619ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.297+0000 7f1e47fff640 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558510617ab0 0x558510619ea0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.298+0000 7f1e47fff640 1 -- 172.21.15.100:0/3214821977 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1e38051070 con 0x558510617ab0 2024-09-18T01:25:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.298+0000 7f1e51934800 1 Processor -- start 2024-09-18T01:25:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.298+0000 7f1e51934800 1 -- start start 2024-09-18T01:25:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.298+0000 7f1e51934800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558510628350 0x558510628770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.298+0000 7f1e51934800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5585103ae580 con 0x558510628350 2024-09-18T01:25:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.298+0000 7f1e4d663640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558510628350 0x558510628770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.298+0000 7f1e4d663640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558510628350 0x558510628770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37560/0 (socket says 172.21.15.100:37560) 2024-09-18T01:25:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.299+0000 7f1e4d663640 1 -- 172.21.15.100:0/851861387 learned_addr learned my addr 172.21.15.100:0/851861387 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.299+0000 7f1e4d663640 1 -- 172.21.15.100:0/851861387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558510628cb0 con 0x558510628350 2024-09-18T01:25:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.299+0000 7f1e4d663640 1 --2- 172.21.15.100:0/851861387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558510628350 0x558510628770 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000c520 tx=0x7f1e400177a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.299+0000 7f1d32ffd640 1 -- 172.21.15.100:0/851861387 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e40040740 con 0x558510628350 2024-09-18T01:25:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.299+0000 7f1d32ffd640 1 -- 172.21.15.100:0/851861387 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e400408e0 con 0x558510628350 2024-09-18T01:25:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.299+0000 7f1e51934800 1 -- 172.21.15.100:0/851861387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558510628ee0 con 0x558510628350 2024-09-18T01:25:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.299+0000 7f1d32ffd640 1 -- 172.21.15.100:0/851861387 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e40040bc0 con 0x558510628350 2024-09-18T01:25:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.299+0000 7f1e51934800 1 -- 172.21.15.100:0/851861387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55851062bbc0 con 0x558510628350 2024-09-18T01:25:29.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.300+0000 7f1d32ffd640 1 -- 172.21.15.100:0/851861387 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1e4003b060 con 0x558510628350 2024-09-18T01:25:29.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.300+0000 7f1d32ffd640 1 --2- 172.21.15.100:0/851861387 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d24036b90 0x7f1d24039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.300+0000 7f1d32ffd640 1 -- 172.21.15.100:0/851861387 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f1e40014070 con 0x558510628350 2024-09-18T01:25:29.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.300+0000 7f1e47fff640 1 --2- 172.21.15.100:0/851861387 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d24036b90 0x7f1d24039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.300+0000 7f1e51934800 1 Processor -- start 2024-09-18T01:25:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.300+0000 7f1e51934800 1 -- start start 2024-09-18T01:25:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.300+0000 7f1e47fff640 1 --2- 172.21.15.100:0/851861387 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d24036b90 0x7f1d24039050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55851060e7d0 tx=0x7f1e38005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.300+0000 7f1e51934800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105ff580 0x5585105ff980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.300+0000 7f1e51934800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558510601f00 con 0x5585105ff580 2024-09-18T01:25:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.301+0000 7f1e4d663640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105ff580 0x5585105ff980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.301+0000 7f1e4d663640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105ff580 0x5585105ff980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37566/0 (socket says 172.21.15.100:37566) 2024-09-18T01:25:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.301+0000 7f1e4d663640 1 -- 172.21.15.100:0/32606599 learned_addr learned my addr 172.21.15.100:0/32606599 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.301+0000 7f1e4d663640 1 -- 172.21.15.100:0/32606599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585105fff50 con 0x5585105ff580 2024-09-18T01:25:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.301+0000 7f1e4d663640 1 --2- 172.21.15.100:0/32606599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105ff580 0x5585105ff980 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1e40025ff0 tx=0x7f1e400217f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a3e7fcb519aba server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.301+0000 7f1d30ff9640 1 -- 172.21.15.100:0/32606599 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e40036070 con 0x5585105ff580 2024-09-18T01:25:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.301+0000 7f1d30ff9640 1 -- 172.21.15.100:0/32606599 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e40040d60 con 0x5585105ff580 2024-09-18T01:25:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.301+0000 7f1d30ff9640 1 -- 172.21.15.100:0/32606599 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e40035d20 con 0x5585105ff580 2024-09-18T01:25:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.302+0000 7f1e51934800 1 -- 172.21.15.100:0/32606599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105ff580 msgr2=0x5585105ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.302+0000 7f1e51934800 1 --2- 172.21.15.100:0/32606599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105ff580 0x5585105ff980 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1e40025ff0 tx=0x7f1e400217f0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.302+0000 7f1e51934800 1 -- 172.21.15.100:0/32606599 shutdown_connections 2024-09-18T01:25:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.302+0000 7f1e51934800 1 --2- 172.21.15.100:0/32606599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105ff580 0x5585105ff980 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.302+0000 7f1e51934800 1 -- 172.21.15.100:0/32606599 >> 172.21.15.100:0/32606599 conn(0x558510631150 msgr2=0x55851062f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.302+0000 7f1e51934800 1 -- 172.21.15.100:0/32606599 shutdown_connections 2024-09-18T01:25:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.302+0000 7f1e51934800 1 -- 172.21.15.100:0/32606599 wait complete. 2024-09-18T01:25:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.302+0000 7f1e51934800 1 Processor -- start 2024-09-18T01:25:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.302+0000 7f1e51934800 1 -- start start 2024-09-18T01:25:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.302+0000 7f1e51934800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105ff580 0x55851063e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.302+0000 7f1e51934800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5585105fe130 con 0x5585105ff580 2024-09-18T01:25:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.302+0000 7f1e4d663640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105ff580 0x55851063e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.302+0000 7f1e4d663640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105ff580 0x55851063e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37574/0 (socket says 172.21.15.100:37574) 2024-09-18T01:25:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.302+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 learned_addr learned my addr 172.21.15.100:0/401635343 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.303+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851063e790 con 0x5585105ff580 2024-09-18T01:25:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.303+0000 7f1e4d663640 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105ff580 0x55851063e250 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1e40021af0 tx=0x7f1e4000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.303+0000 7f1d22ffd640 1 -- 172.21.15.100:0/401635343 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e40051040 con 0x5585105ff580 2024-09-18T01:25:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.303+0000 7f1d22ffd640 1 -- 172.21.15.100:0/401635343 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e40035e00 con 0x5585105ff580 2024-09-18T01:25:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.303+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55851063e790 con 0x5585105ff580 2024-09-18T01:25:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.303+0000 7f1d22ffd640 1 -- 172.21.15.100:0/401635343 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e4003d580 con 0x5585105ff580 2024-09-18T01:25:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.303+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55851063e790 con 0x5585105ff580 2024-09-18T01:25:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.304+0000 7f1d22ffd640 1 -- 172.21.15.100:0/401635343 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1e40033070 con 0x5585105ff580 2024-09-18T01:25:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.304+0000 7f1d22ffd640 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d18036b90 0x7f1d18039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.304+0000 7f1d22ffd640 1 -- 172.21.15.100:0/401635343 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f1e40067ca0 con 0x5585105ff580 2024-09-18T01:25:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.304+0000 7f1e47fff640 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d18036b90 0x7f1d18039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.304+0000 7f1e47fff640 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d18036b90 0x7f1d18039050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1e380539f0 tx=0x7f1e38053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.305+0000 7f1e51934800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.305+0000 7f1e51934800 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5585106499c0 0x55851064be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.305+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851064c5d0 con 0x5585106499c0 2024-09-18T01:25:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.305+0000 7f1e4de64640 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5585106499c0 0x55851064be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.305+0000 7f1e4de64640 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5585106499c0 0x55851064be80 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.305+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.305+0000 7f1e51934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.305+0000 7f1e51934800 20 realm 2024-09-18T01:25:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.305+0000 7f1e51934800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.305+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851064c9e0 con 0x5585106499c0 2024-09-18T01:25:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.305+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.305+0000 7f1e51934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.306+0000 7f1e51934800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.306+0000 7f1e51934800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.306+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851064d2b0 con 0x5585106499c0 2024-09-18T01:25:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.306+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.306+0000 7f1e51934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.306+0000 7f1e51934800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.306+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x5585106499c0 2024-09-18T01:25:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.306+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.306+0000 7f1e51934800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.306+0000 7f1e51934800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.306+0000 7f1e51934800 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55851064e3b0 0x5585106507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.306+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558510650db0 con 0x55851064e3b0 2024-09-18T01:25:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.306+0000 7f1e4d663640 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55851064e3b0 0x5585106507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.306+0000 7f1e4d663640 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55851064e3b0 0x5585106507a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.307+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1e40078040 con 0x55851064e3b0 2024-09-18T01:25:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.307+0000 7f1e51934800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.307+0000 7f1e51934800 20 searching for the correct realm 2024-09-18T01:25:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.307+0000 7f1e51934800 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558510652d60 0x558510655220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.307+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585106558f0 con 0x558510652d60 2024-09-18T01:25:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.307+0000 7f1e47fff640 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558510652d60 0x558510655220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.307+0000 7f1e47fff640 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558510652d60 0x558510655220 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.307+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e38051070 con 0x558510652d60 2024-09-18T01:25:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.307+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585106558f0 con 0x55851064e3b0 2024-09-18T01:25:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.307+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e40078040 con 0x55851064e3b0 2024-09-18T01:25:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.307+0000 7f1e4d663640 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f1e40059070 0x7f1e40034630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.308+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585106558f0 con 0x7f1e40059070 2024-09-18T01:25:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.308+0000 7f1e4de64640 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f1e40059070 0x7f1e40034630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.308+0000 7f1e4de64640 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f1e40059070 0x7f1e40034630 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.308+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.308+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x5585106499c0 2024-09-18T01:25:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.309+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.309+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x5585106499c0 2024-09-18T01:25:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.309+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.309+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x7f1e40059070 2024-09-18T01:25:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.309+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.309+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x7f1e40059070 2024-09-18T01:25:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.309+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.309+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x55851064e3b0 2024-09-18T01:25:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.309+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e40078040 con 0x55851064e3b0 2024-09-18T01:25:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.310+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x558510652d60 2024-09-18T01:25:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.310+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e38051070 con 0x558510652d60 2024-09-18T01:25:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.310+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x5585106499c0 2024-09-18T01:25:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.310+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.310+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x7f1e40059070 2024-09-18T01:25:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.310+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.310+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x5585106499c0 2024-09-18T01:25:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.310+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.310+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x55851064e3b0 2024-09-18T01:25:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.311+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1e40078040 con 0x55851064e3b0 2024-09-18T01:25:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.311+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x558510652d60 2024-09-18T01:25:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.311+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e38051070 con 0x558510652d60 2024-09-18T01:25:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.311+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x558510652d60 2024-09-18T01:25:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.311+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e38051070 con 0x558510652d60 2024-09-18T01:25:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.311+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x7f1e40059070 2024-09-18T01:25:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.311+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.311+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x558510652d60 2024-09-18T01:25:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.312+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e38051070 con 0x558510652d60 2024-09-18T01:25:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.312+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x558510652d60 2024-09-18T01:25:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.312+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e38051070 con 0x558510652d60 2024-09-18T01:25:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.312+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x5585106499c0 2024-09-18T01:25:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.312+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.312+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x5585106499c0 2024-09-18T01:25:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.312+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.312+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x7f1e40059070 2024-09-18T01:25:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.313+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.313+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x558510652d60 2024-09-18T01:25:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.313+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e38051070 con 0x558510652d60 2024-09-18T01:25:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.313+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x55851064e3b0 2024-09-18T01:25:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.313+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e40078040 con 0x55851064e3b0 2024-09-18T01:25:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.313+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x5585106499c0 2024-09-18T01:25:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.313+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.313+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x7f1e40059070 2024-09-18T01:25:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.314+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.314+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x558510652d60 2024-09-18T01:25:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.314+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e38051070 con 0x558510652d60 2024-09-18T01:25:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.314+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x7f1e40059070 2024-09-18T01:25:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.314+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.314+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x55851064e3b0 2024-09-18T01:25:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.314+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e40078040 con 0x55851064e3b0 2024-09-18T01:25:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.314+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x558510652d60 2024-09-18T01:25:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e38051070 con 0x558510652d60 2024-09-18T01:25:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x7f1e40059070 2024-09-18T01:25:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x5585106499c0 2024-09-18T01:25:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851064d650 con 0x55851064e3b0 2024-09-18T01:25:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1e40078040 con 0x55851064e3b0 2024-09-18T01:25:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e51934800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e51934800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e51934800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e51934800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e51934800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e51934800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e51934800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.315+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558510651670 con 0x5585106499c0 2024-09-18T01:25:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558510651a60 con 0x5585106499c0 2024-09-18T01:25:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558510651a60 con 0x7f1e40059070 2024-09-18T01:25:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 20 zone default found 2024-09-18T01:25:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 4 Realm: () 2024-09-18T01:25:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 20 zonegroup default 2024-09-18T01:25:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558510655d70 con 0x7f1e40059070 2024-09-18T01:25:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.316+0000 7f1e51934800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.317+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558510657750 con 0x558510652d60 2024-09-18T01:25:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.317+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e38051070 con 0x558510652d60 2024-09-18T01:25:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.317+0000 7f1e51934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.317+0000 7f1e51934800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.317+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558510657af0 con 0x558510652d60 2024-09-18T01:25:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.317+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e38051070 con 0x558510652d60 2024-09-18T01:25:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.317+0000 7f1e51934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.317+0000 7f1e51934800 20 started sync module instance, tier type = 2024-09-18T01:25:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.317+0000 7f1e51934800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.317+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558510656bf0 con 0x55851064e3b0 2024-09-18T01:25:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.318+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e40078040 con 0x55851064e3b0 2024-09-18T01:25:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.318+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94029994094608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558510658340 con 0x55851064e3b0 2024-09-18T01:25:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.318+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558510658b90 con 0x5585106499c0 2024-09-18T01:25:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.319+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94029994094608] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e40078040 con 0x55851064e3b0 2024-09-18T01:25:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.319+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.319+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94029994098320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558510658b90 con 0x5585106499c0 2024-09-18T01:25:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.319+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558510659550 con 0x558510652d60 2024-09-18T01:25:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.320+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94029994098320] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.320+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e38051070 con 0x558510652d60 2024-09-18T01:25:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.320+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94029994100448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558510658b00 con 0x558510652d60 2024-09-18T01:25:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.320+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851065a440 con 0x55851064e3b0 2024-09-18T01:25:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.321+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e40078040 con 0x55851064e3b0 2024-09-18T01:25:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.321+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94029994108896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851065b0b0 con 0x55851064e3b0 2024-09-18T01:25:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.321+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851065ba70 con 0x5585106499c0 2024-09-18T01:25:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.321+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94029994100448] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e38051070 con 0x558510652d60 2024-09-18T01:25:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.323+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.323+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94029994105200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851065ba70 con 0x5585106499c0 2024-09-18T01:25:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.323+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851065c4c0 con 0x7f1e40059070 2024-09-18T01:25:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.323+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94029994108896] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e40078040 con 0x55851064e3b0 2024-09-18T01:25:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.323+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.323+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94029994109952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851065c480 con 0x7f1e40059070 2024-09-18T01:25:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.324+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851065cef0 con 0x7f1e40059070 2024-09-18T01:25:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.324+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94029994105200] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.324+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.324+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94029994117664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851065cef0 con 0x7f1e40059070 2024-09-18T01:25:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.324+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851065d8b0 con 0x7f1e40059070 2024-09-18T01:25:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.325+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94029994109952] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.325+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94029994117664] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.325+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.325+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94029994112448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851065d400 con 0x7f1e40059070 2024-09-18T01:25:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.326+0000 7f1e51934800 20 add_watcher() i=0 2024-09-18T01:25:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.326+0000 7f1e51934800 20 add_watcher() i=1 2024-09-18T01:25:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.326+0000 7f1e51934800 20 add_watcher() i=2 2024-09-18T01:25:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.326+0000 7f1e51934800 20 add_watcher() i=3 2024-09-18T01:25:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.326+0000 7f1e51934800 20 add_watcher() i=4 2024-09-18T01:25:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.326+0000 7f1e51934800 20 add_watcher() i=5 2024-09-18T01:25:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.326+0000 7f1e51934800 20 add_watcher() i=6 2024-09-18T01:25:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.326+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94029994112448] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.326+0000 7f1e51934800 20 add_watcher() i=7 2024-09-18T01:25:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.326+0000 7f1e51934800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.326+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5585106608e0 con 0x5585106499c0 2024-09-18T01:25:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.327+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.327+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94029994120192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851065dd00 con 0x5585106499c0 2024-09-18T01:25:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.328+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94029994120192] v33'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.328+0000 7f1d037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.328+0000 7f1e51934800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.328+0000 7f1e51934800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.328+0000 7f1e51934800 5 note: GC not initialized 2024-09-18T01:25:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.328+0000 7f1d027e4640 20 reqs_thread_entry: start 2024-09-18T01:25:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.328+0000 7f1e51934800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.328+0000 7f1e51934800 20 Filter name: none 2024-09-18T01:25:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.328+0000 7f1c73fff640 20 reqs_thread_entry: start 2024-09-18T01:25:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.329+0000 7f1e51934800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.329+0000 7f1e51934800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.329+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558510693be0 con 0x5585106499c0 2024-09-18T01:25:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.329+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.329+0000 7f1e51934800 20 rados_obj.operate() r=0 bl.length=582 2024-09-18T01:25:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.329+0000 7f1e51934800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.329+0000 7f1e51934800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.329+0000 7f1e51934800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.329+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851069a260 con 0x5585106499c0 2024-09-18T01:25:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.330+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v33'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.330+0000 7f1e51934800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.330+0000 7f1e51934800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.330+0000 7f1e51934800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.330+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94029994368032 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558510695b10 con 0x5585106499c0 2024-09-18T01:25:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.330+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== watch-notify(notify (1) cookie 94029994105200 notify 141733920777 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f1e48043860 con 0x5585106499c0 2024-09-18T01:25:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.330+0000 7f1d30ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920777 cookie 94029994105200 notifier 4419 bl.length()=732 2024-09-18T01:25:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.330+0000 7f1d30ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.330+0000 7f1d30ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.330+0000 7f1d30ff9640 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1d10003ea0 con 0x5585106499c0 2024-09-18T01:25:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.330+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(64 notify.4 [notify cookie 94029994368032 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.331+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== watch-notify(notify_complete (2) cookie 94029994368032 notify 141733920777 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1e48018d40 con 0x5585106499c0 2024-09-18T01:25:29.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.331+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.344 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-18T01:25:28.943847Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:29.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.332+0000 7f1d037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:29.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.332+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94029994120192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5585106962d0 con 0x5585106499c0 2024-09-18T01:25:29.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.333+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94029994120192] v33'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.333+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94029994094608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5585106962d0 con 0x55851064e3b0 2024-09-18T01:25:29.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.334+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94029994094608] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e40078040 con 0x55851064e3b0 2024-09-18T01:25:29.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.334+0000 7f1e51934800 20 remove_watcher() i=0 2024-09-18T01:25:29.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.334+0000 7f1e51934800 2 removed watcher, disabling cache 2024-09-18T01:25:29.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.334+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94029994098320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5585106962d0 con 0x5585106499c0 2024-09-18T01:25:29.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.335+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94029994098320] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.335+0000 7f1e51934800 20 remove_watcher() i=1 2024-09-18T01:25:29.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.335+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94029994100448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5585106962d0 con 0x558510652d60 2024-09-18T01:25:29.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.336+0000 7f1e47fff640 1 -- 172.21.15.100:0/401635343 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94029994100448] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e38051070 con 0x558510652d60 2024-09-18T01:25:29.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.336+0000 7f1e51934800 20 remove_watcher() i=2 2024-09-18T01:25:29.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.336+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94029994108896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558510691930 con 0x55851064e3b0 2024-09-18T01:25:29.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.337+0000 7f1e4d663640 1 -- 172.21.15.100:0/401635343 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94029994108896] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e40078040 con 0x55851064e3b0 2024-09-18T01:25:29.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.337+0000 7f1e51934800 20 remove_watcher() i=3 2024-09-18T01:25:29.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.337+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94029994105200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558510691930 con 0x5585106499c0 2024-09-18T01:25:29.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.338+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94029994105200] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x5585106499c0 2024-09-18T01:25:29.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.338+0000 7f1e51934800 20 remove_watcher() i=4 2024-09-18T01:25:29.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.338+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94029994109952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558510691930 con 0x7f1e40059070 2024-09-18T01:25:29.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.339+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94029994109952] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.339+0000 7f1e51934800 20 remove_watcher() i=5 2024-09-18T01:25:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.339+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94029994117664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558510691930 con 0x7f1e40059070 2024-09-18T01:25:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.340+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94029994117664] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.340+0000 7f1e51934800 20 remove_watcher() i=6 2024-09-18T01:25:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.340+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94029994112448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558510691930 con 0x7f1e40059070 2024-09-18T01:25:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94029994112448] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4800a4a0 con 0x7f1e40059070 2024-09-18T01:25:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 20 remove_watcher() i=7 2024-09-18T01:25:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f1e40059070 msgr2=0x7f1e40034630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f1e40059070 0x7f1e40034630 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5585106499c0 msgr2=0x55851064be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5585106499c0 0x55851064be80 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55851064e3b0 msgr2=0x5585106507a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55851064e3b0 0x5585106507a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558510652d60 msgr2=0x558510655220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558510652d60 0x558510655220 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d18036b90 msgr2=0x7f1d18039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d18036b90 0x7f1d18039050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1e380539f0 tx=0x7f1e38053000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105ff580 msgr2=0x55851063e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e4de64640 1 -- 172.21.15.100:0/401635343 reap_dead start 2024-09-18T01:25:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105ff580 0x55851063e250 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1e40021af0 tx=0x7f1e4000a430 comp rx=0 tx=0).stop 2024-09-18T01:25:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 shutdown_connections 2024-09-18T01:25:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 --2- 172.21.15.100:0/401635343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105ff580 0x55851063e250 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 >> 172.21.15.100:0/401635343 conn(0x558510631150 msgr2=0x55851062f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 shutdown_connections 2024-09-18T01:25:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 -- 172.21.15.100:0/401635343 wait complete. 2024-09-18T01:25:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 -- 172.21.15.100:0/851861387 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d24036b90 msgr2=0x7f1d24039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 --2- 172.21.15.100:0/851861387 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d24036b90 0x7f1d24039050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55851060e7d0 tx=0x7f1e38005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 -- 172.21.15.100:0/851861387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558510628350 msgr2=0x558510628770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.341+0000 7f1e51934800 1 --2- 172.21.15.100:0/851861387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558510628350 0x558510628770 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000c520 tx=0x7f1e400177a0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 -- 172.21.15.100:0/851861387 shutdown_connections 2024-09-18T01:25:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 --2- 172.21.15.100:0/851861387 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d24036b90 0x7f1d24039050 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 --2- 172.21.15.100:0/851861387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558510628350 0x558510628770 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 -- 172.21.15.100:0/851861387 >> 172.21.15.100:0/851861387 conn(0x55851061d2e0 msgr2=0x55851061fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 -- 172.21.15.100:0/851861387 shutdown_connections 2024-09-18T01:25:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 -- 172.21.15.100:0/851861387 wait complete. 2024-09-18T01:25:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558510617ab0 msgr2=0x558510619ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558510617ab0 0x558510619ea0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558510516900 msgr2=0x5585106112e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558510516900 0x5585106112e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558510613bc0 msgr2=0x558510615fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558510613bc0 0x558510615fb0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d34036b40 msgr2=0x7f1d34039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1d34036b40 0x7f1d34039000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1e38057000 tx=0x7f1e38052000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105124c0 msgr2=0x55851060a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 --2- 172.21.15.100:0/3214821977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585105124c0 0x55851060a270 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1e40004000 tx=0x7f1e40000bc0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e4de64640 1 -- 172.21.15.100:0/3214821977 reap_dead start 2024-09-18T01:25:29.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 shutdown_connections 2024-09-18T01:25:29.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 >> 172.21.15.100:0/3214821977 conn(0x55851050ddf0 msgr2=0x558510600340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 shutdown_connections 2024-09-18T01:25:29.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.342+0000 7f1e51934800 1 -- 172.21.15.100:0/3214821977 wait complete. 2024-09-18T01:25:29.355 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-18T01:25:28.943847Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:29.355 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-18T01:25:29.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-18T01:25:29.356 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-18T01:25:29.402 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:29.403 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:29.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.402+0000 7f233dd29800 1 Processor -- start 2024-09-18T01:25:29.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.402+0000 7f233dd29800 1 -- start start 2024-09-18T01:25:29.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.402+0000 7f233dd29800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5570ddda3a50 0x5570ddda3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.402+0000 7f233dd29800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5570ddc64b30 con 0x5570ddda4390 2024-09-18T01:25:29.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.402+0000 7f233dd29800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5570ddc46360 con 0x5570ddda3a50 2024-09-18T01:25:29.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.403+0000 7f2339a79640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5570ddda3a50 0x5570ddda3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.403+0000 7f2331278640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5570ddda4390 0x5570dddaab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37226/0 (socket says 172.21.15.100:37226) 2024-09-18T01:25:29.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.403+0000 7f2331278640 1 -- 172.21.15.100:0/812506231 learned_addr learned my addr 172.21.15.100:0/812506231 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:29.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.403+0000 7f2339a79640 1 -- 172.21.15.100:0/812506231 >> v1:172.21.15.92:6789/0 conn(0x5570ddda4390 legacy=0x5570dddaab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.403+0000 7f2339a79640 1 -- 172.21.15.100:0/812506231 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ddc6ce00 con 0x5570ddda3a50 2024-09-18T01:25:29.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.405+0000 7f2339a79640 1 --2- 172.21.15.100:0/812506231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 0x5570ddda3e50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f232c00a470 tx=0x7f232c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366021a5e902670f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.405+0000 7f2339278640 1 -- 172.21.15.100:0/812506231 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c053570 con 0x5570ddda3a50 2024-09-18T01:25:29.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.405+0000 7f2339278640 1 -- 172.21.15.100:0/812506231 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c058070 con 0x5570ddda3a50 2024-09-18T01:25:29.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.405+0000 7f2339278640 1 -- 172.21.15.100:0/812506231 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c053880 con 0x5570ddda3a50 2024-09-18T01:25:29.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.406+0000 7f233dd29800 1 -- 172.21.15.100:0/812506231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 msgr2=0x5570ddda3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.406+0000 7f233dd29800 1 --2- 172.21.15.100:0/812506231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 0x5570ddda3e50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f232c00a470 tx=0x7f232c045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:29.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.406+0000 7f233dd29800 1 -- 172.21.15.100:0/812506231 shutdown_connections 2024-09-18T01:25:29.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.406+0000 7f233dd29800 1 --2- 172.21.15.100:0/812506231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 0x5570ddda3e50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.406+0000 7f233dd29800 1 -- 172.21.15.100:0/812506231 >> 172.21.15.100:0/812506231 conn(0x5570ddd9f5e0 msgr2=0x5570ddda1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.406+0000 7f233dd29800 1 -- 172.21.15.100:0/812506231 shutdown_connections 2024-09-18T01:25:29.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.406+0000 7f233dd29800 1 -- 172.21.15.100:0/812506231 wait complete. 2024-09-18T01:25:29.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.419+0000 7f233dd29800 1 Processor -- start 2024-09-18T01:25:29.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.419+0000 7f233dd29800 1 -- start start 2024-09-18T01:25:29.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.420+0000 7f233dd29800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 0x5570dde94880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.420+0000 7f233dd29800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5570ddcf1350 con 0x5570ddda3a50 2024-09-18T01:25:29.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.420+0000 7f2339a79640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 0x5570dde94880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.420+0000 7f2339a79640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 0x5570dde94880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37604/0 (socket says 172.21.15.100:37604) 2024-09-18T01:25:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.420+0000 7f2339a79640 1 -- 172.21.15.100:0/2418382843 learned_addr learned my addr 172.21.15.100:0/2418382843 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.420+0000 7f2339a79640 1 -- 172.21.15.100:0/2418382843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ddc3ebc0 con 0x5570ddda3a50 2024-09-18T01:25:29.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.421+0000 7f2339a79640 1 --2- 172.21.15.100:0/2418382843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 0x5570dde94880 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f232c025c20 tx=0x7f232c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ddd2587ec2223a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.421+0000 7f2227e07640 1 -- 172.21.15.100:0/2418382843 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c053ba0 con 0x5570ddda3a50 2024-09-18T01:25:29.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.421+0000 7f2227e07640 1 -- 172.21.15.100:0/2418382843 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c063030 con 0x5570ddda3a50 2024-09-18T01:25:29.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.421+0000 7f2227e07640 1 -- 172.21.15.100:0/2418382843 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c053440 con 0x5570ddda3a50 2024-09-18T01:25:29.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.421+0000 7f233dd29800 1 -- 172.21.15.100:0/2418382843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 msgr2=0x5570dde94880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.421+0000 7f233dd29800 1 --2- 172.21.15.100:0/2418382843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 0x5570dde94880 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f232c025c20 tx=0x7f232c051000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.421+0000 7f233dd29800 1 -- 172.21.15.100:0/2418382843 shutdown_connections 2024-09-18T01:25:29.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.421+0000 7f233dd29800 1 --2- 172.21.15.100:0/2418382843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 0x5570dde94880 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.421+0000 7f233dd29800 1 -- 172.21.15.100:0/2418382843 >> 172.21.15.100:0/2418382843 conn(0x5570ddd9f5e0 msgr2=0x5570dde90240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.421+0000 7f233dd29800 1 -- 172.21.15.100:0/2418382843 shutdown_connections 2024-09-18T01:25:29.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.421+0000 7f233dd29800 1 -- 172.21.15.100:0/2418382843 wait complete. 2024-09-18T01:25:29.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.422+0000 7f233dd29800 1 Processor -- start 2024-09-18T01:25:29.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.422+0000 7f233dd29800 1 -- start start 2024-09-18T01:25:29.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.422+0000 7f233dd29800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 0x5570dde9c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.422+0000 7f233dd29800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5570dddac670 con 0x5570ddda3a50 2024-09-18T01:25:29.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.422+0000 7f2339a79640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 0x5570dde9c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.422+0000 7f2339a79640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 0x5570dde9c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37608/0 (socket says 172.21.15.100:37608) 2024-09-18T01:25:29.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.422+0000 7f2339a79640 1 -- 172.21.15.100:0/2745749408 learned_addr learned my addr 172.21.15.100:0/2745749408 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.423+0000 7f2339a79640 1 -- 172.21.15.100:0/2745749408 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ddc52fe0 con 0x5570ddda3a50 2024-09-18T01:25:29.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.423+0000 7f2339a79640 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 0x5570dde9c200 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5570dde956e0 tx=0x7f232c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.423+0000 7f2226604640 1 -- 172.21.15.100:0/2745749408 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c078070 con 0x5570ddda3a50 2024-09-18T01:25:29.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.423+0000 7f2226604640 1 -- 172.21.15.100:0/2745749408 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c053570 con 0x5570ddda3a50 2024-09-18T01:25:29.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.423+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570dde9c740 con 0x5570ddda3a50 2024-09-18T01:25:29.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.423+0000 7f2226604640 1 -- 172.21.15.100:0/2745749408 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c053850 con 0x5570ddda3a50 2024-09-18T01:25:29.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.423+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570dde9ccc0 con 0x5570ddda3a50 2024-09-18T01:25:29.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.424+0000 7f2226604640 1 -- 172.21.15.100:0/2745749408 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f232c07b070 con 0x5570ddda3a50 2024-09-18T01:25:29.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.424+0000 7f2226604640 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2220036b40 0x7f2220039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.424+0000 7f2226604640 1 -- 172.21.15.100:0/2745749408 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f232c070070 con 0x5570ddda3a50 2024-09-18T01:25:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.424+0000 7f2331278640 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2220036b40 0x7f2220039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.424+0000 7f233dd29800 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5570ddda4390 0x5570ddea3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.424+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddea3840 con 0x5570ddda4390 2024-09-18T01:25:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.424+0000 7f233a27a640 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5570ddda4390 0x5570ddea3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.424+0000 7f2331278640 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2220036b40 0x7f2220039000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2324000f60 tx=0x7f23240012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.425+0000 7f233a27a640 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5570ddda4390 0x5570ddea3270 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.425+0000 7f233a27a640 1 -- 172.21.15.100:0/2745749408 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddda4390 2024-09-18T01:25:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.425+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddea0840 con 0x5570ddda4390 2024-09-18T01:25:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.425+0000 7f233a27a640 1 -- 172.21.15.100:0/2745749408 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddda4390 2024-09-18T01:25:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.425+0000 7f233dd29800 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5570ddea5b90 0x5570ddea7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.425+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddea8620 con 0x5570ddea5b90 2024-09-18T01:25:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.425+0000 7f2339a79640 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5570ddea5b90 0x5570ddea7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.425+0000 7f2339a79640 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5570ddea5b90 0x5570ddea7f80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.426+0000 7f2339a79640 1 -- 172.21.15.100:0/2745749408 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f232c07a030 con 0x5570ddea5b90 2024-09-18T01:25:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.426+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddea4970 con 0x5570ddda4390 2024-09-18T01:25:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.426+0000 7f233a27a640 1 -- 172.21.15.100:0/2745749408 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddda4390 2024-09-18T01:25:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.426+0000 7f233dd29800 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5570ddea9a80 0x5570ddeabe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.426+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeac4c0 con 0x5570ddea9a80 2024-09-18T01:25:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.426+0000 7f2331278640 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5570ddea9a80 0x5570ddeabe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.427+0000 7f2331278640 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5570ddea9a80 0x5570ddeabe70 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.427+0000 7f2331278640 1 -- 172.21.15.100:0/2745749408 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2324009050 con 0x5570ddea9a80 2024-09-18T01:25:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.427+0000 7f233dd29800 1 Processor -- start 2024-09-18T01:25:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.427+0000 7f233dd29800 1 -- start start 2024-09-18T01:25:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.427+0000 7f233dd29800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddeba270 0x5570ddeba690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.427+0000 7f233dd29800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5570ddc40580 con 0x5570ddeba270 2024-09-18T01:25:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.428+0000 7f2339a79640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddeba270 0x5570ddeba690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.428+0000 7f2339a79640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddeba270 0x5570ddeba690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37616/0 (socket says 172.21.15.100:37616) 2024-09-18T01:25:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.428+0000 7f2339a79640 1 -- 172.21.15.100:0/3885709515 learned_addr learned my addr 172.21.15.100:0/3885709515 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.428+0000 7f2339a79640 1 -- 172.21.15.100:0/3885709515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ddebabd0 con 0x5570ddeba270 2024-09-18T01:25:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.428+0000 7f2339a79640 1 --2- 172.21.15.100:0/3885709515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddeba270 0x5570ddeba690 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f232c05ffd0 tx=0x7f232c05cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.428+0000 7f221f7fe640 1 -- 172.21.15.100:0/3885709515 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c088040 con 0x5570ddeba270 2024-09-18T01:25:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.428+0000 7f221f7fe640 1 -- 172.21.15.100:0/3885709515 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c068de0 con 0x5570ddeba270 2024-09-18T01:25:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.428+0000 7f233dd29800 1 -- 172.21.15.100:0/3885709515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570ddebae60 con 0x5570ddeba270 2024-09-18T01:25:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.428+0000 7f221f7fe640 1 -- 172.21.15.100:0/3885709515 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c07cb00 con 0x5570ddeba270 2024-09-18T01:25:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.428+0000 7f233dd29800 1 -- 172.21.15.100:0/3885709515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570ddebdb40 con 0x5570ddeba270 2024-09-18T01:25:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.429+0000 7f221f7fe640 1 -- 172.21.15.100:0/3885709515 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f232c07cca0 con 0x5570ddeba270 2024-09-18T01:25:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.429+0000 7f221f7fe640 1 --2- 172.21.15.100:0/3885709515 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2214036b90 0x7f2214039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.429+0000 7f221f7fe640 1 -- 172.21.15.100:0/3885709515 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f232c099c50 con 0x5570ddeba270 2024-09-18T01:25:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.429+0000 7f2331278640 1 --2- 172.21.15.100:0/3885709515 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2214036b90 0x7f2214039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.429+0000 7f233dd29800 1 Processor -- start 2024-09-18T01:25:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.429+0000 7f233dd29800 1 -- start start 2024-09-18T01:25:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.429+0000 7f2331278640 1 --2- 172.21.15.100:0/3885709515 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2214036b90 0x7f2214039050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f232400bf50 tx=0x7f232400f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.430+0000 7f233dd29800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda5d10 0x5570ddda6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.430+0000 7f233dd29800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5570dde94fd0 con 0x5570ddda5d10 2024-09-18T01:25:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.430+0000 7f2339a79640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda5d10 0x5570ddda6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.430+0000 7f2339a79640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda5d10 0x5570ddda6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37630/0 (socket says 172.21.15.100:37630) 2024-09-18T01:25:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.430+0000 7f2339a79640 1 -- 172.21.15.100:0/1505861406 learned_addr learned my addr 172.21.15.100:0/1505861406 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.430+0000 7f2339a79640 1 -- 172.21.15.100:0/1505861406 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ddda66e0 con 0x5570ddda5d10 2024-09-18T01:25:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.430+0000 7f2339a79640 1 --2- 172.21.15.100:0/1505861406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda5d10 0x5570ddda6110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f232c05e830 tx=0x7f232c05c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b9407a478dca7f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.430+0000 7f221d7fa640 1 -- 172.21.15.100:0/1505861406 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c068550 con 0x5570ddda5d10 2024-09-18T01:25:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.430+0000 7f221d7fa640 1 -- 172.21.15.100:0/1505861406 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c090340 con 0x5570ddda5d10 2024-09-18T01:25:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.430+0000 7f221d7fa640 1 -- 172.21.15.100:0/1505861406 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c090a70 con 0x5570ddda5d10 2024-09-18T01:25:29.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.431+0000 7f233dd29800 1 -- 172.21.15.100:0/1505861406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda5d10 msgr2=0x5570ddda6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.431+0000 7f233dd29800 1 --2- 172.21.15.100:0/1505861406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda5d10 0x5570ddda6110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f232c05e830 tx=0x7f232c05c820 comp rx=0 tx=0).stop 2024-09-18T01:25:29.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.431+0000 7f233dd29800 1 -- 172.21.15.100:0/1505861406 shutdown_connections 2024-09-18T01:25:29.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.431+0000 7f233dd29800 1 --2- 172.21.15.100:0/1505861406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda5d10 0x5570ddda6110 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.431+0000 7f233dd29800 1 -- 172.21.15.100:0/1505861406 >> 172.21.15.100:0/1505861406 conn(0x5570ddec30d0 msgr2=0x5570ddec11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.431+0000 7f233dd29800 1 -- 172.21.15.100:0/1505861406 shutdown_connections 2024-09-18T01:25:29.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.431+0000 7f233dd29800 1 -- 172.21.15.100:0/1505861406 wait complete. 2024-09-18T01:25:29.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.431+0000 7f233dd29800 1 Processor -- start 2024-09-18T01:25:29.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.431+0000 7f233dd29800 1 -- start start 2024-09-18T01:25:29.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.431+0000 7f233dd29800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda5d10 0x5570dded01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.431+0000 7f233dd29800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5570ddda48c0 con 0x5570ddda5d10 2024-09-18T01:25:29.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.431+0000 7f2339a79640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda5d10 0x5570dded01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.432+0000 7f2339a79640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda5d10 0x5570dded01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37646/0 (socket says 172.21.15.100:37646) 2024-09-18T01:25:29.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.432+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 learned_addr learned my addr 172.21.15.100:0/3328679536 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.432+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570dded0710 con 0x5570ddda5d10 2024-09-18T01:25:29.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.432+0000 7f2339a79640 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda5d10 0x5570dded01d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f232c05e830 tx=0x7f232c05df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.432+0000 7f220b7fe640 1 -- 172.21.15.100:0/3328679536 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c0bf070 con 0x5570ddda5d10 2024-09-18T01:25:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.432+0000 7f220b7fe640 1 -- 172.21.15.100:0/3328679536 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c05e8a0 con 0x5570ddda5d10 2024-09-18T01:25:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.432+0000 7f220b7fe640 1 -- 172.21.15.100:0/3328679536 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f232c05eb80 con 0x5570ddda5d10 2024-09-18T01:25:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.432+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570dded0710 con 0x5570ddda5d10 2024-09-18T01:25:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.432+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570dded0710 con 0x5570ddda5d10 2024-09-18T01:25:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.433+0000 7f220b7fe640 1 -- 172.21.15.100:0/3328679536 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f232c0c2070 con 0x5570ddda5d10 2024-09-18T01:25:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.433+0000 7f220b7fe640 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2204036b90 0x7f2204039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.433+0000 7f220b7fe640 1 -- 172.21.15.100:0/3328679536 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f232c0aa070 con 0x5570ddda5d10 2024-09-18T01:25:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.433+0000 7f2331278640 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2204036b90 0x7f2204039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.433+0000 7f2331278640 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2204036b90 0x7f2204039050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2324001b60 tx=0x7f2324010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233dd29800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233dd29800 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5570ddedb920 0x5570ddeddde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddede530 con 0x5570ddedb920 2024-09-18T01:25:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233a27a640 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5570ddedb920 0x5570ddeddde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233a27a640 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5570ddedb920 0x5570ddeddde0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233dd29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233dd29800 20 realm 2024-09-18T01:25:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233dd29800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddede940 con 0x5570ddedb920 2024-09-18T01:25:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233dd29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233dd29800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233dd29800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.434+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf210 con 0x5570ddedb920 2024-09-18T01:25:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.435+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.435+0000 7f233dd29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.435+0000 7f233dd29800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.435+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddedb920 2024-09-18T01:25:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.435+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.435+0000 7f233dd29800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.435+0000 7f233dd29800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.435+0000 7f233dd29800 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5570ddee0310 0x5570ddee2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.435+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddee2d10 con 0x5570ddee0310 2024-09-18T01:25:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.435+0000 7f2339a79640 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5570ddee0310 0x5570ddee2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.435+0000 7f2339a79640 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5570ddee0310 0x5570ddee2700 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.435+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.435+0000 7f233dd29800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.436+0000 7f233dd29800 20 searching for the correct realm 2024-09-18T01:25:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.436+0000 7f233dd29800 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5570ddee4cc0 0x5570ddee7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.436+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddee7850 con 0x5570ddee4cc0 2024-09-18T01:25:29.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.436+0000 7f2331278640 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5570ddee4cc0 0x5570ddee7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.436+0000 7f2331278640 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5570ddee4cc0 0x5570ddee7180 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.436+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2324009050 con 0x5570ddee4cc0 2024-09-18T01:25:29.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.436+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddee7850 con 0x5570ddee0310 2024-09-18T01:25:29.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.436+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.436+0000 7f2339a79640 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f232c0c4060 0x7f232c088560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.436+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddee7850 con 0x7f232c0c4060 2024-09-18T01:25:29.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.437+0000 7f233a27a640 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f232c0c4060 0x7f232c088560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.437+0000 7f233a27a640 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f232c0c4060 0x7f232c088560 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.437+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.437+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddedb920 2024-09-18T01:25:29.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.438+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.438+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddedb920 2024-09-18T01:25:29.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.438+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.438+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x7f232c0c4060 2024-09-18T01:25:29.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.438+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.438+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x7f232c0c4060 2024-09-18T01:25:29.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.438+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.438+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddee0310 2024-09-18T01:25:29.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.438+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.438+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddee4cc0 2024-09-18T01:25:29.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.439+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2324009050 con 0x5570ddee4cc0 2024-09-18T01:25:29.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.439+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddedb920 2024-09-18T01:25:29.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.439+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.439+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x7f232c0c4060 2024-09-18T01:25:29.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.439+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.439+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddedb920 2024-09-18T01:25:29.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.439+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.439+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddee0310 2024-09-18T01:25:29.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.440+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.440+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddee4cc0 2024-09-18T01:25:29.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.440+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2324009050 con 0x5570ddee4cc0 2024-09-18T01:25:29.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.440+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddee4cc0 2024-09-18T01:25:29.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.440+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2324009050 con 0x5570ddee4cc0 2024-09-18T01:25:29.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.440+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x7f232c0c4060 2024-09-18T01:25:29.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.440+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.440+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddee4cc0 2024-09-18T01:25:29.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.440+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2324009050 con 0x5570ddee4cc0 2024-09-18T01:25:29.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.440+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddee4cc0 2024-09-18T01:25:29.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.441+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2324009050 con 0x5570ddee4cc0 2024-09-18T01:25:29.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.441+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddedb920 2024-09-18T01:25:29.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.441+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.441+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddedb920 2024-09-18T01:25:29.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.441+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.441+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x7f232c0c4060 2024-09-18T01:25:29.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.441+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.441+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddee4cc0 2024-09-18T01:25:29.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.441+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2324009050 con 0x5570ddee4cc0 2024-09-18T01:25:29.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.442+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddee0310 2024-09-18T01:25:29.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.442+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.442+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddedb920 2024-09-18T01:25:29.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.442+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.442+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x7f232c0c4060 2024-09-18T01:25:29.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.442+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.442+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddee4cc0 2024-09-18T01:25:29.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.443+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2324009050 con 0x5570ddee4cc0 2024-09-18T01:25:29.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.443+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x7f232c0c4060 2024-09-18T01:25:29.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.443+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.443+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddee0310 2024-09-18T01:25:29.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.443+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.443+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddee4cc0 2024-09-18T01:25:29.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.443+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2324009050 con 0x5570ddee4cc0 2024-09-18T01:25:29.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.443+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x7f232c0c4060 2024-09-18T01:25:29.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddedb920 2024-09-18T01:25:29.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5570ddedf5b0 con 0x5570ddee0310 2024-09-18T01:25:29.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233dd29800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:29.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233dd29800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:29.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233dd29800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:29.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233dd29800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:29.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233dd29800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:29.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233dd29800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:29.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233dd29800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddee35d0 con 0x5570ddedb920 2024-09-18T01:25:29.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233dd29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233dd29800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddee39c0 con 0x5570ddedb920 2024-09-18T01:25:29.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.444+0000 7f233dd29800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:29.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddee39c0 con 0x7f232c0c4060 2024-09-18T01:25:29.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:29.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 20 zone default found 2024-09-18T01:25:29.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 4 Realm: () 2024-09-18T01:25:29.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:29.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:29.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:29.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 20 zonegroup default 2024-09-18T01:25:29.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddee7cd0 con 0x7f232c0c4060 2024-09-18T01:25:29.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddee96b0 con 0x5570ddee4cc0 2024-09-18T01:25:29.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2324009050 con 0x5570ddee4cc0 2024-09-18T01:25:29.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.445+0000 7f233dd29800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.446+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddee9a50 con 0x5570ddee4cc0 2024-09-18T01:25:29.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.446+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2324009050 con 0x5570ddee4cc0 2024-09-18T01:25:29.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.446+0000 7f233dd29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.446+0000 7f233dd29800 20 started sync module instance, tier type = 2024-09-18T01:25:29.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.446+0000 7f233dd29800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:29.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.446+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddee8b50 con 0x5570ddee0310 2024-09-18T01:25:29.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.447+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.447+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93943248094880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddee9df0 con 0x5570ddee0310 2024-09-18T01:25:29.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.447+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeea6c0 con 0x5570ddedb920 2024-09-18T01:25:29.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.448+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93943248094880] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.448+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.448+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93943248101776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeeaab0 con 0x5570ddedb920 2024-09-18T01:25:29.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.448+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeeb520 con 0x5570ddee4cc0 2024-09-18T01:25:29.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.449+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93943248101776] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.449+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2324009050 con 0x5570ddee4cc0 2024-09-18T01:25:29.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.449+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93943248105456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeeb910 con 0x5570ddee4cc0 2024-09-18T01:25:29.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.449+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeec310 con 0x5570ddee0310 2024-09-18T01:25:29.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.450+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93943248105456] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2324009050 con 0x5570ddee4cc0 2024-09-18T01:25:29.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.450+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.450+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93943248097136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeecbe0 con 0x5570ddee0310 2024-09-18T01:25:29.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.450+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeed490 con 0x5570ddedb920 2024-09-18T01:25:29.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.451+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93943248097136] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.451+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.451+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93943248111408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeed000 con 0x5570ddedb920 2024-09-18T01:25:29.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.451+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeedf50 con 0x7f232c0c4060 2024-09-18T01:25:29.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.452+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.452+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93943248116256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeedf10 con 0x7f232c0c4060 2024-09-18T01:25:29.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.452+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93943248111408] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.452+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeeeec0 con 0x7f232c0c4060 2024-09-18T01:25:29.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.453+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93943248116256] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.453+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.453+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93943248120304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeeeec0 con 0x7f232c0c4060 2024-09-18T01:25:29.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.453+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeef320 con 0x7f232c0c4060 2024-09-18T01:25:29.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.454+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.454+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93943248118592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeef790 con 0x7f232c0c4060 2024-09-18T01:25:29.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.454+0000 7f233dd29800 20 add_watcher() i=0 2024-09-18T01:25:29.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.454+0000 7f233dd29800 20 add_watcher() i=1 2024-09-18T01:25:29.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.454+0000 7f233dd29800 20 add_watcher() i=2 2024-09-18T01:25:29.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.454+0000 7f233dd29800 20 add_watcher() i=3 2024-09-18T01:25:29.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.454+0000 7f233dd29800 20 add_watcher() i=4 2024-09-18T01:25:29.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.454+0000 7f233dd29800 20 add_watcher() i=5 2024-09-18T01:25:29.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.454+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93943248120304] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.454+0000 7f233dd29800 20 add_watcher() i=6 2024-09-18T01:25:29.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.455+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93943248118592] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.455+0000 7f233dd29800 20 add_watcher() i=7 2024-09-18T01:25:29.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.455+0000 7f233dd29800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:29.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.455+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeecb50 con 0x5570ddedb920 2024-09-18T01:25:29.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.455+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.455+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93943248122592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeecb50 con 0x5570ddedb920 2024-09-18T01:25:29.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.456+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93943248122592] v33'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.456+0000 7f21eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:29.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.456+0000 7f233dd29800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:29.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.456+0000 7f233dd29800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:29.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.456+0000 7f233dd29800 5 note: GC not initialized 2024-09-18T01:25:29.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.457+0000 7f21ea7fc640 20 reqs_thread_entry: start 2024-09-18T01:25:29.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.457+0000 7f233dd29800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:29.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.457+0000 7f233dd29800 20 Filter name: none 2024-09-18T01:25:29.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.457+0000 7f215bfff640 20 reqs_thread_entry: start 2024-09-18T01:25:29.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.457+0000 7f233dd29800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:29.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.457+0000 7f233dd29800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.457+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddf25cd0 con 0x5570ddedb920 2024-09-18T01:25:29.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.457+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.457+0000 7f233dd29800 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T01:25:29.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.457+0000 7f233dd29800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:29.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.457+0000 7f233dd29800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:29.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.457+0000 7f233dd29800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:29.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.458+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddf2c450 con 0x5570ddedb920 2024-09-18T01:25:29.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.459+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v33'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.459+0000 7f233dd29800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:29.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.459+0000 7f233dd29800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:29.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.459+0000 7f233dd29800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:29.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.459+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93943248371216 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddf27af0 con 0x5570ddedb920 2024-09-18T01:25:29.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.459+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== watch-notify(notify (1) cookie 93943248111408 notify 141733920778 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f23340437c0 con 0x5570ddedb920 2024-09-18T01:25:29.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.459+0000 7f221d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920778 cookie 93943248111408 notifier 4426 bl.length()=567 2024-09-18T01:25:29.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.459+0000 7f221d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:29.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.459+0000 7f221d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:29.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.459+0000 7f221d7fa640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f21fc003ea0 con 0x5570ddedb920 2024-09-18T01:25:29.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.459+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(64 notify.4 [notify cookie 93943248371216 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.459+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.459+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== watch-notify(notify_complete (2) cookie 93943248371216 notify 141733920778 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2334018dd0 con 0x5570ddedb920 2024-09-18T01:25:29.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.459+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddf2be10 con 0x5570ddee0310 2024-09-18T01:25:29.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.461+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(66 foo:foo2 [delete] v33'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.461+0000 7f233dd29800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-18T01:25:29.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.461+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93943248371216 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570ddf2af30 con 0x5570ddee0310 2024-09-18T01:25:29.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.461+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== watch-notify(notify (1) cookie 93943248094880 notify 141733920773 ret 0) ==== 201+0+0 (crc 0 0 0) 0x5570ddebae60 con 0x5570ddee0310 2024-09-18T01:25:29.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.461+0000 7f221cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 93943248094880 notifier 4426 bl.length()=159 2024-09-18T01:25:29.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.461+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(67 notify.0 [notify cookie 93943248371216 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.461+0000 7f221cff9640 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f21640032c0 con 0x5570ddee0310 2024-09-18T01:25:29.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.461+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== watch-notify(notify_complete (2) cookie 93943248371216 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5570ddebabd0 con 0x5570ddee0310 2024-09-18T01:25:29.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.461+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.475 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:29.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.462+0000 7f21eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:29.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.462+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93943248122592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddf23a20 con 0x5570ddedb920 2024-09-18T01:25:29.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.463+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93943248122592] v33'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.463+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93943248094880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddf23a20 con 0x5570ddee0310 2024-09-18T01:25:29.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.464+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93943248094880] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.464+0000 7f233dd29800 20 remove_watcher() i=0 2024-09-18T01:25:29.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.464+0000 7f233dd29800 2 removed watcher, disabling cache 2024-09-18T01:25:29.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.464+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93943248101776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddf23a20 con 0x5570ddedb920 2024-09-18T01:25:29.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.465+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93943248101776] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.465+0000 7f233dd29800 20 remove_watcher() i=1 2024-09-18T01:25:29.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.465+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93943248105456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddf23a20 con 0x5570ddee4cc0 2024-09-18T01:25:29.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.466+0000 7f2331278640 1 -- 172.21.15.100:0/3328679536 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93943248105456] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2324009050 con 0x5570ddee4cc0 2024-09-18T01:25:29.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.466+0000 7f233dd29800 20 remove_watcher() i=2 2024-09-18T01:25:29.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.466+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93943248097136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeea190 con 0x5570ddee0310 2024-09-18T01:25:29.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.467+0000 7f2339a79640 1 -- 172.21.15.100:0/3328679536 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93943248097136] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f232c0c1030 con 0x5570ddee0310 2024-09-18T01:25:29.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.467+0000 7f233dd29800 20 remove_watcher() i=3 2024-09-18T01:25:29.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.467+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93943248111408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeeaff0 con 0x5570ddedb920 2024-09-18T01:25:29.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.468+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93943248111408] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x5570ddedb920 2024-09-18T01:25:29.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.468+0000 7f233dd29800 20 remove_watcher() i=4 2024-09-18T01:25:29.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.468+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93943248116256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeea190 con 0x7f232c0c4060 2024-09-18T01:25:29.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.469+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93943248116256] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.469+0000 7f233dd29800 20 remove_watcher() i=5 2024-09-18T01:25:29.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.469+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93943248120304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeec730 con 0x7f232c0c4060 2024-09-18T01:25:29.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.470+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93943248120304] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.470+0000 7f233dd29800 20 remove_watcher() i=6 2024-09-18T01:25:29.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.470+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93943248118592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570ddeeaff0 con 0x7f232c0c4060 2024-09-18T01:25:29.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93943248118592] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f233400a4a0 con 0x7f232c0c4060 2024-09-18T01:25:29.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 20 remove_watcher() i=7 2024-09-18T01:25:29.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f232c0c4060 msgr2=0x7f232c088560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f232c0c4060 0x7f232c088560 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5570ddedb920 msgr2=0x5570ddeddde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5570ddedb920 0x5570ddeddde0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5570ddee0310 msgr2=0x5570ddee2700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5570ddee0310 0x5570ddee2700 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5570ddee4cc0 msgr2=0x5570ddee7180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5570ddee4cc0 0x5570ddee7180 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2204036b90 msgr2=0x7f2204039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2204036b90 0x7f2204039050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2324001b60 tx=0x7f2324010000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda5d10 msgr2=0x5570dded01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233a27a640 1 -- 172.21.15.100:0/3328679536 reap_dead start 2024-09-18T01:25:29.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda5d10 0x5570dded01d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f232c05e830 tx=0x7f232c05df00 comp rx=0 tx=0).stop 2024-09-18T01:25:29.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 shutdown_connections 2024-09-18T01:25:29.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 --2- 172.21.15.100:0/3328679536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda5d10 0x5570dded01d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.471+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 >> 172.21.15.100:0/3328679536 conn(0x5570ddec30d0 msgr2=0x5570ddec11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 shutdown_connections 2024-09-18T01:25:29.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/3328679536 wait complete. 2024-09-18T01:25:29.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/3885709515 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2214036b90 msgr2=0x7f2214039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 --2- 172.21.15.100:0/3885709515 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2214036b90 0x7f2214039050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f232400bf50 tx=0x7f232400f000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/3885709515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddeba270 msgr2=0x5570ddeba690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 --2- 172.21.15.100:0/3885709515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddeba270 0x5570ddeba690 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f232c05ffd0 tx=0x7f232c05cfd0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/3885709515 shutdown_connections 2024-09-18T01:25:29.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 --2- 172.21.15.100:0/3885709515 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2214036b90 0x7f2214039050 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 --2- 172.21.15.100:0/3885709515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddeba270 0x5570ddeba690 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/3885709515 >> 172.21.15.100:0/3885709515 conn(0x5570ddeaf200 msgr2=0x5570ddeb1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/3885709515 shutdown_connections 2024-09-18T01:25:29.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/3885709515 wait complete. 2024-09-18T01:25:29.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5570ddea9a80 msgr2=0x5570ddeabe70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5570ddea9a80 0x5570ddeabe70 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5570ddda4390 msgr2=0x5570ddea3270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5570ddda4390 0x5570ddea3270 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5570ddea5b90 msgr2=0x5570ddea7f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5570ddea5b90 0x5570ddea7f80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2220036b40 msgr2=0x7f2220039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2220036b40 0x7f2220039000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2324000f60 tx=0x7f23240012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 msgr2=0x5570dde9c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 --2- 172.21.15.100:0/2745749408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ddda3a50 0x5570dde9c200 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5570dde956e0 tx=0x7f232c002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233a27a640 1 -- 172.21.15.100:0/2745749408 reap_dead start 2024-09-18T01:25:29.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 shutdown_connections 2024-09-18T01:25:29.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.472+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 >> 172.21.15.100:0/2745749408 conn(0x5570ddd9f5e0 msgr2=0x5570dde8eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.473+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 shutdown_connections 2024-09-18T01:25:29.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.473+0000 7f233dd29800 1 -- 172.21.15.100:0/2745749408 wait complete. 2024-09-18T01:25:29.486 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:29.487 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-18T01:25:29.487 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-18T01:25:29.487 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-18T01:25:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.530+0000 7f69a992e800 1 Processor -- start 2024-09-18T01:25:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.530+0000 7f69a992e800 1 -- start start 2024-09-18T01:25:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.531+0000 7f69a992e800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56185dff24c0 0x56185dff28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.531+0000 7f69a992e800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56185deb2b30 con 0x56185dff2e00 2024-09-18T01:25:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.531+0000 7f69a992e800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x56185de94360 con 0x56185dff24c0 2024-09-18T01:25:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.531+0000 7f69a556e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56185dff24c0 0x56185dff28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.531+0000 7f699ffff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x56185dff2e00 0x56185dff7980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37230/0 (socket says 172.21.15.100:37230) 2024-09-18T01:25:29.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.531+0000 7f699ffff640 1 -- 172.21.15.100:0/3823506254 learned_addr learned my addr 172.21.15.100:0/3823506254 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:29.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.531+0000 7f69a556e640 1 -- 172.21.15.100:0/3823506254 >> v1:172.21.15.92:6789/0 conn(0x56185dff2e00 legacy=0x56185dff7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.531+0000 7f69a556e640 1 -- 172.21.15.100:0/3823506254 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56185debae00 con 0x56185dff24c0 2024-09-18T01:25:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.533+0000 7f69a556e640 1 --2- 172.21.15.100:0/3823506254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 0x56185dff28c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f699800a470 tx=0x7f6998045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2ed0923046611b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.533+0000 7f69a4d6d640 1 -- 172.21.15.100:0/3823506254 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6998053570 con 0x56185dff24c0 2024-09-18T01:25:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.533+0000 7f69a4d6d640 1 -- 172.21.15.100:0/3823506254 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6998058070 con 0x56185dff24c0 2024-09-18T01:25:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.533+0000 7f69a4d6d640 1 -- 172.21.15.100:0/3823506254 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6998053880 con 0x56185dff24c0 2024-09-18T01:25:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.534+0000 7f69a992e800 1 -- 172.21.15.100:0/3823506254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 msgr2=0x56185dff28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.534+0000 7f69a992e800 1 --2- 172.21.15.100:0/3823506254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 0x56185dff28c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f699800a470 tx=0x7f6998045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.534+0000 7f69a992e800 1 -- 172.21.15.100:0/3823506254 shutdown_connections 2024-09-18T01:25:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.534+0000 7f69a992e800 1 --2- 172.21.15.100:0/3823506254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 0x56185dff28c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.534+0000 7f69a992e800 1 -- 172.21.15.100:0/3823506254 >> 172.21.15.100:0/3823506254 conn(0x56185dfeddf0 msgr2=0x56185dff0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.534+0000 7f69a992e800 1 -- 172.21.15.100:0/3823506254 shutdown_connections 2024-09-18T01:25:29.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.534+0000 7f69a992e800 1 -- 172.21.15.100:0/3823506254 wait complete. 2024-09-18T01:25:29.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.547+0000 7f69a992e800 1 Processor -- start 2024-09-18T01:25:29.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.547+0000 7f69a992e800 1 -- start start 2024-09-18T01:25:29.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.547+0000 7f69a992e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 0x56185e0e0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.547+0000 7f69a992e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56185df3f330 con 0x56185dff24c0 2024-09-18T01:25:29.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.548+0000 7f69a556e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 0x56185e0e0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.548+0000 7f69a556e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 0x56185e0e0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37672/0 (socket says 172.21.15.100:37672) 2024-09-18T01:25:29.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.548+0000 7f69a556e640 1 -- 172.21.15.100:0/2815978525 learned_addr learned my addr 172.21.15.100:0/2815978525 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.548+0000 7f69a556e640 1 -- 172.21.15.100:0/2815978525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56185de8cbc0 con 0x56185dff24c0 2024-09-18T01:25:29.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.548+0000 7f69a556e640 1 --2- 172.21.15.100:0/2815978525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 0x56185e0e0670 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6998025c20 tx=0x7f6998051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3aab0ee280df3e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.548+0000 7f6893606640 1 -- 172.21.15.100:0/2815978525 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f699805c580 con 0x56185dff24c0 2024-09-18T01:25:29.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.548+0000 7f6893606640 1 -- 172.21.15.100:0/2815978525 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6998063030 con 0x56185dff24c0 2024-09-18T01:25:29.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.549+0000 7f6893606640 1 -- 172.21.15.100:0/2815978525 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f699805c850 con 0x56185dff24c0 2024-09-18T01:25:29.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.549+0000 7f69a992e800 1 -- 172.21.15.100:0/2815978525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 msgr2=0x56185e0e0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.549+0000 7f69a992e800 1 --2- 172.21.15.100:0/2815978525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 0x56185e0e0670 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6998025c20 tx=0x7f6998051000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.549+0000 7f69a992e800 1 -- 172.21.15.100:0/2815978525 shutdown_connections 2024-09-18T01:25:29.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.549+0000 7f69a992e800 1 --2- 172.21.15.100:0/2815978525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 0x56185e0e0670 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.549+0000 7f69a992e800 1 -- 172.21.15.100:0/2815978525 >> 172.21.15.100:0/2815978525 conn(0x56185dfeddf0 msgr2=0x56185e0dc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.549+0000 7f69a992e800 1 -- 172.21.15.100:0/2815978525 shutdown_connections 2024-09-18T01:25:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.549+0000 7f69a992e800 1 -- 172.21.15.100:0/2815978525 wait complete. 2024-09-18T01:25:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.550+0000 7f69a992e800 1 Processor -- start 2024-09-18T01:25:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.550+0000 7f69a992e800 1 -- start start 2024-09-18T01:25:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.550+0000 7f69a992e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 0x56185e0e7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.550+0000 7f69a992e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56185dff94e0 con 0x56185dff24c0 2024-09-18T01:25:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.550+0000 7f69a556e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 0x56185e0e7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.550+0000 7f69a556e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 0x56185e0e7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37678/0 (socket says 172.21.15.100:37678) 2024-09-18T01:25:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.550+0000 7f69a556e640 1 -- 172.21.15.100:0/4117808006 learned_addr learned my addr 172.21.15.100:0/4117808006 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.550+0000 7f69a556e640 1 -- 172.21.15.100:0/4117808006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56185dea0fe0 con 0x56185dff24c0 2024-09-18T01:25:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.550+0000 7f69a556e640 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 0x56185e0e7fb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f699800a330 tx=0x7f6998002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.551+0000 7f6891e03640 1 -- 172.21.15.100:0/4117808006 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f699806c030 con 0x56185dff24c0 2024-09-18T01:25:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.551+0000 7f6891e03640 1 -- 172.21.15.100:0/4117808006 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699805c580 con 0x56185dff24c0 2024-09-18T01:25:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.551+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56185e0e84f0 con 0x56185dff24c0 2024-09-18T01:25:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.551+0000 7f6891e03640 1 -- 172.21.15.100:0/4117808006 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f699805c860 con 0x56185dff24c0 2024-09-18T01:25:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.551+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56185e0e8a70 con 0x56185dff24c0 2024-09-18T01:25:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.551+0000 7f6891e03640 1 -- 172.21.15.100:0/4117808006 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6998053440 con 0x56185dff24c0 2024-09-18T01:25:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.552+0000 7f6891e03640 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f688c036b40 0x7f688c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.552+0000 7f6891e03640 1 -- 172.21.15.100:0/4117808006 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6998070020 con 0x56185dff24c0 2024-09-18T01:25:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.552+0000 7f699ffff640 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f688c036b40 0x7f688c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.552+0000 7f69a992e800 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56185dff2e00 0x56185e0ef020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.552+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e0ef560 con 0x56185dff2e00 2024-09-18T01:25:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.552+0000 7f69a5d6f640 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56185dff2e00 0x56185e0ef020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.552+0000 7f699ffff640 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f688c036b40 0x7f688c039000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6990000f60 tx=0x7f69900012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.552+0000 7f69a5d6f640 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56185dff2e00 0x56185e0ef020 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.552+0000 7f69a5d6f640 1 -- 172.21.15.100:0/4117808006 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185dff2e00 2024-09-18T01:25:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.553+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e0ec5f0 con 0x56185dff2e00 2024-09-18T01:25:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.553+0000 7f69a5d6f640 1 -- 172.21.15.100:0/4117808006 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185dff2e00 2024-09-18T01:25:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.553+0000 7f69a992e800 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56185e0f18b0 0x56185e0f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.553+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e0f4340 con 0x56185e0f18b0 2024-09-18T01:25:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.553+0000 7f69a556e640 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56185e0f18b0 0x56185e0f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.553+0000 7f69a556e640 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56185e0f18b0 0x56185e0f3ca0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.553+0000 7f69a556e640 1 -- 172.21.15.100:0/4117808006 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f699807b070 con 0x56185e0f18b0 2024-09-18T01:25:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.553+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e0f0750 con 0x56185dff2e00 2024-09-18T01:25:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.554+0000 7f69a5d6f640 1 -- 172.21.15.100:0/4117808006 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185dff2e00 2024-09-18T01:25:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.554+0000 7f69a992e800 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56185e0f57a0 0x56185e0f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.554+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e0f8290 con 0x56185e0f57a0 2024-09-18T01:25:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.554+0000 7f699ffff640 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56185e0f57a0 0x56185e0f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.554+0000 7f699ffff640 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56185e0f57a0 0x56185e0f7b90 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.555+0000 7f699ffff640 1 -- 172.21.15.100:0/4117808006 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6990009050 con 0x56185e0f57a0 2024-09-18T01:25:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.555+0000 7f69a992e800 1 Processor -- start 2024-09-18T01:25:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.555+0000 7f69a992e800 1 -- start start 2024-09-18T01:25:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.555+0000 7f69a992e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e105fc0 0x56185e1063e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.555+0000 7f69a992e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56185de8e580 con 0x56185e105fc0 2024-09-18T01:25:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.555+0000 7f69a556e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e105fc0 0x56185e1063e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.555+0000 7f69a556e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e105fc0 0x56185e1063e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37682/0 (socket says 172.21.15.100:37682) 2024-09-18T01:25:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.555+0000 7f69a556e640 1 -- 172.21.15.100:0/1239710925 learned_addr learned my addr 172.21.15.100:0/1239710925 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.555+0000 7f69a556e640 1 -- 172.21.15.100:0/1239710925 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56185e106920 con 0x56185e105fc0 2024-09-18T01:25:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.556+0000 7f69a556e640 1 --2- 172.21.15.100:0/1239710925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e105fc0 0x56185e1063e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f699808eef0 tx=0x7f6998009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.556+0000 7f688affd640 1 -- 172.21.15.100:0/1239710925 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6998095070 con 0x56185e105fc0 2024-09-18T01:25:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.556+0000 7f688affd640 1 -- 172.21.15.100:0/1239710925 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6998009ae0 con 0x56185e105fc0 2024-09-18T01:25:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.556+0000 7f69a992e800 1 -- 172.21.15.100:0/1239710925 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56185e106bb0 con 0x56185e105fc0 2024-09-18T01:25:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.556+0000 7f688affd640 1 -- 172.21.15.100:0/1239710925 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f699805ec30 con 0x56185e105fc0 2024-09-18T01:25:29.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.556+0000 7f69a992e800 1 -- 172.21.15.100:0/1239710925 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56185e106bb0 con 0x56185e105fc0 2024-09-18T01:25:29.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.556+0000 7f688affd640 1 -- 172.21.15.100:0/1239710925 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6998098070 con 0x56185e105fc0 2024-09-18T01:25:29.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.557+0000 7f688affd640 1 --2- 172.21.15.100:0/1239710925 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f687c036b90 0x7f687c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.557+0000 7f688affd640 1 -- 172.21.15.100:0/1239710925 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f699806d070 con 0x56185e105fc0 2024-09-18T01:25:29.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.557+0000 7f699ffff640 1 --2- 172.21.15.100:0/1239710925 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f687c036b90 0x7f687c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.557+0000 7f69a992e800 1 Processor -- start 2024-09-18T01:25:29.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.557+0000 7f69a992e800 1 -- start start 2024-09-18T01:25:29.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.557+0000 7f699ffff640 1 --2- 172.21.15.100:0/1239710925 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f687c036b90 0x7f687c039050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f699000bf50 tx=0x7f699000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.557+0000 7f69a992e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e116c50 0x56185e117050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.557+0000 7f69a992e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56185e0e0dc0 con 0x56185e116c50 2024-09-18T01:25:29.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.557+0000 7f69a556e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e116c50 0x56185e117050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.557+0000 7f69a556e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e116c50 0x56185e117050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37690/0 (socket says 172.21.15.100:37690) 2024-09-18T01:25:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.557+0000 7f69a556e640 1 -- 172.21.15.100:0/290556832 learned_addr learned my addr 172.21.15.100:0/290556832 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.558+0000 7f69a556e640 1 -- 172.21.15.100:0/290556832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56185e117620 con 0x56185e116c50 2024-09-18T01:25:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.558+0000 7f69a556e640 1 --2- 172.21.15.100:0/290556832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e116c50 0x56185e117050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6998090a80 tx=0x7f6998082490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7469c751c7be201 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.558+0000 7f6888ff9640 1 -- 172.21.15.100:0/290556832 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69980a5040 con 0x56185e116c50 2024-09-18T01:25:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.558+0000 7f6888ff9640 1 -- 172.21.15.100:0/290556832 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6998060bd0 con 0x56185e116c50 2024-09-18T01:25:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.558+0000 7f6888ff9640 1 -- 172.21.15.100:0/290556832 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f699809be70 con 0x56185e116c50 2024-09-18T01:25:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.558+0000 7f69a992e800 1 -- 172.21.15.100:0/290556832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e116c50 msgr2=0x56185e117050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.558+0000 7f69a992e800 1 --2- 172.21.15.100:0/290556832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e116c50 0x56185e117050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6998090a80 tx=0x7f6998082490 comp rx=0 tx=0).stop 2024-09-18T01:25:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.558+0000 7f69a992e800 1 -- 172.21.15.100:0/290556832 shutdown_connections 2024-09-18T01:25:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.558+0000 7f69a992e800 1 --2- 172.21.15.100:0/290556832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e116c50 0x56185e117050 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.558+0000 7f69a992e800 1 -- 172.21.15.100:0/290556832 >> 172.21.15.100:0/290556832 conn(0x56185e10eba0 msgr2=0x56185e10cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.558+0000 7f69a992e800 1 -- 172.21.15.100:0/290556832 shutdown_connections 2024-09-18T01:25:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.558+0000 7f69a992e800 1 -- 172.21.15.100:0/290556832 wait complete. 2024-09-18T01:25:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.559+0000 7f69a992e800 1 Processor -- start 2024-09-18T01:25:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.559+0000 7f69a992e800 1 -- start start 2024-09-18T01:25:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.559+0000 7f69a992e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e116c50 0x56185e11ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.559+0000 7f69a992e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56185e117ba0 con 0x56185e116c50 2024-09-18T01:25:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.559+0000 7f69a556e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e116c50 0x56185e11ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.559+0000 7f69a556e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e116c50 0x56185e11ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37700/0 (socket says 172.21.15.100:37700) 2024-09-18T01:25:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.559+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 learned_addr learned my addr 172.21.15.100:0/2845949071 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.559+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56185e11e410 con 0x56185e116c50 2024-09-18T01:25:29.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.559+0000 7f69a556e640 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e116c50 0x56185e11ded0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6998060fb0 tx=0x7f6998082590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.560+0000 7f687affd640 1 -- 172.21.15.100:0/2845949071 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f699805ee90 con 0x56185e116c50 2024-09-18T01:25:29.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.560+0000 7f687affd640 1 -- 172.21.15.100:0/2845949071 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69980b9030 con 0x56185e116c50 2024-09-18T01:25:29.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.560+0000 7f687affd640 1 -- 172.21.15.100:0/2845949071 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f699805f900 con 0x56185e116c50 2024-09-18T01:25:29.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.560+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56185e11e410 con 0x56185e116c50 2024-09-18T01:25:29.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.560+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56185e11e410 con 0x56185e116c50 2024-09-18T01:25:29.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.560+0000 7f687affd640 1 -- 172.21.15.100:0/2845949071 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f699805fb20 con 0x56185e116c50 2024-09-18T01:25:29.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.561+0000 7f687affd640 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6870036ce0 0x7f68700391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.561+0000 7f687affd640 1 -- 172.21.15.100:0/2845949071 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f69980bfc80 con 0x56185e116c50 2024-09-18T01:25:29.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.561+0000 7f699ffff640 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6870036ce0 0x7f68700391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.561+0000 7f69a992e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.561+0000 7f699ffff640 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6870036ce0 0x7f68700391a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6990001b60 tx=0x7f6990010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.561+0000 7f69a992e800 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56185e129590 0x56185e12ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.561+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e12c1a0 con 0x56185e129590 2024-09-18T01:25:29.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.561+0000 7f69a5d6f640 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56185e129590 0x56185e12ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.561+0000 7f69a5d6f640 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56185e129590 0x56185e12ba50 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 20 realm 2024-09-18T01:25:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e12c5b0 con 0x56185e129590 2024-09-18T01:25:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:29.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e12ce80 con 0x56185e129590 2024-09-18T01:25:29.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e129590 2024-09-18T01:25:29.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:29.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56185e12dd10 0x56185e130100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.562+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e130860 con 0x56185e12dd10 2024-09-18T01:25:29.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.563+0000 7f69a556e640 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56185e12dd10 0x56185e130100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.563+0000 7f69a556e640 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56185e12dd10 0x56185e130100 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.563+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f69980c5070 con 0x56185e12dd10 2024-09-18T01:25:29.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.563+0000 7f69a992e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:29.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.563+0000 7f69a992e800 20 searching for the correct realm 2024-09-18T01:25:29.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.563+0000 7f69a992e800 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56185e132910 0x56185e134dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.563+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e1354a0 con 0x56185e132910 2024-09-18T01:25:29.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.563+0000 7f699ffff640 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56185e132910 0x56185e134dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.563+0000 7f699ffff640 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56185e132910 0x56185e134dd0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.564+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6990009050 con 0x56185e132910 2024-09-18T01:25:29.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.564+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e1354a0 con 0x56185e12dd10 2024-09-18T01:25:29.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.564+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69980c5070 con 0x56185e12dd10 2024-09-18T01:25:29.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.564+0000 7f69a556e640 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f69980b4050 0x7f6998051300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.564+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e1354a0 con 0x7f69980b4050 2024-09-18T01:25:29.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.564+0000 7f69a5d6f640 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f69980b4050 0x7f6998051300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.564+0000 7f69a5d6f640 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f69980b4050 0x7f6998051300 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.565+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.565+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e129590 2024-09-18T01:25:29.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.565+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.565+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e129590 2024-09-18T01:25:29.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.565+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.565+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x7f69980b4050 2024-09-18T01:25:29.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.565+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.565+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x7f69980b4050 2024-09-18T01:25:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.566+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.566+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e12dd10 2024-09-18T01:25:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.566+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69980c5070 con 0x56185e12dd10 2024-09-18T01:25:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.566+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e132910 2024-09-18T01:25:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.566+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6990009050 con 0x56185e132910 2024-09-18T01:25:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.566+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e129590 2024-09-18T01:25:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.566+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.566+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x7f69980b4050 2024-09-18T01:25:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.567+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.567+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e129590 2024-09-18T01:25:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.567+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.567+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e12dd10 2024-09-18T01:25:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.567+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f69980c5070 con 0x56185e12dd10 2024-09-18T01:25:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.567+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e132910 2024-09-18T01:25:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.567+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6990009050 con 0x56185e132910 2024-09-18T01:25:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.567+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e132910 2024-09-18T01:25:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.567+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6990009050 con 0x56185e132910 2024-09-18T01:25:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.567+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x7f69980b4050 2024-09-18T01:25:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.568+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.568+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e132910 2024-09-18T01:25:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.568+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6990009050 con 0x56185e132910 2024-09-18T01:25:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.568+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e132910 2024-09-18T01:25:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.568+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6990009050 con 0x56185e132910 2024-09-18T01:25:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.568+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e129590 2024-09-18T01:25:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.568+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.568+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e129590 2024-09-18T01:25:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.569+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.569+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x7f69980b4050 2024-09-18T01:25:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.569+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.569+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e132910 2024-09-18T01:25:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.569+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6990009050 con 0x56185e132910 2024-09-18T01:25:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.569+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e12dd10 2024-09-18T01:25:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.569+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69980c5070 con 0x56185e12dd10 2024-09-18T01:25:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.569+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e129590 2024-09-18T01:25:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.570+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.570+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x7f69980b4050 2024-09-18T01:25:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.570+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.570+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e132910 2024-09-18T01:25:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.570+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6990009050 con 0x56185e132910 2024-09-18T01:25:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.570+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x7f69980b4050 2024-09-18T01:25:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.571+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.571+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e12dd10 2024-09-18T01:25:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.571+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69980c5070 con 0x56185e12dd10 2024-09-18T01:25:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.571+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e132910 2024-09-18T01:25:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.571+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6990009050 con 0x56185e132910 2024-09-18T01:25:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.571+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x7f69980b4050 2024-09-18T01:25:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.571+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.571+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e129590 2024-09-18T01:25:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.571+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.571+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56185e12d220 con 0x56185e12dd10 2024-09-18T01:25:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f69980c5070 con 0x56185e12dd10 2024-09-18T01:25:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a992e800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a992e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a992e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a992e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a992e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a992e800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a992e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e131210 con 0x56185e129590 2024-09-18T01:25:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a992e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e131600 con 0x56185e129590 2024-09-18T01:25:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a992e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a992e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.572+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e131600 con 0x7f69980b4050 2024-09-18T01:25:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 20 zone default found 2024-09-18T01:25:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 4 Realm: () 2024-09-18T01:25:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 20 zonegroup default 2024-09-18T01:25:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e131a20 con 0x7f69980b4050 2024-09-18T01:25:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e131a20 con 0x56185e132910 2024-09-18T01:25:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6990009050 con 0x56185e132910 2024-09-18T01:25:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e137300 con 0x56185e132910 2024-09-18T01:25:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6990009050 con 0x56185e132910 2024-09-18T01:25:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 20 started sync module instance, tier type = 2024-09-18T01:25:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.573+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e1367a0 con 0x56185e12dd10 2024-09-18T01:25:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.574+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69980c5070 con 0x56185e12dd10 2024-09-18T01:25:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.574+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94662657534864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e136400 con 0x56185e12dd10 2024-09-18T01:25:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.574+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e138170 con 0x56185e129590 2024-09-18T01:25:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.575+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94662657534864] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69980c5070 con 0x56185e12dd10 2024-09-18T01:25:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.576+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.576+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94662657539264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e1380e0 con 0x56185e129590 2024-09-18T01:25:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.576+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e139030 con 0x56185e132910 2024-09-18T01:25:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.577+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6990009050 con 0x56185e132910 2024-09-18T01:25:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.577+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94662657543040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e1398d0 con 0x56185e132910 2024-09-18T01:25:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.577+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e13a3a0 con 0x56185e12dd10 2024-09-18T01:25:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.577+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94662657539264] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.578+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94662657543040] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6990009050 con 0x56185e132910 2024-09-18T01:25:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.578+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69980c5070 con 0x56185e12dd10 2024-09-18T01:25:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.578+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94662657547920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e13a790 con 0x56185e12dd10 2024-09-18T01:25:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.578+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e13afe0 con 0x56185e129590 2024-09-18T01:25:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.579+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94662657547920] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69980c5070 con 0x56185e12dd10 2024-09-18T01:25:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.579+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.579+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94662657550224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e13b3d0 con 0x56185e129590 2024-09-18T01:25:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.579+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e13bc20 con 0x7f69980b4050 2024-09-18T01:25:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.580+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.580+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94662657550224] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.580+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94662657553632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e13be50 con 0x7f69980b4050 2024-09-18T01:25:29.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.580+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e13abf0 con 0x7f69980b4050 2024-09-18T01:25:29.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.581+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.581+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94662657551344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e13c8f0 con 0x7f69980b4050 2024-09-18T01:25:29.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.581+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e13d350 con 0x7f69980b4050 2024-09-18T01:25:29.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.581+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94662657553632] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.582+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94662657551344] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.582+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.582+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94662657554688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e13c440 con 0x7f69980b4050 2024-09-18T01:25:29.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.582+0000 7f69a992e800 20 add_watcher() i=0 2024-09-18T01:25:29.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.582+0000 7f69a992e800 20 add_watcher() i=1 2024-09-18T01:25:29.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.582+0000 7f69a992e800 20 add_watcher() i=2 2024-09-18T01:25:29.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.582+0000 7f69a992e800 20 add_watcher() i=3 2024-09-18T01:25:29.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.582+0000 7f69a992e800 20 add_watcher() i=4 2024-09-18T01:25:29.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.582+0000 7f69a992e800 20 add_watcher() i=5 2024-09-18T01:25:29.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.582+0000 7f69a992e800 20 add_watcher() i=6 2024-09-18T01:25:29.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.583+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94662657554688] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.583+0000 7f69a992e800 20 add_watcher() i=7 2024-09-18T01:25:29.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.583+0000 7f69a992e800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:29.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.583+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e140450 con 0x56185e129590 2024-09-18T01:25:29.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.583+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.583+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94662657560112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e13d8d0 con 0x56185e129590 2024-09-18T01:25:29.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.584+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94662657560112] v33'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.584+0000 7f685b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:29.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.584+0000 7f69a992e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:29.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.584+0000 7f69a992e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:29.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.584+0000 7f69a992e800 5 note: GC not initialized 2024-09-18T01:25:29.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.585+0000 7f685a7e4640 20 reqs_thread_entry: start 2024-09-18T01:25:29.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.585+0000 7f69a992e800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:29.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.585+0000 7f69a992e800 20 Filter name: none 2024-09-18T01:25:29.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.585+0000 7f67cbfff640 20 reqs_thread_entry: start 2024-09-18T01:25:29.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.585+0000 7f69a992e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.585+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e173140 con 0x56185e129590 2024-09-18T01:25:29.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.585+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.585+0000 7f69a992e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:29.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.585+0000 7f69a992e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.585+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e173b30 con 0x56185e129590 2024-09-18T01:25:29.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.586+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.586+0000 7f69a992e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:29.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.586+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56185e174b40 con 0x56185e12dd10 2024-09-18T01:25:29.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.586+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f69980c5070 con 0x56185e12dd10 2024-09-18T01:25:29.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.587+0000 7f685b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:29.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.587+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94662657560112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e170f10 con 0x56185e129590 2024-09-18T01:25:29.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.588+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94662657560112] v33'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.588+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94662657534864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e170f10 con 0x56185e12dd10 2024-09-18T01:25:29.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.589+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94662657534864] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69980c5070 con 0x56185e12dd10 2024-09-18T01:25:29.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.589+0000 7f69a992e800 20 remove_watcher() i=0 2024-09-18T01:25:29.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.589+0000 7f69a992e800 2 removed watcher, disabling cache 2024-09-18T01:25:29.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.589+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94662657539264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e170f10 con 0x56185e129590 2024-09-18T01:25:29.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.590+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94662657539264] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.590+0000 7f69a992e800 20 remove_watcher() i=1 2024-09-18T01:25:29.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.590+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94662657543040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e170f10 con 0x56185e132910 2024-09-18T01:25:29.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.591+0000 7f699ffff640 1 -- 172.21.15.100:0/2845949071 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94662657543040] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6990009050 con 0x56185e132910 2024-09-18T01:25:29.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.591+0000 7f69a992e800 20 remove_watcher() i=2 2024-09-18T01:25:29.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.591+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94662657547920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e137cc0 con 0x56185e12dd10 2024-09-18T01:25:29.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.592+0000 7f69a556e640 1 -- 172.21.15.100:0/2845949071 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94662657547920] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69980c5070 con 0x56185e12dd10 2024-09-18T01:25:29.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.592+0000 7f69a992e800 20 remove_watcher() i=3 2024-09-18T01:25:29.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.592+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94662657550224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e138b80 con 0x56185e129590 2024-09-18T01:25:29.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.593+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94662657550224] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x56185e129590 2024-09-18T01:25:29.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.593+0000 7f69a992e800 20 remove_watcher() i=4 2024-09-18T01:25:29.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.593+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94662657553632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e139e90 con 0x7f69980b4050 2024-09-18T01:25:29.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.594+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94662657553632] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.594+0000 7f69a992e800 20 remove_watcher() i=5 2024-09-18T01:25:29.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.594+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94662657551344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e137cc0 con 0x7f69980b4050 2024-09-18T01:25:29.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.595+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94662657551344] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.595+0000 7f69a992e800 20 remove_watcher() i=6 2024-09-18T01:25:29.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.595+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94662657554688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56185e13a790 con 0x7f69980b4050 2024-09-18T01:25:29.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.596+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94662657554688] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a000a4a0 con 0x7f69980b4050 2024-09-18T01:25:29.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.596+0000 7f69a992e800 20 remove_watcher() i=7 2024-09-18T01:25:29.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.596+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f69980b4050 msgr2=0x7f6998051300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.596+0000 7f69a992e800 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f69980b4050 0x7f6998051300 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.596+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56185e129590 msgr2=0x56185e12ba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.596+0000 7f69a992e800 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56185e129590 0x56185e12ba50 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.596+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56185e12dd10 msgr2=0x56185e130100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.596+0000 7f69a992e800 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56185e12dd10 0x56185e130100 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.596+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56185e132910 msgr2=0x56185e134dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.596+0000 7f69a992e800 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56185e132910 0x56185e134dd0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6870036ce0 msgr2=0x7f68700391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6870036ce0 0x7f68700391a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6990001b60 tx=0x7f6990010000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e116c50 msgr2=0x56185e11ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 --2- 172.21.15.100:0/2845949071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e116c50 0x56185e11ded0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6998060fb0 tx=0x7f6998082590 comp rx=0 tx=0).stop 2024-09-18T01:25:29.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 reap_dead start 2024-09-18T01:25:29.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a5d6f640 1 -- 172.21.15.100:0/2845949071 reap_dead start 2024-09-18T01:25:29.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 shutdown_connections 2024-09-18T01:25:29.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 >> 172.21.15.100:0/2845949071 conn(0x56185e10eba0 msgr2=0x56185e10cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 shutdown_connections 2024-09-18T01:25:29.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/2845949071 wait complete. 2024-09-18T01:25:29.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/1239710925 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f687c036b90 msgr2=0x7f687c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 --2- 172.21.15.100:0/1239710925 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f687c036b90 0x7f687c039050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f699000bf50 tx=0x7f699000f000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/1239710925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e105fc0 msgr2=0x56185e1063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 --2- 172.21.15.100:0/1239710925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e105fc0 0x56185e1063e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f699808eef0 tx=0x7f6998009700 comp rx=0 tx=0).stop 2024-09-18T01:25:29.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/1239710925 shutdown_connections 2024-09-18T01:25:29.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 --2- 172.21.15.100:0/1239710925 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f687c036b90 0x7f687c039050 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 --2- 172.21.15.100:0/1239710925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185e105fc0 0x56185e1063e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/1239710925 >> 172.21.15.100:0/1239710925 conn(0x56185e0faf50 msgr2=0x56185e0fdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/1239710925 shutdown_connections 2024-09-18T01:25:29.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/1239710925 wait complete. 2024-09-18T01:25:29.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56185e0f57a0 msgr2=0x56185e0f7b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56185e0f57a0 0x56185e0f7b90 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56185dff2e00 msgr2=0x56185e0ef020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56185dff2e00 0x56185e0ef020 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56185e0f18b0 msgr2=0x56185e0f3ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.597+0000 7f69a992e800 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56185e0f18b0 0x56185e0f3ca0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.598+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f688c036b40 msgr2=0x7f688c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.598+0000 7f69a992e800 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f688c036b40 0x7f688c039000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6990000f60 tx=0x7f69900012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.598+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 msgr2=0x56185e0e7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.598+0000 7f69a992e800 1 --2- 172.21.15.100:0/4117808006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56185dff24c0 0x56185e0e7fb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f699800a330 tx=0x7f6998002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.598+0000 7f69a5d6f640 1 -- 172.21.15.100:0/4117808006 reap_dead start 2024-09-18T01:25:29.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.598+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 shutdown_connections 2024-09-18T01:25:29.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.598+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 >> 172.21.15.100:0/4117808006 conn(0x56185dfeddf0 msgr2=0x56185e0da8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.598+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 shutdown_connections 2024-09-18T01:25:29.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.598+0000 7f69a992e800 1 -- 172.21.15.100:0/4117808006 wait complete. 2024-09-18T01:25:29.611 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-18T01:25:29.611 DEBUG:tasks.util.rgw: json result: [] 2024-09-18T01:25:29.611 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-18T01:25:29.612 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-18T01:25:29.612 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-18T01:25:29.696 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:29.696 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:29.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.696+0000 7f883660e800 1 Processor -- start 2024-09-18T01:25:29.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.696+0000 7f883660e800 1 -- start start 2024-09-18T01:25:29.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.696+0000 7f883660e800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e129573df0 0x55e1296031e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.696+0000 7f883660e800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e1294bfb30 con 0x55e129603720 2024-09-18T01:25:29.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.696+0000 7f883660e800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55e1294a1360 con 0x55e129573df0 2024-09-18T01:25:29.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.696+0000 7f8831d0c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e129573df0 0x55e1296031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.696+0000 7f882bfff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55e129603720 0x55e129605b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37244/0 (socket says 172.21.15.100:37244) 2024-09-18T01:25:29.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.696+0000 7f882bfff640 1 -- 172.21.15.100:0/70733577 learned_addr learned my addr 172.21.15.100:0/70733577 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:29.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.697+0000 7f8831d0c640 1 -- 172.21.15.100:0/70733577 >> v1:172.21.15.92:6789/0 conn(0x55e129603720 legacy=0x55e129605b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.697+0000 7f8831d0c640 1 -- 172.21.15.100:0/70733577 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1294c7e00 con 0x55e129573df0 2024-09-18T01:25:29.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.698+0000 7f8831d0c640 1 --2- 172.21.15.100:0/70733577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 0x55e1296031e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f882400a470 tx=0x7f8824045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db361b050d7acfca server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.699+0000 7f883150b640 1 -- 172.21.15.100:0/70733577 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8824053570 con 0x55e129573df0 2024-09-18T01:25:29.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.699+0000 7f883150b640 1 -- 172.21.15.100:0/70733577 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8824058070 con 0x55e129573df0 2024-09-18T01:25:29.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.699+0000 7f883150b640 1 -- 172.21.15.100:0/70733577 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8824053880 con 0x55e129573df0 2024-09-18T01:25:29.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.699+0000 7f883660e800 1 -- 172.21.15.100:0/70733577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 msgr2=0x55e1296031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.699+0000 7f883660e800 1 --2- 172.21.15.100:0/70733577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 0x55e1296031e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f882400a470 tx=0x7f8824045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:29.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.699+0000 7f883660e800 1 -- 172.21.15.100:0/70733577 shutdown_connections 2024-09-18T01:25:29.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.699+0000 7f883660e800 1 --2- 172.21.15.100:0/70733577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 0x55e1296031e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.699+0000 7f883660e800 1 -- 172.21.15.100:0/70733577 >> 172.21.15.100:0/70733577 conn(0x55e1295fadf0 msgr2=0x55e1295fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.699+0000 7f883660e800 1 -- 172.21.15.100:0/70733577 shutdown_connections 2024-09-18T01:25:29.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.699+0000 7f883660e800 1 -- 172.21.15.100:0/70733577 wait complete. 2024-09-18T01:25:29.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.713+0000 7f883660e800 1 Processor -- start 2024-09-18T01:25:29.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.713+0000 7f883660e800 1 -- start start 2024-09-18T01:25:29.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.713+0000 7f883660e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 0x55e129600b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.713+0000 7f883660e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e12954c330 con 0x55e129573df0 2024-09-18T01:25:29.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.713+0000 7f8831d0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 0x55e129600b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.713+0000 7f8831d0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 0x55e129600b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37724/0 (socket says 172.21.15.100:37724) 2024-09-18T01:25:29.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.714+0000 7f8831d0c640 1 -- 172.21.15.100:0/3614298667 learned_addr learned my addr 172.21.15.100:0/3614298667 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.714+0000 7f8831d0c640 1 -- 172.21.15.100:0/3614298667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e129499bc0 con 0x55e129573df0 2024-09-18T01:25:29.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.714+0000 7f8831d0c640 1 --2- 172.21.15.100:0/3614298667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 0x55e129600b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8824025c20 tx=0x7f8824051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764c800b57a5ae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.714+0000 7f871fe07640 1 -- 172.21.15.100:0/3614298667 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8824053ba0 con 0x55e129573df0 2024-09-18T01:25:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.714+0000 7f871fe07640 1 -- 172.21.15.100:0/3614298667 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8824063030 con 0x55e129573df0 2024-09-18T01:25:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.714+0000 7f871fe07640 1 -- 172.21.15.100:0/3614298667 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8824053440 con 0x55e129573df0 2024-09-18T01:25:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.715+0000 7f883660e800 1 -- 172.21.15.100:0/3614298667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 msgr2=0x55e129600b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.715+0000 7f883660e800 1 --2- 172.21.15.100:0/3614298667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 0x55e129600b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8824025c20 tx=0x7f8824051000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.715+0000 7f883660e800 1 -- 172.21.15.100:0/3614298667 shutdown_connections 2024-09-18T01:25:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.715+0000 7f883660e800 1 --2- 172.21.15.100:0/3614298667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 0x55e129600b10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.715+0000 7f883660e800 1 -- 172.21.15.100:0/3614298667 >> 172.21.15.100:0/3614298667 conn(0x55e1295fadf0 msgr2=0x55e1296eb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.715+0000 7f883660e800 1 -- 172.21.15.100:0/3614298667 shutdown_connections 2024-09-18T01:25:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.715+0000 7f883660e800 1 -- 172.21.15.100:0/3614298667 wait complete. 2024-09-18T01:25:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.715+0000 7f883660e800 1 Processor -- start 2024-09-18T01:25:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.715+0000 7f883660e800 1 -- start start 2024-09-18T01:25:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.715+0000 7f883660e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 0x55e1296f9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.715+0000 7f883660e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e1296075f0 con 0x55e129573df0 2024-09-18T01:25:29.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.716+0000 7f8831d0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 0x55e1296f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.716+0000 7f8831d0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 0x55e1296f9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37738/0 (socket says 172.21.15.100:37738) 2024-09-18T01:25:29.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.716+0000 7f8831d0c640 1 -- 172.21.15.100:0/2741055570 learned_addr learned my addr 172.21.15.100:0/2741055570 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.716+0000 7f8831d0c640 1 -- 172.21.15.100:0/2741055570 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1294adfe0 con 0x55e129573df0 2024-09-18T01:25:29.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.716+0000 7f8831d0c640 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 0x55e1296f9330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55e129600210 tx=0x7f8824002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.716+0000 7f871e604640 1 -- 172.21.15.100:0/2741055570 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8824078070 con 0x55e129573df0 2024-09-18T01:25:29.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.716+0000 7f871e604640 1 -- 172.21.15.100:0/2741055570 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8824053570 con 0x55e129573df0 2024-09-18T01:25:29.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.716+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1296f9870 con 0x55e129573df0 2024-09-18T01:25:29.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.716+0000 7f871e604640 1 -- 172.21.15.100:0/2741055570 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8824053850 con 0x55e129573df0 2024-09-18T01:25:29.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.716+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1296f9df0 con 0x55e129573df0 2024-09-18T01:25:29.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.717+0000 7f871e604640 1 -- 172.21.15.100:0/2741055570 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f882407b070 con 0x55e129573df0 2024-09-18T01:25:29.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.717+0000 7f871e604640 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8718036b40 0x7f8718039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.717+0000 7f871e604640 1 -- 172.21.15.100:0/2741055570 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8824070070 con 0x55e129573df0 2024-09-18T01:25:29.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.717+0000 7f882bfff640 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8718036b40 0x7f8718039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.717+0000 7f883660e800 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e129603720 0x55e1297003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.717+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1297009f0 con 0x55e129603720 2024-09-18T01:25:29.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.717+0000 7f883250d640 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e129603720 0x55e1297003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.718+0000 7f882bfff640 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8718036b40 0x7f8718039000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f881c000f60 tx=0x7f881c0012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.718+0000 7f883250d640 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e129603720 0x55e1297003a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.718+0000 7f883250d640 1 -- 172.21.15.100:0/2741055570 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129603720 2024-09-18T01:25:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.718+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1296fd970 con 0x55e129603720 2024-09-18T01:25:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.718+0000 7f883250d640 1 -- 172.21.15.100:0/2741055570 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129603720 2024-09-18T01:25:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.718+0000 7f883660e800 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e129702d50 0x55e129705140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.718+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e129705830 con 0x55e129702d50 2024-09-18T01:25:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.718+0000 7f8831d0c640 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e129702d50 0x55e129705140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.719+0000 7f8831d0c640 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e129702d50 0x55e129705140 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.719+0000 7f8831d0c640 1 -- 172.21.15.100:0/2741055570 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f882407a030 con 0x55e129702d50 2024-09-18T01:25:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.719+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e129701b30 con 0x55e129603720 2024-09-18T01:25:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.719+0000 7f883250d640 1 -- 172.21.15.100:0/2741055570 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129603720 2024-09-18T01:25:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.719+0000 7f883660e800 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e129706c90 0x55e129709080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.719+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1297096d0 con 0x55e129706c90 2024-09-18T01:25:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.720+0000 7f882bfff640 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e129706c90 0x55e129709080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.720+0000 7f882bfff640 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e129706c90 0x55e129709080 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.720+0000 7f882bfff640 1 -- 172.21.15.100:0/2741055570 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f881c009050 con 0x55e129706c90 2024-09-18T01:25:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.721+0000 7f883660e800 1 Processor -- start 2024-09-18T01:25:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.721+0000 7f883660e800 1 -- start start 2024-09-18T01:25:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.721+0000 7f883660e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129717480 0x55e1297178a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.721+0000 7f883660e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e12949b580 con 0x55e129717480 2024-09-18T01:25:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.721+0000 7f8831d0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129717480 0x55e1297178a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.721+0000 7f8831d0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129717480 0x55e1297178a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37742/0 (socket says 172.21.15.100:37742) 2024-09-18T01:25:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.721+0000 7f8831d0c640 1 -- 172.21.15.100:0/1793370469 learned_addr learned my addr 172.21.15.100:0/1793370469 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.722+0000 7f8831d0c640 1 -- 172.21.15.100:0/1793370469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e129717de0 con 0x55e129717480 2024-09-18T01:25:29.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.722+0000 7f8831d0c640 1 --2- 172.21.15.100:0/1793370469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129717480 0x55e1297178a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f882407ae20 tx=0x7f88240051f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.722+0000 7f87177fe640 1 -- 172.21.15.100:0/1793370469 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8824068df0 con 0x55e129717480 2024-09-18T01:25:29.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.722+0000 7f87177fe640 1 -- 172.21.15.100:0/1793370469 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88240830d0 con 0x55e129717480 2024-09-18T01:25:29.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.722+0000 7f883660e800 1 -- 172.21.15.100:0/1793370469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e129718070 con 0x55e129717480 2024-09-18T01:25:29.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.722+0000 7f87177fe640 1 -- 172.21.15.100:0/1793370469 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f882407c9d0 con 0x55e129717480 2024-09-18T01:25:29.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.722+0000 7f883660e800 1 -- 172.21.15.100:0/1793370469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e12971ad50 con 0x55e129717480 2024-09-18T01:25:29.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.723+0000 7f87177fe640 1 -- 172.21.15.100:0/1793370469 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f882407cb70 con 0x55e129717480 2024-09-18T01:25:29.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.723+0000 7f87177fe640 1 --2- 172.21.15.100:0/1793370469 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f870c036b90 0x7f870c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.723+0000 7f87177fe640 1 -- 172.21.15.100:0/1793370469 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8824088030 con 0x55e129717480 2024-09-18T01:25:29.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.723+0000 7f882bfff640 1 --2- 172.21.15.100:0/1793370469 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f870c036b90 0x7f870c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.723+0000 7f883660e800 1 Processor -- start 2024-09-18T01:25:29.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.723+0000 7f883660e800 1 -- start start 2024-09-18T01:25:29.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.723+0000 7f882bfff640 1 --2- 172.21.15.100:0/1793370469 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f870c036b90 0x7f870c039050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f881c00bf50 tx=0x7f881c00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.723+0000 7f883660e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129723f30 0x55e129724330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.723+0000 7f883660e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e1295ff180 con 0x55e129723f30 2024-09-18T01:25:29.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.724+0000 7f8831d0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129723f30 0x55e129724330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.724+0000 7f8831d0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129723f30 0x55e129724330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37752/0 (socket says 172.21.15.100:37752) 2024-09-18T01:25:29.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.724+0000 7f8831d0c640 1 -- 172.21.15.100:0/3767900920 learned_addr learned my addr 172.21.15.100:0/3767900920 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.724+0000 7f8831d0c640 1 -- 172.21.15.100:0/3767900920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e129724900 con 0x55e129723f30 2024-09-18T01:25:29.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.724+0000 7f8831d0c640 1 --2- 172.21.15.100:0/3767900920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129723f30 0x55e129724330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8824004960 tx=0x7f882405ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a9c88e0cb76eae server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.724+0000 7f87157fa640 1 -- 172.21.15.100:0/3767900920 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f882409d030 con 0x55e129723f30 2024-09-18T01:25:29.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.724+0000 7f87157fa640 1 -- 172.21.15.100:0/3767900920 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8824068420 con 0x55e129723f30 2024-09-18T01:25:29.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.724+0000 7f87157fa640 1 -- 172.21.15.100:0/3767900920 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f882405c450 con 0x55e129723f30 2024-09-18T01:25:29.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.725+0000 7f883660e800 1 -- 172.21.15.100:0/3767900920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129723f30 msgr2=0x55e129724330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.725+0000 7f883660e800 1 --2- 172.21.15.100:0/3767900920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129723f30 0x55e129724330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8824004960 tx=0x7f882405ca00 comp rx=0 tx=0).stop 2024-09-18T01:25:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.725+0000 7f883660e800 1 -- 172.21.15.100:0/3767900920 shutdown_connections 2024-09-18T01:25:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.725+0000 7f883660e800 1 --2- 172.21.15.100:0/3767900920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129723f30 0x55e129724330 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.725+0000 7f883660e800 1 -- 172.21.15.100:0/3767900920 >> 172.21.15.100:0/3767900920 conn(0x55e1297202e0 msgr2=0x55e12971e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.725+0000 7f883660e800 1 -- 172.21.15.100:0/3767900920 shutdown_connections 2024-09-18T01:25:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.725+0000 7f883660e800 1 -- 172.21.15.100:0/3767900920 wait complete. 2024-09-18T01:25:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.725+0000 7f883660e800 1 Processor -- start 2024-09-18T01:25:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.725+0000 7f883660e800 1 -- start start 2024-09-18T01:25:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.725+0000 7f883660e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129723f30 0x55e12972b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.725+0000 7f883660e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e129724d90 con 0x55e129723f30 2024-09-18T01:25:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.725+0000 7f8831d0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129723f30 0x55e12972b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.725+0000 7f8831d0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129723f30 0x55e12972b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37762/0 (socket says 172.21.15.100:37762) 2024-09-18T01:25:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.725+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 learned_addr learned my addr 172.21.15.100:0/1334703955 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.726+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e12972b6f0 con 0x55e129723f30 2024-09-18T01:25:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.726+0000 7f8831d0c640 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129723f30 0x55e12972b1b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f88240833f0 tx=0x7f8824080f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.726+0000 7f87037fe640 1 -- 172.21.15.100:0/1334703955 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88240bc070 con 0x55e129723f30 2024-09-18T01:25:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.726+0000 7f87037fe640 1 -- 172.21.15.100:0/1334703955 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f882407a930 con 0x55e129723f30 2024-09-18T01:25:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.726+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e12972b6f0 con 0x55e129723f30 2024-09-18T01:25:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.726+0000 7f87037fe640 1 -- 172.21.15.100:0/1334703955 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f882405e8a0 con 0x55e129723f30 2024-09-18T01:25:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.726+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e12972b6f0 con 0x55e129723f30 2024-09-18T01:25:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.727+0000 7f87037fe640 1 -- 172.21.15.100:0/1334703955 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f88240bf070 con 0x55e129723f30 2024-09-18T01:25:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.727+0000 7f87037fe640 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f86fc036b90 0x7f86fc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.727+0000 7f87037fe640 1 -- 172.21.15.100:0/1334703955 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f88240c2ca0 con 0x55e129723f30 2024-09-18T01:25:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.727+0000 7f882bfff640 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f86fc036b90 0x7f86fc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.727+0000 7f883660e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.727+0000 7f883660e800 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e129736720 0x55e129738be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.727+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e129739330 con 0x55e129736720 2024-09-18T01:25:29.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.727+0000 7f883250d640 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e129736720 0x55e129738be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f882bfff640 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f86fc036b90 0x7f86fc039050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f881c001b60 tx=0x7f881c010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883250d640 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e129736720 0x55e129738be0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883660e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883660e800 20 realm 2024-09-18T01:25:29.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883660e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e129739740 con 0x55e129736720 2024-09-18T01:25:29.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883660e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883660e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:29.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883660e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a010 con 0x55e129736720 2024-09-18T01:25:29.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883660e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883660e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.728+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e129736720 2024-09-18T01:25:29.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.729+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.729+0000 7f883660e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:29.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.729+0000 7f883660e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.729+0000 7f883660e800 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e12973aea0 0x55e12973d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.729+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e12973d9f0 con 0x55e12973aea0 2024-09-18T01:25:29.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.729+0000 7f8831d0c640 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e12973aea0 0x55e12973d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.729+0000 7f8831d0c640 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e12973aea0 0x55e12973d290 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.729+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f88240be030 con 0x55e12973aea0 2024-09-18T01:25:29.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.729+0000 7f883660e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.729+0000 7f883660e800 20 searching for the correct realm 2024-09-18T01:25:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.729+0000 7f883660e800 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e12973fa90 0x55e129741f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.729+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e129742620 con 0x55e12973fa90 2024-09-18T01:25:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.730+0000 7f882bfff640 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e12973fa90 0x55e129741f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.730+0000 7f882bfff640 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e12973fa90 0x55e129741f50 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.730+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c009050 con 0x55e12973fa90 2024-09-18T01:25:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.730+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e129742620 con 0x55e12973aea0 2024-09-18T01:25:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.730+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88240be030 con 0x55e12973aea0 2024-09-18T01:25:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.730+0000 7f8831d0c640 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88240c1060 0x7f882409e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.730+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e129742620 con 0x7f88240c1060 2024-09-18T01:25:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.731+0000 7f883250d640 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88240c1060 0x7f882409e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.731+0000 7f883250d640 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88240c1060 0x7f882409e9c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.731+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.731+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e129736720 2024-09-18T01:25:29.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.731+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.731+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e129736720 2024-09-18T01:25:29.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.732+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.732+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x7f88240c1060 2024-09-18T01:25:29.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.732+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.732+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x7f88240c1060 2024-09-18T01:25:29.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.732+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.732+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e12973aea0 2024-09-18T01:25:29.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.732+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88240be030 con 0x55e12973aea0 2024-09-18T01:25:29.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.732+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e12973fa90 2024-09-18T01:25:29.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.733+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c009050 con 0x55e12973fa90 2024-09-18T01:25:29.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.733+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e129736720 2024-09-18T01:25:29.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.733+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.733+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x7f88240c1060 2024-09-18T01:25:29.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.733+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.733+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e129736720 2024-09-18T01:25:29.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.733+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.733+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e12973aea0 2024-09-18T01:25:29.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.734+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f88240be030 con 0x55e12973aea0 2024-09-18T01:25:29.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.734+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e12973fa90 2024-09-18T01:25:29.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.734+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c009050 con 0x55e12973fa90 2024-09-18T01:25:29.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.734+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e12973fa90 2024-09-18T01:25:29.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.734+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c009050 con 0x55e12973fa90 2024-09-18T01:25:29.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.734+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x7f88240c1060 2024-09-18T01:25:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.734+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.734+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e12973fa90 2024-09-18T01:25:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.734+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c009050 con 0x55e12973fa90 2024-09-18T01:25:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.734+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e12973fa90 2024-09-18T01:25:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.735+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c009050 con 0x55e12973fa90 2024-09-18T01:25:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.735+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e129736720 2024-09-18T01:25:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.735+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.735+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e129736720 2024-09-18T01:25:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.735+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.735+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x7f88240c1060 2024-09-18T01:25:29.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.735+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.735+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e12973fa90 2024-09-18T01:25:29.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.736+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c009050 con 0x55e12973fa90 2024-09-18T01:25:29.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.736+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e12973aea0 2024-09-18T01:25:29.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.736+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88240be030 con 0x55e12973aea0 2024-09-18T01:25:29.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.736+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e129736720 2024-09-18T01:25:29.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.736+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.736+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x7f88240c1060 2024-09-18T01:25:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.736+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.736+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e12973fa90 2024-09-18T01:25:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.737+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c009050 con 0x55e12973fa90 2024-09-18T01:25:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.737+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x7f88240c1060 2024-09-18T01:25:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.737+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.737+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e12973aea0 2024-09-18T01:25:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.737+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88240be030 con 0x55e12973aea0 2024-09-18T01:25:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.737+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e12973fa90 2024-09-18T01:25:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.737+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c009050 con 0x55e12973fa90 2024-09-18T01:25:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.737+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x7f88240c1060 2024-09-18T01:25:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.738+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.738+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e129736720 2024-09-18T01:25:29.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.738+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.738+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e12973a3b0 con 0x55e12973aea0 2024-09-18T01:25:29.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.738+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f88240be030 con 0x55e12973aea0 2024-09-18T01:25:29.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.738+0000 7f883660e800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:29.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.738+0000 7f883660e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:29.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.738+0000 7f883660e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:29.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.738+0000 7f883660e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:29.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.738+0000 7f883660e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:29.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.738+0000 7f883660e800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:29.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.738+0000 7f883660e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.738+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e12973e390 con 0x55e129736720 2024-09-18T01:25:29.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e12973e780 con 0x55e129736720 2024-09-18T01:25:29.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:29.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e12973e780 con 0x7f88240c1060 2024-09-18T01:25:29.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:29.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 20 zone default found 2024-09-18T01:25:29.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 4 Realm: () 2024-09-18T01:25:29.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:29.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:29.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:29.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 20 zonegroup default 2024-09-18T01:25:29.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.739+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e12973eba0 con 0x7f88240c1060 2024-09-18T01:25:29.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.740+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.740+0000 7f883660e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.740+0000 7f883660e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.740+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e12973eba0 con 0x55e12973fa90 2024-09-18T01:25:29.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.740+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f881c009050 con 0x55e12973fa90 2024-09-18T01:25:29.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.740+0000 7f883660e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.740+0000 7f883660e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.740+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e129744480 con 0x55e12973fa90 2024-09-18T01:25:29.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.740+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f881c009050 con 0x55e12973fa90 2024-09-18T01:25:29.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.740+0000 7f883660e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.740+0000 7f883660e800 20 started sync module instance, tier type = 2024-09-18T01:25:29.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.740+0000 7f883660e800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:29.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.740+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e12973df80 con 0x55e12973aea0 2024-09-18T01:25:29.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.741+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88240be030 con 0x55e12973aea0 2024-09-18T01:25:29.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.741+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94425551485392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129744870 con 0x55e12973aea0 2024-09-18T01:25:29.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.741+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129745360 con 0x55e129736720 2024-09-18T01:25:29.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.742+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94425551485392] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88240be030 con 0x55e12973aea0 2024-09-18T01:25:29.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.742+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.742+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94425551490608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129745750 con 0x55e129736720 2024-09-18T01:25:29.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.743+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129746110 con 0x55e12973fa90 2024-09-18T01:25:29.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.744+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94425551490608] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.744+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881c009050 con 0x55e12973fa90 2024-09-18T01:25:29.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.744+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94425551494240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129746500 con 0x55e12973fa90 2024-09-18T01:25:29.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.744+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129746ec0 con 0x55e12973aea0 2024-09-18T01:25:29.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.745+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94425551494240] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881c009050 con 0x55e12973fa90 2024-09-18T01:25:29.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.745+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88240be030 con 0x55e12973aea0 2024-09-18T01:25:29.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.745+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94425551486624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129747790 con 0x55e12973aea0 2024-09-18T01:25:29.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.745+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129748040 con 0x55e129736720 2024-09-18T01:25:29.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.746+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.746+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94425551486624] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88240be030 con 0x55e12973aea0 2024-09-18T01:25:29.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.746+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94425551501872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1297484f0 con 0x55e129736720 2024-09-18T01:25:29.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.746+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129747320 con 0x7f88240c1060 2024-09-18T01:25:29.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.747+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.747+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94425551506096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129747320 con 0x7f88240c1060 2024-09-18T01:25:29.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.747+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94425551501872] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.747+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129749a00 con 0x7f88240c1060 2024-09-18T01:25:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.748+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.748+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94425551508720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1297499c0 con 0x7f88240c1060 2024-09-18T01:25:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.748+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e12974a440 con 0x7f88240c1060 2024-09-18T01:25:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.748+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94425551506096] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.749+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94425551508720] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.749+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.749+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94425551503360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129749f90 con 0x7f88240c1060 2024-09-18T01:25:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.749+0000 7f883660e800 20 add_watcher() i=0 2024-09-18T01:25:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.749+0000 7f883660e800 20 add_watcher() i=1 2024-09-18T01:25:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.749+0000 7f883660e800 20 add_watcher() i=2 2024-09-18T01:25:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.749+0000 7f883660e800 20 add_watcher() i=3 2024-09-18T01:25:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.749+0000 7f883660e800 20 add_watcher() i=4 2024-09-18T01:25:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.749+0000 7f883660e800 20 add_watcher() i=5 2024-09-18T01:25:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.749+0000 7f883660e800 20 add_watcher() i=6 2024-09-18T01:25:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.750+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94425551503360] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.750+0000 7f883660e800 20 add_watcher() i=7 2024-09-18T01:25:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.750+0000 7f883660e800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.750+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e12974d470 con 0x55e129736720 2024-09-18T01:25:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.750+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.750+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94425551511440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e12974a860 con 0x55e129736720 2024-09-18T01:25:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.751+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94425551511440] v33'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.751+0000 7f86e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.751+0000 7f883660e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.751+0000 7f883660e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.751+0000 7f883660e800 5 note: GC not initialized 2024-09-18T01:25:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.752+0000 7f86e27fc640 20 reqs_thread_entry: start 2024-09-18T01:25:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.752+0000 7f883660e800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.752+0000 7f883660e800 20 Filter name: none 2024-09-18T01:25:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.752+0000 7f8653fff640 20 reqs_thread_entry: start 2024-09-18T01:25:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.752+0000 7f883660e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.752+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e129780340 con 0x55e129736720 2024-09-18T01:25:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.752+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.752+0000 7f883660e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.752+0000 7f883660e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.752+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e129780d30 con 0x55e129736720 2024-09-18T01:25:29.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.753+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.753+0000 7f883660e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:29.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.753+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e129781d40 con 0x55e12973aea0 2024-09-18T01:25:29.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.753+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f88240be030 con 0x55e12973aea0 2024-09-18T01:25:29.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.754+0000 7f86e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:29.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.754+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94425551511440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e12977e130 con 0x55e129736720 2024-09-18T01:25:29.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.755+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94425551511440] v33'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.755+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94425551485392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e12977e130 con 0x55e12973aea0 2024-09-18T01:25:29.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.756+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94425551485392] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88240be030 con 0x55e12973aea0 2024-09-18T01:25:29.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.756+0000 7f883660e800 20 remove_watcher() i=0 2024-09-18T01:25:29.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.756+0000 7f883660e800 2 removed watcher, disabling cache 2024-09-18T01:25:29.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.756+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94425551490608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e12977e130 con 0x55e129736720 2024-09-18T01:25:29.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.757+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94425551490608] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.757+0000 7f883660e800 20 remove_watcher() i=1 2024-09-18T01:25:29.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.757+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94425551494240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e12977e130 con 0x55e12973fa90 2024-09-18T01:25:29.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.758+0000 7f882bfff640 1 -- 172.21.15.100:0/1334703955 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94425551494240] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881c009050 con 0x55e12973fa90 2024-09-18T01:25:29.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.758+0000 7f883660e800 20 remove_watcher() i=2 2024-09-18T01:25:29.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.758+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94425551486624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129744e30 con 0x55e12973aea0 2024-09-18T01:25:29.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.759+0000 7f8831d0c640 1 -- 172.21.15.100:0/1334703955 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94425551486624] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88240be030 con 0x55e12973aea0 2024-09-18T01:25:29.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.759+0000 7f883660e800 20 remove_watcher() i=3 2024-09-18T01:25:29.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.759+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94425551501872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129745c60 con 0x55e129736720 2024-09-18T01:25:29.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.760+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94425551501872] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x55e129736720 2024-09-18T01:25:29.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.760+0000 7f883660e800 20 remove_watcher() i=4 2024-09-18T01:25:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.760+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94425551506096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129743ea0 con 0x7f88240c1060 2024-09-18T01:25:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.761+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94425551506096] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.761+0000 7f883660e800 20 remove_watcher() i=5 2024-09-18T01:25:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.761+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94425551508720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129744e30 con 0x7f88240c1060 2024-09-18T01:25:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.762+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94425551508720] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.762+0000 7f883660e800 20 remove_watcher() i=6 2024-09-18T01:25:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.762+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94425551503360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e129745c60 con 0x7f88240c1060 2024-09-18T01:25:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94425551503360] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f882c00a4a0 con 0x7f88240c1060 2024-09-18T01:25:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 20 remove_watcher() i=7 2024-09-18T01:25:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88240c1060 msgr2=0x7f882409e9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88240c1060 0x7f882409e9c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e129736720 msgr2=0x55e129738be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e129736720 0x55e129738be0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e12973aea0 msgr2=0x55e12973d290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e12973aea0 0x55e12973d290 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e12973fa90 msgr2=0x55e129741f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e12973fa90 0x55e129741f50 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f86fc036b90 msgr2=0x7f86fc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f86fc036b90 0x7f86fc039050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f881c001b60 tx=0x7f881c010000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129723f30 msgr2=0x55e12972b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129723f30 0x55e12972b1b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f88240833f0 tx=0x7f8824080f10 comp rx=0 tx=0).stop 2024-09-18T01:25:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883250d640 1 -- 172.21.15.100:0/1334703955 reap_dead start 2024-09-18T01:25:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 shutdown_connections 2024-09-18T01:25:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 --2- 172.21.15.100:0/1334703955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129723f30 0x55e12972b1b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.763+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 >> 172.21.15.100:0/1334703955 conn(0x55e1297202e0 msgr2=0x55e12971e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 shutdown_connections 2024-09-18T01:25:29.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/1334703955 wait complete. 2024-09-18T01:25:29.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/1793370469 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f870c036b90 msgr2=0x7f870c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 --2- 172.21.15.100:0/1793370469 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f870c036b90 0x7f870c039050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f881c00bf50 tx=0x7f881c00f000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/1793370469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129717480 msgr2=0x55e1297178a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 --2- 172.21.15.100:0/1793370469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129717480 0x55e1297178a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f882407ae20 tx=0x7f88240051f0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/1793370469 shutdown_connections 2024-09-18T01:25:29.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 --2- 172.21.15.100:0/1793370469 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f870c036b90 0x7f870c039050 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 --2- 172.21.15.100:0/1793370469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129717480 0x55e1297178a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/1793370469 >> 172.21.15.100:0/1793370469 conn(0x55e12970c410 msgr2=0x55e12970ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/1793370469 shutdown_connections 2024-09-18T01:25:29.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/1793370469 wait complete. 2024-09-18T01:25:29.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e129706c90 msgr2=0x55e129709080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e129706c90 0x55e129709080 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e129603720 msgr2=0x55e1297003a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e129603720 0x55e1297003a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e129702d50 msgr2=0x55e129705140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e129702d50 0x55e129705140 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8718036b40 msgr2=0x7f8718039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8718036b40 0x7f8718039000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f881c000f60 tx=0x7f881c0012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 msgr2=0x55e1296f9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 --2- 172.21.15.100:0/2741055570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e129573df0 0x55e1296f9330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55e129600210 tx=0x7f8824002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883250d640 1 -- 172.21.15.100:0/2741055570 reap_dead start 2024-09-18T01:25:29.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 shutdown_connections 2024-09-18T01:25:29.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 >> 172.21.15.100:0/2741055570 conn(0x55e1295fadf0 msgr2=0x55e1296eade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.764+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 shutdown_connections 2024-09-18T01:25:29.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.765+0000 7f883660e800 1 -- 172.21.15.100:0/2741055570 wait complete. 2024-09-18T01:25:29.776 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-18T01:25:29.777 DEBUG:tasks.util.rgw: json result: [] 2024-09-18T01:25:29.871 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:29.871 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-18T01:25:29.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-18T01:25:29.871 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-18T01:25:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.915+0000 7fc247298800 1 Processor -- start 2024-09-18T01:25:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.915+0000 7fc247298800 1 -- start start 2024-09-18T01:25:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.916+0000 7fc247298800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e5fc6b86b0 0x55e5fc7471d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.916+0000 7fc247298800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e5fc603b30 con 0x55e5fc747710 2024-09-18T01:25:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.916+0000 7fc247298800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55e5fc5e5360 con 0x55e5fc6b86b0 2024-09-18T01:25:29.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.916+0000 7fc244d8c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e5fc6b86b0 0x55e5fc7471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.916+0000 7fc23c58b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55e5fc747710 0x55e5fc749b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37250/0 (socket says 172.21.15.100:37250) 2024-09-18T01:25:29.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.916+0000 7fc244d8c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e5fc6b86b0 0x55e5fc7471d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37774/0 (socket says 172.21.15.100:37774) 2024-09-18T01:25:29.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.916+0000 7fc23c58b640 1 -- 172.21.15.100:0/4242895402 learned_addr learned my addr 172.21.15.100:0/4242895402 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:29.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.916+0000 7fc244d8c640 1 -- 172.21.15.100:0/4242895402 >> v1:172.21.15.92:6789/0 conn(0x55e5fc747710 legacy=0x55e5fc749b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.916+0000 7fc244d8c640 1 -- 172.21.15.100:0/4242895402 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5fc60be00 con 0x55e5fc6b86b0 2024-09-18T01:25:29.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.918+0000 7fc244d8c640 1 --2- 172.21.15.100:0/4242895402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 0x55e5fc7471d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc23400a470 tx=0x7fc234045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381bddf9faa5d51e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.918+0000 7fc23ffff640 1 -- 172.21.15.100:0/4242895402 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc234053570 con 0x55e5fc6b86b0 2024-09-18T01:25:29.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.918+0000 7fc23ffff640 1 -- 172.21.15.100:0/4242895402 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc234058070 con 0x55e5fc6b86b0 2024-09-18T01:25:29.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.918+0000 7fc23ffff640 1 -- 172.21.15.100:0/4242895402 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc234053880 con 0x55e5fc6b86b0 2024-09-18T01:25:29.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.919+0000 7fc247298800 1 -- 172.21.15.100:0/4242895402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 msgr2=0x55e5fc7471d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.919+0000 7fc247298800 1 --2- 172.21.15.100:0/4242895402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 0x55e5fc7471d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc23400a470 tx=0x7fc234045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:29.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.919+0000 7fc247298800 1 -- 172.21.15.100:0/4242895402 shutdown_connections 2024-09-18T01:25:29.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.919+0000 7fc247298800 1 --2- 172.21.15.100:0/4242895402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 0x55e5fc7471d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.919+0000 7fc247298800 1 -- 172.21.15.100:0/4242895402 >> 172.21.15.100:0/4242895402 conn(0x55e5fc73ede0 msgr2=0x55e5fc741200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.919+0000 7fc247298800 1 -- 172.21.15.100:0/4242895402 shutdown_connections 2024-09-18T01:25:29.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.919+0000 7fc247298800 1 -- 172.21.15.100:0/4242895402 wait complete. 2024-09-18T01:25:29.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.932+0000 7fc247298800 1 Processor -- start 2024-09-18T01:25:29.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.932+0000 7fc247298800 1 -- start start 2024-09-18T01:25:29.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.933+0000 7fc247298800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 0x55e5fc8338c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.933+0000 7fc247298800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e5fc690330 con 0x55e5fc6b86b0 2024-09-18T01:25:29.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.933+0000 7fc244d8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 0x55e5fc8338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.933+0000 7fc244d8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 0x55e5fc8338c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37780/0 (socket says 172.21.15.100:37780) 2024-09-18T01:25:29.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.933+0000 7fc244d8c640 1 -- 172.21.15.100:0/4201286519 learned_addr learned my addr 172.21.15.100:0/4201286519 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.933+0000 7fc244d8c640 1 -- 172.21.15.100:0/4201286519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5fc5ddbc0 con 0x55e5fc6b86b0 2024-09-18T01:25:29.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.933+0000 7fc244d8c640 1 --2- 172.21.15.100:0/4201286519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 0x55e5fc8338c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc234025c20 tx=0x7fc234051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f843d5fa7d7864 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.933+0000 7fc132e0d640 1 -- 172.21.15.100:0/4201286519 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc234053ba0 con 0x55e5fc6b86b0 2024-09-18T01:25:29.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.933+0000 7fc132e0d640 1 -- 172.21.15.100:0/4201286519 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc234063030 con 0x55e5fc6b86b0 2024-09-18T01:25:29.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.934+0000 7fc132e0d640 1 -- 172.21.15.100:0/4201286519 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc234053440 con 0x55e5fc6b86b0 2024-09-18T01:25:29.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.934+0000 7fc247298800 1 -- 172.21.15.100:0/4201286519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 msgr2=0x55e5fc8338c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.934+0000 7fc247298800 1 --2- 172.21.15.100:0/4201286519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 0x55e5fc8338c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc234025c20 tx=0x7fc234051000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.934+0000 7fc247298800 1 -- 172.21.15.100:0/4201286519 shutdown_connections 2024-09-18T01:25:29.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.934+0000 7fc247298800 1 --2- 172.21.15.100:0/4201286519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 0x55e5fc8338c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.934+0000 7fc247298800 1 -- 172.21.15.100:0/4201286519 >> 172.21.15.100:0/4201286519 conn(0x55e5fc73ede0 msgr2=0x55e5fc82f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.934+0000 7fc247298800 1 -- 172.21.15.100:0/4201286519 shutdown_connections 2024-09-18T01:25:29.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.934+0000 7fc247298800 1 -- 172.21.15.100:0/4201286519 wait complete. 2024-09-18T01:25:29.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.935+0000 7fc247298800 1 Processor -- start 2024-09-18T01:25:29.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.935+0000 7fc247298800 1 -- start start 2024-09-18T01:25:29.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.935+0000 7fc247298800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 0x55e5fc83b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.935+0000 7fc247298800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e5fc74b680 con 0x55e5fc6b86b0 2024-09-18T01:25:29.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.935+0000 7fc244d8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 0x55e5fc83b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.935+0000 7fc244d8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 0x55e5fc83b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37786/0 (socket says 172.21.15.100:37786) 2024-09-18T01:25:29.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.935+0000 7fc244d8c640 1 -- 172.21.15.100:0/3196668477 learned_addr learned my addr 172.21.15.100:0/3196668477 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.935+0000 7fc244d8c640 1 -- 172.21.15.100:0/3196668477 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5fc5f1fe0 con 0x55e5fc6b86b0 2024-09-18T01:25:29.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.936+0000 7fc244d8c640 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 0x55e5fc83b1c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55e5fc834720 tx=0x7fc234002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.936+0000 7fc13160a640 1 -- 172.21.15.100:0/3196668477 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc234078070 con 0x55e5fc6b86b0 2024-09-18T01:25:29.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.936+0000 7fc13160a640 1 -- 172.21.15.100:0/3196668477 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc234053570 con 0x55e5fc6b86b0 2024-09-18T01:25:29.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.936+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5fc83b700 con 0x55e5fc6b86b0 2024-09-18T01:25:29.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.936+0000 7fc13160a640 1 -- 172.21.15.100:0/3196668477 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc234053850 con 0x55e5fc6b86b0 2024-09-18T01:25:29.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.936+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5fc83bc80 con 0x55e5fc6b86b0 2024-09-18T01:25:29.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.937+0000 7fc13160a640 1 -- 172.21.15.100:0/3196668477 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc23407b070 con 0x55e5fc6b86b0 2024-09-18T01:25:29.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.937+0000 7fc13160a640 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc12c036b90 0x7fc12c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.937+0000 7fc13160a640 1 -- 172.21.15.100:0/3196668477 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fc234070070 con 0x55e5fc6b86b0 2024-09-18T01:25:29.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.937+0000 7fc23c58b640 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc12c036b90 0x7fc12c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.937+0000 7fc247298800 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e5fc747710 0x55e5fc842230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.937+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc842800 con 0x55e5fc747710 2024-09-18T01:25:29.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.937+0000 7fc24558d640 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e5fc747710 0x55e5fc842230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.937+0000 7fc23c58b640 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc12c036b90 0x7fc12c039050 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc22c000f60 tx=0x7fc22c0012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.937+0000 7fc24558d640 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e5fc747710 0x55e5fc842230 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.938+0000 7fc24558d640 1 -- 172.21.15.100:0/3196668477 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc747710 2024-09-18T01:25:29.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.938+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc83f800 con 0x55e5fc747710 2024-09-18T01:25:29.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.938+0000 7fc24558d640 1 -- 172.21.15.100:0/3196668477 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc747710 2024-09-18T01:25:29.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.938+0000 7fc247298800 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e5fc844b50 0x55e5fc846f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.938+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc847630 con 0x55e5fc844b50 2024-09-18T01:25:29.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.938+0000 7fc244d8c640 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e5fc844b50 0x55e5fc846f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.938+0000 7fc244d8c640 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e5fc844b50 0x55e5fc846f40 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.939+0000 7fc244d8c640 1 -- 172.21.15.100:0/3196668477 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc23407a030 con 0x55e5fc844b50 2024-09-18T01:25:29.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.939+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc843930 con 0x55e5fc747710 2024-09-18T01:25:29.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.939+0000 7fc24558d640 1 -- 172.21.15.100:0/3196668477 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc747710 2024-09-18T01:25:29.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.939+0000 7fc247298800 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e5fc848a90 0x55e5fc84ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.939+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc84b4d0 con 0x55e5fc848a90 2024-09-18T01:25:29.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.939+0000 7fc23c58b640 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e5fc848a90 0x55e5fc84ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.940+0000 7fc23c58b640 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e5fc848a90 0x55e5fc84ae80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.940+0000 7fc23c58b640 1 -- 172.21.15.100:0/3196668477 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc848a90 2024-09-18T01:25:29.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.940+0000 7fc247298800 1 Processor -- start 2024-09-18T01:25:29.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.940+0000 7fc247298800 1 -- start start 2024-09-18T01:25:29.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.941+0000 7fc247298800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc859280 0x55e5fc8596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.941+0000 7fc247298800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e5fc5df580 con 0x55e5fc859280 2024-09-18T01:25:29.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.941+0000 7fc244d8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc859280 0x55e5fc8596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.941+0000 7fc244d8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc859280 0x55e5fc8596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37796/0 (socket says 172.21.15.100:37796) 2024-09-18T01:25:29.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.941+0000 7fc244d8c640 1 -- 172.21.15.100:0/3107467465 learned_addr learned my addr 172.21.15.100:0/3107467465 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.941+0000 7fc244d8c640 1 -- 172.21.15.100:0/3107467465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5fc859be0 con 0x55e5fc859280 2024-09-18T01:25:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.941+0000 7fc244d8c640 1 --2- 172.21.15.100:0/3107467465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc859280 0x55e5fc8596a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc23404ffd0 tx=0x7fc23406a3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.941+0000 7fc12a7fc640 1 -- 172.21.15.100:0/3107467465 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc23405ec50 con 0x55e5fc859280 2024-09-18T01:25:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.941+0000 7fc12a7fc640 1 -- 172.21.15.100:0/3107467465 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc23405edf0 con 0x55e5fc859280 2024-09-18T01:25:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.941+0000 7fc247298800 1 -- 172.21.15.100:0/3107467465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5fc859e70 con 0x55e5fc859280 2024-09-18T01:25:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.941+0000 7fc12a7fc640 1 -- 172.21.15.100:0/3107467465 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc234009b80 con 0x55e5fc859280 2024-09-18T01:25:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.941+0000 7fc247298800 1 -- 172.21.15.100:0/3107467465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5fc85cb50 con 0x55e5fc859280 2024-09-18T01:25:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.942+0000 7fc12a7fc640 1 -- 172.21.15.100:0/3107467465 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc234009d20 con 0x55e5fc859280 2024-09-18T01:25:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.942+0000 7fc12a7fc640 1 --2- 172.21.15.100:0/3107467465 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc11c036b90 0x7fc11c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.942+0000 7fc12a7fc640 1 -- 172.21.15.100:0/3107467465 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fc234099c50 con 0x55e5fc859280 2024-09-18T01:25:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.942+0000 7fc23c58b640 1 --2- 172.21.15.100:0/3107467465 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc11c036b90 0x7fc11c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.942+0000 7fc247298800 1 Processor -- start 2024-09-18T01:25:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.943+0000 7fc247298800 1 -- start start 2024-09-18T01:25:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.943+0000 7fc23c58b640 1 --2- 172.21.15.100:0/3107467465 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc11c036b90 0x7fc11c039050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00bf20 tx=0x7fc22c00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.943+0000 7fc247298800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc744400 0x55e5fc744800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.943+0000 7fc247298800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e5fc834010 con 0x55e5fc744400 2024-09-18T01:25:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.943+0000 7fc244d8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc744400 0x55e5fc744800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.943+0000 7fc244d8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc744400 0x55e5fc744800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37812/0 (socket says 172.21.15.100:37812) 2024-09-18T01:25:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.943+0000 7fc244d8c640 1 -- 172.21.15.100:0/122547369 learned_addr learned my addr 172.21.15.100:0/122547369 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.943+0000 7fc244d8c640 1 -- 172.21.15.100:0/122547369 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5fc744dd0 con 0x55e5fc744400 2024-09-18T01:25:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.943+0000 7fc244d8c640 1 --2- 172.21.15.100:0/122547369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc744400 0x55e5fc744800 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc23405d010 tx=0x7fc23407d570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986b864614cd0a1f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.943+0000 7fc11bfff640 1 -- 172.21.15.100:0/122547369 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc234090a60 con 0x55e5fc744400 2024-09-18T01:25:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.943+0000 7fc11bfff640 1 -- 172.21.15.100:0/122547369 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc234066330 con 0x55e5fc744400 2024-09-18T01:25:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.943+0000 7fc11bfff640 1 -- 172.21.15.100:0/122547369 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc234080120 con 0x55e5fc744400 2024-09-18T01:25:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.944+0000 7fc247298800 1 -- 172.21.15.100:0/122547369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc744400 msgr2=0x55e5fc744800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.944+0000 7fc247298800 1 --2- 172.21.15.100:0/122547369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc744400 0x55e5fc744800 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc23405d010 tx=0x7fc23407d570 comp rx=0 tx=0).stop 2024-09-18T01:25:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.944+0000 7fc247298800 1 -- 172.21.15.100:0/122547369 shutdown_connections 2024-09-18T01:25:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.944+0000 7fc247298800 1 --2- 172.21.15.100:0/122547369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc744400 0x55e5fc744800 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.944+0000 7fc247298800 1 -- 172.21.15.100:0/122547369 >> 172.21.15.100:0/122547369 conn(0x55e5fc862130 msgr2=0x55e5fc860230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.944+0000 7fc247298800 1 -- 172.21.15.100:0/122547369 shutdown_connections 2024-09-18T01:25:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.944+0000 7fc247298800 1 -- 172.21.15.100:0/122547369 wait complete. 2024-09-18T01:25:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.944+0000 7fc247298800 1 Processor -- start 2024-09-18T01:25:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.944+0000 7fc247298800 1 -- start start 2024-09-18T01:25:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.944+0000 7fc247298800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc744400 0x55e5fc86f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.944+0000 7fc247298800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e5fc742fb0 con 0x55e5fc744400 2024-09-18T01:25:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.944+0000 7fc244d8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc744400 0x55e5fc86f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.944+0000 7fc244d8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc744400 0x55e5fc86f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37822/0 (socket says 172.21.15.100:37822) 2024-09-18T01:25:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.944+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 learned_addr learned my addr 172.21.15.100:0/4135495340 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.945+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5fc86f7d0 con 0x55e5fc744400 2024-09-18T01:25:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.945+0000 7fc244d8c640 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc744400 0x55e5fc86f290 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc23405d010 tx=0x7fc234090f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.945+0000 7fc11a7fc640 1 -- 172.21.15.100:0/4135495340 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2340b7070 con 0x55e5fc744400 2024-09-18T01:25:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.945+0000 7fc11a7fc640 1 -- 172.21.15.100:0/4135495340 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc23407da80 con 0x55e5fc744400 2024-09-18T01:25:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.945+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5fc86f7d0 con 0x55e5fc744400 2024-09-18T01:25:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.945+0000 7fc11a7fc640 1 -- 172.21.15.100:0/4135495340 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc23407dd80 con 0x55e5fc744400 2024-09-18T01:25:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.945+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5fc86f7d0 con 0x55e5fc744400 2024-09-18T01:25:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.946+0000 7fc11a7fc640 1 -- 172.21.15.100:0/4135495340 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc2340ba070 con 0x55e5fc744400 2024-09-18T01:25:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.946+0000 7fc11a7fc640 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc110036b40 0x7fc110039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.946+0000 7fc11a7fc640 1 -- 172.21.15.100:0/4135495340 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fc2340a8030 con 0x55e5fc744400 2024-09-18T01:25:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.946+0000 7fc23c58b640 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc110036b40 0x7fc110039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.946+0000 7fc247298800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.946+0000 7fc247298800 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e5fc87a990 0x55e5fc87ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.946+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87d5a0 con 0x55e5fc87a990 2024-09-18T01:25:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.947+0000 7fc24558d640 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e5fc87a990 0x55e5fc87ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.947+0000 7fc23c58b640 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc110036b40 0x7fc110039000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc22c001b60 tx=0x7fc22c010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.947+0000 7fc24558d640 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e5fc87a990 0x55e5fc87ce50 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.947+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.947+0000 7fc247298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.947+0000 7fc247298800 20 realm 2024-09-18T01:25:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.947+0000 7fc247298800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.947+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87d9b0 con 0x55e5fc87a990 2024-09-18T01:25:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.947+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.947+0000 7fc247298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.947+0000 7fc247298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.947+0000 7fc247298800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.947+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e280 con 0x55e5fc87a990 2024-09-18T01:25:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.947+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc247298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc247298800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc87a990 2024-09-18T01:25:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc247298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc247298800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc247298800 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e5fc87f110 0x55e5fc881500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc881c60 con 0x55e5fc87f110 2024-09-18T01:25:29.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc244d8c640 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e5fc87f110 0x55e5fc881500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc244d8c640 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e5fc87f110 0x55e5fc881500 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc2340c3070 con 0x55e5fc87f110 2024-09-18T01:25:29.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc247298800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:29.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc247298800 20 searching for the correct realm 2024-09-18T01:25:29.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc247298800 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e5fc883d10 0x55e5fc8861d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.948+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc8868a0 con 0x55e5fc883d10 2024-09-18T01:25:29.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.949+0000 7fc23c58b640 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e5fc883d10 0x55e5fc8861d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.949+0000 7fc23c58b640 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e5fc883d10 0x55e5fc8861d0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.949+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc883d10 2024-09-18T01:25:29.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.949+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc8868a0 con 0x55e5fc87f110 2024-09-18T01:25:29.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.949+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2340c3070 con 0x55e5fc87f110 2024-09-18T01:25:29.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.949+0000 7fc244d8c640 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc2340bc070 0x7fc2340ac830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:29.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.949+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc8868a0 con 0x7fc2340bc070 2024-09-18T01:25:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.950+0000 7fc24558d640 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc2340bc070 0x7fc2340ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.950+0000 7fc24558d640 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc2340bc070 0x7fc2340ac830 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.950+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.950+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc87a990 2024-09-18T01:25:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.951+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.951+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc87a990 2024-09-18T01:25:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.951+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.951+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x7fc2340bc070 2024-09-18T01:25:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.951+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.951+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x7fc2340bc070 2024-09-18T01:25:29.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.951+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.951+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc87f110 2024-09-18T01:25:29.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.952+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2340c3070 con 0x55e5fc87f110 2024-09-18T01:25:29.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.952+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc883d10 2024-09-18T01:25:29.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.952+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc883d10 2024-09-18T01:25:29.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.952+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc87a990 2024-09-18T01:25:29.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.952+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.952+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x7fc2340bc070 2024-09-18T01:25:29.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.952+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.952+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc87a990 2024-09-18T01:25:29.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.952+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.952+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc87f110 2024-09-18T01:25:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.953+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc2340c3070 con 0x55e5fc87f110 2024-09-18T01:25:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.953+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc883d10 2024-09-18T01:25:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.953+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc883d10 2024-09-18T01:25:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.953+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc883d10 2024-09-18T01:25:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.953+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc883d10 2024-09-18T01:25:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.953+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x7fc2340bc070 2024-09-18T01:25:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.953+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.953+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc883d10 2024-09-18T01:25:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.954+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc883d10 2024-09-18T01:25:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.954+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc883d10 2024-09-18T01:25:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.954+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc883d10 2024-09-18T01:25:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.954+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc87a990 2024-09-18T01:25:29.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.954+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.954+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc87a990 2024-09-18T01:25:29.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.954+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.954+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x7fc2340bc070 2024-09-18T01:25:29.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.955+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.955+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc883d10 2024-09-18T01:25:29.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.955+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc883d10 2024-09-18T01:25:29.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.955+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc87f110 2024-09-18T01:25:29.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.955+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2340c3070 con 0x55e5fc87f110 2024-09-18T01:25:29.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.955+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc87a990 2024-09-18T01:25:29.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.955+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.955+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x7fc2340bc070 2024-09-18T01:25:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.956+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.956+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc883d10 2024-09-18T01:25:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.956+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc883d10 2024-09-18T01:25:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.956+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x7fc2340bc070 2024-09-18T01:25:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.956+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.956+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc87f110 2024-09-18T01:25:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.956+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2340c3070 con 0x55e5fc87f110 2024-09-18T01:25:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.956+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc883d10 2024-09-18T01:25:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.956+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc883d10 2024-09-18T01:25:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.956+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x7fc2340bc070 2024-09-18T01:25:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc87a990 2024-09-18T01:25:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc87e620 con 0x55e5fc87f110 2024-09-18T01:25:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc2340c3070 con 0x55e5fc87f110 2024-09-18T01:25:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc247298800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc247298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc247298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc247298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc247298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc247298800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc247298800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc882610 con 0x55e5fc87a990 2024-09-18T01:25:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc247298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc247298800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.957+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc882a00 con 0x55e5fc87a990 2024-09-18T01:25:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc882a00 con 0x7fc2340bc070 2024-09-18T01:25:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 20 zone default found 2024-09-18T01:25:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 4 Realm: () 2024-09-18T01:25:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 20 zonegroup default 2024-09-18T01:25:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc882e20 con 0x7fc2340bc070 2024-09-18T01:25:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.958+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc882e20 con 0x55e5fc883d10 2024-09-18T01:25:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.959+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc883d10 2024-09-18T01:25:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.959+0000 7fc247298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.959+0000 7fc247298800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.959+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc888700 con 0x55e5fc883d10 2024-09-18T01:25:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.959+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc883d10 2024-09-18T01:25:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.959+0000 7fc247298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.959+0000 7fc247298800 20 started sync module instance, tier type = 2024-09-18T01:25:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.959+0000 7fc247298800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.959+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc887ba0 con 0x55e5fc87f110 2024-09-18T01:25:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.960+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2340c3070 con 0x55e5fc87f110 2024-09-18T01:25:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.960+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94446272675728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc888f50 con 0x55e5fc87f110 2024-09-18T01:25:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.960+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc8897a0 con 0x55e5fc87a990 2024-09-18T01:25:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.961+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94446272675728] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2340c3070 con 0x55e5fc87f110 2024-09-18T01:25:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.961+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.961+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94446272680688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc889bc0 con 0x55e5fc87a990 2024-09-18T01:25:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.961+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc88a410 con 0x55e5fc883d10 2024-09-18T01:25:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.962+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94446272680688] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.963+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc883d10 2024-09-18T01:25:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.963+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94446272682224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc88a7b0 con 0x55e5fc883d10 2024-09-18T01:25:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.963+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc88b1f0 con 0x55e5fc87f110 2024-09-18T01:25:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.963+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94446272682224] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc883d10 2024-09-18T01:25:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.964+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2340c3070 con 0x55e5fc87f110 2024-09-18T01:25:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.964+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94446272683376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc88ba90 con 0x55e5fc87f110 2024-09-18T01:25:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.964+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc88c450 con 0x55e5fc87a990 2024-09-18T01:25:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.965+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.965+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94446272692128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc88c870 con 0x55e5fc87a990 2024-09-18T01:25:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.965+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc88d2f0 con 0x7fc2340bc070 2024-09-18T01:25:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.965+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94446272683376] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2340c3070 con 0x55e5fc87f110 2024-09-18T01:25:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.966+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94446272692128] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.966+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.966+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94446272695776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc88c3c0 con 0x7fc2340bc070 2024-09-18T01:25:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.966+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc88dbc0 con 0x7fc2340bc070 2024-09-18T01:25:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.967+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94446272695776] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.967+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.967+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94446272689632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc88c3c0 con 0x7fc2340bc070 2024-09-18T01:25:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.967+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc88e1e0 con 0x7fc2340bc070 2024-09-18T01:25:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.968+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94446272689632] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.968+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.968+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94446272698128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc88e1e0 con 0x7fc2340bc070 2024-09-18T01:25:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.968+0000 7fc247298800 20 add_watcher() i=0 2024-09-18T01:25:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.968+0000 7fc247298800 20 add_watcher() i=1 2024-09-18T01:25:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.968+0000 7fc247298800 20 add_watcher() i=2 2024-09-18T01:25:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.968+0000 7fc247298800 20 add_watcher() i=3 2024-09-18T01:25:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.968+0000 7fc247298800 20 add_watcher() i=4 2024-09-18T01:25:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.968+0000 7fc247298800 20 add_watcher() i=5 2024-09-18T01:25:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.968+0000 7fc247298800 20 add_watcher() i=6 2024-09-18T01:25:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.969+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94446272698128] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.969+0000 7fc247298800 20 add_watcher() i=7 2024-09-18T01:25:29.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.969+0000 7fc247298800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:29.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.969+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc891520 con 0x55e5fc87a990 2024-09-18T01:25:29.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.969+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.969+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94446272700064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc88e770 con 0x55e5fc87a990 2024-09-18T01:25:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.970+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94446272700064] v33'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.970+0000 7fc0fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.970+0000 7fc247298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.970+0000 7fc247298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.970+0000 7fc247298800 5 note: GC not initialized 2024-09-18T01:25:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.970+0000 7fc0f9fe3640 20 reqs_thread_entry: start 2024-09-18T01:25:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.970+0000 7fc247298800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.971+0000 7fc247298800 20 Filter name: none 2024-09-18T01:25:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.971+0000 7fc06b7fe640 20 reqs_thread_entry: start 2024-09-18T01:25:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.971+0000 7fc247298800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.971+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc8c45a0 con 0x55e5fc87a990 2024-09-18T01:25:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.971+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.971+0000 7fc247298800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.971+0000 7fc247298800 20 rados->read ofs=0 len=0 2024-09-18T01:25:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.971+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc8c4f90 con 0x55e5fc87a990 2024-09-18T01:25:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.971+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.971+0000 7fc247298800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.971+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc8c5fa0 con 0x55e5fc87f110 2024-09-18T01:25:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.972+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc2340c3070 con 0x55e5fc87f110 2024-09-18T01:25:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.972+0000 7fc0fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.972+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94446272700064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc8c23b0 con 0x55e5fc87a990 2024-09-18T01:25:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.973+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94446272700064] v33'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.973+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94446272675728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc8c23b0 con 0x55e5fc87f110 2024-09-18T01:25:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.974+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94446272675728] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2340c3070 con 0x55e5fc87f110 2024-09-18T01:25:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.974+0000 7fc247298800 20 remove_watcher() i=0 2024-09-18T01:25:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.974+0000 7fc247298800 2 removed watcher, disabling cache 2024-09-18T01:25:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.974+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94446272680688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc8c23b0 con 0x55e5fc87a990 2024-09-18T01:25:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.975+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94446272680688] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.976+0000 7fc247298800 20 remove_watcher() i=1 2024-09-18T01:25:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.976+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94446272682224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc8c23b0 con 0x55e5fc883d10 2024-09-18T01:25:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.976+0000 7fc23c58b640 1 -- 172.21.15.100:0/4135495340 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94446272682224] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c009050 con 0x55e5fc883d10 2024-09-18T01:25:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.976+0000 7fc247298800 20 remove_watcher() i=2 2024-09-18T01:25:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.976+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94446272683376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc887f90 con 0x55e5fc87f110 2024-09-18T01:25:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.977+0000 7fc244d8c640 1 -- 172.21.15.100:0/4135495340 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94446272683376] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2340c3070 con 0x55e5fc87f110 2024-09-18T01:25:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.977+0000 7fc247298800 20 remove_watcher() i=3 2024-09-18T01:25:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.977+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94446272692128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc8892f0 con 0x55e5fc87a990 2024-09-18T01:25:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.978+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94446272692128] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x55e5fc87a990 2024-09-18T01:25:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.978+0000 7fc247298800 20 remove_watcher() i=4 2024-09-18T01:25:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.978+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94446272695776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc8898f0 con 0x7fc2340bc070 2024-09-18T01:25:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.979+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94446272695776] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.979+0000 7fc247298800 20 remove_watcher() i=5 2024-09-18T01:25:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.979+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94446272689632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc887f90 con 0x7fc2340bc070 2024-09-18T01:25:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.980+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94446272689632] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.980+0000 7fc247298800 20 remove_watcher() i=6 2024-09-18T01:25:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.980+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94446272698128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e5fc88bfa0 con 0x7fc2340bc070 2024-09-18T01:25:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94446272698128] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc24000a4a0 con 0x7fc2340bc070 2024-09-18T01:25:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 20 remove_watcher() i=7 2024-09-18T01:25:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc2340bc070 msgr2=0x7fc2340ac830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc2340bc070 0x7fc2340ac830 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e5fc87a990 msgr2=0x55e5fc87ce50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e5fc87a990 0x55e5fc87ce50 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e5fc87f110 msgr2=0x55e5fc881500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e5fc87f110 0x55e5fc881500 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e5fc883d10 msgr2=0x55e5fc8861d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e5fc883d10 0x55e5fc8861d0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc110036b40 msgr2=0x7fc110039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc110036b40 0x7fc110039000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc22c001b60 tx=0x7fc22c010000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc744400 msgr2=0x55e5fc86f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc24558d640 1 -- 172.21.15.100:0/4135495340 reap_dead start 2024-09-18T01:25:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc744400 0x55e5fc86f290 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc23405d010 tx=0x7fc234090f60 comp rx=0 tx=0).stop 2024-09-18T01:25:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 shutdown_connections 2024-09-18T01:25:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 --2- 172.21.15.100:0/4135495340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc744400 0x55e5fc86f290 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.981+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 >> 172.21.15.100:0/4135495340 conn(0x55e5fc862130 msgr2=0x55e5fc860200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 shutdown_connections 2024-09-18T01:25:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/4135495340 wait complete. 2024-09-18T01:25:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/3107467465 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc11c036b90 msgr2=0x7fc11c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 --2- 172.21.15.100:0/3107467465 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc11c036b90 0x7fc11c039050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00bf20 tx=0x7fc22c00f000 comp rx=0 tx=0).stop 2024-09-18T01:25:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/3107467465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc859280 msgr2=0x55e5fc8596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 --2- 172.21.15.100:0/3107467465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc859280 0x55e5fc8596a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc23404ffd0 tx=0x7fc23406a3d0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/3107467465 shutdown_connections 2024-09-18T01:25:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 --2- 172.21.15.100:0/3107467465 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc11c036b90 0x7fc11c039050 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 --2- 172.21.15.100:0/3107467465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc859280 0x55e5fc8596a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/3107467465 >> 172.21.15.100:0/3107467465 conn(0x55e5fc84e210 msgr2=0x55e5fc850d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/3107467465 shutdown_connections 2024-09-18T01:25:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/3107467465 wait complete. 2024-09-18T01:25:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e5fc848a90 msgr2=0x55e5fc84ae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e5fc848a90 0x55e5fc84ae80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e5fc747710 msgr2=0x55e5fc842230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e5fc747710 0x55e5fc842230 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e5fc844b50 msgr2=0x55e5fc846f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e5fc844b50 0x55e5fc846f40 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc12c036b90 msgr2=0x7fc12c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc12c036b90 0x7fc12c039050 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc22c000f60 tx=0x7fc22c0012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 msgr2=0x55e5fc83b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:29.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 --2- 172.21.15.100:0/3196668477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5fc6b86b0 0x55e5fc83b1c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55e5fc834720 tx=0x7fc234002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:29.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc24558d640 1 -- 172.21.15.100:0/3196668477 reap_dead start 2024-09-18T01:25:29.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 shutdown_connections 2024-09-18T01:25:29.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 >> 172.21.15.100:0/3196668477 conn(0x55e5fc73ede0 msgr2=0x55e5fc82daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:29.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.982+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 shutdown_connections 2024-09-18T01:25:29.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:29.983+0000 7fc247298800 1 -- 172.21.15.100:0/3196668477 wait complete. 2024-09-18T01:25:29.995 INFO:teuthology.orchestra.run.smithi100.stdout:["myfoo"] 2024-09-18T01:25:29.995 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-18T01:25:30.082 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:30.082 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-18T01:25:30.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-18T01:25:30.082 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-18T01:25:30.125 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:30.125 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:30.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.124+0000 7f19dce40800 1 Processor -- start 2024-09-18T01:25:30.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.124+0000 7f19dce40800 1 -- start start 2024-09-18T01:25:30.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.125+0000 7f19dce40800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ae40eb18f0 0x55ae40eb3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.125+0000 7f19dce40800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ae40d6db30 con 0x55ae40ead4b0 2024-09-18T01:25:30.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.125+0000 7f19dce40800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55ae40d4f360 con 0x55ae40eb18f0 2024-09-18T01:25:30.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.125+0000 7f19d2133640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ae40eb18f0 0x55ae40eb3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.125+0000 7f19da934640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55ae40ead4b0 0x55ae40ead8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37264/0 (socket says 172.21.15.100:37264) 2024-09-18T01:25:30.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.125+0000 7f19da934640 1 -- 172.21.15.100:0/1712124806 learned_addr learned my addr 172.21.15.100:0/1712124806 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:30.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.125+0000 7f19d2133640 1 -- 172.21.15.100:0/1712124806 >> v1:172.21.15.92:6789/0 conn(0x55ae40ead4b0 legacy=0x55ae40ead8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.125+0000 7f19d2133640 1 -- 172.21.15.100:0/1712124806 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae40d75e00 con 0x55ae40eb18f0 2024-09-18T01:25:30.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.127+0000 7f19d2133640 1 --2- 172.21.15.100:0/1712124806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40eb18f0 0x55ae40eb3ce0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f19c400a470 tx=0x7f19c4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fce299631082ad server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.127+0000 7f19da133640 1 -- 172.21.15.100:0/1712124806 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19c4053570 con 0x55ae40eb18f0 2024-09-18T01:25:30.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.127+0000 7f19da133640 1 -- 172.21.15.100:0/1712124806 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c4058070 con 0x55ae40eb18f0 2024-09-18T01:25:30.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.127+0000 7f19da133640 1 -- 172.21.15.100:0/1712124806 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19c4053880 con 0x55ae40eb18f0 2024-09-18T01:25:30.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.128+0000 7f19dce40800 1 -- 172.21.15.100:0/1712124806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40eb18f0 msgr2=0x55ae40eb3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.128+0000 7f19dce40800 1 --2- 172.21.15.100:0/1712124806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40eb18f0 0x55ae40eb3ce0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f19c400a470 tx=0x7f19c4045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:30.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.128+0000 7f19dce40800 1 -- 172.21.15.100:0/1712124806 shutdown_connections 2024-09-18T01:25:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.128+0000 7f19dce40800 1 --2- 172.21.15.100:0/1712124806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40eb18f0 0x55ae40eb3ce0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.128+0000 7f19dce40800 1 -- 172.21.15.100:0/1712124806 >> 172.21.15.100:0/1712124806 conn(0x55ae40ea8de0 msgr2=0x55ae40eab200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.128+0000 7f19dce40800 1 -- 172.21.15.100:0/1712124806 shutdown_connections 2024-09-18T01:25:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.128+0000 7f19dce40800 1 -- 172.21.15.100:0/1712124806 wait complete. 2024-09-18T01:25:30.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.141+0000 7f19dce40800 1 Processor -- start 2024-09-18T01:25:30.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.141+0000 7f19dce40800 1 -- start start 2024-09-18T01:25:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.142+0000 7f19dce40800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40ead4b0 0x55ae40f9c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.142+0000 7f19dce40800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae40dfa320 con 0x55ae40ead4b0 2024-09-18T01:25:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.142+0000 7f19da934640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40ead4b0 0x55ae40f9c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.142+0000 7f19da934640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40ead4b0 0x55ae40f9c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37842/0 (socket says 172.21.15.100:37842) 2024-09-18T01:25:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.142+0000 7f19da934640 1 -- 172.21.15.100:0/830005659 learned_addr learned my addr 172.21.15.100:0/830005659 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.142+0000 7f19da934640 1 -- 172.21.15.100:0/830005659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae40d47bc0 con 0x55ae40ead4b0 2024-09-18T01:25:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.142+0000 7f19da934640 1 --2- 172.21.15.100:0/830005659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40ead4b0 0x55ae40f9c740 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f19cc001e10 tx=0x7f19cc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6460f9c4a3d96f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.142+0000 7f18c8e09640 1 -- 172.21.15.100:0/830005659 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19cc012020 con 0x55ae40ead4b0 2024-09-18T01:25:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.142+0000 7f18c8e09640 1 -- 172.21.15.100:0/830005659 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19cc00e5a0 con 0x55ae40ead4b0 2024-09-18T01:25:30.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.142+0000 7f18c8e09640 1 -- 172.21.15.100:0/830005659 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19cc00e8e0 con 0x55ae40ead4b0 2024-09-18T01:25:30.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.143+0000 7f19dce40800 1 -- 172.21.15.100:0/830005659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40ead4b0 msgr2=0x55ae40f9c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.143+0000 7f19dce40800 1 --2- 172.21.15.100:0/830005659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40ead4b0 0x55ae40f9c740 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f19cc001e10 tx=0x7f19cc00b780 comp rx=0 tx=0).stop 2024-09-18T01:25:30.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.143+0000 7f19dce40800 1 -- 172.21.15.100:0/830005659 shutdown_connections 2024-09-18T01:25:30.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.143+0000 7f19dce40800 1 --2- 172.21.15.100:0/830005659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40ead4b0 0x55ae40f9c740 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.143+0000 7f19dce40800 1 -- 172.21.15.100:0/830005659 >> 172.21.15.100:0/830005659 conn(0x55ae40ea8de0 msgr2=0x55ae40f98100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.143+0000 7f19dce40800 1 -- 172.21.15.100:0/830005659 shutdown_connections 2024-09-18T01:25:30.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.143+0000 7f19dce40800 1 -- 172.21.15.100:0/830005659 wait complete. 2024-09-18T01:25:30.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.143+0000 7f19dce40800 1 Processor -- start 2024-09-18T01:25:30.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.144+0000 7f19dce40800 1 -- start start 2024-09-18T01:25:30.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.144+0000 7f19dce40800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40ead4b0 0x55ae40fa4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.144+0000 7f19dce40800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae40eb4520 con 0x55ae40ead4b0 2024-09-18T01:25:30.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.144+0000 7f19da934640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40ead4b0 0x55ae40fa4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.144+0000 7f19da934640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40ead4b0 0x55ae40fa4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37850/0 (socket says 172.21.15.100:37850) 2024-09-18T01:25:30.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.144+0000 7f19da934640 1 -- 172.21.15.100:0/1892330891 learned_addr learned my addr 172.21.15.100:0/1892330891 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.144+0000 7f19da934640 1 -- 172.21.15.100:0/1892330891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae40d5bfe0 con 0x55ae40ead4b0 2024-09-18T01:25:30.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.144+0000 7f19da934640 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40ead4b0 0x55ae40fa4120 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f19cc001e10 tx=0x7f19cc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.144+0000 7f18c7606640 1 -- 172.21.15.100:0/1892330891 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19cc012030 con 0x55ae40ead4b0 2024-09-18T01:25:30.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.144+0000 7f18c7606640 1 -- 172.21.15.100:0/1892330891 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19cc01a7a0 con 0x55ae40ead4b0 2024-09-18T01:25:30.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.144+0000 7f18c7606640 1 -- 172.21.15.100:0/1892330891 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19cc01aac0 con 0x55ae40ead4b0 2024-09-18T01:25:30.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.145+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae40fa4660 con 0x55ae40ead4b0 2024-09-18T01:25:30.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.145+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae40fa4b80 con 0x55ae40ead4b0 2024-09-18T01:25:30.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.145+0000 7f18c7606640 1 -- 172.21.15.100:0/1892330891 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f19cc015020 con 0x55ae40ead4b0 2024-09-18T01:25:30.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.145+0000 7f18c7606640 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18c0036b40 0x7f18c0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.146+0000 7f18c7606640 1 -- 172.21.15.100:0/1892330891 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f19cc020030 con 0x55ae40ead4b0 2024-09-18T01:25:30.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.146+0000 7f19d2133640 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18c0036b40 0x7f18c0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.146+0000 7f19dce40800 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae40eb18f0 0x55ae40fab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.146+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fab6d0 con 0x55ae40eb18f0 2024-09-18T01:25:30.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.146+0000 7f19db135640 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae40eb18f0 0x55ae40fab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.146+0000 7f19d2133640 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18c0036b40 0x7f18c0039000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f19c4057000 tx=0x7f19c4052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.146+0000 7f19db135640 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae40eb18f0 0x55ae40fab190 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.146+0000 7f19db135640 1 -- 172.21.15.100:0/1892330891 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40eb18f0 2024-09-18T01:25:30.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.146+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fa8760 con 0x55ae40eb18f0 2024-09-18T01:25:30.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.147+0000 7f19db135640 1 -- 172.21.15.100:0/1892330891 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40eb18f0 2024-09-18T01:25:30.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.147+0000 7f19dce40800 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae40fad9e0 0x55ae40fafdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.147+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fb0470 con 0x55ae40fad9e0 2024-09-18T01:25:30.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.147+0000 7f19da934640 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae40fad9e0 0x55ae40fafdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.147+0000 7f19da934640 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae40fad9e0 0x55ae40fafdd0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.147+0000 7f19da934640 1 -- 172.21.15.100:0/1892330891 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f19cc00dcd0 con 0x55ae40fad9e0 2024-09-18T01:25:30.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.147+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fac880 con 0x55ae40eb18f0 2024-09-18T01:25:30.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.148+0000 7f19db135640 1 -- 172.21.15.100:0/1892330891 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40eb18f0 2024-09-18T01:25:30.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.148+0000 7f19dce40800 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ae40fb18d0 0x55ae40fb3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.148+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fb43c0 con 0x55ae40fb18d0 2024-09-18T01:25:30.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.148+0000 7f19d2133640 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ae40fb18d0 0x55ae40fb3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.148+0000 7f19d2133640 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ae40fb18d0 0x55ae40fb3cc0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.149+0000 7f19d2133640 1 -- 172.21.15.100:0/1892330891 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fb18d0 2024-09-18T01:25:30.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.149+0000 7f19dce40800 1 Processor -- start 2024-09-18T01:25:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.149+0000 7f19dce40800 1 -- start start 2024-09-18T01:25:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.149+0000 7f19dce40800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40e21e50 0x55ae40fc5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.149+0000 7f19dce40800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae40d49580 con 0x55ae40e21e50 2024-09-18T01:25:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.149+0000 7f19da934640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40e21e50 0x55ae40fc5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.149+0000 7f19da934640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40e21e50 0x55ae40fc5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37856/0 (socket says 172.21.15.100:37856) 2024-09-18T01:25:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.149+0000 7f19da934640 1 -- 172.21.15.100:0/2874209424 learned_addr learned my addr 172.21.15.100:0/2874209424 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.150+0000 7f19da934640 1 -- 172.21.15.100:0/2874209424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae40fc6440 con 0x55ae40e21e50 2024-09-18T01:25:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.150+0000 7f19da934640 1 --2- 172.21.15.100:0/2874209424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40e21e50 0x55ae40fc5f00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f19cc001750 tx=0x7f19cc02c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.150+0000 7f18c4e01640 1 -- 172.21.15.100:0/2874209424 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19cc0490c0 con 0x55ae40e21e50 2024-09-18T01:25:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.150+0000 7f18c4e01640 1 -- 172.21.15.100:0/2874209424 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19cc049260 con 0x55ae40e21e50 2024-09-18T01:25:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.150+0000 7f19dce40800 1 -- 172.21.15.100:0/2874209424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae40fc6670 con 0x55ae40e21e50 2024-09-18T01:25:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.150+0000 7f18c4e01640 1 -- 172.21.15.100:0/2874209424 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19cc017c50 con 0x55ae40e21e50 2024-09-18T01:25:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.150+0000 7f19dce40800 1 -- 172.21.15.100:0/2874209424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae40fc6b70 con 0x55ae40e21e50 2024-09-18T01:25:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.150+0000 7f18c4e01640 1 -- 172.21.15.100:0/2874209424 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f19cc03c060 con 0x55ae40e21e50 2024-09-18T01:25:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.151+0000 7f18c4e01640 1 --2- 172.21.15.100:0/2874209424 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18b4036b90 0x7f18b4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.151+0000 7f18c4e01640 1 -- 172.21.15.100:0/2874209424 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f19cc036c70 con 0x55ae40e21e50 2024-09-18T01:25:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.151+0000 7f19d2133640 1 --2- 172.21.15.100:0/2874209424 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18b4036b90 0x7f18b4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.151+0000 7f19dce40800 1 Processor -- start 2024-09-18T01:25:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.151+0000 7f19dce40800 1 -- start start 2024-09-18T01:25:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.151+0000 7f19d2133640 1 --2- 172.21.15.100:0/2874209424 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18b4036b90 0x7f18b4039050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55ae40fa8680 tx=0x7f19c4005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.151+0000 7f19dce40800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40fc1f30 0x55ae40fc2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.151+0000 7f19dce40800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae40f9cef0 con 0x55ae40fc1f30 2024-09-18T01:25:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.151+0000 7f19da934640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40fc1f30 0x55ae40fc2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.151+0000 7f19da934640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40fc1f30 0x55ae40fc2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37862/0 (socket says 172.21.15.100:37862) 2024-09-18T01:25:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.151+0000 7f19da934640 1 -- 172.21.15.100:0/1691864311 learned_addr learned my addr 172.21.15.100:0/1691864311 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.151+0000 7f19da934640 1 -- 172.21.15.100:0/1691864311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae40fc2850 con 0x55ae40fc1f30 2024-09-18T01:25:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.152+0000 7f19da934640 1 --2- 172.21.15.100:0/1691864311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40fc1f30 0x55ae40fc2310 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f19cc018740 tx=0x7f19cc044520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d45011ba585c0e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.152+0000 7f18be7fc640 1 -- 172.21.15.100:0/1691864311 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19cc00d3d0 con 0x55ae40fc1f30 2024-09-18T01:25:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.152+0000 7f18be7fc640 1 -- 172.21.15.100:0/1691864311 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19cc051070 con 0x55ae40fc1f30 2024-09-18T01:25:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.152+0000 7f18be7fc640 1 -- 172.21.15.100:0/1691864311 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19cc049bb0 con 0x55ae40fc1f30 2024-09-18T01:25:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.152+0000 7f19dce40800 1 -- 172.21.15.100:0/1691864311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40fc1f30 msgr2=0x55ae40fc2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.152+0000 7f19dce40800 1 --2- 172.21.15.100:0/1691864311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40fc1f30 0x55ae40fc2310 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f19cc018740 tx=0x7f19cc044520 comp rx=0 tx=0).stop 2024-09-18T01:25:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.152+0000 7f19dce40800 1 -- 172.21.15.100:0/1691864311 shutdown_connections 2024-09-18T01:25:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.152+0000 7f19dce40800 1 --2- 172.21.15.100:0/1691864311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40fc1f30 0x55ae40fc2310 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.152+0000 7f19dce40800 1 -- 172.21.15.100:0/1691864311 >> 172.21.15.100:0/1691864311 conn(0x55ae40fcc0e0 msgr2=0x55ae40fca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.152+0000 7f19dce40800 1 -- 172.21.15.100:0/1691864311 shutdown_connections 2024-09-18T01:25:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.152+0000 7f19dce40800 1 -- 172.21.15.100:0/1691864311 wait complete. 2024-09-18T01:25:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.153+0000 7f19dce40800 1 Processor -- start 2024-09-18T01:25:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.153+0000 7f19dce40800 1 -- start start 2024-09-18T01:25:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.153+0000 7f19dce40800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40fc1f30 0x55ae40fd9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.153+0000 7f19dce40800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae40fc2e30 con 0x55ae40fc1f30 2024-09-18T01:25:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.153+0000 7f19da934640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40fc1f30 0x55ae40fd9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.153+0000 7f19da934640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40fc1f30 0x55ae40fd9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37868/0 (socket says 172.21.15.100:37868) 2024-09-18T01:25:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.153+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 learned_addr learned my addr 172.21.15.100:0/670492198 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.153+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae40fd9740 con 0x55ae40fc1f30 2024-09-18T01:25:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.153+0000 7f19da934640 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40fc1f30 0x55ae40fd9200 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f19cc036f00 tx=0x7f19cc03aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.154+0000 7f18bcff9640 1 -- 172.21.15.100:0/670492198 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19cc049bb0 con 0x55ae40fc1f30 2024-09-18T01:25:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.154+0000 7f18bcff9640 1 -- 172.21.15.100:0/670492198 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19cc069030 con 0x55ae40fc1f30 2024-09-18T01:25:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.154+0000 7f18bcff9640 1 -- 172.21.15.100:0/670492198 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19cc044990 con 0x55ae40fc1f30 2024-09-18T01:25:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.154+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae40fd9740 con 0x55ae40fc1f30 2024-09-18T01:25:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.154+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae40fd9740 con 0x55ae40fc1f30 2024-09-18T01:25:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.154+0000 7f18bcff9640 1 -- 172.21.15.100:0/670492198 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f19cc060040 con 0x55ae40fc1f30 2024-09-18T01:25:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.155+0000 7f18bcff9640 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18a4036b90 0x7f18a4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.155+0000 7f18bcff9640 1 -- 172.21.15.100:0/670492198 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f19cc06fc80 con 0x55ae40fc1f30 2024-09-18T01:25:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.155+0000 7f19d2133640 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18a4036b90 0x7f18a4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.155+0000 7f19dce40800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.155+0000 7f19dce40800 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae40fe48f0 0x55ae40fe6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.155+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe7500 con 0x55ae40fe48f0 2024-09-18T01:25:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.155+0000 7f19db135640 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae40fe48f0 0x55ae40fe6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.155+0000 7f19d2133640 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18a4036b90 0x7f18a4039050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f19c4053570 tx=0x7f19c4053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.155+0000 7f19db135640 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae40fe48f0 0x55ae40fe6db0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 20 realm 2024-09-18T01:25:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe7910 con 0x55ae40fe48f0 2024-09-18T01:25:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe81e0 con 0x55ae40fe48f0 2024-09-18T01:25:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fe48f0 2024-09-18T01:25:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae40fe9070 0x55ae40feb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40febbc0 con 0x55ae40fe9070 2024-09-18T01:25:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.156+0000 7f19da934640 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae40fe9070 0x55ae40feb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.157+0000 7f19da934640 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae40fe9070 0x55ae40feb460 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.157+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.157+0000 7f19dce40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.157+0000 7f19dce40800 20 searching for the correct realm 2024-09-18T01:25:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.157+0000 7f19dce40800 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ae40fedc70 0x55ae40ff0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.157+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff0800 con 0x55ae40fedc70 2024-09-18T01:25:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.157+0000 7f19d2133640 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ae40fedc70 0x55ae40ff0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.157+0000 7f19d2133640 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ae40fedc70 0x55ae40ff0130 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.158+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.158+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff0800 con 0x55ae40fe9070 2024-09-18T01:25:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.158+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.158+0000 7f19da934640 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f19cc03e070 0x7f19cc038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.158+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff0800 con 0x7f19cc03e070 2024-09-18T01:25:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.158+0000 7f19db135640 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f19cc03e070 0x7f19cc038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.158+0000 7f19db135640 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f19cc03e070 0x7f19cc038a50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.159+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.159+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fe48f0 2024-09-18T01:25:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.159+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.159+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fe48f0 2024-09-18T01:25:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.159+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.159+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x7f19cc03e070 2024-09-18T01:25:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.159+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.159+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x7f19cc03e070 2024-09-18T01:25:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.160+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.160+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fe9070 2024-09-18T01:25:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.160+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.160+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fedc70 2024-09-18T01:25:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.160+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.160+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fe48f0 2024-09-18T01:25:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.160+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.160+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x7f19cc03e070 2024-09-18T01:25:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.161+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.161+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fe48f0 2024-09-18T01:25:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.161+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.161+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fe9070 2024-09-18T01:25:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.161+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.161+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fedc70 2024-09-18T01:25:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.161+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.161+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fedc70 2024-09-18T01:25:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.162+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.162+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x7f19cc03e070 2024-09-18T01:25:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.162+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.162+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fedc70 2024-09-18T01:25:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.162+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.162+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fedc70 2024-09-18T01:25:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.162+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.162+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fe48f0 2024-09-18T01:25:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.162+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.162+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fe48f0 2024-09-18T01:25:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.163+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.163+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x7f19cc03e070 2024-09-18T01:25:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.163+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.163+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fedc70 2024-09-18T01:25:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.163+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.163+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fe9070 2024-09-18T01:25:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.163+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.163+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fe48f0 2024-09-18T01:25:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.164+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.164+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x7f19cc03e070 2024-09-18T01:25:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.164+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.164+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fedc70 2024-09-18T01:25:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.164+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.164+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x7f19cc03e070 2024-09-18T01:25:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.164+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.164+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fe9070 2024-09-18T01:25:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.165+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.165+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fedc70 2024-09-18T01:25:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.165+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.165+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x7f19cc03e070 2024-09-18T01:25:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.165+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.165+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fe48f0 2024-09-18T01:25:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fe8580 con 0x55ae40fe9070 2024-09-18T01:25:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19dce40800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19dce40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19dce40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19dce40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19dce40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19dce40800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19dce40800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fec570 con 0x55ae40fe48f0 2024-09-18T01:25:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19dce40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19dce40800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fec960 con 0x55ae40fe48f0 2024-09-18T01:25:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19dce40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19dce40800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.166+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fec960 con 0x7f19cc03e070 2024-09-18T01:25:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 20 zone default found 2024-09-18T01:25:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 4 Realm: () 2024-09-18T01:25:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 20 zonegroup default 2024-09-18T01:25:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fecd80 con 0x7f19cc03e070 2024-09-18T01:25:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fecd80 con 0x55ae40fedc70 2024-09-18T01:25:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff2660 con 0x55ae40fedc70 2024-09-18T01:25:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 20 started sync module instance, tier type = 2024-09-18T01:25:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.167+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff1b00 con 0x55ae40fe9070 2024-09-18T01:25:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.168+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.168+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206903131888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff2eb0 con 0x55ae40fe9070 2024-09-18T01:25:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.168+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff3700 con 0x55ae40fe48f0 2024-09-18T01:25:30.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.169+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94206903131888] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.169+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.169+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94206903136848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff3b20 con 0x55ae40fe48f0 2024-09-18T01:25:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.170+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff4370 con 0x55ae40fedc70 2024-09-18T01:25:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.171+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94206903136848] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.171+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.171+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94206903138384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff4710 con 0x55ae40fedc70 2024-09-18T01:25:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.171+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff5150 con 0x55ae40fe9070 2024-09-18T01:25:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.172+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.172+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94206903138384] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.172+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206903143456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fe9070 2024-09-18T01:25:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.172+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff62c0 con 0x55ae40fe48f0 2024-09-18T01:25:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.173+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.173+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206903147920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff6b60 con 0x55ae40fe48f0 2024-09-18T01:25:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.173+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff75e0 con 0x7f19cc03e070 2024-09-18T01:25:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.173+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94206903143456] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.174+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.174+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206903152848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff75a0 con 0x7f19cc03e070 2024-09-18T01:25:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.174+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff8020 con 0x7f19cc03e070 2024-09-18T01:25:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.174+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94206903147920] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.175+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.175+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94206903150256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff8020 con 0x7f19cc03e070 2024-09-18T01:25:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.175+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff8a20 con 0x7f19cc03e070 2024-09-18T01:25:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.175+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94206903152848] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.176+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94206903150256] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.176+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.176+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206903145792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff7b70 con 0x7f19cc03e070 2024-09-18T01:25:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.176+0000 7f19dce40800 20 add_watcher() i=0 2024-09-18T01:25:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.176+0000 7f19dce40800 20 add_watcher() i=1 2024-09-18T01:25:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.176+0000 7f19dce40800 20 add_watcher() i=2 2024-09-18T01:25:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.176+0000 7f19dce40800 20 add_watcher() i=3 2024-09-18T01:25:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.176+0000 7f19dce40800 20 add_watcher() i=4 2024-09-18T01:25:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.176+0000 7f19dce40800 20 add_watcher() i=5 2024-09-18T01:25:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.176+0000 7f19dce40800 20 add_watcher() i=6 2024-09-18T01:25:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.177+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94206903145792] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.177+0000 7f19dce40800 20 add_watcher() i=7 2024-09-18T01:25:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.177+0000 7f19dce40800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.177+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ffbb20 con 0x55ae40fe48f0 2024-09-18T01:25:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.177+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.177+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94206903158064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff8fa0 con 0x55ae40fe48f0 2024-09-18T01:25:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.178+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94206903158064] v33'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.178+0000 7f18917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.178+0000 7f19dce40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.178+0000 7f19dce40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.178+0000 7f19dce40800 5 note: GC not initialized 2024-09-18T01:25:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.178+0000 7f180bfff640 20 reqs_thread_entry: start 2024-09-18T01:25:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.178+0000 7f19dce40800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.178+0000 7f19dce40800 20 Filter name: none 2024-09-18T01:25:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.179+0000 7f1809ffb640 20 reqs_thread_entry: start 2024-09-18T01:25:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.179+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae4102e340 con 0x55ae40fedc70 2024-09-18T01:25:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.179+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(62 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.179+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae4102e340 con 0x55ae40fedc70 2024-09-18T01:25:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.179+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(63 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.179+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae4102e340 con 0x55ae40fe48f0 2024-09-18T01:25:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.179+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(64 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.179+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fec570 con 0x55ae40fe48f0 2024-09-18T01:25:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.180+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 [pgnls start_epoch 33 out=49b] v33'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.180+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fec570 con 0x55ae40fe9070 2024-09-18T01:25:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.180+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(66 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.180+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fedc70 2024-09-18T01:25:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.180+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(67 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.180+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fe48f0 2024-09-18T01:25:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.180+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.180+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fedc70 2024-09-18T01:25:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.180+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(69 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.180+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fe9070 2024-09-18T01:25:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.181+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(70 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.181+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fedc70 2024-09-18T01:25:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.181+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(71 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.181+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fe48f0 2024-09-18T01:25:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.181+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(72 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.181+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x7f19cc03e070 2024-09-18T01:25:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.182+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.182+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x7f19cc03e070 2024-09-18T01:25:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.182+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(74 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.182+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fedc70 2024-09-18T01:25:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.182+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(75 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.182+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x7f19cc03e070 2024-09-18T01:25:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.182+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(76 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.182+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x7f19cc03e070 2024-09-18T01:25:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.182+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(77 [pgnls start_epoch 33 out=127b] v33'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.182+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x7f19cc03e070 2024-09-18T01:25:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.183+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(78 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.183+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fedc70 2024-09-18T01:25:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.183+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(79 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.183+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fe9070 2024-09-18T01:25:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.183+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(80 [pgnls start_epoch 33 out=70b] v33'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.183+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fe48f0 2024-09-18T01:25:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.183+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(81 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.183+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fe48f0 2024-09-18T01:25:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.184+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(82 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.184+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fedc70 2024-09-18T01:25:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.184+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(83 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.184+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fe9070 2024-09-18T01:25:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.184+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(84 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.184+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x7f19cc03e070 2024-09-18T01:25:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.184+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(85 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.184+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fe48f0 2024-09-18T01:25:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.185+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(86 [pgnls start_epoch 33 out=49b] v33'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.185+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x7f19cc03e070 2024-09-18T01:25:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.185+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(87 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.185+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fedc70 2024-09-18T01:25:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.185+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(88 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.185+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fe9070 2024-09-18T01:25:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.185+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(89 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.185+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x7f19cc03e070 2024-09-18T01:25:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.186+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(90 [pgnls start_epoch 33 out=49b] v33'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.186+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fe48f0 2024-09-18T01:25:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.186+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(91 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.186+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fedc70 2024-09-18T01:25:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.186+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(92 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.186+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff59f0 con 0x55ae40fe9070 2024-09-18T01:25:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.186+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(93 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.186+0000 7f19dce40800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 2024-09-18T01:25:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.186+0000 7f19dce40800 20 RGWRados::pool_iterate: got myfoo 2024-09-18T01:25:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.187+0000 7f18917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.187+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94206903158064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40fec570 con 0x55ae40fe48f0 2024-09-18T01:25:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.188+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94206903158064] v33'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.188+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94206903131888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae4102c5e0 con 0x55ae40fe9070 2024-09-18T01:25:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.189+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94206903131888] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.189+0000 7f19dce40800 20 remove_watcher() i=0 2024-09-18T01:25:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.189+0000 7f19dce40800 2 removed watcher, disabling cache 2024-09-18T01:25:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.189+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94206903136848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae4102c5e0 con 0x55ae40fe48f0 2024-09-18T01:25:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.190+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94206903136848] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.190+0000 7f19dce40800 20 remove_watcher() i=1 2024-09-18T01:25:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.190+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94206903138384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae4102c5e0 con 0x55ae40fedc70 2024-09-18T01:25:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.191+0000 7f19d2133640 1 -- 172.21.15.100:0/670492198 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94206903138384] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c4051070 con 0x55ae40fedc70 2024-09-18T01:25:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.191+0000 7f19dce40800 20 remove_watcher() i=2 2024-09-18T01:25:30.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.191+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94206903143456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff1ef0 con 0x55ae40fe9070 2024-09-18T01:25:30.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.192+0000 7f19da934640 1 -- 172.21.15.100:0/670492198 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94206903143456] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc075070 con 0x55ae40fe9070 2024-09-18T01:25:30.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.192+0000 7f19dce40800 20 remove_watcher() i=3 2024-09-18T01:25:30.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.192+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94206903147920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff3250 con 0x55ae40fe48f0 2024-09-18T01:25:30.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.193+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94206903147920] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x55ae40fe48f0 2024-09-18T01:25:30.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.193+0000 7f19dce40800 20 remove_watcher() i=4 2024-09-18T01:25:30.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.193+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94206903152848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff3850 con 0x7f19cc03e070 2024-09-18T01:25:30.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.194+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94206903152848] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.194+0000 7f19dce40800 20 remove_watcher() i=5 2024-09-18T01:25:30.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.194+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94206903150256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff1ef0 con 0x7f19cc03e070 2024-09-18T01:25:30.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.195+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94206903150256] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.195+0000 7f19dce40800 20 remove_watcher() i=6 2024-09-18T01:25:30.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.195+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94206903145792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ae40ff5d90 con 0x7f19cc03e070 2024-09-18T01:25:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94206903145792] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d400a4a0 con 0x7f19cc03e070 2024-09-18T01:25:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 20 remove_watcher() i=7 2024-09-18T01:25:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f19cc03e070 msgr2=0x7f19cc038a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f19cc03e070 0x7f19cc038a50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae40fe48f0 msgr2=0x55ae40fe6db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae40fe48f0 0x55ae40fe6db0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae40fe9070 msgr2=0x55ae40feb460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae40fe9070 0x55ae40feb460 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ae40fedc70 msgr2=0x55ae40ff0130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ae40fedc70 0x55ae40ff0130 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18a4036b90 msgr2=0x7f18a4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18a4036b90 0x7f18a4039050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f19c4053570 tx=0x7f19c4053000 comp rx=0 tx=0).stop 2024-09-18T01:25:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40fc1f30 msgr2=0x55ae40fd9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19db135640 1 -- 172.21.15.100:0/670492198 reap_dead start 2024-09-18T01:25:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40fc1f30 0x55ae40fd9200 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f19cc036f00 tx=0x7f19cc03aec0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 shutdown_connections 2024-09-18T01:25:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 --2- 172.21.15.100:0/670492198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40fc1f30 0x55ae40fd9200 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 >> 172.21.15.100:0/670492198 conn(0x55ae40fcc0e0 msgr2=0x55ae40fca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 shutdown_connections 2024-09-18T01:25:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.196+0000 7f19dce40800 1 -- 172.21.15.100:0/670492198 wait complete. 2024-09-18T01:25:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/2874209424 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18b4036b90 msgr2=0x7f18b4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 --2- 172.21.15.100:0/2874209424 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18b4036b90 0x7f18b4039050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55ae40fa8680 tx=0x7f19c4005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/2874209424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40e21e50 msgr2=0x55ae40fc5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 --2- 172.21.15.100:0/2874209424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40e21e50 0x55ae40fc5f00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f19cc001750 tx=0x7f19cc02c4e0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/2874209424 shutdown_connections 2024-09-18T01:25:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 --2- 172.21.15.100:0/2874209424 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18b4036b90 0x7f18b4039050 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 --2- 172.21.15.100:0/2874209424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40e21e50 0x55ae40fc5f00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/2874209424 >> 172.21.15.100:0/2874209424 conn(0x55ae40fb7100 msgr2=0x55ae40fb9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/2874209424 shutdown_connections 2024-09-18T01:25:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/2874209424 wait complete. 2024-09-18T01:25:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ae40fb18d0 msgr2=0x55ae40fb3cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ae40fb18d0 0x55ae40fb3cc0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae40eb18f0 msgr2=0x55ae40fab190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae40eb18f0 0x55ae40fab190 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae40fad9e0 msgr2=0x55ae40fafdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae40fad9e0 0x55ae40fafdd0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18c0036b40 msgr2=0x7f18c0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f18c0036b40 0x7f18c0039000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f19c4057000 tx=0x7f19c4052000 comp rx=0 tx=0).stop 2024-09-18T01:25:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40ead4b0 msgr2=0x55ae40fa4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 --2- 172.21.15.100:0/1892330891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae40ead4b0 0x55ae40fa4120 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f19cc001e10 tx=0x7f19cc000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19db135640 1 -- 172.21.15.100:0/1892330891 reap_dead start 2024-09-18T01:25:30.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 shutdown_connections 2024-09-18T01:25:30.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 >> 172.21.15.100:0/1892330891 conn(0x55ae40ea8de0 msgr2=0x55ae40f969f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 shutdown_connections 2024-09-18T01:25:30.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.197+0000 7f19dce40800 1 -- 172.21.15.100:0/1892330891 wait complete. 2024-09-18T01:25:30.216 INFO:teuthology.orchestra.run.smithi100.stdout:["myfoo"] 2024-09-18T01:25:30.216 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-18T01:25:30.226 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:30.237 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:30.248 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:30.293 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-18T01:25:30.319 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:30.344 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:30.370 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:30.370 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T01:25:30.371 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T01:25:30.371 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-18T01:25:30.415 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:30.415 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:30.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.415+0000 7f70e4daf800 1 Processor -- start 2024-09-18T01:25:30.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.415+0000 7f70e4daf800 1 -- start start 2024-09-18T01:25:30.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.415+0000 7f70e4daf800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558ff2b6d900 0x558ff2b6fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.415+0000 7f70e4daf800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558ff2a29b30 con 0x558ff2b694c0 2024-09-18T01:25:30.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.415+0000 7f70e4daf800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x558ff2a0b360 con 0x558ff2b6d900 2024-09-18T01:25:30.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.415+0000 7f70e20a2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558ff2b6d900 0x558ff2b6fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.415+0000 7f70e20a2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558ff2b6d900 0x558ff2b6fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37872/0 (socket says 172.21.15.100:37872) 2024-09-18T01:25:30.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.415+0000 7f70e28a3640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x558ff2b694c0 0x558ff2b698c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37280/0 (socket says 172.21.15.100:37280) 2024-09-18T01:25:30.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.415+0000 7f70e20a2640 1 -- 172.21.15.100:0/1618432308 learned_addr learned my addr 172.21.15.100:0/1618432308 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.415+0000 7f70e20a2640 1 -- 172.21.15.100:0/1618432308 >> v1:172.21.15.92:6789/0 conn(0x558ff2b694c0 legacy=0x558ff2b698c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.416+0000 7f70e20a2640 1 -- 172.21.15.100:0/1618432308 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff2a31e00 con 0x558ff2b6d900 2024-09-18T01:25:30.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.417+0000 7f70e20a2640 1 --2- 172.21.15.100:0/1618432308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b6d900 0x558ff2b6fcf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f70d800a6b0 tx=0x7f70d8047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7155ed8dbd159b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.417+0000 7f70e18a1640 1 -- 172.21.15.100:0/1618432308 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d800a200 con 0x558ff2b6d900 2024-09-18T01:25:30.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.417+0000 7f70e18a1640 1 -- 172.21.15.100:0/1618432308 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d800a3a0 con 0x558ff2b6d900 2024-09-18T01:25:30.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.417+0000 7f70e18a1640 1 -- 172.21.15.100:0/1618432308 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d8008700 con 0x558ff2b6d900 2024-09-18T01:25:30.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.418+0000 7f70e4daf800 1 -- 172.21.15.100:0/1618432308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b6d900 msgr2=0x558ff2b6fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.418+0000 7f70e4daf800 1 --2- 172.21.15.100:0/1618432308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b6d900 0x558ff2b6fcf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f70d800a6b0 tx=0x7f70d8047e30 comp rx=0 tx=0).stop 2024-09-18T01:25:30.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.418+0000 7f70e4daf800 1 -- 172.21.15.100:0/1618432308 shutdown_connections 2024-09-18T01:25:30.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.418+0000 7f70e4daf800 1 --2- 172.21.15.100:0/1618432308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b6d900 0x558ff2b6fcf0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.418+0000 7f70e4daf800 1 -- 172.21.15.100:0/1618432308 >> 172.21.15.100:0/1618432308 conn(0x558ff2b64df0 msgr2=0x558ff2b67210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.418+0000 7f70e4daf800 1 -- 172.21.15.100:0/1618432308 shutdown_connections 2024-09-18T01:25:30.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.418+0000 7f70e4daf800 1 -- 172.21.15.100:0/1618432308 wait complete. 2024-09-18T01:25:30.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.431+0000 7f70e4daf800 1 Processor -- start 2024-09-18T01:25:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.431+0000 7f70e4daf800 1 -- start start 2024-09-18T01:25:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.432+0000 7f70e4daf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b694c0 0x558ff2c5b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.432+0000 7f70e4daf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558ff2ab6330 con 0x558ff2b694c0 2024-09-18T01:25:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.432+0000 7f70e28a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b694c0 0x558ff2c5b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.432+0000 7f70e28a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b694c0 0x558ff2c5b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37886/0 (socket says 172.21.15.100:37886) 2024-09-18T01:25:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.432+0000 7f70e28a3640 1 -- 172.21.15.100:0/55792943 learned_addr learned my addr 172.21.15.100:0/55792943 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.432+0000 7f70e28a3640 1 -- 172.21.15.100:0/55792943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff2a03bc0 con 0x558ff2b694c0 2024-09-18T01:25:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.432+0000 7f70e28a3640 1 --2- 172.21.15.100:0/55792943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b694c0 0x558ff2c5b9f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f70d4001e40 tx=0x7f70d4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6647b0744006d3b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.432+0000 7f6fd0e09640 1 -- 172.21.15.100:0/55792943 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d400e5c0 con 0x558ff2b694c0 2024-09-18T01:25:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.433+0000 7f6fd0e09640 1 -- 172.21.15.100:0/55792943 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d4006070 con 0x558ff2b694c0 2024-09-18T01:25:30.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.433+0000 7f6fd0e09640 1 -- 172.21.15.100:0/55792943 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d400e910 con 0x558ff2b694c0 2024-09-18T01:25:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.433+0000 7f70e4daf800 1 -- 172.21.15.100:0/55792943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b694c0 msgr2=0x558ff2c5b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.433+0000 7f70e4daf800 1 --2- 172.21.15.100:0/55792943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b694c0 0x558ff2c5b9f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f70d4001e40 tx=0x7f70d4001e70 comp rx=0 tx=0).stop 2024-09-18T01:25:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.433+0000 7f70e4daf800 1 -- 172.21.15.100:0/55792943 shutdown_connections 2024-09-18T01:25:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.433+0000 7f70e4daf800 1 --2- 172.21.15.100:0/55792943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b694c0 0x558ff2c5b9f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.433+0000 7f70e4daf800 1 -- 172.21.15.100:0/55792943 >> 172.21.15.100:0/55792943 conn(0x558ff2b64df0 msgr2=0x558ff2c52fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.433+0000 7f70e4daf800 1 -- 172.21.15.100:0/55792943 shutdown_connections 2024-09-18T01:25:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.433+0000 7f70e4daf800 1 -- 172.21.15.100:0/55792943 wait complete. 2024-09-18T01:25:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.434+0000 7f70e4daf800 1 Processor -- start 2024-09-18T01:25:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.434+0000 7f70e4daf800 1 -- start start 2024-09-18T01:25:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.434+0000 7f70e4daf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b6d900 0x558ff2c63620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.434+0000 7f70e4daf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558ff2b704d0 con 0x558ff2b6d900 2024-09-18T01:25:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.434+0000 7f70e28a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b6d900 0x558ff2c63620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.434+0000 7f70e28a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b6d900 0x558ff2c63620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37896/0 (socket says 172.21.15.100:37896) 2024-09-18T01:25:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.434+0000 7f70e28a3640 1 -- 172.21.15.100:0/3970385743 learned_addr learned my addr 172.21.15.100:0/3970385743 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.434+0000 7f70e28a3640 1 -- 172.21.15.100:0/3970385743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff2a17fe0 con 0x558ff2b6d900 2024-09-18T01:25:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.434+0000 7f70e28a3640 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b6d900 0x558ff2c63620 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f70d4000f60 tx=0x7f70d4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.435+0000 7f6fcf606640 1 -- 172.21.15.100:0/3970385743 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d401a7c0 con 0x558ff2b6d900 2024-09-18T01:25:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.435+0000 7f6fcf606640 1 -- 172.21.15.100:0/3970385743 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d401a960 con 0x558ff2b6d900 2024-09-18T01:25:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.435+0000 7f6fcf606640 1 -- 172.21.15.100:0/3970385743 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d401acc0 con 0x558ff2b6d900 2024-09-18T01:25:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.435+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ff2c63b60 con 0x558ff2b6d900 2024-09-18T01:25:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.435+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ff2c64080 con 0x558ff2b6d900 2024-09-18T01:25:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.435+0000 7f6fcf606640 1 -- 172.21.15.100:0/3970385743 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f70d4017070 con 0x558ff2b6d900 2024-09-18T01:25:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.436+0000 7f6fcf606640 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fc8036b40 0x7f6fc8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.436+0000 7f6fcf606640 1 -- 172.21.15.100:0/3970385743 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f70d4015020 con 0x558ff2b6d900 2024-09-18T01:25:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.436+0000 7f70e20a2640 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fc8036b40 0x7f6fc8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.436+0000 7f70e4daf800 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558ff2c68680 0x558ff2c6aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.436+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2c6b040 con 0x558ff2c68680 2024-09-18T01:25:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.436+0000 7f70e30a4640 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558ff2c68680 0x558ff2c6aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.436+0000 7f70e20a2640 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fc8036b40 0x7f6fc8039000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f70d8058000 tx=0x7f70d8053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.436+0000 7f70e30a4640 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558ff2c68680 0x558ff2c6aa70 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.436+0000 7f70e30a4640 1 -- 172.21.15.100:0/3970385743 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2c68680 2024-09-18T01:25:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.437+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2c67c60 con 0x558ff2c68680 2024-09-18T01:25:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.437+0000 7f70e30a4640 1 -- 172.21.15.100:0/3970385743 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2c68680 2024-09-18T01:25:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.437+0000 7f70e4daf800 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558ff2c6d350 0x558ff2c6f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.437+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2c6fde0 con 0x558ff2c6d350 2024-09-18T01:25:30.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.437+0000 7f70e28a3640 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558ff2c6d350 0x558ff2c6f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.437+0000 7f70e28a3640 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558ff2c6d350 0x558ff2c6f740 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.437+0000 7f70e28a3640 1 -- 172.21.15.100:0/3970385743 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2c6d350 2024-09-18T01:25:30.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.438+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2c6c1f0 con 0x558ff2c68680 2024-09-18T01:25:30.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.438+0000 7f70e30a4640 1 -- 172.21.15.100:0/3970385743 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2c68680 2024-09-18T01:25:30.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.438+0000 7f70e4daf800 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558ff2c71240 0x558ff2c73630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.438+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2c73d30 con 0x558ff2c71240 2024-09-18T01:25:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.438+0000 7f70e20a2640 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558ff2c71240 0x558ff2c73630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.438+0000 7f70e20a2640 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558ff2c71240 0x558ff2c73630 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.439+0000 7f70e20a2640 1 -- 172.21.15.100:0/3970385743 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2c71240 2024-09-18T01:25:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.439+0000 7f70e4daf800 1 Processor -- start 2024-09-18T01:25:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.439+0000 7f70e4daf800 1 -- start start 2024-09-18T01:25:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.439+0000 7f70e4daf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c81ae0 0x558ff2c81f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.439+0000 7f70e4daf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558ff2a05580 con 0x558ff2c81ae0 2024-09-18T01:25:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.439+0000 7f70e28a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c81ae0 0x558ff2c81f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.439+0000 7f70e28a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c81ae0 0x558ff2c81f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37908/0 (socket says 172.21.15.100:37908) 2024-09-18T01:25:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.439+0000 7f70e28a3640 1 -- 172.21.15.100:0/1193270989 learned_addr learned my addr 172.21.15.100:0/1193270989 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.440+0000 7f70e28a3640 1 -- 172.21.15.100:0/1193270989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff2c82440 con 0x558ff2c81ae0 2024-09-18T01:25:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.440+0000 7f70e28a3640 1 --2- 172.21.15.100:0/1193270989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c81ae0 0x558ff2c81f00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f70d4017930 tx=0x7f70d401b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.440+0000 7f6fcce01640 1 -- 172.21.15.100:0/1193270989 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d404a200 con 0x558ff2c81ae0 2024-09-18T01:25:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.440+0000 7f6fcce01640 1 -- 172.21.15.100:0/1193270989 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d404ba70 con 0x558ff2c81ae0 2024-09-18T01:25:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.440+0000 7f70e4daf800 1 -- 172.21.15.100:0/1193270989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ff2c826d0 con 0x558ff2c81ae0 2024-09-18T01:25:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.440+0000 7f6fcce01640 1 -- 172.21.15.100:0/1193270989 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d404bd70 con 0x558ff2c81ae0 2024-09-18T01:25:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.440+0000 7f70e4daf800 1 -- 172.21.15.100:0/1193270989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ff2c853b0 con 0x558ff2c81ae0 2024-09-18T01:25:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.441+0000 7f6fcce01640 1 -- 172.21.15.100:0/1193270989 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f70d401d450 con 0x558ff2c81ae0 2024-09-18T01:25:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.441+0000 7f6fcce01640 1 --2- 172.21.15.100:0/1193270989 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fbc036b90 0x7f6fbc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.441+0000 7f6fcce01640 1 -- 172.21.15.100:0/1193270989 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f70d404ecb0 con 0x558ff2c81ae0 2024-09-18T01:25:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.441+0000 7f70e20a2640 1 --2- 172.21.15.100:0/1193270989 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fbc036b90 0x7f6fbc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.441+0000 7f70e4daf800 1 Processor -- start 2024-09-18T01:25:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.441+0000 7f70e4daf800 1 -- start start 2024-09-18T01:25:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.441+0000 7f70e20a2640 1 --2- 172.21.15.100:0/1193270989 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fbc036b90 0x7f6fbc039050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x558ff2c67b80 tx=0x7f70d8005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.441+0000 7f70e4daf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c8e580 0x558ff2c8e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.441+0000 7f70e4daf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558ff2c5c1a0 con 0x558ff2c8e580 2024-09-18T01:25:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.442+0000 7f70e28a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c8e580 0x558ff2c8e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.442+0000 7f70e28a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c8e580 0x558ff2c8e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37918/0 (socket says 172.21.15.100:37918) 2024-09-18T01:25:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.442+0000 7f70e28a3640 1 -- 172.21.15.100:0/3359193362 learned_addr learned my addr 172.21.15.100:0/3359193362 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.442+0000 7f70e28a3640 1 -- 172.21.15.100:0/3359193362 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff2c8ef50 con 0x558ff2c8e580 2024-09-18T01:25:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.442+0000 7f70e28a3640 1 --2- 172.21.15.100:0/3359193362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c8e580 0x558ff2c8e980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f70d404b980 tx=0x7f70d4031a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f569ab5603607f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.442+0000 7f6fc67fc640 1 -- 172.21.15.100:0/3359193362 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d4031450 con 0x558ff2c8e580 2024-09-18T01:25:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.442+0000 7f6fc67fc640 1 -- 172.21.15.100:0/3359193362 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d405e070 con 0x558ff2c8e580 2024-09-18T01:25:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.442+0000 7f6fc67fc640 1 -- 172.21.15.100:0/3359193362 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d401f0e0 con 0x558ff2c8e580 2024-09-18T01:25:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e4daf800 1 -- 172.21.15.100:0/3359193362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c8e580 msgr2=0x558ff2c8e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e4daf800 1 --2- 172.21.15.100:0/3359193362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c8e580 0x558ff2c8e980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f70d404b980 tx=0x7f70d4031a40 comp rx=0 tx=0).stop 2024-09-18T01:25:30.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e4daf800 1 -- 172.21.15.100:0/3359193362 shutdown_connections 2024-09-18T01:25:30.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e4daf800 1 --2- 172.21.15.100:0/3359193362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c8e580 0x558ff2c8e980 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e4daf800 1 -- 172.21.15.100:0/3359193362 >> 172.21.15.100:0/3359193362 conn(0x558ff2c8a930 msgr2=0x558ff2c88a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e4daf800 1 -- 172.21.15.100:0/3359193362 shutdown_connections 2024-09-18T01:25:30.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e4daf800 1 -- 172.21.15.100:0/3359193362 wait complete. 2024-09-18T01:25:30.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e4daf800 1 Processor -- start 2024-09-18T01:25:30.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e4daf800 1 -- start start 2024-09-18T01:25:30.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e4daf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c8e580 0x558ff2c95880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e4daf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558ff2c8f3a0 con 0x558ff2c8e580 2024-09-18T01:25:30.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e28a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c8e580 0x558ff2c95880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e28a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c8e580 0x558ff2c95880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37934/0 (socket says 172.21.15.100:37934) 2024-09-18T01:25:30.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 learned_addr learned my addr 172.21.15.100:0/2883234997 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.443+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff2c95dc0 con 0x558ff2c8e580 2024-09-18T01:25:30.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.444+0000 7f70e28a3640 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c8e580 0x558ff2c95880 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f70d4031a80 tx=0x7f70d401ffa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.444+0000 7f6fc4ff9640 1 -- 172.21.15.100:0/2883234997 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d40441a0 con 0x558ff2c8e580 2024-09-18T01:25:30.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.444+0000 7f6fc4ff9640 1 -- 172.21.15.100:0/2883234997 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d4069070 con 0x558ff2c8e580 2024-09-18T01:25:30.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.444+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ff2c95dc0 con 0x558ff2c8e580 2024-09-18T01:25:30.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.444+0000 7f6fc4ff9640 1 -- 172.21.15.100:0/2883234997 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d4031450 con 0x558ff2c8e580 2024-09-18T01:25:30.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.444+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ff2c95dc0 con 0x558ff2c8e580 2024-09-18T01:25:30.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.445+0000 7f6fc4ff9640 1 -- 172.21.15.100:0/2883234997 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f70d4057040 con 0x558ff2c8e580 2024-09-18T01:25:30.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.445+0000 7f6fc4ff9640 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fac036af0 0x7f6fac038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.445+0000 7f6fc4ff9640 1 -- 172.21.15.100:0/2883234997 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f70d4054040 con 0x558ff2c8e580 2024-09-18T01:25:30.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.445+0000 7f70e20a2640 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fac036af0 0x7f6fac038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.445+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.445+0000 7f70e4daf800 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558ff2ca0e50 0x558ff2ca3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.445+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca3a60 con 0x558ff2ca0e50 2024-09-18T01:25:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.445+0000 7f70e30a4640 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558ff2ca0e50 0x558ff2ca3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.445+0000 7f70e20a2640 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fac036af0 0x7f6fac038fb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x558ff2c74130 tx=0x7f70d800a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e30a4640 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558ff2ca0e50 0x558ff2ca3310 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e4daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e4daf800 20 realm 2024-09-18T01:25:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca3e70 con 0x558ff2ca0e50 2024-09-18T01:25:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e4daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e4daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4740 con 0x558ff2ca0e50 2024-09-18T01:25:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e4daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2ca0e50 2024-09-18T01:25:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.446+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.447+0000 7f70e4daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.447+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.447+0000 7f70e4daf800 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558ff2ca55d0 0x558ff2ca79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.447+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca8120 con 0x558ff2ca55d0 2024-09-18T01:25:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.447+0000 7f70e28a3640 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558ff2ca55d0 0x558ff2ca79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.447+0000 7f70e28a3640 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558ff2ca55d0 0x558ff2ca79c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.447+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.447+0000 7f70e4daf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.447+0000 7f70e4daf800 20 searching for the correct realm 2024-09-18T01:25:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.447+0000 7f70e4daf800 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558ff2caa1d0 0x558ff2cac690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.447+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cacd60 con 0x558ff2caa1d0 2024-09-18T01:25:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.447+0000 7f70e20a2640 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558ff2caa1d0 0x558ff2cac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.448+0000 7f70e20a2640 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558ff2caa1d0 0x558ff2cac690 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.448+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.448+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cacd60 con 0x558ff2ca55d0 2024-09-18T01:25:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.448+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.448+0000 7f70e28a3640 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f70d4065040 0x7f70d4051910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.448+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cacd60 con 0x7f70d4065040 2024-09-18T01:25:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.449+0000 7f70e30a4640 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f70d4065040 0x7f70d4051910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.449+0000 7f70e30a4640 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f70d4065040 0x7f70d4051910 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.449+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.449+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2ca0e50 2024-09-18T01:25:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.449+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.449+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2ca0e50 2024-09-18T01:25:30.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.450+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.450+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x7f70d4065040 2024-09-18T01:25:30.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.450+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.450+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x7f70d4065040 2024-09-18T01:25:30.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.450+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.450+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2ca55d0 2024-09-18T01:25:30.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.450+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.450+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2caa1d0 2024-09-18T01:25:30.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.451+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.451+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2ca0e50 2024-09-18T01:25:30.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.451+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.451+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x7f70d4065040 2024-09-18T01:25:30.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.451+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.451+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2ca0e50 2024-09-18T01:25:30.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.451+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.451+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2ca55d0 2024-09-18T01:25:30.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.452+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.452+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2caa1d0 2024-09-18T01:25:30.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.452+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.452+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2caa1d0 2024-09-18T01:25:30.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.452+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.452+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x7f70d4065040 2024-09-18T01:25:30.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.452+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.452+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2caa1d0 2024-09-18T01:25:30.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.453+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.453+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2caa1d0 2024-09-18T01:25:30.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.453+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.453+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2ca0e50 2024-09-18T01:25:30.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.453+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.453+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2ca0e50 2024-09-18T01:25:30.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.453+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.453+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x7f70d4065040 2024-09-18T01:25:30.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.453+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.453+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2caa1d0 2024-09-18T01:25:30.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.454+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.454+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2ca55d0 2024-09-18T01:25:30.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.454+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.454+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2ca0e50 2024-09-18T01:25:30.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.454+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.454+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x7f70d4065040 2024-09-18T01:25:30.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.454+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.454+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2caa1d0 2024-09-18T01:25:30.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.455+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.455+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x7f70d4065040 2024-09-18T01:25:30.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.455+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.455+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2ca55d0 2024-09-18T01:25:30.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.455+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.455+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2caa1d0 2024-09-18T01:25:30.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.455+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.455+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x7f70d4065040 2024-09-18T01:25:30.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2ca0e50 2024-09-18T01:25:30.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca4ae0 con 0x558ff2ca55d0 2024-09-18T01:25:30.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e4daf800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:30.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e4daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:30.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e4daf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:30.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e4daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:30.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e4daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e4daf800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca8ad0 con 0x558ff2ca0e50 2024-09-18T01:25:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e4daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.456+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca8ec0 con 0x558ff2ca0e50 2024-09-18T01:25:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca8ec0 con 0x7f70d4065040 2024-09-18T01:25:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 20 zone default found 2024-09-18T01:25:30.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 4 Realm: () 2024-09-18T01:25:30.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:30.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:30.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:30.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 20 zonegroup default 2024-09-18T01:25:30.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca92e0 con 0x7f70d4065040 2024-09-18T01:25:30.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.457+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ca92e0 con 0x558ff2caa1d0 2024-09-18T01:25:30.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.458+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.458+0000 7f70e4daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.458+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.458+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2caebc0 con 0x558ff2caa1d0 2024-09-18T01:25:30.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.458+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.458+0000 7f70e4daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.458+0000 7f70e4daf800 20 started sync module instance, tier type = 2024-09-18T01:25:30.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.458+0000 7f70e4daf800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:30.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.458+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cae060 con 0x558ff2ca55d0 2024-09-18T01:25:30.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.459+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.459+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94076742067328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cadcc0 con 0x558ff2ca55d0 2024-09-18T01:25:30.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.459+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cafa30 con 0x558ff2ca0e50 2024-09-18T01:25:30.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.460+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94076742067328] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.460+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.460+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94076742071680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2caf9a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.460+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cb08f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.462+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94076742071680] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.462+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.462+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94076742075456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cb0ce0 con 0x558ff2caa1d0 2024-09-18T01:25:30.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.462+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cb16e0 con 0x558ff2ca55d0 2024-09-18T01:25:30.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.463+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.463+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94076742078960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cb1f80 con 0x558ff2ca55d0 2024-09-18T01:25:30.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.463+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cb2a40 con 0x558ff2ca0e50 2024-09-18T01:25:30.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.463+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94076742075456] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.464+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.464+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94076742083856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cb2a00 con 0x558ff2ca0e50 2024-09-18T01:25:30.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.464+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cb34f0 con 0x7f70d4065040 2024-09-18T01:25:30.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.464+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94076742078960] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.465+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.465+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94076742086656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cb34f0 con 0x7f70d4065040 2024-09-18T01:25:30.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.465+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cb3f00 con 0x7f70d4065040 2024-09-18T01:25:30.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.465+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94076742083856] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.465+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94076742086656] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.466+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.466+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94076742081232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cb3a50 con 0x7f70d4065040 2024-09-18T01:25:30.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.466+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cb47a0 con 0x7f70d4065040 2024-09-18T01:25:30.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.467+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.467+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94076742091504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cb3a50 con 0x7f70d4065040 2024-09-18T01:25:30.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.467+0000 7f70e4daf800 20 add_watcher() i=0 2024-09-18T01:25:30.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.467+0000 7f70e4daf800 20 add_watcher() i=1 2024-09-18T01:25:30.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.467+0000 7f70e4daf800 20 add_watcher() i=2 2024-09-18T01:25:30.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.467+0000 7f70e4daf800 20 add_watcher() i=3 2024-09-18T01:25:30.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.467+0000 7f70e4daf800 20 add_watcher() i=4 2024-09-18T01:25:30.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.467+0000 7f70e4daf800 20 add_watcher() i=5 2024-09-18T01:25:30.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.467+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94076742081232] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.467+0000 7f70e4daf800 20 add_watcher() i=6 2024-09-18T01:25:30.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.468+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94076742091504] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.468+0000 7f70e4daf800 20 add_watcher() i=7 2024-09-18T01:25:30.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.468+0000 7f70e4daf800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:30.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.468+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cafe20 con 0x558ff2ca0e50 2024-09-18T01:25:30.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.468+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.468+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94076742092560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cafe20 con 0x558ff2ca0e50 2024-09-18T01:25:30.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.469+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94076742092560] v33'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.469+0000 7f6f997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:30.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.469+0000 7f70e4daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:30.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.469+0000 7f70e4daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:30.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.469+0000 7f70e4daf800 5 note: GC not initialized 2024-09-18T01:25:30.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.469+0000 7f6f13fff640 20 reqs_thread_entry: start 2024-09-18T01:25:30.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.469+0000 7f70e4daf800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:30.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.469+0000 7f70e4daf800 20 Filter name: none 2024-09-18T01:25:30.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.469+0000 7f6f11ffb640 20 reqs_thread_entry: start 2024-09-18T01:25:30.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.470+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.470+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ceab40 con 0x558ff2ca55d0 2024-09-18T01:25:30.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.471+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.471+0000 7f70e4daf800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:30.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.472+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.472+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ceb470 con 0x7f70d4065040 2024-09-18T01:25:30.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.472+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(63 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.472+0000 7f70e4daf800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:30.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.472+0000 7f70e4daf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:25:30.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.472+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ceb4b0 con 0x558ff2ca55d0 2024-09-18T01:25:30.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:30.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:65 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cecc20 con 0x7f70d4065040 2024-09-18T01:25:30.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(65 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:30.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:25:30.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 4.6 4:626e9aa1:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cec160 con 0x558ff2caa1d0 2024-09-18T01:25:30.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 4.32 4:4c543ff0:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cf1790 con 0x558ff2ca0e50 2024-09-18T01:25:30.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 4.16 4:68657b5e:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cf40a0 con 0x558ff2caa1d0 2024-09-18T01:25:30.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 4.27 4:e6db7ecc:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cf40a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 4.2d 4:b5379837:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cf92a0 con 0x7f70d4065040 2024-09-18T01:25:30.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 4.28 4:14044b5f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cfc090 con 0x558ff2ca0e50 2024-09-18T01:25:30.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 4.38 4:1e3fd869:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cfeb10 con 0x558ff2ca0e50 2024-09-18T01:25:30.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:73 4.35 4:ae848ed2:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2d019d0 con 0x558ff2ca0e50 2024-09-18T01:25:30.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 4.1 4:8077271a:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2d04840 con 0x558ff2ca55d0 2024-09-18T01:25:30.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.473+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 4.27 4:e7380930:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2cfc090 con 0x558ff2ca0e50 2024-09-18T01:25:30.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.474+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:76 4.2e 4:76537098:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ff2d019d0 con 0x558ff2caa1d0 2024-09-18T01:25:30.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.474+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(70 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.474+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.474+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(68 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.474+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(74 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.474+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(76 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.474+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(67 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.474+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(69 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.474+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(71 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.474+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(72 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.474+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(73 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.474+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(75 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.475+0000 7f6f997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:30.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.475+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94076742092560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ce8520 con 0x558ff2ca0e50 2024-09-18T01:25:30.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.476+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94076742092560] v33'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.476+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94076742067328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ce8520 con 0x558ff2ca55d0 2024-09-18T01:25:30.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.477+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94076742067328] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.477+0000 7f70e4daf800 20 remove_watcher() i=0 2024-09-18T01:25:30.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.477+0000 7f70e4daf800 2 removed watcher, disabling cache 2024-09-18T01:25:30.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.477+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94076742071680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ce8520 con 0x558ff2ca0e50 2024-09-18T01:25:30.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.478+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94076742071680] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.478+0000 7f70e4daf800 20 remove_watcher() i=1 2024-09-18T01:25:30.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.478+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94076742075456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ce8520 con 0x558ff2caa1d0 2024-09-18T01:25:30.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.479+0000 7f70e20a2640 1 -- 172.21.15.100:0/2883234997 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94076742075456] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d80088f0 con 0x558ff2caa1d0 2024-09-18T01:25:30.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.479+0000 7f70e4daf800 20 remove_watcher() i=2 2024-09-18T01:25:30.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.479+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94076742078960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ce8520 con 0x558ff2ca55d0 2024-09-18T01:25:30.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.480+0000 7f70e28a3640 1 -- 172.21.15.100:0/2883234997 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94076742078960] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d402e070 con 0x558ff2ca55d0 2024-09-18T01:25:30.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.480+0000 7f70e4daf800 20 remove_watcher() i=3 2024-09-18T01:25:30.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.480+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94076742083856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ce8520 con 0x558ff2ca0e50 2024-09-18T01:25:30.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.481+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94076742083856] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x558ff2ca0e50 2024-09-18T01:25:30.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.481+0000 7f70e4daf800 20 remove_watcher() i=4 2024-09-18T01:25:30.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.481+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94076742086656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ce8520 con 0x7f70d4065040 2024-09-18T01:25:30.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.483+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94076742086656] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.483+0000 7f70e4daf800 20 remove_watcher() i=5 2024-09-18T01:25:30.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.483+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94076742081232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ce8520 con 0x7f70d4065040 2024-09-18T01:25:30.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.484+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94076742081232] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.484+0000 7f70e4daf800 20 remove_watcher() i=6 2024-09-18T01:25:30.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.484+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94076742091504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ff2ce8520 con 0x7f70d4065040 2024-09-18T01:25:30.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94076742091504] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70dc00a4a0 con 0x7f70d4065040 2024-09-18T01:25:30.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e4daf800 20 remove_watcher() i=7 2024-09-18T01:25:30.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f70d4065040 msgr2=0x7f70d4051910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e4daf800 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f70d4065040 0x7f70d4051910 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558ff2ca0e50 msgr2=0x558ff2ca3310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e4daf800 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558ff2ca0e50 0x558ff2ca3310 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558ff2ca55d0 msgr2=0x558ff2ca79c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e4daf800 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558ff2ca55d0 0x558ff2ca79c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558ff2caa1d0 msgr2=0x558ff2cac690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e4daf800 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558ff2caa1d0 0x558ff2cac690 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fac036af0 msgr2=0x7f6fac038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e4daf800 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fac036af0 0x7f6fac038fb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x558ff2c74130 tx=0x7f70d800a000 comp rx=0 tx=0).stop 2024-09-18T01:25:30.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c8e580 msgr2=0x558ff2c95880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e4daf800 1 --2- 172.21.15.100:0/2883234997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c8e580 0x558ff2c95880 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f70d4031a80 tx=0x7f70d401ffa0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 reap_dead start 2024-09-18T01:25:30.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.485+0000 7f70e30a4640 1 -- 172.21.15.100:0/2883234997 reap_dead start 2024-09-18T01:25:30.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 shutdown_connections 2024-09-18T01:25:30.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 >> 172.21.15.100:0/2883234997 conn(0x558ff2c8a930 msgr2=0x558ff2c88a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 shutdown_connections 2024-09-18T01:25:30.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/2883234997 wait complete. 2024-09-18T01:25:30.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/1193270989 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fbc036b90 msgr2=0x7f6fbc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 --2- 172.21.15.100:0/1193270989 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fbc036b90 0x7f6fbc039050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x558ff2c67b80 tx=0x7f70d8005ac0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/1193270989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c81ae0 msgr2=0x558ff2c81f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 --2- 172.21.15.100:0/1193270989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c81ae0 0x558ff2c81f00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f70d4017930 tx=0x7f70d401b960 comp rx=0 tx=0).stop 2024-09-18T01:25:30.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/1193270989 shutdown_connections 2024-09-18T01:25:30.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 --2- 172.21.15.100:0/1193270989 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fbc036b90 0x7f6fbc039050 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 --2- 172.21.15.100:0/1193270989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2c81ae0 0x558ff2c81f00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/1193270989 >> 172.21.15.100:0/1193270989 conn(0x558ff2c76a70 msgr2=0x558ff2c795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/1193270989 shutdown_connections 2024-09-18T01:25:30.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/1193270989 wait complete. 2024-09-18T01:25:30.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558ff2c71240 msgr2=0x558ff2c73630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558ff2c71240 0x558ff2c73630 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558ff2c68680 msgr2=0x558ff2c6aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558ff2c68680 0x558ff2c6aa70 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558ff2c6d350 msgr2=0x558ff2c6f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558ff2c6d350 0x558ff2c6f740 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fc8036b40 msgr2=0x7f6fc8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f6fc8036b40 0x7f6fc8039000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f70d8058000 tx=0x7f70d8053000 comp rx=0 tx=0).stop 2024-09-18T01:25:30.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b6d900 msgr2=0x558ff2c63620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e4daf800 1 --2- 172.21.15.100:0/3970385743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff2b6d900 0x558ff2c63620 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f70d4000f60 tx=0x7f70d4000bc0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.486+0000 7f70e30a4640 1 -- 172.21.15.100:0/3970385743 reap_dead start 2024-09-18T01:25:30.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.487+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 shutdown_connections 2024-09-18T01:25:30.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.487+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 >> 172.21.15.100:0/3970385743 conn(0x558ff2b64df0 msgr2=0x558ff2c518d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.487+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 shutdown_connections 2024-09-18T01:25:30.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.487+0000 7f70e4daf800 1 -- 172.21.15.100:0/3970385743 wait complete. 2024-09-18T01:25:30.509 INFO:teuthology.orchestra.run.smithi100.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"2d75eca1-60da-4ca3-af9b-0b09072c949e","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"153b7754-209b-4898-8796-577da7c1273d.4237.1","marker":"153b7754-209b-4898-8796-577da7c1273d.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-18T01:25:29.865966Z","creation_time":"2024-09-18T01:25:29.863166Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-18T01:25:30.510 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2d75eca1-60da-4ca3-af9b-0b09072c949e', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '153b7754-209b-4898-8796-577da7c1273d.4237.1', 'marker': '153b7754-209b-4898-8796-577da7c1273d.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:25:29.865966Z', 'creation_time': '2024-09-18T01:25:29.863166Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T01:25:30.510 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-18T01:25:30.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-18T01:25:30.510 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-18T01:25:30.556 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:30.556 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:30.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.556+0000 7f0b78540800 1 Processor -- start 2024-09-18T01:25:30.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.556+0000 7f0b78540800 1 -- start start 2024-09-18T01:25:30.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.556+0000 7f0b78540800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5597ee1a5860 0x5597ee1a7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.556+0000 7f0b78540800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5597ee060b30 con 0x5597ee114e90 2024-09-18T01:25:30.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.556+0000 7f0b78540800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5597ee042360 con 0x5597ee1a5860 2024-09-18T01:25:30.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.557+0000 7f0b6bfff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5597ee1a5860 0x5597ee1a7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.557+0000 7f0b742ca640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5597ee114e90 0x5597ee1a4140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37288/0 (socket says 172.21.15.100:37288) 2024-09-18T01:25:30.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.557+0000 7f0b742ca640 1 -- 172.21.15.100:0/145098168 learned_addr learned my addr 172.21.15.100:0/145098168 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:30.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.557+0000 7f0b6bfff640 1 -- 172.21.15.100:0/145098168 >> v1:172.21.15.92:6789/0 conn(0x5597ee114e90 legacy=0x5597ee1a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.557+0000 7f0b6bfff640 1 -- 172.21.15.100:0/145098168 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597ee068e00 con 0x5597ee1a5860 2024-09-18T01:25:30.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.559+0000 7f0b6bfff640 1 --2- 172.21.15.100:0/145098168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee1a5860 0x5597ee1a7c70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00a470 tx=0x7f0b5c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6a476f37477914 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.559+0000 7f0b73ac9640 1 -- 172.21.15.100:0/145098168 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b5c053570 con 0x5597ee1a5860 2024-09-18T01:25:30.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.559+0000 7f0b73ac9640 1 -- 172.21.15.100:0/145098168 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b5c058070 con 0x5597ee1a5860 2024-09-18T01:25:30.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.559+0000 7f0b73ac9640 1 -- 172.21.15.100:0/145098168 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b5c053880 con 0x5597ee1a5860 2024-09-18T01:25:30.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.559+0000 7f0b78540800 1 -- 172.21.15.100:0/145098168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee1a5860 msgr2=0x5597ee1a7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.559+0000 7f0b78540800 1 --2- 172.21.15.100:0/145098168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee1a5860 0x5597ee1a7c70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00a470 tx=0x7f0b5c045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:30.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.559+0000 7f0b78540800 1 -- 172.21.15.100:0/145098168 shutdown_connections 2024-09-18T01:25:30.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.559+0000 7f0b78540800 1 --2- 172.21.15.100:0/145098168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee1a5860 0x5597ee1a7c70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.559+0000 7f0b78540800 1 -- 172.21.15.100:0/145098168 >> 172.21.15.100:0/145098168 conn(0x5597ee19bdf0 msgr2=0x5597ee19e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.559+0000 7f0b78540800 1 -- 172.21.15.100:0/145098168 shutdown_connections 2024-09-18T01:25:30.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.559+0000 7f0b78540800 1 -- 172.21.15.100:0/145098168 wait complete. 2024-09-18T01:25:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.573+0000 7f0b78540800 1 Processor -- start 2024-09-18T01:25:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.573+0000 7f0b78540800 1 -- start start 2024-09-18T01:25:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.573+0000 7f0b78540800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee114e90 0x5597ee1a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.573+0000 7f0b78540800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5597ee0ed330 con 0x5597ee114e90 2024-09-18T01:25:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.573+0000 7f0b742ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee114e90 0x5597ee1a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.573+0000 7f0b742ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee114e90 0x5597ee1a1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37950/0 (socket says 172.21.15.100:37950) 2024-09-18T01:25:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.573+0000 7f0b742ca640 1 -- 172.21.15.100:0/3061229012 learned_addr learned my addr 172.21.15.100:0/3061229012 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.573+0000 7f0b742ca640 1 -- 172.21.15.100:0/3061229012 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597ee03abc0 con 0x5597ee114e90 2024-09-18T01:25:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.574+0000 7f0b742ca640 1 --2- 172.21.15.100:0/3061229012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee114e90 0x5597ee1a1a70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0b64001d80 tx=0x7f0b64001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d16ea10829c439 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.574+0000 7f0a6260c640 1 -- 172.21.15.100:0/3061229012 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b64013030 con 0x5597ee114e90 2024-09-18T01:25:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.574+0000 7f0a6260c640 1 -- 172.21.15.100:0/3061229012 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b6400e470 con 0x5597ee114e90 2024-09-18T01:25:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.574+0000 7f0a6260c640 1 -- 172.21.15.100:0/3061229012 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b6400e810 con 0x5597ee114e90 2024-09-18T01:25:30.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.574+0000 7f0b78540800 1 -- 172.21.15.100:0/3061229012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee114e90 msgr2=0x5597ee1a1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.574+0000 7f0b78540800 1 --2- 172.21.15.100:0/3061229012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee114e90 0x5597ee1a1a70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0b64001d80 tx=0x7f0b64001e70 comp rx=0 tx=0).stop 2024-09-18T01:25:30.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.574+0000 7f0b78540800 1 -- 172.21.15.100:0/3061229012 shutdown_connections 2024-09-18T01:25:30.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.574+0000 7f0b78540800 1 --2- 172.21.15.100:0/3061229012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee114e90 0x5597ee1a1a70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.574+0000 7f0b78540800 1 -- 172.21.15.100:0/3061229012 >> 172.21.15.100:0/3061229012 conn(0x5597ee19bdf0 msgr2=0x5597ee28c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.574+0000 7f0b78540800 1 -- 172.21.15.100:0/3061229012 shutdown_connections 2024-09-18T01:25:30.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.574+0000 7f0b78540800 1 -- 172.21.15.100:0/3061229012 wait complete. 2024-09-18T01:25:30.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.575+0000 7f0b78540800 1 Processor -- start 2024-09-18T01:25:30.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.575+0000 7f0b78540800 1 -- start start 2024-09-18T01:25:30.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.575+0000 7f0b78540800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee114e90 0x5597ee29a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.575+0000 7f0b78540800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5597ee1a85f0 con 0x5597ee114e90 2024-09-18T01:25:30.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.575+0000 7f0b742ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee114e90 0x5597ee29a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.575+0000 7f0b742ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee114e90 0x5597ee29a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37954/0 (socket says 172.21.15.100:37954) 2024-09-18T01:25:30.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.575+0000 7f0b742ca640 1 -- 172.21.15.100:0/2037499445 learned_addr learned my addr 172.21.15.100:0/2037499445 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.575+0000 7f0b742ca640 1 -- 172.21.15.100:0/2037499445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597ee04efe0 con 0x5597ee114e90 2024-09-18T01:25:30.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.576+0000 7f0b742ca640 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee114e90 0x5597ee29a490 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0b64004000 tx=0x7f0b64000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.576+0000 7f0a60e09640 1 -- 172.21.15.100:0/2037499445 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b64027070 con 0x5597ee114e90 2024-09-18T01:25:30.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.576+0000 7f0a60e09640 1 -- 172.21.15.100:0/2037499445 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b64001400 con 0x5597ee114e90 2024-09-18T01:25:30.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.576+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597ee29a9d0 con 0x5597ee114e90 2024-09-18T01:25:30.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.576+0000 7f0a60e09640 1 -- 172.21.15.100:0/2037499445 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b64019a70 con 0x5597ee114e90 2024-09-18T01:25:30.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.576+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597ee29aef0 con 0x5597ee114e90 2024-09-18T01:25:30.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.576+0000 7f0a60e09640 1 -- 172.21.15.100:0/2037499445 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0b6402a070 con 0x5597ee114e90 2024-09-18T01:25:30.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.577+0000 7f0a60e09640 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a5c036b40 0x7f0a5c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.577+0000 7f0a60e09640 1 -- 172.21.15.100:0/2037499445 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0b6401f070 con 0x5597ee114e90 2024-09-18T01:25:30.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.577+0000 7f0b6bfff640 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a5c036b40 0x7f0a5c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.577+0000 7f0b78540800 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5597ee1a5860 0x5597ee2a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.577+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2a1ad0 con 0x5597ee1a5860 2024-09-18T01:25:30.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.577+0000 7f0b74acb640 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5597ee1a5860 0x5597ee2a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.577+0000 7f0b6bfff640 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a5c036b40 0x7f0a5c039000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c057000 tx=0x7f0b5c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.577+0000 7f0b74acb640 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5597ee1a5860 0x5597ee2a1500 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.578+0000 7f0b74acb640 1 -- 172.21.15.100:0/2037499445 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee1a5860 2024-09-18T01:25:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.578+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee29ead0 con 0x5597ee1a5860 2024-09-18T01:25:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.578+0000 7f0b74acb640 1 -- 172.21.15.100:0/2037499445 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee1a5860 2024-09-18T01:25:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.578+0000 7f0b78540800 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5597ee2a3de0 0x5597ee2a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.578+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2a6870 con 0x5597ee2a3de0 2024-09-18T01:25:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.578+0000 7f0b742ca640 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5597ee2a3de0 0x5597ee2a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.578+0000 7f0b742ca640 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5597ee2a3de0 0x5597ee2a61d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.579+0000 7f0b742ca640 1 -- 172.21.15.100:0/2037499445 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0b64029030 con 0x5597ee2a3de0 2024-09-18T01:25:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.579+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2a2c80 con 0x5597ee1a5860 2024-09-18T01:25:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.579+0000 7f0b74acb640 1 -- 172.21.15.100:0/2037499445 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee1a5860 2024-09-18T01:25:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.579+0000 7f0b78540800 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5597ee2a7cd0 0x5597ee2aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.579+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2aa7c0 con 0x5597ee2a7cd0 2024-09-18T01:25:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.579+0000 7f0b6bfff640 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5597ee2a7cd0 0x5597ee2aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.580+0000 7f0b6bfff640 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5597ee2a7cd0 0x5597ee2aa0c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.580+0000 7f0b6bfff640 1 -- 172.21.15.100:0/2037499445 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2a7cd0 2024-09-18T01:25:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.580+0000 7f0b78540800 1 Processor -- start 2024-09-18T01:25:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.580+0000 7f0b78540800 1 -- start start 2024-09-18T01:25:30.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.581+0000 7f0b78540800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2b8530 0x5597ee2b8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.581+0000 7f0b78540800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5597ee03c580 con 0x5597ee2b8530 2024-09-18T01:25:30.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.581+0000 7f0b742ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2b8530 0x5597ee2b8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.581+0000 7f0b742ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2b8530 0x5597ee2b8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37960/0 (socket says 172.21.15.100:37960) 2024-09-18T01:25:30.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.581+0000 7f0b742ca640 1 -- 172.21.15.100:0/70763619 learned_addr learned my addr 172.21.15.100:0/70763619 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.581+0000 7f0b742ca640 1 -- 172.21.15.100:0/70763619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597ee2b8e90 con 0x5597ee2b8530 2024-09-18T01:25:30.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.581+0000 7f0b742ca640 1 --2- 172.21.15.100:0/70763619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2b8530 0x5597ee2b8950 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0b6404ad80 tx=0x7f0b64044f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.581+0000 7f0a59ffb640 1 -- 172.21.15.100:0/70763619 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b64039070 con 0x5597ee2b8530 2024-09-18T01:25:30.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.581+0000 7f0a59ffb640 1 -- 172.21.15.100:0/70763619 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b6404c410 con 0x5597ee2b8530 2024-09-18T01:25:30.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.581+0000 7f0b78540800 1 -- 172.21.15.100:0/70763619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597ee2b9120 con 0x5597ee2b8530 2024-09-18T01:25:30.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.581+0000 7f0a59ffb640 1 -- 172.21.15.100:0/70763619 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b6404c6f0 con 0x5597ee2b8530 2024-09-18T01:25:30.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.581+0000 7f0b78540800 1 -- 172.21.15.100:0/70763619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597ee2bbe00 con 0x5597ee2b8530 2024-09-18T01:25:30.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.582+0000 7f0a59ffb640 1 -- 172.21.15.100:0/70763619 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0b6403c070 con 0x5597ee2b8530 2024-09-18T01:25:30.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.582+0000 7f0a59ffb640 1 --2- 172.21.15.100:0/70763619 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a4c036b40 0x7f0a4c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.582+0000 7f0a59ffb640 1 -- 172.21.15.100:0/70763619 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0b64014070 con 0x5597ee2b8530 2024-09-18T01:25:30.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.582+0000 7f0b6bfff640 1 --2- 172.21.15.100:0/70763619 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a4c036b40 0x7f0a4c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.582+0000 7f0b78540800 1 Processor -- start 2024-09-18T01:25:30.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.583+0000 7f0b78540800 1 -- start start 2024-09-18T01:25:30.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.583+0000 7f0b6bfff640 1 --2- 172.21.15.100:0/70763619 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a4c036b40 0x7f0a4c039000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5597ee29e9f0 tx=0x7f0b5c005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.583+0000 7f0b78540800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2c5050 0x5597ee2c5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.583+0000 7f0b78540800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5597ee1a0140 con 0x5597ee2c5050 2024-09-18T01:25:30.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.583+0000 7f0b742ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2c5050 0x5597ee2c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.583+0000 7f0b742ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2c5050 0x5597ee2c5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37976/0 (socket says 172.21.15.100:37976) 2024-09-18T01:25:30.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.583+0000 7f0b742ca640 1 -- 172.21.15.100:0/3340855487 learned_addr learned my addr 172.21.15.100:0/3340855487 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.583+0000 7f0b742ca640 1 -- 172.21.15.100:0/3340855487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597ee2c5a20 con 0x5597ee2c5050 2024-09-18T01:25:30.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.583+0000 7f0b742ca640 1 --2- 172.21.15.100:0/3340855487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2c5050 0x5597ee2c5450 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0b640218a0 tx=0x7f0b64021430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbd36cde1c365d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.583+0000 7f0a537fe640 1 -- 172.21.15.100:0/3340855487 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b64057040 con 0x5597ee2c5050 2024-09-18T01:25:30.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.583+0000 7f0a537fe640 1 -- 172.21.15.100:0/3340855487 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b64060070 con 0x5597ee2c5050 2024-09-18T01:25:30.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.583+0000 7f0a537fe640 1 -- 172.21.15.100:0/3340855487 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b6400c6e0 con 0x5597ee2c5050 2024-09-18T01:25:30.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.584+0000 7f0b78540800 1 -- 172.21.15.100:0/3340855487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2c5050 msgr2=0x5597ee2c5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.584+0000 7f0b78540800 1 --2- 172.21.15.100:0/3340855487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2c5050 0x5597ee2c5450 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0b640218a0 tx=0x7f0b64021430 comp rx=0 tx=0).stop 2024-09-18T01:25:30.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.584+0000 7f0b78540800 1 -- 172.21.15.100:0/3340855487 shutdown_connections 2024-09-18T01:25:30.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.584+0000 7f0b78540800 1 --2- 172.21.15.100:0/3340855487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2c5050 0x5597ee2c5450 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.584+0000 7f0b78540800 1 -- 172.21.15.100:0/3340855487 >> 172.21.15.100:0/3340855487 conn(0x5597ee2c13b0 msgr2=0x5597ee2bf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.584+0000 7f0b78540800 1 -- 172.21.15.100:0/3340855487 shutdown_connections 2024-09-18T01:25:30.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.584+0000 7f0b78540800 1 -- 172.21.15.100:0/3340855487 wait complete. 2024-09-18T01:25:30.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.584+0000 7f0b78540800 1 Processor -- start 2024-09-18T01:25:30.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.584+0000 7f0b78540800 1 -- start start 2024-09-18T01:25:30.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.584+0000 7f0b78540800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2c5050 0x5597ee2cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.584+0000 7f0b78540800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5597ee2c5fe0 con 0x5597ee2c5050 2024-09-18T01:25:30.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.585+0000 7f0b742ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2c5050 0x5597ee2cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.585+0000 7f0b742ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2c5050 0x5597ee2cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37982/0 (socket says 172.21.15.100:37982) 2024-09-18T01:25:30.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.585+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 learned_addr learned my addr 172.21.15.100:0/3592539493 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.585+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597ee2cc8f0 con 0x5597ee2c5050 2024-09-18T01:25:30.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.585+0000 7f0b742ca640 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2c5050 0x5597ee2cc3b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0b64021470 tx=0x7f0b64019330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.585+0000 7f0a51ffb640 1 -- 172.21.15.100:0/3592539493 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b6402b3b0 con 0x5597ee2c5050 2024-09-18T01:25:30.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.585+0000 7f0a51ffb640 1 -- 172.21.15.100:0/3592539493 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b6406b070 con 0x5597ee2c5050 2024-09-18T01:25:30.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.585+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597ee2cc8f0 con 0x5597ee2c5050 2024-09-18T01:25:30.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.585+0000 7f0a51ffb640 1 -- 172.21.15.100:0/3592539493 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b64016690 con 0x5597ee2c5050 2024-09-18T01:25:30.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.585+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597ee2cc8f0 con 0x5597ee2c5050 2024-09-18T01:25:30.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.586+0000 7f0a51ffb640 1 -- 172.21.15.100:0/3592539493 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0b64033070 con 0x5597ee2c5050 2024-09-18T01:25:30.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.586+0000 7f0a51ffb640 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a44036b40 0x7f0a44039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.586+0000 7f0a51ffb640 1 -- 172.21.15.100:0/3592539493 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0b6406a180 con 0x5597ee2c5050 2024-09-18T01:25:30.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.586+0000 7f0b6bfff640 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a44036b40 0x7f0a44039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.586+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b78540800 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5597ee2d7a40 0x5597ee2d9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2da650 con 0x5597ee2d7a40 2024-09-18T01:25:30.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b6bfff640 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a44036b40 0x7f0a44039000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c045a60 tx=0x7f0b5c053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b74acb640 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5597ee2d7a40 0x5597ee2d9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b74acb640 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5597ee2d7a40 0x5597ee2d9f00 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b78540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b78540800 20 realm 2024-09-18T01:25:30.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2daa60 con 0x5597ee2d7a40 2024-09-18T01:25:30.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b78540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b78540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:30.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.587+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db330 con 0x5597ee2d7a40 2024-09-18T01:25:30.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b78540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2d7a40 2024-09-18T01:25:30.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b78540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:30.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b78540800 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5597ee2dc1c0 0x5597ee2de5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2ded10 con 0x5597ee2dc1c0 2024-09-18T01:25:30.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b742ca640 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5597ee2dc1c0 0x5597ee2de5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b742ca640 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5597ee2dc1c0 0x5597ee2de5b0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b78540800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:30.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b78540800 20 searching for the correct realm 2024-09-18T01:25:30.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.588+0000 7f0b78540800 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5597ee2e0dc0 0x5597ee2e3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.589+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e3950 con 0x5597ee2e0dc0 2024-09-18T01:25:30.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.589+0000 7f0b6bfff640 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5597ee2e0dc0 0x5597ee2e3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.589+0000 7f0b6bfff640 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5597ee2e0dc0 0x5597ee2e3280 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.589+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.589+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e3950 con 0x5597ee2dc1c0 2024-09-18T01:25:30.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.589+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.589+0000 7f0b742ca640 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0b64067040 0x7f0b6400c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.589+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e3950 con 0x7f0b64067040 2024-09-18T01:25:30.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.590+0000 7f0b74acb640 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0b64067040 0x7f0b6400c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.590+0000 7f0b74acb640 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0b64067040 0x7f0b6400c9a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.590+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.590+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2d7a40 2024-09-18T01:25:30.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.591+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.591+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2d7a40 2024-09-18T01:25:30.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.591+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.591+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x7f0b64067040 2024-09-18T01:25:30.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.591+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.591+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x7f0b64067040 2024-09-18T01:25:30.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.591+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.591+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2dc1c0 2024-09-18T01:25:30.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.592+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.592+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2e0dc0 2024-09-18T01:25:30.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.592+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.592+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2d7a40 2024-09-18T01:25:30.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.592+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.592+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x7f0b64067040 2024-09-18T01:25:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.592+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.592+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2d7a40 2024-09-18T01:25:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.593+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.593+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2dc1c0 2024-09-18T01:25:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.593+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.593+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2e0dc0 2024-09-18T01:25:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.593+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.593+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2e0dc0 2024-09-18T01:25:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.593+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.593+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x7f0b64067040 2024-09-18T01:25:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.594+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.594+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2e0dc0 2024-09-18T01:25:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.594+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.594+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2e0dc0 2024-09-18T01:25:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.594+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.594+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2d7a40 2024-09-18T01:25:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.594+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.594+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2d7a40 2024-09-18T01:25:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.594+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.594+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x7f0b64067040 2024-09-18T01:25:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.595+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.595+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2e0dc0 2024-09-18T01:25:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.595+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.595+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2dc1c0 2024-09-18T01:25:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.595+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.595+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2d7a40 2024-09-18T01:25:30.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.595+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.595+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x7f0b64067040 2024-09-18T01:25:30.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.596+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.596+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2e0dc0 2024-09-18T01:25:30.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.596+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.596+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x7f0b64067040 2024-09-18T01:25:30.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.596+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.596+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2dc1c0 2024-09-18T01:25:30.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.596+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.596+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2e0dc0 2024-09-18T01:25:30.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.597+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.597+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x7f0b64067040 2024-09-18T01:25:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.597+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.597+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2d7a40 2024-09-18T01:25:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.597+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.597+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2db6d0 con 0x5597ee2dc1c0 2024-09-18T01:25:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.597+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.597+0000 7f0b78540800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.597+0000 7f0b78540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.597+0000 7f0b78540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.597+0000 7f0b78540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.597+0000 7f0b78540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.597+0000 7f0b78540800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2df6c0 con 0x5597ee2d7a40 2024-09-18T01:25:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2dfab0 con 0x5597ee2d7a40 2024-09-18T01:25:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2dfab0 con 0x7f0b64067040 2024-09-18T01:25:30.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:30.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 20 zone default found 2024-09-18T01:25:30.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 4 Realm: () 2024-09-18T01:25:30.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:30.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:30.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:30.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 20 zonegroup default 2024-09-18T01:25:30.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.598+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2dfed0 con 0x7f0b64067040 2024-09-18T01:25:30.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.599+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.599+0000 7f0b78540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.599+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.599+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2dfed0 con 0x5597ee2e0dc0 2024-09-18T01:25:30.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.599+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.599+0000 7f0b78540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.599+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.599+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e57b0 con 0x5597ee2e0dc0 2024-09-18T01:25:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.599+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.599+0000 7f0b78540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.599+0000 7f0b78540800 20 started sync module instance, tier type = 2024-09-18T01:25:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.599+0000 7f0b78540800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.599+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e4c50 con 0x5597ee2dc1c0 2024-09-18T01:25:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.600+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.600+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94111024435264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e6000 con 0x5597ee2dc1c0 2024-09-18T01:25:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.600+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e6850 con 0x5597ee2d7a40 2024-09-18T01:25:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.601+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94111024435264] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.602+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.602+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94111024438096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e6500 con 0x5597ee2d7a40 2024-09-18T01:25:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.602+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e6fc0 con 0x5597ee2e0dc0 2024-09-18T01:25:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.603+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.603+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94111024442000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e7860 con 0x5597ee2e0dc0 2024-09-18T01:25:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.603+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e8360 con 0x5597ee2dc1c0 2024-09-18T01:25:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.603+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94111024438096] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.604+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94111024442000] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.604+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.604+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94111024444336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e5f70 con 0x5597ee2dc1c0 2024-09-18T01:25:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.604+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e8d70 con 0x5597ee2d7a40 2024-09-18T01:25:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.605+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.605+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94111024444336] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.605+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94111024449728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e9190 con 0x5597ee2d7a40 2024-09-18T01:25:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.605+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e7e50 con 0x7f0b64067040 2024-09-18T01:25:30.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.606+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.606+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94111024453280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2e7e50 con 0x7f0b64067040 2024-09-18T01:25:30.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.606+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2ea590 con 0x7f0b64067040 2024-09-18T01:25:30.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.606+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94111024449728] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.607+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94111024453280] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.607+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.607+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94111024454336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2ea0e0 con 0x7f0b64067040 2024-09-18T01:25:30.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.607+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2eaaa0 con 0x7f0b64067040 2024-09-18T01:25:30.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.608+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.608+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94111024457200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2eaec0 con 0x7f0b64067040 2024-09-18T01:25:30.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.608+0000 7f0b78540800 20 add_watcher() i=0 2024-09-18T01:25:30.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.608+0000 7f0b78540800 20 add_watcher() i=1 2024-09-18T01:25:30.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.608+0000 7f0b78540800 20 add_watcher() i=2 2024-09-18T01:25:30.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.608+0000 7f0b78540800 20 add_watcher() i=3 2024-09-18T01:25:30.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.608+0000 7f0b78540800 20 add_watcher() i=4 2024-09-18T01:25:30.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.608+0000 7f0b78540800 20 add_watcher() i=5 2024-09-18T01:25:30.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.608+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94111024454336] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.608+0000 7f0b78540800 20 add_watcher() i=6 2024-09-18T01:25:30.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.609+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94111024457200] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.609+0000 7f0b78540800 20 add_watcher() i=7 2024-09-18T01:25:30.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.609+0000 7f0b78540800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:30.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.609+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2eaec0 con 0x5597ee2d7a40 2024-09-18T01:25:30.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.609+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.609+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94111024458256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee2eae30 con 0x5597ee2d7a40 2024-09-18T01:25:30.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.610+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94111024458256] v33'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.610+0000 7f0a2a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:30.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.611+0000 7f0b78540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:30.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.611+0000 7f0b78540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:30.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.611+0000 7f0b78540800 5 note: GC not initialized 2024-09-18T01:25:30.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.611+0000 7f0a297e2640 20 reqs_thread_entry: start 2024-09-18T01:25:30.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.611+0000 7f0b78540800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:30.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.611+0000 7f0b78540800 20 Filter name: none 2024-09-18T01:25:30.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.611+0000 7f099affd640 20 reqs_thread_entry: start 2024-09-18T01:25:30.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.611+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.611+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee320e60 con 0x5597ee2d7a40 2024-09-18T01:25:30.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.611+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.611+0000 7f0b78540800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:30.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.611+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.612+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee321850 con 0x5597ee2d7a40 2024-09-18T01:25:30.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.612+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.612+0000 7f0b78540800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:30.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.612+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee322860 con 0x5597ee2dc1c0 2024-09-18T01:25:30.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.612+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.612+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.612+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee31ffd0 con 0x5597ee2dc1c0 2024-09-18T01:25:30.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.612+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.612+0000 7f0b78540800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:30.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.612+0000 7f0b78540800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.613+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:66 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee322600 con 0x7f0b64067040 2024-09-18T01:25:30.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.613+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(66 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.613+0000 7f0b78540800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:30.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.613+0000 7f0b78540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:25:30.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.613+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 4.6 4:626e9aa1:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee321a20 con 0x5597ee2e0dc0 2024-09-18T01:25:30.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.613+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 4.32 4:4c543ff0:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee326e60 con 0x5597ee2d7a40 2024-09-18T01:25:30.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.613+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 4.16 4:68657b5e:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee329a40 con 0x5597ee2e0dc0 2024-09-18T01:25:30.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.613+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 4.27 4:e6db7ecc:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee32c630 con 0x5597ee2d7a40 2024-09-18T01:25:30.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.613+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 4.2d 4:b5379837:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee329a40 con 0x7f0b64067040 2024-09-18T01:25:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.613+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 4.28 4:14044b5f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee331670 con 0x5597ee2d7a40 2024-09-18T01:25:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.613+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:73 4.38 4:1e3fd869:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee3344e0 con 0x5597ee2d7a40 2024-09-18T01:25:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.613+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:74 4.35 4:ae848ed2:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee3373a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.613+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:75 4.1 4:8077271a:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee33a210 con 0x5597ee2dc1c0 2024-09-18T01:25:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.613+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 4.27 4:e7380930:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee33d040 con 0x5597ee2d7a40 2024-09-18T01:25:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.614+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(67 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.614+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 4.2e 4:76537098:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597ee33fd30 con 0x5597ee2e0dc0 2024-09-18T01:25:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.614+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(69 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.614+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.614+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(70 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.614+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(71 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.614+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(75 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.614+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(77 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.614+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(73 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.614+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(72 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.614+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(76 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.614+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(74 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.615+0000 7f0a2a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:30.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.615+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94111024458256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee31ec50 con 0x5597ee2d7a40 2024-09-18T01:25:30.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.616+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94111024458256] v33'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.616+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94111024435264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee31ec50 con 0x5597ee2dc1c0 2024-09-18T01:25:30.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.617+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94111024435264] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.617+0000 7f0b78540800 20 remove_watcher() i=0 2024-09-18T01:25:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.617+0000 7f0b78540800 2 removed watcher, disabling cache 2024-09-18T01:25:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.617+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94111024438096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee31ec50 con 0x5597ee2d7a40 2024-09-18T01:25:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.618+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94111024438096] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.618+0000 7f0b78540800 20 remove_watcher() i=1 2024-09-18T01:25:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.618+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94111024442000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee31ec50 con 0x5597ee2e0dc0 2024-09-18T01:25:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.619+0000 7f0b6bfff640 1 -- 172.21.15.100:0/3592539493 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94111024442000] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b5c051070 con 0x5597ee2e0dc0 2024-09-18T01:25:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.619+0000 7f0b78540800 20 remove_watcher() i=2 2024-09-18T01:25:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.619+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94111024444336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee31ec50 con 0x5597ee2dc1c0 2024-09-18T01:25:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.620+0000 7f0b742ca640 1 -- 172.21.15.100:0/3592539493 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94111024444336] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6403b030 con 0x5597ee2dc1c0 2024-09-18T01:25:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.620+0000 7f0b78540800 20 remove_watcher() i=3 2024-09-18T01:25:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.620+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94111024449728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee31ec50 con 0x5597ee2d7a40 2024-09-18T01:25:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.621+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94111024449728] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x5597ee2d7a40 2024-09-18T01:25:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.621+0000 7f0b78540800 20 remove_watcher() i=4 2024-09-18T01:25:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.621+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94111024453280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee31ec50 con 0x7f0b64067040 2024-09-18T01:25:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.622+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94111024453280] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.622+0000 7f0b78540800 20 remove_watcher() i=5 2024-09-18T01:25:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.622+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94111024454336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee31ec50 con 0x7f0b64067040 2024-09-18T01:25:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.622+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94111024454336] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.622+0000 7f0b78540800 20 remove_watcher() i=6 2024-09-18T01:25:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.622+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94111024457200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597ee31ec50 con 0x7f0b64067040 2024-09-18T01:25:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.623+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94111024457200] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b64067040 2024-09-18T01:25:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.623+0000 7f0b78540800 20 remove_watcher() i=7 2024-09-18T01:25:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.623+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0b64067040 msgr2=0x7f0b6400c9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.623+0000 7f0b78540800 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0b64067040 0x7f0b6400c9a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.623+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5597ee2d7a40 msgr2=0x5597ee2d9f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.623+0000 7f0b78540800 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5597ee2d7a40 0x5597ee2d9f00 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.623+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5597ee2dc1c0 msgr2=0x5597ee2de5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5597ee2dc1c0 0x5597ee2de5b0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5597ee2e0dc0 msgr2=0x5597ee2e3280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5597ee2e0dc0 0x5597ee2e3280 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a44036b40 msgr2=0x7f0a44039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a44036b40 0x7f0a44039000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c045a60 tx=0x7f0b5c053000 comp rx=0 tx=0).stop 2024-09-18T01:25:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2c5050 msgr2=0x5597ee2cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b74acb640 1 -- 172.21.15.100:0/3592539493 reap_dead start 2024-09-18T01:25:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2c5050 0x5597ee2cc3b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0b64021470 tx=0x7f0b64019330 comp rx=0 tx=0).stop 2024-09-18T01:25:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 shutdown_connections 2024-09-18T01:25:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 --2- 172.21.15.100:0/3592539493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2c5050 0x5597ee2cc3b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 >> 172.21.15.100:0/3592539493 conn(0x5597ee2c13b0 msgr2=0x5597ee2bf480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 shutdown_connections 2024-09-18T01:25:30.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/3592539493 wait complete. 2024-09-18T01:25:30.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/70763619 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a4c036b40 msgr2=0x7f0a4c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 --2- 172.21.15.100:0/70763619 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a4c036b40 0x7f0a4c039000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5597ee29e9f0 tx=0x7f0b5c005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:30.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/70763619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2b8530 msgr2=0x5597ee2b8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 --2- 172.21.15.100:0/70763619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2b8530 0x5597ee2b8950 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0b6404ad80 tx=0x7f0b64044f40 comp rx=0 tx=0).stop 2024-09-18T01:25:30.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/70763619 shutdown_connections 2024-09-18T01:25:30.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 --2- 172.21.15.100:0/70763619 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a4c036b40 0x7f0a4c039000 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 --2- 172.21.15.100:0/70763619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee2b8530 0x5597ee2b8950 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/70763619 >> 172.21.15.100:0/70763619 conn(0x5597ee2ad4c0 msgr2=0x5597ee2b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/70763619 shutdown_connections 2024-09-18T01:25:30.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/70763619 wait complete. 2024-09-18T01:25:30.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5597ee2a7cd0 msgr2=0x5597ee2aa0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5597ee2a7cd0 0x5597ee2aa0c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.624+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5597ee1a5860 msgr2=0x5597ee2a1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.625+0000 7f0b78540800 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5597ee1a5860 0x5597ee2a1500 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.625+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5597ee2a3de0 msgr2=0x5597ee2a61d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.625+0000 7f0b78540800 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5597ee2a3de0 0x5597ee2a61d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.625+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a5c036b40 msgr2=0x7f0a5c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.625+0000 7f0b78540800 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0a5c036b40 0x7f0a5c039000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c057000 tx=0x7f0b5c052000 comp rx=0 tx=0).stop 2024-09-18T01:25:30.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.625+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee114e90 msgr2=0x5597ee29a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.625+0000 7f0b78540800 1 --2- 172.21.15.100:0/2037499445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597ee114e90 0x5597ee29a490 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0b64004000 tx=0x7f0b64000bc0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.625+0000 7f0b74acb640 1 -- 172.21.15.100:0/2037499445 reap_dead start 2024-09-18T01:25:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.625+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 shutdown_connections 2024-09-18T01:25:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.625+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 >> 172.21.15.100:0/2037499445 conn(0x5597ee19bdf0 msgr2=0x5597ee28bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.625+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 shutdown_connections 2024-09-18T01:25:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.625+0000 7f0b78540800 1 -- 172.21.15.100:0/2037499445 wait complete. 2024-09-18T01:25:30.651 INFO:teuthology.orchestra.run.smithi100.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"2d75eca1-60da-4ca3-af9b-0b09072c949e","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"153b7754-209b-4898-8796-577da7c1273d.4237.1","marker":"153b7754-209b-4898-8796-577da7c1273d.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-18T01:25:29.865966Z","creation_time":"2024-09-18T01:25:29.863166Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-09-18T01:25:30.652 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2d75eca1-60da-4ca3-af9b-0b09072c949e', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '153b7754-209b-4898-8796-577da7c1273d.4237.1', 'marker': '153b7754-209b-4898-8796-577da7c1273d.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:25:29.865966Z', 'creation_time': '2024-09-18T01:25:29.863166Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-18T01:25:30.658 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-18T01:25:30.658 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T01:25:30.658 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T01:25:30.659 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-18T01:25:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:30.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.707+0000 7f4c84519800 1 Processor -- start 2024-09-18T01:25:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.707+0000 7f4c84519800 1 -- start start 2024-09-18T01:25:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.708+0000 7f4c84519800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x556434c1d990 0x556434c1fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.708+0000 7f4c84519800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556434ad9b30 con 0x556434c19550 2024-09-18T01:25:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.708+0000 7f4c84519800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x556434abb360 con 0x556434c1d990 2024-09-18T01:25:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.708+0000 7f4c8180c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x556434c1d990 0x556434c1fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.708+0000 7f4c8200d640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x556434c19550 0x556434c19950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37300/0 (socket says 172.21.15.100:37300) 2024-09-18T01:25:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.708+0000 7f4c8200d640 1 -- 172.21.15.100:0/2139719505 learned_addr learned my addr 172.21.15.100:0/2139719505 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.708+0000 7f4c8180c640 1 -- 172.21.15.100:0/2139719505 >> v1:172.21.15.92:6789/0 conn(0x556434c19550 legacy=0x556434c19950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.708+0000 7f4c8100b640 1 -- 172.21.15.100:0/2139719505 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1110916684 0 0) 0x556434ad9b30 con 0x556434c19550 2024-09-18T01:25:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.708+0000 7f4c8180c640 1 -- 172.21.15.100:0/2139719505 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556434ae1e00 con 0x556434c1d990 2024-09-18T01:25:30.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.710+0000 7f4c8180c640 1 --2- 172.21.15.100:0/2139719505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c1d990 0x556434c1fd80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800a470 tx=0x7f4c78045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb112cff3d0141f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.710+0000 7f4c8100b640 1 -- 172.21.15.100:0/2139719505 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c78053570 con 0x556434c1d990 2024-09-18T01:25:30.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.710+0000 7f4c8100b640 1 -- 172.21.15.100:0/2139719505 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c78058070 con 0x556434c1d990 2024-09-18T01:25:30.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.710+0000 7f4c8100b640 1 -- 172.21.15.100:0/2139719505 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c78053880 con 0x556434c1d990 2024-09-18T01:25:30.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.711+0000 7f4c84519800 1 -- 172.21.15.100:0/2139719505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c1d990 msgr2=0x556434c1fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.711+0000 7f4c84519800 1 --2- 172.21.15.100:0/2139719505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c1d990 0x556434c1fd80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800a470 tx=0x7f4c78045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:30.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.711+0000 7f4c84519800 1 -- 172.21.15.100:0/2139719505 shutdown_connections 2024-09-18T01:25:30.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.711+0000 7f4c84519800 1 --2- 172.21.15.100:0/2139719505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c1d990 0x556434c1fd80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.711+0000 7f4c84519800 1 -- 172.21.15.100:0/2139719505 >> 172.21.15.100:0/2139719505 conn(0x556434c14de0 msgr2=0x556434c17200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.711+0000 7f4c84519800 1 -- 172.21.15.100:0/2139719505 shutdown_connections 2024-09-18T01:25:30.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.711+0000 7f4c84519800 1 -- 172.21.15.100:0/2139719505 wait complete. 2024-09-18T01:25:30.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.724+0000 7f4c84519800 1 Processor -- start 2024-09-18T01:25:30.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.724+0000 7f4c84519800 1 -- start start 2024-09-18T01:25:30.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.724+0000 7f4c84519800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c19550 0x556434d07490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.725+0000 7f4c84519800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556434b66330 con 0x556434c19550 2024-09-18T01:25:30.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.725+0000 7f4c8200d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c19550 0x556434d07490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.725+0000 7f4c8200d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c19550 0x556434d07490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38008/0 (socket says 172.21.15.100:38008) 2024-09-18T01:25:30.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.725+0000 7f4c8200d640 1 -- 172.21.15.100:0/915834754 learned_addr learned my addr 172.21.15.100:0/915834754 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.725+0000 7f4c8200d640 1 -- 172.21.15.100:0/915834754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556434ab3bc0 con 0x556434c19550 2024-09-18T01:25:30.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.725+0000 7f4c8200d640 1 --2- 172.21.15.100:0/915834754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c19550 0x556434d07490 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400b240 tx=0x7f4c7400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9540aa2d3bc8de4b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.725+0000 7f4b70608640 1 -- 172.21.15.100:0/915834754 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c74008070 con 0x556434c19550 2024-09-18T01:25:30.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.725+0000 7f4b70608640 1 -- 172.21.15.100:0/915834754 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7400d500 con 0x556434c19550 2024-09-18T01:25:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.725+0000 7f4b70608640 1 -- 172.21.15.100:0/915834754 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7400d860 con 0x556434c19550 2024-09-18T01:25:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.726+0000 7f4c84519800 1 -- 172.21.15.100:0/915834754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c19550 msgr2=0x556434d07490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.726+0000 7f4c84519800 1 --2- 172.21.15.100:0/915834754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c19550 0x556434d07490 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400b240 tx=0x7f4c7400b700 comp rx=0 tx=0).stop 2024-09-18T01:25:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.726+0000 7f4c84519800 1 -- 172.21.15.100:0/915834754 shutdown_connections 2024-09-18T01:25:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.726+0000 7f4c84519800 1 --2- 172.21.15.100:0/915834754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c19550 0x556434d07490 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.726+0000 7f4c84519800 1 -- 172.21.15.100:0/915834754 >> 172.21.15.100:0/915834754 conn(0x556434c14de0 msgr2=0x556434d02e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.726+0000 7f4c84519800 1 -- 172.21.15.100:0/915834754 shutdown_connections 2024-09-18T01:25:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.726+0000 7f4c84519800 1 -- 172.21.15.100:0/915834754 wait complete. 2024-09-18T01:25:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.726+0000 7f4c84519800 1 Processor -- start 2024-09-18T01:25:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.727+0000 7f4c84519800 1 -- start start 2024-09-18T01:25:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.727+0000 7f4c84519800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c19550 0x556434d0eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.727+0000 7f4c84519800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556434c205c0 con 0x556434c19550 2024-09-18T01:25:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.727+0000 7f4c8200d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c19550 0x556434d0eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.727+0000 7f4c8200d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c19550 0x556434d0eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38020/0 (socket says 172.21.15.100:38020) 2024-09-18T01:25:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.727+0000 7f4c8200d640 1 -- 172.21.15.100:0/3426422669 learned_addr learned my addr 172.21.15.100:0/3426422669 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.727+0000 7f4c8200d640 1 -- 172.21.15.100:0/3426422669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556434ac7fe0 con 0x556434c19550 2024-09-18T01:25:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.727+0000 7f4c8200d640 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c19550 0x556434d0eed0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x556434d082f0 tx=0x7f4c74000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.727+0000 7f4b6ee05640 1 -- 172.21.15.100:0/3426422669 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c74019870 con 0x556434c19550 2024-09-18T01:25:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.727+0000 7f4b6ee05640 1 -- 172.21.15.100:0/3426422669 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c74019a10 con 0x556434c19550 2024-09-18T01:25:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.727+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556434d0f410 con 0x556434c19550 2024-09-18T01:25:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.727+0000 7f4b6ee05640 1 -- 172.21.15.100:0/3426422669 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c74019d30 con 0x556434c19550 2024-09-18T01:25:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.728+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556434d0f930 con 0x556434c19550 2024-09-18T01:25:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.728+0000 7f4b6ee05640 1 -- 172.21.15.100:0/3426422669 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4c74017040 con 0x556434c19550 2024-09-18T01:25:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.728+0000 7f4b6ee05640 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b68036b90 0x7f4b68039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.728+0000 7f4b6ee05640 1 -- 172.21.15.100:0/3426422669 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4c74015020 con 0x556434c19550 2024-09-18T01:25:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.729+0000 7f4c8180c640 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b68036b90 0x7f4b68039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.729+0000 7f4c84519800 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556434c1d990 0x556434d15f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.729+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d164c0 con 0x556434c1d990 2024-09-18T01:25:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.729+0000 7f4c8280e640 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556434c1d990 0x556434d15f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.729+0000 7f4c8180c640 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b68036b90 0x7f4b68039050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c78057000 tx=0x7f4c78052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.729+0000 7f4c8280e640 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556434c1d990 0x556434d15f40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.729+0000 7f4c8280e640 1 -- 172.21.15.100:0/3426422669 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434c1d990 2024-09-18T01:25:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.729+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d13510 con 0x556434c1d990 2024-09-18T01:25:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.730+0000 7f4c8280e640 1 -- 172.21.15.100:0/3426422669 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434c1d990 2024-09-18T01:25:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.730+0000 7f4c84519800 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556434d187f0 0x556434d1abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.730+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d1b2d0 con 0x556434d187f0 2024-09-18T01:25:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.730+0000 7f4c8200d640 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556434d187f0 0x556434d1abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.730+0000 7f4c8200d640 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556434d187f0 0x556434d1abe0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.730+0000 7f4c8200d640 1 -- 172.21.15.100:0/3426422669 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4c7402d070 con 0x556434d187f0 2024-09-18T01:25:30.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.730+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d17690 con 0x556434c1d990 2024-09-18T01:25:30.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.731+0000 7f4c8280e640 1 -- 172.21.15.100:0/3426422669 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434c1d990 2024-09-18T01:25:30.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.731+0000 7f4c84519800 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556434d1c730 0x556434d1eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.731+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d1f220 con 0x556434d1c730 2024-09-18T01:25:30.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.731+0000 7f4c8180c640 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556434d1c730 0x556434d1eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.731+0000 7f4c8180c640 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556434d1c730 0x556434d1eb20 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.731+0000 7f4c8180c640 1 -- 172.21.15.100:0/3426422669 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4c78051070 con 0x556434d1c730 2024-09-18T01:25:30.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.732+0000 7f4c84519800 1 Processor -- start 2024-09-18T01:25:30.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.732+0000 7f4c84519800 1 -- start start 2024-09-18T01:25:30.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.732+0000 7f4c84519800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d313e0 0x556434d31800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.732+0000 7f4c84519800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556434ab5580 con 0x556434d313e0 2024-09-18T01:25:30.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.732+0000 7f4c8200d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d313e0 0x556434d31800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.732+0000 7f4c8200d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d313e0 0x556434d31800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38024/0 (socket says 172.21.15.100:38024) 2024-09-18T01:25:30.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.732+0000 7f4c8200d640 1 -- 172.21.15.100:0/970728872 learned_addr learned my addr 172.21.15.100:0/970728872 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.732+0000 7f4c8200d640 1 -- 172.21.15.100:0/970728872 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556434d31d40 con 0x556434d313e0 2024-09-18T01:25:30.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.733+0000 7f4c8200d640 1 --2- 172.21.15.100:0/970728872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d313e0 0x556434d31800 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4c7404b770 tx=0x7f4c7401aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.733+0000 7f4b67fff640 1 -- 172.21.15.100:0/970728872 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7400eaa0 con 0x556434d313e0 2024-09-18T01:25:30.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.733+0000 7f4b67fff640 1 -- 172.21.15.100:0/970728872 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c74034070 con 0x556434d313e0 2024-09-18T01:25:30.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.733+0000 7f4c84519800 1 -- 172.21.15.100:0/970728872 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556434d31fd0 con 0x556434d313e0 2024-09-18T01:25:30.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.733+0000 7f4b67fff640 1 -- 172.21.15.100:0/970728872 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7400ed70 con 0x556434d313e0 2024-09-18T01:25:30.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.733+0000 7f4c84519800 1 -- 172.21.15.100:0/970728872 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556434d34cb0 con 0x556434d313e0 2024-09-18T01:25:30.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.734+0000 7f4b67fff640 1 -- 172.21.15.100:0/970728872 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4c74036020 con 0x556434d313e0 2024-09-18T01:25:30.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.734+0000 7f4b67fff640 1 --2- 172.21.15.100:0/970728872 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b5c036b90 0x7f4b5c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.734+0000 7f4b67fff640 1 -- 172.21.15.100:0/970728872 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4c7404ecc0 con 0x556434d313e0 2024-09-18T01:25:30.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.734+0000 7f4c8180c640 1 --2- 172.21.15.100:0/970728872 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b5c036b90 0x7f4b5c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.734+0000 7f4c84519800 1 Processor -- start 2024-09-18T01:25:30.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.734+0000 7f4c84519800 1 -- start start 2024-09-18T01:25:30.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.734+0000 7f4c8180c640 1 --2- 172.21.15.100:0/970728872 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b5c036b90 0x7f4b5c039050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x556434d16da0 tx=0x7f4c78005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.735+0000 7f4c84519800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d3dfd0 0x556434d3e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.735+0000 7f4c84519800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556434d07c40 con 0x556434d3dfd0 2024-09-18T01:25:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.735+0000 7f4c8200d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d3dfd0 0x556434d3e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.735+0000 7f4c8200d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d3dfd0 0x556434d3e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38034/0 (socket says 172.21.15.100:38034) 2024-09-18T01:25:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.735+0000 7f4c8200d640 1 -- 172.21.15.100:0/721502639 learned_addr learned my addr 172.21.15.100:0/721502639 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.735+0000 7f4c8200d640 1 -- 172.21.15.100:0/721502639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556434d3e9a0 con 0x556434d3dfd0 2024-09-18T01:25:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.735+0000 7f4c8200d640 1 --2- 172.21.15.100:0/721502639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d3dfd0 0x556434d3e3d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4c74001540 tx=0x7f4c7400fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a831e85e28613a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.735+0000 7f4b65ffb640 1 -- 172.21.15.100:0/721502639 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7405c020 con 0x556434d3dfd0 2024-09-18T01:25:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.735+0000 7f4b65ffb640 1 -- 172.21.15.100:0/721502639 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7403f7d0 con 0x556434d3dfd0 2024-09-18T01:25:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.735+0000 7f4b65ffb640 1 -- 172.21.15.100:0/721502639 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7403f980 con 0x556434d3dfd0 2024-09-18T01:25:30.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.736+0000 7f4c84519800 1 -- 172.21.15.100:0/721502639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d3dfd0 msgr2=0x556434d3e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.736+0000 7f4c84519800 1 --2- 172.21.15.100:0/721502639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d3dfd0 0x556434d3e3d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4c74001540 tx=0x7f4c7400fa20 comp rx=0 tx=0).stop 2024-09-18T01:25:30.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.736+0000 7f4c84519800 1 -- 172.21.15.100:0/721502639 shutdown_connections 2024-09-18T01:25:30.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.736+0000 7f4c84519800 1 --2- 172.21.15.100:0/721502639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d3dfd0 0x556434d3e3d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.736+0000 7f4c84519800 1 -- 172.21.15.100:0/721502639 >> 172.21.15.100:0/721502639 conn(0x556434d3a380 msgr2=0x556434d38480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.736+0000 7f4c84519800 1 -- 172.21.15.100:0/721502639 shutdown_connections 2024-09-18T01:25:30.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.736+0000 7f4c84519800 1 -- 172.21.15.100:0/721502639 wait complete. 2024-09-18T01:25:30.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.736+0000 7f4c84519800 1 Processor -- start 2024-09-18T01:25:30.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.736+0000 7f4c84519800 1 -- start start 2024-09-18T01:25:30.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.736+0000 7f4c84519800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d3dfd0 0x556434d452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.736+0000 7f4c84519800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556434d3ee30 con 0x556434d3dfd0 2024-09-18T01:25:30.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.736+0000 7f4c8200d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d3dfd0 0x556434d452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.736+0000 7f4c8200d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d3dfd0 0x556434d452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38038/0 (socket says 172.21.15.100:38038) 2024-09-18T01:25:30.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.736+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 learned_addr learned my addr 172.21.15.100:0/1587732985 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.737+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556434d457e0 con 0x556434d3dfd0 2024-09-18T01:25:30.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.737+0000 7f4c8200d640 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d3dfd0 0x556434d452a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4c740307d0 tx=0x7f4c7404a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.737+0000 7f4b53fff640 1 -- 172.21.15.100:0/1587732985 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7403f980 con 0x556434d3dfd0 2024-09-18T01:25:30.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.737+0000 7f4b53fff640 1 -- 172.21.15.100:0/1587732985 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c740456b0 con 0x556434d3dfd0 2024-09-18T01:25:30.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.737+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556434d457e0 con 0x556434d3dfd0 2024-09-18T01:25:30.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.737+0000 7f4b53fff640 1 -- 172.21.15.100:0/1587732985 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c74045860 con 0x556434d3dfd0 2024-09-18T01:25:30.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.737+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556434d45c80 con 0x556434d3dfd0 2024-09-18T01:25:30.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.738+0000 7f4b53fff640 1 -- 172.21.15.100:0/1587732985 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4c7405f020 con 0x556434d3dfd0 2024-09-18T01:25:30.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.738+0000 7f4b53fff640 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b4c036b40 0x7f4b4c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.738+0000 7f4b53fff640 1 -- 172.21.15.100:0/1587732985 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4c74067190 con 0x556434d3dfd0 2024-09-18T01:25:30.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.738+0000 7f4c8180c640 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b4c036b40 0x7f4b4c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.739+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.739+0000 7f4c84519800 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556434d50940 0x556434d52e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.739+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d53550 con 0x556434d50940 2024-09-18T01:25:30.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.739+0000 7f4c8280e640 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556434d50940 0x556434d52e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.739+0000 7f4c8180c640 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b4c036b40 0x7f4b4c039000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x556434d1f620 tx=0x7f4c78053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.739+0000 7f4c8280e640 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556434d50940 0x556434d52e00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.739+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.739+0000 7f4c84519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.739+0000 7f4c84519800 20 realm 2024-09-18T01:25:30.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.739+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.739+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d53960 con 0x556434d50940 2024-09-18T01:25:30.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c84519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c84519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:30.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d54230 con 0x556434d50940 2024-09-18T01:25:30.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c84519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d50940 2024-09-18T01:25:30.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c84519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:30.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c84519800 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556434d550c0 0x556434d574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d57c10 con 0x556434d550c0 2024-09-18T01:25:30.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c8200d640 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556434d550c0 0x556434d574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.740+0000 7f4c8200d640 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556434d550c0 0x556434d574b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.741+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4c7402d070 con 0x556434d550c0 2024-09-18T01:25:30.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.741+0000 7f4c84519800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:30.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.741+0000 7f4c84519800 20 searching for the correct realm 2024-09-18T01:25:30.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.741+0000 7f4c84519800 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556434d59cc0 0x556434d5c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.741+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d5c850 con 0x556434d59cc0 2024-09-18T01:25:30.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.741+0000 7f4c8180c640 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556434d59cc0 0x556434d5c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.741+0000 7f4c8180c640 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556434d59cc0 0x556434d5c180 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.741+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.741+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d5c850 con 0x556434d550c0 2024-09-18T01:25:30.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.742+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7402d070 con 0x556434d550c0 2024-09-18T01:25:30.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.742+0000 7f4c8200d640 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4c74061050 0x7f4c7406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.742+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d5c850 con 0x7f4c74061050 2024-09-18T01:25:30.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.742+0000 7f4c8280e640 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4c74061050 0x7f4c7406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.742+0000 7f4c8280e640 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4c74061050 0x7f4c7406d900 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.742+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.742+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d50940 2024-09-18T01:25:30.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.743+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.743+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d50940 2024-09-18T01:25:30.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.743+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.743+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x7f4c74061050 2024-09-18T01:25:30.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.743+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.743+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x7f4c74061050 2024-09-18T01:25:30.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.743+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.743+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d550c0 2024-09-18T01:25:30.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.744+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7402d070 con 0x556434d550c0 2024-09-18T01:25:30.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.744+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d59cc0 2024-09-18T01:25:30.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.744+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.744+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d50940 2024-09-18T01:25:30.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.744+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.744+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x7f4c74061050 2024-09-18T01:25:30.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.744+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.744+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d50940 2024-09-18T01:25:30.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.745+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.745+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d550c0 2024-09-18T01:25:30.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.745+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4c7402d070 con 0x556434d550c0 2024-09-18T01:25:30.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.745+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d59cc0 2024-09-18T01:25:30.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.745+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.745+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d59cc0 2024-09-18T01:25:30.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.745+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.745+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x7f4c74061050 2024-09-18T01:25:30.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.746+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.746+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d59cc0 2024-09-18T01:25:30.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.746+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.746+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d59cc0 2024-09-18T01:25:30.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.746+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.746+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d50940 2024-09-18T01:25:30.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.746+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.746+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d50940 2024-09-18T01:25:30.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.746+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.746+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x7f4c74061050 2024-09-18T01:25:30.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.747+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.747+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d59cc0 2024-09-18T01:25:30.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.747+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.747+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d550c0 2024-09-18T01:25:30.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.747+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7402d070 con 0x556434d550c0 2024-09-18T01:25:30.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.747+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d50940 2024-09-18T01:25:30.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.747+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.747+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x7f4c74061050 2024-09-18T01:25:30.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.748+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.748+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d59cc0 2024-09-18T01:25:30.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.748+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.748+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x7f4c74061050 2024-09-18T01:25:30.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.749+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.749+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d550c0 2024-09-18T01:25:30.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.749+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7402d070 con 0x556434d550c0 2024-09-18T01:25:30.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.749+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d59cc0 2024-09-18T01:25:30.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.749+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.749+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x7f4c74061050 2024-09-18T01:25:30.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d50940 2024-09-18T01:25:30.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556434d545d0 con 0x556434d550c0 2024-09-18T01:25:30.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4c7402d070 con 0x556434d550c0 2024-09-18T01:25:30.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c84519800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:30.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c84519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:30.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c84519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:30.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c84519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:30.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c84519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:30.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c84519800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:30.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d585c0 con 0x556434d50940 2024-09-18T01:25:30.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c84519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.750+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d589b0 con 0x556434d50940 2024-09-18T01:25:30.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:30.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d589b0 con 0x7f4c74061050 2024-09-18T01:25:30.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:30.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 20 zone default found 2024-09-18T01:25:30.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 4 Realm: () 2024-09-18T01:25:30.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:30.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:30.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:30.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 20 zonegroup default 2024-09-18T01:25:30.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d58dd0 con 0x7f4c74061050 2024-09-18T01:25:30.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.751+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d58dd0 con 0x556434d59cc0 2024-09-18T01:25:30.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.752+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.752+0000 7f4c84519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.752+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.752+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d5e6b0 con 0x556434d59cc0 2024-09-18T01:25:30.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.752+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.752+0000 7f4c84519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.752+0000 7f4c84519800 20 started sync module instance, tier type = 2024-09-18T01:25:30.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.752+0000 7f4c84519800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:30.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.752+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d5db50 con 0x556434d550c0 2024-09-18T01:25:30.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.753+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7402d070 con 0x556434d550c0 2024-09-18T01:25:30.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.753+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93888871522112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d5d7b0 con 0x556434d550c0 2024-09-18T01:25:30.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.753+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d5f520 con 0x556434d50940 2024-09-18T01:25:30.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.754+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93888871522112] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7402d070 con 0x556434d550c0 2024-09-18T01:25:30.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.754+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.754+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93888871526512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d5f940 con 0x556434d50940 2024-09-18T01:25:30.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.754+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d60300 con 0x556434d59cc0 2024-09-18T01:25:30.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.755+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93888871526512] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.755+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.755+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93888871527568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d5f8b0 con 0x556434d59cc0 2024-09-18T01:25:30.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.755+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d61170 con 0x556434d550c0 2024-09-18T01:25:30.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.756+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93888871527568] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.756+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7402d070 con 0x556434d550c0 2024-09-18T01:25:30.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.756+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93888871533760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d610e0 con 0x556434d550c0 2024-09-18T01:25:30.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.756+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d62030 con 0x556434d50940 2024-09-18T01:25:30.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.757+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.757+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93888871537536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d62450 con 0x556434d50940 2024-09-18T01:25:30.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.757+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d62f70 con 0x7f4c74061050 2024-09-18T01:25:30.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.757+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93888871533760] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7402d070 con 0x556434d550c0 2024-09-18T01:25:30.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.758+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93888871537536] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.759+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.759+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93888871541312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d61fa0 con 0x7f4c74061050 2024-09-18T01:25:30.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.759+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d63810 con 0x7f4c74061050 2024-09-18T01:25:30.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.760+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.760+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93888871543568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d61fa0 con 0x7f4c74061050 2024-09-18T01:25:30.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.760+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d64330 con 0x7f4c74061050 2024-09-18T01:25:30.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.760+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93888871541312] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.761+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93888871543568] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.761+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.761+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93888871544624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d61560 con 0x7f4c74061050 2024-09-18T01:25:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.761+0000 7f4c84519800 20 add_watcher() i=0 2024-09-18T01:25:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.761+0000 7f4c84519800 20 add_watcher() i=1 2024-09-18T01:25:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.761+0000 7f4c84519800 20 add_watcher() i=2 2024-09-18T01:25:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.761+0000 7f4c84519800 20 add_watcher() i=3 2024-09-18T01:25:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.761+0000 7f4c84519800 20 add_watcher() i=4 2024-09-18T01:25:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.761+0000 7f4c84519800 20 add_watcher() i=5 2024-09-18T01:25:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.761+0000 7f4c84519800 20 add_watcher() i=6 2024-09-18T01:25:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.762+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93888871544624] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.762+0000 7f4c84519800 20 add_watcher() i=7 2024-09-18T01:25:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.762+0000 7f4c84519800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.762+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d67320 con 0x556434d50940 2024-09-18T01:25:30.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.762+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.762+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93888871546368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d647a0 con 0x556434d50940 2024-09-18T01:25:30.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.763+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93888871546368] v33'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.763+0000 7f4b38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:30.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.763+0000 7f4c84519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:30.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.763+0000 7f4c84519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:30.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.763+0000 7f4c84519800 5 note: GC not initialized 2024-09-18T01:25:30.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.764+0000 7f4ab37fe640 20 reqs_thread_entry: start 2024-09-18T01:25:30.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.764+0000 7f4c84519800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:30.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.764+0000 7f4c84519800 20 Filter name: none 2024-09-18T01:25:30.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.764+0000 7f4ab17fa640 20 reqs_thread_entry: start 2024-09-18T01:25:30.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.764+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.764+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d9a4e0 con 0x556434d550c0 2024-09-18T01:25:30.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.764+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4c7402d070 con 0x556434d550c0 2024-09-18T01:25:30.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.764+0000 7f4c84519800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:30.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.764+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.764+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d9ae10 con 0x7f4c74061050 2024-09-18T01:25:30.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.765+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(63 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.765+0000 7f4c84519800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:30.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.765+0000 7f4c84519800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:25:30.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.765+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.765+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d9ae50 con 0x556434d550c0 2024-09-18T01:25:30.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4c7402d070 con 0x556434d550c0 2024-09-18T01:25:30.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:30.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:65 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d9c5a0 con 0x7f4c74061050 2024-09-18T01:25:30.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(65 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:30.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:25:30.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 4.6 4:626e9aa1:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434d9bba0 con 0x556434d59cc0 2024-09-18T01:25:30.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 4.32 4:4c543ff0:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434da10e0 con 0x556434d50940 2024-09-18T01:25:30.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 4.16 4:68657b5e:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434da3950 con 0x556434d59cc0 2024-09-18T01:25:30.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 4.27 4:e6db7ecc:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434da61c0 con 0x556434d50940 2024-09-18T01:25:30.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 4.2d 4:b5379837:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434da8a30 con 0x7f4c74061050 2024-09-18T01:25:30.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 4.28 4:14044b5f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434dab680 con 0x556434d50940 2024-09-18T01:25:30.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 4.38 4:1e3fd869:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434dae120 con 0x556434d50940 2024-09-18T01:25:30.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:73 4.35 4:ae848ed2:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434db0ba0 con 0x556434d50940 2024-09-18T01:25:30.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 4.1 4:8077271a:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434db0ba0 con 0x556434d550c0 2024-09-18T01:25:30.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 4.27 4:e7380930:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434db58e0 con 0x556434d50940 2024-09-18T01:25:30.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.766+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:76 4.2e 4:76537098:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556434db8110 con 0x556434d59cc0 2024-09-18T01:25:30.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.767+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.767+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(70 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.767+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(67 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.767+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(69 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.767+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(71 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.767+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(72 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.767+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(68 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.767+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(73 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.767+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(76 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.767+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(74 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c74090040 con 0x556434d550c0 2024-09-18T01:25:30.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.767+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(75 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.768+0000 7f4b38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:30.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.768+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93888871546368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d97f00 con 0x556434d50940 2024-09-18T01:25:30.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.769+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93888871546368] v33'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.769+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93888871522112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d97f00 con 0x556434d550c0 2024-09-18T01:25:30.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.770+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93888871522112] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c74090040 con 0x556434d550c0 2024-09-18T01:25:30.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.770+0000 7f4c84519800 20 remove_watcher() i=0 2024-09-18T01:25:30.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.770+0000 7f4c84519800 2 removed watcher, disabling cache 2024-09-18T01:25:30.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.770+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93888871526512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d97f00 con 0x556434d50940 2024-09-18T01:25:30.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.771+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93888871526512] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.771+0000 7f4c84519800 20 remove_watcher() i=1 2024-09-18T01:25:30.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.771+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93888871527568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d97f00 con 0x556434d59cc0 2024-09-18T01:25:30.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.772+0000 7f4c8180c640 1 -- 172.21.15.100:0/1587732985 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93888871527568] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7807c040 con 0x556434d59cc0 2024-09-18T01:25:30.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.772+0000 7f4c84519800 20 remove_watcher() i=2 2024-09-18T01:25:30.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.772+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93888871533760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d97f00 con 0x556434d550c0 2024-09-18T01:25:30.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.773+0000 7f4c8200d640 1 -- 172.21.15.100:0/1587732985 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93888871533760] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c74090040 con 0x556434d550c0 2024-09-18T01:25:30.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.773+0000 7f4c84519800 20 remove_watcher() i=3 2024-09-18T01:25:30.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.773+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93888871537536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d97f00 con 0x556434d50940 2024-09-18T01:25:30.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.774+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93888871537536] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x556434d50940 2024-09-18T01:25:30.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.774+0000 7f4c84519800 20 remove_watcher() i=4 2024-09-18T01:25:30.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.774+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93888871541312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d97f00 con 0x7f4c74061050 2024-09-18T01:25:30.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.775+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93888871541312] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.775+0000 7f4c84519800 20 remove_watcher() i=5 2024-09-18T01:25:30.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.775+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93888871543568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d97f00 con 0x7f4c74061050 2024-09-18T01:25:30.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.776+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93888871543568] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.776+0000 7f4c84519800 20 remove_watcher() i=6 2024-09-18T01:25:30.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.776+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93888871544624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556434d97f00 con 0x7f4c74061050 2024-09-18T01:25:30.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93888871544624] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c00a4a0 con 0x7f4c74061050 2024-09-18T01:25:30.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 20 remove_watcher() i=7 2024-09-18T01:25:30.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4c74061050 msgr2=0x7f4c7406d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4c74061050 0x7f4c7406d900 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556434d50940 msgr2=0x556434d52e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556434d50940 0x556434d52e00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556434d550c0 msgr2=0x556434d574b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556434d550c0 0x556434d574b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556434d59cc0 msgr2=0x556434d5c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556434d59cc0 0x556434d5c180 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b4c036b40 msgr2=0x7f4b4c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b4c036b40 0x7f4b4c039000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x556434d1f620 tx=0x7f4c78053000 comp rx=0 tx=0).stop 2024-09-18T01:25:30.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d3dfd0 msgr2=0x556434d452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d3dfd0 0x556434d452a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4c740307d0 tx=0x7f4c7404a650 comp rx=0 tx=0).stop 2024-09-18T01:25:30.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c8280e640 1 -- 172.21.15.100:0/1587732985 reap_dead start 2024-09-18T01:25:30.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 shutdown_connections 2024-09-18T01:25:30.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 --2- 172.21.15.100:0/1587732985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d3dfd0 0x556434d452a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 >> 172.21.15.100:0/1587732985 conn(0x556434d3a380 msgr2=0x556434d38450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 shutdown_connections 2024-09-18T01:25:30.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.777+0000 7f4c84519800 1 -- 172.21.15.100:0/1587732985 wait complete. 2024-09-18T01:25:30.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/970728872 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b5c036b90 msgr2=0x7f4b5c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 --2- 172.21.15.100:0/970728872 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b5c036b90 0x7f4b5c039050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x556434d16da0 tx=0x7f4c78005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:30.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/970728872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d313e0 msgr2=0x556434d31800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 --2- 172.21.15.100:0/970728872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d313e0 0x556434d31800 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4c7404b770 tx=0x7f4c7401aee0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/970728872 shutdown_connections 2024-09-18T01:25:30.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 --2- 172.21.15.100:0/970728872 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b5c036b90 0x7f4b5c039050 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 --2- 172.21.15.100:0/970728872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434d313e0 0x556434d31800 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/970728872 >> 172.21.15.100:0/970728872 conn(0x556434d21f60 msgr2=0x556434d24ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/970728872 shutdown_connections 2024-09-18T01:25:30.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/970728872 wait complete. 2024-09-18T01:25:30.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556434d1c730 msgr2=0x556434d1eb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556434d1c730 0x556434d1eb20 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556434c1d990 msgr2=0x556434d15f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556434c1d990 0x556434d15f40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556434d187f0 msgr2=0x556434d1abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556434d187f0 0x556434d1abe0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b68036b90 msgr2=0x7f4b68039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4b68036b90 0x7f4b68039050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c78057000 tx=0x7f4c78052000 comp rx=0 tx=0).stop 2024-09-18T01:25:30.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c19550 msgr2=0x556434d0eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 --2- 172.21.15.100:0/3426422669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556434c19550 0x556434d0eed0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x556434d082f0 tx=0x7f4c74000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c8280e640 1 -- 172.21.15.100:0/3426422669 reap_dead start 2024-09-18T01:25:30.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 shutdown_connections 2024-09-18T01:25:30.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 >> 172.21.15.100:0/3426422669 conn(0x556434c14de0 msgr2=0x556434d016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 shutdown_connections 2024-09-18T01:25:30.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.778+0000 7f4c84519800 1 -- 172.21.15.100:0/3426422669 wait complete. 2024-09-18T01:25:30.806 INFO:teuthology.orchestra.run.smithi100.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"2d75eca1-60da-4ca3-af9b-0b09072c949e","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"153b7754-209b-4898-8796-577da7c1273d.4237.1","marker":"153b7754-209b-4898-8796-577da7c1273d.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-18T01:25:29.865966Z","creation_time":"2024-09-18T01:25:29.863166Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-18T01:25:30.806 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2d75eca1-60da-4ca3-af9b-0b09072c949e', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '153b7754-209b-4898-8796-577da7c1273d.4237.1', 'marker': '153b7754-209b-4898-8796-577da7c1273d.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:25:29.865966Z', 'creation_time': '2024-09-18T01:25:29.863166Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T01:25:30.806 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-18T01:25:30.806 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-18T01:25:30.807 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-18T01:25:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.851+0000 7f901a1af800 1 Processor -- start 2024-09-18T01:25:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.852+0000 7f901a1af800 1 -- start start 2024-09-18T01:25:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.852+0000 7f901a1af800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560f305c1650 0x560f306501e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.852+0000 7f901a1af800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560f3050cb30 con 0x560f30650720 2024-09-18T01:25:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.852+0000 7f901a1af800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x560f304ee360 con 0x560f305c1650 2024-09-18T01:25:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.852+0000 7f9017ca3640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560f305c1650 0x560f306501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.852+0000 7f900f4a2640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x560f30650720 0x560f30652b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37306/0 (socket says 172.21.15.100:37306) 2024-09-18T01:25:30.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.852+0000 7f9017ca3640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560f305c1650 0x560f306501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38042/0 (socket says 172.21.15.100:38042) 2024-09-18T01:25:30.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.852+0000 7f900f4a2640 1 -- 172.21.15.100:0/3883355003 learned_addr learned my addr 172.21.15.100:0/3883355003 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:30.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.852+0000 7f9017ca3640 1 -- 172.21.15.100:0/3883355003 >> v1:172.21.15.92:6789/0 conn(0x560f30650720 legacy=0x560f30652b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.852+0000 7f90174a2640 1 -- 172.21.15.100:0/3883355003 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452181170 0 0) 0x560f3050cb30 con 0x560f30650720 2024-09-18T01:25:30.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.852+0000 7f9017ca3640 1 -- 172.21.15.100:0/3883355003 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f30514e00 con 0x560f305c1650 2024-09-18T01:25:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.854+0000 7f9017ca3640 1 --2- 172.21.15.100:0/3883355003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 0x560f306501e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f900800a470 tx=0x7f9008045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247edd2777d7cca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.854+0000 7f90174a2640 1 -- 172.21.15.100:0/3883355003 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9008053570 con 0x560f305c1650 2024-09-18T01:25:30.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.854+0000 7f90174a2640 1 -- 172.21.15.100:0/3883355003 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9008058070 con 0x560f305c1650 2024-09-18T01:25:30.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.854+0000 7f90174a2640 1 -- 172.21.15.100:0/3883355003 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9008053880 con 0x560f305c1650 2024-09-18T01:25:30.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.855+0000 7f901a1af800 1 -- 172.21.15.100:0/3883355003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 msgr2=0x560f306501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.855+0000 7f901a1af800 1 --2- 172.21.15.100:0/3883355003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 0x560f306501e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f900800a470 tx=0x7f9008045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:30.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.855+0000 7f901a1af800 1 -- 172.21.15.100:0/3883355003 shutdown_connections 2024-09-18T01:25:30.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.855+0000 7f901a1af800 1 --2- 172.21.15.100:0/3883355003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 0x560f306501e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.855+0000 7f901a1af800 1 -- 172.21.15.100:0/3883355003 >> 172.21.15.100:0/3883355003 conn(0x560f30647db0 msgr2=0x560f3064a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.855+0000 7f901a1af800 1 -- 172.21.15.100:0/3883355003 shutdown_connections 2024-09-18T01:25:30.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.855+0000 7f901a1af800 1 -- 172.21.15.100:0/3883355003 wait complete. 2024-09-18T01:25:30.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.868+0000 7f901a1af800 1 Processor -- start 2024-09-18T01:25:30.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.869+0000 7f901a1af800 1 -- start start 2024-09-18T01:25:30.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.869+0000 7f901a1af800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 0x560f3073c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.869+0000 7f901a1af800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560f30599360 con 0x560f305c1650 2024-09-18T01:25:30.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.869+0000 7f9017ca3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 0x560f3073c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.869+0000 7f9017ca3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 0x560f3073c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38056/0 (socket says 172.21.15.100:38056) 2024-09-18T01:25:30.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.869+0000 7f9017ca3640 1 -- 172.21.15.100:0/2565527094 learned_addr learned my addr 172.21.15.100:0/2565527094 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.869+0000 7f9017ca3640 1 -- 172.21.15.100:0/2565527094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f304e6bc0 con 0x560f305c1650 2024-09-18T01:25:30.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.870+0000 7f9017ca3640 1 --2- 172.21.15.100:0/2565527094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 0x560f3073c640 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9008045f50 tx=0x7f9008051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b061f9531eea4d1b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.870+0000 7f8f05e0b640 1 -- 172.21.15.100:0/2565527094 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9008053c20 con 0x560f305c1650 2024-09-18T01:25:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.870+0000 7f8f05e0b640 1 -- 172.21.15.100:0/2565527094 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9008063030 con 0x560f305c1650 2024-09-18T01:25:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.870+0000 7f8f05e0b640 1 -- 172.21.15.100:0/2565527094 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9008053440 con 0x560f305c1650 2024-09-18T01:25:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.870+0000 7f901a1af800 1 -- 172.21.15.100:0/2565527094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 msgr2=0x560f3073c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.870+0000 7f901a1af800 1 --2- 172.21.15.100:0/2565527094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 0x560f3073c640 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9008045f50 tx=0x7f9008051000 comp rx=0 tx=0).stop 2024-09-18T01:25:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.870+0000 7f901a1af800 1 -- 172.21.15.100:0/2565527094 shutdown_connections 2024-09-18T01:25:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.870+0000 7f901a1af800 1 --2- 172.21.15.100:0/2565527094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 0x560f3073c640 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.870+0000 7f901a1af800 1 -- 172.21.15.100:0/2565527094 >> 172.21.15.100:0/2565527094 conn(0x560f30647db0 msgr2=0x560f30738000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.871+0000 7f901a1af800 1 -- 172.21.15.100:0/2565527094 shutdown_connections 2024-09-18T01:25:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.871+0000 7f901a1af800 1 -- 172.21.15.100:0/2565527094 wait complete. 2024-09-18T01:25:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.871+0000 7f901a1af800 1 Processor -- start 2024-09-18T01:25:30.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.871+0000 7f901a1af800 1 -- start start 2024-09-18T01:25:30.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.871+0000 7f901a1af800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 0x560f30743fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.871+0000 7f901a1af800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560f30654620 con 0x560f305c1650 2024-09-18T01:25:30.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.871+0000 7f9017ca3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 0x560f30743fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.871+0000 7f9017ca3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 0x560f30743fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38068/0 (socket says 172.21.15.100:38068) 2024-09-18T01:25:30.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.871+0000 7f9017ca3640 1 -- 172.21.15.100:0/1993563548 learned_addr learned my addr 172.21.15.100:0/1993563548 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.872+0000 7f9017ca3640 1 -- 172.21.15.100:0/1993563548 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f304fafe0 con 0x560f305c1650 2024-09-18T01:25:30.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.872+0000 7f9017ca3640 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 0x560f30743fa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9008045f20 tx=0x7f9008002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.872+0000 7f8efffff640 1 -- 172.21.15.100:0/1993563548 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9008053570 con 0x560f305c1650 2024-09-18T01:25:30.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.872+0000 7f8efffff640 1 -- 172.21.15.100:0/1993563548 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9008053710 con 0x560f305c1650 2024-09-18T01:25:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.872+0000 7f8efffff640 1 -- 172.21.15.100:0/1993563548 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9008068420 con 0x560f305c1650 2024-09-18T01:25:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.872+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f307444e0 con 0x560f305c1650 2024-09-18T01:25:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.872+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f30744980 con 0x560f305c1650 2024-09-18T01:25:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.873+0000 7f8efffff640 1 -- 172.21.15.100:0/1993563548 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f90080685c0 con 0x560f305c1650 2024-09-18T01:25:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.873+0000 7f8efffff640 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8f00036b90 0x7f8f00039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.873+0000 7f8efffff640 1 -- 172.21.15.100:0/1993563548 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9008070070 con 0x560f305c1650 2024-09-18T01:25:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.873+0000 7f900f4a2640 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8f00036b90 0x7f8f00039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.873+0000 7f901a1af800 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560f30650720 0x560f3074b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.873+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f3074b550 con 0x560f30650720 2024-09-18T01:25:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.873+0000 7f90184a4640 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560f30650720 0x560f3074b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.874+0000 7f900f4a2640 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8f00036b90 0x7f8f00039050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9000000c00 tx=0x7f90000013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.874+0000 7f90184a4640 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560f30650720 0x560f3074b010 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.874+0000 7f90184a4640 1 -- 172.21.15.100:0/1993563548 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30650720 2024-09-18T01:25:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.874+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f30748580 con 0x560f30650720 2024-09-18T01:25:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.874+0000 7f90184a4640 1 -- 172.21.15.100:0/1993563548 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30650720 2024-09-18T01:25:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.874+0000 7f901a1af800 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560f3074d820 0x560f3074fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.874+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307502b0 con 0x560f3074d820 2024-09-18T01:25:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.874+0000 7f9017ca3640 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560f3074d820 0x560f3074fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.875+0000 7f9017ca3640 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560f3074d820 0x560f3074fc10 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.875+0000 7f9017ca3640 1 -- 172.21.15.100:0/1993563548 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9008051070 con 0x560f3074d820 2024-09-18T01:25:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.875+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f3074c5d0 con 0x560f30650720 2024-09-18T01:25:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.875+0000 7f90184a4640 1 -- 172.21.15.100:0/1993563548 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30650720 2024-09-18T01:25:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.875+0000 7f901a1af800 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560f307516f0 0x560f30753ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.875+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f30754180 con 0x560f307516f0 2024-09-18T01:25:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.876+0000 7f900f4a2640 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560f307516f0 0x560f30753ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.876+0000 7f900f4a2640 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560f307516f0 0x560f30753ae0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.876+0000 7f900f4a2640 1 -- 172.21.15.100:0/1993563548 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f900000f670 con 0x560f307516f0 2024-09-18T01:25:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.876+0000 7f901a1af800 1 Processor -- start 2024-09-18T01:25:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.877+0000 7f901a1af800 1 -- start start 2024-09-18T01:25:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.877+0000 7f901a1af800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f30761eb0 0x560f307622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.877+0000 7f901a1af800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560f304e8580 con 0x560f30761eb0 2024-09-18T01:25:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.877+0000 7f9017ca3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f30761eb0 0x560f307622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.877+0000 7f9017ca3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f30761eb0 0x560f307622d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38076/0 (socket says 172.21.15.100:38076) 2024-09-18T01:25:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.877+0000 7f9017ca3640 1 -- 172.21.15.100:0/1484244169 learned_addr learned my addr 172.21.15.100:0/1484244169 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.877+0000 7f9017ca3640 1 -- 172.21.15.100:0/1484244169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f30762810 con 0x560f30761eb0 2024-09-18T01:25:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.877+0000 7f9017ca3640 1 --2- 172.21.15.100:0/1484244169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f30761eb0 0x560f307622d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f900808ee20 tx=0x7f9008068cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.877+0000 7f8efd7fa640 1 -- 172.21.15.100:0/1484244169 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f900805e650 con 0x560f30761eb0 2024-09-18T01:25:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.878+0000 7f8efd7fa640 1 -- 172.21.15.100:0/1484244169 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9008067bc0 con 0x560f30761eb0 2024-09-18T01:25:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.878+0000 7f8efd7fa640 1 -- 172.21.15.100:0/1484244169 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9008090b10 con 0x560f30761eb0 2024-09-18T01:25:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.878+0000 7f901a1af800 1 -- 172.21.15.100:0/1484244169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f30762aa0 con 0x560f30761eb0 2024-09-18T01:25:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.878+0000 7f901a1af800 1 -- 172.21.15.100:0/1484244169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f30765780 con 0x560f30761eb0 2024-09-18T01:25:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.878+0000 7f8efd7fa640 1 -- 172.21.15.100:0/1484244169 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9008090cb0 con 0x560f30761eb0 2024-09-18T01:25:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.878+0000 7f8efd7fa640 1 --2- 172.21.15.100:0/1484244169 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ef0036b90 0x7f8ef0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.878+0000 7f8efd7fa640 1 -- 172.21.15.100:0/1484244169 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9008087040 con 0x560f30761eb0 2024-09-18T01:25:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.879+0000 7f900f4a2640 1 --2- 172.21.15.100:0/1484244169 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ef0036b90 0x7f8ef0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.879+0000 7f901a1af800 1 Processor -- start 2024-09-18T01:25:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.879+0000 7f901a1af800 1 -- start start 2024-09-18T01:25:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.879+0000 7f900f4a2640 1 --2- 172.21.15.100:0/1484244169 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ef0036b90 0x7f8ef0039050 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x560f30754560 tx=0x7f9000006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.879+0000 7f901a1af800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f3064d460 0x560f3064d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.879+0000 7f901a1af800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560f3073cd90 con 0x560f3064d460 2024-09-18T01:25:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.879+0000 7f9017ca3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f3064d460 0x560f3064d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.879+0000 7f9017ca3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f3064d460 0x560f3064d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38086/0 (socket says 172.21.15.100:38086) 2024-09-18T01:25:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.879+0000 7f9017ca3640 1 -- 172.21.15.100:0/4198051016 learned_addr learned my addr 172.21.15.100:0/4198051016 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.880+0000 7f9017ca3640 1 -- 172.21.15.100:0/4198051016 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f3064de30 con 0x560f3064d460 2024-09-18T01:25:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.880+0000 7f9017ca3640 1 --2- 172.21.15.100:0/4198051016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f3064d460 0x560f3064d860 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f900805d010 tx=0x7f9008065390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19989d417e965557 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.880+0000 7f8ef6ffd640 1 -- 172.21.15.100:0/4198051016 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f900809d030 con 0x560f3064d460 2024-09-18T01:25:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.880+0000 7f8ef6ffd640 1 -- 172.21.15.100:0/4198051016 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900804dc90 con 0x560f3064d460 2024-09-18T01:25:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.880+0000 7f8ef6ffd640 1 -- 172.21.15.100:0/4198051016 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9008073750 con 0x560f3064d460 2024-09-18T01:25:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.880+0000 7f901a1af800 1 -- 172.21.15.100:0/4198051016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f3064d460 msgr2=0x560f3064d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.880+0000 7f901a1af800 1 --2- 172.21.15.100:0/4198051016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f3064d460 0x560f3064d860 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f900805d010 tx=0x7f9008065390 comp rx=0 tx=0).stop 2024-09-18T01:25:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.880+0000 7f901a1af800 1 -- 172.21.15.100:0/4198051016 shutdown_connections 2024-09-18T01:25:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.880+0000 7f901a1af800 1 --2- 172.21.15.100:0/4198051016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f3064d460 0x560f3064d860 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.880+0000 7f901a1af800 1 -- 172.21.15.100:0/4198051016 >> 172.21.15.100:0/4198051016 conn(0x560f3076ad30 msgr2=0x560f30768e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.880+0000 7f901a1af800 1 -- 172.21.15.100:0/4198051016 shutdown_connections 2024-09-18T01:25:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.880+0000 7f901a1af800 1 -- 172.21.15.100:0/4198051016 wait complete. 2024-09-18T01:25:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.881+0000 7f901a1af800 1 Processor -- start 2024-09-18T01:25:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.881+0000 7f901a1af800 1 -- start start 2024-09-18T01:25:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.881+0000 7f901a1af800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f3064d460 0x560f30777e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.881+0000 7f901a1af800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560f3064bfc0 con 0x560f3064d460 2024-09-18T01:25:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.881+0000 7f9017ca3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f3064d460 0x560f30777e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.881+0000 7f9017ca3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f3064d460 0x560f30777e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38094/0 (socket says 172.21.15.100:38094) 2024-09-18T01:25:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.881+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 learned_addr learned my addr 172.21.15.100:0/3201949685 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.881+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f30778390 con 0x560f3064d460 2024-09-18T01:25:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.882+0000 7f9017ca3640 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f3064d460 0x560f30777e50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f90080656c0 tx=0x7f900805cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.882+0000 7f8ef57fa640 1 -- 172.21.15.100:0/3201949685 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90080b7070 con 0x560f3064d460 2024-09-18T01:25:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.882+0000 7f8ef57fa640 1 -- 172.21.15.100:0/3201949685 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900805ee40 con 0x560f3064d460 2024-09-18T01:25:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.882+0000 7f8ef57fa640 1 -- 172.21.15.100:0/3201949685 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9008090520 con 0x560f3064d460 2024-09-18T01:25:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.882+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f30778390 con 0x560f3064d460 2024-09-18T01:25:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.882+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f30778390 con 0x560f3064d460 2024-09-18T01:25:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.882+0000 7f8ef57fa640 1 -- 172.21.15.100:0/3201949685 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f90080ba070 con 0x560f3064d460 2024-09-18T01:25:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.883+0000 7f8ef57fa640 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ee0036b90 0x7f8ee0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.883+0000 7f8ef57fa640 1 -- 172.21.15.100:0/3201949685 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f90080a8030 con 0x560f3064d460 2024-09-18T01:25:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.883+0000 7f900f4a2640 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ee0036b90 0x7f8ee0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.883+0000 7f901a1af800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.883+0000 7f901a1af800 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560f30783510 0x560f307859d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.883+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f30786120 con 0x560f30783510 2024-09-18T01:25:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.883+0000 7f90184a4640 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560f30783510 0x560f307859d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.883+0000 7f900f4a2640 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ee0036b90 0x7f8ee0039050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f900000feb0 tx=0x7f9000023040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.883+0000 7f90184a4640 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560f30783510 0x560f307859d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 20 realm 2024-09-18T01:25:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f30786530 con 0x560f30783510 2024-09-18T01:25:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f30786e00 con 0x560f30783510 2024-09-18T01:25:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f30783510 2024-09-18T01:25:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560f30787c90 0x560f3078a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f3078a7c0 con 0x560f30787c90 2024-09-18T01:25:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.884+0000 7f9017ca3640 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560f30787c90 0x560f3078a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.885+0000 7f9017ca3640 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560f30787c90 0x560f3078a080 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.885+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.885+0000 7f901a1af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.885+0000 7f901a1af800 20 searching for the correct realm 2024-09-18T01:25:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.885+0000 7f901a1af800 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560f3078c860 0x560f3078ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.885+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f3078f3f0 con 0x560f3078c860 2024-09-18T01:25:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.885+0000 7f900f4a2640 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560f3078c860 0x560f3078ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.885+0000 7f900f4a2640 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560f3078c860 0x560f3078ed20 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.886+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.886+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f3078f3f0 con 0x560f30787c90 2024-09-18T01:25:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.886+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.886+0000 7f9017ca3640 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f90080bc070 0x7f900804d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.886+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f3078f3f0 con 0x7f90080bc070 2024-09-18T01:25:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.886+0000 7f90184a4640 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f90080bc070 0x7f900804d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.886+0000 7f90184a4640 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f90080bc070 0x7f900804d0b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.887+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.887+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f30783510 2024-09-18T01:25:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.887+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.887+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f30783510 2024-09-18T01:25:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.887+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.887+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x7f90080bc070 2024-09-18T01:25:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.887+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.887+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x7f90080bc070 2024-09-18T01:25:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.888+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.888+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f30787c90 2024-09-18T01:25:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.888+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.888+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f3078c860 2024-09-18T01:25:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.888+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.888+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f30783510 2024-09-18T01:25:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.888+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.888+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x7f90080bc070 2024-09-18T01:25:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.889+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.889+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f30783510 2024-09-18T01:25:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.889+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.889+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f30787c90 2024-09-18T01:25:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.889+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.889+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f3078c860 2024-09-18T01:25:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.889+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.889+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f3078c860 2024-09-18T01:25:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.889+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.890+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x7f90080bc070 2024-09-18T01:25:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.890+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.890+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f3078c860 2024-09-18T01:25:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.890+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.890+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f3078c860 2024-09-18T01:25:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.890+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.890+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f30783510 2024-09-18T01:25:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.890+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.890+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f30783510 2024-09-18T01:25:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.891+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.891+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x7f90080bc070 2024-09-18T01:25:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.891+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.891+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f3078c860 2024-09-18T01:25:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.891+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.891+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f30787c90 2024-09-18T01:25:30.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.891+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.891+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f30783510 2024-09-18T01:25:30.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.892+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.892+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x7f90080bc070 2024-09-18T01:25:30.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.892+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.892+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f3078c860 2024-09-18T01:25:30.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.892+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.892+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x7f90080bc070 2024-09-18T01:25:30.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.892+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.892+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f30787c90 2024-09-18T01:25:30.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.893+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.893+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f3078c860 2024-09-18T01:25:30.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.893+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.893+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x7f90080bc070 2024-09-18T01:25:30.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.893+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.893+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f30783510 2024-09-18T01:25:30.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.893+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.893+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f307871a0 con 0x560f30787c90 2024-09-18T01:25:30.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f3078b160 con 0x560f30783510 2024-09-18T01:25:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f3078b550 con 0x560f30783510 2024-09-18T01:25:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f3078b550 con 0x7f90080bc070 2024-09-18T01:25:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 zone default found 2024-09-18T01:25:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 4 Realm: () 2024-09-18T01:25:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:30.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:30.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:30.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 zonegroup default 2024-09-18T01:25:30.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.894+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f3078b970 con 0x7f90080bc070 2024-09-18T01:25:30.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.895+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.895+0000 7f901a1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.895+0000 7f901a1af800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.895+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f3078b970 con 0x560f3078c860 2024-09-18T01:25:30.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.895+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.895+0000 7f901a1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.895+0000 7f901a1af800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.895+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f30791250 con 0x560f3078c860 2024-09-18T01:25:30.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.895+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.895+0000 7f901a1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:30.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.895+0000 7f901a1af800 20 started sync module instance, tier type = 2024-09-18T01:25:30.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.895+0000 7f901a1af800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:30.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.895+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307906f0 con 0x560f30787c90 2024-09-18T01:25:30.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.896+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.896+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94623237737184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30790350 con 0x560f30787c90 2024-09-18T01:25:30.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.896+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30792130 con 0x560f30783510 2024-09-18T01:25:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.897+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94623237737184] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.897+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.898+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94623237741696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30792550 con 0x560f30783510 2024-09-18T01:25:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.898+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30792f10 con 0x560f3078c860 2024-09-18T01:25:30.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.899+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94623237741696] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.899+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.899+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94623237742752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307924c0 con 0x560f3078c860 2024-09-18T01:25:30.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.899+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30793dd0 con 0x560f30787c90 2024-09-18T01:25:30.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.900+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.900+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94623237749504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30794670 con 0x560f30787c90 2024-09-18T01:25:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.900+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307950c0 con 0x560f30783510 2024-09-18T01:25:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.900+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94623237742752] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.901+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94623237749504] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.901+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.901+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94623237753776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307941c0 con 0x560f30783510 2024-09-18T01:25:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.901+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30795960 con 0x7f90080bc070 2024-09-18T01:25:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.902+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.902+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94623237756000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30795d30 con 0x7f90080bc070 2024-09-18T01:25:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.902+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30796580 con 0x7f90080bc070 2024-09-18T01:25:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.902+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94623237753776] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.903+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94623237756000] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.903+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.903+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94623237757056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30796150 con 0x7f90080bc070 2024-09-18T01:25:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.903+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307969e0 con 0x7f90080bc070 2024-09-18T01:25:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.904+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94623237757056] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.904+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.904+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94623237758112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30796bc0 con 0x7f90080bc070 2024-09-18T01:25:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.904+0000 7f901a1af800 20 add_watcher() i=0 2024-09-18T01:25:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.904+0000 7f901a1af800 20 add_watcher() i=1 2024-09-18T01:25:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.904+0000 7f901a1af800 20 add_watcher() i=2 2024-09-18T01:25:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.904+0000 7f901a1af800 20 add_watcher() i=3 2024-09-18T01:25:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.904+0000 7f901a1af800 20 add_watcher() i=4 2024-09-18T01:25:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.904+0000 7f901a1af800 20 add_watcher() i=5 2024-09-18T01:25:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.904+0000 7f901a1af800 20 add_watcher() i=6 2024-09-18T01:25:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.905+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94623237758112] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.905+0000 7f901a1af800 20 add_watcher() i=7 2024-09-18T01:25:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.905+0000 7f901a1af800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.905+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f30799f90 con 0x560f30783510 2024-09-18T01:25:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.905+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.905+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94623237761712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30797380 con 0x560f30783510 2024-09-18T01:25:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.906+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94623237761712] v33'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.906+0000 7f8ecdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.906+0000 7f901a1af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.906+0000 7f901a1af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.906+0000 7f901a1af800 5 note: GC not initialized 2024-09-18T01:25:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.906+0000 7f8eccfe1640 20 reqs_thread_entry: start 2024-09-18T01:25:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.907+0000 7f901a1af800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.907+0000 7f901a1af800 20 Filter name: none 2024-09-18T01:25:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.907+0000 7f8e467fc640 20 reqs_thread_entry: start 2024-09-18T01:25:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.907+0000 7f901a1af800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.907+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307cccf0 con 0x560f30783510 2024-09-18T01:25:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.907+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.907+0000 7f901a1af800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.907+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307ce240 con 0x560f30787c90 2024-09-18T01:25:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.907+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.908+0000 7f901a1af800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.908+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307ce240 con 0x7f90080bc070 2024-09-18T01:25:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.908+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(64 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.908+0000 7f901a1af800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.908+0000 7f901a1af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:25:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.908+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:65 4.6 4:626e9aa1:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307cfcf0 con 0x560f3078c860 2024-09-18T01:25:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.908+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 4.32 4:4c543ff0:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307d29a0 con 0x560f30783510 2024-09-18T01:25:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.908+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 4.16 4:68657b5e:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307d5650 con 0x560f3078c860 2024-09-18T01:25:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.908+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 4.27 4:e6db7ecc:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307d8010 con 0x560f30783510 2024-09-18T01:25:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.908+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 4.2d 4:b5379837:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307dabb0 con 0x7f90080bc070 2024-09-18T01:25:30.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.908+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 4.28 4:14044b5f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307dd080 con 0x560f30783510 2024-09-18T01:25:30.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 4.38 4:1e3fd869:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307dfda0 con 0x560f30783510 2024-09-18T01:25:30.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 4.35 4:ae848ed2:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307e2b50 con 0x560f30783510 2024-09-18T01:25:30.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:73 4.1 4:8077271a:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307e5800 con 0x560f30787c90 2024-09-18T01:25:30.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(67 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:74 4.27 4:e7380930:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307d5120 con 0x560f30783510 2024-09-18T01:25:30.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(65 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:75 4.2e 4:76537098:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307e2b50 con 0x560f3078c860 2024-09-18T01:25:30.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(68 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(66 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(70 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(72 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(69 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(73 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(71 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(75 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(74 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.909+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307d5120 con 0x560f30787c90 2024-09-18T01:25:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.911+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(76 foo.buckets [call] v33'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.911+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307d5120 con 0x560f30787c90 2024-09-18T01:25:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.911+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(77 foo.buckets [call] v33'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.911+0000 7f901a1af800 20 rados->read ofs=0 len=0 2024-09-18T01:25:30.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.911+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307d5120 con 0x560f30783510 2024-09-18T01:25:30.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.912+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.912+0000 7f901a1af800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:30.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.912+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f307d5120 con 0x560f30787c90 2024-09-18T01:25:30.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.912+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.913+0000 7f8ecdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:30.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.913+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94623237761712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307caae0 con 0x560f30783510 2024-09-18T01:25:30.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.914+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94623237761712] v33'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.914+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94623237737184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307caae0 con 0x560f30787c90 2024-09-18T01:25:30.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.915+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94623237737184] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.915+0000 7f901a1af800 20 remove_watcher() i=0 2024-09-18T01:25:30.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.915+0000 7f901a1af800 2 removed watcher, disabling cache 2024-09-18T01:25:30.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.915+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94623237741696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307caae0 con 0x560f30783510 2024-09-18T01:25:30.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.916+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94623237741696] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.916+0000 7f901a1af800 20 remove_watcher() i=1 2024-09-18T01:25:30.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.916+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94623237742752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307caae0 con 0x560f3078c860 2024-09-18T01:25:30.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.917+0000 7f900f4a2640 1 -- 172.21.15.100:0/3201949685 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94623237742752] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9000037040 con 0x560f3078c860 2024-09-18T01:25:30.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.917+0000 7f901a1af800 20 remove_watcher() i=2 2024-09-18T01:25:30.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.917+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94623237749504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307caae0 con 0x560f30787c90 2024-09-18T01:25:30.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.918+0000 7f9017ca3640 1 -- 172.21.15.100:0/3201949685 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94623237749504] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90080b9030 con 0x560f30787c90 2024-09-18T01:25:30.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.918+0000 7f901a1af800 20 remove_watcher() i=3 2024-09-18T01:25:30.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.918+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94623237753776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307caae0 con 0x560f30783510 2024-09-18T01:25:30.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.919+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94623237753776] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x560f30783510 2024-09-18T01:25:30.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.919+0000 7f901a1af800 20 remove_watcher() i=4 2024-09-18T01:25:30.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.919+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94623237756000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307caae0 con 0x7f90080bc070 2024-09-18T01:25:30.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.920+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94623237756000] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.920+0000 7f901a1af800 20 remove_watcher() i=5 2024-09-18T01:25:30.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.920+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94623237757056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307caae0 con 0x7f90080bc070 2024-09-18T01:25:30.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.921+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94623237757056] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.921+0000 7f901a1af800 20 remove_watcher() i=6 2024-09-18T01:25:30.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.921+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94623237758112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f307caae0 con 0x7f90080bc070 2024-09-18T01:25:30.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94623237758112] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901000a4a0 con 0x7f90080bc070 2024-09-18T01:25:30.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 20 remove_watcher() i=7 2024-09-18T01:25:30.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f90080bc070 msgr2=0x7f900804d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f90080bc070 0x7f900804d0b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560f30783510 msgr2=0x560f307859d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560f30783510 0x560f307859d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560f30787c90 msgr2=0x560f3078a080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560f30787c90 0x560f3078a080 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560f3078c860 msgr2=0x560f3078ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560f3078c860 0x560f3078ed20 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ee0036b90 msgr2=0x7f8ee0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ee0036b90 0x7f8ee0039050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f900000feb0 tx=0x7f9000023040 comp rx=0 tx=0).stop 2024-09-18T01:25:30.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f3064d460 msgr2=0x560f30777e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 --2- 172.21.15.100:0/3201949685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f3064d460 0x560f30777e50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f90080656c0 tx=0x7f900805cc30 comp rx=0 tx=0).stop 2024-09-18T01:25:30.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f90184a4640 1 -- 172.21.15.100:0/3201949685 reap_dead start 2024-09-18T01:25:30.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 shutdown_connections 2024-09-18T01:25:30.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 >> 172.21.15.100:0/3201949685 conn(0x560f3076ad30 msgr2=0x560f30768e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 shutdown_connections 2024-09-18T01:25:30.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/3201949685 wait complete. 2024-09-18T01:25:30.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/1484244169 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ef0036b90 msgr2=0x7f8ef0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 --2- 172.21.15.100:0/1484244169 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ef0036b90 0x7f8ef0039050 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x560f30754560 tx=0x7f9000006000 comp rx=0 tx=0).stop 2024-09-18T01:25:30.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/1484244169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f30761eb0 msgr2=0x560f307622d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 --2- 172.21.15.100:0/1484244169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f30761eb0 0x560f307622d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f900808ee20 tx=0x7f9008068cf0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/1484244169 shutdown_connections 2024-09-18T01:25:30.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 --2- 172.21.15.100:0/1484244169 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8ef0036b90 0x7f8ef0039050 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 --2- 172.21.15.100:0/1484244169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f30761eb0 0x560f307622d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/1484244169 >> 172.21.15.100:0/1484244169 conn(0x560f30756e40 msgr2=0x560f307599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/1484244169 shutdown_connections 2024-09-18T01:25:30.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.922+0000 7f901a1af800 1 -- 172.21.15.100:0/1484244169 wait complete. 2024-09-18T01:25:30.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560f307516f0 msgr2=0x560f30753ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f901a1af800 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560f307516f0 0x560f30753ae0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560f30650720 msgr2=0x560f3074b010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f901a1af800 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560f30650720 0x560f3074b010 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560f3074d820 msgr2=0x560f3074fc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f901a1af800 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560f3074d820 0x560f3074fc10 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8f00036b90 msgr2=0x7f8f00039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f901a1af800 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8f00036b90 0x7f8f00039050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9000000c00 tx=0x7f90000013b0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 msgr2=0x560f30743fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:30.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f901a1af800 1 --2- 172.21.15.100:0/1993563548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f305c1650 0x560f30743fa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9008045f20 tx=0x7f9008002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:30.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f90184a4640 1 -- 172.21.15.100:0/1993563548 reap_dead start 2024-09-18T01:25:30.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 shutdown_connections 2024-09-18T01:25:30.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 >> 172.21.15.100:0/1993563548 conn(0x560f30647db0 msgr2=0x560f307368b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:30.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 shutdown_connections 2024-09-18T01:25:30.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:30.923+0000 7f901a1af800 1 -- 172.21.15.100:0/1993563548 wait complete. 2024-09-18T01:25:30.948 INFO:teuthology.orchestra.run.smithi100.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-18T01:25:30.911932Z","last_stats_update":"2024-09-18T01:25:30.910841Z"} 2024-09-18T01:25:30.948 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-18T01:25:30.911932Z', 'last_stats_update': '2024-09-18T01:25:30.910841Z'} 2024-09-18T01:25:30.954 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:30.954 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-18T01:25:30.954 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-18T01:25:30.955 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-18T01:25:31.000 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:31.000 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.000+0000 7ff169240800 1 Processor -- start 2024-09-18T01:25:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.000+0000 7ff169240800 1 -- start start 2024-09-18T01:25:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.000+0000 7ff169240800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x561e0b312630 0x561e0b3a3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.000+0000 7ff169240800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561e0b25db30 con 0x561e0b3a3b40 2024-09-18T01:25:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.000+0000 7ff169240800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x561e0b23f360 con 0x561e0b312630 2024-09-18T01:25:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.000+0000 7ff166d34640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x561e0b312630 0x561e0b3a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.000+0000 7ff166d34640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x561e0b312630 0x561e0b3a3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38104/0 (socket says 172.21.15.100:38104) 2024-09-18T01:25:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.000+0000 7ff166533640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x561e0b3a3b40 0x561e0b3a5f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37320/0 (socket says 172.21.15.100:37320) 2024-09-18T01:25:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.000+0000 7ff166d34640 1 -- 172.21.15.100:0/2431364470 learned_addr learned my addr 172.21.15.100:0/2431364470 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.001+0000 7ff166d34640 1 -- 172.21.15.100:0/2431364470 >> v1:172.21.15.92:6789/0 conn(0x561e0b3a3b40 legacy=0x561e0b3a5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.001+0000 7ff166d34640 1 -- 172.21.15.100:0/2431364470 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e0b265e00 con 0x561e0b312630 2024-09-18T01:25:31.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.002+0000 7ff166d34640 1 --2- 172.21.15.100:0/2431364470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 0x561e0b3a3600 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff15800a520 tx=0x7ff158045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d554eafa1ef3bce server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.002+0000 7ff165d32640 1 -- 172.21.15.100:0/2431364470 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff158055070 con 0x561e0b312630 2024-09-18T01:25:31.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.002+0000 7ff165d32640 1 -- 172.21.15.100:0/2431364470 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1580515b0 con 0x561e0b312630 2024-09-18T01:25:31.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.002+0000 7ff165d32640 1 -- 172.21.15.100:0/2431364470 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1580518d0 con 0x561e0b312630 2024-09-18T01:25:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.003+0000 7ff169240800 1 -- 172.21.15.100:0/2431364470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 msgr2=0x561e0b3a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.003+0000 7ff169240800 1 --2- 172.21.15.100:0/2431364470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 0x561e0b3a3600 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff15800a520 tx=0x7ff158045ba0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.003+0000 7ff169240800 1 -- 172.21.15.100:0/2431364470 shutdown_connections 2024-09-18T01:25:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.003+0000 7ff169240800 1 --2- 172.21.15.100:0/2431364470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 0x561e0b3a3600 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.003+0000 7ff169240800 1 -- 172.21.15.100:0/2431364470 >> 172.21.15.100:0/2431364470 conn(0x561e0b398db0 msgr2=0x561e0b39b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.003+0000 7ff169240800 1 -- 172.21.15.100:0/2431364470 shutdown_connections 2024-09-18T01:25:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.003+0000 7ff169240800 1 -- 172.21.15.100:0/2431364470 wait complete. 2024-09-18T01:25:31.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.017+0000 7ff169240800 1 Processor -- start 2024-09-18T01:25:31.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.017+0000 7ff169240800 1 -- start start 2024-09-18T01:25:31.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.017+0000 7ff169240800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 0x561e0b48fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.017+0000 7ff169240800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561e0b2ea360 con 0x561e0b312630 2024-09-18T01:25:31.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.017+0000 7ff166d34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 0x561e0b48fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.017+0000 7ff166d34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 0x561e0b48fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38112/0 (socket says 172.21.15.100:38112) 2024-09-18T01:25:31.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.017+0000 7ff166d34640 1 -- 172.21.15.100:0/2516535112 learned_addr learned my addr 172.21.15.100:0/2516535112 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.017+0000 7ff166d34640 1 -- 172.21.15.100:0/2516535112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e0b237bc0 con 0x561e0b312630 2024-09-18T01:25:31.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.017+0000 7ff166d34640 1 --2- 172.21.15.100:0/2516535112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 0x561e0b48fa70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff158025da0 tx=0x7ff158051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec526d56fdcae4b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.018+0000 7ff054e09640 1 -- 172.21.15.100:0/2516535112 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff158051950 con 0x561e0b312630 2024-09-18T01:25:31.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.018+0000 7ff054e09640 1 -- 172.21.15.100:0/2516535112 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff158051af0 con 0x561e0b312630 2024-09-18T01:25:31.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.018+0000 7ff054e09640 1 -- 172.21.15.100:0/2516535112 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff158051dd0 con 0x561e0b312630 2024-09-18T01:25:31.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.018+0000 7ff169240800 1 -- 172.21.15.100:0/2516535112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 msgr2=0x561e0b48fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.018+0000 7ff169240800 1 --2- 172.21.15.100:0/2516535112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 0x561e0b48fa70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff158025da0 tx=0x7ff158051000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.018+0000 7ff169240800 1 -- 172.21.15.100:0/2516535112 shutdown_connections 2024-09-18T01:25:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.018+0000 7ff169240800 1 --2- 172.21.15.100:0/2516535112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 0x561e0b48fa70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.018+0000 7ff169240800 1 -- 172.21.15.100:0/2516535112 >> 172.21.15.100:0/2516535112 conn(0x561e0b398db0 msgr2=0x561e0b48b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.018+0000 7ff169240800 1 -- 172.21.15.100:0/2516535112 shutdown_connections 2024-09-18T01:25:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.018+0000 7ff169240800 1 -- 172.21.15.100:0/2516535112 wait complete. 2024-09-18T01:25:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.019+0000 7ff169240800 1 Processor -- start 2024-09-18T01:25:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.019+0000 7ff169240800 1 -- start start 2024-09-18T01:25:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.019+0000 7ff169240800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 0x561e0b497390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.019+0000 7ff169240800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561e0b3a7920 con 0x561e0b312630 2024-09-18T01:25:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.019+0000 7ff166d34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 0x561e0b497390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.019+0000 7ff166d34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 0x561e0b497390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38120/0 (socket says 172.21.15.100:38120) 2024-09-18T01:25:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.019+0000 7ff166d34640 1 -- 172.21.15.100:0/1779483924 learned_addr learned my addr 172.21.15.100:0/1779483924 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.019+0000 7ff166d34640 1 -- 172.21.15.100:0/1779483924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e0b24bfe0 con 0x561e0b312630 2024-09-18T01:25:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.020+0000 7ff166d34640 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 0x561e0b497390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff158067040 tx=0x7ff158002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.020+0000 7ff053606640 1 -- 172.21.15.100:0/1779483924 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff158073070 con 0x561e0b312630 2024-09-18T01:25:31.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.020+0000 7ff053606640 1 -- 172.21.15.100:0/1779483924 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff15805a450 con 0x561e0b312630 2024-09-18T01:25:31.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.020+0000 7ff053606640 1 -- 172.21.15.100:0/1779483924 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff15805a730 con 0x561e0b312630 2024-09-18T01:25:31.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.020+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e0b4978d0 con 0x561e0b312630 2024-09-18T01:25:31.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.020+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e0b497e50 con 0x561e0b312630 2024-09-18T01:25:31.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.021+0000 7ff053606640 1 -- 172.21.15.100:0/1779483924 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff158076070 con 0x561e0b312630 2024-09-18T01:25:31.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.021+0000 7ff053606640 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff04c036b90 0x7ff04c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.021+0000 7ff053606640 1 -- 172.21.15.100:0/1779483924 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff158062070 con 0x561e0b312630 2024-09-18T01:25:31.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.021+0000 7ff166533640 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff04c036b90 0x7ff04c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.021+0000 7ff169240800 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561e0b3a3b40 0x561e0b49e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.021+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b49ea20 con 0x561e0b3a3b40 2024-09-18T01:25:31.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.021+0000 7ff167535640 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561e0b3a3b40 0x561e0b49e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.021+0000 7ff166533640 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff04c036b90 0x7ff04c039050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff150000f60 tx=0x7ff150001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.021+0000 7ff167535640 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561e0b3a3b40 0x561e0b49e400 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.022+0000 7ff167535640 1 -- 172.21.15.100:0/1779483924 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b3a3b40 2024-09-18T01:25:31.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.022+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b49b9b0 con 0x561e0b3a3b40 2024-09-18T01:25:31.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.022+0000 7ff167535640 1 -- 172.21.15.100:0/1779483924 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b3a3b40 2024-09-18T01:25:31.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.022+0000 7ff169240800 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561e0b4a0d50 0x561e0b4a3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.022+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4a37e0 con 0x561e0b4a0d50 2024-09-18T01:25:31.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.022+0000 7ff166d34640 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561e0b4a0d50 0x561e0b4a3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.022+0000 7ff166d34640 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561e0b4a0d50 0x561e0b4a3140 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.023+0000 7ff166d34640 1 -- 172.21.15.100:0/1779483924 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff15807f070 con 0x561e0b4a0d50 2024-09-18T01:25:31.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.023+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b49fbf0 con 0x561e0b3a3b40 2024-09-18T01:25:31.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.023+0000 7ff167535640 1 -- 172.21.15.100:0/1779483924 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b3a3b40 2024-09-18T01:25:31.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.023+0000 7ff169240800 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x561e0b4a4c40 0x561e0b4a7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.023+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4a7730 con 0x561e0b4a4c40 2024-09-18T01:25:31.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.023+0000 7ff166533640 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x561e0b4a4c40 0x561e0b4a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.024+0000 7ff166533640 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x561e0b4a4c40 0x561e0b4a7030 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.024+0000 7ff166533640 1 -- 172.21.15.100:0/1779483924 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff15000f690 con 0x561e0b4a4c40 2024-09-18T01:25:31.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.024+0000 7ff169240800 1 Processor -- start 2024-09-18T01:25:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.024+0000 7ff169240800 1 -- start start 2024-09-18T01:25:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.024+0000 7ff169240800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4b54e0 0x561e0b4b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.024+0000 7ff169240800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561e0b239580 con 0x561e0b4b54e0 2024-09-18T01:25:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.025+0000 7ff166d34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4b54e0 0x561e0b4b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.025+0000 7ff166d34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4b54e0 0x561e0b4b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38126/0 (socket says 172.21.15.100:38126) 2024-09-18T01:25:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.025+0000 7ff166d34640 1 -- 172.21.15.100:0/2054874307 learned_addr learned my addr 172.21.15.100:0/2054874307 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.025+0000 7ff166d34640 1 -- 172.21.15.100:0/2054874307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e0b4b5e40 con 0x561e0b4b54e0 2024-09-18T01:25:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.025+0000 7ff166d34640 1 --2- 172.21.15.100:0/2054874307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4b54e0 0x561e0b4b5900 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff158050c70 tx=0x7ff158065e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.025+0000 7ff050e01640 1 -- 172.21.15.100:0/2054874307 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff15805a960 con 0x561e0b4b54e0 2024-09-18T01:25:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.025+0000 7ff050e01640 1 -- 172.21.15.100:0/2054874307 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff15805ab00 con 0x561e0b4b54e0 2024-09-18T01:25:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.025+0000 7ff169240800 1 -- 172.21.15.100:0/2054874307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e0b4b60d0 con 0x561e0b4b54e0 2024-09-18T01:25:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.025+0000 7ff050e01640 1 -- 172.21.15.100:0/2054874307 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff15805ade0 con 0x561e0b4b54e0 2024-09-18T01:25:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.025+0000 7ff169240800 1 -- 172.21.15.100:0/2054874307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e0b4b8db0 con 0x561e0b4b54e0 2024-09-18T01:25:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.026+0000 7ff050e01640 1 -- 172.21.15.100:0/2054874307 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff158058070 con 0x561e0b4b54e0 2024-09-18T01:25:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.026+0000 7ff050e01640 1 --2- 172.21.15.100:0/2054874307 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff040036b90 0x7ff040039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.026+0000 7ff050e01640 1 -- 172.21.15.100:0/2054874307 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff15808b040 con 0x561e0b4b54e0 2024-09-18T01:25:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.026+0000 7ff166533640 1 --2- 172.21.15.100:0/2054874307 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff040036b90 0x7ff040039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.026+0000 7ff169240800 1 Processor -- start 2024-09-18T01:25:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.027+0000 7ff169240800 1 -- start start 2024-09-18T01:25:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.027+0000 7ff166533640 1 --2- 172.21.15.100:0/2054874307 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff040036b90 0x7ff040039050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x561e0b49b8f0 tx=0x7ff15000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.027+0000 7ff169240800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4c1f90 0x561e0b4c2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.027+0000 7ff169240800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561e0b490160 con 0x561e0b4c1f90 2024-09-18T01:25:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.027+0000 7ff166d34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4c1f90 0x561e0b4c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.027+0000 7ff166d34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4c1f90 0x561e0b4c2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38142/0 (socket says 172.21.15.100:38142) 2024-09-18T01:25:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.027+0000 7ff166d34640 1 -- 172.21.15.100:0/2122060521 learned_addr learned my addr 172.21.15.100:0/2122060521 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.027+0000 7ff166d34640 1 -- 172.21.15.100:0/2122060521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e0b4c2960 con 0x561e0b4c1f90 2024-09-18T01:25:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.027+0000 7ff166d34640 1 --2- 172.21.15.100:0/2122060521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4c1f90 0x561e0b4c2390 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff158063e90 tx=0x7ff158068690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29561c82037b7147 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.027+0000 7ff04a7fc640 1 -- 172.21.15.100:0/2122060521 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff15805edd0 con 0x561e0b4c1f90 2024-09-18T01:25:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.027+0000 7ff04a7fc640 1 -- 172.21.15.100:0/2122060521 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff158009410 con 0x561e0b4c1f90 2024-09-18T01:25:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.027+0000 7ff04a7fc640 1 -- 172.21.15.100:0/2122060521 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1580646e0 con 0x561e0b4c1f90 2024-09-18T01:25:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.028+0000 7ff169240800 1 -- 172.21.15.100:0/2122060521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4c1f90 msgr2=0x561e0b4c2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.028+0000 7ff169240800 1 --2- 172.21.15.100:0/2122060521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4c1f90 0x561e0b4c2390 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff158063e90 tx=0x7ff158068690 comp rx=0 tx=0).stop 2024-09-18T01:25:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.028+0000 7ff169240800 1 -- 172.21.15.100:0/2122060521 shutdown_connections 2024-09-18T01:25:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.028+0000 7ff169240800 1 --2- 172.21.15.100:0/2122060521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4c1f90 0x561e0b4c2390 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.028+0000 7ff169240800 1 -- 172.21.15.100:0/2122060521 >> 172.21.15.100:0/2122060521 conn(0x561e0b4be390 msgr2=0x561e0b4bc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.028+0000 7ff169240800 1 -- 172.21.15.100:0/2122060521 shutdown_connections 2024-09-18T01:25:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.028+0000 7ff169240800 1 -- 172.21.15.100:0/2122060521 wait complete. 2024-09-18T01:25:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.028+0000 7ff169240800 1 Processor -- start 2024-09-18T01:25:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.028+0000 7ff169240800 1 -- start start 2024-09-18T01:25:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.028+0000 7ff169240800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4c1f90 0x561e0b4c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.028+0000 7ff169240800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561e0b4c2e40 con 0x561e0b4c1f90 2024-09-18T01:25:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.028+0000 7ff166d34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4c1f90 0x561e0b4c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.028+0000 7ff166d34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4c1f90 0x561e0b4c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38158/0 (socket says 172.21.15.100:38158) 2024-09-18T01:25:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.028+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 learned_addr learned my addr 172.21.15.100:0/3051035484 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.029+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e0b4c97a0 con 0x561e0b4c1f90 2024-09-18T01:25:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.029+0000 7ff166d34640 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4c1f90 0x561e0b4c9260 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff158063e90 tx=0x7ff158009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.029+0000 7ff048ff9640 1 -- 172.21.15.100:0/3051035484 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1580858a0 con 0x561e0b4c1f90 2024-09-18T01:25:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.029+0000 7ff048ff9640 1 -- 172.21.15.100:0/3051035484 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff158085a40 con 0x561e0b4c1f90 2024-09-18T01:25:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.029+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e0b4c97a0 con 0x561e0b4c1f90 2024-09-18T01:25:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.029+0000 7ff048ff9640 1 -- 172.21.15.100:0/3051035484 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff15806e4f0 con 0x561e0b4c1f90 2024-09-18T01:25:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.029+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e0b4c97a0 con 0x561e0b4c1f90 2024-09-18T01:25:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.030+0000 7ff048ff9640 1 -- 172.21.15.100:0/3051035484 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff15804f070 con 0x561e0b4c1f90 2024-09-18T01:25:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.030+0000 7ff048ff9640 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff030036b90 0x7ff030039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.030+0000 7ff048ff9640 1 -- 172.21.15.100:0/3051035484 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff1580a9030 con 0x561e0b4c1f90 2024-09-18T01:25:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.030+0000 7ff166533640 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff030036b90 0x7ff030039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.030+0000 7ff166533640 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff030036b90 0x7ff030039050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x561e0b4a7b30 tx=0x7ff150010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.031+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.031+0000 7ff169240800 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561e0b4d4a50 0x561e0b4d6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.031+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d7660 con 0x561e0b4d4a50 2024-09-18T01:25:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.031+0000 7ff167535640 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561e0b4d4a50 0x561e0b4d6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.031+0000 7ff167535640 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561e0b4d4a50 0x561e0b4d6f10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.031+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.031+0000 7ff169240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.031+0000 7ff169240800 20 realm 2024-09-18T01:25:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.031+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.031+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d7a70 con 0x561e0b4d4a50 2024-09-18T01:25:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.031+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff169240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff169240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d8340 con 0x561e0b4d4a50 2024-09-18T01:25:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff169240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4d4a50 2024-09-18T01:25:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff169240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff169240800 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561e0b4d9440 0x561e0b4db830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4dbe40 con 0x561e0b4d9440 2024-09-18T01:25:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff166d34640 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561e0b4d9440 0x561e0b4db830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.032+0000 7ff166d34640 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561e0b4d9440 0x561e0b4db830 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.033+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.033+0000 7ff169240800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.033+0000 7ff169240800 20 searching for the correct realm 2024-09-18T01:25:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.033+0000 7ff169240800 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x561e0b4dddf0 0x561e0b4e02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.033+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e0980 con 0x561e0b4dddf0 2024-09-18T01:25:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.033+0000 7ff166533640 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x561e0b4dddf0 0x561e0b4e02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.033+0000 7ff166533640 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x561e0b4dddf0 0x561e0b4e02b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.033+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff150037040 con 0x561e0b4dddf0 2024-09-18T01:25:31.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.033+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e0980 con 0x561e0b4d9440 2024-09-18T01:25:31.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.034+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.034+0000 7ff166d34640 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff158078070 0x7ff1580bc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.034+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e0980 con 0x7ff158078070 2024-09-18T01:25:31.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.034+0000 7ff167535640 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff158078070 0x7ff1580bc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.034+0000 7ff167535640 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff158078070 0x7ff1580bc440 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.034+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.034+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4d4a50 2024-09-18T01:25:31.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.035+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.035+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4d4a50 2024-09-18T01:25:31.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.035+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.035+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x7ff158078070 2024-09-18T01:25:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.035+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.035+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x7ff158078070 2024-09-18T01:25:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.035+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.035+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4d9440 2024-09-18T01:25:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.036+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.036+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4dddf0 2024-09-18T01:25:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.036+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff150037040 con 0x561e0b4dddf0 2024-09-18T01:25:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.036+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4d4a50 2024-09-18T01:25:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.036+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.036+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x7ff158078070 2024-09-18T01:25:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.036+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.036+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4d4a50 2024-09-18T01:25:31.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.036+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.036+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4d9440 2024-09-18T01:25:31.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.037+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.037+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4dddf0 2024-09-18T01:25:31.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.037+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff150037040 con 0x561e0b4dddf0 2024-09-18T01:25:31.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.037+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4dddf0 2024-09-18T01:25:31.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.037+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff150037040 con 0x561e0b4dddf0 2024-09-18T01:25:31.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.037+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x7ff158078070 2024-09-18T01:25:31.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.037+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.037+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4dddf0 2024-09-18T01:25:31.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.038+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff150037040 con 0x561e0b4dddf0 2024-09-18T01:25:31.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.038+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4dddf0 2024-09-18T01:25:31.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.038+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff150037040 con 0x561e0b4dddf0 2024-09-18T01:25:31.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.038+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4d4a50 2024-09-18T01:25:31.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.038+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.038+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4d4a50 2024-09-18T01:25:31.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.038+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.038+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x7ff158078070 2024-09-18T01:25:31.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.039+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.039+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4dddf0 2024-09-18T01:25:31.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.039+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff150037040 con 0x561e0b4dddf0 2024-09-18T01:25:31.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.039+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4d9440 2024-09-18T01:25:31.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.039+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.039+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4d4a50 2024-09-18T01:25:31.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.039+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.039+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x7ff158078070 2024-09-18T01:25:31.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.040+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.040+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4dddf0 2024-09-18T01:25:31.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.040+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff150037040 con 0x561e0b4dddf0 2024-09-18T01:25:31.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.040+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x7ff158078070 2024-09-18T01:25:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.040+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.040+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4d9440 2024-09-18T01:25:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.040+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.040+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4dddf0 2024-09-18T01:25:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.040+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff150037040 con 0x561e0b4dddf0 2024-09-18T01:25:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.040+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x7ff158078070 2024-09-18T01:25:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4d4a50 2024-09-18T01:25:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4d86e0 con 0x561e0b4d9440 2024-09-18T01:25:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff169240800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff169240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff169240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff169240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff169240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff169240800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4dc700 con 0x561e0b4d4a50 2024-09-18T01:25:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff169240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.041+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4dcaf0 con 0x561e0b4d4a50 2024-09-18T01:25:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4dcaf0 con 0x7ff158078070 2024-09-18T01:25:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 20 zone default found 2024-09-18T01:25:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 4 Realm: () 2024-09-18T01:25:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 20 zonegroup default 2024-09-18T01:25:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e0e00 con 0x7ff158078070 2024-09-18T01:25:31.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.042+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e27e0 con 0x561e0b4dddf0 2024-09-18T01:25:31.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.043+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff150037040 con 0x561e0b4dddf0 2024-09-18T01:25:31.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.043+0000 7ff169240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.043+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.043+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e2b80 con 0x561e0b4dddf0 2024-09-18T01:25:31.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.043+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff150037040 con 0x561e0b4dddf0 2024-09-18T01:25:31.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.043+0000 7ff169240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.043+0000 7ff169240800 20 started sync module instance, tier type = 2024-09-18T01:25:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.043+0000 7ff169240800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.043+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e1c80 con 0x561e0b4d9440 2024-09-18T01:25:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.044+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.044+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94687038677152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e18e0 con 0x561e0b4d9440 2024-09-18T01:25:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.044+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e38c0 con 0x561e0b4d4a50 2024-09-18T01:25:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.045+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94687038677152] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.045+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.045+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94687038680864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e3cb0 con 0x561e0b4d4a50 2024-09-18T01:25:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.045+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e46e0 con 0x561e0b4dddf0 2024-09-18T01:25:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.046+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff150037040 con 0x561e0b4dddf0 2024-09-18T01:25:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.046+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94687038685680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e4f80 con 0x561e0b4dddf0 2024-09-18T01:25:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.046+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e5a60 con 0x561e0b4d9440 2024-09-18T01:25:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.046+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94687038680864] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.047+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94687038685680] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff150037040 con 0x561e0b4dddf0 2024-09-18T01:25:31.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.047+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.047+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94687038681920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e5e80 con 0x561e0b4d9440 2024-09-18T01:25:31.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.047+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e66d0 con 0x561e0b4d4a50 2024-09-18T01:25:31.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.048+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.048+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94687038693472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e6ab0 con 0x561e0b4d4a50 2024-09-18T01:25:31.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.048+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e75b0 con 0x7ff158078070 2024-09-18T01:25:31.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.048+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94687038681920] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.049+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94687038693472] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.049+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.049+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94687038697632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e7570 con 0x7ff158078070 2024-09-18T01:25:31.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.049+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e7e80 con 0x7ff158078070 2024-09-18T01:25:31.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.050+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.050+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94687038699904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e7570 con 0x7ff158078070 2024-09-18T01:25:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.050+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e8990 con 0x7ff158078070 2024-09-18T01:25:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.050+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94687038697632] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.051+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.051+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94687038702752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e8990 con 0x7ff158078070 2024-09-18T01:25:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.051+0000 7ff169240800 20 add_watcher() i=0 2024-09-18T01:25:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.051+0000 7ff169240800 20 add_watcher() i=1 2024-09-18T01:25:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.051+0000 7ff169240800 20 add_watcher() i=2 2024-09-18T01:25:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.051+0000 7ff169240800 20 add_watcher() i=3 2024-09-18T01:25:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.051+0000 7ff169240800 20 add_watcher() i=4 2024-09-18T01:25:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.051+0000 7ff169240800 20 add_watcher() i=5 2024-09-18T01:25:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.051+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94687038699904] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.051+0000 7ff169240800 20 add_watcher() i=6 2024-09-18T01:25:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.052+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94687038702752] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.052+0000 7ff169240800 20 add_watcher() i=7 2024-09-18T01:25:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.052+0000 7ff169240800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.052+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e7da0 con 0x561e0b4d4a50 2024-09-18T01:25:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.052+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.052+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94687038690672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b4e7da0 con 0x561e0b4d4a50 2024-09-18T01:25:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.053+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94687038690672] v33'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.053+0000 7ff01d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.053+0000 7ff169240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.053+0000 7ff169240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.053+0000 7ff169240800 5 note: GC not initialized 2024-09-18T01:25:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7fef97fff640 20 reqs_thread_entry: start 2024-09-18T01:25:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7ff169240800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7ff169240800 20 Filter name: none 2024-09-18T01:25:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7fef95ffb640 20 reqs_thread_entry: start 2024-09-18T01:25:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7ff169240800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b51ec80 con 0x561e0b4d4a50 2024-09-18T01:25:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7ff169240800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7ff169240800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7ff169240800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7ff169240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7ff169240800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:25:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.054+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b520d60 con 0x561e0b4d9440 2024-09-18T01:25:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff169240800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff169240800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:25:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff169240800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff169240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 : miss 2024-09-18T01:25:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b522590 con 0x7ff158078070 2024-09-18T01:25:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(64 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff169240800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff169240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff169240800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff169240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff169240800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff169240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 2024-09-18T01:25:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff169240800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-18T01:25:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.055+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b525cb0 con 0x561e0b4d9440 2024-09-18T01:25:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.056+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(65 foo.buckets [call] v33'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.056+0000 7ff169240800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-18T01:25:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.056+0000 7ff169240800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.056+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b524df0 con 0x561e0b4d9440 2024-09-18T01:25:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.057+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.057+0000 7ff169240800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.057+0000 7ff169240800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-18T01:25:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.057+0000 7ff169240800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.057+0000 7ff169240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.057+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b529aa0 con 0x561e0b4d9440 2024-09-18T01:25:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.058+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v33'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.058+0000 7ff169240800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-18T01:25:31.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.058+0000 7ff169240800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:31.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.058+0000 7ff169240800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:25:31.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.058+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94687038968960 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561e0b5267d0 con 0x7ff158078070 2024-09-18T01:25:31.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.058+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== watch-notify(notify (1) cookie 94687038699904 notify 141733920769 ret 0) ==== 380+0+0 (crc 0 0 0) 0x561e0b522980 con 0x7ff158078070 2024-09-18T01:25:31.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.058+0000 7ff04a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94687038699904 notifier 4489 bl.length()=338 2024-09-18T01:25:31.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.058+0000 7ff04a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-18T01:25:31.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.058+0000 7ff04a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:31.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.058+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(68 notify.6 [notify cookie 94687038968960 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.058+0000 7ff04a7fc640 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff02c003ea0 con 0x7ff158078070 2024-09-18T01:25:31.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.058+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.058+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== watch-notify(notify_complete (2) cookie 94687038968960 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561e0b521b00 con 0x7ff158078070 2024-09-18T01:25:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.059+0000 7ff01d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.059+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94687038690672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b51c9d0 con 0x561e0b4d4a50 2024-09-18T01:25:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.060+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94687038690672] v33'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.060+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94687038677152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b51c9d0 con 0x561e0b4d9440 2024-09-18T01:25:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.061+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94687038677152] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.061+0000 7ff169240800 20 remove_watcher() i=0 2024-09-18T01:25:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.061+0000 7ff169240800 2 removed watcher, disabling cache 2024-09-18T01:25:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.061+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94687038680864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b51c9d0 con 0x561e0b4d4a50 2024-09-18T01:25:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.062+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94687038680864] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.062+0000 7ff169240800 20 remove_watcher() i=1 2024-09-18T01:25:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.062+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94687038685680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b529aa0 con 0x561e0b4dddf0 2024-09-18T01:25:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.063+0000 7ff166533640 1 -- 172.21.15.100:0/3051035484 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94687038685680] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff150037040 con 0x561e0b4dddf0 2024-09-18T01:25:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.063+0000 7ff169240800 20 remove_watcher() i=2 2024-09-18T01:25:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.064+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94687038681920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b51c9d0 con 0x561e0b4d9440 2024-09-18T01:25:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.064+0000 7ff166d34640 1 -- 172.21.15.100:0/3051035484 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94687038681920] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15809f070 con 0x561e0b4d9440 2024-09-18T01:25:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.064+0000 7ff169240800 20 remove_watcher() i=3 2024-09-18T01:25:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.064+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94687038693472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b51c9d0 con 0x561e0b4d4a50 2024-09-18T01:25:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.065+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94687038693472] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x561e0b4d4a50 2024-09-18T01:25:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.065+0000 7ff169240800 20 remove_watcher() i=4 2024-09-18T01:25:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.065+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94687038697632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b51c9d0 con 0x7ff158078070 2024-09-18T01:25:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.066+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94687038697632] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.066+0000 7ff169240800 20 remove_watcher() i=5 2024-09-18T01:25:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.066+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94687038699904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b51c9d0 con 0x7ff158078070 2024-09-18T01:25:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.067+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94687038699904] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.067+0000 7ff169240800 20 remove_watcher() i=6 2024-09-18T01:25:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.067+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94687038702752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561e0b51c9d0 con 0x7ff158078070 2024-09-18T01:25:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94687038702752] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16000a4a0 con 0x7ff158078070 2024-09-18T01:25:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 20 remove_watcher() i=7 2024-09-18T01:25:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff158078070 msgr2=0x7ff1580bc440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff158078070 0x7ff1580bc440 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561e0b4d4a50 msgr2=0x561e0b4d6f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561e0b4d4a50 0x561e0b4d6f10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561e0b4d9440 msgr2=0x561e0b4db830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561e0b4d9440 0x561e0b4db830 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x561e0b4dddf0 msgr2=0x561e0b4e02b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x561e0b4dddf0 0x561e0b4e02b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff030036b90 msgr2=0x7ff030039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff030036b90 0x7ff030039050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x561e0b4a7b30 tx=0x7ff150010000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4c1f90 msgr2=0x561e0b4c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff167535640 1 -- 172.21.15.100:0/3051035484 reap_dead start 2024-09-18T01:25:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4c1f90 0x561e0b4c9260 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff158063e90 tx=0x7ff158009a90 comp rx=0 tx=0).stop 2024-09-18T01:25:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 shutdown_connections 2024-09-18T01:25:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 --2- 172.21.15.100:0/3051035484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4c1f90 0x561e0b4c9260 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 >> 172.21.15.100:0/3051035484 conn(0x561e0b4be390 msgr2=0x561e0b4bc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 shutdown_connections 2024-09-18T01:25:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/3051035484 wait complete. 2024-09-18T01:25:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/2054874307 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff040036b90 msgr2=0x7ff040039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 --2- 172.21.15.100:0/2054874307 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff040036b90 0x7ff040039050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x561e0b49b8f0 tx=0x7ff15000f000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/2054874307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4b54e0 msgr2=0x561e0b4b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 --2- 172.21.15.100:0/2054874307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4b54e0 0x561e0b4b5900 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff158050c70 tx=0x7ff158065e50 comp rx=0 tx=0).stop 2024-09-18T01:25:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/2054874307 shutdown_connections 2024-09-18T01:25:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 --2- 172.21.15.100:0/2054874307 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff040036b90 0x7ff040039050 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 --2- 172.21.15.100:0/2054874307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b4b54e0 0x561e0b4b5900 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/2054874307 >> 172.21.15.100:0/2054874307 conn(0x561e0b4aa470 msgr2=0x561e0b4acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/2054874307 shutdown_connections 2024-09-18T01:25:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.069+0000 7ff169240800 1 -- 172.21.15.100:0/2054874307 wait complete. 2024-09-18T01:25:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x561e0b4a4c40 msgr2=0x561e0b4a7030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff169240800 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x561e0b4a4c40 0x561e0b4a7030 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561e0b3a3b40 msgr2=0x561e0b49e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff169240800 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561e0b3a3b40 0x561e0b49e400 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561e0b4a0d50 msgr2=0x561e0b4a3140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff169240800 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561e0b4a0d50 0x561e0b4a3140 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff04c036b90 msgr2=0x7ff04c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff169240800 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff04c036b90 0x7ff04c039050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff150000f60 tx=0x7ff150001370 comp rx=0 tx=0).stop 2024-09-18T01:25:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 msgr2=0x561e0b497390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff169240800 1 --2- 172.21.15.100:0/1779483924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e0b312630 0x561e0b497390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff158067040 tx=0x7ff158002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff167535640 1 -- 172.21.15.100:0/1779483924 reap_dead start 2024-09-18T01:25:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 shutdown_connections 2024-09-18T01:25:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 >> 172.21.15.100:0/1779483924 conn(0x561e0b398db0 msgr2=0x561e0b489cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 shutdown_connections 2024-09-18T01:25:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.070+0000 7ff169240800 1 -- 172.21.15.100:0/1779483924 wait complete. 2024-09-18T01:25:31.085 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-18T01:25:31.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-18T01:25:31.085 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-18T01:25:31.137 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:31.137 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:31.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.137+0000 7f8901e0f800 1 Processor -- start 2024-09-18T01:25:31.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.137+0000 7f8901e0f800 1 -- start start 2024-09-18T01:25:31.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.137+0000 7f8901e0f800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e0198439d0 0x55e019845dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.137+0000 7f8901e0f800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e0196ffb30 con 0x55e01983f590 2024-09-18T01:25:31.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.137+0000 7f8901e0f800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55e0196e1360 con 0x55e0198439d0 2024-09-18T01:25:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.137+0000 7f88fcced640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e0198439d0 0x55e019845dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.137+0000 7f88fcced640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e0198439d0 0x55e019845dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38168/0 (socket says 172.21.15.100:38168) 2024-09-18T01:25:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.137+0000 7f88fcced640 1 -- 172.21.15.100:0/2428496568 learned_addr learned my addr 172.21.15.100:0/2428496568 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.137+0000 7f88fd4ee640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55e01983f590 0x55e01983f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37324/0 (socket says 172.21.15.100:37324) 2024-09-18T01:25:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.137+0000 7f88fcced640 1 -- 172.21.15.100:0/2428496568 >> v1:172.21.15.92:6789/0 conn(0x55e01983f590 legacy=0x55e01983f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.137+0000 7f88fcced640 1 -- 172.21.15.100:0/2428496568 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e019707e00 con 0x55e0198439d0 2024-09-18T01:25:31.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.139+0000 7f88fcced640 1 --2- 172.21.15.100:0/2428496568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0198439d0 0x55e019845dc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f88f400a520 tx=0x7f88f4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f969872418ac4e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.139+0000 7f88effff640 1 -- 172.21.15.100:0/2428496568 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f4055070 con 0x55e0198439d0 2024-09-18T01:25:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.139+0000 7f88effff640 1 -- 172.21.15.100:0/2428496568 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f40515b0 con 0x55e0198439d0 2024-09-18T01:25:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.139+0000 7f88effff640 1 -- 172.21.15.100:0/2428496568 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f40518d0 con 0x55e0198439d0 2024-09-18T01:25:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.140+0000 7f8901e0f800 1 -- 172.21.15.100:0/2428496568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0198439d0 msgr2=0x55e019845dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.140+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2428496568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0198439d0 0x55e019845dc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f88f400a520 tx=0x7f88f4045ba0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.140+0000 7f8901e0f800 1 -- 172.21.15.100:0/2428496568 shutdown_connections 2024-09-18T01:25:31.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.140+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2428496568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0198439d0 0x55e019845dc0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.140+0000 7f8901e0f800 1 -- 172.21.15.100:0/2428496568 >> 172.21.15.100:0/2428496568 conn(0x55e01983ae20 msgr2=0x55e01983d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.140+0000 7f8901e0f800 1 -- 172.21.15.100:0/2428496568 shutdown_connections 2024-09-18T01:25:31.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.140+0000 7f8901e0f800 1 -- 172.21.15.100:0/2428496568 wait complete. 2024-09-18T01:25:31.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.154+0000 7f8901e0f800 1 Processor -- start 2024-09-18T01:25:31.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.154+0000 7f8901e0f800 1 -- start start 2024-09-18T01:25:31.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.154+0000 7f8901e0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e01983f590 0x55e01992e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.154+0000 7f8901e0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e01978c370 con 0x55e01983f590 2024-09-18T01:25:31.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.154+0000 7f88fd4ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e01983f590 0x55e01992e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.154+0000 7f88fd4ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e01983f590 0x55e01992e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38172/0 (socket says 172.21.15.100:38172) 2024-09-18T01:25:31.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.154+0000 7f88fd4ee640 1 -- 172.21.15.100:0/2961578788 learned_addr learned my addr 172.21.15.100:0/2961578788 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.154+0000 7f88fd4ee640 1 -- 172.21.15.100:0/2961578788 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0196d9bc0 con 0x55e01983f590 2024-09-18T01:25:31.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.154+0000 7f88fd4ee640 1 --2- 172.21.15.100:0/2961578788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e01983f590 0x55e01992e870 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f88f000b230 tx=0x7f88f000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349ee4d8050967b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.155+0000 7f87eb606640 1 -- 172.21.15.100:0/2961578788 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f000e5c0 con 0x55e01983f590 2024-09-18T01:25:31.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.155+0000 7f87eb606640 1 -- 172.21.15.100:0/2961578788 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f0006070 con 0x55e01983f590 2024-09-18T01:25:31.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.155+0000 7f87eb606640 1 -- 172.21.15.100:0/2961578788 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f000e890 con 0x55e01983f590 2024-09-18T01:25:31.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.155+0000 7f8901e0f800 1 -- 172.21.15.100:0/2961578788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e01983f590 msgr2=0x55e01992e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.155+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2961578788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e01983f590 0x55e01992e870 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f88f000b230 tx=0x7f88f000b6f0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.155+0000 7f8901e0f800 1 -- 172.21.15.100:0/2961578788 shutdown_connections 2024-09-18T01:25:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.155+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2961578788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e01983f590 0x55e01992e870 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.155+0000 7f8901e0f800 1 -- 172.21.15.100:0/2961578788 >> 172.21.15.100:0/2961578788 conn(0x55e01983ae20 msgr2=0x55e01992a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.155+0000 7f8901e0f800 1 -- 172.21.15.100:0/2961578788 shutdown_connections 2024-09-18T01:25:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.155+0000 7f8901e0f800 1 -- 172.21.15.100:0/2961578788 wait complete. 2024-09-18T01:25:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.156+0000 7f8901e0f800 1 Processor -- start 2024-09-18T01:25:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.156+0000 7f8901e0f800 1 -- start start 2024-09-18T01:25:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.156+0000 7f8901e0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e01983f590 0x55e0197b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.156+0000 7f8901e0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e019846600 con 0x55e01983f590 2024-09-18T01:25:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.156+0000 7f88fd4ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e01983f590 0x55e0197b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.156+0000 7f88fd4ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e01983f590 0x55e0197b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38178/0 (socket says 172.21.15.100:38178) 2024-09-18T01:25:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.156+0000 7f88fd4ee640 1 -- 172.21.15.100:0/2674588103 learned_addr learned my addr 172.21.15.100:0/2674588103 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.156+0000 7f88fd4ee640 1 -- 172.21.15.100:0/2674588103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0196edfe0 con 0x55e01983f590 2024-09-18T01:25:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.156+0000 7f88fd4ee640 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e01983f590 0x55e0197b4620 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f88f0000fd0 tx=0x7f88f0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.157+0000 7f87e9e03640 1 -- 172.21.15.100:0/2674588103 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f000f8d0 con 0x55e01983f590 2024-09-18T01:25:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.157+0000 7f87e9e03640 1 -- 172.21.15.100:0/2674588103 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f000fa90 con 0x55e01983f590 2024-09-18T01:25:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.157+0000 7f87e9e03640 1 -- 172.21.15.100:0/2674588103 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f000fdb0 con 0x55e01983f590 2024-09-18T01:25:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.157+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e019937dc0 con 0x55e01983f590 2024-09-18T01:25:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.157+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e01993c720 con 0x55e01983f590 2024-09-18T01:25:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.157+0000 7f87e9e03640 1 -- 172.21.15.100:0/2674588103 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f88f0017070 con 0x55e01983f590 2024-09-18T01:25:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.158+0000 7f87e9e03640 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87e4036b90 0x7f87e4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.158+0000 7f87e9e03640 1 -- 172.21.15.100:0/2674588103 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f88f0015020 con 0x55e01983f590 2024-09-18T01:25:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.158+0000 7f88fcced640 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87e4036b90 0x7f87e4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.158+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e0198439d0 0x55e019940540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.158+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e019940b60 con 0x55e0198439d0 2024-09-18T01:25:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.158+0000 7f88fdcef640 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e0198439d0 0x55e019940540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.158+0000 7f88fcced640 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87e4036b90 0x7f87e4039050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f88f4057000 tx=0x7f88f4052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.158+0000 7f88fdcef640 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e0198439d0 0x55e019940540 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.158+0000 7f88fdcef640 1 -- 172.21.15.100:0/2674588103 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e0198439d0 2024-09-18T01:25:31.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.159+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e01993db10 con 0x55e0198439d0 2024-09-18T01:25:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.159+0000 7f88fdcef640 1 -- 172.21.15.100:0/2674588103 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e0198439d0 2024-09-18T01:25:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.159+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e019942eb0 0x55e0199452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.159+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e019945990 con 0x55e019942eb0 2024-09-18T01:25:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.159+0000 7f88fd4ee640 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e019942eb0 0x55e0199452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.159+0000 7f88fd4ee640 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e019942eb0 0x55e0199452a0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.159+0000 7f88fd4ee640 1 -- 172.21.15.100:0/2674588103 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f88f002e070 con 0x55e019942eb0 2024-09-18T01:25:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.159+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e019941d50 con 0x55e0198439d0 2024-09-18T01:25:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.160+0000 7f88fdcef640 1 -- 172.21.15.100:0/2674588103 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e0198439d0 2024-09-18T01:25:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.160+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e019946df0 0x55e0199491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.160+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e0199498e0 con 0x55e019946df0 2024-09-18T01:25:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.160+0000 7f88fcced640 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e019946df0 0x55e0199491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.160+0000 7f88fcced640 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e019946df0 0x55e0199491e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.161+0000 7f88fcced640 1 -- 172.21.15.100:0/2674588103 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f88f4057030 con 0x55e019946df0 2024-09-18T01:25:31.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.161+0000 7f8901e0f800 1 Processor -- start 2024-09-18T01:25:31.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.161+0000 7f8901e0f800 1 -- start start 2024-09-18T01:25:31.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.161+0000 7f8901e0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e019957690 0x55e019957ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.161+0000 7f8901e0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e0196db580 con 0x55e019957690 2024-09-18T01:25:31.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.161+0000 7f88fd4ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e019957690 0x55e019957ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.161+0000 7f88fd4ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e019957690 0x55e019957ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38180/0 (socket says 172.21.15.100:38180) 2024-09-18T01:25:31.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.161+0000 7f88fd4ee640 1 -- 172.21.15.100:0/2232313020 learned_addr learned my addr 172.21.15.100:0/2232313020 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.162+0000 7f88fd4ee640 1 -- 172.21.15.100:0/2232313020 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e019957ff0 con 0x55e019957690 2024-09-18T01:25:31.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.162+0000 7f88fd4ee640 1 --2- 172.21.15.100:0/2232313020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e019957690 0x55e019957ab0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f88f0000c00 tx=0x7f88f0040f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.162+0000 7f87e2ffd640 1 -- 172.21.15.100:0/2232313020 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f0017ad0 con 0x55e019957690 2024-09-18T01:25:31.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.162+0000 7f87e2ffd640 1 -- 172.21.15.100:0/2232313020 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f0035070 con 0x55e019957690 2024-09-18T01:25:31.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.162+0000 7f8901e0f800 1 -- 172.21.15.100:0/2232313020 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e019958280 con 0x55e019957690 2024-09-18T01:25:31.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.162+0000 7f87e2ffd640 1 -- 172.21.15.100:0/2232313020 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f0017da0 con 0x55e019957690 2024-09-18T01:25:31.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.162+0000 7f8901e0f800 1 -- 172.21.15.100:0/2232313020 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e01995af60 con 0x55e019957690 2024-09-18T01:25:31.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.163+0000 7f87e2ffd640 1 -- 172.21.15.100:0/2232313020 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f88f0037020 con 0x55e019957690 2024-09-18T01:25:31.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.163+0000 7f87e2ffd640 1 --2- 172.21.15.100:0/2232313020 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87d8036b90 0x7f87d8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.163+0000 7f87e2ffd640 1 -- 172.21.15.100:0/2232313020 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f88f003ac70 con 0x55e019957690 2024-09-18T01:25:31.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.163+0000 7f88fcced640 1 --2- 172.21.15.100:0/2232313020 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87d8036b90 0x7f87d8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.163+0000 7f8901e0f800 1 Processor -- start 2024-09-18T01:25:31.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.163+0000 7f8901e0f800 1 -- start start 2024-09-18T01:25:31.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.163+0000 7f88fcced640 1 --2- 172.21.15.100:0/2232313020 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87d8036b90 0x7f87d8039050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55e019941460 tx=0x7f88f4005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.163+0000 7f8901e0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0199640b0 0x55e0199644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.163+0000 7f8901e0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e01992f020 con 0x55e0199640b0 2024-09-18T01:25:31.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.163+0000 7f88fd4ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0199640b0 0x55e0199644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.163+0000 7f88fd4ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0199640b0 0x55e0199644b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38184/0 (socket says 172.21.15.100:38184) 2024-09-18T01:25:31.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.163+0000 7f88fd4ee640 1 -- 172.21.15.100:0/298056016 learned_addr learned my addr 172.21.15.100:0/298056016 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.164+0000 7f88fd4ee640 1 -- 172.21.15.100:0/298056016 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e019964a80 con 0x55e0199640b0 2024-09-18T01:25:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.164+0000 7f88fd4ee640 1 --2- 172.21.15.100:0/298056016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0199640b0 0x55e0199644b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f88f00015e0 tx=0x7f88f0044e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd5d8c343bf1f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.164+0000 7f87e0ff9640 1 -- 172.21.15.100:0/298056016 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f00441b0 con 0x55e0199640b0 2024-09-18T01:25:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.164+0000 7f87e0ff9640 1 -- 172.21.15.100:0/298056016 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f004b280 con 0x55e0199640b0 2024-09-18T01:25:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.164+0000 7f87e0ff9640 1 -- 172.21.15.100:0/298056016 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f0003a20 con 0x55e0199640b0 2024-09-18T01:25:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.164+0000 7f8901e0f800 1 -- 172.21.15.100:0/298056016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0199640b0 msgr2=0x55e0199644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.164+0000 7f8901e0f800 1 --2- 172.21.15.100:0/298056016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0199640b0 0x55e0199644b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f88f00015e0 tx=0x7f88f0044e70 comp rx=0 tx=0).stop 2024-09-18T01:25:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.164+0000 7f8901e0f800 1 -- 172.21.15.100:0/298056016 shutdown_connections 2024-09-18T01:25:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.164+0000 7f8901e0f800 1 --2- 172.21.15.100:0/298056016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0199640b0 0x55e0199644b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.164+0000 7f8901e0f800 1 -- 172.21.15.100:0/298056016 >> 172.21.15.100:0/298056016 conn(0x55e019960460 msgr2=0x55e01995e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.165+0000 7f8901e0f800 1 -- 172.21.15.100:0/298056016 shutdown_connections 2024-09-18T01:25:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.165+0000 7f8901e0f800 1 -- 172.21.15.100:0/298056016 wait complete. 2024-09-18T01:25:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.165+0000 7f8901e0f800 1 Processor -- start 2024-09-18T01:25:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.165+0000 7f8901e0f800 1 -- start start 2024-09-18T01:25:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.165+0000 7f8901e0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0199640b0 0x55e01996b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.165+0000 7f8901e0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e019964f10 con 0x55e0199640b0 2024-09-18T01:25:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.165+0000 7f88fd4ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0199640b0 0x55e01996b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.165+0000 7f88fd4ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0199640b0 0x55e01996b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38186/0 (socket says 172.21.15.100:38186) 2024-09-18T01:25:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.165+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 learned_addr learned my addr 172.21.15.100:0/482140384 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.165+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e01996b8f0 con 0x55e0199640b0 2024-09-18T01:25:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.166+0000 7f88fd4ee640 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0199640b0 0x55e01996b3b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f88f0044cd0 tx=0x7f88f0055000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.166+0000 7f87ceffd640 1 -- 172.21.15.100:0/482140384 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f0066070 con 0x55e0199640b0 2024-09-18T01:25:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.166+0000 7f87ceffd640 1 -- 172.21.15.100:0/482140384 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f00454a0 con 0x55e0199640b0 2024-09-18T01:25:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.166+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e01996b8f0 con 0x55e0199640b0 2024-09-18T01:25:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.166+0000 7f87ceffd640 1 -- 172.21.15.100:0/482140384 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f00457c0 con 0x55e0199640b0 2024-09-18T01:25:31.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.166+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e01996b8f0 con 0x55e0199640b0 2024-09-18T01:25:31.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.166+0000 7f87ceffd640 1 -- 172.21.15.100:0/482140384 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f88f005f040 con 0x55e0199640b0 2024-09-18T01:25:31.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.167+0000 7f87ceffd640 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87c8036b90 0x7f87c8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.167+0000 7f87ceffd640 1 -- 172.21.15.100:0/482140384 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f88f006ccc0 con 0x55e0199640b0 2024-09-18T01:25:31.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.167+0000 7f88fcced640 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87c8036b90 0x7f87c8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.167+0000 7f88fcced640 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87c8036b90 0x7f87c8039050 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f88f4000c00 tx=0x7f88f406d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.167+0000 7f8901e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.167+0000 7f8901e0f800 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e019976ab0 0x55e019978f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.167+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e0199796c0 con 0x55e019976ab0 2024-09-18T01:25:31.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.167+0000 7f88fdcef640 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e019976ab0 0x55e019978f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f88fdcef640 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e019976ab0 0x55e019978f70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f8901e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f8901e0f800 20 realm 2024-09-18T01:25:31.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f8901e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e019979ad0 con 0x55e019976ab0 2024-09-18T01:25:31.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f8901e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f8901e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f8901e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a3a0 con 0x55e019976ab0 2024-09-18T01:25:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f8901e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f8901e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.168+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e019976ab0 2024-09-18T01:25:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.169+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.169+0000 7f8901e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.169+0000 7f8901e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.169+0000 7f8901e0f800 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e01997b4a0 0x55e01997d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.169+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e01997dea0 con 0x55e01997b4a0 2024-09-18T01:25:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.169+0000 7f88fd4ee640 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e01997b4a0 0x55e01997d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.169+0000 7f88fd4ee640 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e01997b4a0 0x55e01997d890 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.169+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f88f002e070 con 0x55e01997b4a0 2024-09-18T01:25:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.169+0000 7f8901e0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.169+0000 7f8901e0f800 20 searching for the correct realm 2024-09-18T01:25:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.169+0000 7f8901e0f800 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e01997fe50 0x55e019982310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.169+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e0199829e0 con 0x55e01997fe50 2024-09-18T01:25:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.170+0000 7f88fcced640 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e01997fe50 0x55e019982310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.170+0000 7f88fcced640 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e01997fe50 0x55e019982310 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.170+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.170+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e0199829e0 con 0x55e01997b4a0 2024-09-18T01:25:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.170+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f002e070 con 0x55e01997b4a0 2024-09-18T01:25:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.170+0000 7f88fd4ee640 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88f0062040 0x7f88f0031650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.170+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e0199829e0 con 0x7f88f0062040 2024-09-18T01:25:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.171+0000 7f88fdcef640 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88f0062040 0x7f88f0031650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.171+0000 7f88fdcef640 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88f0062040 0x7f88f0031650 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.171+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.171+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e019976ab0 2024-09-18T01:25:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.171+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.171+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e019976ab0 2024-09-18T01:25:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.172+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.172+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x7f88f0062040 2024-09-18T01:25:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.172+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.172+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x7f88f0062040 2024-09-18T01:25:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.172+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.172+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e01997b4a0 2024-09-18T01:25:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.172+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f002e070 con 0x55e01997b4a0 2024-09-18T01:25:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.172+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e01997fe50 2024-09-18T01:25:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.173+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.173+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e019976ab0 2024-09-18T01:25:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.173+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.173+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x7f88f0062040 2024-09-18T01:25:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.173+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.173+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e019976ab0 2024-09-18T01:25:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.173+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.173+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e01997b4a0 2024-09-18T01:25:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.174+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f88f002e070 con 0x55e01997b4a0 2024-09-18T01:25:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.174+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e01997fe50 2024-09-18T01:25:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.174+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.174+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e01997fe50 2024-09-18T01:25:31.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.174+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.174+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x7f88f0062040 2024-09-18T01:25:31.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.174+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.174+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e01997fe50 2024-09-18T01:25:31.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.174+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.174+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e01997fe50 2024-09-18T01:25:31.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.175+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.175+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e019976ab0 2024-09-18T01:25:31.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.175+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.175+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e019976ab0 2024-09-18T01:25:31.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.175+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.175+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x7f88f0062040 2024-09-18T01:25:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.176+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.176+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e01997fe50 2024-09-18T01:25:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.176+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.176+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e01997b4a0 2024-09-18T01:25:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.176+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f002e070 con 0x55e01997b4a0 2024-09-18T01:25:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.176+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e019976ab0 2024-09-18T01:25:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.176+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.176+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x7f88f0062040 2024-09-18T01:25:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.177+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.177+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e01997fe50 2024-09-18T01:25:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.177+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.177+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x7f88f0062040 2024-09-18T01:25:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.177+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.177+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e01997b4a0 2024-09-18T01:25:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.177+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f002e070 con 0x55e01997b4a0 2024-09-18T01:25:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.177+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e01997fe50 2024-09-18T01:25:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x7f88f0062040 2024-09-18T01:25:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e019976ab0 2024-09-18T01:25:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e01997a740 con 0x55e01997b4a0 2024-09-18T01:25:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f88f002e070 con 0x55e01997b4a0 2024-09-18T01:25:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f8901e0f800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f8901e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f8901e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f8901e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f8901e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f8901e0f800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f8901e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e01997e760 con 0x55e019976ab0 2024-09-18T01:25:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.178+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e01997eb50 con 0x55e019976ab0 2024-09-18T01:25:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e01997eb50 con 0x7f88f0062040 2024-09-18T01:25:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 20 zone default found 2024-09-18T01:25:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 4 Realm: () 2024-09-18T01:25:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 20 zonegroup default 2024-09-18T01:25:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e01997e3c0 con 0x7f88f0062040 2024-09-18T01:25:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.179+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e01997e3c0 con 0x55e01997fe50 2024-09-18T01:25:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.180+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.180+0000 7f8901e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.180+0000 7f8901e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.180+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e0199848f0 con 0x55e01997fe50 2024-09-18T01:25:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.180+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.180+0000 7f8901e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.180+0000 7f8901e0f800 20 started sync module instance, tier type = 2024-09-18T01:25:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.180+0000 7f8901e0f800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.180+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e019983ce0 con 0x55e01997b4a0 2024-09-18T01:25:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.181+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f002e070 con 0x55e01997b4a0 2024-09-18T01:25:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.181+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94420990443728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e019985200 con 0x55e01997b4a0 2024-09-18T01:25:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.181+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e019985a50 con 0x55e019976ab0 2024-09-18T01:25:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.182+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94420990443728] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f002e070 con 0x55e01997b4a0 2024-09-18T01:25:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.182+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.182+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94420990446928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e019985ab0 con 0x55e019976ab0 2024-09-18T01:25:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.182+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199865a0 con 0x55e01997fe50 2024-09-18T01:25:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.183+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94420990446928] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.184+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.184+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94420990451824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199869c0 con 0x55e01997fe50 2024-09-18T01:25:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.184+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199873e0 con 0x55e01997b4a0 2024-09-18T01:25:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.185+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94420990451824] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.185+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f002e070 con 0x55e01997b4a0 2024-09-18T01:25:31.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.185+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94420990449056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e019987cb0 con 0x55e01997b4a0 2024-09-18T01:25:31.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.185+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e019988670 con 0x55e019976ab0 2024-09-18T01:25:31.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.186+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.186+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94420990460352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199885e0 con 0x55e019976ab0 2024-09-18T01:25:31.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.186+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e019989640 con 0x7f88f0062040 2024-09-18T01:25:31.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.186+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94420990449056] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f002e070 con 0x55e01997b4a0 2024-09-18T01:25:31.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.186+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.187+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94420990464304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e019989600 con 0x7f88f0062040 2024-09-18T01:25:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.187+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e01998a080 con 0x7f88f0062040 2024-09-18T01:25:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.187+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94420990460352] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.187+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94420990464304] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.188+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.188+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94420990457856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e019989bd0 con 0x7f88f0062040 2024-09-18T01:25:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.188+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e01998a590 con 0x7f88f0062040 2024-09-18T01:25:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.189+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94420990457856] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.189+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.189+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94420990462560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e01998a590 con 0x7f88f0062040 2024-09-18T01:25:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.189+0000 7f8901e0f800 20 add_watcher() i=0 2024-09-18T01:25:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.189+0000 7f8901e0f800 20 add_watcher() i=1 2024-09-18T01:25:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.189+0000 7f8901e0f800 20 add_watcher() i=2 2024-09-18T01:25:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.189+0000 7f8901e0f800 20 add_watcher() i=3 2024-09-18T01:25:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.189+0000 7f8901e0f800 20 add_watcher() i=4 2024-09-18T01:25:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.189+0000 7f8901e0f800 20 add_watcher() i=5 2024-09-18T01:25:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.189+0000 7f8901e0f800 20 add_watcher() i=6 2024-09-18T01:25:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.189+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94420990462560] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.189+0000 7f8901e0f800 20 add_watcher() i=7 2024-09-18T01:25:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.189+0000 7f8901e0f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.190+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e01998d850 con 0x55e019976ab0 2024-09-18T01:25:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.190+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.190+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94420990468688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e01998ab20 con 0x55e019976ab0 2024-09-18T01:25:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.191+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94420990468688] v33'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.191+0000 7f87b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.191+0000 7f8901e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:31.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.191+0000 7f8901e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:31.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.191+0000 7f8901e0f800 5 note: GC not initialized 2024-09-18T01:25:31.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.191+0000 7f87b27e4640 20 reqs_thread_entry: start 2024-09-18T01:25:31.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.191+0000 7f8901e0f800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:31.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.192+0000 7f8901e0f800 20 Filter name: none 2024-09-18T01:25:31.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.192+0000 7f8723fff640 20 reqs_thread_entry: start 2024-09-18T01:25:31.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.192+0000 7f8901e0f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:25:31.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.192+0000 7f8901e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.192+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e0199c0d70 con 0x7f88f0062040 2024-09-18T01:25:31.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.192+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.192+0000 7f8901e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.192+0000 7f8901e0f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-18T01:25:31.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.192+0000 7f8901e0f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:25:31.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.192+0000 7f8901e0f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-18T01:25:31.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.192+0000 7f8901e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.192+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e0199bf3b0 con 0x7f88f0062040 2024-09-18T01:25:31.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.193+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.193+0000 7f8901e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.193+0000 7f8901e0f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-18T01:25:31.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.193+0000 7f8901e0f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:25:31.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.193+0000 7f8901e0f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T01:25:31.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.193+0000 7f8901e0f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T01:25:31.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.193+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199bfc80 con 0x7f88f0062040 2024-09-18T01:25:31.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.194+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v33'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.194+0000 7f8901e0f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-18T01:25:31.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.194+0000 7f8901e0f800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:25:31.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.194+0000 7f8901e0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-18T01:25:31.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.194+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94420990687184 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e0199c4810 con 0x7f88f0062040 2024-09-18T01:25:31.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.194+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== watch-notify(notify (1) cookie 94420990464304 notify 141733920770 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55e0199c0020 con 0x7f88f0062040 2024-09-18T01:25:31.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.194+0000 7f87e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 94420990464304 notifier 4496 bl.length()=556 2024-09-18T01:25:31.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.194+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(65 notify.5 [notify cookie 94420990687184 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.194+0000 7f87e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-18T01:25:31.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.194+0000 7f87e0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:25:31.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.194+0000 7f87e0ff9640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f87c0003ea0 con 0x7f88f0062040 2024-09-18T01:25:31.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.195+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.195+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== watch-notify(notify_complete (2) cookie 94420990687184 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e0199c07c0 con 0x7f88f0062040 2024-09-18T01:25:31.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.195+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199c2340 con 0x7f88f0062040 2024-09-18T01:25:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.196+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.196+0000 7f8901e0f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:25:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.196+0000 7f8901e0f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:25:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.196+0000 7f8901e0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:25:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.196+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94420990687104 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e0199c4810 con 0x55e01997fe50 2024-09-18T01:25:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.196+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== watch-notify(notify (1) cookie 94420990451824 notify 141733920770 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55e019707e00 con 0x55e01997fe50 2024-09-18T01:25:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.196+0000 7f87e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 94420990451824 notifier 4496 bl.length()=177 2024-09-18T01:25:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.196+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(68 notify.2 [notify cookie 94420990687104 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.196+0000 7f87e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:25:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.196+0000 7f87e0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:25:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.196+0000 7f87e0ff9640 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f87c0003ea0 con 0x55e01997fe50 2024-09-18T01:25:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.196+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.196+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== watch-notify(notify_complete (2) cookie 94420990687104 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f88f4080680 con 0x55e01997fe50 2024-09-18T01:25:31.211 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T01:25:31.194136Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:31.194124Z","tags":[],"group_ids":[]} 2024-09-18T01:25:31.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.197+0000 7f87b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:31.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.197+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94420990468688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199bea50 con 0x55e019976ab0 2024-09-18T01:25:31.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.198+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94420990468688] v33'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.198+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94420990443728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199bea50 con 0x55e01997b4a0 2024-09-18T01:25:31.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.199+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94420990443728] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f002e070 con 0x55e01997b4a0 2024-09-18T01:25:31.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.199+0000 7f8901e0f800 20 remove_watcher() i=0 2024-09-18T01:25:31.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.199+0000 7f8901e0f800 2 removed watcher, disabling cache 2024-09-18T01:25:31.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.199+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94420990446928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199bea50 con 0x55e019976ab0 2024-09-18T01:25:31.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.200+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94420990446928] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.200+0000 7f8901e0f800 20 remove_watcher() i=1 2024-09-18T01:25:31.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.200+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94420990451824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199bea50 con 0x55e01997fe50 2024-09-18T01:25:31.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.201+0000 7f88fcced640 1 -- 172.21.15.100:0/482140384 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94420990451824] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f4057030 con 0x55e01997fe50 2024-09-18T01:25:31.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.201+0000 7f8901e0f800 20 remove_watcher() i=2 2024-09-18T01:25:31.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.201+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94420990449056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199bea50 con 0x55e01997b4a0 2024-09-18T01:25:31.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.202+0000 7f88fd4ee640 1 -- 172.21.15.100:0/482140384 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94420990449056] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f002e070 con 0x55e01997b4a0 2024-09-18T01:25:31.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.202+0000 7f8901e0f800 20 remove_watcher() i=3 2024-09-18T01:25:31.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.202+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94420990460352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199bea50 con 0x55e019976ab0 2024-09-18T01:25:31.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.203+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94420990460352] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x55e019976ab0 2024-09-18T01:25:31.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.203+0000 7f8901e0f800 20 remove_watcher() i=4 2024-09-18T01:25:31.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.203+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94420990464304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199bea50 con 0x7f88f0062040 2024-09-18T01:25:31.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.204+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94420990464304] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.204+0000 7f8901e0f800 20 remove_watcher() i=5 2024-09-18T01:25:31.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.204+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94420990457856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199bea50 con 0x7f88f0062040 2024-09-18T01:25:31.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.205+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94420990457856] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.205+0000 7f8901e0f800 20 remove_watcher() i=6 2024-09-18T01:25:31.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.205+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94420990462560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e0199bea50 con 0x7f88f0062040 2024-09-18T01:25:31.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94420990462560] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f800a4a0 con 0x7f88f0062040 2024-09-18T01:25:31.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 20 remove_watcher() i=7 2024-09-18T01:25:31.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88f0062040 msgr2=0x7f88f0031650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f88f0062040 0x7f88f0031650 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e019976ab0 msgr2=0x55e019978f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e019976ab0 0x55e019978f70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e01997b4a0 msgr2=0x55e01997d890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e01997b4a0 0x55e01997d890 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e01997fe50 msgr2=0x55e019982310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e01997fe50 0x55e019982310 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87c8036b90 msgr2=0x7f87c8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87c8036b90 0x7f87c8039050 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f88f4000c00 tx=0x7f88f406d040 comp rx=0 tx=0).stop 2024-09-18T01:25:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f88fdcef640 1 -- 172.21.15.100:0/482140384 reap_dead start 2024-09-18T01:25:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0199640b0 msgr2=0x55e01996b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0199640b0 0x55e01996b3b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f88f0044cd0 tx=0x7f88f0055000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 shutdown_connections 2024-09-18T01:25:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 --2- 172.21.15.100:0/482140384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0199640b0 0x55e01996b3b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 >> 172.21.15.100:0/482140384 conn(0x55e019960460 msgr2=0x55e01995e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 shutdown_connections 2024-09-18T01:25:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.206+0000 7f8901e0f800 1 -- 172.21.15.100:0/482140384 wait complete. 2024-09-18T01:25:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2232313020 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87d8036b90 msgr2=0x7f87d8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2232313020 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87d8036b90 0x7f87d8039050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55e019941460 tx=0x7f88f4005ac0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2232313020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e019957690 msgr2=0x55e019957ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2232313020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e019957690 0x55e019957ab0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f88f0000c00 tx=0x7f88f0040f90 comp rx=0 tx=0).stop 2024-09-18T01:25:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2232313020 shutdown_connections 2024-09-18T01:25:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2232313020 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87d8036b90 0x7f87d8039050 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2232313020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e019957690 0x55e019957ab0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2232313020 >> 172.21.15.100:0/2232313020 conn(0x55e01994c620 msgr2=0x55e01994f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2232313020 shutdown_connections 2024-09-18T01:25:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2232313020 wait complete. 2024-09-18T01:25:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e019946df0 msgr2=0x55e0199491e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e019946df0 0x55e0199491e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e0198439d0 msgr2=0x55e019940540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e0198439d0 0x55e019940540 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e019942eb0 msgr2=0x55e0199452a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e019942eb0 0x55e0199452a0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87e4036b90 msgr2=0x7f87e4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f87e4036b90 0x7f87e4039050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f88f4057000 tx=0x7f88f4052000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e01983f590 msgr2=0x55e0197b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 --2- 172.21.15.100:0/2674588103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e01983f590 0x55e0197b4620 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f88f0000fd0 tx=0x7f88f0000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f88fdcef640 1 -- 172.21.15.100:0/2674588103 reap_dead start 2024-09-18T01:25:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 shutdown_connections 2024-09-18T01:25:31.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 >> 172.21.15.100:0/2674588103 conn(0x55e01983ae20 msgr2=0x55e019928ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 shutdown_connections 2024-09-18T01:25:31.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.207+0000 7f8901e0f800 1 -- 172.21.15.100:0/2674588103 wait complete. 2024-09-18T01:25:31.222 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T01:25:31.194136Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:31.194124Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:31.227 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-18T01:25:31.231 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:31.232 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-18T01:25:31.232 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-18T01:25:31.232 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-18T01:25:31.274 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:31.274 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.274+0000 7fd5cabaf800 1 Processor -- start 2024-09-18T01:25:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.274+0000 7fd5cabaf800 1 -- start start 2024-09-18T01:25:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.274+0000 7fd5cabaf800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558eaed40630 0x558eaedcf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.274+0000 7fd5cabaf800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558eaec8bb30 con 0x558eaedcf790 2024-09-18T01:25:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.274+0000 7fd5cabaf800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x558eaec6d360 con 0x558eaed40630 2024-09-18T01:25:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.274+0000 7fd5c86a3640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558eaed40630 0x558eaedcf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.275+0000 7fd5c86a3640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558eaed40630 0x558eaedcf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38196/0 (socket says 172.21.15.100:38196) 2024-09-18T01:25:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.275+0000 7fd5bffff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x558eaedcf790 0x558eaedd1b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37332/0 (socket says 172.21.15.100:37332) 2024-09-18T01:25:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.275+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2055960362 learned_addr learned my addr 172.21.15.100:0/2055960362 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.275+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2055960362 >> v1:172.21.15.92:6789/0 conn(0x558eaedcf790 legacy=0x558eaedd1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.275+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2055960362 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eaec93e00 con 0x558eaed40630 2024-09-18T01:25:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.277+0000 7fd5c86a3640 1 --2- 172.21.15.100:0/2055960362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 0x558eaedcf250 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800a520 tx=0x7fd5b8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae07812a254cbb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.277+0000 7fd5c7ea2640 1 -- 172.21.15.100:0/2055960362 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5b8055070 con 0x558eaed40630 2024-09-18T01:25:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.277+0000 7fd5c7ea2640 1 -- 172.21.15.100:0/2055960362 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b80515b0 con 0x558eaed40630 2024-09-18T01:25:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.277+0000 7fd5c7ea2640 1 -- 172.21.15.100:0/2055960362 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5b80518d0 con 0x558eaed40630 2024-09-18T01:25:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.277+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2055960362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 msgr2=0x558eaedcf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.277+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/2055960362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 0x558eaedcf250 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800a520 tx=0x7fd5b8045ba0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.277+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2055960362 shutdown_connections 2024-09-18T01:25:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.277+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/2055960362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 0x558eaedcf250 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.277+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2055960362 >> 172.21.15.100:0/2055960362 conn(0x558eaedc6de0 msgr2=0x558eaedc9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.277+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2055960362 shutdown_connections 2024-09-18T01:25:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.277+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2055960362 wait complete. 2024-09-18T01:25:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.291+0000 7fd5cabaf800 1 Processor -- start 2024-09-18T01:25:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.291+0000 7fd5cabaf800 1 -- start start 2024-09-18T01:25:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.291+0000 7fd5cabaf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 0x558eaedccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.291+0000 7fd5cabaf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558eaed18330 con 0x558eaed40630 2024-09-18T01:25:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.291+0000 7fd5c86a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 0x558eaedccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.291+0000 7fd5c86a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 0x558eaedccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38210/0 (socket says 172.21.15.100:38210) 2024-09-18T01:25:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.291+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2562321505 learned_addr learned my addr 172.21.15.100:0/2562321505 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.292+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2562321505 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eaec65bc0 con 0x558eaed40630 2024-09-18T01:25:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.292+0000 7fd5c86a3640 1 --2- 172.21.15.100:0/2562321505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 0x558eaedccb80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8025da0 tx=0x7fd5b8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df5f4f38572cfdd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.292+0000 7fd4b660c640 1 -- 172.21.15.100:0/2562321505 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5b8051950 con 0x558eaed40630 2024-09-18T01:25:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.292+0000 7fd4b660c640 1 -- 172.21.15.100:0/2562321505 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b8051af0 con 0x558eaed40630 2024-09-18T01:25:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.292+0000 7fd4b660c640 1 -- 172.21.15.100:0/2562321505 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5b8051dd0 con 0x558eaed40630 2024-09-18T01:25:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.293+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2562321505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 msgr2=0x558eaedccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.293+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/2562321505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 0x558eaedccb80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8025da0 tx=0x7fd5b8051000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.293+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2562321505 shutdown_connections 2024-09-18T01:25:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.293+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/2562321505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 0x558eaedccb80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.293+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2562321505 >> 172.21.15.100:0/2562321505 conn(0x558eaedc6de0 msgr2=0x558eaeeb7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.293+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2562321505 shutdown_connections 2024-09-18T01:25:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.293+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2562321505 wait complete. 2024-09-18T01:25:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.293+0000 7fd5cabaf800 1 Processor -- start 2024-09-18T01:25:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.293+0000 7fd5cabaf800 1 -- start start 2024-09-18T01:25:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.293+0000 7fd5cabaf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 0x558eaeec53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.293+0000 7fd5cabaf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558eaedd3690 con 0x558eaed40630 2024-09-18T01:25:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.293+0000 7fd5c86a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 0x558eaeec53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.293+0000 7fd5c86a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 0x558eaeec53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38212/0 (socket says 172.21.15.100:38212) 2024-09-18T01:25:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.293+0000 7fd5c86a3640 1 -- 172.21.15.100:0/1710973716 learned_addr learned my addr 172.21.15.100:0/1710973716 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.294+0000 7fd5c86a3640 1 -- 172.21.15.100:0/1710973716 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eaec79fe0 con 0x558eaed40630 2024-09-18T01:25:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.294+0000 7fd5c86a3640 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 0x558eaeec53c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8067040 tx=0x7fd5b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.294+0000 7fd4b4e09640 1 -- 172.21.15.100:0/1710973716 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5b8073070 con 0x558eaed40630 2024-09-18T01:25:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.294+0000 7fd4b4e09640 1 -- 172.21.15.100:0/1710973716 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b805a450 con 0x558eaed40630 2024-09-18T01:25:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.294+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558eaeec5900 con 0x558eaed40630 2024-09-18T01:25:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.294+0000 7fd4b4e09640 1 -- 172.21.15.100:0/1710973716 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5b805a730 con 0x558eaed40630 2024-09-18T01:25:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.294+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eaeec5e80 con 0x558eaed40630 2024-09-18T01:25:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.295+0000 7fd4b4e09640 1 -- 172.21.15.100:0/1710973716 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd5b8076070 con 0x558eaed40630 2024-09-18T01:25:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.295+0000 7fd4b4e09640 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4b0036b40 0x7fd4b0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.295+0000 7fd4b4e09640 1 -- 172.21.15.100:0/1710973716 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fd5b8062070 con 0x558eaed40630 2024-09-18T01:25:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.295+0000 7fd5bffff640 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4b0036b40 0x7fd4b0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.295+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558eaedcf790 0x558eaeecc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.295+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaeecc9b0 con 0x558eaedcf790 2024-09-18T01:25:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.295+0000 7fd5c8ea4640 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558eaedcf790 0x558eaeecc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.295+0000 7fd5bffff640 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4b0036b40 0x7fd4b0039000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0000f60 tx=0x7fd5b0001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.295+0000 7fd5c8ea4640 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558eaedcf790 0x558eaeecc430 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.296+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/1710973716 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaedcf790 2024-09-18T01:25:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.296+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaeec9a00 con 0x558eaedcf790 2024-09-18T01:25:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.296+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/1710973716 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaedcf790 2024-09-18T01:25:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.296+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558eaeecece0 0x558eaeed10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.296+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaeed1770 con 0x558eaeecece0 2024-09-18T01:25:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.296+0000 7fd5c86a3640 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558eaeecece0 0x558eaeed10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.296+0000 7fd5c86a3640 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558eaeecece0 0x558eaeed10d0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.297+0000 7fd5c86a3640 1 -- 172.21.15.100:0/1710973716 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd5b8075030 con 0x558eaeecece0 2024-09-18T01:25:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.297+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaeecdb80 con 0x558eaedcf790 2024-09-18T01:25:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.297+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/1710973716 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaedcf790 2024-09-18T01:25:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.297+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558eaeed2bd0 0x558eaeed4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.297+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaeed56c0 con 0x558eaeed2bd0 2024-09-18T01:25:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.297+0000 7fd5bffff640 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558eaeed2bd0 0x558eaeed4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.298+0000 7fd5bffff640 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558eaeed2bd0 0x558eaeed4fc0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.298+0000 7fd5bffff640 1 -- 172.21.15.100:0/1710973716 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd5b000f690 con 0x558eaeed2bd0 2024-09-18T01:25:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.298+0000 7fd5cabaf800 1 Processor -- start 2024-09-18T01:25:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.298+0000 7fd5cabaf800 1 -- start start 2024-09-18T01:25:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.298+0000 7fd5cabaf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeee3470 0x558eaeee3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.298+0000 7fd5cabaf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558eaec67580 con 0x558eaeee3470 2024-09-18T01:25:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.299+0000 7fd5c86a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeee3470 0x558eaeee3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.299+0000 7fd5c86a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeee3470 0x558eaeee3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38226/0 (socket says 172.21.15.100:38226) 2024-09-18T01:25:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.299+0000 7fd5c86a3640 1 -- 172.21.15.100:0/1058668363 learned_addr learned my addr 172.21.15.100:0/1058668363 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.299+0000 7fd5c86a3640 1 -- 172.21.15.100:0/1058668363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eaeee3dd0 con 0x558eaeee3470 2024-09-18T01:25:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.299+0000 7fd5c86a3640 1 --2- 172.21.15.100:0/1058668363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeee3470 0x558eaeee3890 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd5b808f5b0 tx=0x7fd5b806ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.299+0000 7fd4adffb640 1 -- 172.21.15.100:0/1058668363 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5b8099070 con 0x558eaeee3470 2024-09-18T01:25:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.299+0000 7fd4adffb640 1 -- 172.21.15.100:0/1058668363 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b8065bb0 con 0x558eaeee3470 2024-09-18T01:25:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.299+0000 7fd4adffb640 1 -- 172.21.15.100:0/1058668363 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5b806e3c0 con 0x558eaeee3470 2024-09-18T01:25:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.299+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1058668363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558eaeee4060 con 0x558eaeee3470 2024-09-18T01:25:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.299+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1058668363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eaeee6d40 con 0x558eaeee3470 2024-09-18T01:25:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.300+0000 7fd4adffb640 1 -- 172.21.15.100:0/1058668363 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd5b809c070 con 0x558eaeee3470 2024-09-18T01:25:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.300+0000 7fd4adffb640 1 --2- 172.21.15.100:0/1058668363 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4a0036b90 0x7fd4a0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.300+0000 7fd4adffb640 1 -- 172.21.15.100:0/1058668363 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fd5b809fca0 con 0x558eaeee3470 2024-09-18T01:25:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.300+0000 7fd5bffff640 1 --2- 172.21.15.100:0/1058668363 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4a0036b90 0x7fd4a0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.301+0000 7fd5cabaf800 1 Processor -- start 2024-09-18T01:25:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.301+0000 7fd5cabaf800 1 -- start start 2024-09-18T01:25:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.301+0000 7fd5bffff640 1 --2- 172.21.15.100:0/1058668363 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4a0036b90 0x7fd4a0039050 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x558eaeec9920 tx=0x7fd5b000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.301+0000 7fd5cabaf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeeeff20 0x558eaeef0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.301+0000 7fd5cabaf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558eaedcb160 con 0x558eaeeeff20 2024-09-18T01:25:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.301+0000 7fd5c86a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeeeff20 0x558eaeef0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.301+0000 7fd5c86a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeeeff20 0x558eaeef0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38232/0 (socket says 172.21.15.100:38232) 2024-09-18T01:25:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.301+0000 7fd5c86a3640 1 -- 172.21.15.100:0/4174340746 learned_addr learned my addr 172.21.15.100:0/4174340746 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.301+0000 7fd5c86a3640 1 -- 172.21.15.100:0/4174340746 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eaeef08f0 con 0x558eaeeeff20 2024-09-18T01:25:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.301+0000 7fd5c86a3640 1 --2- 172.21.15.100:0/4174340746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeeeff20 0x558eaeef0320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd5b806ec20 tx=0x7fd5b806e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afe1ab2151ed581 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.301+0000 7fd49f7fe640 1 -- 172.21.15.100:0/4174340746 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5b80a9040 con 0x558eaeeeff20 2024-09-18T01:25:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.301+0000 7fd49f7fe640 1 -- 172.21.15.100:0/4174340746 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b8094d40 con 0x558eaeeeff20 2024-09-18T01:25:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.301+0000 7fd49f7fe640 1 -- 172.21.15.100:0/4174340746 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5b8063310 con 0x558eaeeeff20 2024-09-18T01:25:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.302+0000 7fd5cabaf800 1 -- 172.21.15.100:0/4174340746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeeeff20 msgr2=0x558eaeef0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.302+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/4174340746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeeeff20 0x558eaeef0320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd5b806ec20 tx=0x7fd5b806e930 comp rx=0 tx=0).stop 2024-09-18T01:25:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.302+0000 7fd5cabaf800 1 -- 172.21.15.100:0/4174340746 shutdown_connections 2024-09-18T01:25:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.302+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/4174340746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeeeff20 0x558eaeef0320 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.302+0000 7fd5cabaf800 1 -- 172.21.15.100:0/4174340746 >> 172.21.15.100:0/4174340746 conn(0x558eaeeec2d0 msgr2=0x558eaeeea3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.302+0000 7fd5cabaf800 1 -- 172.21.15.100:0/4174340746 shutdown_connections 2024-09-18T01:25:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.302+0000 7fd5cabaf800 1 -- 172.21.15.100:0/4174340746 wait complete. 2024-09-18T01:25:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.302+0000 7fd5cabaf800 1 Processor -- start 2024-09-18T01:25:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.302+0000 7fd5cabaf800 1 -- start start 2024-09-18T01:25:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.302+0000 7fd5cabaf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeeeff20 0x558eaeef71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.302+0000 7fd5cabaf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558eaeef0d40 con 0x558eaeeeff20 2024-09-18T01:25:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.303+0000 7fd5c86a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeeeff20 0x558eaeef71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.303+0000 7fd5c86a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeeeff20 0x558eaeef71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38242/0 (socket says 172.21.15.100:38242) 2024-09-18T01:25:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.303+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 learned_addr learned my addr 172.21.15.100:0/2868345 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.303+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eaeef7700 con 0x558eaeeeff20 2024-09-18T01:25:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.303+0000 7fd5c86a3640 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeeeff20 0x558eaeef71c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd5b801bb60 tx=0x7fd5b8098f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.303+0000 7fd49dffb640 1 -- 172.21.15.100:0/2868345 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5b80bc020 con 0x558eaeeeff20 2024-09-18T01:25:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.303+0000 7fd49dffb640 1 -- 172.21.15.100:0/2868345 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b80674b0 con 0x558eaeeeff20 2024-09-18T01:25:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.303+0000 7fd49dffb640 1 -- 172.21.15.100:0/2868345 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5b8063a00 con 0x558eaeeeff20 2024-09-18T01:25:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.303+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558eaeef7700 con 0x558eaeeeff20 2024-09-18T01:25:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.303+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eaeef7700 con 0x558eaeeeff20 2024-09-18T01:25:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.304+0000 7fd49dffb640 1 -- 172.21.15.100:0/2868345 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd5b80bf020 con 0x558eaeeeff20 2024-09-18T01:25:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.304+0000 7fd49dffb640 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd490036b90 0x7fd490039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.304+0000 7fd49dffb640 1 -- 172.21.15.100:0/2868345 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fd5b80b3040 con 0x558eaeeeff20 2024-09-18T01:25:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.304+0000 7fd5bffff640 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd490036b90 0x7fd490039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.304+0000 7fd5cabaf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.304+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558eaef02920 0x558eaef04de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.305+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaef05530 con 0x558eaef02920 2024-09-18T01:25:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.305+0000 7fd5c8ea4640 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558eaef02920 0x558eaef04de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.305+0000 7fd5bffff640 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd490036b90 0x7fd490039050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x558eaeed5ac0 tx=0x7fd5b0010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.305+0000 7fd5c8ea4640 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558eaef02920 0x558eaef04de0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.305+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.305+0000 7fd5cabaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.305+0000 7fd5cabaf800 20 realm 2024-09-18T01:25:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.305+0000 7fd5cabaf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.305+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaef05940 con 0x558eaef02920 2024-09-18T01:25:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.305+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.305+0000 7fd5cabaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.305+0000 7fd5cabaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.305+0000 7fd5cabaf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.305+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaef06210 con 0x558eaef02920 2024-09-18T01:25:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.306+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.306+0000 7fd5cabaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.306+0000 7fd5cabaf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.306+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef02920 2024-09-18T01:25:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.306+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.306+0000 7fd5cabaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.306+0000 7fd5cabaf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.306+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558eaef070a0 0x558eaef09490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.306+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaef09bf0 con 0x558eaef070a0 2024-09-18T01:25:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.306+0000 7fd5c86a3640 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558eaef070a0 0x558eaef09490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.306+0000 7fd5c86a3640 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558eaef070a0 0x558eaef09490 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.306+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd5b809b030 con 0x558eaef070a0 2024-09-18T01:25:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.306+0000 7fd5cabaf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.306+0000 7fd5cabaf800 20 searching for the correct realm 2024-09-18T01:25:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.307+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558eaef0bcd0 0x558eaef0e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.307+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef0e860 con 0x558eaef0bcd0 2024-09-18T01:25:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.307+0000 7fd5bffff640 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558eaef0bcd0 0x558eaef0e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.307+0000 7fd5bffff640 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558eaef0bcd0 0x558eaef0e190 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.307+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5b0037040 con 0x558eaef0bcd0 2024-09-18T01:25:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.307+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef0e860 con 0x558eaef070a0 2024-09-18T01:25:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.307+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5b809b030 con 0x558eaef070a0 2024-09-18T01:25:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.307+0000 7fd5c86a3640 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd5b80cc040 0x7fd5b80ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.307+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef0e860 con 0x7fd5b80cc040 2024-09-18T01:25:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.308+0000 7fd5c8ea4640 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd5b80cc040 0x7fd5b80ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.308+0000 7fd5c8ea4640 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd5b80cc040 0x7fd5b80ad420 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.309+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.309+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef02920 2024-09-18T01:25:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.309+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.309+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef02920 2024-09-18T01:25:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.309+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.309+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x7fd5b80cc040 2024-09-18T01:25:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.309+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.309+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x7fd5b80cc040 2024-09-18T01:25:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.310+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.310+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef070a0 2024-09-18T01:25:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.310+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5b809b030 con 0x558eaef070a0 2024-09-18T01:25:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.310+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef0bcd0 2024-09-18T01:25:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.310+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5b0037040 con 0x558eaef0bcd0 2024-09-18T01:25:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.310+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef02920 2024-09-18T01:25:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.310+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.310+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x7fd5b80cc040 2024-09-18T01:25:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.311+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.311+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef02920 2024-09-18T01:25:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.311+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.311+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef070a0 2024-09-18T01:25:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.311+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd5b809b030 con 0x558eaef070a0 2024-09-18T01:25:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.311+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef0bcd0 2024-09-18T01:25:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.311+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5b0037040 con 0x558eaef0bcd0 2024-09-18T01:25:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.311+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef0bcd0 2024-09-18T01:25:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.311+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5b0037040 con 0x558eaef0bcd0 2024-09-18T01:25:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.311+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x7fd5b80cc040 2024-09-18T01:25:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.312+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.312+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef0bcd0 2024-09-18T01:25:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.312+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5b0037040 con 0x558eaef0bcd0 2024-09-18T01:25:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.312+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef0bcd0 2024-09-18T01:25:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.312+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5b0037040 con 0x558eaef0bcd0 2024-09-18T01:25:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.312+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef02920 2024-09-18T01:25:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.312+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.312+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef02920 2024-09-18T01:25:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.313+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.313+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x7fd5b80cc040 2024-09-18T01:25:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.313+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.313+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef0bcd0 2024-09-18T01:25:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.313+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5b0037040 con 0x558eaef0bcd0 2024-09-18T01:25:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.313+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef070a0 2024-09-18T01:25:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.313+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5b809b030 con 0x558eaef070a0 2024-09-18T01:25:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.313+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef02920 2024-09-18T01:25:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.314+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.314+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x7fd5b80cc040 2024-09-18T01:25:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.314+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.314+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef0bcd0 2024-09-18T01:25:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.314+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5b0037040 con 0x558eaef0bcd0 2024-09-18T01:25:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.314+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x7fd5b80cc040 2024-09-18T01:25:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.314+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.314+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef070a0 2024-09-18T01:25:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.315+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5b809b030 con 0x558eaef070a0 2024-09-18T01:25:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.315+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef0bcd0 2024-09-18T01:25:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.315+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5b0037040 con 0x558eaef0bcd0 2024-09-18T01:25:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.315+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x7fd5b80cc040 2024-09-18T01:25:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.315+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.315+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef02920 2024-09-18T01:25:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.315+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.315+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558eaef065b0 con 0x558eaef070a0 2024-09-18T01:25:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd5b809b030 con 0x558eaef070a0 2024-09-18T01:25:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaef0a5d0 con 0x558eaef02920 2024-09-18T01:25:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaef0a9c0 con 0x558eaef02920 2024-09-18T01:25:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaef0a9c0 con 0x7fd5b80cc040 2024-09-18T01:25:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.316+0000 7fd5cabaf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 20 zone default found 2024-09-18T01:25:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 4 Realm: () 2024-09-18T01:25:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 20 zonegroup default 2024-09-18T01:25:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaef0ade0 con 0x7fd5b80cc040 2024-09-18T01:25:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaef0ade0 con 0x558eaef0bcd0 2024-09-18T01:25:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd5b0037040 con 0x558eaef0bcd0 2024-09-18T01:25:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaef106c0 con 0x558eaef0bcd0 2024-09-18T01:25:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd5b0037040 con 0x558eaef0bcd0 2024-09-18T01:25:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 20 started sync module instance, tier type = 2024-09-18T01:25:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.317+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef0fb60 con 0x558eaef070a0 2024-09-18T01:25:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.318+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5b809b030 con 0x558eaef070a0 2024-09-18T01:25:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.318+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94071308746624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef0f7c0 con 0x558eaef070a0 2024-09-18T01:25:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.318+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef11590 con 0x558eaef02920 2024-09-18T01:25:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.319+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94071308746624] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5b809b030 con 0x558eaef070a0 2024-09-18T01:25:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.320+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.320+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94071308750976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef119b0 con 0x558eaef02920 2024-09-18T01:25:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.320+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef123f0 con 0x558eaef0bcd0 2024-09-18T01:25:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.321+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5b0037040 con 0x558eaef0bcd0 2024-09-18T01:25:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.321+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94071308754624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef12c90 con 0x558eaef0bcd0 2024-09-18T01:25:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.321+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef13770 con 0x558eaef070a0 2024-09-18T01:25:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.322+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94071308750976] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.322+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94071308754624] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5b0037040 con 0x558eaef0bcd0 2024-09-18T01:25:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.322+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5b809b030 con 0x558eaef070a0 2024-09-18T01:25:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.322+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94071308759680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef13b60 con 0x558eaef070a0 2024-09-18T01:25:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.322+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef143b0 con 0x558eaef02920 2024-09-18T01:25:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.323+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.324+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94071308763392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef14b90 con 0x558eaef02920 2024-09-18T01:25:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.324+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef15660 con 0x7fd5b80cc040 2024-09-18T01:25:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.324+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94071308759680] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5b809b030 con 0x558eaef070a0 2024-09-18T01:25:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.325+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.325+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94071308767568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef15620 con 0x7fd5b80cc040 2024-09-18T01:25:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.325+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef160a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.325+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94071308763392] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.325+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94071308767568] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.326+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.326+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94071308749408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef15bf0 con 0x7fd5b80cc040 2024-09-18T01:25:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.326+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef165b0 con 0x7fd5b80cc040 2024-09-18T01:25:31.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.327+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.327+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94071308749408] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.327+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94071308771584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef169d0 con 0x7fd5b80cc040 2024-09-18T01:25:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.327+0000 7fd5cabaf800 20 add_watcher() i=0 2024-09-18T01:25:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.327+0000 7fd5cabaf800 20 add_watcher() i=1 2024-09-18T01:25:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.327+0000 7fd5cabaf800 20 add_watcher() i=2 2024-09-18T01:25:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.327+0000 7fd5cabaf800 20 add_watcher() i=3 2024-09-18T01:25:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.327+0000 7fd5cabaf800 20 add_watcher() i=4 2024-09-18T01:25:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.327+0000 7fd5cabaf800 20 add_watcher() i=5 2024-09-18T01:25:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.327+0000 7fd5cabaf800 20 add_watcher() i=6 2024-09-18T01:25:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.327+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94071308771584] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.328+0000 7fd5cabaf800 20 add_watcher() i=7 2024-09-18T01:25:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.328+0000 7fd5cabaf800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.328+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaef169d0 con 0x558eaef02920 2024-09-18T01:25:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.328+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.328+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94071308772640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef17250 con 0x558eaef02920 2024-09-18T01:25:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.329+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94071308772640] v33'114 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.329+0000 7fd47efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.329+0000 7fd5cabaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.329+0000 7fd5cabaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.329+0000 7fd5cabaf800 5 note: GC not initialized 2024-09-18T01:25:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.329+0000 7fd47dfdb640 20 reqs_thread_entry: start 2024-09-18T01:25:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.329+0000 7fd5cabaf800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.329+0000 7fd5cabaf800 20 Filter name: none 2024-09-18T01:25:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.329+0000 7fd3ef7fe640 20 reqs_thread_entry: start 2024-09-18T01:25:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.330+0000 7fd5cabaf800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.330+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558eaef4c880 con 0x558eaef070a0 2024-09-18T01:25:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.330+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7fd5b809b030 con 0x558eaef070a0 2024-09-18T01:25:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.330+0000 7fd5cabaf800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.331+0000 7fd47efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.331+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94071308772640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef4a6e0 con 0x558eaef02920 2024-09-18T01:25:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.332+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94071308772640] v33'115 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.332+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94071308746624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef4a6e0 con 0x558eaef070a0 2024-09-18T01:25:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.333+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94071308746624] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5b809b030 con 0x558eaef070a0 2024-09-18T01:25:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.333+0000 7fd5cabaf800 20 remove_watcher() i=0 2024-09-18T01:25:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.333+0000 7fd5cabaf800 2 removed watcher, disabling cache 2024-09-18T01:25:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.333+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94071308750976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef4a6e0 con 0x558eaef02920 2024-09-18T01:25:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.334+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94071308750976] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.334+0000 7fd5cabaf800 20 remove_watcher() i=1 2024-09-18T01:25:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.334+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94071308754624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef4a6e0 con 0x558eaef0bcd0 2024-09-18T01:25:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.335+0000 7fd5bffff640 1 -- 172.21.15.100:0/2868345 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94071308754624] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5b0037040 con 0x558eaef0bcd0 2024-09-18T01:25:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.335+0000 7fd5cabaf800 20 remove_watcher() i=2 2024-09-18T01:25:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.335+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94071308759680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef0ff80 con 0x558eaef070a0 2024-09-18T01:25:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.336+0000 7fd5c86a3640 1 -- 172.21.15.100:0/2868345 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94071308759680] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5b809b030 con 0x558eaef070a0 2024-09-18T01:25:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.336+0000 7fd5cabaf800 20 remove_watcher() i=3 2024-09-18T01:25:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.336+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94071308763392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef0ff80 con 0x558eaef02920 2024-09-18T01:25:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.337+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94071308763392] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x558eaef02920 2024-09-18T01:25:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.337+0000 7fd5cabaf800 20 remove_watcher() i=4 2024-09-18T01:25:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.337+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94071308767568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef14100 con 0x7fd5b80cc040 2024-09-18T01:25:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.338+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94071308767568] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.338+0000 7fd5cabaf800 20 remove_watcher() i=5 2024-09-18T01:25:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.338+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94071308749408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef0ff80 con 0x7fd5b80cc040 2024-09-18T01:25:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.339+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94071308749408] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.339+0000 7fd5cabaf800 20 remove_watcher() i=6 2024-09-18T01:25:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.339+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94071308771584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558eaef14100 con 0x7fd5b80cc040 2024-09-18T01:25:31.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94071308771584] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5c000a4a0 con 0x7fd5b80cc040 2024-09-18T01:25:31.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5cabaf800 20 remove_watcher() i=7 2024-09-18T01:25:31.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd5b80cc040 msgr2=0x7fd5b80ad420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd5b80cc040 0x7fd5b80ad420 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558eaef02920 msgr2=0x558eaef04de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558eaef02920 0x558eaef04de0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558eaef070a0 msgr2=0x558eaef09490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558eaef070a0 0x558eaef09490 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558eaef0bcd0 msgr2=0x558eaef0e190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558eaef0bcd0 0x558eaef0e190 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd490036b90 msgr2=0x7fd490039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd490036b90 0x7fd490039050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x558eaeed5ac0 tx=0x7fd5b0010000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeeeff20 msgr2=0x558eaeef71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeeeff20 0x558eaeef71c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd5b801bb60 tx=0x7fd5b8098f20 comp rx=0 tx=0).stop 2024-09-18T01:25:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.340+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/2868345 reap_dead start 2024-09-18T01:25:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 shutdown_connections 2024-09-18T01:25:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/2868345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeeeff20 0x558eaeef71c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 >> 172.21.15.100:0/2868345 conn(0x558eaeeec2d0 msgr2=0x558eaeeea3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 shutdown_connections 2024-09-18T01:25:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/2868345 wait complete. 2024-09-18T01:25:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1058668363 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4a0036b90 msgr2=0x7fd4a0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/1058668363 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4a0036b90 0x7fd4a0039050 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x558eaeec9920 tx=0x7fd5b000f000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1058668363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeee3470 msgr2=0x558eaeee3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/1058668363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeee3470 0x558eaeee3890 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd5b808f5b0 tx=0x7fd5b806ef80 comp rx=0 tx=0).stop 2024-09-18T01:25:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1058668363 shutdown_connections 2024-09-18T01:25:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/1058668363 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4a0036b90 0x7fd4a0039050 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/1058668363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaeee3470 0x558eaeee3890 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1058668363 >> 172.21.15.100:0/1058668363 conn(0x558eaeed8400 msgr2=0x558eaeedaf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1058668363 shutdown_connections 2024-09-18T01:25:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1058668363 wait complete. 2024-09-18T01:25:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558eaeed2bd0 msgr2=0x558eaeed4fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558eaeed2bd0 0x558eaeed4fc0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558eaedcf790 msgr2=0x558eaeecc430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558eaedcf790 0x558eaeecc430 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558eaeecece0 msgr2=0x558eaeed10d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558eaeecece0 0x558eaeed10d0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4b0036b40 msgr2=0x7fd4b0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4b0036b40 0x7fd4b0039000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0000f60 tx=0x7fd5b0001370 comp rx=0 tx=0).stop 2024-09-18T01:25:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 msgr2=0x558eaeec53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.341+0000 7fd5cabaf800 1 --2- 172.21.15.100:0/1710973716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558eaed40630 0x558eaeec53c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8067040 tx=0x7fd5b8002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.342+0000 7fd5c8ea4640 1 -- 172.21.15.100:0/1710973716 reap_dead start 2024-09-18T01:25:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.342+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 shutdown_connections 2024-09-18T01:25:31.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.342+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 >> 172.21.15.100:0/1710973716 conn(0x558eaedc6de0 msgr2=0x558eaedcb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.342+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 shutdown_connections 2024-09-18T01:25:31.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.342+0000 7fd5cabaf800 1 -- 172.21.15.100:0/1710973716 wait complete. 2024-09-18T01:25:31.351 INFO:teuthology.orchestra.run.smithi100.stdout:{"key":"bucket:myfoo","ver":{"tag":"_MMgsGfRygm_cbfNwukJ3gym","ver":2},"mtime":"2024-09-18T01:25:31.057965Z","data":{"bucket":{"name":"myfoo","marker":"153b7754-209b-4898-8796-577da7c1273d.4237.1","bucket_id":"153b7754-209b-4898-8796-577da7c1273d.4237.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-18T01:25:29.863166Z","linked":false,"has_bucket_info":false}} 2024-09-18T01:25:31.352 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_MMgsGfRygm_cbfNwukJ3gym', 'ver': 2}, 'mtime': '2024-09-18T01:25:31.057965Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '153b7754-209b-4898-8796-577da7c1273d.4237.1', 'bucket_id': '153b7754-209b-4898-8796-577da7c1273d.4237.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-18T01:25:29.863166Z', 'linked': False, 'has_bucket_info': False}} 2024-09-18T01:25:31.352 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '153b7754-209b-4898-8796-577da7c1273d.4237.1'] 2024-09-18T01:25:31.352 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '153b7754-209b-4898-8796-577da7c1273d.4237.1'] 2024-09-18T01:25:31.353 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 153b7754-209b-4898-8796-577da7c1273d.4237.1 2024-09-18T01:25:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:31.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.440+0000 7fa87ed30800 1 Processor -- start 2024-09-18T01:25:31.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.440+0000 7fa87ed30800 1 -- start start 2024-09-18T01:25:31.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.440+0000 7fa87ed30800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55fc724f9a80 0x55fc724fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.440+0000 7fa87ed30800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fc723b4b30 con 0x55fc724f5780 2024-09-18T01:25:31.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.440+0000 7fa87ed30800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55fc72396360 con 0x55fc724f9a80 2024-09-18T01:25:31.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.440+0000 7fa87a25b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55fc724f9a80 0x55fc724fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.440+0000 7fa87a25b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55fc724f9a80 0x55fc724fbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38248/0 (socket says 172.21.15.100:38248) 2024-09-18T01:25:31.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.440+0000 7fa87a25b640 1 -- 172.21.15.100:0/2571225011 learned_addr learned my addr 172.21.15.100:0/2571225011 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.440+0000 7fa87aa5c640 1 --1- 172.21.15.100:0/2571225011 >> v1:172.21.15.92:6789/0 conn(0x55fc724f5780 0x55fc724f5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37340/0 (socket says 172.21.15.100:37340) 2024-09-18T01:25:31.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.441+0000 7fa87a25b640 1 -- 172.21.15.100:0/2571225011 >> v1:172.21.15.92:6789/0 conn(0x55fc724f5780 legacy=0x55fc724f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.441+0000 7fa87a25b640 1 -- 172.21.15.100:0/2571225011 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc723bce00 con 0x55fc724f9a80 2024-09-18T01:25:31.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.442+0000 7fa87a25b640 1 --2- 172.21.15.100:0/2571225011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f9a80 0x55fc724fbe70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa87000a520 tx=0x7fa870045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48bc51bd647668b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.443+0000 7fa879a5a640 1 -- 172.21.15.100:0/2571225011 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa870055070 con 0x55fc724f9a80 2024-09-18T01:25:31.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.443+0000 7fa879a5a640 1 -- 172.21.15.100:0/2571225011 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8700515b0 con 0x55fc724f9a80 2024-09-18T01:25:31.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.443+0000 7fa879a5a640 1 -- 172.21.15.100:0/2571225011 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8700518d0 con 0x55fc724f9a80 2024-09-18T01:25:31.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.443+0000 7fa87ed30800 1 -- 172.21.15.100:0/2571225011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f9a80 msgr2=0x55fc724fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.443+0000 7fa87ed30800 1 --2- 172.21.15.100:0/2571225011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f9a80 0x55fc724fbe70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa87000a520 tx=0x7fa870045ba0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.443+0000 7fa87ed30800 1 -- 172.21.15.100:0/2571225011 shutdown_connections 2024-09-18T01:25:31.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.443+0000 7fa87ed30800 1 --2- 172.21.15.100:0/2571225011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f9a80 0x55fc724fbe70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.443+0000 7fa87ed30800 1 -- 172.21.15.100:0/2571225011 >> 172.21.15.100:0/2571225011 conn(0x55fc724f1010 msgr2=0x55fc724f3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.443+0000 7fa87ed30800 1 -- 172.21.15.100:0/2571225011 shutdown_connections 2024-09-18T01:25:31.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.443+0000 7fa87ed30800 1 -- 172.21.15.100:0/2571225011 wait complete. 2024-09-18T01:25:31.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.457+0000 7fa87ed30800 1 Processor -- start 2024-09-18T01:25:31.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.457+0000 7fa87ed30800 1 -- start start 2024-09-18T01:25:31.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.457+0000 7fa87ed30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f5780 0x55fc725e4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.457+0000 7fa87ed30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fc72441350 con 0x55fc724f5780 2024-09-18T01:25:31.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.457+0000 7fa87aa5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f5780 0x55fc725e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.457+0000 7fa87aa5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f5780 0x55fc725e4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38250/0 (socket says 172.21.15.100:38250) 2024-09-18T01:25:31.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.457+0000 7fa87aa5c640 1 -- 172.21.15.100:0/3352059432 learned_addr learned my addr 172.21.15.100:0/3352059432 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.457+0000 7fa87aa5c640 1 -- 172.21.15.100:0/3352059432 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc7238ebc0 con 0x55fc724f5780 2024-09-18T01:25:31.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.458+0000 7fa87aa5c640 1 --2- 172.21.15.100:0/3352059432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f5780 0x55fc725e4940 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00b230 tx=0x7fa86c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4180f4bbecac3d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.458+0000 7fa768e09640 1 -- 172.21.15.100:0/3352059432 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c00e5c0 con 0x55fc724f5780 2024-09-18T01:25:31.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.458+0000 7fa768e09640 1 -- 172.21.15.100:0/3352059432 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa86c006070 con 0x55fc724f5780 2024-09-18T01:25:31.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.458+0000 7fa768e09640 1 -- 172.21.15.100:0/3352059432 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c00e890 con 0x55fc724f5780 2024-09-18T01:25:31.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.458+0000 7fa87ed30800 1 -- 172.21.15.100:0/3352059432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f5780 msgr2=0x55fc725e4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.458+0000 7fa87ed30800 1 --2- 172.21.15.100:0/3352059432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f5780 0x55fc725e4940 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00b230 tx=0x7fa86c00b6f0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.458+0000 7fa87ed30800 1 -- 172.21.15.100:0/3352059432 shutdown_connections 2024-09-18T01:25:31.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.458+0000 7fa87ed30800 1 --2- 172.21.15.100:0/3352059432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f5780 0x55fc725e4940 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.458+0000 7fa87ed30800 1 -- 172.21.15.100:0/3352059432 >> 172.21.15.100:0/3352059432 conn(0x55fc724f1010 msgr2=0x55fc725e0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.458+0000 7fa87ed30800 1 -- 172.21.15.100:0/3352059432 shutdown_connections 2024-09-18T01:25:31.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.458+0000 7fa87ed30800 1 -- 172.21.15.100:0/3352059432 wait complete. 2024-09-18T01:25:31.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.459+0000 7fa87ed30800 1 Processor -- start 2024-09-18T01:25:31.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.459+0000 7fa87ed30800 1 -- start start 2024-09-18T01:25:31.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.459+0000 7fa87ed30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f5780 0x55fc7246b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.459+0000 7fa87ed30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fc724fc6b0 con 0x55fc724f5780 2024-09-18T01:25:31.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.459+0000 7fa87aa5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f5780 0x55fc7246b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.459+0000 7fa87aa5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f5780 0x55fc7246b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38254/0 (socket says 172.21.15.100:38254) 2024-09-18T01:25:31.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.459+0000 7fa87aa5c640 1 -- 172.21.15.100:0/4008158211 learned_addr learned my addr 172.21.15.100:0/4008158211 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.459+0000 7fa87aa5c640 1 -- 172.21.15.100:0/4008158211 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc723a2fe0 con 0x55fc724f5780 2024-09-18T01:25:31.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.459+0000 7fa87aa5c640 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f5780 0x55fc7246b6e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa86c000fd0 tx=0x7fa86c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.460+0000 7fa767606640 1 -- 172.21.15.100:0/4008158211 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c00f8d0 con 0x55fc724f5780 2024-09-18T01:25:31.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.460+0000 7fa767606640 1 -- 172.21.15.100:0/4008158211 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa86c00fa90 con 0x55fc724f5780 2024-09-18T01:25:31.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.460+0000 7fa767606640 1 -- 172.21.15.100:0/4008158211 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c00fdb0 con 0x55fc724f5780 2024-09-18T01:25:31.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.460+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc72469dd0 con 0x55fc724f5780 2024-09-18T01:25:31.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.460+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc7246a2f0 con 0x55fc724f5780 2024-09-18T01:25:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.460+0000 7fa767606640 1 -- 172.21.15.100:0/4008158211 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa86c017070 con 0x55fc724f5780 2024-09-18T01:25:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.461+0000 7fa767606640 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa760036b90 0x7fa760039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.461+0000 7fa767606640 1 -- 172.21.15.100:0/4008158211 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa86c015020 con 0x55fc724f5780 2024-09-18T01:25:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.461+0000 7fa87a25b640 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa760036b90 0x7fa760039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.461+0000 7fa87ed30800 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55fc724f9a80 0x55fc725f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.461+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc725f5ca0 con 0x55fc724f9a80 2024-09-18T01:25:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.461+0000 7fa87b25d640 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55fc724f9a80 0x55fc725f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.461+0000 7fa87a25b640 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa760036b90 0x7fa760039050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa870057000 tx=0x7fa870052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.461+0000 7fa87b25d640 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55fc724f9a80 0x55fc725f5760 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.461+0000 7fa87b25d640 1 -- 172.21.15.100:0/4008158211 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc724f9a80 2024-09-18T01:25:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.461+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc725f64f0 con 0x55fc724f9a80 2024-09-18T01:25:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.462+0000 7fa87b25d640 1 -- 172.21.15.100:0/4008158211 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc724f9a80 2024-09-18T01:25:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.462+0000 7fa87ed30800 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55fc725f7f20 0x55fc725fa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.462+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc725fab00 con 0x55fc725f7f20 2024-09-18T01:25:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.462+0000 7fa87aa5c640 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55fc725f7f20 0x55fc725fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.462+0000 7fa87aa5c640 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55fc725f7f20 0x55fc725fa370 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.462+0000 7fa87aa5c640 1 -- 172.21.15.100:0/4008158211 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa86c02e070 con 0x55fc725f7f20 2024-09-18T01:25:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.462+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc725f6d40 con 0x55fc724f9a80 2024-09-18T01:25:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.463+0000 7fa87b25d640 1 -- 172.21.15.100:0/4008158211 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc724f9a80 2024-09-18T01:25:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.463+0000 7fa87ed30800 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55fc725fbf60 0x55fc725fe350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.463+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc725fea40 con 0x55fc725fbf60 2024-09-18T01:25:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.463+0000 7fa87a25b640 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55fc725fbf60 0x55fc725fe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.463+0000 7fa87a25b640 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55fc725fbf60 0x55fc725fe350 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.464+0000 7fa87a25b640 1 -- 172.21.15.100:0/4008158211 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa870057030 con 0x55fc725fbf60 2024-09-18T01:25:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.464+0000 7fa87ed30800 1 Processor -- start 2024-09-18T01:25:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.464+0000 7fa87ed30800 1 -- start start 2024-09-18T01:25:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.464+0000 7fa87ed30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc7260c7f0 0x55fc7260cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.464+0000 7fa87ed30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fc7246bc20 con 0x55fc7260c7f0 2024-09-18T01:25:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.464+0000 7fa87aa5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc7260c7f0 0x55fc7260cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.464+0000 7fa87aa5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc7260c7f0 0x55fc7260cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38256/0 (socket says 172.21.15.100:38256) 2024-09-18T01:25:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.464+0000 7fa87aa5c640 1 -- 172.21.15.100:0/2356311703 learned_addr learned my addr 172.21.15.100:0/2356311703 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.464+0000 7fa87aa5c640 1 -- 172.21.15.100:0/2356311703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc7260d150 con 0x55fc7260c7f0 2024-09-18T01:25:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.465+0000 7fa87aa5c640 1 --2- 172.21.15.100:0/2356311703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc7260c7f0 0x55fc7260cc10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0176e0 tx=0x7fa86c01b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.465+0000 7fa764e01640 1 -- 172.21.15.100:0/2356311703 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c01a480 con 0x55fc7260c7f0 2024-09-18T01:25:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.465+0000 7fa764e01640 1 -- 172.21.15.100:0/2356311703 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa86c01a620 con 0x55fc7260c7f0 2024-09-18T01:25:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.465+0000 7fa87ed30800 1 -- 172.21.15.100:0/2356311703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc7260d3e0 con 0x55fc7260c7f0 2024-09-18T01:25:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.465+0000 7fa764e01640 1 -- 172.21.15.100:0/2356311703 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c01a900 con 0x55fc7260c7f0 2024-09-18T01:25:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.465+0000 7fa87ed30800 1 -- 172.21.15.100:0/2356311703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc726100c0 con 0x55fc7260c7f0 2024-09-18T01:25:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.465+0000 7fa764e01640 1 -- 172.21.15.100:0/2356311703 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa86c044d40 con 0x55fc7260c7f0 2024-09-18T01:25:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.466+0000 7fa764e01640 1 --2- 172.21.15.100:0/2356311703 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa754036b90 0x7fa754039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.466+0000 7fa764e01640 1 -- 172.21.15.100:0/2356311703 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa86c04ec80 con 0x55fc7260c7f0 2024-09-18T01:25:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.466+0000 7fa87a25b640 1 --2- 172.21.15.100:0/2356311703 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa754036b90 0x7fa754039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.466+0000 7fa87ed30800 1 Processor -- start 2024-09-18T01:25:31.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.466+0000 7fa87ed30800 1 -- start start 2024-09-18T01:25:31.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.466+0000 7fa87a25b640 1 --2- 172.21.15.100:0/2356311703 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa754036b90 0x7fa754039050 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55fc7246a750 tx=0x7fa870005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.466+0000 7fa87ed30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc726192b0 0x55fc726196b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.466+0000 7fa87ed30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fc72390580 con 0x55fc726192b0 2024-09-18T01:25:31.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.466+0000 7fa87aa5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc726192b0 0x55fc726196b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.466+0000 7fa87aa5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc726192b0 0x55fc726196b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38264/0 (socket says 172.21.15.100:38264) 2024-09-18T01:25:31.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.466+0000 7fa87aa5c640 1 -- 172.21.15.100:0/2728220087 learned_addr learned my addr 172.21.15.100:0/2728220087 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.467+0000 7fa87aa5c640 1 -- 172.21.15.100:0/2728220087 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc72619c80 con 0x55fc726192b0 2024-09-18T01:25:31.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.467+0000 7fa87aa5c640 1 --2- 172.21.15.100:0/2728220087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc726192b0 0x55fc726196b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa86c031760 tx=0x7fa86c04bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8cd55227e26374 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.467+0000 7fa75e7fc640 1 -- 172.21.15.100:0/2728220087 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c05d020 con 0x55fc726192b0 2024-09-18T01:25:31.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.467+0000 7fa75e7fc640 1 -- 172.21.15.100:0/2728220087 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa86c026390 con 0x55fc726192b0 2024-09-18T01:25:31.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.467+0000 7fa75e7fc640 1 -- 172.21.15.100:0/2728220087 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c019860 con 0x55fc726192b0 2024-09-18T01:25:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.467+0000 7fa87ed30800 1 -- 172.21.15.100:0/2728220087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc726192b0 msgr2=0x55fc726196b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.467+0000 7fa87ed30800 1 --2- 172.21.15.100:0/2728220087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc726192b0 0x55fc726196b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa86c031760 tx=0x7fa86c04bf70 comp rx=0 tx=0).stop 2024-09-18T01:25:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.467+0000 7fa87ed30800 1 -- 172.21.15.100:0/2728220087 shutdown_connections 2024-09-18T01:25:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.467+0000 7fa87ed30800 1 --2- 172.21.15.100:0/2728220087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc726192b0 0x55fc726196b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.467+0000 7fa87ed30800 1 -- 172.21.15.100:0/2728220087 >> 172.21.15.100:0/2728220087 conn(0x55fc72615610 msgr2=0x55fc72613710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.467+0000 7fa87ed30800 1 -- 172.21.15.100:0/2728220087 shutdown_connections 2024-09-18T01:25:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.467+0000 7fa87ed30800 1 -- 172.21.15.100:0/2728220087 wait complete. 2024-09-18T01:25:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.468+0000 7fa87ed30800 1 Processor -- start 2024-09-18T01:25:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.468+0000 7fa87ed30800 1 -- start start 2024-09-18T01:25:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.468+0000 7fa87ed30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc726192b0 0x55fc72620310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.468+0000 7fa87ed30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fc7261a080 con 0x55fc726192b0 2024-09-18T01:25:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.468+0000 7fa87aa5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc726192b0 0x55fc72620310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.468+0000 7fa87aa5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc726192b0 0x55fc72620310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38266/0 (socket says 172.21.15.100:38266) 2024-09-18T01:25:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.468+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 learned_addr learned my addr 172.21.15.100:0/1218394887 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.468+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc72620850 con 0x55fc726192b0 2024-09-18T01:25:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.468+0000 7fa87aa5c640 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc726192b0 0x55fc72620310 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa86c04eef0 tx=0x7fa86c03af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.468+0000 7fa75cff9640 1 -- 172.21.15.100:0/1218394887 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c072070 con 0x55fc726192b0 2024-09-18T01:25:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.469+0000 7fa75cff9640 1 -- 172.21.15.100:0/1218394887 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa86c03d0c0 con 0x55fc726192b0 2024-09-18T01:25:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.469+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc72620850 con 0x55fc726192b0 2024-09-18T01:25:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.469+0000 7fa75cff9640 1 -- 172.21.15.100:0/1218394887 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c03d2b0 con 0x55fc726192b0 2024-09-18T01:25:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.469+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc72620850 con 0x55fc726192b0 2024-09-18T01:25:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.469+0000 7fa75cff9640 1 -- 172.21.15.100:0/1218394887 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa86c075070 con 0x55fc726192b0 2024-09-18T01:25:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.470+0000 7fa75cff9640 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa744036c40 0x7fa744039100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.470+0000 7fa75cff9640 1 -- 172.21.15.100:0/1218394887 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa86c06a070 con 0x55fc726192b0 2024-09-18T01:25:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.470+0000 7fa87a25b640 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa744036c40 0x7fa744039100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.470+0000 7fa87a25b640 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa744036c40 0x7fa744039100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa870000c00 tx=0x7fa87006d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.470+0000 7fa87ed30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.470+0000 7fa87ed30800 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55fc7262b8f0 0x55fc7262ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.470+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262e500 con 0x55fc7262b8f0 2024-09-18T01:25:31.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.470+0000 7fa87b25d640 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55fc7262b8f0 0x55fc7262ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87b25d640 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55fc7262b8f0 0x55fc7262ddb0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87ed30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87ed30800 20 realm 2024-09-18T01:25:31.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87ed30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262e910 con 0x55fc7262b8f0 2024-09-18T01:25:31.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87ed30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87ed30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:31.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87ed30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f1e0 con 0x55fc7262b8f0 2024-09-18T01:25:31.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87ed30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87ed30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc7262b8f0 2024-09-18T01:25:31.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.471+0000 7fa87ed30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:31.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.472+0000 7fa87ed30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.472+0000 7fa87ed30800 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55fc726302e0 0x55fc726326d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.472+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc72632ce0 con 0x55fc726302e0 2024-09-18T01:25:31.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.472+0000 7fa87aa5c640 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55fc726302e0 0x55fc726326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.472+0000 7fa87aa5c640 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55fc726302e0 0x55fc726326d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.472+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.472+0000 7fa87ed30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:31.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.472+0000 7fa87ed30800 20 searching for the correct realm 2024-09-18T01:25:31.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.472+0000 7fa87ed30800 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55fc72634c90 0x55fc72637150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.472+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc72637820 con 0x55fc72634c90 2024-09-18T01:25:31.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.472+0000 7fa87a25b640 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55fc72634c90 0x55fc72637150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.473+0000 7fa87a25b640 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55fc72634c90 0x55fc72637150 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.473+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa870057030 con 0x55fc72634c90 2024-09-18T01:25:31.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.473+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc72637820 con 0x55fc726302e0 2024-09-18T01:25:31.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.473+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.473+0000 7fa87aa5c640 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa86c077060 0x7fa86c01c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.473+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc72637820 con 0x7fa86c077060 2024-09-18T01:25:31.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.473+0000 7fa87b25d640 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa86c077060 0x7fa86c01c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.474+0000 7fa87b25d640 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa86c077060 0x7fa86c01c5f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.474+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.474+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc7262b8f0 2024-09-18T01:25:31.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.474+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.474+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc7262b8f0 2024-09-18T01:25:31.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.474+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.474+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x7fa86c077060 2024-09-18T01:25:31.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.475+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.475+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x7fa86c077060 2024-09-18T01:25:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.475+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.475+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc726302e0 2024-09-18T01:25:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.475+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.475+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc72634c90 2024-09-18T01:25:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.475+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa870057030 con 0x55fc72634c90 2024-09-18T01:25:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.475+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc7262b8f0 2024-09-18T01:25:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.475+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.475+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x7fa86c077060 2024-09-18T01:25:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.476+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.476+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc7262b8f0 2024-09-18T01:25:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.476+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.476+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc726302e0 2024-09-18T01:25:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.476+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.476+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc72634c90 2024-09-18T01:25:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.476+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa870057030 con 0x55fc72634c90 2024-09-18T01:25:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.476+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc72634c90 2024-09-18T01:25:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.477+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa870057030 con 0x55fc72634c90 2024-09-18T01:25:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.477+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x7fa86c077060 2024-09-18T01:25:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.477+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.477+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc72634c90 2024-09-18T01:25:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.477+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa870057030 con 0x55fc72634c90 2024-09-18T01:25:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.477+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc72634c90 2024-09-18T01:25:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.478+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa870057030 con 0x55fc72634c90 2024-09-18T01:25:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.478+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc7262b8f0 2024-09-18T01:25:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.478+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.478+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc7262b8f0 2024-09-18T01:25:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.478+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.478+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x7fa86c077060 2024-09-18T01:25:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.478+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.478+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc72634c90 2024-09-18T01:25:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.478+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa870057030 con 0x55fc72634c90 2024-09-18T01:25:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.479+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc726302e0 2024-09-18T01:25:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.479+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.479+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc7262b8f0 2024-09-18T01:25:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.479+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.479+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x7fa86c077060 2024-09-18T01:25:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.479+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.479+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc72634c90 2024-09-18T01:25:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.479+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa870057030 con 0x55fc72634c90 2024-09-18T01:25:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.479+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x7fa86c077060 2024-09-18T01:25:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.480+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.480+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc726302e0 2024-09-18T01:25:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.480+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.480+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc72634c90 2024-09-18T01:25:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.480+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa870057030 con 0x55fc72634c90 2024-09-18T01:25:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.480+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x7fa86c077060 2024-09-18T01:25:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.480+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.480+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc7262b8f0 2024-09-18T01:25:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fc7262f580 con 0x55fc726302e0 2024-09-18T01:25:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87ed30800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87ed30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87ed30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87ed30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87ed30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87ed30800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87ed30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc726335a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87ed30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87ed30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc72633990 con 0x55fc7262b8f0 2024-09-18T01:25:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87ed30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87ed30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.481+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc72633990 con 0x7fa86c077060 2024-09-18T01:25:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 20 zone default found 2024-09-18T01:25:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 4 Realm: () 2024-09-18T01:25:31.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:31.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:31.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:31.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 20 zonegroup default 2024-09-18T01:25:31.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc72633200 con 0x7fa86c077060 2024-09-18T01:25:31.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc72633200 con 0x55fc72634c90 2024-09-18T01:25:31.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa870057030 con 0x55fc72634c90 2024-09-18T01:25:31.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc72639730 con 0x55fc72634c90 2024-09-18T01:25:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa870057030 con 0x55fc72634c90 2024-09-18T01:25:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 20 started sync module instance, tier type = 2024-09-18T01:25:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.482+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc72638b20 con 0x55fc726302e0 2024-09-18T01:25:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.483+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.483+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94542739246864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc72638780 con 0x55fc726302e0 2024-09-18T01:25:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.483+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263a660 con 0x55fc7262b8f0 2024-09-18T01:25:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.484+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94542739246864] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.485+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.485+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94542739251632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263a5d0 con 0x55fc7262b8f0 2024-09-18T01:25:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.485+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263b520 con 0x55fc72634c90 2024-09-18T01:25:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.486+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94542739251632] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.486+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa870057030 con 0x55fc72634c90 2024-09-18T01:25:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.486+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94542739255408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263b8c0 con 0x55fc72634c90 2024-09-18T01:25:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.486+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263c2e0 con 0x55fc726302e0 2024-09-18T01:25:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.487+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94542739255408] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa870057030 con 0x55fc72634c90 2024-09-18T01:25:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.487+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.487+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94542739253840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263cb80 con 0x55fc726302e0 2024-09-18T01:25:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.487+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263d540 con 0x55fc7262b8f0 2024-09-18T01:25:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.488+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.488+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94542739263632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263d960 con 0x55fc7262b8f0 2024-09-18T01:25:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.488+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263e420 con 0x7fa86c077060 2024-09-18T01:25:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.488+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94542739253840] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.489+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.489+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94542739267312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263e3e0 con 0x7fa86c077060 2024-09-18T01:25:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.489+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263ee30 con 0x7fa86c077060 2024-09-18T01:25:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.489+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94542739263632] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.490+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94542739267312] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.490+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.490+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94542739261136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263e980 con 0x7fa86c077060 2024-09-18T01:25:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.490+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263f250 con 0x7fa86c077060 2024-09-18T01:25:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.491+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94542739261136] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.491+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.491+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94542739264688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263f430 con 0x7fa86c077060 2024-09-18T01:25:31.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.491+0000 7fa87ed30800 20 add_watcher() i=0 2024-09-18T01:25:31.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.491+0000 7fa87ed30800 20 add_watcher() i=1 2024-09-18T01:25:31.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.491+0000 7fa87ed30800 20 add_watcher() i=2 2024-09-18T01:25:31.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.491+0000 7fa87ed30800 20 add_watcher() i=3 2024-09-18T01:25:31.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.491+0000 7fa87ed30800 20 add_watcher() i=4 2024-09-18T01:25:31.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.491+0000 7fa87ed30800 20 add_watcher() i=5 2024-09-18T01:25:31.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.491+0000 7fa87ed30800 20 add_watcher() i=6 2024-09-18T01:25:31.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.492+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94542739264688] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.492+0000 7fa87ed30800 20 add_watcher() i=7 2024-09-18T01:25:31.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.492+0000 7fa87ed30800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:31.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.492+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc72642800 con 0x55fc7262b8f0 2024-09-18T01:25:31.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.492+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.492+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94542739272480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263fbf0 con 0x55fc7262b8f0 2024-09-18T01:25:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.493+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94542739272480] v33'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.493+0000 7fa7317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.494+0000 7fa87ed30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.494+0000 7fa87ed30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.494+0000 7fa87ed30800 5 note: GC not initialized 2024-09-18T01:25:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.494+0000 7fa6abfff640 20 reqs_thread_entry: start 2024-09-18T01:25:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.494+0000 7fa87ed30800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.494+0000 7fa87ed30800 20 Filter name: none 2024-09-18T01:25:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.494+0000 7fa6a9ffb640 20 reqs_thread_entry: start 2024-09-18T01:25:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.494+0000 7fa87ed30800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:25:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.494+0000 7fa87ed30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.494+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc72675ac0 con 0x7fa86c077060 2024-09-18T01:25:31.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.495+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.495+0000 7fa87ed30800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:25:31.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.495+0000 7fa87ed30800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T01:25:31.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.495+0000 7fa87ed30800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:25:31.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.495+0000 7fa87ed30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:31.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.495+0000 7fa87ed30800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:25:31.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.495+0000 7fa87ed30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.495+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc72677ba0 con 0x55fc726302e0 2024-09-18T01:25:31.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.495+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.495+0000 7fa87ed30800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:31.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.495+0000 7fa87ed30800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:25:31.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.495+0000 7fa87ed30800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:31.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.496+0000 7fa87ed30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 : miss 2024-09-18T01:25:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.496+0000 7fa87ed30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.496+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc72679610 con 0x7fa86c077060 2024-09-18T01:25:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.496+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(64 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.496+0000 7fa87ed30800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.496+0000 7fa87ed30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.496+0000 7fa87ed30800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.496+0000 7fa87ed30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.496+0000 7fa87ed30800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.496+0000 7fa87ed30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 2024-09-18T01:25:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.496+0000 7fa87ed30800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-18T01:25:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.496+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7267dbf0 con 0x55fc726302e0 2024-09-18T01:25:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.497+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(65 foo.buckets [call] v33'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.497+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:66 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc72683af0 con 0x7fa86c077060 2024-09-18T01:25:31.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.498+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(66 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.498+0000 7fa87ed30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:31.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa87ed30800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:31.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa87ed30800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:31.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa87ed30800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1, ofs0, ns] 2024-09-18T01:25:31.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94542739508928 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc7267e020 con 0x55fc7262b8f0 2024-09-18T01:25:31.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== watch-notify(notify (1) cookie 94542739251632 notify 141733920786 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55fc72679a00 con 0x55fc7262b8f0 2024-09-18T01:25:31.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa75e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920786 cookie 94542739251632 notifier 4510 bl.length()=752 2024-09-18T01:25:31.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa75e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:31.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa75e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:31.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(67 notify.1 [notify cookie 94542739508928 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa75e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:31.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa75e7fc640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa740003ea0 con 0x55fc7262b8f0 2024-09-18T01:25:31.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== watch-notify(notify_complete (2) cookie 94542739508928 notify 141733920786 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fc72678b60 con 0x55fc7262b8f0 2024-09-18T01:25:31.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa87ed30800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): orig_sources= new_sources= 2024-09-18T01:25:31.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa87ed30800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): potential sources added=[] removed=[] 2024-09-18T01:25:31.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa87ed30800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): orig_dests= new_dests= 2024-09-18T01:25:31.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa87ed30800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): potential dests added=[] removed=[] 2024-09-18T01:25:31.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.499+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc72678ec0 con 0x7fa86c077060 2024-09-18T01:25:31.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.501+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(69 fud.buckets [call] v33'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.501+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc72683320 con 0x55fc726302e0 2024-09-18T01:25:31.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.502+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.502+0000 7fa87ed30800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T01:25:31.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.502+0000 7fa87ed30800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:31.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.502+0000 7fa87ed30800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:25:31.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.502+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94542739508928 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fc726827c0 con 0x7fa86c077060 2024-09-18T01:25:31.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.502+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== watch-notify(notify (1) cookie 94542739261136 notify 141733920771 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fa874018d20 con 0x7fa86c077060 2024-09-18T01:25:31.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.502+0000 7fa75e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 94542739261136 notifier 4510 bl.length()=314 2024-09-18T01:25:31.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.502+0000 7fa75e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T01:25:31.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.502+0000 7fa75e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:31.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.502+0000 7fa75e7fc640 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa740003ea0 con 0x7fa86c077060 2024-09-18T01:25:31.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.502+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(71 notify.6 [notify cookie 94542739508928 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.502+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== watch-notify(notify_complete (2) cookie 94542739508928 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa8740434f0 con 0x7fa86c077060 2024-09-18T01:25:31.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.502+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.503+0000 7fa7317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:31.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.503+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94542739272480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc72673810 con 0x55fc7262b8f0 2024-09-18T01:25:31.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.504+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94542739272480] v33'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.504+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94542739246864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc72673810 con 0x55fc726302e0 2024-09-18T01:25:31.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.505+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94542739246864] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.505+0000 7fa87ed30800 20 remove_watcher() i=0 2024-09-18T01:25:31.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.505+0000 7fa87ed30800 2 removed watcher, disabling cache 2024-09-18T01:25:31.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.505+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94542739251632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc72673810 con 0x55fc7262b8f0 2024-09-18T01:25:31.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.506+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94542739251632] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.506+0000 7fa87ed30800 20 remove_watcher() i=1 2024-09-18T01:25:31.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.506+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94542739255408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc72673810 con 0x55fc72634c90 2024-09-18T01:25:31.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.507+0000 7fa87a25b640 1 -- 172.21.15.100:0/1218394887 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94542739255408] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa870057030 con 0x55fc72634c90 2024-09-18T01:25:31.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.507+0000 7fa87ed30800 20 remove_watcher() i=2 2024-09-18T01:25:31.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.507+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94542739253840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263a1b0 con 0x55fc726302e0 2024-09-18T01:25:31.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.508+0000 7fa87aa5c640 1 -- 172.21.15.100:0/1218394887 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94542739253840] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa86c074030 con 0x55fc726302e0 2024-09-18T01:25:31.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.508+0000 7fa87ed30800 20 remove_watcher() i=3 2024-09-18T01:25:31.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.508+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94542739263632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263b070 con 0x55fc7262b8f0 2024-09-18T01:25:31.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.509+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94542739263632] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x55fc7262b8f0 2024-09-18T01:25:31.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.509+0000 7fa87ed30800 20 remove_watcher() i=4 2024-09-18T01:25:31.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.509+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94542739267312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263a1b0 con 0x7fa86c077060 2024-09-18T01:25:31.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.510+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94542739267312] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.510+0000 7fa87ed30800 20 remove_watcher() i=5 2024-09-18T01:25:31.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.510+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94542739261136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263d090 con 0x7fa86c077060 2024-09-18T01:25:31.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.511+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94542739261136] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.511+0000 7fa87ed30800 20 remove_watcher() i=6 2024-09-18T01:25:31.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.511+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94542739264688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fc7263b070 con 0x7fa86c077060 2024-09-18T01:25:31.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94542739264688] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa87400a4a0 con 0x7fa86c077060 2024-09-18T01:25:31.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 20 remove_watcher() i=7 2024-09-18T01:25:31.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa86c077060 msgr2=0x7fa86c01c5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa86c077060 0x7fa86c01c5f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55fc7262b8f0 msgr2=0x55fc7262ddb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55fc7262b8f0 0x55fc7262ddb0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55fc726302e0 msgr2=0x55fc726326d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55fc726302e0 0x55fc726326d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55fc72634c90 msgr2=0x55fc72637150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55fc72634c90 0x55fc72637150 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa744036c40 msgr2=0x7fa744039100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa744036c40 0x7fa744039100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa870000c00 tx=0x7fa87006d040 comp rx=0 tx=0).stop 2024-09-18T01:25:31.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc726192b0 msgr2=0x55fc72620310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc726192b0 0x55fc72620310 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa86c04eef0 tx=0x7fa86c03af00 comp rx=0 tx=0).stop 2024-09-18T01:25:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87b25d640 1 -- 172.21.15.100:0/1218394887 reap_dead start 2024-09-18T01:25:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 shutdown_connections 2024-09-18T01:25:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 --2- 172.21.15.100:0/1218394887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc726192b0 0x55fc72620310 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 >> 172.21.15.100:0/1218394887 conn(0x55fc72615610 msgr2=0x55fc726136e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 shutdown_connections 2024-09-18T01:25:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.512+0000 7fa87ed30800 1 -- 172.21.15.100:0/1218394887 wait complete. 2024-09-18T01:25:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/2356311703 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa754036b90 msgr2=0x7fa754039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 --2- 172.21.15.100:0/2356311703 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa754036b90 0x7fa754039050 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55fc7246a750 tx=0x7fa870005ac0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/2356311703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc7260c7f0 msgr2=0x55fc7260cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 --2- 172.21.15.100:0/2356311703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc7260c7f0 0x55fc7260cc10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0176e0 tx=0x7fa86c01b960 comp rx=0 tx=0).stop 2024-09-18T01:25:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/2356311703 shutdown_connections 2024-09-18T01:25:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 --2- 172.21.15.100:0/2356311703 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa754036b90 0x7fa754039050 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 --2- 172.21.15.100:0/2356311703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc7260c7f0 0x55fc7260cc10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/2356311703 >> 172.21.15.100:0/2356311703 conn(0x55fc72601780 msgr2=0x55fc72604300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/2356311703 shutdown_connections 2024-09-18T01:25:31.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/2356311703 wait complete. 2024-09-18T01:25:31.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55fc725fbf60 msgr2=0x55fc725fe350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55fc725fbf60 0x55fc725fe350 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55fc724f9a80 msgr2=0x55fc725f5760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55fc724f9a80 0x55fc725f5760 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55fc725f7f20 msgr2=0x55fc725fa370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55fc725f7f20 0x55fc725fa370 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa760036b90 msgr2=0x7fa760039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa760036b90 0x7fa760039050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa870057000 tx=0x7fa870052000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f5780 msgr2=0x55fc7246b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 --2- 172.21.15.100:0/4008158211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc724f5780 0x55fc7246b6e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa86c000fd0 tx=0x7fa86c000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87b25d640 1 -- 172.21.15.100:0/4008158211 reap_dead start 2024-09-18T01:25:31.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 shutdown_connections 2024-09-18T01:25:31.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 >> 172.21.15.100:0/4008158211 conn(0x55fc724f1010 msgr2=0x55fc725deb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 shutdown_connections 2024-09-18T01:25:31.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.513+0000 7fa87ed30800 1 -- 172.21.15.100:0/4008158211 wait complete. 2024-09-18T01:25:31.529 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-18T01:25:31.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-18T01:25:31.529 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-18T01:25:31.573 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:31.573 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:31.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.573+0000 7fc350724800 1 Processor -- start 2024-09-18T01:25:31.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.573+0000 7fc350724800 1 -- start start 2024-09-18T01:25:31.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.573+0000 7fc350724800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55a011244610 0x55a0112d5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.573+0000 7fc350724800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a01118fb30 con 0x55a0112d5bb0 2024-09-18T01:25:31.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.573+0000 7fc350724800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55a011171360 con 0x55a011244610 2024-09-18T01:25:31.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.573+0000 7fc34c4ac640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55a011244610 0x55a0112d5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.573+0000 7fc34bcab640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55a0112d5bb0 0x55a0112d7fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37352/0 (socket says 172.21.15.100:37352) 2024-09-18T01:25:31.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.573+0000 7fc34bcab640 1 -- 172.21.15.100:0/884347992 learned_addr learned my addr 172.21.15.100:0/884347992 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:31.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.574+0000 7fc34c4ac640 1 -- 172.21.15.100:0/884347992 >> v1:172.21.15.92:6789/0 conn(0x55a0112d5bb0 legacy=0x55a0112d7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.574+0000 7fc34c4ac640 1 -- 172.21.15.100:0/884347992 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a011197e00 con 0x55a011244610 2024-09-18T01:25:31.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.576+0000 7fc34c4ac640 1 --2- 172.21.15.100:0/884347992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 0x55a0112d5670 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00a470 tx=0x7fc33c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06366abba48a52 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.576+0000 7fc34b4aa640 1 -- 172.21.15.100:0/884347992 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c053570 con 0x55a011244610 2024-09-18T01:25:31.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.576+0000 7fc34b4aa640 1 -- 172.21.15.100:0/884347992 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c058070 con 0x55a011244610 2024-09-18T01:25:31.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.576+0000 7fc34b4aa640 1 -- 172.21.15.100:0/884347992 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c053880 con 0x55a011244610 2024-09-18T01:25:31.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.576+0000 7fc350724800 1 -- 172.21.15.100:0/884347992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 msgr2=0x55a0112d5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.576+0000 7fc350724800 1 --2- 172.21.15.100:0/884347992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 0x55a0112d5670 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00a470 tx=0x7fc33c045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:31.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.576+0000 7fc350724800 1 -- 172.21.15.100:0/884347992 shutdown_connections 2024-09-18T01:25:31.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.576+0000 7fc350724800 1 --2- 172.21.15.100:0/884347992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 0x55a0112d5670 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.576+0000 7fc350724800 1 -- 172.21.15.100:0/884347992 >> 172.21.15.100:0/884347992 conn(0x55a0112cade0 msgr2=0x55a0112cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.576+0000 7fc350724800 1 -- 172.21.15.100:0/884347992 shutdown_connections 2024-09-18T01:25:31.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.576+0000 7fc350724800 1 -- 172.21.15.100:0/884347992 wait complete. 2024-09-18T01:25:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.590+0000 7fc350724800 1 Processor -- start 2024-09-18T01:25:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.590+0000 7fc350724800 1 -- start start 2024-09-18T01:25:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.590+0000 7fc350724800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 0x55a0113c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.590+0000 7fc350724800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a01121c330 con 0x55a011244610 2024-09-18T01:25:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.590+0000 7fc34c4ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 0x55a0113c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.590+0000 7fc34c4ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 0x55a0113c1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38274/0 (socket says 172.21.15.100:38274) 2024-09-18T01:25:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.590+0000 7fc34c4ac640 1 -- 172.21.15.100:0/1395142946 learned_addr learned my addr 172.21.15.100:0/1395142946 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.591+0000 7fc34c4ac640 1 -- 172.21.15.100:0/1395142946 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a011169bc0 con 0x55a011244610 2024-09-18T01:25:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.591+0000 7fc34c4ac640 1 --2- 172.21.15.100:0/1395142946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 0x55a0113c1a80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc33c025c20 tx=0x7fc33c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc5bdbac1435e79 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.591+0000 7fc23a60c640 1 -- 172.21.15.100:0/1395142946 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c05c580 con 0x55a011244610 2024-09-18T01:25:31.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.591+0000 7fc23a60c640 1 -- 172.21.15.100:0/1395142946 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c063030 con 0x55a011244610 2024-09-18T01:25:31.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.591+0000 7fc23a60c640 1 -- 172.21.15.100:0/1395142946 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c05c850 con 0x55a011244610 2024-09-18T01:25:31.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.592+0000 7fc350724800 1 -- 172.21.15.100:0/1395142946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 msgr2=0x55a0113c1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.592+0000 7fc350724800 1 --2- 172.21.15.100:0/1395142946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 0x55a0113c1a80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc33c025c20 tx=0x7fc33c051000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.592+0000 7fc350724800 1 -- 172.21.15.100:0/1395142946 shutdown_connections 2024-09-18T01:25:31.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.592+0000 7fc350724800 1 --2- 172.21.15.100:0/1395142946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 0x55a0113c1a80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.592+0000 7fc350724800 1 -- 172.21.15.100:0/1395142946 >> 172.21.15.100:0/1395142946 conn(0x55a0112cade0 msgr2=0x55a0113bd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.592+0000 7fc350724800 1 -- 172.21.15.100:0/1395142946 shutdown_connections 2024-09-18T01:25:31.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.592+0000 7fc350724800 1 -- 172.21.15.100:0/1395142946 wait complete. 2024-09-18T01:25:31.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.592+0000 7fc350724800 1 Processor -- start 2024-09-18T01:25:31.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.592+0000 7fc350724800 1 -- start start 2024-09-18T01:25:31.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.592+0000 7fc350724800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 0x55a0113c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.592+0000 7fc350724800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a0112d9990 con 0x55a011244610 2024-09-18T01:25:31.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.593+0000 7fc34c4ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 0x55a0113c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.593+0000 7fc34c4ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 0x55a0113c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38284/0 (socket says 172.21.15.100:38284) 2024-09-18T01:25:31.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.593+0000 7fc34c4ac640 1 -- 172.21.15.100:0/3574281714 learned_addr learned my addr 172.21.15.100:0/3574281714 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.593+0000 7fc34c4ac640 1 -- 172.21.15.100:0/3574281714 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a01117dfe0 con 0x55a011244610 2024-09-18T01:25:31.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.593+0000 7fc34c4ac640 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 0x55a0113c93f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55a0113c28e0 tx=0x7fc33c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.593+0000 7fc238e09640 1 -- 172.21.15.100:0/3574281714 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c054ad0 con 0x55a011244610 2024-09-18T01:25:31.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.593+0000 7fc238e09640 1 -- 172.21.15.100:0/3574281714 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c054c70 con 0x55a011244610 2024-09-18T01:25:31.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.593+0000 7fc238e09640 1 -- 172.21.15.100:0/3574281714 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c068420 con 0x55a011244610 2024-09-18T01:25:31.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.593+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0113c9930 con 0x55a011244610 2024-09-18T01:25:31.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.593+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0113c9e50 con 0x55a011244610 2024-09-18T01:25:31.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.594+0000 7fc238e09640 1 -- 172.21.15.100:0/3574281714 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc33c0685c0 con 0x55a011244610 2024-09-18T01:25:31.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.594+0000 7fc238e09640 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc234036b90 0x7fc234039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.594+0000 7fc238e09640 1 -- 172.21.15.100:0/3574281714 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fc33c070030 con 0x55a011244610 2024-09-18T01:25:31.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.594+0000 7fc34bcab640 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc234036b90 0x7fc234039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.594+0000 7fc350724800 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a0112d5bb0 0x55a0113d0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.594+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0113d09a0 con 0x55a0112d5bb0 2024-09-18T01:25:31.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.594+0000 7fc34ccad640 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a0112d5bb0 0x55a0113d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.595+0000 7fc34bcab640 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc234036b90 0x7fc234039050 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc340000f60 tx=0x7fc3400012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.595+0000 7fc34ccad640 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a0112d5bb0 0x55a0113d0460 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.595+0000 7fc34ccad640 1 -- 172.21.15.100:0/3574281714 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0112d5bb0 2024-09-18T01:25:31.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.595+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0113cda30 con 0x55a0112d5bb0 2024-09-18T01:25:31.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.595+0000 7fc34ccad640 1 -- 172.21.15.100:0/3574281714 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0112d5bb0 2024-09-18T01:25:31.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.595+0000 7fc350724800 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a0113d2cf0 0x55a0113d50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.595+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0113d57d0 con 0x55a0113d2cf0 2024-09-18T01:25:31.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.595+0000 7fc34c4ac640 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a0113d2cf0 0x55a0113d50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.596+0000 7fc34c4ac640 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a0113d2cf0 0x55a0113d50e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.596+0000 7fc34c4ac640 1 -- 172.21.15.100:0/3574281714 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc33c051070 con 0x55a0113d2cf0 2024-09-18T01:25:31.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.596+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0113d1b90 con 0x55a0112d5bb0 2024-09-18T01:25:31.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.596+0000 7fc34ccad640 1 -- 172.21.15.100:0/3574281714 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0112d5bb0 2024-09-18T01:25:31.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.596+0000 7fc350724800 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a0113d6c30 0x55a0113d9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.596+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0113d9720 con 0x55a0113d6c30 2024-09-18T01:25:31.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.596+0000 7fc34bcab640 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a0113d6c30 0x55a0113d9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.597+0000 7fc34bcab640 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a0113d6c30 0x55a0113d9020 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.597+0000 7fc34bcab640 1 -- 172.21.15.100:0/3574281714 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc340009050 con 0x55a0113d6c30 2024-09-18T01:25:31.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.597+0000 7fc350724800 1 Processor -- start 2024-09-18T01:25:31.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.597+0000 7fc350724800 1 -- start start 2024-09-18T01:25:31.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.598+0000 7fc350724800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113e74d0 0x55a0113e78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.598+0000 7fc350724800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a01116b580 con 0x55a0113e74d0 2024-09-18T01:25:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.598+0000 7fc34c4ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113e74d0 0x55a0113e78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.598+0000 7fc34c4ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113e74d0 0x55a0113e78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38292/0 (socket says 172.21.15.100:38292) 2024-09-18T01:25:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.598+0000 7fc34c4ac640 1 -- 172.21.15.100:0/167381391 learned_addr learned my addr 172.21.15.100:0/167381391 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.598+0000 7fc34c4ac640 1 -- 172.21.15.100:0/167381391 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0113e7e30 con 0x55a0113e74d0 2024-09-18T01:25:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.598+0000 7fc34c4ac640 1 --2- 172.21.15.100:0/167381391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113e74d0 0x55a0113e78f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc33c08f010 tx=0x7fc33c0747a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.598+0000 7fc231ffb640 1 -- 172.21.15.100:0/167381391 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c05e810 con 0x55a0113e74d0 2024-09-18T01:25:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.598+0000 7fc231ffb640 1 -- 172.21.15.100:0/167381391 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c07db00 con 0x55a0113e74d0 2024-09-18T01:25:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.598+0000 7fc350724800 1 -- 172.21.15.100:0/167381391 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0113e80c0 con 0x55a0113e74d0 2024-09-18T01:25:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.598+0000 7fc231ffb640 1 -- 172.21.15.100:0/167381391 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c07de20 con 0x55a0113e74d0 2024-09-18T01:25:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.599+0000 7fc350724800 1 -- 172.21.15.100:0/167381391 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0113eada0 con 0x55a0113e74d0 2024-09-18T01:25:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.599+0000 7fc231ffb640 1 -- 172.21.15.100:0/167381391 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc33c07d3f0 con 0x55a0113e74d0 2024-09-18T01:25:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.599+0000 7fc231ffb640 1 --2- 172.21.15.100:0/167381391 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc224036b90 0x7fc224039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.599+0000 7fc231ffb640 1 -- 172.21.15.100:0/167381391 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fc33c099c50 con 0x55a0113e74d0 2024-09-18T01:25:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.599+0000 7fc34bcab640 1 --2- 172.21.15.100:0/167381391 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc224036b90 0x7fc224039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.600+0000 7fc350724800 1 Processor -- start 2024-09-18T01:25:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.600+0000 7fc350724800 1 -- start start 2024-09-18T01:25:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.600+0000 7fc34bcab640 1 --2- 172.21.15.100:0/167381391 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc224036b90 0x7fc224039050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc34000bf50 tx=0x7fc34000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.600+0000 7fc350724800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113f3fd0 0x55a0113f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.600+0000 7fc350724800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a0113c21d0 con 0x55a0113f3fd0 2024-09-18T01:25:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.600+0000 7fc34c4ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113f3fd0 0x55a0113f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.600+0000 7fc34c4ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113f3fd0 0x55a0113f43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38306/0 (socket says 172.21.15.100:38306) 2024-09-18T01:25:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.600+0000 7fc34c4ac640 1 -- 172.21.15.100:0/2261598036 learned_addr learned my addr 172.21.15.100:0/2261598036 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.600+0000 7fc34c4ac640 1 -- 172.21.15.100:0/2261598036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0113f49a0 con 0x55a0113f3fd0 2024-09-18T01:25:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.600+0000 7fc34c4ac640 1 --2- 172.21.15.100:0/2261598036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113f3fd0 0x55a0113f43d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc33c063fb0 tx=0x7fc33c08d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13aa6b7664410994 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.601+0000 7fc22b7fe640 1 -- 172.21.15.100:0/2261598036 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c086680 con 0x55a0113f3fd0 2024-09-18T01:25:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.601+0000 7fc22b7fe640 1 -- 172.21.15.100:0/2261598036 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c086840 con 0x55a0113f3fd0 2024-09-18T01:25:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.601+0000 7fc22b7fe640 1 -- 172.21.15.100:0/2261598036 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c09bd90 con 0x55a0113f3fd0 2024-09-18T01:25:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.601+0000 7fc350724800 1 -- 172.21.15.100:0/2261598036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113f3fd0 msgr2=0x55a0113f43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.601+0000 7fc350724800 1 --2- 172.21.15.100:0/2261598036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113f3fd0 0x55a0113f43d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc33c063fb0 tx=0x7fc33c08d280 comp rx=0 tx=0).stop 2024-09-18T01:25:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.601+0000 7fc350724800 1 -- 172.21.15.100:0/2261598036 shutdown_connections 2024-09-18T01:25:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.601+0000 7fc350724800 1 --2- 172.21.15.100:0/2261598036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113f3fd0 0x55a0113f43d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.601+0000 7fc350724800 1 -- 172.21.15.100:0/2261598036 >> 172.21.15.100:0/2261598036 conn(0x55a0113f0330 msgr2=0x55a0113ee430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.601+0000 7fc350724800 1 -- 172.21.15.100:0/2261598036 shutdown_connections 2024-09-18T01:25:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.601+0000 7fc350724800 1 -- 172.21.15.100:0/2261598036 wait complete. 2024-09-18T01:25:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.601+0000 7fc350724800 1 Processor -- start 2024-09-18T01:25:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.601+0000 7fc350724800 1 -- start start 2024-09-18T01:25:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.601+0000 7fc350724800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113f3fd0 0x55a0113fb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.601+0000 7fc350724800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a0113f4f20 con 0x55a0113f3fd0 2024-09-18T01:25:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.602+0000 7fc34c4ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113f3fd0 0x55a0113fb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.602+0000 7fc34c4ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113f3fd0 0x55a0113fb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38310/0 (socket says 172.21.15.100:38310) 2024-09-18T01:25:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.602+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 learned_addr learned my addr 172.21.15.100:0/715873395 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.602+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0113fb7a0 con 0x55a0113f3fd0 2024-09-18T01:25:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.602+0000 7fc34c4ac640 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113f3fd0 0x55a0113fb260 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0884f0 tx=0x7fc33c09efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.602+0000 7fc229ffb640 1 -- 172.21.15.100:0/715873395 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c0bd070 con 0x55a0113f3fd0 2024-09-18T01:25:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.602+0000 7fc229ffb640 1 -- 172.21.15.100:0/715873395 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c068a30 con 0x55a0113f3fd0 2024-09-18T01:25:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.602+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0113fb7a0 con 0x55a0113f3fd0 2024-09-18T01:25:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.602+0000 7fc229ffb640 1 -- 172.21.15.100:0/715873395 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c05ab50 con 0x55a0113f3fd0 2024-09-18T01:25:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.602+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0113fb7a0 con 0x55a0113f3fd0 2024-09-18T01:25:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.603+0000 7fc229ffb640 1 -- 172.21.15.100:0/715873395 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc33c0c0070 con 0x55a0113f3fd0 2024-09-18T01:25:31.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.603+0000 7fc229ffb640 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc21c036b40 0x7fc21c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.603+0000 7fc229ffb640 1 -- 172.21.15.100:0/715873395 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fc33c0b5070 con 0x55a0113f3fd0 2024-09-18T01:25:31.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.603+0000 7fc34bcab640 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc21c036b40 0x7fc21c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.604+0000 7fc34bcab640 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc21c036b40 0x7fc21c039000 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc340001b60 tx=0x7fc340010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.604+0000 7fc350724800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.604+0000 7fc350724800 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a0114067c0 0x55a011408c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.604+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0114093d0 con 0x55a0114067c0 2024-09-18T01:25:31.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.604+0000 7fc34ccad640 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a0114067c0 0x55a011408c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.604+0000 7fc34ccad640 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a0114067c0 0x55a011408c80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 20 realm 2024-09-18T01:25:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0114097e0 con 0x55a0114067c0 2024-09-18T01:25:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a0b0 con 0x55a0114067c0 2024-09-18T01:25:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a0114067c0 2024-09-18T01:25:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a01140b1b0 0x55a01140d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.605+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a01140dbb0 con 0x55a01140b1b0 2024-09-18T01:25:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.606+0000 7fc34c4ac640 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a01140b1b0 0x55a01140d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.606+0000 7fc34c4ac640 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a01140b1b0 0x55a01140d5a0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.606+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.606+0000 7fc350724800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.606+0000 7fc350724800 20 searching for the correct realm 2024-09-18T01:25:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.606+0000 7fc350724800 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a01140fb60 0x55a011412020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.606+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0114126f0 con 0x55a01140fb60 2024-09-18T01:25:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.606+0000 7fc34bcab640 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a01140fb60 0x55a011412020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.606+0000 7fc34bcab640 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a01140fb60 0x55a011412020 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.607+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.607+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0114126f0 con 0x55a01140b1b0 2024-09-18T01:25:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.607+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.607+0000 7fc34c4ac640 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc33c0c2060 0x7fc33c0a2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.607+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0114126f0 con 0x7fc33c0c2060 2024-09-18T01:25:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.607+0000 7fc34ccad640 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc33c0c2060 0x7fc33c0a2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.607+0000 7fc34ccad640 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc33c0c2060 0x7fc33c0a2810 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.608+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.608+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a0114067c0 2024-09-18T01:25:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.608+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.608+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a0114067c0 2024-09-18T01:25:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.608+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.608+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x7fc33c0c2060 2024-09-18T01:25:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.608+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.608+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x7fc33c0c2060 2024-09-18T01:25:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.609+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.609+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a01140b1b0 2024-09-18T01:25:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.609+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.609+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a01140fb60 2024-09-18T01:25:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.609+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.609+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a0114067c0 2024-09-18T01:25:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.609+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.609+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x7fc33c0c2060 2024-09-18T01:25:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.610+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.610+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a0114067c0 2024-09-18T01:25:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.610+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.610+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a01140b1b0 2024-09-18T01:25:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.610+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.610+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a01140fb60 2024-09-18T01:25:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.610+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.610+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a01140fb60 2024-09-18T01:25:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.611+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.611+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x7fc33c0c2060 2024-09-18T01:25:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.611+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.611+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a01140fb60 2024-09-18T01:25:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.611+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.611+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a01140fb60 2024-09-18T01:25:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.611+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.611+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a0114067c0 2024-09-18T01:25:31.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.611+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.612+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a0114067c0 2024-09-18T01:25:31.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.612+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.612+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x7fc33c0c2060 2024-09-18T01:25:31.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.612+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.612+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a01140fb60 2024-09-18T01:25:31.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.612+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.612+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a01140b1b0 2024-09-18T01:25:31.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.613+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.613+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a0114067c0 2024-09-18T01:25:31.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.613+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.613+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x7fc33c0c2060 2024-09-18T01:25:31.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.613+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.613+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a01140fb60 2024-09-18T01:25:31.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.613+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.613+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x7fc33c0c2060 2024-09-18T01:25:31.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.614+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.614+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a01140b1b0 2024-09-18T01:25:31.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.614+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.614+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a01140fb60 2024-09-18T01:25:31.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.614+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.614+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x7fc33c0c2060 2024-09-18T01:25:31.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.614+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.614+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a0114067c0 2024-09-18T01:25:31.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a01140a450 con 0x55a01140b1b0 2024-09-18T01:25:31.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc350724800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:31.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc350724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:31.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc350724800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:31.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc350724800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:31.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc350724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:31.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc350724800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:31.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc350724800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a01140e470 con 0x55a0114067c0 2024-09-18T01:25:31.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc350724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc350724800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a01140e860 con 0x55a0114067c0 2024-09-18T01:25:31.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc350724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:31.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc350724800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.615+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a01140e860 con 0x7fc33c0c2060 2024-09-18T01:25:31.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.616+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.616+0000 7fc350724800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:31.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.616+0000 7fc350724800 20 zone default found 2024-09-18T01:25:31.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.616+0000 7fc350724800 4 Realm: () 2024-09-18T01:25:31.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.616+0000 7fc350724800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:31.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.616+0000 7fc350724800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:31.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.616+0000 7fc350724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:31.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.616+0000 7fc350724800 20 zonegroup default 2024-09-18T01:25:31.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.616+0000 7fc350724800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.616+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a01140e080 con 0x7fc33c0c2060 2024-09-18T01:25:31.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.616+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.616+0000 7fc350724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.616+0000 7fc350724800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.616+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a011414550 con 0x55a01140fb60 2024-09-18T01:25:31.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.617+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.617+0000 7fc350724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.617+0000 7fc350724800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.617+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0114148f0 con 0x55a01140fb60 2024-09-18T01:25:31.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.617+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.617+0000 7fc350724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.617+0000 7fc350724800 20 started sync module instance, tier type = 2024-09-18T01:25:31.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.617+0000 7fc350724800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:31.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.617+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0114139f0 con 0x55a01140b1b0 2024-09-18T01:25:31.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.618+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.618+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94145972616672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011413650 con 0x55a01140b1b0 2024-09-18T01:25:31.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.618+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0114155f0 con 0x55a0114067c0 2024-09-18T01:25:31.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.619+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94145972616672] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.619+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.619+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94145972620912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0114159e0 con 0x55a0114067c0 2024-09-18T01:25:31.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.619+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011416400 con 0x55a01140fb60 2024-09-18T01:25:31.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.620+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94145972620912] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.620+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.620+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94145972625136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0114167f0 con 0x55a01140fb60 2024-09-18T01:25:31.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.620+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011417210 con 0x55a01140b1b0 2024-09-18T01:25:31.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.623+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94145972625136] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.623+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.623+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94145972622032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011417ab0 con 0x55a01140b1b0 2024-09-18T01:25:31.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.623+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011418470 con 0x55a0114067c0 2024-09-18T01:25:31.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.624+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94145972622032] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.624+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.624+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94145972631520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011418470 con 0x55a0114067c0 2024-09-18T01:25:31.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.624+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011418e30 con 0x7fc33c0c2060 2024-09-18T01:25:31.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.625+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94145972631520] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.625+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.625+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94145972634016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011418e30 con 0x7fc33c0c2060 2024-09-18T01:25:31.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.625+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0114197f0 con 0x7fc33c0c2060 2024-09-18T01:25:31.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.626+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94145972634016] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.626+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.626+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94145972636032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0114199d0 con 0x7fc33c0c2060 2024-09-18T01:25:31.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.626+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a01141a220 con 0x7fc33c0c2060 2024-09-18T01:25:31.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.627+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94145972636032] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.627+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.627+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94145972639488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a01141a070 con 0x7fc33c0c2060 2024-09-18T01:25:31.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.627+0000 7fc350724800 20 add_watcher() i=0 2024-09-18T01:25:31.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.627+0000 7fc350724800 20 add_watcher() i=1 2024-09-18T01:25:31.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.627+0000 7fc350724800 20 add_watcher() i=2 2024-09-18T01:25:31.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.627+0000 7fc350724800 20 add_watcher() i=3 2024-09-18T01:25:31.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.627+0000 7fc350724800 20 add_watcher() i=4 2024-09-18T01:25:31.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.627+0000 7fc350724800 20 add_watcher() i=5 2024-09-18T01:25:31.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.627+0000 7fc350724800 20 add_watcher() i=6 2024-09-18T01:25:31.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.628+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94145972639488] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.628+0000 7fc350724800 20 add_watcher() i=7 2024-09-18T01:25:31.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.628+0000 7fc350724800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:31.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.628+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a01141d5e0 con 0x55a0114067c0 2024-09-18T01:25:31.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.629+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.629+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94145972640544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a01141aad0 con 0x55a0114067c0 2024-09-18T01:25:31.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.630+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94145972640544] v33'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.630+0000 7fc2027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:31.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.630+0000 7fc350724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:31.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.630+0000 7fc350724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:31.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.630+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a01141d420 con 0x55a0114067c0 2024-09-18T01:25:31.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.631+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'44 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.631+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011426790 con 0x7fc33c0c2060 2024-09-18T01:25:31.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.633+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.633+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011426bb0 con 0x55a01140fb60 2024-09-18T01:25:31.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.633+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.634+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0114275d0 con 0x55a0114067c0 2024-09-18T01:25:31.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.634+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'119 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.634+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0114279c0 con 0x55a01140b1b0 2024-09-18T01:25:31.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.635+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.635+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0114279c0 con 0x55a01140fb60 2024-09-18T01:25:31.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.636+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'33 uv16 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.636+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0114283e0 con 0x55a0114067c0 2024-09-18T01:25:31.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.638+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.638+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0114283e0 con 0x7fc33c0c2060 2024-09-18T01:25:31.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.639+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.639+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428520 con 0x55a01140b1b0 2024-09-18T01:25:31.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.639+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.640+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428520 con 0x55a01140fb60 2024-09-18T01:25:31.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.640+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.640+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428970 con 0x55a01140b1b0 2024-09-18T01:25:31.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.642+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.642+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428970 con 0x7fc33c0c2060 2024-09-18T01:25:31.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.643+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.643+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428970 con 0x55a01140b1b0 2024-09-18T01:25:31.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.644+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.644+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428970 con 0x7fc33c0c2060 2024-09-18T01:25:31.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.645+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'40 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.645+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428970 con 0x55a0114067c0 2024-09-18T01:25:31.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.646+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'120 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.646+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428970 con 0x55a01140fb60 2024-09-18T01:25:31.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.647+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'32 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.647+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f60 con 0x55a01140b1b0 2024-09-18T01:25:31.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.648+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'40 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.648+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x55a01140fb60 2024-09-18T01:25:31.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.649+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'26 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.649+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x55a0114067c0 2024-09-18T01:25:31.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.650+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.650+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x55a0114067c0 2024-09-18T01:25:31.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.651+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'121 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.651+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x55a01140fb60 2024-09-18T01:25:31.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.652+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.652+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x55a01140b1b0 2024-09-18T01:25:31.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.653+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'30 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.653+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x55a01140fb60 2024-09-18T01:25:31.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.654+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.654+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x55a01140fb60 2024-09-18T01:25:31.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.655+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.655+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x55a01140fb60 2024-09-18T01:25:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.656+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.656+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x55a01140fb60 2024-09-18T01:25:31.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.657+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'34 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.657+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x7fc33c0c2060 2024-09-18T01:25:31.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.658+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.658+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x55a01140fb60 2024-09-18T01:25:31.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.659+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.659+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x7fc33c0c2060 2024-09-18T01:25:31.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.660+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.660+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x55a01140fb60 2024-09-18T01:25:31.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.661+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.661+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x7fc33c0c2060 2024-09-18T01:25:31.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.662+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'41 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.662+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011428f40 con 0x55a01140b1b0 2024-09-18T01:25:31.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.663+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.664+0000 7fc2017e2640 20 reqs_thread_entry: start 2024-09-18T01:25:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.664+0000 7fc350724800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.664+0000 7fc350724800 20 Filter name: none 2024-09-18T01:25:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.664+0000 7fc172ffd640 20 reqs_thread_entry: start 2024-09-18T01:25:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.664+0000 7fc350724800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:25:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.664+0000 7fc350724800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.664+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0114539e0 con 0x7fc33c0c2060 2024-09-18T01:25:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.664+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.664+0000 7fc350724800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:25:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.664+0000 7fc350724800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T01:25:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.664+0000 7fc350724800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:25:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.664+0000 7fc350724800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:31.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.664+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a011456470 con 0x7fc33c0c2060 2024-09-18T01:25:31.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.665+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.667 INFO:teuthology.orchestra.run.smithi100.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-18T01:25:31.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.665+0000 7fc2027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:31.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.665+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94145972640544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0114038c0 con 0x55a0114067c0 2024-09-18T01:25:31.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.666+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94145972640544] v33'122 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.666+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94145972616672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011419b20 con 0x55a01140b1b0 2024-09-18T01:25:31.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.667+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94145972616672] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.667+0000 7fc350724800 20 remove_watcher() i=0 2024-09-18T01:25:31.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.667+0000 7fc350724800 2 removed watcher, disabling cache 2024-09-18T01:25:31.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.667+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94145972620912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011419b20 con 0x55a0114067c0 2024-09-18T01:25:31.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.669+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94145972620912] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.669+0000 7fc350724800 20 remove_watcher() i=1 2024-09-18T01:25:31.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.669+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94145972625136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011414e70 con 0x55a01140fb60 2024-09-18T01:25:31.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.670+0000 7fc34bcab640 1 -- 172.21.15.100:0/715873395 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94145972625136] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc340009050 con 0x55a01140fb60 2024-09-18T01:25:31.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.670+0000 7fc350724800 20 remove_watcher() i=2 2024-09-18T01:25:31.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.670+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94145972622032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011419b20 con 0x55a01140b1b0 2024-09-18T01:25:31.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.671+0000 7fc34c4ac640 1 -- 172.21.15.100:0/715873395 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94145972622032] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0bf030 con 0x55a01140b1b0 2024-09-18T01:25:31.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.671+0000 7fc350724800 20 remove_watcher() i=3 2024-09-18T01:25:31.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.671+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94145972631520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011415320 con 0x55a0114067c0 2024-09-18T01:25:31.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.672+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94145972631520] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x55a0114067c0 2024-09-18T01:25:31.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.672+0000 7fc350724800 20 remove_watcher() i=4 2024-09-18T01:25:31.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.672+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94145972634016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011415320 con 0x7fc33c0c2060 2024-09-18T01:25:31.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.673+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94145972634016] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.673+0000 7fc350724800 20 remove_watcher() i=5 2024-09-18T01:25:31.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.673+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94145972636032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011415320 con 0x7fc33c0c2060 2024-09-18T01:25:31.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.673+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94145972636032] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.673+0000 7fc350724800 20 remove_watcher() i=6 2024-09-18T01:25:31.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.674+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94145972639488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a011415320 con 0x7fc33c0c2060 2024-09-18T01:25:31.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 <== osd.0 v2:172.21.15.92:6800/2777570747 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94145972639488] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34400a4a0 con 0x7fc33c0c2060 2024-09-18T01:25:31.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 20 remove_watcher() i=7 2024-09-18T01:25:31.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc33c0c2060 msgr2=0x7fc33c0a2810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc33c0c2060 0x7fc33c0a2810 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a0114067c0 msgr2=0x55a011408c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a0114067c0 0x55a011408c80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a01140b1b0 msgr2=0x55a01140d5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a01140b1b0 0x55a01140d5a0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a01140fb60 msgr2=0x55a011412020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a01140fb60 0x55a011412020 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc21c036b40 msgr2=0x7fc21c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc21c036b40 0x7fc21c039000 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc340001b60 tx=0x7fc340010000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc34ccad640 1 -- 172.21.15.100:0/715873395 reap_dead start 2024-09-18T01:25:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113f3fd0 msgr2=0x55a0113fb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113f3fd0 0x55a0113fb260 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0884f0 tx=0x7fc33c09efb0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 shutdown_connections 2024-09-18T01:25:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 --2- 172.21.15.100:0/715873395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113f3fd0 0x55a0113fb260 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 >> 172.21.15.100:0/715873395 conn(0x55a0113f0330 msgr2=0x55a0113ee400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 shutdown_connections 2024-09-18T01:25:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 -- 172.21.15.100:0/715873395 wait complete. 2024-09-18T01:25:31.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 -- 172.21.15.100:0/167381391 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc224036b90 msgr2=0x7fc224039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 --2- 172.21.15.100:0/167381391 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc224036b90 0x7fc224039050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc34000bf50 tx=0x7fc34000f000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 -- 172.21.15.100:0/167381391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113e74d0 msgr2=0x55a0113e78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 --2- 172.21.15.100:0/167381391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113e74d0 0x55a0113e78f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc33c08f010 tx=0x7fc33c0747a0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 -- 172.21.15.100:0/167381391 shutdown_connections 2024-09-18T01:25:31.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 --2- 172.21.15.100:0/167381391 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc224036b90 0x7fc224039050 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 --2- 172.21.15.100:0/167381391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0113e74d0 0x55a0113e78f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.675+0000 7fc350724800 1 -- 172.21.15.100:0/167381391 >> 172.21.15.100:0/167381391 conn(0x55a0113dc460 msgr2=0x55a0113defe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 -- 172.21.15.100:0/167381391 shutdown_connections 2024-09-18T01:25:31.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 -- 172.21.15.100:0/167381391 wait complete. 2024-09-18T01:25:31.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a0113d6c30 msgr2=0x55a0113d9020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a0113d6c30 0x55a0113d9020 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a0112d5bb0 msgr2=0x55a0113d0460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a0112d5bb0 0x55a0113d0460 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a0113d2cf0 msgr2=0x55a0113d50e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a0113d2cf0 0x55a0113d50e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc234036b90 msgr2=0x7fc234039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc234036b90 0x7fc234039050 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc340000f60 tx=0x7fc3400012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 msgr2=0x55a0113c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 --2- 172.21.15.100:0/3574281714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a011244610 0x55a0113c93f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55a0113c28e0 tx=0x7fc33c002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc34ccad640 1 -- 172.21.15.100:0/3574281714 reap_dead start 2024-09-18T01:25:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 shutdown_connections 2024-09-18T01:25:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 >> 172.21.15.100:0/3574281714 conn(0x55a0112cade0 msgr2=0x55a0113bbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 shutdown_connections 2024-09-18T01:25:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.676+0000 7fc350724800 1 -- 172.21.15.100:0/3574281714 wait complete. 2024-09-18T01:25:31.685 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-18T01:25:31.686 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-18T01:25:31.686 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-18T01:25:31.686 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-18T01:25:31.732 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:31.732 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:31.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.731+0000 7fa4a2939800 1 Processor -- start 2024-09-18T01:25:31.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.731+0000 7fa4a2939800 1 -- start start 2024-09-18T01:25:31.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.731+0000 7fa4a2939800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x559b5b6524e0 0x559b5b6528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.731+0000 7fa4a2939800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559b5b512b30 con 0x559b5b652e20 2024-09-18T01:25:31.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.732+0000 7fa4a2939800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x559b5b4f4360 con 0x559b5b6524e0 2024-09-18T01:25:31.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.732+0000 7fa49e5d1640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x559b5b6524e0 0x559b5b6528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.732+0000 7fa49e5d1640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x559b5b6524e0 0x559b5b6528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38314/0 (socket says 172.21.15.100:38314) 2024-09-18T01:25:31.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.732+0000 7fa49e5d1640 1 -- 172.21.15.100:0/2298283644 learned_addr learned my addr 172.21.15.100:0/2298283644 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.732+0000 7fa497fff640 1 --1- 172.21.15.100:0/2298283644 >> v1:172.21.15.92:6789/0 conn(0x559b5b652e20 0x559b5b6579a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37366/0 (socket says 172.21.15.100:37366) 2024-09-18T01:25:31.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.732+0000 7fa49e5d1640 1 -- 172.21.15.100:0/2298283644 >> v1:172.21.15.92:6789/0 conn(0x559b5b652e20 legacy=0x559b5b6579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.732+0000 7fa49e5d1640 1 -- 172.21.15.100:0/2298283644 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b5b51ae00 con 0x559b5b6524e0 2024-09-18T01:25:31.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.734+0000 7fa49e5d1640 1 --2- 172.21.15.100:0/2298283644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 0x559b5b6528e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa49000a520 tx=0x7fa490045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d97288f67884d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.734+0000 7fa49ddd0640 1 -- 172.21.15.100:0/2298283644 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa490055070 con 0x559b5b6524e0 2024-09-18T01:25:31.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.734+0000 7fa49ddd0640 1 -- 172.21.15.100:0/2298283644 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4900515b0 con 0x559b5b6524e0 2024-09-18T01:25:31.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.734+0000 7fa49ddd0640 1 -- 172.21.15.100:0/2298283644 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4900518d0 con 0x559b5b6524e0 2024-09-18T01:25:31.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.735+0000 7fa4a2939800 1 -- 172.21.15.100:0/2298283644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 msgr2=0x559b5b6528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.735+0000 7fa4a2939800 1 --2- 172.21.15.100:0/2298283644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 0x559b5b6528e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa49000a520 tx=0x7fa490045ba0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.735+0000 7fa4a2939800 1 -- 172.21.15.100:0/2298283644 shutdown_connections 2024-09-18T01:25:31.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.735+0000 7fa4a2939800 1 --2- 172.21.15.100:0/2298283644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 0x559b5b6528e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.735+0000 7fa4a2939800 1 -- 172.21.15.100:0/2298283644 >> 172.21.15.100:0/2298283644 conn(0x559b5b64ddb0 msgr2=0x559b5b6501d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.735+0000 7fa4a2939800 1 -- 172.21.15.100:0/2298283644 shutdown_connections 2024-09-18T01:25:31.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.735+0000 7fa4a2939800 1 -- 172.21.15.100:0/2298283644 wait complete. 2024-09-18T01:25:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.748+0000 7fa4a2939800 1 Processor -- start 2024-09-18T01:25:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.748+0000 7fa4a2939800 1 -- start start 2024-09-18T01:25:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.749+0000 7fa4a2939800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 0x559b5b744a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.749+0000 7fa4a2939800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559b5b59f360 con 0x559b5b6524e0 2024-09-18T01:25:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.749+0000 7fa49e5d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 0x559b5b744a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.749+0000 7fa49e5d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 0x559b5b744a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38316/0 (socket says 172.21.15.100:38316) 2024-09-18T01:25:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.749+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3884764423 learned_addr learned my addr 172.21.15.100:0/3884764423 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.749+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3884764423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b5b4ecbc0 con 0x559b5b6524e0 2024-09-18T01:25:31.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.749+0000 7fa49e5d1640 1 --2- 172.21.15.100:0/3884764423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 0x559b5b744a80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa490025da0 tx=0x7fa490051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a889e57f486207d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.750+0000 7fa38c608640 1 -- 172.21.15.100:0/3884764423 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa490051890 con 0x559b5b6524e0 2024-09-18T01:25:31.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.750+0000 7fa38c608640 1 -- 172.21.15.100:0/3884764423 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa490051ac0 con 0x559b5b6524e0 2024-09-18T01:25:31.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.750+0000 7fa38c608640 1 -- 172.21.15.100:0/3884764423 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa490051da0 con 0x559b5b6524e0 2024-09-18T01:25:31.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.750+0000 7fa4a2939800 1 -- 172.21.15.100:0/3884764423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 msgr2=0x559b5b744a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.750+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3884764423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 0x559b5b744a80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa490025da0 tx=0x7fa490051000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.750+0000 7fa4a2939800 1 -- 172.21.15.100:0/3884764423 shutdown_connections 2024-09-18T01:25:31.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.750+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3884764423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 0x559b5b744a80 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.750+0000 7fa4a2939800 1 -- 172.21.15.100:0/3884764423 >> 172.21.15.100:0/3884764423 conn(0x559b5b64ddb0 msgr2=0x559b5b73c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.750+0000 7fa4a2939800 1 -- 172.21.15.100:0/3884764423 shutdown_connections 2024-09-18T01:25:31.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.750+0000 7fa4a2939800 1 -- 172.21.15.100:0/3884764423 wait complete. 2024-09-18T01:25:31.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.751+0000 7fa4a2939800 1 Processor -- start 2024-09-18T01:25:31.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.751+0000 7fa4a2939800 1 -- start start 2024-09-18T01:25:31.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.751+0000 7fa4a2939800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 0x559b5b74c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.751+0000 7fa4a2939800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559b5b659500 con 0x559b5b6524e0 2024-09-18T01:25:31.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.751+0000 7fa49e5d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 0x559b5b74c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.751+0000 7fa49e5d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 0x559b5b74c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38326/0 (socket says 172.21.15.100:38326) 2024-09-18T01:25:31.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.751+0000 7fa49e5d1640 1 -- 172.21.15.100:0/436970173 learned_addr learned my addr 172.21.15.100:0/436970173 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.751+0000 7fa49e5d1640 1 -- 172.21.15.100:0/436970173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b5b500fe0 con 0x559b5b6524e0 2024-09-18T01:25:31.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.751+0000 7fa49e5d1640 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 0x559b5b74c320 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa490025da0 tx=0x7fa490002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.752+0000 7fa38ae05640 1 -- 172.21.15.100:0/436970173 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa490073070 con 0x559b5b6524e0 2024-09-18T01:25:31.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.752+0000 7fa38ae05640 1 -- 172.21.15.100:0/436970173 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49005a580 con 0x559b5b6524e0 2024-09-18T01:25:31.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.752+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b5b74c860 con 0x559b5b6524e0 2024-09-18T01:25:31.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.752+0000 7fa38ae05640 1 -- 172.21.15.100:0/436970173 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa49005a860 con 0x559b5b6524e0 2024-09-18T01:25:31.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.752+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b5b74cde0 con 0x559b5b6524e0 2024-09-18T01:25:31.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.752+0000 7fa38ae05640 1 -- 172.21.15.100:0/436970173 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa490076070 con 0x559b5b6524e0 2024-09-18T01:25:31.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.752+0000 7fa38ae05640 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa384036b40 0x7fa384039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.753+0000 7fa38ae05640 1 -- 172.21.15.100:0/436970173 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa490062070 con 0x559b5b6524e0 2024-09-18T01:25:31.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.753+0000 7fa497fff640 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa384036b40 0x7fa384039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.753+0000 7fa4a2939800 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559b5b652e20 0x559b5b753390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.753+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b753a00 con 0x559b5b652e20 2024-09-18T01:25:31.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.753+0000 7fa49edd2640 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559b5b652e20 0x559b5b753390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.753+0000 7fa497fff640 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa384036b40 0x7fa384039000 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa488000f60 tx=0x7fa488006390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.753+0000 7fa49edd2640 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559b5b652e20 0x559b5b753390 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.753+0000 7fa49edd2640 1 -- 172.21.15.100:0/436970173 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b652e20 2024-09-18T01:25:31.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.753+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b750960 con 0x559b5b652e20 2024-09-18T01:25:31.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.754+0000 7fa49edd2640 1 -- 172.21.15.100:0/436970173 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b652e20 2024-09-18T01:25:31.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.754+0000 7fa4a2939800 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559b5b755d30 0x559b5b758120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.754+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b758810 con 0x559b5b755d30 2024-09-18T01:25:31.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.754+0000 7fa49e5d1640 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559b5b755d30 0x559b5b758120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.754+0000 7fa49e5d1640 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559b5b755d30 0x559b5b758120 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.754+0000 7fa49e5d1640 1 -- 172.21.15.100:0/436970173 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa49007f070 con 0x559b5b755d30 2024-09-18T01:25:31.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.754+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b754bd0 con 0x559b5b652e20 2024-09-18T01:25:31.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.755+0000 7fa49edd2640 1 -- 172.21.15.100:0/436970173 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b652e20 2024-09-18T01:25:31.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.755+0000 7fa4a2939800 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559b5b759c70 0x559b5b75c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.755+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b75c760 con 0x559b5b759c70 2024-09-18T01:25:31.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.755+0000 7fa497fff640 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559b5b759c70 0x559b5b75c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.755+0000 7fa497fff640 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559b5b759c70 0x559b5b75c060 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.755+0000 7fa497fff640 1 -- 172.21.15.100:0/436970173 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa48800bbf0 con 0x559b5b759c70 2024-09-18T01:25:31.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.756+0000 7fa4a2939800 1 Processor -- start 2024-09-18T01:25:31.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.756+0000 7fa4a2939800 1 -- start start 2024-09-18T01:25:31.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.756+0000 7fa4a2939800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b76a500 0x559b5b76a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.756+0000 7fa4a2939800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559b5b4ee580 con 0x559b5b76a500 2024-09-18T01:25:31.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.756+0000 7fa49e5d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b76a500 0x559b5b76a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.756+0000 7fa49e5d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b76a500 0x559b5b76a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38338/0 (socket says 172.21.15.100:38338) 2024-09-18T01:25:31.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.756+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3443874626 learned_addr learned my addr 172.21.15.100:0/3443874626 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.756+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3443874626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b5b76ae60 con 0x559b5b76a500 2024-09-18T01:25:31.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.756+0000 7fa49e5d1640 1 --2- 172.21.15.100:0/3443874626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b76a500 0x559b5b76a920 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa49005cfd0 tx=0x7fa490065e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.757+0000 7fa383fff640 1 -- 172.21.15.100:0/3443874626 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa49000a020 con 0x559b5b76a500 2024-09-18T01:25:31.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.757+0000 7fa383fff640 1 -- 172.21.15.100:0/3443874626 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49000a1c0 con 0x559b5b76a500 2024-09-18T01:25:31.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.757+0000 7fa4a2939800 1 -- 172.21.15.100:0/3443874626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b5b76b0f0 con 0x559b5b76a500 2024-09-18T01:25:31.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.757+0000 7fa383fff640 1 -- 172.21.15.100:0/3443874626 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa49006e4f0 con 0x559b5b76a500 2024-09-18T01:25:31.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.757+0000 7fa4a2939800 1 -- 172.21.15.100:0/3443874626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b5b76ddd0 con 0x559b5b76a500 2024-09-18T01:25:31.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.757+0000 7fa383fff640 1 -- 172.21.15.100:0/3443874626 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa490058070 con 0x559b5b76a500 2024-09-18T01:25:31.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.757+0000 7fa383fff640 1 --2- 172.21.15.100:0/3443874626 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa378036b90 0x7fa378039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.757+0000 7fa383fff640 1 -- 172.21.15.100:0/3443874626 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa49008c040 con 0x559b5b76a500 2024-09-18T01:25:31.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.758+0000 7fa497fff640 1 --2- 172.21.15.100:0/3443874626 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa378036b90 0x7fa378039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.758+0000 7fa4a2939800 1 Processor -- start 2024-09-18T01:25:31.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.758+0000 7fa4a2939800 1 -- start start 2024-09-18T01:25:31.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.758+0000 7fa497fff640 1 --2- 172.21.15.100:0/3443874626 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa378036b90 0x7fa378039050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa48800bfd0 tx=0x7fa48800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.758+0000 7fa4a2939800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b776f70 0x559b5b777370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.758+0000 7fa4a2939800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559b5b745170 con 0x559b5b776f70 2024-09-18T01:25:31.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.758+0000 7fa49e5d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b776f70 0x559b5b777370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.758+0000 7fa49e5d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b776f70 0x559b5b777370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38344/0 (socket says 172.21.15.100:38344) 2024-09-18T01:25:31.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.758+0000 7fa49e5d1640 1 -- 172.21.15.100:0/667364247 learned_addr learned my addr 172.21.15.100:0/667364247 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.758+0000 7fa49e5d1640 1 -- 172.21.15.100:0/667364247 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b5b777940 con 0x559b5b776f70 2024-09-18T01:25:31.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.759+0000 7fa49e5d1640 1 --2- 172.21.15.100:0/667364247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b776f70 0x559b5b777370 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa490050c00 tx=0x7fa490082690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c8750101d2b0cd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.759+0000 7fa381ffb640 1 -- 172.21.15.100:0/667364247 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa49008f940 con 0x559b5b776f70 2024-09-18T01:25:31.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.759+0000 7fa381ffb640 1 -- 172.21.15.100:0/667364247 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa490086ca0 con 0x559b5b776f70 2024-09-18T01:25:31.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.759+0000 7fa381ffb640 1 -- 172.21.15.100:0/667364247 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa490009790 con 0x559b5b776f70 2024-09-18T01:25:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.759+0000 7fa4a2939800 1 -- 172.21.15.100:0/667364247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b776f70 msgr2=0x559b5b777370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.759+0000 7fa4a2939800 1 --2- 172.21.15.100:0/667364247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b776f70 0x559b5b777370 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa490050c00 tx=0x7fa490082690 comp rx=0 tx=0).stop 2024-09-18T01:25:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.759+0000 7fa4a2939800 1 -- 172.21.15.100:0/667364247 shutdown_connections 2024-09-18T01:25:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.759+0000 7fa4a2939800 1 --2- 172.21.15.100:0/667364247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b776f70 0x559b5b777370 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.759+0000 7fa4a2939800 1 -- 172.21.15.100:0/667364247 >> 172.21.15.100:0/667364247 conn(0x559b5b773360 msgr2=0x559b5b771460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.759+0000 7fa4a2939800 1 -- 172.21.15.100:0/667364247 shutdown_connections 2024-09-18T01:25:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.759+0000 7fa4a2939800 1 -- 172.21.15.100:0/667364247 wait complete. 2024-09-18T01:25:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.759+0000 7fa4a2939800 1 Processor -- start 2024-09-18T01:25:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.759+0000 7fa4a2939800 1 -- start start 2024-09-18T01:25:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.760+0000 7fa4a2939800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b776f70 0x559b5b77e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.760+0000 7fa4a2939800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559b5b777dd0 con 0x559b5b776f70 2024-09-18T01:25:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.760+0000 7fa49e5d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b776f70 0x559b5b77e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.760+0000 7fa49e5d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b776f70 0x559b5b77e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38358/0 (socket says 172.21.15.100:38358) 2024-09-18T01:25:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.760+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 learned_addr learned my addr 172.21.15.100:0/3786231034 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.760+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b5b77e7d0 con 0x559b5b776f70 2024-09-18T01:25:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.760+0000 7fa49e5d1640 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b776f70 0x559b5b77e290 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa490093ef0 tx=0x7fa490093e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.760+0000 7fa36ffff640 1 -- 172.21.15.100:0/3786231034 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4900bf070 con 0x559b5b776f70 2024-09-18T01:25:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.760+0000 7fa36ffff640 1 -- 172.21.15.100:0/3786231034 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa490078ca0 con 0x559b5b776f70 2024-09-18T01:25:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.760+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b5b77e7d0 con 0x559b5b776f70 2024-09-18T01:25:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.760+0000 7fa36ffff640 1 -- 172.21.15.100:0/3786231034 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4900806d0 con 0x559b5b776f70 2024-09-18T01:25:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.760+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b5b77e7d0 con 0x559b5b776f70 2024-09-18T01:25:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.761+0000 7fa36ffff640 1 -- 172.21.15.100:0/3786231034 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa4900c2070 con 0x559b5b776f70 2024-09-18T01:25:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.761+0000 7fa36ffff640 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa368036b40 0x7fa368039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.761+0000 7fa36ffff640 1 -- 172.21.15.100:0/3786231034 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa4900aa070 con 0x559b5b776f70 2024-09-18T01:25:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.761+0000 7fa497fff640 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa368036b40 0x7fa368039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.762+0000 7fa497fff640 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa368036b40 0x7fa368039000 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa48800cfd0 tx=0x7fa488010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.762+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.762+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559b5b7898c0 0x559b5b78bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.762+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78c4d0 con 0x559b5b7898c0 2024-09-18T01:25:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.762+0000 7fa49edd2640 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559b5b7898c0 0x559b5b78bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.762+0000 7fa49edd2640 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559b5b7898c0 0x559b5b78bd80 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 20 realm 2024-09-18T01:25:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78c8e0 con 0x559b5b7898c0 2024-09-18T01:25:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d1b0 con 0x559b5b7898c0 2024-09-18T01:25:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b7898c0 2024-09-18T01:25:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559b5b78e2b0 0x559b5b7906a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.763+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b790cb0 con 0x559b5b78e2b0 2024-09-18T01:25:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.764+0000 7fa49e5d1640 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559b5b78e2b0 0x559b5b7906a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.764+0000 7fa49e5d1640 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559b5b78e2b0 0x559b5b7906a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.764+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.764+0000 7fa4a2939800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.764+0000 7fa4a2939800 20 searching for the correct realm 2024-09-18T01:25:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.764+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559b5b792c60 0x559b5b795120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.764+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7957f0 con 0x559b5b792c60 2024-09-18T01:25:31.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.764+0000 7fa497fff640 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559b5b792c60 0x559b5b795120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.764+0000 7fa497fff640 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559b5b792c60 0x559b5b795120 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.765+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48802e030 con 0x559b5b792c60 2024-09-18T01:25:31.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.765+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7957f0 con 0x559b5b78e2b0 2024-09-18T01:25:31.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.765+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.765+0000 7fa49e5d1640 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa4900c4060 0x7fa490097350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.765+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7957f0 con 0x7fa4900c4060 2024-09-18T01:25:31.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.765+0000 7fa49edd2640 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa4900c4060 0x7fa490097350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.766+0000 7fa49edd2640 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa4900c4060 0x7fa490097350 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.766+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.766+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b7898c0 2024-09-18T01:25:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.766+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.766+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b7898c0 2024-09-18T01:25:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.766+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.766+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x7fa4900c4060 2024-09-18T01:25:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.767+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.767+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x7fa4900c4060 2024-09-18T01:25:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.767+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.767+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b78e2b0 2024-09-18T01:25:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.767+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.767+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b792c60 2024-09-18T01:25:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.767+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48802e030 con 0x559b5b792c60 2024-09-18T01:25:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.767+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b7898c0 2024-09-18T01:25:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.768+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.768+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x7fa4900c4060 2024-09-18T01:25:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.768+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.768+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b7898c0 2024-09-18T01:25:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.768+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.768+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b78e2b0 2024-09-18T01:25:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.768+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.768+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b792c60 2024-09-18T01:25:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.769+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48802e030 con 0x559b5b792c60 2024-09-18T01:25:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.769+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b792c60 2024-09-18T01:25:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.769+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48802e030 con 0x559b5b792c60 2024-09-18T01:25:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.769+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x7fa4900c4060 2024-09-18T01:25:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.769+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.769+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b792c60 2024-09-18T01:25:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.769+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48802e030 con 0x559b5b792c60 2024-09-18T01:25:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.769+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b792c60 2024-09-18T01:25:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.769+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48802e030 con 0x559b5b792c60 2024-09-18T01:25:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.769+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b7898c0 2024-09-18T01:25:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.770+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.770+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b7898c0 2024-09-18T01:25:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.770+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.770+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x7fa4900c4060 2024-09-18T01:25:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.770+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.770+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b792c60 2024-09-18T01:25:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.770+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48802e030 con 0x559b5b792c60 2024-09-18T01:25:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.770+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b78e2b0 2024-09-18T01:25:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.771+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.771+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b7898c0 2024-09-18T01:25:31.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.771+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.771+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x7fa4900c4060 2024-09-18T01:25:31.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.771+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.771+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b792c60 2024-09-18T01:25:31.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.771+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48802e030 con 0x559b5b792c60 2024-09-18T01:25:31.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.772+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x7fa4900c4060 2024-09-18T01:25:31.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.772+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.772+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b78e2b0 2024-09-18T01:25:31.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.772+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.772+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b792c60 2024-09-18T01:25:31.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.772+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48802e030 con 0x559b5b792c60 2024-09-18T01:25:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.772+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x7fa4900c4060 2024-09-18T01:25:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.772+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b7898c0 2024-09-18T01:25:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b5b78d550 con 0x559b5b78e2b0 2024-09-18T01:25:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa4a2939800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa4a2939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa4a2939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa4a2939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa4a2939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa4a2939800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b791570 con 0x559b5b7898c0 2024-09-18T01:25:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa4a2939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b791960 con 0x559b5b7898c0 2024-09-18T01:25:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa4a2939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.773+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b791960 con 0x7fa4900c4060 2024-09-18T01:25:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 20 zone default found 2024-09-18T01:25:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 4 Realm: () 2024-09-18T01:25:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 20 zonegroup default 2024-09-18T01:25:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b791180 con 0x7fa4900c4060 2024-09-18T01:25:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7911b0 con 0x559b5b792c60 2024-09-18T01:25:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa48802e030 con 0x559b5b792c60 2024-09-18T01:25:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.774+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7977d0 con 0x559b5b792c60 2024-09-18T01:25:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.775+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa48802e030 con 0x559b5b792c60 2024-09-18T01:25:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.775+0000 7fa4a2939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.775+0000 7fa4a2939800 20 started sync module instance, tier type = 2024-09-18T01:25:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.775+0000 7fa4a2939800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.775+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b796af0 con 0x559b5b78e2b0 2024-09-18T01:25:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.776+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.776+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94125742976736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7980e0 con 0x559b5b78e2b0 2024-09-18T01:25:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.776+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b798930 con 0x559b5b7898c0 2024-09-18T01:25:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.777+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94125742976736] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.777+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.777+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94125742980144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b798970 con 0x559b5b7898c0 2024-09-18T01:25:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.777+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b799410 con 0x559b5b792c60 2024-09-18T01:25:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.778+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94125742980144] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.779+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48802e030 con 0x559b5b792c60 2024-09-18T01:25:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.779+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94125742984960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b799830 con 0x559b5b792c60 2024-09-18T01:25:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.779+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b79a250 con 0x559b5b78e2b0 2024-09-18T01:25:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.780+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.780+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94125742990912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b79af10 con 0x559b5b78e2b0 2024-09-18T01:25:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.780+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94125742984960] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48802e030 con 0x559b5b792c60 2024-09-18T01:25:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.780+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7984a0 con 0x559b5b7898c0 2024-09-18T01:25:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.781+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94125742990912] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.781+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.781+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94125742991968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b79ae80 con 0x559b5b7898c0 2024-09-18T01:25:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.781+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b79bef0 con 0x7fa4900c4060 2024-09-18T01:25:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.782+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.782+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94125742991968] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.782+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94125742996032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b79c310 con 0x7fa4900c4060 2024-09-18T01:25:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.782+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b79c820 con 0x7fa4900c4060 2024-09-18T01:25:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.783+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.783+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94125742994464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b79ccd0 con 0x7fa4900c4060 2024-09-18T01:25:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.783+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b79d710 con 0x7fa4900c4060 2024-09-18T01:25:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.783+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94125742996032] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.784+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94125742994464] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.784+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.784+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94125743002080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b79c820 con 0x7fa4900c4060 2024-09-18T01:25:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.784+0000 7fa4a2939800 20 add_watcher() i=0 2024-09-18T01:25:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.784+0000 7fa4a2939800 20 add_watcher() i=1 2024-09-18T01:25:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.784+0000 7fa4a2939800 20 add_watcher() i=2 2024-09-18T01:25:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.784+0000 7fa4a2939800 20 add_watcher() i=3 2024-09-18T01:25:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.784+0000 7fa4a2939800 20 add_watcher() i=4 2024-09-18T01:25:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.784+0000 7fa4a2939800 20 add_watcher() i=5 2024-09-18T01:25:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.784+0000 7fa4a2939800 20 add_watcher() i=6 2024-09-18T01:25:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.785+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94125743002080] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.785+0000 7fa4a2939800 20 add_watcher() i=7 2024-09-18T01:25:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.785+0000 7fa4a2939800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.785+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7a0810 con 0x559b5b7898c0 2024-09-18T01:25:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.785+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.785+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94125742997088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b79dc90 con 0x559b5b7898c0 2024-09-18T01:25:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.786+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94125742997088] v33'123 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.786+0000 7fa354fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.787+0000 7fa4a2939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.787+0000 7fa4a2939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.787+0000 7fa4a2939800 5 note: GC not initialized 2024-09-18T01:25:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.787+0000 7fa2cf7fe640 20 reqs_thread_entry: start 2024-09-18T01:25:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.787+0000 7fa4a2939800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.787+0000 7fa4a2939800 20 Filter name: none 2024-09-18T01:25:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.787+0000 7fa2cd7fa640 20 reqs_thread_entry: start 2024-09-18T01:25:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.787+0000 7fa4a2939800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:25:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.787+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.787+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7d3a40 con 0x7fa4900c4060 2024-09-18T01:25:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.787+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.787+0000 7fa4a2939800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:25:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.788+0000 7fa4a2939800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T01:25:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.788+0000 7fa4a2939800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:25:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.788+0000 7fa4a2939800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.788+0000 7fa4a2939800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:25:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.788+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.788+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7d5b20 con 0x559b5b78e2b0 2024-09-18T01:25:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.788+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.788+0000 7fa4a2939800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.788+0000 7fa4a2939800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:25:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.788+0000 7fa4a2939800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.788+0000 7fa4a2939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 : miss 2024-09-18T01:25:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.788+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.788+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7d7510 con 0x7fa4900c4060 2024-09-18T01:25:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.789+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(64 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.789+0000 7fa4a2939800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.789+0000 7fa4a2939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.789+0000 7fa4a2939800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.789+0000 7fa4a2939800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.789+0000 7fa4a2939800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.789+0000 7fa4a2939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 2024-09-18T01:25:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.789+0000 7fa4a2939800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-18T01:25:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.789+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7d8a90 con 0x7fa4900c4060 2024-09-18T01:25:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.790+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(65 fud.buckets [call] v33'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.790+0000 7fa4a2939800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-18T01:25:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.790+0000 7fa4a2939800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.790+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7d8e90 con 0x559b5b78e2b0 2024-09-18T01:25:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.790+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.790+0000 7fa4a2939800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.790+0000 7fa4a2939800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-18T01:25:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.790+0000 7fa4a2939800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.790+0000 7fa4a2939800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.790+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7dea80 con 0x559b5b78e2b0 2024-09-18T01:25:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.791+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v33'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.791+0000 7fa4a2939800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-18T01:25:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.791+0000 7fa4a2939800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.791+0000 7fa4a2939800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:25:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.791+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94125743252880 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7dbfb0 con 0x7fa4900c4060 2024-09-18T01:25:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.792+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== watch-notify(notify (1) cookie 94125742994464 notify 141733920772 ret 0) ==== 380+0+0 (crc 0 0 0) 0x559b5b7d7900 con 0x7fa4900c4060 2024-09-18T01:25:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.792+0000 7fa381ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94125742994464 notifier 4524 bl.length()=338 2024-09-18T01:25:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.792+0000 7fa381ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-18T01:25:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.792+0000 7fa381ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.792+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(68 notify.6 [notify cookie 94125743252880 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.792+0000 7fa381ffb640 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa364003ea0 con 0x7fa4900c4060 2024-09-18T01:25:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.792+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.792+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== watch-notify(notify_complete (2) cookie 94125743252880 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559b5b7d6a50 con 0x7fa4900c4060 2024-09-18T01:25:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.793+0000 7fa354fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.793+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94125742997088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7d1790 con 0x559b5b7898c0 2024-09-18T01:25:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.794+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94125742997088] v33'124 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.794+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94125742976736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7d1790 con 0x559b5b78e2b0 2024-09-18T01:25:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.795+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94125742976736] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.795+0000 7fa4a2939800 20 remove_watcher() i=0 2024-09-18T01:25:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.795+0000 7fa4a2939800 2 removed watcher, disabling cache 2024-09-18T01:25:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.795+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94125742980144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7d1790 con 0x559b5b7898c0 2024-09-18T01:25:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.796+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94125742980144] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.796+0000 7fa4a2939800 20 remove_watcher() i=1 2024-09-18T01:25:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.796+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94125742984960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b7d1790 con 0x559b5b792c60 2024-09-18T01:25:31.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.797+0000 7fa497fff640 1 -- 172.21.15.100:0/3786231034 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94125742984960] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48802e030 con 0x559b5b792c60 2024-09-18T01:25:31.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.797+0000 7fa4a2939800 20 remove_watcher() i=2 2024-09-18T01:25:31.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.797+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94125742990912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b796ee0 con 0x559b5b78e2b0 2024-09-18T01:25:31.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.798+0000 7fa49e5d1640 1 -- 172.21.15.100:0/3786231034 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94125742990912] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4900c1030 con 0x559b5b78e2b0 2024-09-18T01:25:31.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.798+0000 7fa4a2939800 20 remove_watcher() i=3 2024-09-18T01:25:31.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.798+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94125742991968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b797c30 con 0x559b5b7898c0 2024-09-18T01:25:31.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.799+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94125742991968] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x559b5b7898c0 2024-09-18T01:25:31.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.799+0000 7fa4a2939800 20 remove_watcher() i=4 2024-09-18T01:25:31.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.799+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94125742996032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b798f00 con 0x7fa4900c4060 2024-09-18T01:25:31.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.800+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94125742996032] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.800+0000 7fa4a2939800 20 remove_watcher() i=5 2024-09-18T01:25:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.800+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94125742994464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b798f00 con 0x7fa4900c4060 2024-09-18T01:25:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.801+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94125742994464] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.801+0000 7fa4a2939800 20 remove_watcher() i=6 2024-09-18T01:25:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.801+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94125743002080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b5b79b420 con 0x7fa4900c4060 2024-09-18T01:25:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.802+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94125743002080] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa49800a4a0 con 0x7fa4900c4060 2024-09-18T01:25:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.802+0000 7fa4a2939800 20 remove_watcher() i=7 2024-09-18T01:25:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.802+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa4900c4060 msgr2=0x7fa490097350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.802+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa4900c4060 0x7fa490097350 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.802+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559b5b7898c0 msgr2=0x559b5b78bd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.802+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559b5b7898c0 0x559b5b78bd80 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.802+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559b5b78e2b0 msgr2=0x559b5b7906a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.802+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559b5b78e2b0 0x559b5b7906a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.802+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559b5b792c60 msgr2=0x559b5b795120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.802+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559b5b792c60 0x559b5b795120 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa368036b40 msgr2=0x7fa368039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa368036b40 0x7fa368039000 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa48800cfd0 tx=0x7fa488010000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b776f70 msgr2=0x559b5b77e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa49edd2640 1 -- 172.21.15.100:0/3786231034 reap_dead start 2024-09-18T01:25:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b776f70 0x559b5b77e290 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa490093ef0 tx=0x7fa490093e80 comp rx=0 tx=0).stop 2024-09-18T01:25:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 shutdown_connections 2024-09-18T01:25:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3786231034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b776f70 0x559b5b77e290 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 >> 172.21.15.100:0/3786231034 conn(0x559b5b773360 msgr2=0x559b5b771430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 shutdown_connections 2024-09-18T01:25:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/3786231034 wait complete. 2024-09-18T01:25:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/3443874626 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa378036b90 msgr2=0x7fa378039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3443874626 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa378036b90 0x7fa378039050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa48800bfd0 tx=0x7fa48800f000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/3443874626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b76a500 msgr2=0x559b5b76a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3443874626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b76a500 0x559b5b76a920 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa49005cfd0 tx=0x7fa490065e80 comp rx=0 tx=0).stop 2024-09-18T01:25:31.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/3443874626 shutdown_connections 2024-09-18T01:25:31.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3443874626 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa378036b90 0x7fa378039050 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 --2- 172.21.15.100:0/3443874626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b76a500 0x559b5b76a920 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/3443874626 >> 172.21.15.100:0/3443874626 conn(0x559b5b75f490 msgr2=0x559b5b762010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/3443874626 shutdown_connections 2024-09-18T01:25:31.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/3443874626 wait complete. 2024-09-18T01:25:31.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559b5b759c70 msgr2=0x559b5b75c060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559b5b759c70 0x559b5b75c060 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559b5b652e20 msgr2=0x559b5b753390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559b5b652e20 0x559b5b753390 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559b5b755d30 msgr2=0x559b5b758120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.803+0000 7fa4a2939800 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559b5b755d30 0x559b5b758120 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.804+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa384036b40 msgr2=0x7fa384039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.804+0000 7fa4a2939800 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa384036b40 0x7fa384039000 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa488000f60 tx=0x7fa488006390 comp rx=0 tx=0).stop 2024-09-18T01:25:31.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.804+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 msgr2=0x559b5b74c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.804+0000 7fa4a2939800 1 --2- 172.21.15.100:0/436970173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b5b6524e0 0x559b5b74c320 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa490025da0 tx=0x7fa490002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.804+0000 7fa49edd2640 1 -- 172.21.15.100:0/436970173 reap_dead start 2024-09-18T01:25:31.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.804+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 shutdown_connections 2024-09-18T01:25:31.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.804+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 >> 172.21.15.100:0/436970173 conn(0x559b5b64ddb0 msgr2=0x559b5b73a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.804+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 shutdown_connections 2024-09-18T01:25:31.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.804+0000 7fa4a2939800 1 -- 172.21.15.100:0/436970173 wait complete. 2024-09-18T01:25:31.819 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '153b7754-209b-4898-8796-577da7c1273d.4237.1'] 2024-09-18T01:25:31.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '153b7754-209b-4898-8796-577da7c1273d.4237.1'] 2024-09-18T01:25:31.819 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 153b7754-209b-4898-8796-577da7c1273d.4237.1 2024-09-18T01:25:31.867 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:31.867 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:31.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.867+0000 7f06e7087800 1 Processor -- start 2024-09-18T01:25:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.867+0000 7f06e7087800 1 -- start start 2024-09-18T01:25:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.867+0000 7f06e7087800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560924e50630 0x560924edf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.867+0000 7f06e7087800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560924d9bb30 con 0x560924edf7d0 2024-09-18T01:25:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.867+0000 7f06e7087800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x560924d7d360 con 0x560924e50630 2024-09-18T01:25:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.867+0000 7f06e4b7b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560924e50630 0x560924edf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.867+0000 7f06dffff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x560924edf7d0 0x560924ee1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37372/0 (socket says 172.21.15.100:37372) 2024-09-18T01:25:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.867+0000 7f06dffff640 1 -- 172.21.15.100:0/3230358421 learned_addr learned my addr 172.21.15.100:0/3230358421 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.867+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3230358421 >> v1:172.21.15.92:6789/0 conn(0x560924edf7d0 legacy=0x560924ee1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.867+0000 7f06df7fe640 1 -- 172.21.15.100:0/3230358421 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3703478346 0 0) 0x560924d9bb30 con 0x560924edf7d0 2024-09-18T01:25:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.867+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3230358421 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560924da3e00 con 0x560924e50630 2024-09-18T01:25:31.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.869+0000 7f06e4b7b640 1 --2- 172.21.15.100:0/3230358421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 0x560924edf290 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f06d800a470 tx=0x7f06d8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f2250cd8faf94 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.869+0000 7f06df7fe640 1 -- 172.21.15.100:0/3230358421 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8053570 con 0x560924e50630 2024-09-18T01:25:31.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.869+0000 7f06df7fe640 1 -- 172.21.15.100:0/3230358421 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d8058070 con 0x560924e50630 2024-09-18T01:25:31.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.869+0000 7f06df7fe640 1 -- 172.21.15.100:0/3230358421 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8053880 con 0x560924e50630 2024-09-18T01:25:31.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.870+0000 7f06e7087800 1 -- 172.21.15.100:0/3230358421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 msgr2=0x560924edf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.870+0000 7f06e7087800 1 --2- 172.21.15.100:0/3230358421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 0x560924edf290 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f06d800a470 tx=0x7f06d8045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:31.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.870+0000 7f06e7087800 1 -- 172.21.15.100:0/3230358421 shutdown_connections 2024-09-18T01:25:31.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.870+0000 7f06e7087800 1 --2- 172.21.15.100:0/3230358421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 0x560924edf290 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.870+0000 7f06e7087800 1 -- 172.21.15.100:0/3230358421 >> 172.21.15.100:0/3230358421 conn(0x560924ed6e00 msgr2=0x560924ed9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.870+0000 7f06e7087800 1 -- 172.21.15.100:0/3230358421 shutdown_connections 2024-09-18T01:25:31.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.870+0000 7f06e7087800 1 -- 172.21.15.100:0/3230358421 wait complete. 2024-09-18T01:25:31.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.884+0000 7f06e7087800 1 Processor -- start 2024-09-18T01:25:31.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.884+0000 7f06e7087800 1 -- start start 2024-09-18T01:25:31.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.884+0000 7f06e7087800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 0x560924fcb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.884+0000 7f06e7087800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560924e28350 con 0x560924e50630 2024-09-18T01:25:31.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.884+0000 7f06e4b7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 0x560924fcb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.884+0000 7f06e4b7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 0x560924fcb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38380/0 (socket says 172.21.15.100:38380) 2024-09-18T01:25:31.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.884+0000 7f06e4b7b640 1 -- 172.21.15.100:0/2086305831 learned_addr learned my addr 172.21.15.100:0/2086305831 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.884+0000 7f06e4b7b640 1 -- 172.21.15.100:0/2086305831 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560924d75bc0 con 0x560924e50630 2024-09-18T01:25:31.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.885+0000 7f06e4b7b640 1 --2- 172.21.15.100:0/2086305831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 0x560924fcb730 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f06d8045f50 tx=0x7f06d8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec4d5757e24390c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.885+0000 7f05d2e05640 1 -- 172.21.15.100:0/2086305831 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8053c20 con 0x560924e50630 2024-09-18T01:25:31.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.885+0000 7f05d2e05640 1 -- 172.21.15.100:0/2086305831 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d8063030 con 0x560924e50630 2024-09-18T01:25:31.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.885+0000 7f05d2e05640 1 -- 172.21.15.100:0/2086305831 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8053440 con 0x560924e50630 2024-09-18T01:25:31.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.885+0000 7f06e7087800 1 -- 172.21.15.100:0/2086305831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 msgr2=0x560924fcb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.885+0000 7f06e7087800 1 --2- 172.21.15.100:0/2086305831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 0x560924fcb730 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f06d8045f50 tx=0x7f06d8051000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.885+0000 7f06e7087800 1 -- 172.21.15.100:0/2086305831 shutdown_connections 2024-09-18T01:25:31.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.885+0000 7f06e7087800 1 --2- 172.21.15.100:0/2086305831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 0x560924fcb730 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.885+0000 7f06e7087800 1 -- 172.21.15.100:0/2086305831 >> 172.21.15.100:0/2086305831 conn(0x560924ed6e00 msgr2=0x560924fc70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.885+0000 7f06e7087800 1 -- 172.21.15.100:0/2086305831 shutdown_connections 2024-09-18T01:25:31.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.885+0000 7f06e7087800 1 -- 172.21.15.100:0/2086305831 wait complete. 2024-09-18T01:25:31.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.886+0000 7f06e7087800 1 Processor -- start 2024-09-18T01:25:31.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.886+0000 7f06e7087800 1 -- start start 2024-09-18T01:25:31.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.886+0000 7f06e7087800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 0x560924fd30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.886+0000 7f06e7087800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560924ee36a0 con 0x560924e50630 2024-09-18T01:25:31.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.886+0000 7f06e4b7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 0x560924fd30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.886+0000 7f06e4b7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 0x560924fd30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38382/0 (socket says 172.21.15.100:38382) 2024-09-18T01:25:31.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.886+0000 7f06e4b7b640 1 -- 172.21.15.100:0/2354714988 learned_addr learned my addr 172.21.15.100:0/2354714988 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.887+0000 7f06e4b7b640 1 -- 172.21.15.100:0/2354714988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560924d89fe0 con 0x560924e50630 2024-09-18T01:25:31.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.887+0000 7f06e4b7b640 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 0x560924fd30b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f06d8045f20 tx=0x7f06d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.887+0000 7f05d1602640 1 -- 172.21.15.100:0/2354714988 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8053570 con 0x560924e50630 2024-09-18T01:25:31.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.887+0000 7f05d1602640 1 -- 172.21.15.100:0/2354714988 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d8053710 con 0x560924e50630 2024-09-18T01:25:31.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.887+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560924fd35f0 con 0x560924e50630 2024-09-18T01:25:31.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.887+0000 7f05d1602640 1 -- 172.21.15.100:0/2354714988 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8068420 con 0x560924e50630 2024-09-18T01:25:31.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.887+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560924fd3a90 con 0x560924e50630 2024-09-18T01:25:31.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.888+0000 7f05d1602640 1 -- 172.21.15.100:0/2354714988 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f06d80685c0 con 0x560924e50630 2024-09-18T01:25:31.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.888+0000 7f05d1602640 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05cc036b90 0x7f05cc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.888+0000 7f05d1602640 1 -- 172.21.15.100:0/2354714988 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f06d8070070 con 0x560924e50630 2024-09-18T01:25:31.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.888+0000 7f06dffff640 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05cc036b90 0x7f05cc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.888+0000 7f06e7087800 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560924edf7d0 0x560924fda120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.888+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560924fda660 con 0x560924edf7d0 2024-09-18T01:25:31.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.888+0000 7f06e537c640 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560924edf7d0 0x560924fda120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.888+0000 7f06dffff640 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05cc036b90 0x7f05cc039050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f06d0000c00 tx=0x7f06d00013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.889+0000 7f06e537c640 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560924edf7d0 0x560924fda120 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.889+0000 7f06e537c640 1 -- 172.21.15.100:0/2354714988 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x560924edf7d0 2024-09-18T01:25:31.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.889+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560924fd76d0 con 0x560924edf7d0 2024-09-18T01:25:31.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.889+0000 7f06e537c640 1 -- 172.21.15.100:0/2354714988 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06e000a4a0 con 0x560924edf7d0 2024-09-18T01:25:31.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.889+0000 7f06e7087800 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560924fdc900 0x560924fdecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.889+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560924fdf3c0 con 0x560924fdc900 2024-09-18T01:25:31.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.889+0000 7f06e4b7b640 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560924fdc900 0x560924fdecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.889+0000 7f06e4b7b640 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560924fdc900 0x560924fdecf0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.890+0000 7f06e4b7b640 1 -- 172.21.15.100:0/2354714988 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f06d8051070 con 0x560924fdc900 2024-09-18T01:25:31.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.890+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560924fdb6e0 con 0x560924edf7d0 2024-09-18T01:25:31.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.890+0000 7f06e537c640 1 -- 172.21.15.100:0/2354714988 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06e000a4a0 con 0x560924edf7d0 2024-09-18T01:25:31.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.890+0000 7f06e7087800 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560924fe0800 0x560924fe2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.890+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560924fe3290 con 0x560924fe0800 2024-09-18T01:25:31.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.890+0000 7f06dffff640 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560924fe0800 0x560924fe2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.891+0000 7f06dffff640 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560924fe0800 0x560924fe2bf0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.891+0000 7f06dffff640 1 -- 172.21.15.100:0/2354714988 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f06d000f670 con 0x560924fe0800 2024-09-18T01:25:31.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.891+0000 7f06e7087800 1 Processor -- start 2024-09-18T01:25:31.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.891+0000 7f06e7087800 1 -- start start 2024-09-18T01:25:31.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.891+0000 7f06e7087800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924ff1000 0x560924ff1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.891+0000 7f06e7087800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560924d77580 con 0x560924ff1000 2024-09-18T01:25:31.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.892+0000 7f06e4b7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924ff1000 0x560924ff1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.892+0000 7f06e4b7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924ff1000 0x560924ff1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38388/0 (socket says 172.21.15.100:38388) 2024-09-18T01:25:31.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.892+0000 7f06e4b7b640 1 -- 172.21.15.100:0/4023429279 learned_addr learned my addr 172.21.15.100:0/4023429279 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.892+0000 7f06e4b7b640 1 -- 172.21.15.100:0/4023429279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560924ff1960 con 0x560924ff1000 2024-09-18T01:25:31.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.892+0000 7f06e4b7b640 1 --2- 172.21.15.100:0/4023429279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924ff1000 0x560924ff1420 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f06d808edc0 tx=0x7f06d8068e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.892+0000 7f05ca7fc640 1 -- 172.21.15.100:0/4023429279 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8087040 con 0x560924ff1000 2024-09-18T01:25:31.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.892+0000 7f05ca7fc640 1 -- 172.21.15.100:0/4023429279 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d8090e20 con 0x560924ff1000 2024-09-18T01:25:31.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.892+0000 7f06e7087800 1 -- 172.21.15.100:0/4023429279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560924ff1bf0 con 0x560924ff1000 2024-09-18T01:25:31.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.892+0000 7f05ca7fc640 1 -- 172.21.15.100:0/4023429279 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d805ec10 con 0x560924ff1000 2024-09-18T01:25:31.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.892+0000 7f06e7087800 1 -- 172.21.15.100:0/4023429279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560924ff1bf0 con 0x560924ff1000 2024-09-18T01:25:31.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.893+0000 7f05ca7fc640 1 -- 172.21.15.100:0/4023429279 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f06d808a070 con 0x560924ff1000 2024-09-18T01:25:31.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.893+0000 7f05ca7fc640 1 --2- 172.21.15.100:0/4023429279 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05bc036b90 0x7f05bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.893+0000 7f05ca7fc640 1 -- 172.21.15.100:0/4023429279 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f06d809bc80 con 0x560924ff1000 2024-09-18T01:25:31.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.893+0000 7f06dffff640 1 --2- 172.21.15.100:0/4023429279 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05bc036b90 0x7f05bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.893+0000 7f06e7087800 1 Processor -- start 2024-09-18T01:25:31.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.894+0000 7f06e7087800 1 -- start start 2024-09-18T01:25:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.894+0000 7f06dffff640 1 --2- 172.21.15.100:0/4023429279 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05bc036b90 0x7f05bc039050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x560924fdaaa0 tx=0x7f06d0006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.894+0000 7f06e7087800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924edc4c0 0x560924edc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.894+0000 7f06e7087800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560924fcbe80 con 0x560924edc4c0 2024-09-18T01:25:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.894+0000 7f06e4b7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924edc4c0 0x560924edc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.894+0000 7f06e4b7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924edc4c0 0x560924edc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38400/0 (socket says 172.21.15.100:38400) 2024-09-18T01:25:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.894+0000 7f06e4b7b640 1 -- 172.21.15.100:0/2505458816 learned_addr learned my addr 172.21.15.100:0/2505458816 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.894+0000 7f06e4b7b640 1 -- 172.21.15.100:0/2505458816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560924edce90 con 0x560924edc4c0 2024-09-18T01:25:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.894+0000 7f06e4b7b640 1 --2- 172.21.15.100:0/2505458816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924edc4c0 0x560924edc8c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f06d8085010 tx=0x7f06d805d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1729409ece3b2b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.894+0000 7f05bbfff640 1 -- 172.21.15.100:0/2505458816 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d80a8030 con 0x560924edc4c0 2024-09-18T01:25:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.894+0000 7f05bbfff640 1 -- 172.21.15.100:0/2505458816 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d8094020 con 0x560924edc4c0 2024-09-18T01:25:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.894+0000 7f05bbfff640 1 -- 172.21.15.100:0/2505458816 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d807f120 con 0x560924edc4c0 2024-09-18T01:25:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.895+0000 7f06e7087800 1 -- 172.21.15.100:0/2505458816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924edc4c0 msgr2=0x560924edc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.895+0000 7f06e7087800 1 --2- 172.21.15.100:0/2505458816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924edc4c0 0x560924edc8c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f06d8085010 tx=0x7f06d805d3a0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.895+0000 7f06e7087800 1 -- 172.21.15.100:0/2505458816 shutdown_connections 2024-09-18T01:25:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.895+0000 7f06e7087800 1 --2- 172.21.15.100:0/2505458816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924edc4c0 0x560924edc8c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.895+0000 7f06e7087800 1 -- 172.21.15.100:0/2505458816 >> 172.21.15.100:0/2505458816 conn(0x560924ff9c60 msgr2=0x560924ff7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.895+0000 7f06e7087800 1 -- 172.21.15.100:0/2505458816 shutdown_connections 2024-09-18T01:25:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.895+0000 7f06e7087800 1 -- 172.21.15.100:0/2505458816 wait complete. 2024-09-18T01:25:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.895+0000 7f06e7087800 1 Processor -- start 2024-09-18T01:25:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.895+0000 7f06e7087800 1 -- start start 2024-09-18T01:25:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.895+0000 7f06e7087800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924edc4c0 0x560925006d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.895+0000 7f06e7087800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560924edb070 con 0x560924edc4c0 2024-09-18T01:25:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.895+0000 7f06e4b7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924edc4c0 0x560925006d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.896+0000 7f06e4b7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924edc4c0 0x560925006d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38410/0 (socket says 172.21.15.100:38410) 2024-09-18T01:25:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.896+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 learned_addr learned my addr 172.21.15.100:0/3384405544 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.896+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560925007280 con 0x560924edc4c0 2024-09-18T01:25:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.896+0000 7f06e4b7b640 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924edc4c0 0x560925006d40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f06d800a330 tx=0x7f06d8072f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.896+0000 7f05ba7fc640 1 -- 172.21.15.100:0/3384405544 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d809dd00 con 0x560924edc4c0 2024-09-18T01:25:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.896+0000 7f05ba7fc640 1 -- 172.21.15.100:0/3384405544 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d809dea0 con 0x560924edc4c0 2024-09-18T01:25:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.896+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560925007280 con 0x560924edc4c0 2024-09-18T01:25:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.896+0000 7f05ba7fc640 1 -- 172.21.15.100:0/3384405544 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8061b30 con 0x560924edc4c0 2024-09-18T01:25:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.896+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560925007280 con 0x560924edc4c0 2024-09-18T01:25:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.897+0000 7f05ba7fc640 1 -- 172.21.15.100:0/3384405544 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f06d80bb070 con 0x560924edc4c0 2024-09-18T01:25:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.897+0000 7f05ba7fc640 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05b0036b90 0x7f05b0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.897+0000 7f05ba7fc640 1 -- 172.21.15.100:0/3384405544 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f06d80ac070 con 0x560924edc4c0 2024-09-18T01:25:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.897+0000 7f06dffff640 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05b0036b90 0x7f05b0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.898+0000 7f06dffff640 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05b0036b90 0x7f05b0039050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f06d000ffd0 tx=0x7f06d0023040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.898+0000 7f06e7087800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.898+0000 7f06e7087800 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5609250124a0 0x560925014960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.898+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5609250150b0 con 0x5609250124a0 2024-09-18T01:25:31.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.898+0000 7f06e537c640 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5609250124a0 0x560925014960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.898+0000 7f06e537c640 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5609250124a0 0x560925014960 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 20 realm 2024-09-18T01:25:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5609250154c0 con 0x5609250124a0 2024-09-18T01:25:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560925015d90 con 0x5609250124a0 2024-09-18T01:25:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x5609250124a0 2024-09-18T01:25:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560925016e90 0x560925019280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560925019840 con 0x560925016e90 2024-09-18T01:25:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.899+0000 7f06e4b7b640 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560925016e90 0x560925019280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.900+0000 7f06e4b7b640 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560925016e90 0x560925019280 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.900+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.900+0000 7f06e7087800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.900+0000 7f06e7087800 20 searching for the correct realm 2024-09-18T01:25:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.900+0000 7f06e7087800 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56092501b7f0 0x56092501dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.900+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56092501e380 con 0x56092501b7f0 2024-09-18T01:25:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.900+0000 7f06dffff640 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56092501b7f0 0x56092501dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.900+0000 7f06dffff640 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56092501b7f0 0x56092501dcb0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.901+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d0037040 con 0x56092501b7f0 2024-09-18T01:25:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.901+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56092501e380 con 0x560925016e90 2024-09-18T01:25:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.901+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.901+0000 7f06e4b7b640 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f06d805f040 0x7f06d80b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.901+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56092501e380 con 0x7f06d805f040 2024-09-18T01:25:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.901+0000 7f06e537c640 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f06d805f040 0x7f06d80b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.901+0000 7f06e537c640 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f06d805f040 0x7f06d80b1880 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.902+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.902+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x5609250124a0 2024-09-18T01:25:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.902+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.902+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x5609250124a0 2024-09-18T01:25:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.902+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.902+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x7f06d805f040 2024-09-18T01:25:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.903+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.903+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x7f06d805f040 2024-09-18T01:25:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.903+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.903+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x560925016e90 2024-09-18T01:25:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.903+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.903+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x56092501b7f0 2024-09-18T01:25:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.903+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d0037040 con 0x56092501b7f0 2024-09-18T01:25:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.903+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x5609250124a0 2024-09-18T01:25:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.903+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.903+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x7f06d805f040 2024-09-18T01:25:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.904+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.904+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x5609250124a0 2024-09-18T01:25:31.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.904+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.904+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x560925016e90 2024-09-18T01:25:31.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.904+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.904+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x56092501b7f0 2024-09-18T01:25:31.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.904+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d0037040 con 0x56092501b7f0 2024-09-18T01:25:31.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.905+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x56092501b7f0 2024-09-18T01:25:31.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.905+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d0037040 con 0x56092501b7f0 2024-09-18T01:25:31.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.905+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x7f06d805f040 2024-09-18T01:25:31.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.905+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.905+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x56092501b7f0 2024-09-18T01:25:31.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.905+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d0037040 con 0x56092501b7f0 2024-09-18T01:25:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.905+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x56092501b7f0 2024-09-18T01:25:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.905+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d0037040 con 0x56092501b7f0 2024-09-18T01:25:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.905+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x5609250124a0 2024-09-18T01:25:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.906+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.906+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x5609250124a0 2024-09-18T01:25:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.906+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.906+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x7f06d805f040 2024-09-18T01:25:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.906+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.906+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x56092501b7f0 2024-09-18T01:25:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.906+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d0037040 con 0x56092501b7f0 2024-09-18T01:25:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.907+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x560925016e90 2024-09-18T01:25:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.907+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.907+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x5609250124a0 2024-09-18T01:25:31.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.907+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.907+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x7f06d805f040 2024-09-18T01:25:31.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.907+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.907+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x56092501b7f0 2024-09-18T01:25:31.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.907+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d0037040 con 0x56092501b7f0 2024-09-18T01:25:31.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.908+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x7f06d805f040 2024-09-18T01:25:31.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.908+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.908+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x560925016e90 2024-09-18T01:25:31.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.908+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.908+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x56092501b7f0 2024-09-18T01:25:31.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.908+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d0037040 con 0x56092501b7f0 2024-09-18T01:25:31.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.908+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x7f06d805f040 2024-09-18T01:25:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x5609250124a0 2024-09-18T01:25:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560925016130 con 0x560925016e90 2024-09-18T01:25:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e7087800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e7087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e7087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e7087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e7087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e7087800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e7087800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56092501a100 con 0x5609250124a0 2024-09-18T01:25:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e7087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e7087800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.909+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56092501a4f0 con 0x5609250124a0 2024-09-18T01:25:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.910+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.910+0000 7f06e7087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.910+0000 7f06e7087800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.910+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56092501a4f0 con 0x7f06d805f040 2024-09-18T01:25:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.910+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.910+0000 7f06e7087800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.910+0000 7f06e7087800 20 zone default found 2024-09-18T01:25:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.910+0000 7f06e7087800 4 Realm: () 2024-09-18T01:25:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.910+0000 7f06e7087800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.910+0000 7f06e7087800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.910+0000 7f06e7087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.910+0000 7f06e7087800 20 zonegroup default 2024-09-18T01:25:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.910+0000 7f06e7087800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.910+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560925019d60 con 0x7f06d805f040 2024-09-18T01:25:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.911+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.911+0000 7f06e7087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.911+0000 7f06e7087800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.911+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5609250201e0 con 0x56092501b7f0 2024-09-18T01:25:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.911+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06d0037040 con 0x56092501b7f0 2024-09-18T01:25:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.911+0000 7f06e7087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.911+0000 7f06e7087800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.911+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560925020580 con 0x56092501b7f0 2024-09-18T01:25:31.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.911+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06d0037040 con 0x56092501b7f0 2024-09-18T01:25:31.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.911+0000 7f06e7087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:31.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.911+0000 7f06e7087800 20 started sync module instance, tier type = 2024-09-18T01:25:31.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.911+0000 7f06e7087800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:31.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.911+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56092501f680 con 0x560925016e90 2024-09-18T01:25:31.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.912+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.912+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94597275581040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925020dd0 con 0x560925016e90 2024-09-18T01:25:31.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.912+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925021620 con 0x5609250124a0 2024-09-18T01:25:31.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.913+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94597275581040] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.914+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.914+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94597275584800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925021230 con 0x5609250124a0 2024-09-18T01:25:31.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.914+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925021cf0 con 0x56092501b7f0 2024-09-18T01:25:31.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.915+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94597275584800] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.915+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d0037040 con 0x56092501b7f0 2024-09-18T01:25:31.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.915+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94597275588544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5609250220e0 con 0x56092501b7f0 2024-09-18T01:25:31.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.915+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925022b40 con 0x560925016e90 2024-09-18T01:25:31.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.916+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94597275588544] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d0037040 con 0x56092501b7f0 2024-09-18T01:25:31.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.916+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.916+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94597275585856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925022f30 con 0x560925016e90 2024-09-18T01:25:31.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.916+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925023950 con 0x5609250124a0 2024-09-18T01:25:31.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.917+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94597275585856] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.917+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.917+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94597275595840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925023910 con 0x5609250124a0 2024-09-18T01:25:31.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.917+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5609250243a0 con 0x7f06d805f040 2024-09-18T01:25:31.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.918+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94597275595840] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.918+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.918+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94597275598512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5609250243a0 con 0x7f06d805f040 2024-09-18T01:25:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.918+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925024db0 con 0x7f06d805f040 2024-09-18T01:25:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.919+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94597275598512] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.919+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.919+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94597275592224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925024db0 con 0x7f06d805f040 2024-09-18T01:25:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.919+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5609250257c0 con 0x7f06d805f040 2024-09-18T01:25:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.920+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94597275592224] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.920+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.920+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94597275601632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5609250257c0 con 0x7f06d805f040 2024-09-18T01:25:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.920+0000 7f06e7087800 20 add_watcher() i=0 2024-09-18T01:25:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.920+0000 7f06e7087800 20 add_watcher() i=1 2024-09-18T01:25:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.920+0000 7f06e7087800 20 add_watcher() i=2 2024-09-18T01:25:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.920+0000 7f06e7087800 20 add_watcher() i=3 2024-09-18T01:25:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.920+0000 7f06e7087800 20 add_watcher() i=4 2024-09-18T01:25:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.920+0000 7f06e7087800 20 add_watcher() i=5 2024-09-18T01:25:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.920+0000 7f06e7087800 20 add_watcher() i=6 2024-09-18T01:25:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.921+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94597275601632] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.921+0000 7f06e7087800 20 add_watcher() i=7 2024-09-18T01:25:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.921+0000 7f06e7087800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.921+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560925028b20 con 0x5609250124a0 2024-09-18T01:25:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.922+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.922+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94597275604096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925025d50 con 0x5609250124a0 2024-09-18T01:25:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.923+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94597275604096] v33'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.923+0000 7f059afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.923+0000 7f06e7087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.923+0000 7f06e7087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.923+0000 7f06e7087800 5 note: GC not initialized 2024-09-18T01:25:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.923+0000 7f0599fe3640 20 reqs_thread_entry: start 2024-09-18T01:25:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.923+0000 7f06e7087800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.923+0000 7f06e7087800 20 Filter name: none 2024-09-18T01:25:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.923+0000 7f050b7fe640 20 reqs_thread_entry: start 2024-09-18T01:25:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.923+0000 7f06e7087800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.923+0000 7f06e7087800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.923+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56092505c0b0 con 0x5609250124a0 2024-09-18T01:25:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e7087800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e7087800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e7087800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e7087800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e7087800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:25:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e7087800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56092505e190 con 0x560925016e90 2024-09-18T01:25:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e7087800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e7087800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:25:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e7087800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e7087800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 : miss 2024-09-18T01:25:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e7087800 20 rados->read ofs=0 len=0 2024-09-18T01:25:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.924+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56092505f9b0 con 0x7f06d805f040 2024-09-18T01:25:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.925+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(64 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.925+0000 7f06e7087800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.925+0000 7f06e7087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.925+0000 7f06e7087800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.925+0000 7f06e7087800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.925+0000 7f06e7087800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.925+0000 7f06e7087800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 2024-09-18T01:25:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.925+0000 7f06e7087800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-18T01:25:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.925+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925064220 con 0x7f06d805f040 2024-09-18T01:25:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.926+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(65 fud.buckets [call] v33'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.926+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:66 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56092506a120 con 0x7f06d805f040 2024-09-18T01:25:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.927+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(66 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.927+0000 7f06e7087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.927+0000 7f06e7087800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.927+0000 7f06e7087800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.927+0000 7f06e7087800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1, ofs0, ns] 2024-09-18T01:25:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.927+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94597275844720 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560925064650 con 0x5609250124a0 2024-09-18T01:25:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.927+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== watch-notify(notify (1) cookie 94597275584800 notify 141733920787 ret 0) ==== 794+0+0 (crc 0 0 0) 0x56092505fda0 con 0x5609250124a0 2024-09-18T01:25:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.927+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(67 notify.1 [notify cookie 94597275844720 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.927+0000 7f05bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920787 cookie 94597275584800 notifier 4531 bl.length()=752 2024-09-18T01:25:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.927+0000 7f05bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.927+0000 7f05bbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.927+0000 7f05bbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.927+0000 7f05bbfff640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f05a8003ea0 con 0x5609250124a0 2024-09-18T01:25:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.928+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.928+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== watch-notify(notify_complete (2) cookie 94597275844720 notify 141733920787 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56092505eef0 con 0x5609250124a0 2024-09-18T01:25:31.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.928+0000 7f06e7087800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): orig_sources= new_sources= 2024-09-18T01:25:31.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.928+0000 7f06e7087800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): potential sources added=[] removed=[] 2024-09-18T01:25:31.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.928+0000 7f06e7087800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): orig_dests= new_dests= 2024-09-18T01:25:31.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.928+0000 7f06e7087800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): potential dests added=[] removed=[] 2024-09-18T01:25:31.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.928+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925060050 con 0x560925016e90 2024-09-18T01:25:31.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.929+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(69 foo.buckets [call] v33'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.929+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925060050 con 0x560925016e90 2024-09-18T01:25:31.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.930+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.930+0000 7f06e7087800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T01:25:31.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.930+0000 7f06e7087800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.930+0000 7f06e7087800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:25:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.930+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94597275844688 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560925068df0 con 0x7f06d805f040 2024-09-18T01:25:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.930+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== watch-notify(notify (1) cookie 94597275592224 notify 141733920773 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f06e0018d60 con 0x7f06d805f040 2024-09-18T01:25:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.930+0000 7f05bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 94597275592224 notifier 4531 bl.length()=314 2024-09-18T01:25:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.930+0000 7f05bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T01:25:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.930+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(71 notify.6 [notify cookie 94597275844688 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.930+0000 7f05bbfff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.931+0000 7f05bbfff640 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f05a8003ea0 con 0x7f06d805f040 2024-09-18T01:25:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.931+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.931+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== watch-notify(notify_complete (2) cookie 94597275844688 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f06e00435c0 con 0x7f06d805f040 2024-09-18T01:25:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.932+0000 7f059afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.932+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94597275604096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925059e20 con 0x5609250124a0 2024-09-18T01:25:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.933+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94597275604096] v33'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.933+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94597275581040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925059e20 con 0x560925016e90 2024-09-18T01:25:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.933+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94597275581040] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.934+0000 7f06e7087800 20 remove_watcher() i=0 2024-09-18T01:25:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.934+0000 7f06e7087800 2 removed watcher, disabling cache 2024-09-18T01:25:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.934+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94597275584800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925059e20 con 0x5609250124a0 2024-09-18T01:25:31.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.935+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94597275584800] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.935+0000 7f06e7087800 20 remove_watcher() i=1 2024-09-18T01:25:31.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.935+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94597275588544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925059e20 con 0x56092501b7f0 2024-09-18T01:25:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.937+0000 7f06dffff640 1 -- 172.21.15.100:0/3384405544 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94597275588544] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d0037040 con 0x56092501b7f0 2024-09-18T01:25:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.937+0000 7f06e7087800 20 remove_watcher() i=2 2024-09-18T01:25:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.937+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94597275585856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925020920 con 0x560925016e90 2024-09-18T01:25:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.938+0000 7f06e4b7b640 1 -- 172.21.15.100:0/3384405544 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94597275585856] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d80d0040 con 0x560925016e90 2024-09-18T01:25:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.938+0000 7f06e7087800 20 remove_watcher() i=3 2024-09-18T01:25:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.938+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94597275595840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5609250217c0 con 0x5609250124a0 2024-09-18T01:25:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.939+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94597275595840] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x5609250124a0 2024-09-18T01:25:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.939+0000 7f06e7087800 20 remove_watcher() i=4 2024-09-18T01:25:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.939+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94597275598512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925023440 con 0x7f06d805f040 2024-09-18T01:25:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.940+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94597275598512] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.941+0000 7f06e7087800 20 remove_watcher() i=5 2024-09-18T01:25:31.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.941+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94597275592224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5609250217c0 con 0x7f06d805f040 2024-09-18T01:25:31.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.942+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94597275592224] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.942+0000 7f06e7087800 20 remove_watcher() i=6 2024-09-18T01:25:31.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.942+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94597275601632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560925023440 con 0x7f06d805f040 2024-09-18T01:25:31.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94597275601632] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4a0 con 0x7f06d805f040 2024-09-18T01:25:31.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 20 remove_watcher() i=7 2024-09-18T01:25:31.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f06d805f040 msgr2=0x7f06d80b1880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f06d805f040 0x7f06d80b1880 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5609250124a0 msgr2=0x560925014960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5609250124a0 0x560925014960 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560925016e90 msgr2=0x560925019280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560925016e90 0x560925019280 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56092501b7f0 msgr2=0x56092501dcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56092501b7f0 0x56092501dcb0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05b0036b90 msgr2=0x7f05b0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05b0036b90 0x7f05b0039050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f06d000ffd0 tx=0x7f06d0023040 comp rx=0 tx=0).stop 2024-09-18T01:25:31.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924edc4c0 msgr2=0x560925006d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 --2- 172.21.15.100:0/3384405544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924edc4c0 0x560925006d40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f06d800a330 tx=0x7f06d8072f20 comp rx=0 tx=0).stop 2024-09-18T01:25:31.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 reap_dead start 2024-09-18T01:25:31.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e537c640 1 -- 172.21.15.100:0/3384405544 reap_dead start 2024-09-18T01:25:31.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 shutdown_connections 2024-09-18T01:25:31.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 >> 172.21.15.100:0/3384405544 conn(0x560924ff9c60 msgr2=0x560924ff7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 shutdown_connections 2024-09-18T01:25:31.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/3384405544 wait complete. 2024-09-18T01:25:31.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/4023429279 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05bc036b90 msgr2=0x7f05bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 --2- 172.21.15.100:0/4023429279 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05bc036b90 0x7f05bc039050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x560924fdaaa0 tx=0x7f06d0006000 comp rx=0 tx=0).stop 2024-09-18T01:25:31.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/4023429279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924ff1000 msgr2=0x560924ff1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 --2- 172.21.15.100:0/4023429279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924ff1000 0x560924ff1420 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f06d808edc0 tx=0x7f06d8068e50 comp rx=0 tx=0).stop 2024-09-18T01:25:31.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/4023429279 shutdown_connections 2024-09-18T01:25:31.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 --2- 172.21.15.100:0/4023429279 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05bc036b90 0x7f05bc039050 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 --2- 172.21.15.100:0/4023429279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924ff1000 0x560924ff1420 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/4023429279 >> 172.21.15.100:0/4023429279 conn(0x560924fe5f90 msgr2=0x560924fe8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/4023429279 shutdown_connections 2024-09-18T01:25:31.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.943+0000 7f06e7087800 1 -- 172.21.15.100:0/4023429279 wait complete. 2024-09-18T01:25:31.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560924fe0800 msgr2=0x560924fe2bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e7087800 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560924fe0800 0x560924fe2bf0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560924edf7d0 msgr2=0x560924fda120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e7087800 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560924edf7d0 0x560924fda120 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560924fdc900 msgr2=0x560924fdecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e7087800 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560924fdc900 0x560924fdecf0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05cc036b90 msgr2=0x7f05cc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e7087800 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f05cc036b90 0x7f05cc039050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f06d0000c00 tx=0x7f06d00013b0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 msgr2=0x560924fd30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:31.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e7087800 1 --2- 172.21.15.100:0/2354714988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560924e50630 0x560924fd30b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f06d8045f20 tx=0x7f06d8002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:31.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e537c640 1 -- 172.21.15.100:0/2354714988 reap_dead start 2024-09-18T01:25:31.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 shutdown_connections 2024-09-18T01:25:31.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 >> 172.21.15.100:0/2354714988 conn(0x560924ed6e00 msgr2=0x560924fc5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:31.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 shutdown_connections 2024-09-18T01:25:31.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:31.944+0000 7f06e7087800 1 -- 172.21.15.100:0/2354714988 wait complete. 2024-09-18T01:25:31.957 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-18T01:25:31.957 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-18T01:25:31.957 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-18T01:25:32.001 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:32.001 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:32.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.001+0000 7f7a6b840800 1 Processor -- start 2024-09-18T01:25:32.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.001+0000 7f7a6b840800 1 -- start start 2024-09-18T01:25:32.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.001+0000 7f7a6b840800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55662af7cdb0 0x55662af7f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.001+0000 7f7a6b840800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55662ae35b30 con 0x55662aeea5f0 2024-09-18T01:25:32.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.001+0000 7f7a6b840800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55662ae17360 con 0x55662af7cdb0 2024-09-18T01:25:32.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.002+0000 7f7a60b33640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55662af7cdb0 0x55662af7f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.002+0000 7f7a60b33640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55662af7cdb0 0x55662af7f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38412/0 (socket says 172.21.15.100:38412) 2024-09-18T01:25:32.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.002+0000 7f7a69334640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55662aeea5f0 0x55662af7b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37388/0 (socket says 172.21.15.100:37388) 2024-09-18T01:25:32.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.002+0000 7f7a60b33640 1 -- 172.21.15.100:0/1170452395 learned_addr learned my addr 172.21.15.100:0/1170452395 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.002+0000 7f7a60b33640 1 -- 172.21.15.100:0/1170452395 >> v1:172.21.15.92:6789/0 conn(0x55662aeea5f0 legacy=0x55662af7b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.002+0000 7f7a60b33640 1 -- 172.21.15.100:0/1170452395 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662ae3de00 con 0x55662af7cdb0 2024-09-18T01:25:32.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.004+0000 7f7a60b33640 1 --2- 172.21.15.100:0/1170452395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662af7cdb0 0x55662af7f1a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400a520 tx=0x7f7a54045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331d5015c6752017 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.004+0000 7f7a68b33640 1 -- 172.21.15.100:0/1170452395 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a54055070 con 0x55662af7cdb0 2024-09-18T01:25:32.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.004+0000 7f7a68b33640 1 -- 172.21.15.100:0/1170452395 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a540515b0 con 0x55662af7cdb0 2024-09-18T01:25:32.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.004+0000 7f7a68b33640 1 -- 172.21.15.100:0/1170452395 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a540518d0 con 0x55662af7cdb0 2024-09-18T01:25:32.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.004+0000 7f7a6b840800 1 -- 172.21.15.100:0/1170452395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662af7cdb0 msgr2=0x55662af7f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.004+0000 7f7a6b840800 1 --2- 172.21.15.100:0/1170452395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662af7cdb0 0x55662af7f1a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400a520 tx=0x7f7a54045ba0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.004+0000 7f7a6b840800 1 -- 172.21.15.100:0/1170452395 shutdown_connections 2024-09-18T01:25:32.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.004+0000 7f7a6b840800 1 --2- 172.21.15.100:0/1170452395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662af7cdb0 0x55662af7f1a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.004+0000 7f7a6b840800 1 -- 172.21.15.100:0/1170452395 >> 172.21.15.100:0/1170452395 conn(0x55662af70de0 msgr2=0x55662af73200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.004+0000 7f7a6b840800 1 -- 172.21.15.100:0/1170452395 shutdown_connections 2024-09-18T01:25:32.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.004+0000 7f7a6b840800 1 -- 172.21.15.100:0/1170452395 wait complete. 2024-09-18T01:25:32.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.018+0000 7f7a6b840800 1 Processor -- start 2024-09-18T01:25:32.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.018+0000 7f7a6b840800 1 -- start start 2024-09-18T01:25:32.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.018+0000 7f7a6b840800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662aeea5f0 0x55662b067a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.018+0000 7f7a6b840800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55662aec2330 con 0x55662aeea5f0 2024-09-18T01:25:32.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.019+0000 7f7a69334640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662aeea5f0 0x55662b067a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.019+0000 7f7a69334640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662aeea5f0 0x55662b067a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38428/0 (socket says 172.21.15.100:38428) 2024-09-18T01:25:32.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.019+0000 7f7a69334640 1 -- 172.21.15.100:0/1034808122 learned_addr learned my addr 172.21.15.100:0/1034808122 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.019+0000 7f7a69334640 1 -- 172.21.15.100:0/1034808122 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662ae0fbc0 con 0x55662aeea5f0 2024-09-18T01:25:32.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.019+0000 7f7a69334640 1 --2- 172.21.15.100:0/1034808122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662aeea5f0 0x55662b067a80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00b230 tx=0x7f7a5c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366bd76e6a6a8c90 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.019+0000 7f7957606640 1 -- 172.21.15.100:0/1034808122 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a5c00e5c0 con 0x55662aeea5f0 2024-09-18T01:25:32.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.019+0000 7f7957606640 1 -- 172.21.15.100:0/1034808122 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5c006070 con 0x55662aeea5f0 2024-09-18T01:25:32.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.019+0000 7f7957606640 1 -- 172.21.15.100:0/1034808122 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a5c00e890 con 0x55662aeea5f0 2024-09-18T01:25:32.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.020+0000 7f7a6b840800 1 -- 172.21.15.100:0/1034808122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662aeea5f0 msgr2=0x55662b067a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.020+0000 7f7a6b840800 1 --2- 172.21.15.100:0/1034808122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662aeea5f0 0x55662b067a80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00b230 tx=0x7f7a5c00b6f0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.020+0000 7f7a6b840800 1 -- 172.21.15.100:0/1034808122 shutdown_connections 2024-09-18T01:25:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.020+0000 7f7a6b840800 1 --2- 172.21.15.100:0/1034808122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662aeea5f0 0x55662b067a80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.020+0000 7f7a6b840800 1 -- 172.21.15.100:0/1034808122 >> 172.21.15.100:0/1034808122 conn(0x55662af70de0 msgr2=0x55662b063440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.020+0000 7f7a6b840800 1 -- 172.21.15.100:0/1034808122 shutdown_connections 2024-09-18T01:25:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.020+0000 7f7a6b840800 1 -- 172.21.15.100:0/1034808122 wait complete. 2024-09-18T01:25:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.020+0000 7f7a6b840800 1 Processor -- start 2024-09-18T01:25:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.020+0000 7f7a6b840800 1 -- start start 2024-09-18T01:25:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.020+0000 7f7a6b840800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662aeea5f0 0x55662b06f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.020+0000 7f7a6b840800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55662af7f980 con 0x55662aeea5f0 2024-09-18T01:25:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.021+0000 7f7a69334640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662aeea5f0 0x55662b06f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.021+0000 7f7a69334640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662aeea5f0 0x55662b06f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38434/0 (socket says 172.21.15.100:38434) 2024-09-18T01:25:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.021+0000 7f7a69334640 1 -- 172.21.15.100:0/2041985618 learned_addr learned my addr 172.21.15.100:0/2041985618 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.021+0000 7f7a69334640 1 -- 172.21.15.100:0/2041985618 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662ae23fe0 con 0x55662aeea5f0 2024-09-18T01:25:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.021+0000 7f7a69334640 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662aeea5f0 0x55662b06f4b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c000fd0 tx=0x7f7a5c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.021+0000 7f7955e03640 1 -- 172.21.15.100:0/2041985618 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a5c00f8d0 con 0x55662aeea5f0 2024-09-18T01:25:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.021+0000 7f7955e03640 1 -- 172.21.15.100:0/2041985618 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5c00fa90 con 0x55662aeea5f0 2024-09-18T01:25:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.021+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55662b06f9f0 con 0x55662aeea5f0 2024-09-18T01:25:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.021+0000 7f7955e03640 1 -- 172.21.15.100:0/2041985618 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a5c00fdb0 con 0x55662aeea5f0 2024-09-18T01:25:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.021+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55662b06ff10 con 0x55662aeea5f0 2024-09-18T01:25:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.022+0000 7f7955e03640 1 -- 172.21.15.100:0/2041985618 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7a5c017070 con 0x55662aeea5f0 2024-09-18T01:25:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.022+0000 7f7955e03640 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7950036b90 0x7f7950039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.022+0000 7f7955e03640 1 -- 172.21.15.100:0/2041985618 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f7a5c015020 con 0x55662aeea5f0 2024-09-18T01:25:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.022+0000 7f7a60b33640 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7950036b90 0x7f7950039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.022+0000 7f7a6b840800 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55662af7cdb0 0x55662b076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.022+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b076a60 con 0x55662af7cdb0 2024-09-18T01:25:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.022+0000 7f7a69b35640 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55662af7cdb0 0x55662b076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.023+0000 7f7a60b33640 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7950036b90 0x7f7950039050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a54057000 tx=0x7f7a54052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.023+0000 7f7a69b35640 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55662af7cdb0 0x55662b076520 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.023+0000 7f7a69b35640 1 -- 172.21.15.100:0/2041985618 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662af7cdb0 2024-09-18T01:25:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.023+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b073ad0 con 0x55662af7cdb0 2024-09-18T01:25:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.023+0000 7f7a69b35640 1 -- 172.21.15.100:0/2041985618 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662af7cdb0 2024-09-18T01:25:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.023+0000 7f7a6b840800 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55662b078d70 0x55662b07b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.023+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b07b800 con 0x55662b078d70 2024-09-18T01:25:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.023+0000 7f7a69334640 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55662b078d70 0x55662b07b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.024+0000 7f7a69334640 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55662b078d70 0x55662b07b160 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.024+0000 7f7a69334640 1 -- 172.21.15.100:0/2041985618 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b078d70 2024-09-18T01:25:32.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.024+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b077c10 con 0x55662af7cdb0 2024-09-18T01:25:32.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.024+0000 7f7a69b35640 1 -- 172.21.15.100:0/2041985618 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662af7cdb0 2024-09-18T01:25:32.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.024+0000 7f7a6b840800 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55662b07cc60 0x55662b07f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.024+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b07f750 con 0x55662b07cc60 2024-09-18T01:25:32.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.025+0000 7f7a60b33640 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55662b07cc60 0x55662b07f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.025+0000 7f7a60b33640 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55662b07cc60 0x55662b07f050 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.025+0000 7f7a60b33640 1 -- 172.21.15.100:0/2041985618 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7a54057030 con 0x55662b07cc60 2024-09-18T01:25:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.026+0000 7f7a6b840800 1 Processor -- start 2024-09-18T01:25:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.026+0000 7f7a6b840800 1 -- start start 2024-09-18T01:25:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.026+0000 7f7a6b840800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b08d500 0x55662b08d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.026+0000 7f7a6b840800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55662ae11580 con 0x55662b08d500 2024-09-18T01:25:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.026+0000 7f7a69334640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b08d500 0x55662b08d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.026+0000 7f7a69334640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b08d500 0x55662b08d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38448/0 (socket says 172.21.15.100:38448) 2024-09-18T01:25:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.026+0000 7f7a69334640 1 -- 172.21.15.100:0/2597529041 learned_addr learned my addr 172.21.15.100:0/2597529041 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.026+0000 7f7a69334640 1 -- 172.21.15.100:0/2597529041 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662b08de60 con 0x55662b08d500 2024-09-18T01:25:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.026+0000 7f7a69334640 1 --2- 172.21.15.100:0/2597529041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b08d500 0x55662b08d920 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c04b760 tx=0x7f7a5c01bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.026+0000 7f794effd640 1 -- 172.21.15.100:0/2597529041 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a5c017c30 con 0x55662b08d500 2024-09-18T01:25:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.026+0000 7f794effd640 1 -- 172.21.15.100:0/2597529041 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5c017dd0 con 0x55662b08d500 2024-09-18T01:25:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.026+0000 7f7a6b840800 1 -- 172.21.15.100:0/2597529041 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55662b08e0f0 con 0x55662b08d500 2024-09-18T01:25:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.026+0000 7f794effd640 1 -- 172.21.15.100:0/2597529041 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a5c04bbe0 con 0x55662b08d500 2024-09-18T01:25:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.027+0000 7f7a6b840800 1 -- 172.21.15.100:0/2597529041 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55662b090dd0 con 0x55662b08d500 2024-09-18T01:25:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.027+0000 7f794effd640 1 -- 172.21.15.100:0/2597529041 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7a5c01a480 con 0x55662b08d500 2024-09-18T01:25:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.027+0000 7f794effd640 1 --2- 172.21.15.100:0/2597529041 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7940036b90 0x7f7940039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.027+0000 7f794effd640 1 -- 172.21.15.100:0/2597529041 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f7a5c028c90 con 0x55662b08d500 2024-09-18T01:25:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.027+0000 7f7a60b33640 1 --2- 172.21.15.100:0/2597529041 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7940036b90 0x7f7940039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.028+0000 7f7a6b840800 1 Processor -- start 2024-09-18T01:25:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.028+0000 7f7a6b840800 1 -- start start 2024-09-18T01:25:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.028+0000 7f7a60b33640 1 --2- 172.21.15.100:0/2597529041 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7940036b90 0x7f7940039050 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55662b073a10 tx=0x7f7a54005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.028+0000 7f7a6b840800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b099f50 0x55662b09a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.028+0000 7f7a6b840800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55662b068230 con 0x55662b099f50 2024-09-18T01:25:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.028+0000 7f7a69334640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b099f50 0x55662b09a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.028+0000 7f7a69334640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b099f50 0x55662b09a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38454/0 (socket says 172.21.15.100:38454) 2024-09-18T01:25:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.028+0000 7f7a69334640 1 -- 172.21.15.100:0/3487732774 learned_addr learned my addr 172.21.15.100:0/3487732774 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.028+0000 7f7a69334640 1 -- 172.21.15.100:0/3487732774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662b09a920 con 0x55662b099f50 2024-09-18T01:25:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.028+0000 7f7a69334640 1 --2- 172.21.15.100:0/3487732774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b099f50 0x55662b09a350 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0015e0 tx=0x7f7a5c0318d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93173a3167b457 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.028+0000 7f794cff9640 1 -- 172.21.15.100:0/3487732774 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a5c044d30 con 0x55662b099f50 2024-09-18T01:25:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.028+0000 7f794cff9640 1 -- 172.21.15.100:0/3487732774 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5c03f830 con 0x55662b099f50 2024-09-18T01:25:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.029+0000 7f794cff9640 1 -- 172.21.15.100:0/3487732774 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a5c044ed0 con 0x55662b099f50 2024-09-18T01:25:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.029+0000 7f7a6b840800 1 -- 172.21.15.100:0/3487732774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b099f50 msgr2=0x55662b09a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.029+0000 7f7a6b840800 1 --2- 172.21.15.100:0/3487732774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b099f50 0x55662b09a350 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0015e0 tx=0x7f7a5c0318d0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.029+0000 7f7a6b840800 1 -- 172.21.15.100:0/3487732774 shutdown_connections 2024-09-18T01:25:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.029+0000 7f7a6b840800 1 --2- 172.21.15.100:0/3487732774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b099f50 0x55662b09a350 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.029+0000 7f7a6b840800 1 -- 172.21.15.100:0/3487732774 >> 172.21.15.100:0/3487732774 conn(0x55662b096300 msgr2=0x55662b094400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.029+0000 7f7a6b840800 1 -- 172.21.15.100:0/3487732774 shutdown_connections 2024-09-18T01:25:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.029+0000 7f7a6b840800 1 -- 172.21.15.100:0/3487732774 wait complete. 2024-09-18T01:25:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.029+0000 7f7a6b840800 1 Processor -- start 2024-09-18T01:25:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.029+0000 7f7a6b840800 1 -- start start 2024-09-18T01:25:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.029+0000 7f7a6b840800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b099f50 0x55662b0a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.029+0000 7f7a6b840800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55662b09a920 con 0x55662b099f50 2024-09-18T01:25:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.030+0000 7f7a69334640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b099f50 0x55662b0a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.030+0000 7f7a69334640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b099f50 0x55662b0a10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38468/0 (socket says 172.21.15.100:38468) 2024-09-18T01:25:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.030+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 learned_addr learned my addr 172.21.15.100:0/1091327919 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.030+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662b0a1630 con 0x55662b099f50 2024-09-18T01:25:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.030+0000 7f7a69334640 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b099f50 0x55662b0a10f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0015e0 tx=0x7f7a5c01ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.030+0000 7f793effd640 1 -- 172.21.15.100:0/1091327919 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a5c069020 con 0x55662b099f50 2024-09-18T01:25:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.030+0000 7f793effd640 1 -- 172.21.15.100:0/1091327919 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5c045820 con 0x55662b099f50 2024-09-18T01:25:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.030+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55662b0a1630 con 0x55662b099f50 2024-09-18T01:25:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.030+0000 7f793effd640 1 -- 172.21.15.100:0/1091327919 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a5c045b00 con 0x55662b099f50 2024-09-18T01:25:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.030+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55662b0a1ad0 con 0x55662b099f50 2024-09-18T01:25:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.031+0000 7f793effd640 1 -- 172.21.15.100:0/1091327919 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7a5c06c020 con 0x55662b099f50 2024-09-18T01:25:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.031+0000 7f793effd640 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7934036af0 0x7f7934038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.031+0000 7f793effd640 1 -- 172.21.15.100:0/1091327919 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f7a5c06fc60 con 0x55662b099f50 2024-09-18T01:25:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.031+0000 7f7a60b33640 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7934036af0 0x7f7934038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.032+0000 7f7a60b33640 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7934036af0 0x7f7934038fb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a54000c00 tx=0x7f7a5406d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.032+0000 7f7a6b840800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.032+0000 7f7a6b840800 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55662b0ac730 0x55662b0aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.032+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0af340 con 0x55662b0ac730 2024-09-18T01:25:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.032+0000 7f7a69b35640 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55662b0ac730 0x55662b0aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.032+0000 7f7a69b35640 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55662b0ac730 0x55662b0aebf0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 20 realm 2024-09-18T01:25:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0af750 con 0x55662b0ac730 2024-09-18T01:25:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b0020 con 0x55662b0ac730 2024-09-18T01:25:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0ac730 2024-09-18T01:25:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55662b0b1120 0x55662b0b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b3b20 con 0x55662b0b1120 2024-09-18T01:25:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.033+0000 7f7a69334640 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55662b0b1120 0x55662b0b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.034+0000 7f7a69334640 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55662b0b1120 0x55662b0b3510 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.034+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.034+0000 7f7a6b840800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:32.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.034+0000 7f7a6b840800 20 searching for the correct realm 2024-09-18T01:25:32.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.034+0000 7f7a6b840800 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55662b0b5ad0 0x55662b0b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.034+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b8660 con 0x55662b0b5ad0 2024-09-18T01:25:32.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.034+0000 7f7a60b33640 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55662b0b5ad0 0x55662b0b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.034+0000 7f7a60b33640 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55662b0b5ad0 0x55662b0b7f90 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.035+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.035+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b8660 con 0x55662b0b1120 2024-09-18T01:25:32.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.035+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.035+0000 7f7a69334640 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7a5c079040 0x7f7a5c04e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.035+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b8660 con 0x7f7a5c079040 2024-09-18T01:25:32.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.035+0000 7f7a69b35640 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7a5c079040 0x7f7a5c04e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.035+0000 7f7a69b35640 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7a5c079040 0x7f7a5c04e4a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.036+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.036+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0ac730 2024-09-18T01:25:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.036+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.036+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0ac730 2024-09-18T01:25:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.036+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.036+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x7f7a5c079040 2024-09-18T01:25:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.036+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.036+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x7f7a5c079040 2024-09-18T01:25:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.037+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.037+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0b1120 2024-09-18T01:25:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.037+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.037+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0b5ad0 2024-09-18T01:25:32.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.037+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.037+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0ac730 2024-09-18T01:25:32.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.037+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.037+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x7f7a5c079040 2024-09-18T01:25:32.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.038+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.038+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0ac730 2024-09-18T01:25:32.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.038+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.038+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0b1120 2024-09-18T01:25:32.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.038+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.038+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0b5ad0 2024-09-18T01:25:32.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.038+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.038+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0b5ad0 2024-09-18T01:25:32.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.038+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.038+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x7f7a5c079040 2024-09-18T01:25:32.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.039+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.039+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0b5ad0 2024-09-18T01:25:32.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.039+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.039+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0b5ad0 2024-09-18T01:25:32.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.039+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.039+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0ac730 2024-09-18T01:25:32.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.039+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.039+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0ac730 2024-09-18T01:25:32.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.040+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.040+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x7f7a5c079040 2024-09-18T01:25:32.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.040+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.040+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0b5ad0 2024-09-18T01:25:32.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.040+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.040+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0b1120 2024-09-18T01:25:32.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.040+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.040+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0ac730 2024-09-18T01:25:32.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.041+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.041+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x7f7a5c079040 2024-09-18T01:25:32.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.041+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.041+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0b5ad0 2024-09-18T01:25:32.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.041+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.041+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x7f7a5c079040 2024-09-18T01:25:32.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.041+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.041+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0b1120 2024-09-18T01:25:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.042+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.042+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0b5ad0 2024-09-18T01:25:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.042+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.042+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x7f7a5c079040 2024-09-18T01:25:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.042+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.042+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0ac730 2024-09-18T01:25:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.042+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.042+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b03c0 con 0x55662b0b1120 2024-09-18T01:25:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.042+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b43e0 con 0x55662b0ac730 2024-09-18T01:25:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b47d0 con 0x55662b0ac730 2024-09-18T01:25:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b47d0 con 0x7f7a5c079040 2024-09-18T01:25:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:32.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 zone default found 2024-09-18T01:25:32.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 4 Realm: () 2024-09-18T01:25:32.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:32.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:32.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:32.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 zonegroup default 2024-09-18T01:25:32.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.043+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b3ff0 con 0x7f7a5c079040 2024-09-18T01:25:32.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.044+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.044+0000 7f7a6b840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.044+0000 7f7a6b840800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.044+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0ba4c0 con 0x55662b0b5ad0 2024-09-18T01:25:32.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.044+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.044+0000 7f7a6b840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.044+0000 7f7a6b840800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.044+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0ba860 con 0x55662b0b5ad0 2024-09-18T01:25:32.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.044+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.044+0000 7f7a6b840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.044+0000 7f7a6b840800 20 started sync module instance, tier type = 2024-09-18T01:25:32.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.044+0000 7f7a6b840800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:32.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.044+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0b9960 con 0x55662b0b1120 2024-09-18T01:25:32.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.045+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.045+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93897297204400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bac00 con 0x55662b0b1120 2024-09-18T01:25:32.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.045+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bb450 con 0x55662b0ac730 2024-09-18T01:25:32.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.046+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93897297204400] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.046+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.047+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93897297211296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bb3c0 con 0x55662b0ac730 2024-09-18T01:25:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.047+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bc310 con 0x55662b0b5ad0 2024-09-18T01:25:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.047+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.048+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93897297215072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bcbb0 con 0x55662b0b5ad0 2024-09-18T01:25:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.048+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bd660 con 0x55662b0b1120 2024-09-18T01:25:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.048+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93897297211296] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.049+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93897297215072] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.049+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.049+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93897297213504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bda80 con 0x55662b0b1120 2024-09-18T01:25:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.049+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0be2d0 con 0x55662b0ac730 2024-09-18T01:25:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.050+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.050+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93897297213504] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.050+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93897297223680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0be6c0 con 0x55662b0ac730 2024-09-18T01:25:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.050+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bf080 con 0x7f7a5c079040 2024-09-18T01:25:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.051+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.051+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93897297226704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0beff0 con 0x7f7a5c079040 2024-09-18T01:25:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.051+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bff80 con 0x7f7a5c079040 2024-09-18T01:25:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.051+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93897297223680] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.052+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93897297226704] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.052+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.052+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93897297230480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bf3e0 con 0x7f7a5c079040 2024-09-18T01:25:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.052+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0c05a0 con 0x7f7a5c079040 2024-09-18T01:25:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.053+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93897297230480] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.053+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.053+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93897297219952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0c05a0 con 0x7f7a5c079040 2024-09-18T01:25:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.053+0000 7f7a6b840800 20 add_watcher() i=0 2024-09-18T01:25:32.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.053+0000 7f7a6b840800 20 add_watcher() i=1 2024-09-18T01:25:32.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.053+0000 7f7a6b840800 20 add_watcher() i=2 2024-09-18T01:25:32.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.053+0000 7f7a6b840800 20 add_watcher() i=3 2024-09-18T01:25:32.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.053+0000 7f7a6b840800 20 add_watcher() i=4 2024-09-18T01:25:32.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.053+0000 7f7a6b840800 20 add_watcher() i=5 2024-09-18T01:25:32.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.053+0000 7f7a6b840800 20 add_watcher() i=6 2024-09-18T01:25:32.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.053+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93897297219952] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.053+0000 7f7a6b840800 20 add_watcher() i=7 2024-09-18T01:25:32.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.053+0000 7f7a6b840800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:32.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.053+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0c3810 con 0x55662b0ac730 2024-09-18T01:25:32.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.054+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.054+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93897297232480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0c0b30 con 0x55662b0ac730 2024-09-18T01:25:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.055+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93897297232480] v33'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.055+0000 7f791f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.055+0000 7f7a6b840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.055+0000 7f7a6b840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.055+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cc300 con 0x55662b0ac730 2024-09-18T01:25:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.057+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'45 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.057+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cc950 con 0x7f7a5c079040 2024-09-18T01:25:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.058+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.058+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0ccdd0 con 0x55662b0b5ad0 2024-09-18T01:25:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.059+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.059+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cd7f0 con 0x55662b0ac730 2024-09-18T01:25:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.060+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'128 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.060+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0c7fd0 con 0x55662b0b1120 2024-09-18T01:25:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.061+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'41 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.061+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0c7fa0 con 0x55662b0b5ad0 2024-09-18T01:25:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.062+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'35 uv16 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.062+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0ce350 con 0x55662b0ac730 2024-09-18T01:25:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.063+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.063+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0ce910 con 0x7f7a5c079040 2024-09-18T01:25:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.064+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.064+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0ce910 con 0x55662b0b1120 2024-09-18T01:25:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.065+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.065+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0ce9a0 con 0x55662b0b5ad0 2024-09-18T01:25:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.066+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.066+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cef30 con 0x55662b0b1120 2024-09-18T01:25:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.067+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.067+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cef10 con 0x7f7a5c079040 2024-09-18T01:25:32.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.068+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.068+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cef10 con 0x55662b0b1120 2024-09-18T01:25:32.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.069+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.069+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cef10 con 0x7f7a5c079040 2024-09-18T01:25:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.070+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'42 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.070+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cef10 con 0x55662b0ac730 2024-09-18T01:25:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.071+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'129 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.071+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cef10 con 0x55662b0b5ad0 2024-09-18T01:25:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.072+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'35 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.072+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf5c0 con 0x55662b0b1120 2024-09-18T01:25:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.073+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'43 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.073+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x55662b0b5ad0 2024-09-18T01:25:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.074+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'27 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.074+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x55662b0ac730 2024-09-18T01:25:32.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.075+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.075+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x55662b0ac730 2024-09-18T01:25:32.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.076+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'130 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.076+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x55662b0b5ad0 2024-09-18T01:25:32.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.077+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.077+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x55662b0b1120 2024-09-18T01:25:32.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.077+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'31 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.078+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x55662b0b5ad0 2024-09-18T01:25:32.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.078+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.078+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x55662b0b5ad0 2024-09-18T01:25:32.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.079+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.079+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x55662b0b5ad0 2024-09-18T01:25:32.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.080+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.080+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x55662b0b5ad0 2024-09-18T01:25:32.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.081+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'36 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.081+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x7f7a5c079040 2024-09-18T01:25:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.082+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.082+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x55662b0b5ad0 2024-09-18T01:25:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.083+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.083+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x7f7a5c079040 2024-09-18T01:25:32.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.084+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.084+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x55662b0b5ad0 2024-09-18T01:25:32.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.085+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.085+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x7f7a5c079040 2024-09-18T01:25:32.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.087+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'43 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.087+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0cf540 con 0x55662b0b1120 2024-09-18T01:25:32.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.088+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.088+0000 7f791e7e4640 20 reqs_thread_entry: start 2024-09-18T01:25:32.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.088+0000 7f7a6b840800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:32.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.088+0000 7f7a6b840800 20 Filter name: none 2024-09-18T01:25:32.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.088+0000 7f788ffff640 20 reqs_thread_entry: start 2024-09-18T01:25:32.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.088+0000 7f7a6b840800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:25:32.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.088+0000 7f7a6b840800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.088+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0fa270 con 0x7f7a5c079040 2024-09-18T01:25:32.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.089+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.089+0000 7f7a6b840800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:25:32.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.089+0000 7f7a6b840800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T01:25:32.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.089+0000 7f7a6b840800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:25:32.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.089+0000 7f7a6b840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:32.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.089+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0fcb30 con 0x7f7a5c079040 2024-09-18T01:25:32.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.089+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.089+0000 7f7a6b840800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-18T01:25:32.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.089+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0fab10 con 0x7f7a5c079040 2024-09-18T01:25:32.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.090+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v33'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.090+0000 7f7a6b840800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:25:32.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.090+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93897297474944 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0fd140 con 0x55662b0b5ad0 2024-09-18T01:25:32.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.090+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== watch-notify(notify (1) cookie 93897297215072 notify 141733920771 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55662b0c7af0 con 0x55662b0b5ad0 2024-09-18T01:25:32.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.090+0000 7f794cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 93897297215072 notifier 4538 bl.length()=170 2024-09-18T01:25:32.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.090+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 27 ==== osd_op_reply(97 notify.2 [notify cookie 93897297474944 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.090+0000 7f794cff9640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f792c003d60 con 0x55662b0b5ad0 2024-09-18T01:25:32.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.090+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.091+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 29 ==== watch-notify(notify_complete (2) cookie 93897297474944 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55662b0c6910 con 0x55662b0b5ad0 2024-09-18T01:25:32.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.091+0000 7f7a6b840800 10 removing email index: 2024-09-18T01:25:32.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.091+0000 7f7a6b840800 10 removing user buckets index 2024-09-18T01:25:32.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.091+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0fd0c0 con 0x7f7a5c079040 2024-09-18T01:25:32.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.092+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(99 fud.buckets [delete] v33'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.092+0000 7f7a6b840800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-18T01:25:32.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.092+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93897297481920 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0fc560 con 0x7f7a5c079040 2024-09-18T01:25:32.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.092+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 29 ==== watch-notify(notify (1) cookie 93897297230480 notify 141733920774 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55662b0cf2d0 con 0x7f7a5c079040 2024-09-18T01:25:32.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.092+0000 7f794cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 93897297230480 notifier 4538 bl.length()=160 2024-09-18T01:25:32.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.092+0000 7f794cff9640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f792c003d60 con 0x7f7a5c079040 2024-09-18T01:25:32.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.092+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 30 ==== osd_op_reply(100 notify.6 [notify cookie 93897297481920 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.092+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.092+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 32 ==== watch-notify(notify_complete (2) cookie 93897297481920 notify 141733920774 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55662b0cbe60 con 0x7f7a5c079040 2024-09-18T01:25:32.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.092+0000 7f7a6b840800 10 removing user index: fud 2024-09-18T01:25:32.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.092+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0fd0c0 con 0x7f7a5c079040 2024-09-18T01:25:32.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.093+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 33 ==== osd_op_reply(102 fud [call,call,delete] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.093+0000 7f7a6b840800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-18T01:25:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.093+0000 7f7a6b840800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-18T01:25:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.093+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 93897297481920 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55662b0fb550 con 0x7f7a5c079040 2024-09-18T01:25:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.093+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 34 ==== watch-notify(notify (1) cookie 93897297226704 notify 141733920775 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55662b0cbe60 con 0x7f7a5c079040 2024-09-18T01:25:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.093+0000 7f793ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 93897297226704 notifier 4538 bl.length()=152 2024-09-18T01:25:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.093+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 35 ==== osd_op_reply(103 notify.5 [notify cookie 93897297481920 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.093+0000 7f793ffff640 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f789c0032c0 con 0x7f7a5c079040 2024-09-18T01:25:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.094+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.094+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 37 ==== watch-notify(notify_complete (2) cookie 93897297481920 notify 141733920775 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55662b0cbc90 con 0x7f7a5c079040 2024-09-18T01:25:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.095+0000 7f791f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.095+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93897297232480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0fd0c0 con 0x55662b0ac730 2024-09-18T01:25:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.095+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93897297232480] v33'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.095+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93897297204400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0fd0c0 con 0x55662b0b1120 2024-09-18T01:25:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.096+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93897297204400] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.096+0000 7f7a6b840800 20 remove_watcher() i=0 2024-09-18T01:25:32.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.096+0000 7f7a6b840800 2 removed watcher, disabling cache 2024-09-18T01:25:32.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.096+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93897297211296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0fd0c0 con 0x55662b0ac730 2024-09-18T01:25:32.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.097+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93897297211296] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.097+0000 7f7a6b840800 20 remove_watcher() i=1 2024-09-18T01:25:32.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.097+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93897297215072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bafa0 con 0x55662b0b5ad0 2024-09-18T01:25:32.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.099+0000 7f7a60b33640 1 -- 172.21.15.100:0/1091327919 <== osd.3 v2:172.21.15.100:6816/595195757 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93897297215072] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a54057030 con 0x55662b0b5ad0 2024-09-18T01:25:32.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.099+0000 7f7a6b840800 20 remove_watcher() i=2 2024-09-18T01:25:32.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.099+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93897297213504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bbe60 con 0x55662b0b1120 2024-09-18T01:25:32.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.100+0000 7f7a69334640 1 -- 172.21.15.100:0/1091327919 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93897297213504] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5c02e070 con 0x55662b0b1120 2024-09-18T01:25:32.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.100+0000 7f7a6b840800 20 remove_watcher() i=3 2024-09-18T01:25:32.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.100+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93897297223680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bafa0 con 0x55662b0ac730 2024-09-18T01:25:32.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.101+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93897297223680] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x55662b0ac730 2024-09-18T01:25:32.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.101+0000 7f7a6b840800 20 remove_watcher() i=4 2024-09-18T01:25:32.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.101+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93897297226704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bb840 con 0x7f7a5c079040 2024-09-18T01:25:32.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.102+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93897297226704] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.102+0000 7f7a6b840800 20 remove_watcher() i=5 2024-09-18T01:25:32.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.102+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93897297230480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0bbe60 con 0x7f7a5c079040 2024-09-18T01:25:32.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.103+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93897297230480] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.103+0000 7f7a6b840800 20 remove_watcher() i=6 2024-09-18T01:25:32.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.103+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93897297219952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55662b0be000 con 0x7f7a5c079040 2024-09-18T01:25:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.103+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 <== osd.0 v2:172.21.15.92:6800/2777570747 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93897297219952] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a6400a4a0 con 0x7f7a5c079040 2024-09-18T01:25:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 20 remove_watcher() i=7 2024-09-18T01:25:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7a5c079040 msgr2=0x7f7a5c04e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7a5c079040 0x7f7a5c04e4a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55662b0ac730 msgr2=0x55662b0aebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55662b0ac730 0x55662b0aebf0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55662b0b1120 msgr2=0x55662b0b3510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55662b0b1120 0x55662b0b3510 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55662b0b5ad0 msgr2=0x55662b0b7f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55662b0b5ad0 0x55662b0b7f90 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7934036af0 msgr2=0x7f7934038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7934036af0 0x7f7934038fb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a54000c00 tx=0x7f7a5406d040 comp rx=0 tx=0).stop 2024-09-18T01:25:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b099f50 msgr2=0x55662b0a10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b099f50 0x55662b0a10f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0015e0 tx=0x7f7a5c01ff60 comp rx=0 tx=0).stop 2024-09-18T01:25:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a69b35640 1 -- 172.21.15.100:0/1091327919 reap_dead start 2024-09-18T01:25:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 shutdown_connections 2024-09-18T01:25:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 --2- 172.21.15.100:0/1091327919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b099f50 0x55662b0a10f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 >> 172.21.15.100:0/1091327919 conn(0x55662b096300 msgr2=0x55662b0943d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 shutdown_connections 2024-09-18T01:25:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/1091327919 wait complete. 2024-09-18T01:25:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/2597529041 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7940036b90 msgr2=0x7f7940039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 --2- 172.21.15.100:0/2597529041 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7940036b90 0x7f7940039050 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55662b073a10 tx=0x7f7a54005ac0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/2597529041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b08d500 msgr2=0x55662b08d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 --2- 172.21.15.100:0/2597529041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b08d500 0x55662b08d920 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c04b760 tx=0x7f7a5c01bdc0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/2597529041 shutdown_connections 2024-09-18T01:25:32.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 --2- 172.21.15.100:0/2597529041 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7940036b90 0x7f7940039050 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 --2- 172.21.15.100:0/2597529041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662b08d500 0x55662b08d920 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/2597529041 >> 172.21.15.100:0/2597529041 conn(0x55662b082490 msgr2=0x55662b085010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/2597529041 shutdown_connections 2024-09-18T01:25:32.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.104+0000 7f7a6b840800 1 -- 172.21.15.100:0/2597529041 wait complete. 2024-09-18T01:25:32.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55662b07cc60 msgr2=0x55662b07f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a6b840800 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55662b07cc60 0x55662b07f050 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55662af7cdb0 msgr2=0x55662b076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a6b840800 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55662af7cdb0 0x55662b076520 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55662b078d70 msgr2=0x55662b07b160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a6b840800 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55662b078d70 0x55662b07b160 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7950036b90 msgr2=0x7f7950039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a6b840800 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7950036b90 0x7f7950039050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a54057000 tx=0x7f7a54052000 comp rx=0 tx=0).stop 2024-09-18T01:25:32.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662aeea5f0 msgr2=0x55662b06f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a6b840800 1 --2- 172.21.15.100:0/2041985618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55662aeea5f0 0x55662b06f4b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c000fd0 tx=0x7f7a5c000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a69b35640 1 -- 172.21.15.100:0/2041985618 reap_dead start 2024-09-18T01:25:32.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 shutdown_connections 2024-09-18T01:25:32.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 >> 172.21.15.100:0/2041985618 conn(0x55662af70de0 msgr2=0x55662b061cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 shutdown_connections 2024-09-18T01:25:32.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.105+0000 7f7a6b840800 1 -- 172.21.15.100:0/2041985618 wait complete. 2024-09-18T01:25:32.115 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-18T01:25:32.115 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-18T01:25:32.115 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-18T01:25:32.209 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:32.209 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.208+0000 7fcffdcb5800 1 Processor -- start 2024-09-18T01:25:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.209+0000 7fcffdcb5800 1 -- start start 2024-09-18T01:25:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.209+0000 7fcffdcb5800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x563153399510 0x563153399910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.209+0000 7fcffdcb5800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563153259b30 con 0x563153399e50 2024-09-18T01:25:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.209+0000 7fcffdcb5800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x56315323b360 con 0x563153399510 2024-09-18T01:25:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.209+0000 7fcffb7a9640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x563153399510 0x563153399910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.209+0000 7fcffb7a9640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x563153399510 0x563153399910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38480/0 (socket says 172.21.15.100:38480) 2024-09-18T01:25:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.209+0000 7fcff3fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x563153399e50 0x56315339e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37392/0 (socket says 172.21.15.100:37392) 2024-09-18T01:25:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.209+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1264944010 learned_addr learned my addr 172.21.15.100:0/1264944010 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.209+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1264944010 >> v1:172.21.15.92:6789/0 conn(0x563153399e50 legacy=0x56315339e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.209+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1264944010 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563153261e00 con 0x563153399510 2024-09-18T01:25:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.211+0000 7fcffb7a9640 1 --2- 172.21.15.100:0/1264944010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 0x563153399910 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00a520 tx=0x7fcfec045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65184a5ea741230 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.211+0000 7fcffafa8640 1 -- 172.21.15.100:0/1264944010 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec055070 con 0x563153399510 2024-09-18T01:25:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.211+0000 7fcffafa8640 1 -- 172.21.15.100:0/1264944010 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfec0515b0 con 0x563153399510 2024-09-18T01:25:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.211+0000 7fcffafa8640 1 -- 172.21.15.100:0/1264944010 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec0518d0 con 0x563153399510 2024-09-18T01:25:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.212+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1264944010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 msgr2=0x563153399910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.212+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1264944010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 0x563153399910 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00a520 tx=0x7fcfec045ba0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.212+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1264944010 shutdown_connections 2024-09-18T01:25:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.212+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1264944010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 0x563153399910 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.212+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1264944010 >> 172.21.15.100:0/1264944010 conn(0x563153394de0 msgr2=0x563153397200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.212+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1264944010 shutdown_connections 2024-09-18T01:25:32.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.212+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1264944010 wait complete. 2024-09-18T01:25:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.226+0000 7fcffdcb5800 1 Processor -- start 2024-09-18T01:25:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.226+0000 7fcffdcb5800 1 -- start start 2024-09-18T01:25:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.226+0000 7fcffdcb5800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 0x56315330e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.226+0000 7fcffdcb5800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5631532e6450 con 0x563153399510 2024-09-18T01:25:32.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.226+0000 7fcffb7a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 0x56315330e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.226+0000 7fcffb7a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 0x56315330e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38494/0 (socket says 172.21.15.100:38494) 2024-09-18T01:25:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.226+0000 7fcffb7a9640 1 -- 172.21.15.100:0/3926312526 learned_addr learned my addr 172.21.15.100:0/3926312526 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.226+0000 7fcffb7a9640 1 -- 172.21.15.100:0/3926312526 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563153233bc0 con 0x563153399510 2024-09-18T01:25:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.226+0000 7fcffb7a9640 1 --2- 172.21.15.100:0/3926312526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 0x56315330e5f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcfec025da0 tx=0x7fcfec051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6629bdbce45bbee server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.227+0000 7fcee960a640 1 -- 172.21.15.100:0/3926312526 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec051950 con 0x563153399510 2024-09-18T01:25:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.227+0000 7fcee960a640 1 -- 172.21.15.100:0/3926312526 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfec051af0 con 0x563153399510 2024-09-18T01:25:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.227+0000 7fcee960a640 1 -- 172.21.15.100:0/3926312526 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec051dd0 con 0x563153399510 2024-09-18T01:25:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.227+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3926312526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 msgr2=0x56315330e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.227+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/3926312526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 0x56315330e5f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcfec025da0 tx=0x7fcfec051000 comp rx=0 tx=0).stop 2024-09-18T01:25:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.227+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3926312526 shutdown_connections 2024-09-18T01:25:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.227+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/3926312526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 0x56315330e5f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.227+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3926312526 >> 172.21.15.100:0/3926312526 conn(0x563153394de0 msgr2=0x563153484240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.227+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3926312526 shutdown_connections 2024-09-18T01:25:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.227+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3926312526 wait complete. 2024-09-18T01:25:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.228+0000 7fcffdcb5800 1 Processor -- start 2024-09-18T01:25:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.228+0000 7fcffdcb5800 1 -- start start 2024-09-18T01:25:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.228+0000 7fcffdcb5800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 0x5631534933f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.228+0000 7fcffdcb5800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5631533a0530 con 0x563153399510 2024-09-18T01:25:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.228+0000 7fcffb7a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 0x5631534933f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.228+0000 7fcffb7a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 0x5631534933f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38510/0 (socket says 172.21.15.100:38510) 2024-09-18T01:25:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.228+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1579289829 learned_addr learned my addr 172.21.15.100:0/1579289829 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.228+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1579289829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563153247fe0 con 0x563153399510 2024-09-18T01:25:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.229+0000 7fcffb7a9640 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 0x5631534933f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcfec067040 tx=0x7fcfec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.229+0000 7fcee7e07640 1 -- 172.21.15.100:0/1579289829 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec073070 con 0x563153399510 2024-09-18T01:25:32.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.229+0000 7fcee7e07640 1 -- 172.21.15.100:0/1579289829 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfec05a450 con 0x563153399510 2024-09-18T01:25:32.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.229+0000 7fcee7e07640 1 -- 172.21.15.100:0/1579289829 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec05a730 con 0x563153399510 2024-09-18T01:25:32.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.229+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563153493930 con 0x563153399510 2024-09-18T01:25:32.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.229+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563153493eb0 con 0x563153399510 2024-09-18T01:25:32.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.230+0000 7fcee7e07640 1 -- 172.21.15.100:0/1579289829 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcfec076070 con 0x563153399510 2024-09-18T01:25:32.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.230+0000 7fcee7e07640 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcee0036b90 0x7fcee0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.230+0000 7fcee7e07640 1 -- 172.21.15.100:0/1579289829 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fcfec062070 con 0x563153399510 2024-09-18T01:25:32.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.230+0000 7fcff3fff640 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcee0036b90 0x7fcee0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.230+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563153399e50 0x56315349a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.230+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56315349a9e0 con 0x563153399e50 2024-09-18T01:25:32.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.230+0000 7fcffbfaa640 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563153399e50 0x56315349a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.230+0000 7fcff3fff640 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcee0036b90 0x7fcee0039050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4001e40 tx=0x7fcfe40013a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.230+0000 7fcffbfaa640 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563153399e50 0x56315349a460 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.231+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1579289829 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x563153399e50 2024-09-18T01:25:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.231+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56315349b280 con 0x563153399e50 2024-09-18T01:25:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.231+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1579289829 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcff400a4a0 con 0x563153399e50 2024-09-18T01:25:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.231+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56315349cb90 0x56315349f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.231+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56315349f7b0 con 0x56315349cb90 2024-09-18T01:25:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.231+0000 7fcffb7a9640 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56315349cb90 0x56315349f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.231+0000 7fcffb7a9640 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56315349cb90 0x56315349f020 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.232+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1579289829 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcfec075030 con 0x56315349cb90 2024-09-18T01:25:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.232+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56315349bad0 con 0x563153399e50 2024-09-18T01:25:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.232+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1579289829 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcff400a4a0 con 0x563153399e50 2024-09-18T01:25:32.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.232+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5631534a0c10 0x5631534a3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.232+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5631534a36f0 con 0x5631534a0c10 2024-09-18T01:25:32.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.232+0000 7fcff3fff640 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5631534a0c10 0x5631534a3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.232+0000 7fcff3fff640 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5631534a0c10 0x5631534a3000 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.233+0000 7fcff3fff640 1 -- 172.21.15.100:0/1579289829 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcfe400f6d0 con 0x5631534a0c10 2024-09-18T01:25:32.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.233+0000 7fcffdcb5800 1 Processor -- start 2024-09-18T01:25:32.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.233+0000 7fcffdcb5800 1 -- start start 2024-09-18T01:25:32.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.233+0000 7fcffdcb5800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534b14a0 0x5631534b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.233+0000 7fcffdcb5800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563153235580 con 0x5631534b14a0 2024-09-18T01:25:32.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.233+0000 7fcffb7a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534b14a0 0x5631534b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.234+0000 7fcffb7a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534b14a0 0x5631534b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38514/0 (socket says 172.21.15.100:38514) 2024-09-18T01:25:32.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.234+0000 7fcffb7a9640 1 -- 172.21.15.100:0/3274549014 learned_addr learned my addr 172.21.15.100:0/3274549014 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.234+0000 7fcffb7a9640 1 -- 172.21.15.100:0/3274549014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631534b1e00 con 0x5631534b14a0 2024-09-18T01:25:32.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.234+0000 7fcffb7a9640 1 --2- 172.21.15.100:0/3274549014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534b14a0 0x5631534b18c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fcfec06ffd0 tx=0x7fcfec064f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.234+0000 7fcee5602640 1 -- 172.21.15.100:0/3274549014 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec07d040 con 0x5631534b14a0 2024-09-18T01:25:32.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.234+0000 7fcee5602640 1 -- 172.21.15.100:0/3274549014 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfec065740 con 0x5631534b14a0 2024-09-18T01:25:32.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.234+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3274549014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631534b2090 con 0x5631534b14a0 2024-09-18T01:25:32.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.234+0000 7fcee5602640 1 -- 172.21.15.100:0/3274549014 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec065a40 con 0x5631534b14a0 2024-09-18T01:25:32.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.234+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3274549014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631534b2090 con 0x5631534b14a0 2024-09-18T01:25:32.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.235+0000 7fcee5602640 1 -- 172.21.15.100:0/3274549014 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcfec09d060 con 0x5631534b14a0 2024-09-18T01:25:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.235+0000 7fcee5602640 1 --2- 172.21.15.100:0/3274549014 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fced4036b90 0x7fced4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.235+0000 7fcee5602640 1 -- 172.21.15.100:0/3274549014 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fcfec0a0c60 con 0x5631534b14a0 2024-09-18T01:25:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.235+0000 7fcff3fff640 1 --2- 172.21.15.100:0/3274549014 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fced4036b90 0x7fced4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.235+0000 7fcffdcb5800 1 Processor -- start 2024-09-18T01:25:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.235+0000 7fcffdcb5800 1 -- start start 2024-09-18T01:25:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.235+0000 7fcff3fff640 1 --2- 172.21.15.100:0/3274549014 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fced4036b90 0x7fced4039050 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x563153497950 tx=0x7fcfe400f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.236+0000 7fcffdcb5800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534bddd0 0x5631534be1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.236+0000 7fcffdcb5800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56315348eab0 con 0x5631534bddd0 2024-09-18T01:25:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.236+0000 7fcffb7a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534bddd0 0x5631534be1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.236+0000 7fcffb7a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534bddd0 0x5631534be1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38516/0 (socket says 172.21.15.100:38516) 2024-09-18T01:25:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.236+0000 7fcffb7a9640 1 -- 172.21.15.100:0/3746236019 learned_addr learned my addr 172.21.15.100:0/3746236019 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.236+0000 7fcffb7a9640 1 -- 172.21.15.100:0/3746236019 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631534be7a0 con 0x5631534bddd0 2024-09-18T01:25:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.236+0000 7fcffb7a9640 1 --2- 172.21.15.100:0/3746236019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534bddd0 0x5631534be1d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fcfec051cc0 tx=0x7fcfec05d450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fc4f3be57ceb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.236+0000 7fcedeffd640 1 -- 172.21.15.100:0/3746236019 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec083d60 con 0x5631534bddd0 2024-09-18T01:25:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.236+0000 7fcedeffd640 1 -- 172.21.15.100:0/3746236019 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfec065dc0 con 0x5631534bddd0 2024-09-18T01:25:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.236+0000 7fcedeffd640 1 -- 172.21.15.100:0/3746236019 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec081c50 con 0x5631534bddd0 2024-09-18T01:25:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.237+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3746236019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534bddd0 msgr2=0x5631534be1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.237+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/3746236019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534bddd0 0x5631534be1d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fcfec051cc0 tx=0x7fcfec05d450 comp rx=0 tx=0).stop 2024-09-18T01:25:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.237+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3746236019 shutdown_connections 2024-09-18T01:25:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.237+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/3746236019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534bddd0 0x5631534be1d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.237+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3746236019 >> 172.21.15.100:0/3746236019 conn(0x5631534ba130 msgr2=0x5631534b8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.237+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3746236019 shutdown_connections 2024-09-18T01:25:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.237+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3746236019 wait complete. 2024-09-18T01:25:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.237+0000 7fcffdcb5800 1 Processor -- start 2024-09-18T01:25:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.237+0000 7fcffdcb5800 1 -- start start 2024-09-18T01:25:32.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.237+0000 7fcffdcb5800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534bddd0 0x5631534c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.237+0000 7fcffdcb5800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5631534bed20 con 0x5631534bddd0 2024-09-18T01:25:32.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.237+0000 7fcffb7a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534bddd0 0x5631534c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.237+0000 7fcffb7a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534bddd0 0x5631534c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38526/0 (socket says 172.21.15.100:38526) 2024-09-18T01:25:32.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.237+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 learned_addr learned my addr 172.21.15.100:0/1763199581 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.238+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631534c5540 con 0x5631534bddd0 2024-09-18T01:25:32.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.238+0000 7fcffb7a9640 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534bddd0 0x5631534c5000 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcfec05d7a0 tx=0x7fcfec056ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.238+0000 7fcedd7fa640 1 -- 172.21.15.100:0/1763199581 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec081d80 con 0x5631534bddd0 2024-09-18T01:25:32.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.238+0000 7fcedd7fa640 1 -- 172.21.15.100:0/1763199581 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfec0ba070 con 0x5631534bddd0 2024-09-18T01:25:32.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.238+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631534c5540 con 0x5631534bddd0 2024-09-18T01:25:32.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.238+0000 7fcedd7fa640 1 -- 172.21.15.100:0/1763199581 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec083570 con 0x5631534bddd0 2024-09-18T01:25:32.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.238+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631534c5540 con 0x5631534bddd0 2024-09-18T01:25:32.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.239+0000 7fcedd7fa640 1 -- 172.21.15.100:0/1763199581 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcfec0a8070 con 0x5631534bddd0 2024-09-18T01:25:32.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.239+0000 7fcedd7fa640 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcec4036b40 0x7fcec4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.239+0000 7fcedd7fa640 1 -- 172.21.15.100:0/1763199581 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fcfec0af070 con 0x5631534bddd0 2024-09-18T01:25:32.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.239+0000 7fcff3fff640 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcec4036b40 0x7fcec4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.239+0000 7fcff3fff640 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcec4036b40 0x7fcec4039000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5631534a3af0 tx=0x7fcfe4010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.240+0000 7fcffdcb5800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.240+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5631534d0780 0x5631534d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.240+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5631534d3390 con 0x5631534d0780 2024-09-18T01:25:32.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.240+0000 7fcffbfaa640 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5631534d0780 0x5631534d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.240+0000 7fcffbfaa640 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5631534d0780 0x5631534d2c40 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.240+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.240+0000 7fcffdcb5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.240+0000 7fcffdcb5800 20 realm 2024-09-18T01:25:32.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.240+0000 7fcffdcb5800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.240+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5631534d37a0 con 0x5631534d0780 2024-09-18T01:25:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffdcb5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffdcb5800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffdcb5800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4070 con 0x5631534d0780 2024-09-18T01:25:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffdcb5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffdcb5800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d0780 2024-09-18T01:25:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffdcb5800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffdcb5800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5631534d5170 0x5631534d7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5631534d7b70 con 0x5631534d5170 2024-09-18T01:25:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffb7a9640 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5631534d5170 0x5631534d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.241+0000 7fcffb7a9640 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5631534d5170 0x5631534d7560 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.242+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.242+0000 7fcffdcb5800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.242+0000 7fcffdcb5800 20 searching for the correct realm 2024-09-18T01:25:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.242+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5631534d9b20 0x5631534dbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.242+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534dc6b0 con 0x5631534d9b20 2024-09-18T01:25:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.242+0000 7fcff3fff640 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5631534d9b20 0x5631534dbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.242+0000 7fcff3fff640 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5631534d9b20 0x5631534dbfe0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.242+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.242+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534dc6b0 con 0x5631534d5170 2024-09-18T01:25:32.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.243+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.243+0000 7fcffb7a9640 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcfec0aa030 0x7fcfec0aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.243+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534dc6b0 con 0x7fcfec0aa030 2024-09-18T01:25:32.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.243+0000 7fcffbfaa640 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcfec0aa030 0x7fcfec0aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.243+0000 7fcffbfaa640 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcfec0aa030 0x7fcfec0aa860 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.244+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.244+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d0780 2024-09-18T01:25:32.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.244+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.244+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d0780 2024-09-18T01:25:32.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.244+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.244+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x7fcfec0aa030 2024-09-18T01:25:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.244+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.244+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x7fcfec0aa030 2024-09-18T01:25:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.244+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.245+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d5170 2024-09-18T01:25:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.245+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.245+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d9b20 2024-09-18T01:25:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.245+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.245+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d0780 2024-09-18T01:25:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.245+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.245+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x7fcfec0aa030 2024-09-18T01:25:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.246+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.246+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d0780 2024-09-18T01:25:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.246+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.246+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d5170 2024-09-18T01:25:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.246+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.246+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d9b20 2024-09-18T01:25:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.246+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.246+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d9b20 2024-09-18T01:25:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.246+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.246+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x7fcfec0aa030 2024-09-18T01:25:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.247+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.247+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d9b20 2024-09-18T01:25:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.247+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.247+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d9b20 2024-09-18T01:25:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.247+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.247+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d0780 2024-09-18T01:25:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.247+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.247+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d0780 2024-09-18T01:25:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.248+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.248+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x7fcfec0aa030 2024-09-18T01:25:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.248+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.248+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d9b20 2024-09-18T01:25:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.248+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.248+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d5170 2024-09-18T01:25:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.248+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.248+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d0780 2024-09-18T01:25:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.249+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.249+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x7fcfec0aa030 2024-09-18T01:25:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.249+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.249+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d9b20 2024-09-18T01:25:32.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.249+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.249+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x7fcfec0aa030 2024-09-18T01:25:32.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.249+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.249+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d5170 2024-09-18T01:25:32.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.250+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.250+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d9b20 2024-09-18T01:25:32.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.250+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.250+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x7fcfec0aa030 2024-09-18T01:25:32.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.250+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.250+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d0780 2024-09-18T01:25:32.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.250+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.250+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5631534d4410 con 0x5631534d5170 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffdcb5800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffdcb5800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffdcb5800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffdcb5800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffdcb5800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffdcb5800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffdcb5800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5631534d8430 con 0x5631534d0780 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffdcb5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffdcb5800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5631534d8820 con 0x5631534d0780 2024-09-18T01:25:32.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffdcb5800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:32.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffdcb5800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.251+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5631534d8820 con 0x7fcfec0aa030 2024-09-18T01:25:32.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:32.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 20 zone default found 2024-09-18T01:25:32.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 4 Realm: () 2024-09-18T01:25:32.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:32.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:32.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:32.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 20 zonegroup default 2024-09-18T01:25:32.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5631534d8070 con 0x7fcfec0aa030 2024-09-18T01:25:32.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5631534de510 con 0x5631534d9b20 2024-09-18T01:25:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5631534de8b0 con 0x5631534d9b20 2024-09-18T01:25:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 20 started sync module instance, tier type = 2024-09-18T01:25:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.252+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534dd9b0 con 0x5631534d5170 2024-09-18T01:25:32.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.253+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.253+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94769850998224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534df100 con 0x5631534d5170 2024-09-18T01:25:32.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.253+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534df950 con 0x5631534d0780 2024-09-18T01:25:32.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.254+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94769850998224] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.255+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.255+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94769851001936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534df950 con 0x5631534d0780 2024-09-18T01:25:32.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.255+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534e03d0 con 0x5631534d9b20 2024-09-18T01:25:32.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.256+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94769851001936] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.256+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.256+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94769851004064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534df8c0 con 0x5631534d9b20 2024-09-18T01:25:32.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.256+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534e1290 con 0x5631534d5170 2024-09-18T01:25:32.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.257+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.257+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94769851012656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534e1f00 con 0x5631534d5170 2024-09-18T01:25:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.257+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534e28c0 con 0x5631534d0780 2024-09-18T01:25:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.257+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94769851004064] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.258+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.258+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94769851016208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534e2830 con 0x5631534d0780 2024-09-18T01:25:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.258+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534e3780 con 0x7fcfec0aa030 2024-09-18T01:25:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.258+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94769851012656] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.259+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.259+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94769851013712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534e3780 con 0x7fcfec0aa030 2024-09-18T01:25:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.259+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534e4140 con 0x7fcfec0aa030 2024-09-18T01:25:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.259+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94769851016208] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.260+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94769851013712] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.260+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.260+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94769851019984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534e36f0 con 0x7fcfec0aa030 2024-09-18T01:25:32.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.260+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534e45f0 con 0x7fcfec0aa030 2024-09-18T01:25:32.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.261+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94769851019984] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.261+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.261+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94769851022480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534e4560 con 0x7fcfec0aa030 2024-09-18T01:25:32.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.261+0000 7fcffdcb5800 20 add_watcher() i=0 2024-09-18T01:25:32.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.261+0000 7fcffdcb5800 20 add_watcher() i=1 2024-09-18T01:25:32.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.261+0000 7fcffdcb5800 20 add_watcher() i=2 2024-09-18T01:25:32.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.261+0000 7fcffdcb5800 20 add_watcher() i=3 2024-09-18T01:25:32.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.261+0000 7fcffdcb5800 20 add_watcher() i=4 2024-09-18T01:25:32.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.261+0000 7fcffdcb5800 20 add_watcher() i=5 2024-09-18T01:25:32.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.261+0000 7fcffdcb5800 20 add_watcher() i=6 2024-09-18T01:25:32.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.262+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94769851022480] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.262+0000 7fcffdcb5800 20 add_watcher() i=7 2024-09-18T01:25:32.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.262+0000 7fcffdcb5800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:32.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.262+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5631534e7960 con 0x5631534d0780 2024-09-18T01:25:32.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.262+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.262+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94769851024000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5631534e4e20 con 0x5631534d0780 2024-09-18T01:25:32.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.263+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94769851024000] v33'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.263+0000 7fceb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:32.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.263+0000 7fcffdcb5800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:32.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.263+0000 7fcffdcb5800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:32.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.263+0000 7fcffdcb5800 5 note: GC not initialized 2024-09-18T01:25:32.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.263+0000 7fceb0fe1640 20 reqs_thread_entry: start 2024-09-18T01:25:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fcffdcb5800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fcffdcb5800 20 Filter name: none 2024-09-18T01:25:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fce2a7fc640 20 reqs_thread_entry: start 2024-09-18T01:25:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fcffdcb5800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-18T01:25:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fcffdcb5800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56315351afc0 con 0x7fcfec0aa030 2024-09-18T01:25:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fcffdcb5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fcffdcb5800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-18T01:25:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fcffdcb5800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T01:25:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fcffdcb5800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-18T01:25:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fcffdcb5800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563153519550 con 0x7fcfec0aa030 2024-09-18T01:25:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.264+0000 7fcffdcb5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.265+0000 7fcffdcb5800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-18T01:25:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.265+0000 7fcffdcb5800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:25:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.265+0000 7fcffdcb5800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T01:25:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.265+0000 7fcffdcb5800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T01:25:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.265+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56315351dd40 con 0x7fcfec0aa030 2024-09-18T01:25:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.266+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v33'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.266+0000 7fcffdcb5800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-18T01:25:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.266+0000 7fcffdcb5800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T01:25:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.266+0000 7fcffdcb5800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-18T01:25:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.266+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94769851258736 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56315351e890 con 0x5631534d5170 2024-09-18T01:25:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.266+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== watch-notify(notify (1) cookie 94769851012656 notify 141733920780 ret 0) ==== 652+0+0 (crc 0 0 0) 0x5631534b1e00 con 0x5631534d5170 2024-09-18T01:25:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.266+0000 7fcedeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920780 cookie 94769851012656 notifier 4545 bl.length()=610 2024-09-18T01:25:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.266+0000 7fcedeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-18T01:25:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.266+0000 7fcedeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T01:25:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.266+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(65 notify.3 [notify cookie 94769851258736 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.266+0000 7fcedeffd640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fcec0003ea0 con 0x5631534d5170 2024-09-18T01:25:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.266+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.266+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== watch-notify(notify_complete (2) cookie 94769851258736 notify 141733920780 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcfec08a070 con 0x5631534d5170 2024-09-18T01:25:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.266+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56315351d770 con 0x7fcfec0aa030 2024-09-18T01:25:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.267+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v33'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.267+0000 7fcffdcb5800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:25:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.267+0000 7fcffdcb5800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:25:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.267+0000 7fcffdcb5800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:25:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.267+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94769851258736 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56315351cb50 con 0x5631534d9b20 2024-09-18T01:25:32.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.268+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== watch-notify(notify (1) cookie 94769851004064 notify 141733920772 ret 0) ==== 234+0+0 (crc 0 0 0) 0x7fcfe4018040 con 0x5631534d9b20 2024-09-18T01:25:32.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.268+0000 7fcedeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94769851004064 notifier 4545 bl.length()=192 2024-09-18T01:25:32.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.268+0000 7fcedeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:25:32.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.268+0000 7fcedeffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:25:32.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.268+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(68 notify.2 [notify cookie 94769851258736 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.268+0000 7fcedeffd640 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fcec0003ea0 con 0x5631534d9b20 2024-09-18T01:25:32.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.268+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== watch-notify(notify_complete (2) cookie 94769851258736 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcfe4009050 con 0x5631534d9b20 2024-09-18T01:25:32.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.268+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.283 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T01:25:32.265919Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:32.265909Z","tags":[],"group_ids":[]} 2024-09-18T01:25:32.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.269+0000 7fceb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:32.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.269+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94769851024000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563153518ae0 con 0x5631534d0780 2024-09-18T01:25:32.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.270+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94769851024000] v33'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.270+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94769850998224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563153518ae0 con 0x5631534d5170 2024-09-18T01:25:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.271+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94769850998224] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.271+0000 7fcffdcb5800 20 remove_watcher() i=0 2024-09-18T01:25:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.271+0000 7fcffdcb5800 2 removed watcher, disabling cache 2024-09-18T01:25:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.271+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94769851001936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563153518ae0 con 0x5631534d0780 2024-09-18T01:25:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.272+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94769851001936] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.272+0000 7fcffdcb5800 20 remove_watcher() i=1 2024-09-18T01:25:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.272+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94769851004064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563153518ae0 con 0x5631534d9b20 2024-09-18T01:25:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.273+0000 7fcff3fff640 1 -- 172.21.15.100:0/1763199581 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94769851004064] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfe4037040 con 0x5631534d9b20 2024-09-18T01:25:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.273+0000 7fcffdcb5800 20 remove_watcher() i=2 2024-09-18T01:25:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.273+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94769851012656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563153518ae0 con 0x5631534d5170 2024-09-18T01:25:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.274+0000 7fcffb7a9640 1 -- 172.21.15.100:0/1763199581 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94769851012656] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec0b2030 con 0x5631534d5170 2024-09-18T01:25:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.274+0000 7fcffdcb5800 20 remove_watcher() i=3 2024-09-18T01:25:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.274+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94769851016208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563153518ae0 con 0x5631534d0780 2024-09-18T01:25:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.275+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94769851016208] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x5631534d0780 2024-09-18T01:25:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.275+0000 7fcffdcb5800 20 remove_watcher() i=4 2024-09-18T01:25:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.275+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94769851013712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563153518ae0 con 0x7fcfec0aa030 2024-09-18T01:25:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.276+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94769851013712] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.276+0000 7fcffdcb5800 20 remove_watcher() i=5 2024-09-18T01:25:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.276+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94769851019984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563153518ae0 con 0x7fcfec0aa030 2024-09-18T01:25:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.277+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94769851019984] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.277+0000 7fcffdcb5800 20 remove_watcher() i=6 2024-09-18T01:25:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.277+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94769851022480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563153518ae0 con 0x7fcfec0aa030 2024-09-18T01:25:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94769851022480] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfec0aa030 2024-09-18T01:25:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 20 remove_watcher() i=7 2024-09-18T01:25:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcfec0aa030 msgr2=0x7fcfec0aa860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcfec0aa030 0x7fcfec0aa860 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5631534d0780 msgr2=0x5631534d2c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5631534d0780 0x5631534d2c40 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5631534d5170 msgr2=0x5631534d7560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5631534d5170 0x5631534d7560 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5631534d9b20 msgr2=0x5631534dbfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5631534d9b20 0x5631534dbfe0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcec4036b40 msgr2=0x7fcec4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcec4036b40 0x7fcec4039000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5631534a3af0 tx=0x7fcfe4010000 comp rx=0 tx=0).stop 2024-09-18T01:25:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534bddd0 msgr2=0x5631534c5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1763199581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534bddd0 0x5631534c5000 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcfec05d7a0 tx=0x7fcfec056ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1763199581 reap_dead start 2024-09-18T01:25:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 shutdown_connections 2024-09-18T01:25:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 >> 172.21.15.100:0/1763199581 conn(0x5631534ba130 msgr2=0x5631534b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 shutdown_connections 2024-09-18T01:25:32.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.278+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1763199581 wait complete. 2024-09-18T01:25:32.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3274549014 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fced4036b90 msgr2=0x7fced4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/3274549014 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fced4036b90 0x7fced4039050 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x563153497950 tx=0x7fcfe400f000 comp rx=0 tx=0).stop 2024-09-18T01:25:32.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3274549014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534b14a0 msgr2=0x5631534b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/3274549014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534b14a0 0x5631534b18c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fcfec06ffd0 tx=0x7fcfec064f80 comp rx=0 tx=0).stop 2024-09-18T01:25:32.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3274549014 shutdown_connections 2024-09-18T01:25:32.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/3274549014 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fced4036b90 0x7fced4039050 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/3274549014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631534b14a0 0x5631534b18c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3274549014 >> 172.21.15.100:0/3274549014 conn(0x5631534a6430 msgr2=0x5631534a8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3274549014 shutdown_connections 2024-09-18T01:25:32.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/3274549014 wait complete. 2024-09-18T01:25:32.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5631534a0c10 msgr2=0x5631534a3000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5631534a0c10 0x5631534a3000 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563153399e50 msgr2=0x56315349a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563153399e50 0x56315349a460 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56315349cb90 msgr2=0x56315349f020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56315349cb90 0x56315349f020 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcee0036b90 msgr2=0x7fcee0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fcee0036b90 0x7fcee0039050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4001e40 tx=0x7fcfe40013a0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 msgr2=0x5631534933f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 --2- 172.21.15.100:0/1579289829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563153399510 0x5631534933f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcfec067040 tx=0x7fcfec002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffbfaa640 1 -- 172.21.15.100:0/1579289829 reap_dead start 2024-09-18T01:25:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 shutdown_connections 2024-09-18T01:25:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 >> 172.21.15.100:0/1579289829 conn(0x563153394de0 msgr2=0x563153482ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 shutdown_connections 2024-09-18T01:25:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.279+0000 7fcffdcb5800 1 -- 172.21.15.100:0/1579289829 wait complete. 2024-09-18T01:25:32.295 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T01:25:32.265919Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:32.265909Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:32.295 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-18T01:25:32.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-18T01:25:32.295 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-18T01:25:32.343 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:32.343 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:32.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.343+0000 7fe6c2b2e800 1 Processor -- start 2024-09-18T01:25:32.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.343+0000 7fe6c2b2e800 1 -- start start 2024-09-18T01:25:32.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.343+0000 7fe6c2b2e800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x562fea31a650 0x562fea3a9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.343+0000 7fe6c2b2e800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562fea265b30 con 0x562fea3a97b0 2024-09-18T01:25:32.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.343+0000 7fe6c2b2e800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x562fea247360 con 0x562fea31a650 2024-09-18T01:25:32.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.343+0000 7fe6be85c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x562fea31a650 0x562fea3a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.343+0000 7fe6b7fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x562fea3a97b0 0x562fea3abba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37398/0 (socket says 172.21.15.100:37398) 2024-09-18T01:25:32.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.343+0000 7fe6b7fff640 1 -- 172.21.15.100:0/3263817791 learned_addr learned my addr 172.21.15.100:0/3263817791 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:32.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.343+0000 7fe6be85c640 1 -- 172.21.15.100:0/3263817791 >> v1:172.21.15.92:6789/0 conn(0x562fea3a97b0 legacy=0x562fea3abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.343+0000 7fe6be05b640 1 -- 172.21.15.100:0/3263817791 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3910374658 0 0) 0x562fea265b30 con 0x562fea3a97b0 2024-09-18T01:25:32.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.343+0000 7fe6be85c640 1 -- 172.21.15.100:0/3263817791 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fea26de00 con 0x562fea31a650 2024-09-18T01:25:32.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.345+0000 7fe6be85c640 1 --2- 172.21.15.100:0/3263817791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 0x562fea3a9270 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000a470 tx=0x7fe6b0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2206821d2aae7db server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.345+0000 7fe6be05b640 1 -- 172.21.15.100:0/3263817791 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0053570 con 0x562fea31a650 2024-09-18T01:25:32.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.345+0000 7fe6be05b640 1 -- 172.21.15.100:0/3263817791 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b0058070 con 0x562fea31a650 2024-09-18T01:25:32.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.345+0000 7fe6be05b640 1 -- 172.21.15.100:0/3263817791 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0053880 con 0x562fea31a650 2024-09-18T01:25:32.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.346+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3263817791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 msgr2=0x562fea3a9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.346+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/3263817791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 0x562fea3a9270 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000a470 tx=0x7fe6b0045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:32.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.346+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3263817791 shutdown_connections 2024-09-18T01:25:32.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.346+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/3263817791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 0x562fea3a9270 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.346+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3263817791 >> 172.21.15.100:0/3263817791 conn(0x562fea3a0e00 msgr2=0x562fea3a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.346+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3263817791 shutdown_connections 2024-09-18T01:25:32.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.346+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3263817791 wait complete. 2024-09-18T01:25:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.360+0000 7fe6c2b2e800 1 Processor -- start 2024-09-18T01:25:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.360+0000 7fe6c2b2e800 1 -- start start 2024-09-18T01:25:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.360+0000 7fe6c2b2e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 0x562fea3a6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.360+0000 7fe6c2b2e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562fea2f2350 con 0x562fea31a650 2024-09-18T01:25:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.360+0000 7fe6be85c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 0x562fea3a6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.360+0000 7fe6be85c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 0x562fea3a6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38540/0 (socket says 172.21.15.100:38540) 2024-09-18T01:25:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.360+0000 7fe6be85c640 1 -- 172.21.15.100:0/2192161372 learned_addr learned my addr 172.21.15.100:0/2192161372 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.360+0000 7fe6be85c640 1 -- 172.21.15.100:0/2192161372 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fea23fbc0 con 0x562fea31a650 2024-09-18T01:25:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.361+0000 7fe6be85c640 1 --2- 172.21.15.100:0/2192161372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 0x562fea3a6ba0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0045f50 tx=0x7fe6b0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4eeebe7efca9f6f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.361+0000 7fe5ace09640 1 -- 172.21.15.100:0/2192161372 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0053c20 con 0x562fea31a650 2024-09-18T01:25:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.361+0000 7fe5ace09640 1 -- 172.21.15.100:0/2192161372 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b0063030 con 0x562fea31a650 2024-09-18T01:25:32.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.361+0000 7fe5ace09640 1 -- 172.21.15.100:0/2192161372 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0053440 con 0x562fea31a650 2024-09-18T01:25:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.361+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/2192161372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 msgr2=0x562fea3a6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.361+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/2192161372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 0x562fea3a6ba0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0045f50 tx=0x7fe6b0051000 comp rx=0 tx=0).stop 2024-09-18T01:25:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.362+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/2192161372 shutdown_connections 2024-09-18T01:25:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.362+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/2192161372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 0x562fea3a6ba0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.362+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/2192161372 >> 172.21.15.100:0/2192161372 conn(0x562fea3a0e00 msgr2=0x562fea491020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.362+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/2192161372 shutdown_connections 2024-09-18T01:25:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.362+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/2192161372 wait complete. 2024-09-18T01:25:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.362+0000 7fe6c2b2e800 1 Processor -- start 2024-09-18T01:25:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.362+0000 7fe6c2b2e800 1 -- start start 2024-09-18T01:25:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.362+0000 7fe6c2b2e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 0x562fea49f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.362+0000 7fe6c2b2e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562fea3ad6b0 con 0x562fea31a650 2024-09-18T01:25:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.362+0000 7fe6be85c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 0x562fea49f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.362+0000 7fe6be85c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 0x562fea49f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38552/0 (socket says 172.21.15.100:38552) 2024-09-18T01:25:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.362+0000 7fe6be85c640 1 -- 172.21.15.100:0/3278670929 learned_addr learned my addr 172.21.15.100:0/3278670929 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.363+0000 7fe6be85c640 1 -- 172.21.15.100:0/3278670929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fea253fe0 con 0x562fea31a650 2024-09-18T01:25:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.363+0000 7fe6be85c640 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 0x562fea49f1e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0045f20 tx=0x7fe6b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.363+0000 7fe5ab606640 1 -- 172.21.15.100:0/3278670929 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0053570 con 0x562fea31a650 2024-09-18T01:25:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.363+0000 7fe5ab606640 1 -- 172.21.15.100:0/3278670929 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b0053710 con 0x562fea31a650 2024-09-18T01:25:32.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.363+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fea49f720 con 0x562fea31a650 2024-09-18T01:25:32.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.363+0000 7fe5ab606640 1 -- 172.21.15.100:0/3278670929 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0068420 con 0x562fea31a650 2024-09-18T01:25:32.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.363+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fea49fbc0 con 0x562fea31a650 2024-09-18T01:25:32.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.364+0000 7fe5ab606640 1 -- 172.21.15.100:0/3278670929 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe6b00685c0 con 0x562fea31a650 2024-09-18T01:25:32.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.364+0000 7fe5ab606640 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe5a4036b90 0x7fe5a4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.364+0000 7fe5ab606640 1 -- 172.21.15.100:0/3278670929 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fe6b0070070 con 0x562fea31a650 2024-09-18T01:25:32.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.364+0000 7fe6b7fff640 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe5a4036b90 0x7fe5a4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.364+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562fea3a97b0 0x562fea4a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.364+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4a6790 con 0x562fea3a97b0 2024-09-18T01:25:32.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.364+0000 7fe6bf05d640 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562fea3a97b0 0x562fea4a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.364+0000 7fe6b7fff640 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe5a4036b90 0x7fe5a4039050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8000c00 tx=0x7fe6a80013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.364+0000 7fe6bf05d640 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562fea3a97b0 0x562fea4a6250 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.365+0000 7fe6bf05d640 1 -- 172.21.15.100:0/3278670929 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea3a97b0 2024-09-18T01:25:32.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.365+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4a37e0 con 0x562fea3a97b0 2024-09-18T01:25:32.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.365+0000 7fe6bf05d640 1 -- 172.21.15.100:0/3278670929 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea3a97b0 2024-09-18T01:25:32.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.365+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562fea4a8a80 0x562fea4aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.365+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4ab4d0 con 0x562fea4a8a80 2024-09-18T01:25:32.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.365+0000 7fe6be85c640 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562fea4a8a80 0x562fea4aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.365+0000 7fe6be85c640 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562fea4a8a80 0x562fea4aae70 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.366+0000 7fe6be85c640 1 -- 172.21.15.100:0/3278670929 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe6b0051070 con 0x562fea4a8a80 2024-09-18T01:25:32.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.366+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4a7860 con 0x562fea3a97b0 2024-09-18T01:25:32.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.366+0000 7fe6bf05d640 1 -- 172.21.15.100:0/3278670929 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea3a97b0 2024-09-18T01:25:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.366+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562fea4ac930 0x562fea4aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.366+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4af370 con 0x562fea4ac930 2024-09-18T01:25:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.366+0000 7fe6b7fff640 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562fea4ac930 0x562fea4aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.366+0000 7fe6b7fff640 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562fea4ac930 0x562fea4aed20 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.367+0000 7fe6b7fff640 1 -- 172.21.15.100:0/3278670929 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe6a800f670 con 0x562fea4ac930 2024-09-18T01:25:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.367+0000 7fe6c2b2e800 1 Processor -- start 2024-09-18T01:25:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.367+0000 7fe6c2b2e800 1 -- start start 2024-09-18T01:25:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.367+0000 7fe6c2b2e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4bd120 0x562fea4bd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.367+0000 7fe6c2b2e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562fea241580 con 0x562fea4bd120 2024-09-18T01:25:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.367+0000 7fe6be85c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4bd120 0x562fea4bd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.367+0000 7fe6be85c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4bd120 0x562fea4bd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38562/0 (socket says 172.21.15.100:38562) 2024-09-18T01:25:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.367+0000 7fe6be85c640 1 -- 172.21.15.100:0/1408991140 learned_addr learned my addr 172.21.15.100:0/1408991140 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.368+0000 7fe6be85c640 1 -- 172.21.15.100:0/1408991140 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fea4bda80 con 0x562fea4bd120 2024-09-18T01:25:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.368+0000 7fe6be85c640 1 --2- 172.21.15.100:0/1408991140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4bd120 0x562fea4bd540 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe6b008ee20 tx=0x7fe6b0068cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.368+0000 7fe5a8e01640 1 -- 172.21.15.100:0/1408991140 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b005e650 con 0x562fea4bd120 2024-09-18T01:25:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.368+0000 7fe5a8e01640 1 -- 172.21.15.100:0/1408991140 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b0067bc0 con 0x562fea4bd120 2024-09-18T01:25:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.368+0000 7fe5a8e01640 1 -- 172.21.15.100:0/1408991140 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0090b10 con 0x562fea4bd120 2024-09-18T01:25:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.368+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/1408991140 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fea4bdd10 con 0x562fea4bd120 2024-09-18T01:25:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.368+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/1408991140 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fea4c09f0 con 0x562fea4bd120 2024-09-18T01:25:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.369+0000 7fe5a8e01640 1 -- 172.21.15.100:0/1408991140 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe6b0090cb0 con 0x562fea4bd120 2024-09-18T01:25:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.369+0000 7fe5a8e01640 1 --2- 172.21.15.100:0/1408991140 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe598036b90 0x7fe598039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.369+0000 7fe5a8e01640 1 -- 172.21.15.100:0/1408991140 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fe6b0087040 con 0x562fea4bd120 2024-09-18T01:25:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.369+0000 7fe6b7fff640 1 --2- 172.21.15.100:0/1408991140 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe598036b90 0x7fe598039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.369+0000 7fe6c2b2e800 1 Processor -- start 2024-09-18T01:25:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.369+0000 7fe6c2b2e800 1 -- start start 2024-09-18T01:25:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.369+0000 7fe6b7fff640 1 --2- 172.21.15.100:0/1408991140 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe598036b90 0x7fe598039050 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x562fea4a3740 tx=0x7fe6a8006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.369+0000 7fe6c2b2e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4c9bc0 0x562fea4c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.369+0000 7fe6c2b2e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562fea3a5210 con 0x562fea4c9bc0 2024-09-18T01:25:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.370+0000 7fe6be85c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4c9bc0 0x562fea4c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.370+0000 7fe6be85c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4c9bc0 0x562fea4c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38564/0 (socket says 172.21.15.100:38564) 2024-09-18T01:25:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.370+0000 7fe6be85c640 1 -- 172.21.15.100:0/2095014915 learned_addr learned my addr 172.21.15.100:0/2095014915 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.370+0000 7fe6be85c640 1 -- 172.21.15.100:0/2095014915 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fea4ca590 con 0x562fea4c9bc0 2024-09-18T01:25:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.370+0000 7fe6be85c640 1 --2- 172.21.15.100:0/2095014915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4c9bc0 0x562fea4c9fc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe6b005d010 tx=0x7fe6b0065390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4c9fcd4feec3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.370+0000 7fe5a27fc640 1 -- 172.21.15.100:0/2095014915 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b009d030 con 0x562fea4c9bc0 2024-09-18T01:25:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.370+0000 7fe5a27fc640 1 -- 172.21.15.100:0/2095014915 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b004dc90 con 0x562fea4c9bc0 2024-09-18T01:25:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.370+0000 7fe5a27fc640 1 -- 172.21.15.100:0/2095014915 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0073750 con 0x562fea4c9bc0 2024-09-18T01:25:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.371+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/2095014915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4c9bc0 msgr2=0x562fea4c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.371+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/2095014915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4c9bc0 0x562fea4c9fc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe6b005d010 tx=0x7fe6b0065390 comp rx=0 tx=0).stop 2024-09-18T01:25:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.371+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/2095014915 shutdown_connections 2024-09-18T01:25:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.371+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/2095014915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4c9bc0 0x562fea4c9fc0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.371+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/2095014915 >> 172.21.15.100:0/2095014915 conn(0x562fea4c5f70 msgr2=0x562fea4c4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.371+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/2095014915 shutdown_connections 2024-09-18T01:25:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.371+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/2095014915 wait complete. 2024-09-18T01:25:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.371+0000 7fe6c2b2e800 1 Processor -- start 2024-09-18T01:25:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.371+0000 7fe6c2b2e800 1 -- start start 2024-09-18T01:25:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.371+0000 7fe6c2b2e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4c9bc0 0x562fea4d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.371+0000 7fe6c2b2e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562fea4ca9e0 con 0x562fea4c9bc0 2024-09-18T01:25:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.371+0000 7fe6be85c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4c9bc0 0x562fea4d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.371+0000 7fe6be85c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4c9bc0 0x562fea4d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38580/0 (socket says 172.21.15.100:38580) 2024-09-18T01:25:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.371+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 learned_addr learned my addr 172.21.15.100:0/587338151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.372+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fea4d1400 con 0x562fea4c9bc0 2024-09-18T01:25:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.372+0000 7fe6be85c640 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4c9bc0 0x562fea4d0ec0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00656c0 tx=0x7fe6b005cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.372+0000 7fe5a0ff9640 1 -- 172.21.15.100:0/587338151 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b00b7070 con 0x562fea4c9bc0 2024-09-18T01:25:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.372+0000 7fe5a0ff9640 1 -- 172.21.15.100:0/587338151 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b005ee40 con 0x562fea4c9bc0 2024-09-18T01:25:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.372+0000 7fe5a0ff9640 1 -- 172.21.15.100:0/587338151 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0090520 con 0x562fea4c9bc0 2024-09-18T01:25:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.372+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fea4d1400 con 0x562fea4c9bc0 2024-09-18T01:25:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.372+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fea4d1400 con 0x562fea4c9bc0 2024-09-18T01:25:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.373+0000 7fe5a0ff9640 1 -- 172.21.15.100:0/587338151 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe6b00ba070 con 0x562fea4c9bc0 2024-09-18T01:25:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.373+0000 7fe5a0ff9640 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe588036b90 0x7fe588039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.373+0000 7fe5a0ff9640 1 -- 172.21.15.100:0/587338151 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fe6b00a8030 con 0x562fea4c9bc0 2024-09-18T01:25:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.373+0000 7fe6b7fff640 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe588036b90 0x7fe588039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.373+0000 7fe6b7fff640 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe588036b90 0x7fe588039050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800ffd0 tx=0x7fe6a8023040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.374+0000 7fe6c2b2e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.374+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562fea4dc5d0 0x562fea4dea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.374+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4df1e0 con 0x562fea4dc5d0 2024-09-18T01:25:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.374+0000 7fe6bf05d640 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562fea4dc5d0 0x562fea4dea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.374+0000 7fe6bf05d640 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562fea4dc5d0 0x562fea4dea90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.374+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.374+0000 7fe6c2b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.374+0000 7fe6c2b2e800 20 realm 2024-09-18T01:25:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.374+0000 7fe6c2b2e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.374+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4df5f0 con 0x562fea4dc5d0 2024-09-18T01:25:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6c2b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6c2b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6c2b2e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4dfec0 con 0x562fea4dc5d0 2024-09-18T01:25:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6c2b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6c2b2e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4dc5d0 2024-09-18T01:25:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6c2b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6c2b2e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562fea4e0fc0 0x562fea4e33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e39c0 con 0x562fea4e0fc0 2024-09-18T01:25:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6be85c640 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562fea4e0fc0 0x562fea4e33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.375+0000 7fe6be85c640 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562fea4e0fc0 0x562fea4e33b0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.376+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.376+0000 7fe6c2b2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.376+0000 7fe6c2b2e800 20 searching for the correct realm 2024-09-18T01:25:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.376+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562fea4e5970 0x562fea4e7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.376+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e8500 con 0x562fea4e5970 2024-09-18T01:25:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.376+0000 7fe6b7fff640 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562fea4e5970 0x562fea4e7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.376+0000 7fe6b7fff640 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562fea4e5970 0x562fea4e7e30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.376+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.376+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e8500 con 0x562fea4e0fc0 2024-09-18T01:25:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.376+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.376+0000 7fe6be85c640 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe6b00bc070 0x7fe6b00509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.377+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e8500 con 0x7fe6b00bc070 2024-09-18T01:25:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.377+0000 7fe6bf05d640 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe6b00bc070 0x7fe6b00509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.377+0000 7fe6bf05d640 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe6b00bc070 0x7fe6b00509c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.377+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.377+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4dc5d0 2024-09-18T01:25:32.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.377+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.377+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4dc5d0 2024-09-18T01:25:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.378+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.378+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x7fe6b00bc070 2024-09-18T01:25:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.378+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.378+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x7fe6b00bc070 2024-09-18T01:25:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.378+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.378+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4e0fc0 2024-09-18T01:25:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.378+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.378+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4e5970 2024-09-18T01:25:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.379+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.379+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4dc5d0 2024-09-18T01:25:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.379+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.379+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x7fe6b00bc070 2024-09-18T01:25:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.379+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.379+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4dc5d0 2024-09-18T01:25:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.379+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.379+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4e0fc0 2024-09-18T01:25:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.380+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.380+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4e5970 2024-09-18T01:25:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.380+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.380+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4e5970 2024-09-18T01:25:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.380+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.380+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x7fe6b00bc070 2024-09-18T01:25:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.380+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.380+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4e5970 2024-09-18T01:25:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.380+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.381+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4e5970 2024-09-18T01:25:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.381+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.381+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4dc5d0 2024-09-18T01:25:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.381+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.381+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4dc5d0 2024-09-18T01:25:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.381+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.381+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x7fe6b00bc070 2024-09-18T01:25:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.381+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.381+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4e5970 2024-09-18T01:25:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.382+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.382+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4e0fc0 2024-09-18T01:25:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.382+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.382+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4dc5d0 2024-09-18T01:25:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.382+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.382+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x7fe6b00bc070 2024-09-18T01:25:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.382+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.382+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4e5970 2024-09-18T01:25:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.383+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.383+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x7fe6b00bc070 2024-09-18T01:25:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.383+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.383+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4e0fc0 2024-09-18T01:25:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.383+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.383+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4e5970 2024-09-18T01:25:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.383+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.383+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x7fe6b00bc070 2024-09-18T01:25:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4dc5d0 2024-09-18T01:25:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e0260 con 0x562fea4e0fc0 2024-09-18T01:25:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6c2b2e800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6c2b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6c2b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6c2b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6c2b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6c2b2e800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6c2b2e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e4280 con 0x562fea4dc5d0 2024-09-18T01:25:32.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6c2b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6c2b2e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.384+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e4670 con 0x562fea4dc5d0 2024-09-18T01:25:32.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:32.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e4670 con 0x7fe6b00bc070 2024-09-18T01:25:32.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:32.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 20 zone default found 2024-09-18T01:25:32.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 4 Realm: () 2024-09-18T01:25:32.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:32.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:32.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:32.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 20 zonegroup default 2024-09-18T01:25:32.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e8980 con 0x7fe6b00bc070 2024-09-18T01:25:32.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.385+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4ea360 con 0x562fea4e5970 2024-09-18T01:25:32.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.386+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.386+0000 7fe6c2b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.386+0000 7fe6c2b2e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.386+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4ea700 con 0x562fea4e5970 2024-09-18T01:25:32.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.386+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.386+0000 7fe6c2b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.386+0000 7fe6c2b2e800 20 started sync module instance, tier type = 2024-09-18T01:25:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.386+0000 7fe6c2b2e800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.386+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4e9800 con 0x562fea4e0fc0 2024-09-18T01:25:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.387+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.387+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94763794471920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4eaf50 con 0x562fea4e0fc0 2024-09-18T01:25:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.387+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4eb7a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.388+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94763794471920] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.388+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.388+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94763794475680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4eb7a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.388+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4ec1f0 con 0x562fea4e5970 2024-09-18T01:25:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.389+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94763794475680] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.389+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.389+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94763794477808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4eb710 con 0x562fea4e5970 2024-09-18T01:25:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.389+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4ed0e0 con 0x562fea4e0fc0 2024-09-18T01:25:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.390+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94763794477808] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.390+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.390+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94763794484272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4ed050 con 0x562fea4e0fc0 2024-09-18T01:25:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.390+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4edfa0 con 0x562fea4dc5d0 2024-09-18T01:25:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.391+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.391+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94763794488048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4ee3c0 con 0x562fea4dc5d0 2024-09-18T01:25:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.391+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4eee90 con 0x7fe6b00bc070 2024-09-18T01:25:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.392+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94763794484272] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.392+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.392+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94763794488048] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.392+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94763794491776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4edf10 con 0x7fe6b00bc070 2024-09-18T01:25:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.392+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4ef470 con 0x7fe6b00bc070 2024-09-18T01:25:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.393+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94763794491776] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.394+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.394+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94763794486480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4ef470 con 0x7fe6b00bc070 2024-09-18T01:25:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.394+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4efd20 con 0x7fe6b00bc070 2024-09-18T01:25:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.395+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.395+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94763794495088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4f0190 con 0x7fe6b00bc070 2024-09-18T01:25:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.395+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94763794486480] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.395+0000 7fe6c2b2e800 20 add_watcher() i=0 2024-09-18T01:25:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.395+0000 7fe6c2b2e800 20 add_watcher() i=1 2024-09-18T01:25:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.395+0000 7fe6c2b2e800 20 add_watcher() i=2 2024-09-18T01:25:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.395+0000 7fe6c2b2e800 20 add_watcher() i=3 2024-09-18T01:25:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.395+0000 7fe6c2b2e800 20 add_watcher() i=4 2024-09-18T01:25:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.395+0000 7fe6c2b2e800 20 add_watcher() i=5 2024-09-18T01:25:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.395+0000 7fe6c2b2e800 20 add_watcher() i=6 2024-09-18T01:25:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.395+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94763794495088] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.395+0000 7fe6c2b2e800 20 add_watcher() i=7 2024-09-18T01:25:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.395+0000 7fe6c2b2e800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.395+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea4f0190 con 0x562fea4dc5d0 2024-09-18T01:25:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.396+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.396+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94763794496736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4f0100 con 0x562fea4dc5d0 2024-09-18T01:25:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.397+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94763794496736] v33'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.397+0000 7fe5757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.397+0000 7fe6c2b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.397+0000 7fe6c2b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.397+0000 7fe6c2b2e800 5 note: GC not initialized 2024-09-18T01:25:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.397+0000 7fe4effff640 20 reqs_thread_entry: start 2024-09-18T01:25:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.397+0000 7fe6c2b2e800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.397+0000 7fe6c2b2e800 20 Filter name: none 2024-09-18T01:25:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.397+0000 7fe4edffb640 20 reqs_thread_entry: start 2024-09-18T01:25:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.398+0000 7fe6c2b2e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-18T01:25:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.398+0000 7fe6c2b2e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.398+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea526710 con 0x7fe6b00bc070 2024-09-18T01:25:32.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.398+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.398+0000 7fe6c2b2e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-18T01:25:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.398+0000 7fe6c2b2e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-18T01:25:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.398+0000 7fe6c2b2e800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T01:25:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.398+0000 7fe6c2b2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.398+0000 7fe6c2b2e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:25:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.398+0000 7fe6c2b2e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.398+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea526160 con 0x562fea4e0fc0 2024-09-18T01:25:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6c2b2e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6c2b2e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:25:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6c2b2e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6c2b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 : miss 2024-09-18T01:25:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6c2b2e800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea529ec0 con 0x7fe6b00bc070 2024-09-18T01:25:32.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(64 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6c2b2e800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:32.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6c2b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:32.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6c2b2e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:32.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6c2b2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:32.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6c2b2e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:32.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6c2b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 2024-09-18T01:25:32.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6c2b2e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-18T01:25:32.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.399+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea52e650 con 0x562fea4e0fc0 2024-09-18T01:25:32.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.400+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(65 foo.buckets [call] v33'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.401+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 8.f 8:f4921ab2:root::.bucket.meta.testx%3amyfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea531f60 con 0x562fea4e5970 2024-09-18T01:25:32.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [create,call,writefull 0~412,setxattr (203)] v33'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6c2b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x7 2024-09-18T01:25:32.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6c2b2e800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:32.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6c2b2e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-18T01:25:32.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6c2b2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1, ofs0, ns] 2024-09-18T01:25:32.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94763794759056 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea531ab0 con 0x562fea4e0fc0 2024-09-18T01:25:32.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== watch-notify(notify (1) cookie 94763794471920 notify 141733920781 ret 0) ==== 889+0+0 (crc 0 0 0) 0x562fea4bdd10 con 0x562fea4e0fc0 2024-09-18T01:25:32.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe5a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920781 cookie 94763794471920 notifier 4552 bl.length()=847 2024-09-18T01:25:32.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe5a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x7 2024-09-18T01:25:32.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe5a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:32.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe5a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-18T01:25:32.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe5a27fc640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe584003ea0 con 0x562fea4e0fc0 2024-09-18T01:25:32.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(67 notify.0 [notify cookie 94763794759056 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== watch-notify(notify_complete (2) cookie 94763794759056 notify 141733920781 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562fea4bda80 con 0x562fea4e0fc0 2024-09-18T01:25:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6c2b2e800 20 handle_bi_update(): bucket=testx:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): orig_sources= new_sources= 2024-09-18T01:25:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6c2b2e800 20 handle_bi_update(): bucket=testx:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): potential sources added=[] removed=[] 2024-09-18T01:25:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6c2b2e800 20 handle_bi_update(): bucket=testx:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): orig_dests= new_dests= 2024-09-18T01:25:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6c2b2e800 20 handle_bi_update(): bucket=testx:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): potential dests added=[] removed=[] 2024-09-18T01:25:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.402+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea52fd90 con 0x562fea4dc5d0 2024-09-18T01:25:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.403+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v33'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.404+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea5325d0 con 0x562fea4dc5d0 2024-09-18T01:25:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.405+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v33'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.405+0000 7fe6c2b2e800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-18T01:25:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.405+0000 7fe6c2b2e800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-18T01:25:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.405+0000 7fe6c2b2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-18T01:25:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.405+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94763794765600 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea532a80 con 0x562fea4dc5d0 2024-09-18T01:25:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.405+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== watch-notify(notify (1) cookie 94763794488048 notify 141733920788 ret 0) ==== 390+0+0 (crc 0 0 0) 0x562fea531bd0 con 0x562fea4dc5d0 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.405+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(71 notify.4 [notify cookie 94763794765600 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.405+0000 7fe5a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920788 cookie 94763794488048 notifier 4552 bl.length()=348 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.405+0000 7fe5a1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.405+0000 7fe5a1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.405+0000 7fe5a1ffb640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe4f4003400 con 0x562fea4dc5d0 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.405+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.405+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== watch-notify(notify_complete (2) cookie 94763794765600 notify 141733920788 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562fea530da0 con 0x562fea4dc5d0 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.405+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea531720 con 0x562fea4e0fc0 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.406+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(73 myfoo [call,delete] v33'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.406+0000 7fe6c2b2e800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.406+0000 7fe6c2b2e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.406+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94763794765600 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea52f230 con 0x7fe6b00bc070 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.407+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== watch-notify(notify (1) cookie 94763794486480 notify 141733920776 ret 0) ==== 191+0+0 (crc 0 0 0) 0x562fea530da0 con 0x7fe6b00bc070 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.407+0000 7fe5a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 94763794486480 notifier 4552 bl.length()=149 2024-09-18T01:25:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.407+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(74 notify.6 [notify cookie 94763794765600 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.407+0000 7fe5a1ffb640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe4f4003400 con 0x7fe6b00bc070 2024-09-18T01:25:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.407+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== watch-notify(notify_complete (2) cookie 94763794765600 notify 141733920776 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562fea52a2b0 con 0x7fe6b00bc070 2024-09-18T01:25:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.407+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.407+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea531720 con 0x7fe6b00bc070 2024-09-18T01:25:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.408+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(76 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call,delete] v33'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.408+0000 7fe6c2b2e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 from cache 2024-09-18T01:25:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.408+0000 7fe6c2b2e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1, ofs0, ns] 2024-09-18T01:25:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.408+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify cookie 94763794765600 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fea528340 con 0x562fea4dc5d0 2024-09-18T01:25:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.408+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== watch-notify(notify (1) cookie 94763794475680 notify 141733920789 ret 0) ==== 248+0+0 (crc 0 0 0) 0x562fea52a2b0 con 0x562fea4dc5d0 2024-09-18T01:25:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.408+0000 7fe5a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920789 cookie 94763794475680 notifier 4552 bl.length()=206 2024-09-18T01:25:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.408+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(77 notify.1 [notify cookie 94763794765600 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.408+0000 7fe5a1ffb640 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:78 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe4f4002f90 con 0x562fea4dc5d0 2024-09-18T01:25:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.409+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(78 notify.1 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.409+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== watch-notify(notify_complete (2) cookie 94763794765600 notify 141733920789 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562fea5294b0 con 0x562fea4dc5d0 2024-09-18T01:25:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.409+0000 7fe5757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.410+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94763794496736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea5242c0 con 0x562fea4dc5d0 2024-09-18T01:25:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.410+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94763794496736] v33'135 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.411+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94763794471920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea5242c0 con 0x562fea4e0fc0 2024-09-18T01:25:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.411+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94763794471920] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.411+0000 7fe6c2b2e800 20 remove_watcher() i=0 2024-09-18T01:25:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.411+0000 7fe6c2b2e800 2 removed watcher, disabling cache 2024-09-18T01:25:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.411+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94763794475680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea5242c0 con 0x562fea4dc5d0 2024-09-18T01:25:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.413+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94763794475680] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.413+0000 7fe6c2b2e800 20 remove_watcher() i=1 2024-09-18T01:25:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.413+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94763794477808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea5242c0 con 0x562fea4e5970 2024-09-18T01:25:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.414+0000 7fe6b7fff640 1 -- 172.21.15.100:0/587338151 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94763794477808] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a8037040 con 0x562fea4e5970 2024-09-18T01:25:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.414+0000 7fe6c2b2e800 20 remove_watcher() i=2 2024-09-18T01:25:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.414+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94763794484272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4efce0 con 0x562fea4e0fc0 2024-09-18T01:25:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.414+0000 7fe6be85c640 1 -- 172.21.15.100:0/587338151 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94763794484272] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b00b9030 con 0x562fea4e0fc0 2024-09-18T01:25:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.414+0000 7fe6c2b2e800 20 remove_watcher() i=3 2024-09-18T01:25:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.414+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94763794488048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4eaaa0 con 0x562fea4dc5d0 2024-09-18T01:25:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.415+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94763794488048] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x562fea4dc5d0 2024-09-18T01:25:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.415+0000 7fe6c2b2e800 20 remove_watcher() i=4 2024-09-18T01:25:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.415+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94763794491776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4ecc30 con 0x7fe6b00bc070 2024-09-18T01:25:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.416+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94763794491776] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.416+0000 7fe6c2b2e800 20 remove_watcher() i=5 2024-09-18T01:25:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.416+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94763794486480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4efce0 con 0x7fe6b00bc070 2024-09-18T01:25:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.417+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94763794486480] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.417+0000 7fe6c2b2e800 20 remove_watcher() i=6 2024-09-18T01:25:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.417+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94763794495088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fea4edaf0 con 0x7fe6b00bc070 2024-09-18T01:25:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.418+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94763794495088] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b800a4a0 con 0x7fe6b00bc070 2024-09-18T01:25:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.418+0000 7fe6c2b2e800 20 remove_watcher() i=7 2024-09-18T01:25:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.418+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe6b00bc070 msgr2=0x7fe6b00509c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.418+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe6b00bc070 0x7fe6b00509c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.418+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562fea4dc5d0 msgr2=0x562fea4dea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.418+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562fea4dc5d0 0x562fea4dea90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.418+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562fea4e0fc0 msgr2=0x562fea4e33b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.418+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562fea4e0fc0 0x562fea4e33b0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.418+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562fea4e5970 msgr2=0x562fea4e7e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.418+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562fea4e5970 0x562fea4e7e30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe588036b90 msgr2=0x7fe588039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe588036b90 0x7fe588039050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800ffd0 tx=0x7fe6a8023040 comp rx=0 tx=0).stop 2024-09-18T01:25:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4c9bc0 msgr2=0x562fea4d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6bf05d640 1 -- 172.21.15.100:0/587338151 reap_dead start 2024-09-18T01:25:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4c9bc0 0x562fea4d0ec0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00656c0 tx=0x7fe6b005cc30 comp rx=0 tx=0).stop 2024-09-18T01:25:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 shutdown_connections 2024-09-18T01:25:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/587338151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4c9bc0 0x562fea4d0ec0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 >> 172.21.15.100:0/587338151 conn(0x562fea4c5f70 msgr2=0x562fea4c4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 shutdown_connections 2024-09-18T01:25:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/587338151 wait complete. 2024-09-18T01:25:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/1408991140 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe598036b90 msgr2=0x7fe598039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/1408991140 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe598036b90 0x7fe598039050 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x562fea4a3740 tx=0x7fe6a8006000 comp rx=0 tx=0).stop 2024-09-18T01:25:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/1408991140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4bd120 msgr2=0x562fea4bd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/1408991140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4bd120 0x562fea4bd540 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe6b008ee20 tx=0x7fe6b0068cf0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/1408991140 shutdown_connections 2024-09-18T01:25:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/1408991140 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe598036b90 0x7fe598039050 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/1408991140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea4bd120 0x562fea4bd540 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/1408991140 >> 172.21.15.100:0/1408991140 conn(0x562fea4b20b0 msgr2=0x562fea4b4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/1408991140 shutdown_connections 2024-09-18T01:25:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/1408991140 wait complete. 2024-09-18T01:25:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562fea4ac930 msgr2=0x562fea4aed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562fea4ac930 0x562fea4aed20 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562fea3a97b0 msgr2=0x562fea4a6250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562fea3a97b0 0x562fea4a6250 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562fea4a8a80 msgr2=0x562fea4aae70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.419+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562fea4a8a80 0x562fea4aae70 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.420+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe5a4036b90 msgr2=0x7fe5a4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.420+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe5a4036b90 0x7fe5a4039050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8000c00 tx=0x7fe6a80013b0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.420+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 msgr2=0x562fea49f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.420+0000 7fe6c2b2e800 1 --2- 172.21.15.100:0/3278670929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fea31a650 0x562fea49f1e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0045f20 tx=0x7fe6b0002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.420+0000 7fe6bf05d640 1 -- 172.21.15.100:0/3278670929 reap_dead start 2024-09-18T01:25:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.420+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 shutdown_connections 2024-09-18T01:25:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.420+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 >> 172.21.15.100:0/3278670929 conn(0x562fea3a0e00 msgr2=0x562fea490bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.420+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 shutdown_connections 2024-09-18T01:25:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.420+0000 7fe6c2b2e800 1 -- 172.21.15.100:0/3278670929 wait complete. 2024-09-18T01:25:32.433 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-18T01:25:32.433 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-18T01:25:32.433 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-18T01:25:32.476 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:32.476 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.476+0000 7f9fb3887800 1 Processor -- start 2024-09-18T01:25:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.476+0000 7f9fb3887800 1 -- start start 2024-09-18T01:25:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.476+0000 7f9fb3887800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e9694aacf0 0x55e9694ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.476+0000 7f9fb3887800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e969363b30 con 0x55e9694186b0 2024-09-18T01:25:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.476+0000 7f9fb3887800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55e969345360 con 0x55e9694aacf0 2024-09-18T01:25:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.477+0000 7f9fb0b7a640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e9694aacf0 0x55e9694ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.477+0000 7f9fb137b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55e9694186b0 0x55e9694a95d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37412/0 (socket says 172.21.15.100:37412) 2024-09-18T01:25:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.477+0000 7f9fb137b640 1 -- 172.21.15.100:0/1005482197 learned_addr learned my addr 172.21.15.100:0/1005482197 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:32.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.477+0000 7f9fabfff640 1 -- 172.21.15.100:0/1005482197 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 363067915 0 0) 0x55e969363b30 con 0x55e9694186b0 2024-09-18T01:25:32.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.477+0000 7f9fabfff640 1 -- 172.21.15.100:0/1005482197 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fa0001e10 con 0x55e9694186b0 2024-09-18T01:25:32.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.477+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/1005482197 >> v1:172.21.15.92:6789/0 conn(0x55e9694186b0 legacy=0x55e9694a95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.477+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/1005482197 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e96936be00 con 0x55e9694aacf0 2024-09-18T01:25:32.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.479+0000 7f9fb0b7a640 1 --2- 172.21.15.100:0/1005482197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694aacf0 0x55e9694ad0e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00a470 tx=0x7f9f9c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5109f99c879e9676 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.479+0000 7f9fabfff640 1 -- 172.21.15.100:0/1005482197 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f9c059070 con 0x55e9694aacf0 2024-09-18T01:25:32.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.479+0000 7f9fabfff640 1 -- 172.21.15.100:0/1005482197 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f9c054570 con 0x55e9694aacf0 2024-09-18T01:25:32.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.479+0000 7f9fabfff640 1 -- 172.21.15.100:0/1005482197 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f9c054870 con 0x55e9694aacf0 2024-09-18T01:25:32.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.479+0000 7f9fb3887800 1 -- 172.21.15.100:0/1005482197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694aacf0 msgr2=0x55e9694ad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.479+0000 7f9fb3887800 1 --2- 172.21.15.100:0/1005482197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694aacf0 0x55e9694ad0e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00a470 tx=0x7f9f9c045920 comp rx=0 tx=0).stop 2024-09-18T01:25:32.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.479+0000 7f9fb3887800 1 -- 172.21.15.100:0/1005482197 shutdown_connections 2024-09-18T01:25:32.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.479+0000 7f9fb3887800 1 --2- 172.21.15.100:0/1005482197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694aacf0 0x55e9694ad0e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.479+0000 7f9fb3887800 1 -- 172.21.15.100:0/1005482197 >> 172.21.15.100:0/1005482197 conn(0x55e96949ede0 msgr2=0x55e9694a1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.479+0000 7f9fb3887800 1 -- 172.21.15.100:0/1005482197 shutdown_connections 2024-09-18T01:25:32.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.479+0000 7f9fb3887800 1 -- 172.21.15.100:0/1005482197 wait complete. 2024-09-18T01:25:32.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.493+0000 7f9fb3887800 1 Processor -- start 2024-09-18T01:25:32.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.493+0000 7f9fb3887800 1 -- start start 2024-09-18T01:25:32.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.493+0000 7f9fb3887800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694186b0 0x55e969595970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.493+0000 7f9fb3887800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e9693f0330 con 0x55e9694186b0 2024-09-18T01:25:32.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.493+0000 7f9fb137b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694186b0 0x55e969595970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.493+0000 7f9fb137b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694186b0 0x55e969595970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38590/0 (socket says 172.21.15.100:38590) 2024-09-18T01:25:32.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.493+0000 7f9fb137b640 1 -- 172.21.15.100:0/2392074155 learned_addr learned my addr 172.21.15.100:0/2392074155 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.494+0000 7f9fb137b640 1 -- 172.21.15.100:0/2392074155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e96933dbc0 con 0x55e9694186b0 2024-09-18T01:25:32.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.494+0000 7f9fb137b640 1 --2- 172.21.15.100:0/2392074155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694186b0 0x55e969595970 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4001680 tx=0x7f9fa4001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ff00c0771a7d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.494+0000 7f9e9f606640 1 -- 172.21.15.100:0/2392074155 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa4016070 con 0x55e9694186b0 2024-09-18T01:25:32.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.494+0000 7f9e9f606640 1 -- 172.21.15.100:0/2392074155 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa4004520 con 0x55e9694186b0 2024-09-18T01:25:32.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.494+0000 7f9e9f606640 1 -- 172.21.15.100:0/2392074155 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa4004880 con 0x55e9694186b0 2024-09-18T01:25:32.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.495+0000 7f9fb3887800 1 -- 172.21.15.100:0/2392074155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694186b0 msgr2=0x55e969595970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.495+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2392074155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694186b0 0x55e969595970 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4001680 tx=0x7f9fa4001b40 comp rx=0 tx=0).stop 2024-09-18T01:25:32.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.495+0000 7f9fb3887800 1 -- 172.21.15.100:0/2392074155 shutdown_connections 2024-09-18T01:25:32.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.495+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2392074155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694186b0 0x55e969595970 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.495+0000 7f9fb3887800 1 -- 172.21.15.100:0/2392074155 >> 172.21.15.100:0/2392074155 conn(0x55e96949ede0 msgr2=0x55e969591330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.495+0000 7f9fb3887800 1 -- 172.21.15.100:0/2392074155 shutdown_connections 2024-09-18T01:25:32.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.495+0000 7f9fb3887800 1 -- 172.21.15.100:0/2392074155 wait complete. 2024-09-18T01:25:32.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.495+0000 7f9fb3887800 1 Processor -- start 2024-09-18T01:25:32.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.495+0000 7f9fb3887800 1 -- start start 2024-09-18T01:25:32.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.495+0000 7f9fb3887800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694186b0 0x55e96959d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.495+0000 7f9fb3887800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e9694ad920 con 0x55e9694186b0 2024-09-18T01:25:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.495+0000 7f9fb137b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694186b0 0x55e96959d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.495+0000 7f9fb137b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694186b0 0x55e96959d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38604/0 (socket says 172.21.15.100:38604) 2024-09-18T01:25:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.495+0000 7f9fb137b640 1 -- 172.21.15.100:0/2821685283 learned_addr learned my addr 172.21.15.100:0/2821685283 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.496+0000 7f9fb137b640 1 -- 172.21.15.100:0/2821685283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e969351fe0 con 0x55e9694186b0 2024-09-18T01:25:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.496+0000 7f9fb137b640 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694186b0 0x55e96959d3e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4014040 tx=0x7f9fa4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.496+0000 7f9e9de03640 1 -- 172.21.15.100:0/2821685283 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa4021020 con 0x55e9694186b0 2024-09-18T01:25:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.496+0000 7f9e9de03640 1 -- 172.21.15.100:0/2821685283 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa4011530 con 0x55e9694186b0 2024-09-18T01:25:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.496+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e96959d920 con 0x55e9694186b0 2024-09-18T01:25:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.496+0000 7f9e9de03640 1 -- 172.21.15.100:0/2821685283 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa4016040 con 0x55e9694186b0 2024-09-18T01:25:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.496+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e96959dde0 con 0x55e9694186b0 2024-09-18T01:25:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.497+0000 7f9e9de03640 1 -- 172.21.15.100:0/2821685283 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9fa4024020 con 0x55e9694186b0 2024-09-18T01:25:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.497+0000 7f9e9de03640 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e98036b90 0x7f9e98039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.497+0000 7f9e9de03640 1 -- 172.21.15.100:0/2821685283 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9fa404bff0 con 0x55e9694186b0 2024-09-18T01:25:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.497+0000 7f9fb0b7a640 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e98036b90 0x7f9e98039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.497+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e9694aacf0 0x55e9695a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.497+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695a49a0 con 0x55e9694aacf0 2024-09-18T01:25:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.497+0000 7f9fb1b7c640 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e9694aacf0 0x55e9695a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.498+0000 7f9fb0b7a640 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e98036b90 0x7f9e98039050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55e969417df0 tx=0x7f9f9c050000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.498+0000 7f9fb1b7c640 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e9694aacf0 0x55e9695a4380 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.498+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2821685283 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fac0083e0 con 0x55e9694aacf0 2024-09-18T01:25:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.498+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695a1970 con 0x55e9694aacf0 2024-09-18T01:25:32.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.498+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2821685283 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9fac0083e0 con 0x55e9694aacf0 2024-09-18T01:25:32.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.498+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e9695a6a90 0x55e9695a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.498+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695a96e0 con 0x55e9695a6a90 2024-09-18T01:25:32.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.498+0000 7f9fb137b640 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e9695a6a90 0x55e9695a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.499+0000 7f9fb137b640 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e9695a6a90 0x55e9695a8f50 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.499+0000 7f9fb137b640 1 -- 172.21.15.100:0/2821685283 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9fa400f070 con 0x55e9695a6a90 2024-09-18T01:25:32.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.499+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695a5260 con 0x55e9694aacf0 2024-09-18T01:25:32.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.499+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2821685283 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9fac0083e0 con 0x55e9694aacf0 2024-09-18T01:25:32.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.499+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e9695aab40 0x55e9695acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.499+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ad5d0 con 0x55e9695aab40 2024-09-18T01:25:32.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.499+0000 7f9fb0b7a640 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e9695aab40 0x55e9695acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.500+0000 7f9fb0b7a640 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e9695aab40 0x55e9695acf30 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.500+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2821685283 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9f9c05c040 con 0x55e9695aab40 2024-09-18T01:25:32.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.500+0000 7f9fb3887800 1 Processor -- start 2024-09-18T01:25:32.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.500+0000 7f9fb3887800 1 -- start start 2024-09-18T01:25:32.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.501+0000 7f9fb3887800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695bb340 0x55e9695bb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.501+0000 7f9fb3887800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e96933f580 con 0x55e9695bb340 2024-09-18T01:25:32.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.501+0000 7f9fb137b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695bb340 0x55e9695bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.501+0000 7f9fb137b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695bb340 0x55e9695bb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38620/0 (socket says 172.21.15.100:38620) 2024-09-18T01:25:32.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.501+0000 7f9fb137b640 1 -- 172.21.15.100:0/2324736890 learned_addr learned my addr 172.21.15.100:0/2324736890 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.501+0000 7f9fb137b640 1 -- 172.21.15.100:0/2324736890 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9695bbca0 con 0x55e9695bb340 2024-09-18T01:25:32.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.501+0000 7f9fb137b640 1 --2- 172.21.15.100:0/2324736890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695bb340 0x55e9695bb760 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9fa402dda0 tx=0x7f9fa401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.501+0000 7f9e96ffd640 1 -- 172.21.15.100:0/2324736890 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa4045040 con 0x55e9695bb340 2024-09-18T01:25:32.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.501+0000 7f9e96ffd640 1 -- 172.21.15.100:0/2324736890 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa400faf0 con 0x55e9695bb340 2024-09-18T01:25:32.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.501+0000 7f9fb3887800 1 -- 172.21.15.100:0/2324736890 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9695bbf30 con 0x55e9695bb340 2024-09-18T01:25:32.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.501+0000 7f9e96ffd640 1 -- 172.21.15.100:0/2324736890 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa400fdd0 con 0x55e9695bb340 2024-09-18T01:25:32.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.501+0000 7f9fb3887800 1 -- 172.21.15.100:0/2324736890 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9695bea00 con 0x55e9695bb340 2024-09-18T01:25:32.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.502+0000 7f9e96ffd640 1 -- 172.21.15.100:0/2324736890 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9fa402d300 con 0x55e9695bb340 2024-09-18T01:25:32.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.502+0000 7f9e96ffd640 1 --2- 172.21.15.100:0/2324736890 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e88036b40 0x7f9e88039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.502+0000 7f9e96ffd640 1 -- 172.21.15.100:0/2324736890 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9fa4049320 con 0x55e9695bb340 2024-09-18T01:25:32.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.502+0000 7f9fb0b7a640 1 --2- 172.21.15.100:0/2324736890 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e88036b40 0x7f9e88039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.502+0000 7f9fb3887800 1 Processor -- start 2024-09-18T01:25:32.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.503+0000 7f9fb3887800 1 -- start start 2024-09-18T01:25:32.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.503+0000 7f9fb0b7a640 1 --2- 172.21.15.100:0/2324736890 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e88036b40 0x7f9e88039000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55e9694ae6c0 tx=0x7f9f9c005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.503+0000 7f9fb3887800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695c7cb0 0x55e9695c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.503+0000 7f9fb3887800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e969596120 con 0x55e9695c7cb0 2024-09-18T01:25:32.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.503+0000 7f9fb137b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695c7cb0 0x55e9695c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.503+0000 7f9fb137b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695c7cb0 0x55e9695c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38624/0 (socket says 172.21.15.100:38624) 2024-09-18T01:25:32.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.503+0000 7f9fb137b640 1 -- 172.21.15.100:0/2722548743 learned_addr learned my addr 172.21.15.100:0/2722548743 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.503+0000 7f9fb137b640 1 -- 172.21.15.100:0/2722548743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9695c8680 con 0x55e9695c7cb0 2024-09-18T01:25:32.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.503+0000 7f9fb137b640 1 --2- 172.21.15.100:0/2722548743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695c7cb0 0x55e9695c80b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9fa401c8e0 tx=0x7f9fa402fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5425e131b5310b5e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.503+0000 7f9e94ff9640 1 -- 172.21.15.100:0/2722548743 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa403a440 con 0x55e9695c7cb0 2024-09-18T01:25:32.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.503+0000 7f9e94ff9640 1 -- 172.21.15.100:0/2722548743 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa40437a0 con 0x55e9695c7cb0 2024-09-18T01:25:32.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.503+0000 7f9e94ff9640 1 -- 172.21.15.100:0/2722548743 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa4018320 con 0x55e9695c7cb0 2024-09-18T01:25:32.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.504+0000 7f9fb3887800 1 -- 172.21.15.100:0/2722548743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695c7cb0 msgr2=0x55e9695c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.504+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2722548743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695c7cb0 0x55e9695c80b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9fa401c8e0 tx=0x7f9fa402fb50 comp rx=0 tx=0).stop 2024-09-18T01:25:32.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.504+0000 7f9fb3887800 1 -- 172.21.15.100:0/2722548743 shutdown_connections 2024-09-18T01:25:32.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.504+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2722548743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695c7cb0 0x55e9695c80b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.504+0000 7f9fb3887800 1 -- 172.21.15.100:0/2722548743 >> 172.21.15.100:0/2722548743 conn(0x55e9695c4060 msgr2=0x55e9695c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.504+0000 7f9fb3887800 1 -- 172.21.15.100:0/2722548743 shutdown_connections 2024-09-18T01:25:32.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.504+0000 7f9fb3887800 1 -- 172.21.15.100:0/2722548743 wait complete. 2024-09-18T01:25:32.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.504+0000 7f9fb3887800 1 Processor -- start 2024-09-18T01:25:32.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.504+0000 7f9fb3887800 1 -- start start 2024-09-18T01:25:32.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.504+0000 7f9fb3887800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695c7cb0 0x55e9695ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.504+0000 7f9fb3887800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e9695c8680 con 0x55e9695c7cb0 2024-09-18T01:25:32.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.505+0000 7f9fb137b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695c7cb0 0x55e9695ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.505+0000 7f9fb137b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695c7cb0 0x55e9695ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38632/0 (socket says 172.21.15.100:38632) 2024-09-18T01:25:32.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.505+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 learned_addr learned my addr 172.21.15.100:0/2624602638 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.505+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9695cf2c0 con 0x55e9695c7cb0 2024-09-18T01:25:32.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.505+0000 7f9fb137b640 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695c7cb0 0x55e9695ced80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4025ff0 tx=0x7f9fa404fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.505+0000 7f9e86ffd640 1 -- 172.21.15.100:0/2624602638 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa4069020 con 0x55e9695c7cb0 2024-09-18T01:25:32.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.505+0000 7f9e86ffd640 1 -- 172.21.15.100:0/2624602638 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa404e610 con 0x55e9695c7cb0 2024-09-18T01:25:32.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.505+0000 7f9e86ffd640 1 -- 172.21.15.100:0/2624602638 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa4018320 con 0x55e9695c7cb0 2024-09-18T01:25:32.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.505+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9695cf2c0 con 0x55e9695c7cb0 2024-09-18T01:25:32.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.505+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9695cf760 con 0x55e9695c7cb0 2024-09-18T01:25:32.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.506+0000 7f9e86ffd640 1 -- 172.21.15.100:0/2624602638 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9fa406c020 con 0x55e9695c7cb0 2024-09-18T01:25:32.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.506+0000 7f9e86ffd640 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e7c036b90 0x7f9e7c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.506+0000 7f9e86ffd640 1 -- 172.21.15.100:0/2624602638 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9fa405f030 con 0x55e9695c7cb0 2024-09-18T01:25:32.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.506+0000 7f9fb0b7a640 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e7c036b90 0x7f9e7c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.507+0000 7f9fb3887800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.507+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e9695da3b0 0x55e9695dc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.507+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695dcfc0 con 0x55e9695da3b0 2024-09-18T01:25:32.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.507+0000 7f9fb1b7c640 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e9695da3b0 0x55e9695dc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.507+0000 7f9fb0b7a640 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e7c036b90 0x7f9e7c039050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c057040 tx=0x7f9f9c051000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.507+0000 7f9fb1b7c640 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e9695da3b0 0x55e9695dc870 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.507+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fac0083e0 con 0x55e9695da3b0 2024-09-18T01:25:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.507+0000 7f9fb3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.507+0000 7f9fb3887800 20 realm 2024-09-18T01:25:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.507+0000 7f9fb3887800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.507+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695dd3f0 con 0x55e9695da3b0 2024-09-18T01:25:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.507+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fac0083e0 con 0x55e9695da3b0 2024-09-18T01:25:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb3887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb3887800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695da3b0 2024-09-18T01:25:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fac0083e0 con 0x55e9695da3b0 2024-09-18T01:25:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb3887800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695de060 con 0x55e9695da3b0 2024-09-18T01:25:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9fac0083e0 con 0x55e9695da3b0 2024-09-18T01:25:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb3887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb3887800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e9695dea20 0x55e9695e0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e1350 con 0x55e9695dea20 2024-09-18T01:25:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb137b640 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e9695dea20 0x55e9695e0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.508+0000 7f9fb137b640 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e9695dea20 0x55e9695e0e10 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.509+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9fa4062070 con 0x55e9695dea20 2024-09-18T01:25:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.509+0000 7f9fb3887800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.509+0000 7f9fb3887800 20 searching for the correct realm 2024-09-18T01:25:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.509+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e9695e33b0 0x55e9695e5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.509+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e5f40 con 0x55e9695e33b0 2024-09-18T01:25:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.509+0000 7f9fb0b7a640 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e9695e33b0 0x55e9695e5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.509+0000 7f9fb0b7a640 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e9695e33b0 0x55e9695e5870 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.509+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f9c081070 con 0x55e9695e33b0 2024-09-18T01:25:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.509+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e5f40 con 0x55e9695dea20 2024-09-18T01:25:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.510+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa4062070 con 0x55e9695dea20 2024-09-18T01:25:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.510+0000 7f9fb137b640 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9fa406e020 0x7f9fa4065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.510+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e5f40 con 0x7f9fa406e020 2024-09-18T01:25:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.510+0000 7f9fb1b7c640 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9fa406e020 0x7f9fa4065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.510+0000 7f9fb1b7c640 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9fa406e020 0x7f9fa4065870 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.511+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9fac0083e0 con 0x7f9fa406e020 2024-09-18T01:25:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.511+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695da3b0 2024-09-18T01:25:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.511+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac0083e0 con 0x55e9695da3b0 2024-09-18T01:25:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.511+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695da3b0 2024-09-18T01:25:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.511+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.511+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x7f9fa406e020 2024-09-18T01:25:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.511+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.511+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x7f9fa406e020 2024-09-18T01:25:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.511+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.511+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695dea20 2024-09-18T01:25:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.512+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa4062070 con 0x55e9695dea20 2024-09-18T01:25:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.512+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695e33b0 2024-09-18T01:25:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.512+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f9c081070 con 0x55e9695e33b0 2024-09-18T01:25:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.512+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695da3b0 2024-09-18T01:25:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.512+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.512+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x7f9fa406e020 2024-09-18T01:25:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.513+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.513+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695da3b0 2024-09-18T01:25:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.513+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.513+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695dea20 2024-09-18T01:25:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.513+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9fa4062070 con 0x55e9695dea20 2024-09-18T01:25:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.513+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695e33b0 2024-09-18T01:25:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.513+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f9c081070 con 0x55e9695e33b0 2024-09-18T01:25:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.513+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695e33b0 2024-09-18T01:25:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.513+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f9c081070 con 0x55e9695e33b0 2024-09-18T01:25:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.513+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x7f9fa406e020 2024-09-18T01:25:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.514+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.514+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695e33b0 2024-09-18T01:25:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.514+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f9c081070 con 0x55e9695e33b0 2024-09-18T01:25:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.514+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695e33b0 2024-09-18T01:25:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.514+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f9c081070 con 0x55e9695e33b0 2024-09-18T01:25:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.514+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695da3b0 2024-09-18T01:25:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.514+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.514+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695da3b0 2024-09-18T01:25:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.515+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.515+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x7f9fa406e020 2024-09-18T01:25:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.515+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.515+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695e33b0 2024-09-18T01:25:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.515+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f9c081070 con 0x55e9695e33b0 2024-09-18T01:25:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.515+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695dea20 2024-09-18T01:25:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.515+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa4062070 con 0x55e9695dea20 2024-09-18T01:25:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.515+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695da3b0 2024-09-18T01:25:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.516+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.516+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x7f9fa406e020 2024-09-18T01:25:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.516+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.516+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695e33b0 2024-09-18T01:25:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.516+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f9c081070 con 0x55e9695e33b0 2024-09-18T01:25:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.516+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x7f9fa406e020 2024-09-18T01:25:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.516+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.516+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695dea20 2024-09-18T01:25:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.517+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa4062070 con 0x55e9695dea20 2024-09-18T01:25:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.517+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695e33b0 2024-09-18T01:25:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.517+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f9c081070 con 0x55e9695e33b0 2024-09-18T01:25:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.517+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x7f9fa406e020 2024-09-18T01:25:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.517+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.517+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695da3b0 2024-09-18T01:25:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.517+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.517+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ddcc0 con 0x55e9695dea20 2024-09-18T01:25:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9fa4062070 con 0x55e9695dea20 2024-09-18T01:25:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e1cb0 con 0x55e9695da3b0 2024-09-18T01:25:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e20a0 con 0x55e9695da3b0 2024-09-18T01:25:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e20a0 con 0x7f9fa406e020 2024-09-18T01:25:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 zone default found 2024-09-18T01:25:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 4 Realm: () 2024-09-18T01:25:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 zonegroup default 2024-09-18T01:25:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.518+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e24c0 con 0x7f9fa406e020 2024-09-18T01:25:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.519+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.519+0000 7f9fb3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.519+0000 7f9fb3887800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.519+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e24c0 con 0x55e9695e33b0 2024-09-18T01:25:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.519+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f9c081070 con 0x55e9695e33b0 2024-09-18T01:25:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.519+0000 7f9fb3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.519+0000 7f9fb3887800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.519+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e7da0 con 0x55e9695e33b0 2024-09-18T01:25:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.519+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f9c081070 con 0x55e9695e33b0 2024-09-18T01:25:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.519+0000 7f9fb3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.519+0000 7f9fb3887800 20 started sync module instance, tier type = 2024-09-18T01:25:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.519+0000 7f9fb3887800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.519+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e7240 con 0x55e9695dea20 2024-09-18T01:25:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.520+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa4062070 con 0x55e9695dea20 2024-09-18T01:25:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.520+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94460983539296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e6ea0 con 0x55e9695dea20 2024-09-18T01:25:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.520+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e8c10 con 0x55e9695da3b0 2024-09-18T01:25:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.521+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94460983539296] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa4062070 con 0x55e9695dea20 2024-09-18T01:25:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.521+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.521+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94460983543648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e9030 con 0x55e9695da3b0 2024-09-18T01:25:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.521+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e99f0 con 0x55e9695e33b0 2024-09-18T01:25:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.522+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f9c081070 con 0x55e9695e33b0 2024-09-18T01:25:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.522+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94460983547200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ea290 con 0x55e9695e33b0 2024-09-18T01:25:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.522+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ead50 con 0x55e9695dea20 2024-09-18T01:25:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.523+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94460983543648] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.523+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94460983547200] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f9c081070 con 0x55e9695e33b0 2024-09-18T01:25:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.523+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa4062070 con 0x55e9695dea20 2024-09-18T01:25:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.523+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94460983552128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695eb170 con 0x55e9695dea20 2024-09-18T01:25:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.523+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695eb9c0 con 0x55e9695da3b0 2024-09-18T01:25:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.524+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.524+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94460983554928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ebe30 con 0x55e9695da3b0 2024-09-18T01:25:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.524+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ec950 con 0x7f9fa406e020 2024-09-18T01:25:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.524+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94460983552128] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa4062070 con 0x55e9695dea20 2024-09-18T01:25:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.525+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.525+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94460983559200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ec910 con 0x7f9fa406e020 2024-09-18T01:25:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.525+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ec910 con 0x7f9fa406e020 2024-09-18T01:25:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.525+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94460983554928] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.526+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94460983559200] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.526+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.526+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94460983544704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695eceb0 con 0x7f9fa406e020 2024-09-18T01:25:32.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.526+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ed870 con 0x7f9fa406e020 2024-09-18T01:25:32.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.528+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94460983544704] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.528+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.528+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94460983556176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ed870 con 0x7f9fa406e020 2024-09-18T01:25:32.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.528+0000 7f9fb3887800 20 add_watcher() i=0 2024-09-18T01:25:32.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.528+0000 7f9fb3887800 20 add_watcher() i=1 2024-09-18T01:25:32.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.528+0000 7f9fb3887800 20 add_watcher() i=2 2024-09-18T01:25:32.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.528+0000 7f9fb3887800 20 add_watcher() i=3 2024-09-18T01:25:32.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.528+0000 7f9fb3887800 20 add_watcher() i=4 2024-09-18T01:25:32.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.528+0000 7f9fb3887800 20 add_watcher() i=5 2024-09-18T01:25:32.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.528+0000 7f9fb3887800 20 add_watcher() i=6 2024-09-18T01:25:32.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.528+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94460983556176] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.528+0000 7f9fb3887800 20 add_watcher() i=7 2024-09-18T01:25:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.528+0000 7f9fb3887800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.529+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e9695f0b90 con 0x55e9695da3b0 2024-09-18T01:25:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.529+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.529+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94460983563568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ede00 con 0x55e9695da3b0 2024-09-18T01:25:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.530+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94460983563568] v33'136 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.530+0000 7f9e677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.530+0000 7f9fb3887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.530+0000 7f9fb3887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.530+0000 7f9fb3887800 5 note: GC not initialized 2024-09-18T01:25:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.530+0000 7f9e667e4640 20 reqs_thread_entry: start 2024-09-18T01:25:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.530+0000 7f9fb3887800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.530+0000 7f9fb3887800 20 Filter name: none 2024-09-18T01:25:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.531+0000 7f9dd7fff640 20 reqs_thread_entry: start 2024-09-18T01:25:32.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.531+0000 7f9fb3887800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.531+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e969623ac0 con 0x55e9695da3b0 2024-09-18T01:25:32.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.531+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.531+0000 7f9fb3887800 20 rados_obj.operate() r=0 bl.length=193 2024-09-18T01:25:32.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.532+0000 7f9e677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:32.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.532+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94460983563568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e969621940 con 0x55e9695da3b0 2024-09-18T01:25:32.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.533+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94460983563568] v33'137 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.533+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94460983539296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e969621940 con 0x55e9695dea20 2024-09-18T01:25:32.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.534+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94460983539296] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa4062070 con 0x55e9695dea20 2024-09-18T01:25:32.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.534+0000 7f9fb3887800 20 remove_watcher() i=0 2024-09-18T01:25:32.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.534+0000 7f9fb3887800 2 removed watcher, disabling cache 2024-09-18T01:25:32.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.534+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94460983543648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e969621940 con 0x55e9695da3b0 2024-09-18T01:25:32.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.535+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94460983543648] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.535+0000 7f9fb3887800 20 remove_watcher() i=1 2024-09-18T01:25:32.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.535+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94460983547200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e969621940 con 0x55e9695e33b0 2024-09-18T01:25:32.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.536+0000 7f9fb0b7a640 1 -- 172.21.15.100:0/2624602638 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94460983547200] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f9c081070 con 0x55e9695e33b0 2024-09-18T01:25:32.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.536+0000 7f9fb3887800 20 remove_watcher() i=2 2024-09-18T01:25:32.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.536+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94460983552128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e7660 con 0x55e9695dea20 2024-09-18T01:25:32.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.537+0000 7f9fb137b640 1 -- 172.21.15.100:0/2624602638 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94460983552128] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa4062070 con 0x55e9695dea20 2024-09-18T01:25:32.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.537+0000 7f9fb3887800 20 remove_watcher() i=3 2024-09-18T01:25:32.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.537+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94460983554928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e8760 con 0x55e9695da3b0 2024-09-18T01:25:32.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.538+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94460983554928] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x55e9695da3b0 2024-09-18T01:25:32.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.538+0000 7f9fb3887800 20 remove_watcher() i=4 2024-09-18T01:25:32.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.538+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94460983559200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695ea880 con 0x7f9fa406e020 2024-09-18T01:25:32.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.539+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94460983559200] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.539+0000 7f9fb3887800 20 remove_watcher() i=5 2024-09-18T01:25:32.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.539+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94460983544704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695e7660 con 0x7f9fa406e020 2024-09-18T01:25:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.540+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94460983544704] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.540+0000 7f9fb3887800 20 remove_watcher() i=6 2024-09-18T01:25:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.540+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94460983556176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e9695eb370 con 0x7f9fa406e020 2024-09-18T01:25:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94460983556176] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac027040 con 0x7f9fa406e020 2024-09-18T01:25:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 20 remove_watcher() i=7 2024-09-18T01:25:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9fa406e020 msgr2=0x7f9fa4065870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9fa406e020 0x7f9fa4065870 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e9695da3b0 msgr2=0x55e9695dc870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e9695da3b0 0x55e9695dc870 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e9695dea20 msgr2=0x55e9695e0e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e9695dea20 0x55e9695e0e10 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e9695e33b0 msgr2=0x55e9695e5870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e9695e33b0 0x55e9695e5870 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e7c036b90 msgr2=0x7f9e7c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e7c036b90 0x7f9e7c039050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c057040 tx=0x7f9f9c051000 comp rx=0 tx=0).stop 2024-09-18T01:25:32.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695c7cb0 msgr2=0x55e9695ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2624602638 reap_dead start 2024-09-18T01:25:32.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695c7cb0 0x55e9695ced80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4025ff0 tx=0x7f9fa404fab0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 shutdown_connections 2024-09-18T01:25:32.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2624602638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695c7cb0 0x55e9695ced80 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 >> 172.21.15.100:0/2624602638 conn(0x55e9695c4060 msgr2=0x55e9695c2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 shutdown_connections 2024-09-18T01:25:32.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.541+0000 7f9fb3887800 1 -- 172.21.15.100:0/2624602638 wait complete. 2024-09-18T01:25:32.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2324736890 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e88036b40 msgr2=0x7f9e88039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2324736890 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e88036b40 0x7f9e88039000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55e9694ae6c0 tx=0x7f9f9c005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:32.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2324736890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695bb340 msgr2=0x55e9695bb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2324736890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695bb340 0x55e9695bb760 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9fa402dda0 tx=0x7f9fa401c730 comp rx=0 tx=0).stop 2024-09-18T01:25:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2324736890 shutdown_connections 2024-09-18T01:25:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2324736890 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e88036b40 0x7f9e88039000 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2324736890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9695bb340 0x55e9695bb760 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2324736890 >> 172.21.15.100:0/2324736890 conn(0x55e9695b02d0 msgr2=0x55e9695b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2324736890 shutdown_connections 2024-09-18T01:25:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2324736890 wait complete. 2024-09-18T01:25:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e9695aab40 msgr2=0x55e9695acf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e9695aab40 0x55e9695acf30 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e9694aacf0 msgr2=0x55e9695a4380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e9694aacf0 0x55e9695a4380 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e9695a6a90 msgr2=0x55e9695a8f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e9695a6a90 0x55e9695a8f50 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e98036b90 msgr2=0x7f9e98039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9e98036b90 0x7f9e98039050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55e969417df0 tx=0x7f9f9c050000 comp rx=0 tx=0).stop 2024-09-18T01:25:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694186b0 msgr2=0x55e96959d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 --2- 172.21.15.100:0/2821685283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9694186b0 0x55e96959d3e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4014040 tx=0x7f9fa4001250 comp rx=0 tx=0).stop 2024-09-18T01:25:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb1b7c640 1 -- 172.21.15.100:0/2821685283 reap_dead start 2024-09-18T01:25:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 shutdown_connections 2024-09-18T01:25:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 >> 172.21.15.100:0/2821685283 conn(0x55e96949ede0 msgr2=0x55e96958fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 shutdown_connections 2024-09-18T01:25:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.542+0000 7f9fb3887800 1 -- 172.21.15.100:0/2821685283 wait complete. 2024-09-18T01:25:32.554 INFO:teuthology.orchestra.run.smithi100.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"Pl0cJmVrZFCuCQXbnygmcdjJ","ver":2},"mtime":"2024-09-18T01:25:32.404906Z","data":{"bucket":{"name":"myfoo","marker":"153b7754-209b-4898-8796-577da7c1273d.4237.1","bucket_id":"153b7754-209b-4898-8796-577da7c1273d.4237.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-18T01:25:29.863166Z","linked":true,"has_bucket_info":false}} 2024-09-18T01:25:32.554 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'Pl0cJmVrZFCuCQXbnygmcdjJ', 'ver': 2}, 'mtime': '2024-09-18T01:25:32.404906Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '153b7754-209b-4898-8796-577da7c1273d.4237.1', 'bucket_id': '153b7754-209b-4898-8796-577da7c1273d.4237.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-18T01:25:29.863166Z', 'linked': True, 'has_bucket_info': False}} 2024-09-18T01:25:32.554 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-18T01:25:32.554 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-18T01:25:32.555 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-18T01:25:32.639 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:32.640 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:32.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.639+0000 7f9290610800 1 Processor -- start 2024-09-18T01:25:32.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.639+0000 7f9290610800 1 -- start start 2024-09-18T01:25:32.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.639+0000 7f9290610800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x557b6f1c7650 0x557b6f2561e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.640+0000 7f9290610800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b6f112b30 con 0x557b6f256720 2024-09-18T01:25:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.640+0000 7f9290610800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x557b6f0f4360 con 0x557b6f1c7650 2024-09-18T01:25:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.640+0000 7f928bdcd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x557b6f1c7650 0x557b6f2561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.640+0000 7f928b5cc640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x557b6f256720 0x557b6f258b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37428/0 (socket says 172.21.15.100:37428) 2024-09-18T01:25:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.640+0000 7f928bdcd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x557b6f1c7650 0x557b6f2561e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38642/0 (socket says 172.21.15.100:38642) 2024-09-18T01:25:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.640+0000 7f928b5cc640 1 -- 172.21.15.100:0/2142341791 learned_addr learned my addr 172.21.15.100:0/2142341791 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.640+0000 7f928bdcd640 1 -- 172.21.15.100:0/2142341791 >> v1:172.21.15.92:6789/0 conn(0x557b6f256720 legacy=0x557b6f258b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.640+0000 7f928bdcd640 1 -- 172.21.15.100:0/2142341791 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b6f11ae00 con 0x557b6f1c7650 2024-09-18T01:25:32.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.642+0000 7f928bdcd640 1 --2- 172.21.15.100:0/2142341791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 0x557b6f2561e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f927c00a470 tx=0x7f927c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223d22a9ae6967ea server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.642+0000 7f928adcb640 1 -- 172.21.15.100:0/2142341791 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c053570 con 0x557b6f1c7650 2024-09-18T01:25:32.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.642+0000 7f928adcb640 1 -- 172.21.15.100:0/2142341791 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f927c058070 con 0x557b6f1c7650 2024-09-18T01:25:32.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.642+0000 7f928adcb640 1 -- 172.21.15.100:0/2142341791 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c053880 con 0x557b6f1c7650 2024-09-18T01:25:32.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.643+0000 7f9290610800 1 -- 172.21.15.100:0/2142341791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 msgr2=0x557b6f2561e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.643+0000 7f9290610800 1 --2- 172.21.15.100:0/2142341791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 0x557b6f2561e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f927c00a470 tx=0x7f927c045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:32.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.643+0000 7f9290610800 1 -- 172.21.15.100:0/2142341791 shutdown_connections 2024-09-18T01:25:32.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.643+0000 7f9290610800 1 --2- 172.21.15.100:0/2142341791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 0x557b6f2561e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.643+0000 7f9290610800 1 -- 172.21.15.100:0/2142341791 >> 172.21.15.100:0/2142341791 conn(0x557b6f24ddb0 msgr2=0x557b6f2501d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.643+0000 7f9290610800 1 -- 172.21.15.100:0/2142341791 shutdown_connections 2024-09-18T01:25:32.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.643+0000 7f9290610800 1 -- 172.21.15.100:0/2142341791 wait complete. 2024-09-18T01:25:32.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.656+0000 7f9290610800 1 Processor -- start 2024-09-18T01:25:32.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.656+0000 7f9290610800 1 -- start start 2024-09-18T01:25:32.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.656+0000 7f9290610800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 0x557b6f342880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.656+0000 7f9290610800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557b6f19f360 con 0x557b6f1c7650 2024-09-18T01:25:32.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.657+0000 7f928bdcd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 0x557b6f342880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.657+0000 7f928bdcd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 0x557b6f342880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38650/0 (socket says 172.21.15.100:38650) 2024-09-18T01:25:32.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.657+0000 7f928bdcd640 1 -- 172.21.15.100:0/4190175004 learned_addr learned my addr 172.21.15.100:0/4190175004 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.657+0000 7f928bdcd640 1 -- 172.21.15.100:0/4190175004 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b6f0ecbc0 con 0x557b6f1c7650 2024-09-18T01:25:32.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.657+0000 7f928bdcd640 1 --2- 172.21.15.100:0/4190175004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 0x557b6f342880 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f927c025c20 tx=0x7f927c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb39d917590945 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.657+0000 7f9179e0b640 1 -- 172.21.15.100:0/4190175004 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c05c580 con 0x557b6f1c7650 2024-09-18T01:25:32.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.657+0000 7f9179e0b640 1 -- 172.21.15.100:0/4190175004 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f927c063030 con 0x557b6f1c7650 2024-09-18T01:25:32.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.657+0000 7f9179e0b640 1 -- 172.21.15.100:0/4190175004 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c05c850 con 0x557b6f1c7650 2024-09-18T01:25:32.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.658+0000 7f9290610800 1 -- 172.21.15.100:0/4190175004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 msgr2=0x557b6f342880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.658+0000 7f9290610800 1 --2- 172.21.15.100:0/4190175004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 0x557b6f342880 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f927c025c20 tx=0x7f927c051000 comp rx=0 tx=0).stop 2024-09-18T01:25:32.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.658+0000 7f9290610800 1 -- 172.21.15.100:0/4190175004 shutdown_connections 2024-09-18T01:25:32.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.658+0000 7f9290610800 1 --2- 172.21.15.100:0/4190175004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 0x557b6f342880 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.658+0000 7f9290610800 1 -- 172.21.15.100:0/4190175004 >> 172.21.15.100:0/4190175004 conn(0x557b6f24ddb0 msgr2=0x557b6f33e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.658+0000 7f9290610800 1 -- 172.21.15.100:0/4190175004 shutdown_connections 2024-09-18T01:25:32.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.658+0000 7f9290610800 1 -- 172.21.15.100:0/4190175004 wait complete. 2024-09-18T01:25:32.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.658+0000 7f9290610800 1 Processor -- start 2024-09-18T01:25:32.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.659+0000 7f9290610800 1 -- start start 2024-09-18T01:25:32.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.659+0000 7f9290610800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 0x557b6f34a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.659+0000 7f9290610800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557b6f25a620 con 0x557b6f1c7650 2024-09-18T01:25:32.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.659+0000 7f928bdcd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 0x557b6f34a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.659+0000 7f928bdcd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 0x557b6f34a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38666/0 (socket says 172.21.15.100:38666) 2024-09-18T01:25:32.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.659+0000 7f928bdcd640 1 -- 172.21.15.100:0/3997131699 learned_addr learned my addr 172.21.15.100:0/3997131699 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.659+0000 7f928bdcd640 1 -- 172.21.15.100:0/3997131699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b6f100fe0 con 0x557b6f1c7650 2024-09-18T01:25:32.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.659+0000 7f928bdcd640 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 0x557b6f34a200 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x557b6f3436e0 tx=0x7f927c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.659+0000 7f9173fff640 1 -- 172.21.15.100:0/3997131699 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c054ad0 con 0x557b6f1c7650 2024-09-18T01:25:32.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.659+0000 7f9173fff640 1 -- 172.21.15.100:0/3997131699 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f927c054c70 con 0x557b6f1c7650 2024-09-18T01:25:32.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.659+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b6f34a740 con 0x557b6f1c7650 2024-09-18T01:25:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.659+0000 7f9173fff640 1 -- 172.21.15.100:0/3997131699 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c068420 con 0x557b6f1c7650 2024-09-18T01:25:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.660+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b6f34ac60 con 0x557b6f1c7650 2024-09-18T01:25:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.660+0000 7f9173fff640 1 -- 172.21.15.100:0/3997131699 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f927c0685c0 con 0x557b6f1c7650 2024-09-18T01:25:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.660+0000 7f9173fff640 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9174036b90 0x7f9174039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.660+0000 7f9173fff640 1 -- 172.21.15.100:0/3997131699 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f927c070030 con 0x557b6f1c7650 2024-09-18T01:25:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.661+0000 7f928b5cc640 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9174036b90 0x7f9174039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.661+0000 7f9290610800 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557b6f256720 0x557b6f351270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.661+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3517b0 con 0x557b6f256720 2024-09-18T01:25:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.661+0000 7f928c5ce640 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557b6f256720 0x557b6f351270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.661+0000 7f928b5cc640 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9174036b90 0x7f9174039050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9280000f60 tx=0x7f92800012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.661+0000 7f928c5ce640 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557b6f256720 0x557b6f351270 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.661+0000 7f928c5ce640 1 -- 172.21.15.100:0/3997131699 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f256720 2024-09-18T01:25:32.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.661+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f34e840 con 0x557b6f256720 2024-09-18T01:25:32.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.662+0000 7f928c5ce640 1 -- 172.21.15.100:0/3997131699 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f256720 2024-09-18T01:25:32.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.662+0000 7f9290610800 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557b6f353b00 0x557b6f355ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.662+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3565e0 con 0x557b6f353b00 2024-09-18T01:25:32.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.662+0000 7f928bdcd640 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557b6f353b00 0x557b6f355ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.662+0000 7f928bdcd640 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557b6f353b00 0x557b6f355ef0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.662+0000 7f928bdcd640 1 -- 172.21.15.100:0/3997131699 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f927c051070 con 0x557b6f353b00 2024-09-18T01:25:32.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.662+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3529a0 con 0x557b6f256720 2024-09-18T01:25:32.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.663+0000 7f928c5ce640 1 -- 172.21.15.100:0/3997131699 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f256720 2024-09-18T01:25:32.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.663+0000 7f9290610800 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x557b6f357a40 0x557b6f359e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.663+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f35a4f0 con 0x557b6f357a40 2024-09-18T01:25:32.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.663+0000 7f928b5cc640 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x557b6f357a40 0x557b6f359e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.663+0000 7f928b5cc640 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x557b6f357a40 0x557b6f359e30 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.664+0000 7f928b5cc640 1 -- 172.21.15.100:0/3997131699 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9280009050 con 0x557b6f357a40 2024-09-18T01:25:32.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.664+0000 7f9290610800 1 Processor -- start 2024-09-18T01:25:32.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.664+0000 7f9290610800 1 -- start start 2024-09-18T01:25:32.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.664+0000 7f9290610800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f3682a0 0x557b6f3686c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.664+0000 7f9290610800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557b6f0ee580 con 0x557b6f3682a0 2024-09-18T01:25:32.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.664+0000 7f928bdcd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f3682a0 0x557b6f3686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.664+0000 7f928bdcd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f3682a0 0x557b6f3686c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38678/0 (socket says 172.21.15.100:38678) 2024-09-18T01:25:32.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.664+0000 7f928bdcd640 1 -- 172.21.15.100:0/2028933416 learned_addr learned my addr 172.21.15.100:0/2028933416 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.665+0000 7f928bdcd640 1 -- 172.21.15.100:0/2028933416 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b6f368c00 con 0x557b6f3682a0 2024-09-18T01:25:32.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.665+0000 7f928bdcd640 1 --2- 172.21.15.100:0/2028933416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f3682a0 0x557b6f3686c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f927c025c20 tx=0x7f927c05cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.665+0000 7f91717fa640 1 -- 172.21.15.100:0/2028933416 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c082270 con 0x557b6f3682a0 2024-09-18T01:25:32.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.665+0000 7f91717fa640 1 -- 172.21.15.100:0/2028933416 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f927c05e600 con 0x557b6f3682a0 2024-09-18T01:25:32.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.665+0000 7f91717fa640 1 -- 172.21.15.100:0/2028933416 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c05e920 con 0x557b6f3682a0 2024-09-18T01:25:32.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.665+0000 7f9290610800 1 -- 172.21.15.100:0/2028933416 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b6f368e90 con 0x557b6f3682a0 2024-09-18T01:25:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.665+0000 7f9290610800 1 -- 172.21.15.100:0/2028933416 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b6f36bb70 con 0x557b6f3682a0 2024-09-18T01:25:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.666+0000 7f91717fa640 1 -- 172.21.15.100:0/2028933416 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f927c07db00 con 0x557b6f3682a0 2024-09-18T01:25:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.666+0000 7f91717fa640 1 --2- 172.21.15.100:0/2028933416 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9164036ed0 0x7f9164039390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.666+0000 7f91717fa640 1 -- 172.21.15.100:0/2028933416 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f927c099c50 con 0x557b6f3682a0 2024-09-18T01:25:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.666+0000 7f928b5cc640 1 --2- 172.21.15.100:0/2028933416 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9164036ed0 0x7f9164039390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.666+0000 7f9290610800 1 Processor -- start 2024-09-18T01:25:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.666+0000 7f9290610800 1 -- start start 2024-09-18T01:25:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.666+0000 7f928b5cc640 1 --2- 172.21.15.100:0/2028933416 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9164036ed0 0x7f9164039390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f928000bf50 tx=0x7f928000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.666+0000 7f9290610800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f253410 0x557b6f253810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.666+0000 7f9290610800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557b6f342fd0 con 0x557b6f253410 2024-09-18T01:25:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.666+0000 7f928bdcd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f253410 0x557b6f253810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.667+0000 7f928bdcd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f253410 0x557b6f253810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38682/0 (socket says 172.21.15.100:38682) 2024-09-18T01:25:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.667+0000 7f928bdcd640 1 -- 172.21.15.100:0/4174809011 learned_addr learned my addr 172.21.15.100:0/4174809011 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.667+0000 7f928bdcd640 1 -- 172.21.15.100:0/4174809011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b6f253de0 con 0x557b6f253410 2024-09-18T01:25:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.667+0000 7f928bdcd640 1 --2- 172.21.15.100:0/4174809011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f253410 0x557b6f253810 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f927c082f00 tx=0x7f927c05a800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6d62df3b38bc02 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.667+0000 7f916affd640 1 -- 172.21.15.100:0/4174809011 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c09d040 con 0x557b6f253410 2024-09-18T01:25:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.667+0000 7f916affd640 1 -- 172.21.15.100:0/4174809011 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f927c068bf0 con 0x557b6f253410 2024-09-18T01:25:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.667+0000 7f916affd640 1 -- 172.21.15.100:0/4174809011 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c090250 con 0x557b6f253410 2024-09-18T01:25:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.667+0000 7f9290610800 1 -- 172.21.15.100:0/4174809011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f253410 msgr2=0x557b6f253810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.667+0000 7f9290610800 1 --2- 172.21.15.100:0/4174809011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f253410 0x557b6f253810 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f927c082f00 tx=0x7f927c05a800 comp rx=0 tx=0).stop 2024-09-18T01:25:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.667+0000 7f9290610800 1 -- 172.21.15.100:0/4174809011 shutdown_connections 2024-09-18T01:25:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.667+0000 7f9290610800 1 --2- 172.21.15.100:0/4174809011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f253410 0x557b6f253810 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.667+0000 7f9290610800 1 -- 172.21.15.100:0/4174809011 >> 172.21.15.100:0/4174809011 conn(0x557b6f371180 msgr2=0x557b6f36f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.668+0000 7f9290610800 1 -- 172.21.15.100:0/4174809011 shutdown_connections 2024-09-18T01:25:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.668+0000 7f9290610800 1 -- 172.21.15.100:0/4174809011 wait complete. 2024-09-18T01:25:32.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.668+0000 7f9290610800 1 Processor -- start 2024-09-18T01:25:32.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.668+0000 7f9290610800 1 -- start start 2024-09-18T01:25:32.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.668+0000 7f9290610800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f253410 0x557b6f37e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.668+0000 7f9290610800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557b6f251fc0 con 0x557b6f253410 2024-09-18T01:25:32.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.668+0000 7f928bdcd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f253410 0x557b6f37e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.668+0000 7f928bdcd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f253410 0x557b6f37e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38688/0 (socket says 172.21.15.100:38688) 2024-09-18T01:25:32.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.668+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 learned_addr learned my addr 172.21.15.100:0/540655826 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.669+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b6f37e7e0 con 0x557b6f253410 2024-09-18T01:25:32.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.669+0000 7f928bdcd640 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f253410 0x557b6f37e2a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f927c000c00 tx=0x7f927c056120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.669+0000 7f91697fa640 1 -- 172.21.15.100:0/540655826 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c09d050 con 0x557b6f253410 2024-09-18T01:25:32.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.669+0000 7f91697fa640 1 -- 172.21.15.100:0/540655826 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f927c0909f0 con 0x557b6f253410 2024-09-18T01:25:32.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.669+0000 7f91697fa640 1 -- 172.21.15.100:0/540655826 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c009770 con 0x557b6f253410 2024-09-18T01:25:32.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.669+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b6f37e7e0 con 0x557b6f253410 2024-09-18T01:25:32.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.669+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b6f37e7e0 con 0x557b6f253410 2024-09-18T01:25:32.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.670+0000 7f91697fa640 1 -- 172.21.15.100:0/540655826 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f927c009910 con 0x557b6f253410 2024-09-18T01:25:32.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.670+0000 7f91697fa640 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9154036b40 0x7f9154039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.670+0000 7f91697fa640 1 -- 172.21.15.100:0/540655826 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f927c0b5070 con 0x557b6f253410 2024-09-18T01:25:32.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.670+0000 7f928b5cc640 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9154036b40 0x7f9154039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.671+0000 7f928b5cc640 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9154036b40 0x7f9154039000 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f928000efd0 tx=0x7f9280010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.671+0000 7f9290610800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.671+0000 7f9290610800 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557b6f3899e0 0x557b6f38bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.671+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38c5f0 con 0x557b6f3899e0 2024-09-18T01:25:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.671+0000 7f928c5ce640 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557b6f3899e0 0x557b6f38bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.671+0000 7f928c5ce640 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557b6f3899e0 0x557b6f38bea0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.672+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.672+0000 7f9290610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.672+0000 7f9290610800 20 realm 2024-09-18T01:25:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.672+0000 7f9290610800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.672+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38ca00 con 0x557b6f3899e0 2024-09-18T01:25:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.672+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.672+0000 7f9290610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.672+0000 7f9290610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.672+0000 7f9290610800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.672+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d2d0 con 0x557b6f3899e0 2024-09-18T01:25:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.672+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.672+0000 7f9290610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.672+0000 7f9290610800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.672+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f3899e0 2024-09-18T01:25:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.673+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.673+0000 7f9290610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.673+0000 7f9290610800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.673+0000 7f9290610800 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557b6f38e3d0 0x557b6f3907c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.673+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f390d80 con 0x557b6f38e3d0 2024-09-18T01:25:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.673+0000 7f928bdcd640 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557b6f38e3d0 0x557b6f3907c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.673+0000 7f928bdcd640 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557b6f38e3d0 0x557b6f3907c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.673+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.673+0000 7f9290610800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.673+0000 7f9290610800 20 searching for the correct realm 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.673+0000 7f9290610800 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x557b6f392d30 0x557b6f3951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.674+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3958c0 con 0x557b6f392d30 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.674+0000 7f928b5cc640 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x557b6f392d30 0x557b6f3951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.674+0000 7f928b5cc640 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x557b6f392d30 0x557b6f3951f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.674+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.674+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3958c0 con 0x557b6f38e3d0 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.674+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.674+0000 7f928bdcd640 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f927c08c040 0x7f927c082580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.674+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3958c0 con 0x7f927c08c040 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.675+0000 7f928c5ce640 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f927c08c040 0x7f927c082580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.675+0000 7f928c5ce640 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f927c08c040 0x7f927c082580 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.675+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.675+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f3899e0 2024-09-18T01:25:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.676+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.676+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f3899e0 2024-09-18T01:25:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.676+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.676+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x7f927c08c040 2024-09-18T01:25:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.676+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.676+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x7f927c08c040 2024-09-18T01:25:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.676+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.676+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f38e3d0 2024-09-18T01:25:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.677+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.677+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f392d30 2024-09-18T01:25:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.677+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.677+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f3899e0 2024-09-18T01:25:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.677+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.677+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x7f927c08c040 2024-09-18T01:25:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.677+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.677+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f3899e0 2024-09-18T01:25:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.677+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.678+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f38e3d0 2024-09-18T01:25:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.678+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.678+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f392d30 2024-09-18T01:25:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.678+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.678+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f392d30 2024-09-18T01:25:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.678+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.678+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x7f927c08c040 2024-09-18T01:25:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.679+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.679+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f392d30 2024-09-18T01:25:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.679+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.679+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f392d30 2024-09-18T01:25:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.679+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.679+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f3899e0 2024-09-18T01:25:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.679+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.679+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f3899e0 2024-09-18T01:25:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.680+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.680+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x7f927c08c040 2024-09-18T01:25:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.680+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.680+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f392d30 2024-09-18T01:25:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.680+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.680+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f38e3d0 2024-09-18T01:25:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.681+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.681+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f3899e0 2024-09-18T01:25:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.681+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.681+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x7f927c08c040 2024-09-18T01:25:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.681+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.681+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f392d30 2024-09-18T01:25:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.681+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.681+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x7f927c08c040 2024-09-18T01:25:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.681+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.681+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f38e3d0 2024-09-18T01:25:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.682+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.682+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f392d30 2024-09-18T01:25:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.682+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.682+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x7f927c08c040 2024-09-18T01:25:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.682+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.682+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f3899e0 2024-09-18T01:25:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.682+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.682+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557b6f38d670 con 0x557b6f38e3d0 2024-09-18T01:25:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f9290610800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f9290610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f9290610800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f9290610800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f9290610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f9290610800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f9290610800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f391640 con 0x557b6f3899e0 2024-09-18T01:25:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f9290610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f9290610800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f391a30 con 0x557b6f3899e0 2024-09-18T01:25:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f9290610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f9290610800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.683+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f391a30 con 0x7f927c08c040 2024-09-18T01:25:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 20 zone default found 2024-09-18T01:25:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 4 Realm: () 2024-09-18T01:25:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 20 zonegroup default 2024-09-18T01:25:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f395d40 con 0x7f927c08c040 2024-09-18T01:25:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f397720 con 0x557b6f392d30 2024-09-18T01:25:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f397ac0 con 0x557b6f392d30 2024-09-18T01:25:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.684+0000 7f9290610800 20 started sync module instance, tier type = 2024-09-18T01:25:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.685+0000 7f9290610800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.685+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f396bc0 con 0x557b6f38e3d0 2024-09-18T01:25:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.685+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.686+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93988635373488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f398310 con 0x557b6f38e3d0 2024-09-18T01:25:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.686+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f398b60 con 0x557b6f3899e0 2024-09-18T01:25:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.687+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93988635373488] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.687+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.687+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93988635377248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f398b60 con 0x557b6f3899e0 2024-09-18T01:25:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.687+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f399200 con 0x557b6f392d30 2024-09-18T01:25:32.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.688+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93988635377248] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.688+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.688+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93988635379376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f399ad0 con 0x557b6f392d30 2024-09-18T01:25:32.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.688+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f39a490 con 0x557b6f38e3d0 2024-09-18T01:25:32.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.689+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.689+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93988635379376] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.689+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93988635386304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f39ac50 con 0x557b6f38e3d0 2024-09-18T01:25:32.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.689+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f399660 con 0x557b6f3899e0 2024-09-18T01:25:32.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.690+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93988635386304] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.690+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.690+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93988635387552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f399660 con 0x557b6f3899e0 2024-09-18T01:25:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.690+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f39bce0 con 0x7f927c08c040 2024-09-18T01:25:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.691+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93988635387552] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.692+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.692+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93988635390480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f39bce0 con 0x7f927c08c040 2024-09-18T01:25:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.692+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f39c6a0 con 0x7f927c08c040 2024-09-18T01:25:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.693+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93988635390480] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.693+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.693+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93988635392528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f39c6a0 con 0x7f927c08c040 2024-09-18T01:25:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.693+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f39d060 con 0x7f927c08c040 2024-09-18T01:25:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.694+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(58 notify.7 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.694+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93988635397040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f39d480 con 0x7f927c08c040 2024-09-18T01:25:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.694+0000 7f9290610800 20 add_watcher() i=0 2024-09-18T01:25:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.694+0000 7f9290610800 20 add_watcher() i=1 2024-09-18T01:25:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.694+0000 7f9290610800 20 add_watcher() i=2 2024-09-18T01:25:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.694+0000 7f9290610800 20 add_watcher() i=3 2024-09-18T01:25:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.694+0000 7f9290610800 20 add_watcher() i=4 2024-09-18T01:25:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.694+0000 7f9290610800 20 add_watcher() i=5 2024-09-18T01:25:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.694+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93988635392528] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.694+0000 7f9290610800 20 add_watcher() i=6 2024-09-18T01:25:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.695+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93988635397040] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.695+0000 7f9290610800 20 add_watcher() i=7 2024-09-18T01:25:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.695+0000 7f9290610800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.695+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f39d480 con 0x557b6f3899e0 2024-09-18T01:25:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.695+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.695+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93988635398096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f39d3f0 con 0x557b6f3899e0 2024-09-18T01:25:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.696+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93988635398096] v33'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.696+0000 7f9141fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.696+0000 7f9290610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.696+0000 7f9290610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.696+0000 7f9290610800 5 note: GC not initialized 2024-09-18T01:25:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.696+0000 7f9140fe1640 20 reqs_thread_entry: start 2024-09-18T01:25:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 20 Filter name: none 2024-09-18T01:25:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f90ba7fc640 20 reqs_thread_entry: start 2024-09-18T01:25:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3d3870 con 0x557b6f3899e0 2024-09-18T01:25:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-18T01:25:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3d5950 con 0x557b6f3899e0 2024-09-18T01:25:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 20 rados_obj.operate() r=0 bl.length=193 2024-09-18T01:25:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-18T01:25:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-18T01:25:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 : miss 2024-09-18T01:25:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.697+0000 7f9290610800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.698+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 8.f 8:f4921ab2:root::.bucket.meta.testx%3amyfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3d71c0 con 0x557b6f392d30 2024-09-18T01:25:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.698+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.698+0000 7f9290610800 20 rados_obj.operate() r=0 bl.length=412 2024-09-18T01:25:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.698+0000 7f9290610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.698+0000 7f9290610800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.698+0000 7f9290610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.698+0000 7f9290610800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-18T01:25:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.698+0000 7f9290610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 2024-09-18T01:25:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.698+0000 7f9290610800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-18T01:25:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.698+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3dbcb0 con 0x557b6f3899e0 2024-09-18T01:25:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.699+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v33'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.699+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:66 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3df5c0 con 0x7f927c08c040 2024-09-18T01:25:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.701+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(66 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [create,call,writefull 0~379,setxattr (123)] v33'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.701+0000 7f9290610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x7 2024-09-18T01:25:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.701+0000 7f9290610800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.701+0000 7f9290610800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.701+0000 7f9290610800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1, ofs0, ns] 2024-09-18T01:25:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.701+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 93988635661056 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3def80 con 0x557b6f3899e0 2024-09-18T01:25:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.701+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== watch-notify(notify (1) cookie 93988635377248 notify 141733920790 ret 0) ==== 770+0+0 (crc 0 0 0) 0x557b6f3df960 con 0x557b6f3899e0 2024-09-18T01:25:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.701+0000 7f916affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920790 cookie 93988635377248 notifier 4566 bl.length()=728 2024-09-18T01:25:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.701+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(67 notify.1 [notify cookie 93988635661056 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.701+0000 7f916affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x7 2024-09-18T01:25:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.701+0000 7f916affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.701+0000 7f916affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.701+0000 7f916affd640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f9150003ea0 con 0x557b6f3899e0 2024-09-18T01:25:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.702+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.702+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== watch-notify(notify_complete (2) cookie 93988635661056 notify 141733920790 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557b6f3db6e0 con 0x557b6f3899e0 2024-09-18T01:25:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.702+0000 7f9290610800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): orig_sources= new_sources= 2024-09-18T01:25:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.702+0000 7f9290610800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): potential sources added=[] removed=[] 2024-09-18T01:25:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.702+0000 7f9290610800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): orig_dests= new_dests= 2024-09-18T01:25:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.702+0000 7f9290610800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): potential dests added=[] removed=[] 2024-09-18T01:25:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.702+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3df060 con 0x557b6f38e3d0 2024-09-18T01:25:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.703+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(69 foo.buckets [call] v33'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.703+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3de4e0 con 0x557b6f38e3d0 2024-09-18T01:25:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.704+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.704+0000 7f9290610800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T01:25:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.704+0000 7f9290610800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.704+0000 7f9290610800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:25:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.704+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93988635665632 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3df260 con 0x7f927c08c040 2024-09-18T01:25:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.704+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== watch-notify(notify (1) cookie 93988635392528 notify 141733920777 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f9284043690 con 0x7f927c08c040 2024-09-18T01:25:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.704+0000 7f916affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920777 cookie 93988635392528 notifier 4566 bl.length()=314 2024-09-18T01:25:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.704+0000 7f916affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T01:25:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.704+0000 7f916affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.704+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(71 notify.6 [notify cookie 93988635665632 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.704+0000 7f916affd640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f9150003ea0 con 0x7f927c08c040 2024-09-18T01:25:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.704+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.704+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== watch-notify(notify_complete (2) cookie 93988635665632 notify 141733920777 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9284043930 con 0x7f927c08c040 2024-09-18T01:25:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.705+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3de4e0 con 0x557b6f3899e0 2024-09-18T01:25:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.705+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(73 testx/myfoo [call,delete] v33'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.705+0000 7f9290610800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-18T01:25:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.705+0000 7f9290610800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-18T01:25:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.706+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 93988635665632 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3df260 con 0x557b6f3899e0 2024-09-18T01:25:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.706+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== watch-notify(notify (1) cookie 93988635387552 notify 141733920791 ret 0) ==== 197+0+0 (crc 0 0 0) 0x7f9284043930 con 0x557b6f3899e0 2024-09-18T01:25:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.706+0000 7f916a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 93988635387552 notifier 4566 bl.length()=155 2024-09-18T01:25:32.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.706+0000 7f916a7fc640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f90c00032c0 con 0x557b6f3899e0 2024-09-18T01:25:32.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.706+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(74 notify.4 [notify cookie 93988635665632 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.706+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== watch-notify(notify_complete (2) cookie 93988635665632 notify 141733920791 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9284043d00 con 0x557b6f3899e0 2024-09-18T01:25:32.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.706+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.706+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:76 8.f 8:f4921ab2:root::.bucket.meta.testx%3amyfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3de4e0 con 0x557b6f392d30 2024-09-18T01:25:32.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.708+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call,delete] v33'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.708+0000 7f9290610800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 from cache 2024-09-18T01:25:32.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.708+0000 7f9290610800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1, ofs0, ns] 2024-09-18T01:25:32.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.708+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93988635637888 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3df060 con 0x557b6f38e3d0 2024-09-18T01:25:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.708+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== watch-notify(notify (1) cookie 93988635373488 notify 141733920782 ret 0) ==== 254+0+0 (crc 0 0 0) 0x557b6f3de310 con 0x557b6f38e3d0 2024-09-18T01:25:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.708+0000 7f916affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920782 cookie 93988635373488 notifier 4566 bl.length()=212 2024-09-18T01:25:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.708+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(77 notify.0 [notify cookie 93988635637888 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.708+0000 7f916affd640 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f9150003ea0 con 0x557b6f38e3d0 2024-09-18T01:25:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.708+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== watch-notify(notify_complete (2) cookie 93988635637888 notify 141733920782 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557b6f368c00 con 0x557b6f38e3d0 2024-09-18T01:25:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.708+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.709+0000 7f9141fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.709+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93988635398096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3d15c0 con 0x557b6f3899e0 2024-09-18T01:25:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.710+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93988635398096] v33'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.710+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93988635373488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3d15c0 con 0x557b6f38e3d0 2024-09-18T01:25:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.711+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93988635373488] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.711+0000 7f9290610800 20 remove_watcher() i=0 2024-09-18T01:25:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.711+0000 7f9290610800 2 removed watcher, disabling cache 2024-09-18T01:25:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.711+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93988635377248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3d15c0 con 0x557b6f3899e0 2024-09-18T01:25:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.713+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 34 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93988635377248] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.713+0000 7f9290610800 20 remove_watcher() i=1 2024-09-18T01:25:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.713+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93988635379376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3d15c0 con 0x557b6f392d30 2024-09-18T01:25:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.714+0000 7f928b5cc640 1 -- 172.21.15.100:0/540655826 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93988635379376] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9280009050 con 0x557b6f392d30 2024-09-18T01:25:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.714+0000 7f9290610800 20 remove_watcher() i=2 2024-09-18T01:25:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.714+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93988635386304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3d15c0 con 0x557b6f38e3d0 2024-09-18T01:25:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.715+0000 7f928bdcd640 1 -- 172.21.15.100:0/540655826 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93988635386304] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927c09f070 con 0x557b6f38e3d0 2024-09-18T01:25:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.715+0000 7f9290610800 20 remove_watcher() i=3 2024-09-18T01:25:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.715+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93988635387552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3d15c0 con 0x557b6f3899e0 2024-09-18T01:25:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.716+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.1 v2:172.21.15.100:6800/170575980 35 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93988635387552] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x557b6f3899e0 2024-09-18T01:25:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.716+0000 7f9290610800 20 remove_watcher() i=4 2024-09-18T01:25:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.716+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93988635390480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3d15c0 con 0x7f927c08c040 2024-09-18T01:25:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.717+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93988635390480] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.717+0000 7f9290610800 20 remove_watcher() i=5 2024-09-18T01:25:32.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.717+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93988635392528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3d15c0 con 0x7f927c08c040 2024-09-18T01:25:32.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.717+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93988635392528] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.718+0000 7f9290610800 20 remove_watcher() i=6 2024-09-18T01:25:32.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.718+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93988635397040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557b6f3d15c0 con 0x7f927c08c040 2024-09-18T01:25:32.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.718+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93988635397040] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928400a4a0 con 0x7f927c08c040 2024-09-18T01:25:32.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.718+0000 7f9290610800 20 remove_watcher() i=7 2024-09-18T01:25:32.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f927c08c040 msgr2=0x7f927c082580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f927c08c040 0x7f927c082580 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557b6f3899e0 msgr2=0x557b6f38bea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557b6f3899e0 0x557b6f38bea0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557b6f38e3d0 msgr2=0x557b6f3907c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557b6f38e3d0 0x557b6f3907c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x557b6f392d30 msgr2=0x557b6f3951f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x557b6f392d30 0x557b6f3951f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9154036b40 msgr2=0x7f9154039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9154036b40 0x7f9154039000 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f928000efd0 tx=0x7f9280010000 comp rx=0 tx=0).stop 2024-09-18T01:25:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f253410 msgr2=0x557b6f37e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 --2- 172.21.15.100:0/540655826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f253410 0x557b6f37e2a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f927c000c00 tx=0x7f927c056120 comp rx=0 tx=0).stop 2024-09-18T01:25:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 reap_dead start 2024-09-18T01:25:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f928c5ce640 1 -- 172.21.15.100:0/540655826 reap_dead start 2024-09-18T01:25:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 shutdown_connections 2024-09-18T01:25:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 >> 172.21.15.100:0/540655826 conn(0x557b6f371180 msgr2=0x557b6f36f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 shutdown_connections 2024-09-18T01:25:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/540655826 wait complete. 2024-09-18T01:25:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/2028933416 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9164036ed0 msgr2=0x7f9164039390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 --2- 172.21.15.100:0/2028933416 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9164036ed0 0x7f9164039390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f928000bf50 tx=0x7f928000f000 comp rx=0 tx=0).stop 2024-09-18T01:25:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/2028933416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f3682a0 msgr2=0x557b6f3686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 --2- 172.21.15.100:0/2028933416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f3682a0 0x557b6f3686c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f927c025c20 tx=0x7f927c05cbc0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/2028933416 shutdown_connections 2024-09-18T01:25:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 --2- 172.21.15.100:0/2028933416 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9164036ed0 0x7f9164039390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 --2- 172.21.15.100:0/2028933416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f3682a0 0x557b6f3686c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/2028933416 >> 172.21.15.100:0/2028933416 conn(0x557b6f35d230 msgr2=0x557b6f35fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/2028933416 shutdown_connections 2024-09-18T01:25:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.719+0000 7f9290610800 1 -- 172.21.15.100:0/2028933416 wait complete. 2024-09-18T01:25:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x557b6f357a40 msgr2=0x557b6f359e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f9290610800 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x557b6f357a40 0x557b6f359e30 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557b6f256720 msgr2=0x557b6f351270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f9290610800 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557b6f256720 0x557b6f351270 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557b6f353b00 msgr2=0x557b6f355ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f9290610800 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557b6f353b00 0x557b6f355ef0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9174036b90 msgr2=0x7f9174039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f9290610800 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9174036b90 0x7f9174039050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9280000f60 tx=0x7f92800012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 msgr2=0x557b6f34a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f9290610800 1 --2- 172.21.15.100:0/3997131699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b6f1c7650 0x557b6f34a200 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x557b6f3436e0 tx=0x7f927c002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f928c5ce640 1 -- 172.21.15.100:0/3997131699 reap_dead start 2024-09-18T01:25:32.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 shutdown_connections 2024-09-18T01:25:32.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 >> 172.21.15.100:0/3997131699 conn(0x557b6f24ddb0 msgr2=0x557b6f33cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 shutdown_connections 2024-09-18T01:25:32.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.720+0000 7f9290610800 1 -- 172.21.15.100:0/3997131699 wait complete. 2024-09-18T01:25:32.729 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-18T01:25:32.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-18T01:25:32.730 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-18T01:25:32.776 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:32.776 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.775+0000 7f83b810c800 1 Processor -- start 2024-09-18T01:25:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.775+0000 7f83b810c800 1 -- start start 2024-09-18T01:25:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.776+0000 7f83b810c800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55cc11f82d60 0x55cc11f85150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.776+0000 7f83b810c800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cc11e3bb30 con 0x55cc11ef05f0 2024-09-18T01:25:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.776+0000 7f83b810c800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55cc11e1d360 con 0x55cc11f82d60 2024-09-18T01:25:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.776+0000 7f83affff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55cc11f82d60 0x55cc11f85150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.776+0000 7f83b5c00640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55cc11ef05f0 0x55cc11f81640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37432/0 (socket says 172.21.15.100:37432) 2024-09-18T01:25:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.776+0000 7f83affff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55cc11f82d60 0x55cc11f85150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38696/0 (socket says 172.21.15.100:38696) 2024-09-18T01:25:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.776+0000 7f83b5c00640 1 -- 172.21.15.100:0/1199212066 learned_addr learned my addr 172.21.15.100:0/1199212066 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.776+0000 7f83affff640 1 -- 172.21.15.100:0/1199212066 >> v1:172.21.15.92:6789/0 conn(0x55cc11ef05f0 legacy=0x55cc11f81640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.776+0000 7f83affff640 1 -- 172.21.15.100:0/1199212066 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc11e43e00 con 0x55cc11f82d60 2024-09-18T01:25:32.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.778+0000 7f83affff640 1 --2- 172.21.15.100:0/1199212066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11f82d60 0x55cc11f85150 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f83a000a470 tx=0x7f83a0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2ea6bff0d2dd32 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.778+0000 7f83b53ff640 1 -- 172.21.15.100:0/1199212066 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a0053570 con 0x55cc11f82d60 2024-09-18T01:25:32.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.778+0000 7f83b53ff640 1 -- 172.21.15.100:0/1199212066 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a0058070 con 0x55cc11f82d60 2024-09-18T01:25:32.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.778+0000 7f83b53ff640 1 -- 172.21.15.100:0/1199212066 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a0053880 con 0x55cc11f82d60 2024-09-18T01:25:32.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.778+0000 7f83b810c800 1 -- 172.21.15.100:0/1199212066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11f82d60 msgr2=0x55cc11f85150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.778+0000 7f83b810c800 1 --2- 172.21.15.100:0/1199212066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11f82d60 0x55cc11f85150 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f83a000a470 tx=0x7f83a0045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:32.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.779+0000 7f83b810c800 1 -- 172.21.15.100:0/1199212066 shutdown_connections 2024-09-18T01:25:32.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.779+0000 7f83b810c800 1 --2- 172.21.15.100:0/1199212066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11f82d60 0x55cc11f85150 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.779+0000 7f83b810c800 1 -- 172.21.15.100:0/1199212066 >> 172.21.15.100:0/1199212066 conn(0x55cc11f76db0 msgr2=0x55cc11f791d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.779+0000 7f83b810c800 1 -- 172.21.15.100:0/1199212066 shutdown_connections 2024-09-18T01:25:32.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.779+0000 7f83b810c800 1 -- 172.21.15.100:0/1199212066 wait complete. 2024-09-18T01:25:32.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.792+0000 7f83b810c800 1 Processor -- start 2024-09-18T01:25:32.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.792+0000 7f83b810c800 1 -- start start 2024-09-18T01:25:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.793+0000 7f83b810c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11ef05f0 0x55cc1206da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.793+0000 7f83b810c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cc11ec8360 con 0x55cc11ef05f0 2024-09-18T01:25:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.793+0000 7f83b5c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11ef05f0 0x55cc1206da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.793+0000 7f83b5c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11ef05f0 0x55cc1206da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38702/0 (socket says 172.21.15.100:38702) 2024-09-18T01:25:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.793+0000 7f83b5c00640 1 -- 172.21.15.100:0/4196286621 learned_addr learned my addr 172.21.15.100:0/4196286621 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.793+0000 7f83b5c00640 1 -- 172.21.15.100:0/4196286621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc11e15bc0 con 0x55cc11ef05f0 2024-09-18T01:25:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.793+0000 7f83b5c00640 1 --2- 172.21.15.100:0/4196286621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11ef05f0 0x55cc1206da80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f83a8001d80 tx=0x7f83a8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3122b8b4fa2b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.793+0000 7f82a3e07640 1 -- 172.21.15.100:0/4196286621 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a8013030 con 0x55cc11ef05f0 2024-09-18T01:25:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.793+0000 7f82a3e07640 1 -- 172.21.15.100:0/4196286621 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a800e470 con 0x55cc11ef05f0 2024-09-18T01:25:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.793+0000 7f82a3e07640 1 -- 172.21.15.100:0/4196286621 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a800e810 con 0x55cc11ef05f0 2024-09-18T01:25:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.794+0000 7f83b810c800 1 -- 172.21.15.100:0/4196286621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11ef05f0 msgr2=0x55cc1206da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.794+0000 7f83b810c800 1 --2- 172.21.15.100:0/4196286621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11ef05f0 0x55cc1206da80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f83a8001d80 tx=0x7f83a8001e70 comp rx=0 tx=0).stop 2024-09-18T01:25:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.794+0000 7f83b810c800 1 -- 172.21.15.100:0/4196286621 shutdown_connections 2024-09-18T01:25:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.794+0000 7f83b810c800 1 --2- 172.21.15.100:0/4196286621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11ef05f0 0x55cc1206da80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.794+0000 7f83b810c800 1 -- 172.21.15.100:0/4196286621 >> 172.21.15.100:0/4196286621 conn(0x55cc11f76db0 msgr2=0x55cc12069440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.794+0000 7f83b810c800 1 -- 172.21.15.100:0/4196286621 shutdown_connections 2024-09-18T01:25:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.794+0000 7f83b810c800 1 -- 172.21.15.100:0/4196286621 wait complete. 2024-09-18T01:25:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.794+0000 7f83b810c800 1 Processor -- start 2024-09-18T01:25:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.795+0000 7f83b810c800 1 -- start start 2024-09-18T01:25:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.795+0000 7f83b810c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11ef05f0 0x55cc12075490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.795+0000 7f83b810c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cc11f85930 con 0x55cc11ef05f0 2024-09-18T01:25:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.795+0000 7f83b5c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11ef05f0 0x55cc12075490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.795+0000 7f83b5c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11ef05f0 0x55cc12075490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38704/0 (socket says 172.21.15.100:38704) 2024-09-18T01:25:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.795+0000 7f83b5c00640 1 -- 172.21.15.100:0/2183123969 learned_addr learned my addr 172.21.15.100:0/2183123969 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.795+0000 7f83b5c00640 1 -- 172.21.15.100:0/2183123969 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc11e29fe0 con 0x55cc11ef05f0 2024-09-18T01:25:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.795+0000 7f83b5c00640 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11ef05f0 0x55cc12075490 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f83a8004000 tx=0x7f83a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.795+0000 7f82a2604640 1 -- 172.21.15.100:0/2183123969 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a8027070 con 0x55cc11ef05f0 2024-09-18T01:25:32.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.795+0000 7f82a2604640 1 -- 172.21.15.100:0/2183123969 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a8001400 con 0x55cc11ef05f0 2024-09-18T01:25:32.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.795+0000 7f82a2604640 1 -- 172.21.15.100:0/2183123969 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a8019a70 con 0x55cc11ef05f0 2024-09-18T01:25:32.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.795+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc120759d0 con 0x55cc11ef05f0 2024-09-18T01:25:32.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.795+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc12075ef0 con 0x55cc11ef05f0 2024-09-18T01:25:32.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.796+0000 7f82a2604640 1 -- 172.21.15.100:0/2183123969 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f83a802a070 con 0x55cc11ef05f0 2024-09-18T01:25:32.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.796+0000 7f82a2604640 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f829c036b90 0x7f829c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.796+0000 7f82a2604640 1 -- 172.21.15.100:0/2183123969 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f83a801f070 con 0x55cc11ef05f0 2024-09-18T01:25:32.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.796+0000 7f83affff640 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f829c036b90 0x7f829c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.797+0000 7f83b810c800 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55cc11f82d60 0x55cc1207c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.797+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc1207ca40 con 0x55cc11f82d60 2024-09-18T01:25:32.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.797+0000 7f83b6401640 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55cc11f82d60 0x55cc1207c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.797+0000 7f83affff640 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f829c036b90 0x7f829c039050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f83a0057000 tx=0x7f83a0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.797+0000 7f83b6401640 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55cc11f82d60 0x55cc1207c500 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.797+0000 7f83b6401640 1 -- 172.21.15.100:0/2183123969 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc11f82d60 2024-09-18T01:25:32.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.797+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc12079ad0 con 0x55cc11f82d60 2024-09-18T01:25:32.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.797+0000 7f83b6401640 1 -- 172.21.15.100:0/2183123969 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc11f82d60 2024-09-18T01:25:32.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.798+0000 7f83b810c800 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55cc1207ed90 0x55cc12081180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.798+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc12081820 con 0x55cc1207ed90 2024-09-18T01:25:32.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.798+0000 7f83b5c00640 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55cc1207ed90 0x55cc12081180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.798+0000 7f83b5c00640 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55cc1207ed90 0x55cc12081180 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.798+0000 7f83b5c00640 1 -- 172.21.15.100:0/2183123969 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f83a8029030 con 0x55cc1207ed90 2024-09-18T01:25:32.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.798+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc1207dc30 con 0x55cc11f82d60 2024-09-18T01:25:32.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.798+0000 7f83b6401640 1 -- 172.21.15.100:0/2183123969 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc11f82d60 2024-09-18T01:25:32.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.798+0000 7f83b810c800 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55cc12082c80 0x55cc12085070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.798+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc12085770 con 0x55cc12082c80 2024-09-18T01:25:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.799+0000 7f83affff640 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55cc12082c80 0x55cc12085070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.799+0000 7f83affff640 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55cc12082c80 0x55cc12085070 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.799+0000 7f83affff640 1 -- 172.21.15.100:0/2183123969 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f83a0051070 con 0x55cc12082c80 2024-09-18T01:25:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.800+0000 7f83b810c800 1 Processor -- start 2024-09-18T01:25:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.800+0000 7f83b810c800 1 -- start start 2024-09-18T01:25:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.800+0000 7f83b810c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc120934e0 0x55cc12093900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.800+0000 7f83b810c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cc11e17580 con 0x55cc120934e0 2024-09-18T01:25:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.800+0000 7f83b5c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc120934e0 0x55cc12093900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.800+0000 7f83b5c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc120934e0 0x55cc12093900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38706/0 (socket says 172.21.15.100:38706) 2024-09-18T01:25:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.800+0000 7f83b5c00640 1 -- 172.21.15.100:0/3171262316 learned_addr learned my addr 172.21.15.100:0/3171262316 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.800+0000 7f83b5c00640 1 -- 172.21.15.100:0/3171262316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc12093e40 con 0x55cc120934e0 2024-09-18T01:25:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.800+0000 7f83b5c00640 1 --2- 172.21.15.100:0/3171262316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc120934e0 0x55cc12093900 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f83a804ad70 tx=0x7f83a80176a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.800+0000 7f829b7fe640 1 -- 172.21.15.100:0/3171262316 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a803a070 con 0x55cc120934e0 2024-09-18T01:25:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.801+0000 7f829b7fe640 1 -- 172.21.15.100:0/3171262316 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a80443a0 con 0x55cc120934e0 2024-09-18T01:25:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.801+0000 7f83b810c800 1 -- 172.21.15.100:0/3171262316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc120940d0 con 0x55cc120934e0 2024-09-18T01:25:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.801+0000 7f829b7fe640 1 -- 172.21.15.100:0/3171262316 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a8044680 con 0x55cc120934e0 2024-09-18T01:25:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.801+0000 7f83b810c800 1 -- 172.21.15.100:0/3171262316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc12096db0 con 0x55cc120934e0 2024-09-18T01:25:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.801+0000 7f829b7fe640 1 -- 172.21.15.100:0/3171262316 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f83a803d070 con 0x55cc120934e0 2024-09-18T01:25:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.801+0000 7f829b7fe640 1 --2- 172.21.15.100:0/3171262316 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8290036b90 0x7f8290039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.801+0000 7f829b7fe640 1 -- 172.21.15.100:0/3171262316 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f83a8014070 con 0x55cc120934e0 2024-09-18T01:25:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.801+0000 7f83affff640 1 --2- 172.21.15.100:0/3171262316 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8290036b90 0x7f8290039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.802+0000 7f83b810c800 1 Processor -- start 2024-09-18T01:25:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.802+0000 7f83b810c800 1 -- start start 2024-09-18T01:25:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.802+0000 7f83affff640 1 --2- 172.21.15.100:0/3171262316 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8290036b90 0x7f8290039050 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55cc120799f0 tx=0x7f83a0005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.802+0000 7f83b810c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc1209ffb0 0x55cc120a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.802+0000 7f83b810c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cc1206e230 con 0x55cc1209ffb0 2024-09-18T01:25:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.802+0000 7f83b5c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc1209ffb0 0x55cc120a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.802+0000 7f83b5c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc1209ffb0 0x55cc120a03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38722/0 (socket says 172.21.15.100:38722) 2024-09-18T01:25:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.802+0000 7f83b5c00640 1 -- 172.21.15.100:0/3151803269 learned_addr learned my addr 172.21.15.100:0/3151803269 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.802+0000 7f83b5c00640 1 -- 172.21.15.100:0/3151803269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc120a0980 con 0x55cc1209ffb0 2024-09-18T01:25:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.802+0000 7f83b5c00640 1 --2- 172.21.15.100:0/3151803269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc1209ffb0 0x55cc120a03b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f83a8019640 tx=0x7f83a804c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ac96dfed1a9db8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.803+0000 7f82997fa640 1 -- 172.21.15.100:0/3151803269 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a8049770 con 0x55cc1209ffb0 2024-09-18T01:25:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.803+0000 7f82997fa640 1 -- 172.21.15.100:0/3151803269 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a8044820 con 0x55cc1209ffb0 2024-09-18T01:25:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.803+0000 7f82997fa640 1 -- 172.21.15.100:0/3151803269 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a804fbb0 con 0x55cc1209ffb0 2024-09-18T01:25:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.803+0000 7f83b810c800 1 -- 172.21.15.100:0/3151803269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc1209ffb0 msgr2=0x55cc120a03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.803+0000 7f83b810c800 1 --2- 172.21.15.100:0/3151803269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc1209ffb0 0x55cc120a03b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f83a8019640 tx=0x7f83a804c8e0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.803+0000 7f83b810c800 1 -- 172.21.15.100:0/3151803269 shutdown_connections 2024-09-18T01:25:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.803+0000 7f83b810c800 1 --2- 172.21.15.100:0/3151803269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc1209ffb0 0x55cc120a03b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.803+0000 7f83b810c800 1 -- 172.21.15.100:0/3151803269 >> 172.21.15.100:0/3151803269 conn(0x55cc1209c310 msgr2=0x55cc1209a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.803+0000 7f83b810c800 1 -- 172.21.15.100:0/3151803269 shutdown_connections 2024-09-18T01:25:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.803+0000 7f83b810c800 1 -- 172.21.15.100:0/3151803269 wait complete. 2024-09-18T01:25:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.803+0000 7f83b810c800 1 Processor -- start 2024-09-18T01:25:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.803+0000 7f83b810c800 1 -- start start 2024-09-18T01:25:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.804+0000 7f83b810c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc1209ffb0 0x55cc120a72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.804+0000 7f83b810c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cc120a0f40 con 0x55cc1209ffb0 2024-09-18T01:25:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.804+0000 7f83b5c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc1209ffb0 0x55cc120a72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.804+0000 7f83b5c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc1209ffb0 0x55cc120a72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38726/0 (socket says 172.21.15.100:38726) 2024-09-18T01:25:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.804+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 learned_addr learned my addr 172.21.15.100:0/598861739 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.804+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc120a7810 con 0x55cc1209ffb0 2024-09-18T01:25:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.804+0000 7f83b5c00640 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc1209ffb0 0x55cc120a72d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f83a803a000 tx=0x7f83a80234d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.804+0000 7f82877fe640 1 -- 172.21.15.100:0/598861739 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a806e020 con 0x55cc1209ffb0 2024-09-18T01:25:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.804+0000 7f82877fe640 1 -- 172.21.15.100:0/598861739 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a804cbb0 con 0x55cc1209ffb0 2024-09-18T01:25:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.804+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc120a7810 con 0x55cc1209ffb0 2024-09-18T01:25:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.804+0000 7f82877fe640 1 -- 172.21.15.100:0/598861739 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a80491a0 con 0x55cc1209ffb0 2024-09-18T01:25:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.805+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc120a7810 con 0x55cc1209ffb0 2024-09-18T01:25:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.805+0000 7f82877fe640 1 -- 172.21.15.100:0/598861739 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f83a8071020 con 0x55cc1209ffb0 2024-09-18T01:25:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.805+0000 7f82877fe640 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8280036b90 0x7f8280039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.805+0000 7f82877fe640 1 -- 172.21.15.100:0/598861739 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f83a8064050 con 0x55cc1209ffb0 2024-09-18T01:25:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.806+0000 7f83affff640 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8280036b90 0x7f8280039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.806+0000 7f83affff640 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8280036b90 0x7f8280039050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f83a0045a60 tx=0x7f83a0053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.806+0000 7f83b810c800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.806+0000 7f83b810c800 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55cc120b28c0 0x55cc120b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.806+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b54d0 con 0x55cc120b28c0 2024-09-18T01:25:32.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.806+0000 7f83b6401640 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55cc120b28c0 0x55cc120b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b6401640 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55cc120b28c0 0x55cc120b4d80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b810c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b810c800 20 realm 2024-09-18T01:25:32.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b810c800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b58e0 con 0x55cc120b28c0 2024-09-18T01:25:32.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b810c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b810c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:32.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b810c800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b61b0 con 0x55cc120b28c0 2024-09-18T01:25:32.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b810c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b810c800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.807+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120b28c0 2024-09-18T01:25:32.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.808+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.808+0000 7f83b810c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:32.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.808+0000 7f83b810c800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.808+0000 7f83b810c800 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55cc120b72b0 0x55cc120b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.808+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b9cb0 con 0x55cc120b72b0 2024-09-18T01:25:32.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.808+0000 7f83b5c00640 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55cc120b72b0 0x55cc120b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.808+0000 7f83b5c00640 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55cc120b72b0 0x55cc120b96a0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.808+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.808+0000 7f83b810c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.808+0000 7f83b810c800 20 searching for the correct realm 2024-09-18T01:25:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.808+0000 7f83b810c800 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55cc120bbc60 0x55cc120be120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.808+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120be7f0 con 0x55cc120bbc60 2024-09-18T01:25:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.808+0000 7f83affff640 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55cc120bbc60 0x55cc120be120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.809+0000 7f83affff640 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55cc120bbc60 0x55cc120be120 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.809+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.809+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120be7f0 con 0x55cc120b72b0 2024-09-18T01:25:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.809+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.809+0000 7f83b5c00640 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f83a8073020 0x7f83a8050680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.809+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120be7f0 con 0x7f83a8073020 2024-09-18T01:25:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.810+0000 7f83b6401640 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f83a8073020 0x7f83a8050680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.810+0000 7f83b6401640 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f83a8073020 0x7f83a8050680 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.810+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.810+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120b28c0 2024-09-18T01:25:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.810+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.810+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120b28c0 2024-09-18T01:25:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.811+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.811+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x7f83a8073020 2024-09-18T01:25:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.811+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.811+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x7f83a8073020 2024-09-18T01:25:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.811+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.811+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120b72b0 2024-09-18T01:25:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.812+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.812+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120bbc60 2024-09-18T01:25:32.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.812+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.812+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120b28c0 2024-09-18T01:25:32.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.812+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.812+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x7f83a8073020 2024-09-18T01:25:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.812+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.812+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120b28c0 2024-09-18T01:25:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.813+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.813+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120b72b0 2024-09-18T01:25:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.813+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.813+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120bbc60 2024-09-18T01:25:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.813+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.813+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120bbc60 2024-09-18T01:25:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.813+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.813+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x7f83a8073020 2024-09-18T01:25:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.814+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.814+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120bbc60 2024-09-18T01:25:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.814+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.814+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120bbc60 2024-09-18T01:25:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.814+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.814+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120b28c0 2024-09-18T01:25:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.814+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.814+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120b28c0 2024-09-18T01:25:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.814+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.814+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x7f83a8073020 2024-09-18T01:25:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.815+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.815+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120bbc60 2024-09-18T01:25:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.815+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.815+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120b72b0 2024-09-18T01:25:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.815+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.815+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120b28c0 2024-09-18T01:25:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.815+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.815+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x7f83a8073020 2024-09-18T01:25:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.816+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.816+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120bbc60 2024-09-18T01:25:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.816+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.816+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x7f83a8073020 2024-09-18T01:25:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.816+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.816+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120b72b0 2024-09-18T01:25:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.816+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.816+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120bbc60 2024-09-18T01:25:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x7f83a8073020 2024-09-18T01:25:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120b28c0 2024-09-18T01:25:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cc120b6550 con 0x55cc120b72b0 2024-09-18T01:25:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83b810c800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83b810c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83b810c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83b810c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83b810c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83b810c800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83b810c800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.817+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc120ba570 con 0x55cc120b28c0 2024-09-18T01:25:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc120ba960 con 0x55cc120b28c0 2024-09-18T01:25:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc120ba960 con 0x7f83a8073020 2024-09-18T01:25:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 20 zone default found 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 4 Realm: () 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 20 zonegroup default 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc120ba1a0 con 0x7f83a8073020 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.818+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c0650 con 0x55cc120bbc60 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.819+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.819+0000 7f83b810c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.819+0000 7f83b810c800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.819+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c09f0 con 0x55cc120bbc60 2024-09-18T01:25:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.819+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.819+0000 7f83b810c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.819+0000 7f83b810c800 20 started sync module instance, tier type = 2024-09-18T01:25:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.819+0000 7f83b810c800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.819+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120bfaf0 con 0x55cc120b72b0 2024-09-18T01:25:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.820+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.820+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94334964463168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c0d90 con 0x55cc120b72b0 2024-09-18T01:25:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.820+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c1620 con 0x55cc120b28c0 2024-09-18T01:25:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.821+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94334964463168] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.821+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.821+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94334964465424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c1240 con 0x55cc120b28c0 2024-09-18T01:25:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.821+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c2070 con 0x55cc120bbc60 2024-09-18T01:25:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.823+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94334964465424] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.823+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.823+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94334964469136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c11b0 con 0x55cc120bbc60 2024-09-18T01:25:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.823+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c2f30 con 0x55cc120b72b0 2024-09-18T01:25:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.824+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94334964469136] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.824+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.824+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94334964476544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c3350 con 0x55cc120b72b0 2024-09-18T01:25:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.824+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c3d10 con 0x55cc120b28c0 2024-09-18T01:25:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.825+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94334964476544] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.825+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.825+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94334964478080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c3d10 con 0x55cc120b28c0 2024-09-18T01:25:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.825+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c46d0 con 0x7f83a8073020 2024-09-18T01:25:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.826+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94334964478080] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.826+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.826+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94334964480576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c46d0 con 0x7f83a8073020 2024-09-18T01:25:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.826+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c5090 con 0x7f83a8073020 2024-09-18T01:25:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.827+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94334964480576] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.827+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.827+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94334964483072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c5090 con 0x7f83a8073020 2024-09-18T01:25:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.827+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c5a50 con 0x7f83a8073020 2024-09-18T01:25:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.828+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94334964483072] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.828+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.828+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94334964488064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c5090 con 0x7f83a8073020 2024-09-18T01:25:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.829+0000 7f83b810c800 20 add_watcher() i=0 2024-09-18T01:25:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.829+0000 7f83b810c800 20 add_watcher() i=1 2024-09-18T01:25:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.829+0000 7f83b810c800 20 add_watcher() i=2 2024-09-18T01:25:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.829+0000 7f83b810c800 20 add_watcher() i=3 2024-09-18T01:25:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.829+0000 7f83b810c800 20 add_watcher() i=4 2024-09-18T01:25:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.829+0000 7f83b810c800 20 add_watcher() i=5 2024-09-18T01:25:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.829+0000 7f83b810c800 20 add_watcher() i=6 2024-09-18T01:25:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.829+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94334964488064] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.829+0000 7f83b810c800 20 add_watcher() i=7 2024-09-18T01:25:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.829+0000 7f83b810c800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.829+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c8f80 con 0x55cc120b28c0 2024-09-18T01:25:32.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.830+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.830+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94334964485760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c6350 con 0x55cc120b28c0 2024-09-18T01:25:32.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.832+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94334964485760] v33'140 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.832+0000 7f82677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.832+0000 7f83b810c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.832+0000 7f83b810c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.833+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c8870 con 0x55cc120b28c0 2024-09-18T01:25:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.834+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'46 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.834+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d2040 con 0x7f83a8073020 2024-09-18T01:25:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.835+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.835+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d2040 con 0x55cc120bbc60 2024-09-18T01:25:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.836+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.836+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d2fd0 con 0x55cc120b28c0 2024-09-18T01:25:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.837+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'141 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.837+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d16e0 con 0x55cc120b72b0 2024-09-18T01:25:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.838+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.838+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d16b0 con 0x55cc120bbc60 2024-09-18T01:25:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.839+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'37 uv16 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.839+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d16b0 con 0x55cc120b28c0 2024-09-18T01:25:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.840+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.840+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d3b30 con 0x7f83a8073020 2024-09-18T01:25:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.841+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.841+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d3b30 con 0x55cc120b72b0 2024-09-18T01:25:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.842+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.842+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d3b30 con 0x55cc120bbc60 2024-09-18T01:25:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.844+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.844+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d1420 con 0x55cc120b72b0 2024-09-18T01:25:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.845+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'45 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.845+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d1420 con 0x7f83a8073020 2024-09-18T01:25:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.846+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.846+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d1420 con 0x55cc120b72b0 2024-09-18T01:25:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.846+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.846+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d1420 con 0x7f83a8073020 2024-09-18T01:25:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.848+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'44 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.848+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d1420 con 0x55cc120b28c0 2024-09-18T01:25:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.849+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'142 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.849+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d1420 con 0x55cc120bbc60 2024-09-18T01:25:32.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.850+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'38 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.850+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4380 con 0x55cc120b72b0 2024-09-18T01:25:32.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.851+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'46 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.851+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4380 con 0x55cc120bbc60 2024-09-18T01:25:32.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.852+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'28 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.852+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4410 con 0x55cc120b28c0 2024-09-18T01:25:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.853+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.853+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4410 con 0x55cc120b28c0 2024-09-18T01:25:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.854+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'143 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.854+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4410 con 0x55cc120bbc60 2024-09-18T01:25:32.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.855+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.855+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4410 con 0x55cc120b72b0 2024-09-18T01:25:32.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.856+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'32 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.856+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4410 con 0x55cc120bbc60 2024-09-18T01:25:32.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.857+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.857+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4410 con 0x55cc120bbc60 2024-09-18T01:25:32.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.858+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.858+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4410 con 0x55cc120bbc60 2024-09-18T01:25:32.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.859+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.859+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4410 con 0x55cc120bbc60 2024-09-18T01:25:32.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.860+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'38 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.860+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4410 con 0x7f83a8073020 2024-09-18T01:25:32.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.862+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.862+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4410 con 0x55cc120bbc60 2024-09-18T01:25:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.862+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.862+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4410 con 0x7f83a8073020 2024-09-18T01:25:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.864+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'33 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.864+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4410 con 0x55cc120bbc60 2024-09-18T01:25:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.865+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.865+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4410 con 0x7f83a8073020 2024-09-18T01:25:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.866+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'45 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.866+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120d4380 con 0x55cc120b72b0 2024-09-18T01:25:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.867+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.867+0000 7f82667fc640 20 reqs_thread_entry: start 2024-09-18T01:25:32.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.868+0000 7f83b810c800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:32.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.868+0000 7f83b810c800 20 Filter name: none 2024-09-18T01:25:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.868+0000 7f81d7fff640 20 reqs_thread_entry: start 2024-09-18T01:25:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.868+0000 7f83b810c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-18T01:25:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.868+0000 7f83b810c800 20 rados->read ofs=0 len=0 2024-09-18T01:25:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.868+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc120ff550 con 0x7f83a8073020 2024-09-18T01:25:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.868+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.868+0000 7f83b810c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-18T01:25:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.868+0000 7f83b810c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-18T01:25:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.868+0000 7f83b810c800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T01:25:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.868+0000 7f83b810c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.868+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc120fefe0 con 0x55cc120b28c0 2024-09-18T01:25:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.868+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.869+0000 7f83b810c800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-18T01:25:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.869+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120fefe0 con 0x7f83a8073020 2024-09-18T01:25:32.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.870+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v33'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.870+0000 7f83b810c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:25:32.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.870+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94334964730576 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc121023b0 con 0x55cc120bbc60 2024-09-18T01:25:32.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.870+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== watch-notify(notify (1) cookie 94334964469136 notify 141733920773 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55cc120d1470 con 0x55cc120bbc60 2024-09-18T01:25:32.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.870+0000 7f82997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 94334964469136 notifier 4573 bl.length()=170 2024-09-18T01:25:32.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.870+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 27 ==== osd_op_reply(97 notify.2 [notify cookie 94334964730576 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.870+0000 7f82997fa640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8278003d60 con 0x55cc120bbc60 2024-09-18T01:25:32.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.870+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.870+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 29 ==== watch-notify(notify_complete (2) cookie 94334964730576 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cc120d1030 con 0x55cc120bbc60 2024-09-18T01:25:32.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.870+0000 7f83b810c800 10 removing email index: 2024-09-18T01:25:32.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.870+0000 7f83b810c800 10 removing user buckets index 2024-09-18T01:25:32.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.870+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120fff50 con 0x55cc120b28c0 2024-09-18T01:25:32.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.871+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v33'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.871+0000 7f83b810c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-18T01:25:32.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.871+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94334964730544 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc12102390 con 0x55cc120b28c0 2024-09-18T01:25:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.871+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== watch-notify(notify (1) cookie 94334964478080 notify 141733920792 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55cc120d1d10 con 0x55cc120b28c0 2024-09-18T01:25:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.871+0000 7f82997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 94334964478080 notifier 4573 bl.length()=175 2024-09-18T01:25:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.871+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(100 notify.4 [notify cookie 94334964730544 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.871+0000 7f82997fa640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8278003d60 con 0x55cc120b28c0 2024-09-18T01:25:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.872+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.872+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== watch-notify(notify_complete (2) cookie 94334964730544 notify 141733920792 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cc120d25f0 con 0x55cc120b28c0 2024-09-18T01:25:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.872+0000 7f83b810c800 10 removing user index: testx$tenanteduser 2024-09-18T01:25:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.872+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc121040f0 con 0x7f83a8073020 2024-09-18T01:25:32.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.873+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v33'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.873+0000 7f83b810c800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-18T01:25:32.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.873+0000 7f83b810c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-18T01:25:32.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.873+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94334964743232 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cc12104060 con 0x55cc120b72b0 2024-09-18T01:25:32.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.873+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== watch-notify(notify (1) cookie 94334964476544 notify 141733920783 ret 0) ==== 209+0+0 (crc 0 0 0) 0x55cc120d3b30 con 0x55cc120b72b0 2024-09-18T01:25:32.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.873+0000 7f8298ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920783 cookie 94334964476544 notifier 4573 bl.length()=167 2024-09-18T01:25:32.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.873+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(103 notify.3 [notify cookie 94334964743232 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.873+0000 7f8298ff9640 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f81e00032c0 con 0x55cc120b72b0 2024-09-18T01:25:32.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.874+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.874+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== watch-notify(notify_complete (2) cookie 94334964743232 notify 141733920783 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cc12093e40 con 0x55cc120b72b0 2024-09-18T01:25:32.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.875+0000 7f82677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:32.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.875+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94334964485760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc12103c40 con 0x55cc120b28c0 2024-09-18T01:25:32.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.876+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94334964485760] v33'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.876+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94334964463168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c4e80 con 0x55cc120b72b0 2024-09-18T01:25:32.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.877+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94334964463168] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.877+0000 7f83b810c800 20 remove_watcher() i=0 2024-09-18T01:25:32.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.877+0000 7f83b810c800 2 removed watcher, disabling cache 2024-09-18T01:25:32.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.877+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94334964465424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c4e80 con 0x55cc120b28c0 2024-09-18T01:25:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.878+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94334964465424] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.878+0000 7f83b810c800 20 remove_watcher() i=1 2024-09-18T01:25:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.878+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94334964469136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c4e80 con 0x55cc120bbc60 2024-09-18T01:25:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.879+0000 7f83affff640 1 -- 172.21.15.100:0/598861739 <== osd.3 v2:172.21.15.100:6816/595195757 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94334964469136] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a0051070 con 0x55cc120bbc60 2024-09-18T01:25:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.879+0000 7f83b810c800 20 remove_watcher() i=2 2024-09-18T01:25:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.879+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94334964476544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c0d90 con 0x55cc120b72b0 2024-09-18T01:25:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.880+0000 7f83b5c00640 1 -- 172.21.15.100:0/598861739 <== osd.2 v2:172.21.15.100:6808/3104327688 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94334964476544] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a803c030 con 0x55cc120b72b0 2024-09-18T01:25:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.880+0000 7f83b810c800 20 remove_watcher() i=3 2024-09-18T01:25:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.880+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94334964478080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c2a80 con 0x55cc120b28c0 2024-09-18T01:25:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.881+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.1 v2:172.21.15.100:6800/170575980 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94334964478080] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x55cc120b28c0 2024-09-18T01:25:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.881+0000 7f83b810c800 20 remove_watcher() i=4 2024-09-18T01:25:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.881+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94334964480576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c0d90 con 0x7f83a8073020 2024-09-18T01:25:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.882+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94334964480576] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.882+0000 7f83b810c800 20 remove_watcher() i=5 2024-09-18T01:25:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.882+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94334964483072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c2a80 con 0x7f83a8073020 2024-09-18T01:25:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.883+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94334964483072] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.883+0000 7f83b810c800 20 remove_watcher() i=6 2024-09-18T01:25:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.883+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94334964488064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cc120c3a40 con 0x7f83a8073020 2024-09-18T01:25:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 <== osd.0 v2:172.21.15.92:6800/2777570747 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94334964488064] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a8073020 2024-09-18T01:25:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 20 remove_watcher() i=7 2024-09-18T01:25:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f83a8073020 msgr2=0x7f83a8050680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f83a8073020 0x7f83a8050680 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55cc120b28c0 msgr2=0x55cc120b4d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55cc120b28c0 0x55cc120b4d80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55cc120b72b0 msgr2=0x55cc120b96a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55cc120b72b0 0x55cc120b96a0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55cc120bbc60 msgr2=0x55cc120be120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55cc120bbc60 0x55cc120be120 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8280036b90 msgr2=0x7f8280039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8280036b90 0x7f8280039050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f83a0045a60 tx=0x7f83a0053000 comp rx=0 tx=0).stop 2024-09-18T01:25:32.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b6401640 1 -- 172.21.15.100:0/598861739 reap_dead start 2024-09-18T01:25:32.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc1209ffb0 msgr2=0x55cc120a72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc1209ffb0 0x55cc120a72d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f83a803a000 tx=0x7f83a80234d0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 shutdown_connections 2024-09-18T01:25:32.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 --2- 172.21.15.100:0/598861739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc1209ffb0 0x55cc120a72d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 >> 172.21.15.100:0/598861739 conn(0x55cc1209c310 msgr2=0x55cc1209a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 shutdown_connections 2024-09-18T01:25:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.884+0000 7f83b810c800 1 -- 172.21.15.100:0/598861739 wait complete. 2024-09-18T01:25:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/3171262316 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8290036b90 msgr2=0x7f8290039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 --2- 172.21.15.100:0/3171262316 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8290036b90 0x7f8290039050 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55cc120799f0 tx=0x7f83a0005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/3171262316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc120934e0 msgr2=0x55cc12093900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 --2- 172.21.15.100:0/3171262316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc120934e0 0x55cc12093900 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f83a804ad70 tx=0x7f83a80176a0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/3171262316 shutdown_connections 2024-09-18T01:25:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 --2- 172.21.15.100:0/3171262316 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8290036b90 0x7f8290039050 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 --2- 172.21.15.100:0/3171262316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc120934e0 0x55cc12093900 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/3171262316 >> 172.21.15.100:0/3171262316 conn(0x55cc12088470 msgr2=0x55cc1208aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/3171262316 shutdown_connections 2024-09-18T01:25:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/3171262316 wait complete. 2024-09-18T01:25:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55cc12082c80 msgr2=0x55cc12085070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55cc12082c80 0x55cc12085070 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55cc11f82d60 msgr2=0x55cc1207c500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55cc11f82d60 0x55cc1207c500 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55cc1207ed90 msgr2=0x55cc12081180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55cc1207ed90 0x55cc12081180 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f829c036b90 msgr2=0x7f829c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f829c036b90 0x7f829c039050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f83a0057000 tx=0x7f83a0052000 comp rx=0 tx=0).stop 2024-09-18T01:25:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11ef05f0 msgr2=0x55cc12075490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 --2- 172.21.15.100:0/2183123969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc11ef05f0 0x55cc12075490 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f83a8004000 tx=0x7f83a8000bc0 comp rx=0 tx=0).stop 2024-09-18T01:25:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b6401640 1 -- 172.21.15.100:0/2183123969 reap_dead start 2024-09-18T01:25:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 shutdown_connections 2024-09-18T01:25:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 >> 172.21.15.100:0/2183123969 conn(0x55cc11f76db0 msgr2=0x55cc12067d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 shutdown_connections 2024-09-18T01:25:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.885+0000 7f83b810c800 1 -- 172.21.15.100:0/2183123969 wait complete. 2024-09-18T01:25:32.902 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-18T01:25:32.906 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-18T01:25:32.949 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:32.949 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-18T01:25:32.949 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-18T01:25:32.950 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-18T01:25:32.996 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:32.996 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:32.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.996+0000 7faaa9c30800 1 Processor -- start 2024-09-18T01:25:32.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.996+0000 7faaa9c30800 1 -- start start 2024-09-18T01:25:32.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.996+0000 7faaa9c30800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55b725e88920 0x55b725e8ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:32.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.996+0000 7faaa9c30800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b725d44b30 con 0x55b725e844e0 2024-09-18T01:25:32.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.996+0000 7faaa9c30800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55b725d26360 con 0x55b725e88920 2024-09-18T01:25:32.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.996+0000 7faa9ffff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55b725e88920 0x55b725e8ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:32.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.996+0000 7faaa4f4b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55b725e844e0 0x55b725e848e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37434/0 (socket says 172.21.15.100:37434) 2024-09-18T01:25:32.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.996+0000 7faaa4f4b640 1 -- 172.21.15.100:0/1122705111 learned_addr learned my addr 172.21.15.100:0/1122705111 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:32.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.997+0000 7faa9ffff640 1 -- 172.21.15.100:0/1122705111 >> v1:172.21.15.92:6789/0 conn(0x55b725e844e0 legacy=0x55b725e848e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:32.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.997+0000 7faa9ffff640 1 -- 172.21.15.100:0/1122705111 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b725d4ce00 con 0x55b725e88920 2024-09-18T01:25:32.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.997+0000 7faa9f7fe640 1 -- 172.21.15.100:0/1122705111 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2779861885 0 0) 0x55b725d44b30 con 0x55b725e844e0 2024-09-18T01:25:33.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.998+0000 7faa9ffff640 1 --2- 172.21.15.100:0/1122705111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e88920 0x55b725e8ad10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7faa9000a470 tx=0x7faa90045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585207ec81c5b10e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.999+0000 7faa9f7fe640 1 -- 172.21.15.100:0/1122705111 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa90053570 con 0x55b725e88920 2024-09-18T01:25:33.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.999+0000 7faa9f7fe640 1 -- 172.21.15.100:0/1122705111 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa90058070 con 0x55b725e88920 2024-09-18T01:25:33.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.999+0000 7faa9f7fe640 1 -- 172.21.15.100:0/1122705111 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa90053880 con 0x55b725e88920 2024-09-18T01:25:33.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.999+0000 7faaa9c30800 1 -- 172.21.15.100:0/1122705111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e88920 msgr2=0x55b725e8ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.999+0000 7faaa9c30800 1 --2- 172.21.15.100:0/1122705111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e88920 0x55b725e8ad10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7faa9000a470 tx=0x7faa90045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:33.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.999+0000 7faaa9c30800 1 -- 172.21.15.100:0/1122705111 shutdown_connections 2024-09-18T01:25:33.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.999+0000 7faaa9c30800 1 --2- 172.21.15.100:0/1122705111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e88920 0x55b725e8ad10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.999+0000 7faaa9c30800 1 -- 172.21.15.100:0/1122705111 >> 172.21.15.100:0/1122705111 conn(0x55b725e7fdd0 msgr2=0x55b725e821f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.999+0000 7faaa9c30800 1 -- 172.21.15.100:0/1122705111 shutdown_connections 2024-09-18T01:25:33.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:32.999+0000 7faaa9c30800 1 -- 172.21.15.100:0/1122705111 wait complete. 2024-09-18T01:25:33.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.013+0000 7faaa9c30800 1 Processor -- start 2024-09-18T01:25:33.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.013+0000 7faaa9c30800 1 -- start start 2024-09-18T01:25:33.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.013+0000 7faaa9c30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e844e0 0x55b725df8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.013+0000 7faaa9c30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b725dd1360 con 0x55b725e844e0 2024-09-18T01:25:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.013+0000 7faaa4f4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e844e0 0x55b725df8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.013+0000 7faaa4f4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e844e0 0x55b725df8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38742/0 (socket says 172.21.15.100:38742) 2024-09-18T01:25:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.013+0000 7faaa4f4b640 1 -- 172.21.15.100:0/3325788677 learned_addr learned my addr 172.21.15.100:0/3325788677 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.014+0000 7faaa4f4b640 1 -- 172.21.15.100:0/3325788677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b725d1ebc0 con 0x55b725e844e0 2024-09-18T01:25:33.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.014+0000 7faaa4f4b640 1 --2- 172.21.15.100:0/3325788677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e844e0 0x55b725df8da0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faa9800b240 tx=0x7faa9800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3134ca7fbce2bec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.014+0000 7fa992e05640 1 -- 172.21.15.100:0/3325788677 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa98008070 con 0x55b725e844e0 2024-09-18T01:25:33.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.014+0000 7fa992e05640 1 -- 172.21.15.100:0/3325788677 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9800d500 con 0x55b725e844e0 2024-09-18T01:25:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.014+0000 7fa992e05640 1 -- 172.21.15.100:0/3325788677 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa9800d860 con 0x55b725e844e0 2024-09-18T01:25:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.015+0000 7faaa9c30800 1 -- 172.21.15.100:0/3325788677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e844e0 msgr2=0x55b725df8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.015+0000 7faaa9c30800 1 --2- 172.21.15.100:0/3325788677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e844e0 0x55b725df8da0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faa9800b240 tx=0x7faa9800b700 comp rx=0 tx=0).stop 2024-09-18T01:25:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.015+0000 7faaa9c30800 1 -- 172.21.15.100:0/3325788677 shutdown_connections 2024-09-18T01:25:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.015+0000 7faaa9c30800 1 --2- 172.21.15.100:0/3325788677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e844e0 0x55b725df8da0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.015+0000 7faaa9c30800 1 -- 172.21.15.100:0/3325788677 >> 172.21.15.100:0/3325788677 conn(0x55b725e7fdd0 msgr2=0x55b725f6eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.015+0000 7faaa9c30800 1 -- 172.21.15.100:0/3325788677 shutdown_connections 2024-09-18T01:25:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.015+0000 7faaa9c30800 1 -- 172.21.15.100:0/3325788677 wait complete. 2024-09-18T01:25:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.015+0000 7faaa9c30800 1 Processor -- start 2024-09-18T01:25:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.015+0000 7faaa9c30800 1 -- start start 2024-09-18T01:25:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.015+0000 7faaa9c30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e844e0 0x55b725f7e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.015+0000 7faaa9c30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b725e8b550 con 0x55b725e844e0 2024-09-18T01:25:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.015+0000 7faaa4f4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e844e0 0x55b725f7e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.015+0000 7faaa4f4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e844e0 0x55b725f7e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38748/0 (socket says 172.21.15.100:38748) 2024-09-18T01:25:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.015+0000 7faaa4f4b640 1 -- 172.21.15.100:0/1128545067 learned_addr learned my addr 172.21.15.100:0/1128545067 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.016+0000 7faaa4f4b640 1 -- 172.21.15.100:0/1128545067 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b725d32fe0 con 0x55b725e844e0 2024-09-18T01:25:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.016+0000 7faaa4f4b640 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e844e0 0x55b725f7e280 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7faa98000f60 tx=0x7faa98000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.016+0000 7fa991602640 1 -- 172.21.15.100:0/1128545067 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa98019870 con 0x55b725e844e0 2024-09-18T01:25:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.016+0000 7fa991602640 1 -- 172.21.15.100:0/1128545067 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa98019a10 con 0x55b725e844e0 2024-09-18T01:25:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.016+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b725f7e7c0 con 0x55b725e844e0 2024-09-18T01:25:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.016+0000 7fa991602640 1 -- 172.21.15.100:0/1128545067 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa98019d10 con 0x55b725e844e0 2024-09-18T01:25:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.016+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b725f7ece0 con 0x55b725e844e0 2024-09-18T01:25:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.017+0000 7fa991602640 1 -- 172.21.15.100:0/1128545067 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faa98017040 con 0x55b725e844e0 2024-09-18T01:25:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.017+0000 7fa991602640 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa98c036b40 0x7fa98c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.017+0000 7fa991602640 1 -- 172.21.15.100:0/1128545067 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7faa98015020 con 0x55b725e844e0 2024-09-18T01:25:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.017+0000 7faa9ffff640 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa98c036b40 0x7fa98c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.017+0000 7faaa9c30800 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b725e88920 0x55b725f852f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.017+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725f85830 con 0x55b725e88920 2024-09-18T01:25:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.017+0000 7faaa574c640 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b725e88920 0x55b725f852f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.017+0000 7faa9ffff640 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa98c036b40 0x7fa98c039000 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faa90057000 tx=0x7faa90052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.017+0000 7faaa574c640 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b725e88920 0x55b725f852f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.018+0000 7faaa574c640 1 -- 172.21.15.100:0/1128545067 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725e88920 2024-09-18T01:25:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.018+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725f828c0 con 0x55b725e88920 2024-09-18T01:25:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.018+0000 7faaa574c640 1 -- 172.21.15.100:0/1128545067 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725e88920 2024-09-18T01:25:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.018+0000 7faaa9c30800 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b725f87b20 0x55b725f89f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.018+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725f8a5b0 con 0x55b725f87b20 2024-09-18T01:25:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.018+0000 7faaa4f4b640 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b725f87b20 0x55b725f89f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.018+0000 7faaa4f4b640 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b725f87b20 0x55b725f89f10 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.019+0000 7faaa4f4b640 1 -- 172.21.15.100:0/1128545067 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faa9802d070 con 0x55b725f87b20 2024-09-18T01:25:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.019+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725f869c0 con 0x55b725e88920 2024-09-18T01:25:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.019+0000 7faaa574c640 1 -- 172.21.15.100:0/1128545067 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725e88920 2024-09-18T01:25:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.019+0000 7faaa9c30800 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b725f8ba10 0x55b725f8de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.019+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725f8e500 con 0x55b725f8ba10 2024-09-18T01:25:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.019+0000 7faa9ffff640 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b725f8ba10 0x55b725f8de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.020+0000 7faa9ffff640 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b725f8ba10 0x55b725f8de00 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.020+0000 7faa9ffff640 1 -- 172.21.15.100:0/1128545067 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faa90051070 con 0x55b725f8ba10 2024-09-18T01:25:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.020+0000 7faaa9c30800 1 Processor -- start 2024-09-18T01:25:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.020+0000 7faaa9c30800 1 -- start start 2024-09-18T01:25:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.020+0000 7faaa9c30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725f9c2b0 0x55b725f9c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.020+0000 7faaa9c30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b725d20580 con 0x55b725f9c2b0 2024-09-18T01:25:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.021+0000 7faaa4f4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725f9c2b0 0x55b725f9c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.021+0000 7faaa4f4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725f9c2b0 0x55b725f9c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38760/0 (socket says 172.21.15.100:38760) 2024-09-18T01:25:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.021+0000 7faaa4f4b640 1 -- 172.21.15.100:0/443552105 learned_addr learned my addr 172.21.15.100:0/443552105 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.021+0000 7faaa4f4b640 1 -- 172.21.15.100:0/443552105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b725f9cc10 con 0x55b725f9c2b0 2024-09-18T01:25:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.021+0000 7faaa4f4b640 1 --2- 172.21.15.100:0/443552105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725f9c2b0 0x55b725f9c6d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7faa9800eb40 tx=0x7faa9800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.021+0000 7fa98a7fc640 1 -- 172.21.15.100:0/443552105 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa9804bb00 con 0x55b725f9c2b0 2024-09-18T01:25:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.021+0000 7fa98a7fc640 1 -- 172.21.15.100:0/443552105 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9804bca0 con 0x55b725f9c2b0 2024-09-18T01:25:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.021+0000 7faaa9c30800 1 -- 172.21.15.100:0/443552105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b725f9cea0 con 0x55b725f9c2b0 2024-09-18T01:25:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.021+0000 7fa98a7fc640 1 -- 172.21.15.100:0/443552105 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa9801a720 con 0x55b725f9c2b0 2024-09-18T01:25:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.021+0000 7faaa9c30800 1 -- 172.21.15.100:0/443552105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b725f9fb80 con 0x55b725f9c2b0 2024-09-18T01:25:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.022+0000 7fa98a7fc640 1 -- 172.21.15.100:0/443552105 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faa9801a8c0 con 0x55b725f9c2b0 2024-09-18T01:25:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.022+0000 7fa98a7fc640 1 --2- 172.21.15.100:0/443552105 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa97c036b90 0x7fa97c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.022+0000 7fa98a7fc640 1 -- 172.21.15.100:0/443552105 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7faa9804ed80 con 0x55b725f9c2b0 2024-09-18T01:25:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.022+0000 7faa9ffff640 1 --2- 172.21.15.100:0/443552105 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa97c036b90 0x7fa97c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.022+0000 7faaa9c30800 1 Processor -- start 2024-09-18T01:25:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.022+0000 7faaa9c30800 1 -- start start 2024-09-18T01:25:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.022+0000 7faa9ffff640 1 --2- 172.21.15.100:0/443552105 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa97c036b90 0x7fa97c039050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55b725f827e0 tx=0x7faa90005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.022+0000 7faaa9c30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725fa8f30 0x55b725fa9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.022+0000 7faaa9c30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b725f79730 con 0x55b725fa8f30 2024-09-18T01:25:33.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.023+0000 7faaa4f4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725fa8f30 0x55b725fa9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.023+0000 7faaa4f4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725fa8f30 0x55b725fa9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38770/0 (socket says 172.21.15.100:38770) 2024-09-18T01:25:33.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.023+0000 7faaa4f4b640 1 -- 172.21.15.100:0/828802043 learned_addr learned my addr 172.21.15.100:0/828802043 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.023+0000 7faaa4f4b640 1 -- 172.21.15.100:0/828802043 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b725fa9870 con 0x55b725fa8f30 2024-09-18T01:25:33.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.023+0000 7faaa4f4b640 1 --2- 172.21.15.100:0/828802043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725fa8f30 0x55b725fa9330 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7faa9804f040 tx=0x7faa98044e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6a047bd4f3b24 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.023+0000 7fa97bfff640 1 -- 172.21.15.100:0/828802043 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa98018ab0 con 0x55b725fa8f30 2024-09-18T01:25:33.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.023+0000 7fa97bfff640 1 -- 172.21.15.100:0/828802043 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa98044260 con 0x55b725fa8f30 2024-09-18T01:25:33.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.023+0000 7fa97bfff640 1 -- 172.21.15.100:0/828802043 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa98045d60 con 0x55b725fa8f30 2024-09-18T01:25:33.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.024+0000 7faaa9c30800 1 -- 172.21.15.100:0/828802043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725fa8f30 msgr2=0x55b725fa9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.024+0000 7faaa9c30800 1 --2- 172.21.15.100:0/828802043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725fa8f30 0x55b725fa9330 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7faa9804f040 tx=0x7faa98044e80 comp rx=0 tx=0).stop 2024-09-18T01:25:33.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.024+0000 7faaa9c30800 1 -- 172.21.15.100:0/828802043 shutdown_connections 2024-09-18T01:25:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.024+0000 7faaa9c30800 1 --2- 172.21.15.100:0/828802043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725fa8f30 0x55b725fa9330 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.024+0000 7faaa9c30800 1 -- 172.21.15.100:0/828802043 >> 172.21.15.100:0/828802043 conn(0x55b725fa52e0 msgr2=0x55b725fa33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.024+0000 7faaa9c30800 1 -- 172.21.15.100:0/828802043 shutdown_connections 2024-09-18T01:25:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.024+0000 7faaa9c30800 1 -- 172.21.15.100:0/828802043 wait complete. 2024-09-18T01:25:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.024+0000 7faaa9c30800 1 Processor -- start 2024-09-18T01:25:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.024+0000 7faaa9c30800 1 -- start start 2024-09-18T01:25:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.024+0000 7faaa9c30800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725fa8f30 0x55b725fb01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.024+0000 7faaa9c30800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b725fa9d90 con 0x55b725fa8f30 2024-09-18T01:25:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.024+0000 7faaa4f4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725fa8f30 0x55b725fb01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.024+0000 7faaa4f4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725fa8f30 0x55b725fb01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38776/0 (socket says 172.21.15.100:38776) 2024-09-18T01:25:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.024+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 learned_addr learned my addr 172.21.15.100:0/755765127 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.025+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b725fb0710 con 0x55b725fa8f30 2024-09-18T01:25:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.025+0000 7faaa4f4b640 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725fa8f30 0x55b725fb01d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7faa9801a6d0 tx=0x7faa98044ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.025+0000 7fa97a7fc640 1 -- 172.21.15.100:0/755765127 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa98030450 con 0x55b725fa8f30 2024-09-18T01:25:33.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.025+0000 7fa97a7fc640 1 -- 172.21.15.100:0/755765127 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9804fa20 con 0x55b725fa8f30 2024-09-18T01:25:33.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.025+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b725fb0710 con 0x55b725fa8f30 2024-09-18T01:25:33.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.025+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b725fb0710 con 0x55b725fa8f30 2024-09-18T01:25:33.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.025+0000 7fa97a7fc640 1 -- 172.21.15.100:0/755765127 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa98076060 con 0x55b725fa8f30 2024-09-18T01:25:33.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.026+0000 7fa97a7fc640 1 -- 172.21.15.100:0/755765127 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faa98054070 con 0x55b725fa8f30 2024-09-18T01:25:33.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.026+0000 7fa97a7fc640 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa970036af0 0x7fa970038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.026+0000 7fa97a7fc640 1 -- 172.21.15.100:0/755765127 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7faa98072c80 con 0x55b725fa8f30 2024-09-18T01:25:33.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.026+0000 7faa9ffff640 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa970036af0 0x7fa970038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.026+0000 7faa9ffff640 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa970036af0 0x7fa970038fb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55b725f8e900 tx=0x7faa9006b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa9c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa9c30800 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b725fbb720 0x55b725fbdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbe330 con 0x55b725fbb720 2024-09-18T01:25:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa574c640 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b725fbb720 0x55b725fbdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa574c640 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b725fbb720 0x55b725fbdbe0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa9c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa9c30800 20 realm 2024-09-18T01:25:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa9c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbe740 con 0x55b725fbb720 2024-09-18T01:25:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa9c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa9c30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa9c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.027+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf010 con 0x55b725fbb720 2024-09-18T01:25:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.028+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.028+0000 7faaa9c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.028+0000 7faaa9c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.028+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fbb720 2024-09-18T01:25:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.028+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.028+0000 7faaa9c30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.028+0000 7faaa9c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.028+0000 7faaa9c30800 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b725fc0110 0x55b725fc2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.028+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725fc2b10 con 0x55b725fc0110 2024-09-18T01:25:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.028+0000 7faaa4f4b640 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b725fc0110 0x55b725fc2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.028+0000 7faaa4f4b640 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b725fc0110 0x55b725fc2500 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.029+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faa98078070 con 0x55b725fc0110 2024-09-18T01:25:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.029+0000 7faaa9c30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.029+0000 7faaa9c30800 20 searching for the correct realm 2024-09-18T01:25:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.029+0000 7faaa9c30800 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b725fc4ac0 0x55b725fc6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.029+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fc7650 con 0x55b725fc4ac0 2024-09-18T01:25:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.029+0000 7faa9ffff640 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b725fc4ac0 0x55b725fc6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.029+0000 7faa9ffff640 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b725fc4ac0 0x55b725fc6f80 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.029+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.029+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fc7650 con 0x55b725fc0110 2024-09-18T01:25:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.029+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa98078070 con 0x55b725fc0110 2024-09-18T01:25:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.029+0000 7faaa4f4b640 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7faa98071020 0x7faa980723f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.030+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fc7650 con 0x7faa98071020 2024-09-18T01:25:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.030+0000 7faaa574c640 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7faa98071020 0x7faa980723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.030+0000 7faaa574c640 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7faa98071020 0x7faa980723f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.031+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.031+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fbb720 2024-09-18T01:25:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.031+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.031+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fbb720 2024-09-18T01:25:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.031+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.031+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x7faa98071020 2024-09-18T01:25:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.031+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.031+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x7faa98071020 2024-09-18T01:25:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.031+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.031+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fc0110 2024-09-18T01:25:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.032+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa98078070 con 0x55b725fc0110 2024-09-18T01:25:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.032+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fc4ac0 2024-09-18T01:25:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.032+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.032+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fbb720 2024-09-18T01:25:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.032+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.032+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x7faa98071020 2024-09-18T01:25:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.032+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.032+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fbb720 2024-09-18T01:25:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.033+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.033+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fc0110 2024-09-18T01:25:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.033+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.033+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fc4ac0 2024-09-18T01:25:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.033+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.033+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fc4ac0 2024-09-18T01:25:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.033+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.033+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x7faa98071020 2024-09-18T01:25:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.034+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.034+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fc4ac0 2024-09-18T01:25:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.034+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.034+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fc4ac0 2024-09-18T01:25:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.034+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.034+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fbb720 2024-09-18T01:25:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.034+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.034+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fbb720 2024-09-18T01:25:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.034+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.034+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x7faa98071020 2024-09-18T01:25:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.035+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.035+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fc4ac0 2024-09-18T01:25:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.035+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.035+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fc0110 2024-09-18T01:25:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.035+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.035+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fbb720 2024-09-18T01:25:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.035+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.035+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x7faa98071020 2024-09-18T01:25:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.036+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.036+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fc4ac0 2024-09-18T01:25:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.036+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.036+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x7faa98071020 2024-09-18T01:25:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.036+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.036+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fc0110 2024-09-18T01:25:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.036+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.036+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fc4ac0 2024-09-18T01:25:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.036+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.036+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x7faa98071020 2024-09-18T01:25:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fbb720 2024-09-18T01:25:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b725fbf3b0 con 0x55b725fc0110 2024-09-18T01:25:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa9c30800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa9c30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa9c30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa9c30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa9c30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa9c30800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:33.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa9c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725fc33d0 con 0x55b725fbb720 2024-09-18T01:25:33.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa9c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa9c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.037+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725fc37c0 con 0x55b725fbb720 2024-09-18T01:25:33.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:33.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725fc37c0 con 0x7faa98071020 2024-09-18T01:25:33.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:33.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 20 zone default found 2024-09-18T01:25:33.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 4 Realm: () 2024-09-18T01:25:33.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:33.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:33.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:33.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 20 zonegroup default 2024-09-18T01:25:33.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725fc3030 con 0x7faa98071020 2024-09-18T01:25:33.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.038+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725fc94b0 con 0x55b725fc4ac0 2024-09-18T01:25:33.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.039+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.039+0000 7faaa9c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.039+0000 7faaa9c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.039+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725fc9850 con 0x55b725fc4ac0 2024-09-18T01:25:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.039+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.039+0000 7faaa9c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.039+0000 7faaa9c30800 20 started sync module instance, tier type = 2024-09-18T01:25:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.039+0000 7faaa9c30800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.039+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fc8950 con 0x55b725fc0110 2024-09-18T01:25:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.040+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.040+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94245104682144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fc9bf0 con 0x55b725fc0110 2024-09-18T01:25:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.040+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fca4a0 con 0x55b725fbb720 2024-09-18T01:25:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.041+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94245104682144] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.041+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.041+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94245104689040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fca8c0 con 0x55b725fbb720 2024-09-18T01:25:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.041+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fcb300 con 0x55b725fc4ac0 2024-09-18T01:25:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.042+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94245104689040] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.043+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.043+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94245104692688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fcb6f0 con 0x55b725fc4ac0 2024-09-18T01:25:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.043+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fcc110 con 0x55b725fc0110 2024-09-18T01:25:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.044+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94245104692688] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.044+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.044+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94245104684352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fcc9e0 con 0x55b725fc0110 2024-09-18T01:25:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.044+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fcd2b0 con 0x55b725fbb720 2024-09-18T01:25:33.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.045+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.045+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94245104684352] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.045+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94245104699872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fcce00 con 0x55b725fbb720 2024-09-18T01:25:33.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.045+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fcc570 con 0x7faa98071020 2024-09-18T01:25:33.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.046+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.046+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94245104704880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fcc530 con 0x7faa98071020 2024-09-18T01:25:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.046+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fcec60 con 0x7faa98071020 2024-09-18T01:25:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.046+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94245104699872] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.047+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94245104704880] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.047+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.047+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94245104705936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fce7b0 con 0x7faa98071020 2024-09-18T01:25:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.047+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fcf170 con 0x7faa98071020 2024-09-18T01:25:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.048+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94245104705936] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.048+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.048+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94245104703136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fcf170 con 0x7faa98071020 2024-09-18T01:25:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.048+0000 7faaa9c30800 20 add_watcher() i=0 2024-09-18T01:25:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.048+0000 7faaa9c30800 20 add_watcher() i=1 2024-09-18T01:25:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.048+0000 7faaa9c30800 20 add_watcher() i=2 2024-09-18T01:25:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.048+0000 7faaa9c30800 20 add_watcher() i=3 2024-09-18T01:25:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.048+0000 7faaa9c30800 20 add_watcher() i=4 2024-09-18T01:25:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.048+0000 7faaa9c30800 20 add_watcher() i=5 2024-09-18T01:25:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.048+0000 7faaa9c30800 20 add_watcher() i=6 2024-09-18T01:25:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.049+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94245104703136] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.049+0000 7faaa9c30800 20 add_watcher() i=7 2024-09-18T01:25:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.049+0000 7faaa9c30800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.049+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b725fd2490 con 0x55b725fbb720 2024-09-18T01:25:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.049+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.050+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94245104709168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fcf700 con 0x55b725fbb720 2024-09-18T01:25:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.050+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94245104709168] v33'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.051+0000 7fa95afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.051+0000 7faaa9c30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.051+0000 7faaa9c30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.051+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fd1dc0 con 0x55b725fbb720 2024-09-18T01:25:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.052+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'47 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.052+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdb630 con 0x7faa98071020 2024-09-18T01:25:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.053+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.053+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdba90 con 0x55b725fc4ac0 2024-09-18T01:25:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.054+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.054+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdc380 con 0x55b725fbb720 2024-09-18T01:25:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.055+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'146 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.055+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdacd0 con 0x55b725fc0110 2024-09-18T01:25:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.056+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'47 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.056+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdacd0 con 0x55b725fc4ac0 2024-09-18T01:25:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.057+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'39 uv16 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.057+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdce80 con 0x55b725fbb720 2024-09-18T01:25:33.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.058+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.058+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdcf10 con 0x7faa98071020 2024-09-18T01:25:33.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.059+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.059+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdcfa0 con 0x55b725fc0110 2024-09-18T01:25:33.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.060+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.060+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdd030 con 0x55b725fc4ac0 2024-09-18T01:25:33.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.061+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.061+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdd5c0 con 0x55b725fc0110 2024-09-18T01:25:33.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.062+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'48 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.062+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdd5a0 con 0x7faa98071020 2024-09-18T01:25:33.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.063+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.063+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdd5a0 con 0x55b725fc0110 2024-09-18T01:25:33.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.064+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.064+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdd5a0 con 0x7faa98071020 2024-09-18T01:25:33.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.065+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'46 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.065+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdd5a0 con 0x55b725fbb720 2024-09-18T01:25:33.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.066+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'147 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.066+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fdd5a0 con 0x55b725fc4ac0 2024-09-18T01:25:33.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.067+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'41 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.067+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fddbb0 con 0x55b725fc0110 2024-09-18T01:25:33.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.068+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'49 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.068+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fddb50 con 0x55b725fc4ac0 2024-09-18T01:25:33.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.069+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'29 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.069+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fddb50 con 0x55b725fbb720 2024-09-18T01:25:33.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.070+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.070+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fddb50 con 0x55b725fbb720 2024-09-18T01:25:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.071+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'148 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.071+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fddb50 con 0x55b725fc4ac0 2024-09-18T01:25:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.072+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.072+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fddb50 con 0x55b725fc0110 2024-09-18T01:25:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.073+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'33 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.073+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fddb50 con 0x55b725fc4ac0 2024-09-18T01:25:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.074+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.074+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fddb50 con 0x55b725fc4ac0 2024-09-18T01:25:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.075+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.075+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fda710 con 0x55b725fc4ac0 2024-09-18T01:25:33.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.076+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.076+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fda710 con 0x55b725fc4ac0 2024-09-18T01:25:33.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.077+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'40 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.077+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fda710 con 0x7faa98071020 2024-09-18T01:25:33.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.078+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.078+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fda710 con 0x55b725fc4ac0 2024-09-18T01:25:33.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.079+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.079+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fda710 con 0x7faa98071020 2024-09-18T01:25:33.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.080+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'35 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.080+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fda710 con 0x55b725fc4ac0 2024-09-18T01:25:33.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.081+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.081+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fda710 con 0x7faa98071020 2024-09-18T01:25:33.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.082+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'47 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.082+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fda710 con 0x55b725fc0110 2024-09-18T01:25:33.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.083+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.084+0000 7fa959fe3640 20 reqs_thread_entry: start 2024-09-18T01:25:33.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.084+0000 7faaa9c30800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:33.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.084+0000 7faaa9c30800 20 Filter name: none 2024-09-18T01:25:33.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.084+0000 7fa8cb7fe640 20 reqs_thread_entry: start 2024-09-18T01:25:33.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.084+0000 7faaa9c30800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:25:33.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.084+0000 7faaa9c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.084+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7260089b0 con 0x55b725fc0110 2024-09-18T01:25:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.084+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.084+0000 7faaa9c30800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.084+0000 7faaa9c30800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:25:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.084+0000 7faaa9c30800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.084+0000 7faaa9c30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 : miss 2024-09-18T01:25:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.084+0000 7faaa9c30800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.084+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:95 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b72600a420 con 0x7faa98071020 2024-09-18T01:25:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(95 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa9c30800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa9c30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa9c30800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa9c30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa9c30800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa9c30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 2024-09-18T01:25:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa9c30800 20 get_obj_state: octx=0x7faa9805ef30 obj=myfoo:four state=0x55b72600b708 s->prefetch_data=0 2024-09-18T01:25:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:96 3.fs0 3:f2fef2f9:::153b7754-209b-4898-8796-577da7c1273d.4237.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b72600c530 con 0x55b725fc0110 2024-09-18T01:25:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(96 153b7754-209b-4898-8796-577da7c1273d.4237.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+867 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa9c30800 10 manifest: total_size = 4 2024-09-18T01:25:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa9c30800 20 get_obj_state: setting s->obj_tag to 153b7754-209b-4898-8796-577da7c1273d.4237.12889779842137212582 2024-09-18T01:25:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa9c30800 20 get_obj_state: octx=0x7faa9805ef30 obj=myfoo:four state=0x55b72600b708 s->prefetch_data=0 2024-09-18T01:25:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa9c30800 20 prepare_atomic_modification: state is not atomic. state=0x55b72600b708 2024-09-18T01:25:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa9c30800 20 bucket index object: :.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6 2024-09-18T01:25:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.085+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:97 4.38 4:1e3fd869:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b726010e70 con 0x55b725fbb720 2024-09-18T01:25:33.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.086+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(97 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6 [stat,call,call] v33'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.086+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:98 3.fs0 3:f2fef2f9:::153b7754-209b-4898-8796-577da7c1273d.4237.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b726010e70 con 0x55b725fc0110 2024-09-18T01:25:33.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.088+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(98 153b7754-209b-4898-8796-577da7c1273d.4237.1_four [call] v33'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.088+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:99 4.38 4:1e3fd869:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b726011900 con 0x55b725fbb720 2024-09-18T01:25:33.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.089+0000 7fa95afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:33.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.089+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94245104709168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b726011900 con 0x55b725fbb720 2024-09-18T01:25:33.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.089+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(99 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6 [stat,call,call] v33'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.089+0000 7fa97bfff640 20 handle_completion(): completion ok for obj=four 2024-09-18T01:25:33.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.090+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94245104709168] v33'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.090+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94245104682144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b726011900 con 0x55b725fc0110 2024-09-18T01:25:33.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.091+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94245104682144] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.091+0000 7faaa9c30800 20 remove_watcher() i=0 2024-09-18T01:25:33.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.091+0000 7faaa9c30800 2 removed watcher, disabling cache 2024-09-18T01:25:33.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.091+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94245104689040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b726011900 con 0x55b725fbb720 2024-09-18T01:25:33.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.092+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94245104689040] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.092+0000 7faaa9c30800 20 remove_watcher() i=1 2024-09-18T01:25:33.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.092+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94245104692688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b726011900 con 0x55b725fc4ac0 2024-09-18T01:25:33.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.093+0000 7faa9ffff640 1 -- 172.21.15.100:0/755765127 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94245104692688] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa90051070 con 0x55b725fc4ac0 2024-09-18T01:25:33.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.093+0000 7faaa9c30800 20 remove_watcher() i=2 2024-09-18T01:25:33.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.093+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94245104684352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b726011900 con 0x55b725fc0110 2024-09-18T01:25:33.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.094+0000 7faaa4f4b640 1 -- 172.21.15.100:0/755765127 <== osd.2 v2:172.21.15.100:6808/3104327688 23 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94245104684352] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa98088060 con 0x55b725fc0110 2024-09-18T01:25:33.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.094+0000 7faaa9c30800 20 remove_watcher() i=3 2024-09-18T01:25:33.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.094+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94245104699872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b726011900 con 0x55b725fbb720 2024-09-18T01:25:33.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.096+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94245104699872] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x55b725fbb720 2024-09-18T01:25:33.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.096+0000 7faaa9c30800 20 remove_watcher() i=4 2024-09-18T01:25:33.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.096+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94245104704880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b726011900 con 0x7faa98071020 2024-09-18T01:25:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.097+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94245104704880] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.097+0000 7faaa9c30800 20 remove_watcher() i=5 2024-09-18T01:25:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.097+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94245104705936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fc9f90 con 0x7faa98071020 2024-09-18T01:25:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.097+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94245104705936] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.097+0000 7faaa9c30800 20 remove_watcher() i=6 2024-09-18T01:25:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.097+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94245104703136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b725fcadd0 con 0x7faa98071020 2024-09-18T01:25:33.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.098+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94245104703136] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaa000a4a0 con 0x7faa98071020 2024-09-18T01:25:33.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.098+0000 7faaa9c30800 20 remove_watcher() i=7 2024-09-18T01:25:33.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.098+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7faa98071020 msgr2=0x7faa980723f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.098+0000 7faaa9c30800 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7faa98071020 0x7faa980723f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.098+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b725fbb720 msgr2=0x55b725fbdbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.098+0000 7faaa9c30800 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b725fbb720 0x55b725fbdbe0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.098+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b725fc0110 msgr2=0x55b725fc2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b725fc0110 0x55b725fc2500 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b725fc4ac0 msgr2=0x55b725fc6f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b725fc4ac0 0x55b725fc6f80 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa970036af0 msgr2=0x7fa970038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa970036af0 0x7fa970038fb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55b725f8e900 tx=0x7faa9006b040 comp rx=0 tx=0).stop 2024-09-18T01:25:33.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725fa8f30 msgr2=0x55b725fb01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725fa8f30 0x55b725fb01d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7faa9801a6d0 tx=0x7faa98044ef0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa574c640 1 -- 172.21.15.100:0/755765127 reap_dead start 2024-09-18T01:25:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 shutdown_connections 2024-09-18T01:25:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 --2- 172.21.15.100:0/755765127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725fa8f30 0x55b725fb01d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 >> 172.21.15.100:0/755765127 conn(0x55b725fa52e0 msgr2=0x55b725fa33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 shutdown_connections 2024-09-18T01:25:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/755765127 wait complete. 2024-09-18T01:25:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/443552105 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa97c036b90 msgr2=0x7fa97c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 --2- 172.21.15.100:0/443552105 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa97c036b90 0x7fa97c039050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55b725f827e0 tx=0x7faa90005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/443552105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725f9c2b0 msgr2=0x55b725f9c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 --2- 172.21.15.100:0/443552105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725f9c2b0 0x55b725f9c6d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7faa9800eb40 tx=0x7faa9800ef60 comp rx=0 tx=0).stop 2024-09-18T01:25:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/443552105 shutdown_connections 2024-09-18T01:25:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 --2- 172.21.15.100:0/443552105 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa97c036b90 0x7fa97c039050 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 --2- 172.21.15.100:0/443552105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725f9c2b0 0x55b725f9c6d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/443552105 >> 172.21.15.100:0/443552105 conn(0x55b725f91240 msgr2=0x55b725f93dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/443552105 shutdown_connections 2024-09-18T01:25:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/443552105 wait complete. 2024-09-18T01:25:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b725f8ba10 msgr2=0x55b725f8de00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b725f8ba10 0x55b725f8de00 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b725e88920 msgr2=0x55b725f852f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.099+0000 7faaa9c30800 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b725e88920 0x55b725f852f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.100+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b725f87b20 msgr2=0x55b725f89f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.100+0000 7faaa9c30800 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b725f87b20 0x55b725f89f10 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.100+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa98c036b40 msgr2=0x7fa98c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.100+0000 7faaa9c30800 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa98c036b40 0x7fa98c039000 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faa90057000 tx=0x7faa90052000 comp rx=0 tx=0).stop 2024-09-18T01:25:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.100+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e844e0 msgr2=0x55b725f7e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.100+0000 7faaa9c30800 1 --2- 172.21.15.100:0/1128545067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b725e844e0 0x55b725f7e280 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7faa98000f60 tx=0x7faa98000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.100+0000 7faaa574c640 1 -- 172.21.15.100:0/1128545067 reap_dead start 2024-09-18T01:25:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.100+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 shutdown_connections 2024-09-18T01:25:33.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.100+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 >> 172.21.15.100:0/1128545067 conn(0x55b725e7fdd0 msgr2=0x55b725f6d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.100+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 shutdown_connections 2024-09-18T01:25:33.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.100+0000 7faaa9c30800 1 -- 172.21.15.100:0/1128545067 wait complete. 2024-09-18T01:25:33.109 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T01:25:33.109 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T01:25:33.109 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-18T01:25:33.153 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:33.153 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.153+0000 7fd4faf19800 1 Processor -- start 2024-09-18T01:25:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.153+0000 7fd4faf19800 1 -- start start 2024-09-18T01:25:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.153+0000 7fd4faf19800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5615b9aff4c0 0x5615b9aff8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.153+0000 7fd4faf19800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5615b99bfb30 con 0x5615b9affe00 2024-09-18T01:25:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.153+0000 7fd4faf19800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5615b99a1360 con 0x5615b9aff4c0 2024-09-18T01:25:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.153+0000 7fd4f8a0d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5615b9aff4c0 0x5615b9aff8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.153+0000 7fd4f3fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5615b9affe00 0x5615b9b04980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37450/0 (socket says 172.21.15.100:37450) 2024-09-18T01:25:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.153+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2524106795 learned_addr learned my addr 172.21.15.100:0/2524106795 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.153+0000 7fd4f8a0d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5615b9aff4c0 0x5615b9aff8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38786/0 (socket says 172.21.15.100:38786) 2024-09-18T01:25:33.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.154+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2524106795 >> v1:172.21.15.92:6789/0 conn(0x5615b9affe00 legacy=0x5615b9b04980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.154+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2524106795 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615b99c7e00 con 0x5615b9aff4c0 2024-09-18T01:25:33.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.154+0000 7fd4f37fe640 1 -- 172.21.15.100:0/2524106795 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 196544312 0 0) 0x5615b99bfb30 con 0x5615b9affe00 2024-09-18T01:25:33.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.155+0000 7fd4f8a0d640 1 --2- 172.21.15.100:0/2524106795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 0x5615b9aff8c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00a470 tx=0x7fd4ec045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2db59c4728f9be server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.156+0000 7fd4f37fe640 1 -- 172.21.15.100:0/2524106795 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec053570 con 0x5615b9aff4c0 2024-09-18T01:25:33.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.156+0000 7fd4f37fe640 1 -- 172.21.15.100:0/2524106795 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec058070 con 0x5615b9aff4c0 2024-09-18T01:25:33.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.156+0000 7fd4f37fe640 1 -- 172.21.15.100:0/2524106795 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec053880 con 0x5615b9aff4c0 2024-09-18T01:25:33.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.156+0000 7fd4faf19800 1 -- 172.21.15.100:0/2524106795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 msgr2=0x5615b9aff8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.156+0000 7fd4faf19800 1 --2- 172.21.15.100:0/2524106795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 0x5615b9aff8c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00a470 tx=0x7fd4ec045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:33.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.156+0000 7fd4faf19800 1 -- 172.21.15.100:0/2524106795 shutdown_connections 2024-09-18T01:25:33.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.156+0000 7fd4faf19800 1 --2- 172.21.15.100:0/2524106795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 0x5615b9aff8c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.156+0000 7fd4faf19800 1 -- 172.21.15.100:0/2524106795 >> 172.21.15.100:0/2524106795 conn(0x5615b9afadf0 msgr2=0x5615b9afd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.156+0000 7fd4faf19800 1 -- 172.21.15.100:0/2524106795 shutdown_connections 2024-09-18T01:25:33.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.156+0000 7fd4faf19800 1 -- 172.21.15.100:0/2524106795 wait complete. 2024-09-18T01:25:33.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.169+0000 7fd4faf19800 1 Processor -- start 2024-09-18T01:25:33.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.170+0000 7fd4faf19800 1 -- start start 2024-09-18T01:25:33.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.170+0000 7fd4faf19800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 0x5615b9bee530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.170+0000 7fd4faf19800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5615b9a4c330 con 0x5615b9aff4c0 2024-09-18T01:25:33.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.170+0000 7fd4f8a0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 0x5615b9bee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.170+0000 7fd4f8a0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 0x5615b9bee530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38798/0 (socket says 172.21.15.100:38798) 2024-09-18T01:25:33.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.170+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/3391815217 learned_addr learned my addr 172.21.15.100:0/3391815217 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.170+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/3391815217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615b9999bc0 con 0x5615b9aff4c0 2024-09-18T01:25:33.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.171+0000 7fd4f8a0d640 1 --2- 172.21.15.100:0/3391815217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 0x5615b9bee530 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec005870 tx=0x7fd4ec051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d9d1b85f48bf44 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.171+0000 7fd3e6e05640 1 -- 172.21.15.100:0/3391815217 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec05c580 con 0x5615b9aff4c0 2024-09-18T01:25:33.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.171+0000 7fd3e6e05640 1 -- 172.21.15.100:0/3391815217 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec063030 con 0x5615b9aff4c0 2024-09-18T01:25:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.171+0000 7fd3e6e05640 1 -- 172.21.15.100:0/3391815217 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec05c850 con 0x5615b9aff4c0 2024-09-18T01:25:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.171+0000 7fd4faf19800 1 -- 172.21.15.100:0/3391815217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 msgr2=0x5615b9bee530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.171+0000 7fd4faf19800 1 --2- 172.21.15.100:0/3391815217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 0x5615b9bee530 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec005870 tx=0x7fd4ec051000 comp rx=0 tx=0).stop 2024-09-18T01:25:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.171+0000 7fd4faf19800 1 -- 172.21.15.100:0/3391815217 shutdown_connections 2024-09-18T01:25:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.171+0000 7fd4faf19800 1 --2- 172.21.15.100:0/3391815217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 0x5615b9bee530 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.171+0000 7fd4faf19800 1 -- 172.21.15.100:0/3391815217 >> 172.21.15.100:0/3391815217 conn(0x5615b9afadf0 msgr2=0x5615b9be9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.172+0000 7fd4faf19800 1 -- 172.21.15.100:0/3391815217 shutdown_connections 2024-09-18T01:25:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.172+0000 7fd4faf19800 1 -- 172.21.15.100:0/3391815217 wait complete. 2024-09-18T01:25:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.172+0000 7fd4faf19800 1 Processor -- start 2024-09-18T01:25:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.172+0000 7fd4faf19800 1 -- start start 2024-09-18T01:25:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.172+0000 7fd4faf19800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 0x5615b9bf5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.172+0000 7fd4faf19800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5615b9b064e0 con 0x5615b9aff4c0 2024-09-18T01:25:33.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.172+0000 7fd4f8a0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 0x5615b9bf5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.172+0000 7fd4f8a0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 0x5615b9bf5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38810/0 (socket says 172.21.15.100:38810) 2024-09-18T01:25:33.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.172+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/1289532964 learned_addr learned my addr 172.21.15.100:0/1289532964 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.173+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/1289532964 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615b99adfe0 con 0x5615b9aff4c0 2024-09-18T01:25:33.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.173+0000 7fd4f8a0d640 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 0x5615b9bf5df0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec025c20 tx=0x7fd4ec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.173+0000 7fd3e5602640 1 -- 172.21.15.100:0/1289532964 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec05cb70 con 0x5615b9aff4c0 2024-09-18T01:25:33.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.173+0000 7fd3e5602640 1 -- 172.21.15.100:0/1289532964 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec05cd10 con 0x5615b9aff4c0 2024-09-18T01:25:33.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.173+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615b9bf6330 con 0x5615b9aff4c0 2024-09-18T01:25:33.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.173+0000 7fd3e5602640 1 -- 172.21.15.100:0/1289532964 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec06a630 con 0x5615b9aff4c0 2024-09-18T01:25:33.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.173+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615b9bf68b0 con 0x5615b9aff4c0 2024-09-18T01:25:33.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.174+0000 7fd3e5602640 1 -- 172.21.15.100:0/1289532964 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd4ec06a7d0 con 0x5615b9aff4c0 2024-09-18T01:25:33.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.174+0000 7fd3e5602640 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3e0036b90 0x7fd3e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.174+0000 7fd3e5602640 1 -- 172.21.15.100:0/1289532964 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fd4ec072070 con 0x5615b9aff4c0 2024-09-18T01:25:33.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.174+0000 7fd4f3fff640 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3e0036b90 0x7fd3e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.174+0000 7fd4faf19800 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5615b9affe00 0x5615b9bfbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.174+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9bfc330 con 0x5615b9affe00 2024-09-18T01:25:33.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.174+0000 7fd4f920e640 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5615b9affe00 0x5615b9bfbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.174+0000 7fd4f3fff640 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3e0036b90 0x7fd3e0039050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4000c00 tx=0x7fd4e40013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.175+0000 7fd4f920e640 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5615b9affe00 0x5615b9bfbdb0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.175+0000 7fd4f920e640 1 -- 172.21.15.100:0/1289532964 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9affe00 2024-09-18T01:25:33.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.175+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9bf9360 con 0x5615b9affe00 2024-09-18T01:25:33.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.175+0000 7fd4f920e640 1 -- 172.21.15.100:0/1289532964 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9affe00 2024-09-18T01:25:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.175+0000 7fd4faf19800 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5615b9bfe6b0 0x5615b9c00aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.175+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c01190 con 0x5615b9bfe6b0 2024-09-18T01:25:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.175+0000 7fd4f8a0d640 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5615b9bfe6b0 0x5615b9c00aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.175+0000 7fd4f8a0d640 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5615b9bfe6b0 0x5615b9c00aa0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.176+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/1289532964 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd4ec07c020 con 0x5615b9bfe6b0 2024-09-18T01:25:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.176+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9bfd550 con 0x5615b9affe00 2024-09-18T01:25:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.176+0000 7fd4f920e640 1 -- 172.21.15.100:0/1289532964 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9affe00 2024-09-18T01:25:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.176+0000 7fd4faf19800 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5615b9c025f0 0x5615b9c049e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.176+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c050e0 con 0x5615b9c025f0 2024-09-18T01:25:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.176+0000 7fd4f3fff640 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5615b9c025f0 0x5615b9c049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.177+0000 7fd4f3fff640 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5615b9c025f0 0x5615b9c049e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.177+0000 7fd4f3fff640 1 -- 172.21.15.100:0/1289532964 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd4e400f670 con 0x5615b9c025f0 2024-09-18T01:25:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.177+0000 7fd4faf19800 1 Processor -- start 2024-09-18T01:25:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.177+0000 7fd4faf19800 1 -- start start 2024-09-18T01:25:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.177+0000 7fd4faf19800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c12e90 0x5615b9c132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.177+0000 7fd4faf19800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5615b999b580 con 0x5615b9c12e90 2024-09-18T01:25:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.177+0000 7fd4f8a0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c12e90 0x5615b9c132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.178+0000 7fd4f8a0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c12e90 0x5615b9c132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38824/0 (socket says 172.21.15.100:38824) 2024-09-18T01:25:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.178+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/929168162 learned_addr learned my addr 172.21.15.100:0/929168162 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.178+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/929168162 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615b9c137f0 con 0x5615b9c12e90 2024-09-18T01:25:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.178+0000 7fd4f8a0d640 1 --2- 172.21.15.100:0/929168162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c12e90 0x5615b9c132b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec091410 tx=0x7fd4ec07f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.178+0000 7fd3de7fc640 1 -- 172.21.15.100:0/929168162 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec053e30 con 0x5615b9c12e90 2024-09-18T01:25:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.178+0000 7fd3de7fc640 1 -- 172.21.15.100:0/929168162 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec06acd0 con 0x5615b9c12e90 2024-09-18T01:25:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.178+0000 7fd4faf19800 1 -- 172.21.15.100:0/929168162 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615b9c13a80 con 0x5615b9c12e90 2024-09-18T01:25:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.178+0000 7fd3de7fc640 1 -- 172.21.15.100:0/929168162 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec091720 con 0x5615b9c12e90 2024-09-18T01:25:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.178+0000 7fd4faf19800 1 -- 172.21.15.100:0/929168162 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615b9c16760 con 0x5615b9c12e90 2024-09-18T01:25:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.179+0000 7fd3de7fc640 1 -- 172.21.15.100:0/929168162 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd4ec0918c0 con 0x5615b9c12e90 2024-09-18T01:25:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.179+0000 7fd3de7fc640 1 --2- 172.21.15.100:0/929168162 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3d0036b90 0x7fd3d0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.179+0000 7fd3de7fc640 1 -- 172.21.15.100:0/929168162 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fd4ec09bc50 con 0x5615b9c12e90 2024-09-18T01:25:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.179+0000 7fd4f3fff640 1 --2- 172.21.15.100:0/929168162 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3d0036b90 0x7fd3d0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.179+0000 7fd4faf19800 1 Processor -- start 2024-09-18T01:25:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.179+0000 7fd4f3fff640 1 --2- 172.21.15.100:0/929168162 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3d0036b90 0x7fd3d0039050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5615b9bfcc60 tx=0x7fd4e4006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.179+0000 7fd4faf19800 1 -- start start 2024-09-18T01:25:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.180+0000 7fd4faf19800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c1f9c0 0x5615b9c1fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.180+0000 7fd4faf19800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5615b9beec80 con 0x5615b9c1f9c0 2024-09-18T01:25:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.180+0000 7fd4f8a0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c1f9c0 0x5615b9c1fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.180+0000 7fd4f8a0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c1f9c0 0x5615b9c1fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38834/0 (socket says 172.21.15.100:38834) 2024-09-18T01:25:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.180+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/283767575 learned_addr learned my addr 172.21.15.100:0/283767575 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.180+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/283767575 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615b9c20390 con 0x5615b9c1f9c0 2024-09-18T01:25:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.180+0000 7fd4f8a0d640 1 --2- 172.21.15.100:0/283767575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c1f9c0 0x5615b9c1fdc0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec07fbd0 tx=0x7fd4ec0768a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b344fd101fbaea server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.180+0000 7fd3cffff640 1 -- 172.21.15.100:0/283767575 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec07c2b0 con 0x5615b9c1f9c0 2024-09-18T01:25:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.180+0000 7fd3cffff640 1 -- 172.21.15.100:0/283767575 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec084de0 con 0x5615b9c1f9c0 2024-09-18T01:25:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.180+0000 7fd3cffff640 1 -- 172.21.15.100:0/283767575 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec0780c0 con 0x5615b9c1f9c0 2024-09-18T01:25:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.181+0000 7fd4faf19800 1 -- 172.21.15.100:0/283767575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c1f9c0 msgr2=0x5615b9c1fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.181+0000 7fd4faf19800 1 --2- 172.21.15.100:0/283767575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c1f9c0 0x5615b9c1fdc0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec07fbd0 tx=0x7fd4ec0768a0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.181+0000 7fd4faf19800 1 -- 172.21.15.100:0/283767575 shutdown_connections 2024-09-18T01:25:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.181+0000 7fd4faf19800 1 --2- 172.21.15.100:0/283767575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c1f9c0 0x5615b9c1fdc0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.181+0000 7fd4faf19800 1 -- 172.21.15.100:0/283767575 >> 172.21.15.100:0/283767575 conn(0x5615b9c1bd70 msgr2=0x5615b9c19e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.181+0000 7fd4faf19800 1 -- 172.21.15.100:0/283767575 shutdown_connections 2024-09-18T01:25:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.181+0000 7fd4faf19800 1 -- 172.21.15.100:0/283767575 wait complete. 2024-09-18T01:25:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.181+0000 7fd4faf19800 1 Processor -- start 2024-09-18T01:25:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.181+0000 7fd4faf19800 1 -- start start 2024-09-18T01:25:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.181+0000 7fd4faf19800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c1f9c0 0x5615b9c26c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.181+0000 7fd4faf19800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5615b9c207e0 con 0x5615b9c1f9c0 2024-09-18T01:25:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.182+0000 7fd4f8a0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c1f9c0 0x5615b9c26c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.182+0000 7fd4f8a0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c1f9c0 0x5615b9c26c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38844/0 (socket says 172.21.15.100:38844) 2024-09-18T01:25:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.182+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 learned_addr learned my addr 172.21.15.100:0/2535690573 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.182+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615b9c27160 con 0x5615b9c1f9c0 2024-09-18T01:25:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.182+0000 7fd4f8a0d640 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c1f9c0 0x5615b9c26c20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec078370 tx=0x7fd4ec086f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.182+0000 7fd3ce7fc640 1 -- 172.21.15.100:0/2535690573 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec0a8070 con 0x5615b9c1f9c0 2024-09-18T01:25:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.182+0000 7fd3ce7fc640 1 -- 172.21.15.100:0/2535690573 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec091dc0 con 0x5615b9c1f9c0 2024-09-18T01:25:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.182+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615b9c27160 con 0x5615b9c1f9c0 2024-09-18T01:25:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.182+0000 7fd3ce7fc640 1 -- 172.21.15.100:0/2535690573 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec08ec70 con 0x5615b9c1f9c0 2024-09-18T01:25:33.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.182+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615b9c27160 con 0x5615b9c1f9c0 2024-09-18T01:25:33.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.183+0000 7fd3ce7fc640 1 -- 172.21.15.100:0/2535690573 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd4ec0ba070 con 0x5615b9c1f9c0 2024-09-18T01:25:33.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.183+0000 7fd3ce7fc640 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3c4036b90 0x7fd3c4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.183+0000 7fd3ce7fc640 1 -- 172.21.15.100:0/2535690573 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fd4ec0ab050 con 0x5615b9c1f9c0 2024-09-18T01:25:33.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.184+0000 7fd4f3fff640 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3c4036b90 0x7fd3c4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.184+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.184+0000 7fd4faf19800 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5615b9c32350 0x5615b9c34810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.184+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c34f60 con 0x5615b9c32350 2024-09-18T01:25:33.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.184+0000 7fd4f920e640 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5615b9c32350 0x5615b9c34810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.184+0000 7fd4f3fff640 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3c4036b90 0x7fd3c4039050 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x5615b9c054e0 tx=0x7fd4e4023040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.184+0000 7fd4f920e640 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5615b9c32350 0x5615b9c34810 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.184+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.184+0000 7fd4faf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.184+0000 7fd4faf19800 20 realm 2024-09-18T01:25:33.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.184+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.184+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35370 con 0x5615b9c32350 2024-09-18T01:25:33.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4faf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4faf19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:33.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35c40 con 0x5615b9c32350 2024-09-18T01:25:33.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4faf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c32350 2024-09-18T01:25:33.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4faf19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:33.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4faf19800 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5615b9c36ad0 0x5615b9c38ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c39620 con 0x5615b9c36ad0 2024-09-18T01:25:33.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.185+0000 7fd4f8a0d640 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5615b9c36ad0 0x5615b9c38ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.186+0000 7fd4f8a0d640 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5615b9c36ad0 0x5615b9c38ec0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.186+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd4ec0c3020 con 0x5615b9c36ad0 2024-09-18T01:25:33.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.186+0000 7fd4faf19800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:33.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.186+0000 7fd4faf19800 20 searching for the correct realm 2024-09-18T01:25:33.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.186+0000 7fd4faf19800 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5615b9c3b6d0 0x5615b9c3db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.186+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c3e260 con 0x5615b9c3b6d0 2024-09-18T01:25:33.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.186+0000 7fd4f3fff640 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5615b9c3b6d0 0x5615b9c3db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.186+0000 7fd4f3fff640 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5615b9c3b6d0 0x5615b9c3db90 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.187+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.187+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c3e260 con 0x5615b9c36ad0 2024-09-18T01:25:33.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.187+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec0c3020 con 0x5615b9c36ad0 2024-09-18T01:25:33.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.187+0000 7fd4f8a0d640 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd4ec08b070 0x7fd4ec0b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.187+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c3e260 con 0x7fd4ec08b070 2024-09-18T01:25:33.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.187+0000 7fd4f920e640 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd4ec08b070 0x7fd4ec0b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.187+0000 7fd4f920e640 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd4ec08b070 0x7fd4ec0b92c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.188+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.188+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c32350 2024-09-18T01:25:33.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.188+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.188+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c32350 2024-09-18T01:25:33.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.188+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.188+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x7fd4ec08b070 2024-09-18T01:25:33.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.188+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.188+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x7fd4ec08b070 2024-09-18T01:25:33.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.189+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.189+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c36ad0 2024-09-18T01:25:33.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.189+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec0c3020 con 0x5615b9c36ad0 2024-09-18T01:25:33.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.189+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c3b6d0 2024-09-18T01:25:33.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.189+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.189+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c32350 2024-09-18T01:25:33.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.189+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.189+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x7fd4ec08b070 2024-09-18T01:25:33.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.190+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.190+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c32350 2024-09-18T01:25:33.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.190+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.190+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c36ad0 2024-09-18T01:25:33.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.190+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd4ec0c3020 con 0x5615b9c36ad0 2024-09-18T01:25:33.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.190+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c3b6d0 2024-09-18T01:25:33.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.190+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.190+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c3b6d0 2024-09-18T01:25:33.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.191+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.191+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x7fd4ec08b070 2024-09-18T01:25:33.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.191+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.191+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c3b6d0 2024-09-18T01:25:33.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.191+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.191+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c3b6d0 2024-09-18T01:25:33.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.191+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.191+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c32350 2024-09-18T01:25:33.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.192+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.192+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c32350 2024-09-18T01:25:33.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.192+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.192+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x7fd4ec08b070 2024-09-18T01:25:33.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.192+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.192+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c3b6d0 2024-09-18T01:25:33.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.192+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.192+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c36ad0 2024-09-18T01:25:33.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.192+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec0d6040 con 0x5615b9c36ad0 2024-09-18T01:25:33.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.193+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c32350 2024-09-18T01:25:33.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.193+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.193+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x7fd4ec08b070 2024-09-18T01:25:33.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.193+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.193+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c3b6d0 2024-09-18T01:25:33.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.193+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.193+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x7fd4ec08b070 2024-09-18T01:25:33.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.193+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.193+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c36ad0 2024-09-18T01:25:33.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.194+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec0d6040 con 0x5615b9c36ad0 2024-09-18T01:25:33.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.194+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c3b6d0 2024-09-18T01:25:33.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.194+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.194+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x7fd4ec08b070 2024-09-18T01:25:33.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.194+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.194+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c32350 2024-09-18T01:25:33.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.194+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.194+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c35fe0 con 0x5615b9c36ad0 2024-09-18T01:25:33.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd4ec0d6040 con 0x5615b9c36ad0 2024-09-18T01:25:33.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:33.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:33.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:33.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:33.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:33.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:33.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c39fd0 con 0x5615b9c32350 2024-09-18T01:25:33.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c3a3c0 con 0x5615b9c32350 2024-09-18T01:25:33.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:33.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c3a3c0 con 0x7fd4ec08b070 2024-09-18T01:25:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 zone default found 2024-09-18T01:25:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 4 Realm: () 2024-09-18T01:25:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 zonegroup default 2024-09-18T01:25:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.195+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c3a7e0 con 0x7fd4ec08b070 2024-09-18T01:25:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.196+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.196+0000 7fd4faf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.196+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.196+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c3ac00 con 0x5615b9c3b6d0 2024-09-18T01:25:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.196+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.196+0000 7fd4faf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.196+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.196+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c400c0 con 0x5615b9c3b6d0 2024-09-18T01:25:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.196+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.196+0000 7fd4faf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.196+0000 7fd4faf19800 20 started sync module instance, tier type = 2024-09-18T01:25:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.196+0000 7fd4faf19800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.196+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c3f560 con 0x5615b9c36ad0 2024-09-18T01:25:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.197+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec0d6040 con 0x5615b9c36ad0 2024-09-18T01:25:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.197+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94651310930304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c3f1c0 con 0x5615b9c36ad0 2024-09-18T01:25:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.197+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c40fb0 con 0x5615b9c32350 2024-09-18T01:25:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.198+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94651310930304] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec0d6040 con 0x5615b9c36ad0 2024-09-18T01:25:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.199+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.199+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94651310934656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c40f70 con 0x5615b9c32350 2024-09-18T01:25:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.199+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c41a40 con 0x5615b9c3b6d0 2024-09-18T01:25:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.200+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.200+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94651310937456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c42310 con 0x5615b9c3b6d0 2024-09-18T01:25:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.200+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c42df0 con 0x5615b9c36ad0 2024-09-18T01:25:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.200+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94651310934656] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.201+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94651310937456] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.201+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec0d6040 con 0x5615b9c36ad0 2024-09-18T01:25:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.201+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94651310939744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c42900 con 0x5615b9c36ad0 2024-09-18T01:25:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.201+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c436c0 con 0x5615b9c32350 2024-09-18T01:25:33.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.202+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.202+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94651310939744] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec0d6040 con 0x5615b9c36ad0 2024-09-18T01:25:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.202+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94651310944784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c43ae0 con 0x5615b9c32350 2024-09-18T01:25:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.202+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c40460 con 0x7fd4ec08b070 2024-09-18T01:25:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.203+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.203+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94651310948560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c40460 con 0x7fd4ec08b070 2024-09-18T01:25:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.203+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94651310944784] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.203+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c45000 con 0x7fd4ec08b070 2024-09-18T01:25:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.204+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94651310948560] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.206+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.206+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94651310945968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c44b10 con 0x7fd4ec08b070 2024-09-18T01:25:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.206+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c454d0 con 0x7fd4ec08b070 2024-09-18T01:25:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.207+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94651310945968] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.207+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.207+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94651310949616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c454d0 con 0x7fd4ec08b070 2024-09-18T01:25:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.207+0000 7fd4faf19800 20 add_watcher() i=0 2024-09-18T01:25:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.207+0000 7fd4faf19800 20 add_watcher() i=1 2024-09-18T01:25:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.207+0000 7fd4faf19800 20 add_watcher() i=2 2024-09-18T01:25:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.207+0000 7fd4faf19800 20 add_watcher() i=3 2024-09-18T01:25:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.207+0000 7fd4faf19800 20 add_watcher() i=4 2024-09-18T01:25:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.207+0000 7fd4faf19800 20 add_watcher() i=5 2024-09-18T01:25:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.207+0000 7fd4faf19800 20 add_watcher() i=6 2024-09-18T01:25:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.208+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94651310949616] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.208+0000 7fd4faf19800 20 add_watcher() i=7 2024-09-18T01:25:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.208+0000 7fd4faf19800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.208+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c487f0 con 0x5615b9c32350 2024-09-18T01:25:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.209+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.209+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94651310952848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c45a60 con 0x5615b9c32350 2024-09-18T01:25:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.210+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94651310952848] v33'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.210+0000 7fd3aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.210+0000 7fd4faf19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.210+0000 7fd4faf19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.210+0000 7fd4faf19800 5 note: GC not initialized 2024-09-18T01:25:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.210+0000 7fd3adfe3640 20 reqs_thread_entry: start 2024-09-18T01:25:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.210+0000 7fd4faf19800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.210+0000 7fd4faf19800 20 Filter name: none 2024-09-18T01:25:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.210+0000 7fd31f7fe640 20 reqs_thread_entry: start 2024-09-18T01:25:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.210+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.210+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c7bb90 con 0x5615b9c36ad0 2024-09-18T01:25:33.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.211+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd4ec0d6040 con 0x5615b9c36ad0 2024-09-18T01:25:33.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.211+0000 7fd4faf19800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:33.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.211+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.211+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c7c4c0 con 0x7fd4ec08b070 2024-09-18T01:25:33.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.211+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(63 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.211+0000 7fd4faf19800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:33.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.211+0000 7fd4faf19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:25:33.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.211+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.211+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c7c500 con 0x5615b9c36ad0 2024-09-18T01:25:33.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd4ec0d6040 con 0x5615b9c36ad0 2024-09-18T01:25:33.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:33.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:65 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c7dc20 con 0x7fd4ec08b070 2024-09-18T01:25:33.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(65 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:33.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:25:33.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 4.6 4:626e9aa1:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c7d280 con 0x5615b9c3b6d0 2024-09-18T01:25:33.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 4.32 4:4c543ff0:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c82790 con 0x5615b9c32350 2024-09-18T01:25:33.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 4.16 4:68657b5e:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c850c0 con 0x5615b9c3b6d0 2024-09-18T01:25:33.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 4.27 4:e6db7ecc:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c879e0 con 0x5615b9c32350 2024-09-18T01:25:33.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 4.2d 4:b5379837:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c8a730 con 0x7fd4ec08b070 2024-09-18T01:25:33.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 4.28 4:14044b5f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c8a730 con 0x5615b9c32350 2024-09-18T01:25:33.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 4.38 4:1e3fd869:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c8fb30 con 0x5615b9c32350 2024-09-18T01:25:33.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:73 4.35 4:ae848ed2:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c92560 con 0x5615b9c32350 2024-09-18T01:25:33.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 4.1 4:8077271a:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c94f90 con 0x5615b9c36ad0 2024-09-18T01:25:33.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.212+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 4.27 4:e7380930:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c97980 con 0x5615b9c32350 2024-09-18T01:25:33.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.213+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.213+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:76 4.2e 4:76537098:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c97980 con 0x5615b9c3b6d0 2024-09-18T01:25:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.213+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(68 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.213+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(70 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.213+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(67 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.213+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(74 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd4ec0d6040 con 0x5615b9c36ad0 2024-09-18T01:25:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.213+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(76 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.213+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(69 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.213+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(71 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.213+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(72 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.213+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(73 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.213+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(75 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.1.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.214+0000 7fd3aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.214+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94651310952848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c7daf0 con 0x5615b9c32350 2024-09-18T01:25:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.215+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94651310952848] v33'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.215+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94651310930304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c795b0 con 0x5615b9c36ad0 2024-09-18T01:25:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.216+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94651310930304] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec0d6040 con 0x5615b9c36ad0 2024-09-18T01:25:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.216+0000 7fd4faf19800 20 remove_watcher() i=0 2024-09-18T01:25:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.216+0000 7fd4faf19800 2 removed watcher, disabling cache 2024-09-18T01:25:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.216+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94651310934656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c795b0 con 0x5615b9c32350 2024-09-18T01:25:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.217+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94651310934656] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.217+0000 7fd4faf19800 20 remove_watcher() i=1 2024-09-18T01:25:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.217+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94651310937456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c795b0 con 0x5615b9c3b6d0 2024-09-18T01:25:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.218+0000 7fd4f3fff640 1 -- 172.21.15.100:0/2535690573 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94651310937456] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e4037040 con 0x5615b9c3b6d0 2024-09-18T01:25:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.218+0000 7fd4faf19800 20 remove_watcher() i=2 2024-09-18T01:25:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.218+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94651310939744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c795b0 con 0x5615b9c36ad0 2024-09-18T01:25:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.219+0000 7fd4f8a0d640 1 -- 172.21.15.100:0/2535690573 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94651310939744] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec0d6040 con 0x5615b9c36ad0 2024-09-18T01:25:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.219+0000 7fd4faf19800 20 remove_watcher() i=3 2024-09-18T01:25:33.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.219+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94651310944784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c795b0 con 0x5615b9c32350 2024-09-18T01:25:33.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.220+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94651310944784] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x5615b9c32350 2024-09-18T01:25:33.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.220+0000 7fd4faf19800 20 remove_watcher() i=4 2024-09-18T01:25:33.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.220+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94651310948560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c795b0 con 0x7fd4ec08b070 2024-09-18T01:25:33.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.221+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94651310948560] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.221+0000 7fd4faf19800 20 remove_watcher() i=5 2024-09-18T01:25:33.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.221+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94651310945968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c795b0 con 0x7fd4ec08b070 2024-09-18T01:25:33.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.222+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94651310945968] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.222+0000 7fd4faf19800 20 remove_watcher() i=6 2024-09-18T01:25:33.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.222+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94651310949616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615b9c795b0 con 0x7fd4ec08b070 2024-09-18T01:25:33.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94651310949616] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4a0 con 0x7fd4ec08b070 2024-09-18T01:25:33.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 20 remove_watcher() i=7 2024-09-18T01:25:33.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd4ec08b070 msgr2=0x7fd4ec0b92c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd4ec08b070 0x7fd4ec0b92c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5615b9c32350 msgr2=0x5615b9c34810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5615b9c32350 0x5615b9c34810 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5615b9c36ad0 msgr2=0x5615b9c38ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5615b9c36ad0 0x5615b9c38ec0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5615b9c3b6d0 msgr2=0x5615b9c3db90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5615b9c3b6d0 0x5615b9c3db90 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3c4036b90 msgr2=0x7fd3c4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3c4036b90 0x7fd3c4039050 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x5615b9c054e0 tx=0x7fd4e4023040 comp rx=0 tx=0).stop 2024-09-18T01:25:33.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c1f9c0 msgr2=0x5615b9c26c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4f920e640 1 -- 172.21.15.100:0/2535690573 reap_dead start 2024-09-18T01:25:33.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c1f9c0 0x5615b9c26c20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec078370 tx=0x7fd4ec086f20 comp rx=0 tx=0).stop 2024-09-18T01:25:33.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 shutdown_connections 2024-09-18T01:25:33.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 --2- 172.21.15.100:0/2535690573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c1f9c0 0x5615b9c26c20 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 >> 172.21.15.100:0/2535690573 conn(0x5615b9c1bd70 msgr2=0x5615b9c19e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 shutdown_connections 2024-09-18T01:25:33.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.223+0000 7fd4faf19800 1 -- 172.21.15.100:0/2535690573 wait complete. 2024-09-18T01:25:33.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/929168162 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3d0036b90 msgr2=0x7fd3d0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 --2- 172.21.15.100:0/929168162 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3d0036b90 0x7fd3d0039050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5615b9bfcc60 tx=0x7fd4e4006000 comp rx=0 tx=0).stop 2024-09-18T01:25:33.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/929168162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c12e90 msgr2=0x5615b9c132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 --2- 172.21.15.100:0/929168162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c12e90 0x5615b9c132b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec091410 tx=0x7fd4ec07f580 comp rx=0 tx=0).stop 2024-09-18T01:25:33.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/929168162 shutdown_connections 2024-09-18T01:25:33.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 --2- 172.21.15.100:0/929168162 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3d0036b90 0x7fd3d0039050 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 --2- 172.21.15.100:0/929168162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9c12e90 0x5615b9c132b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/929168162 >> 172.21.15.100:0/929168162 conn(0x5615b9c07e20 msgr2=0x5615b9c0a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/929168162 shutdown_connections 2024-09-18T01:25:33.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/929168162 wait complete. 2024-09-18T01:25:33.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5615b9c025f0 msgr2=0x5615b9c049e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5615b9c025f0 0x5615b9c049e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5615b9affe00 msgr2=0x5615b9bfbdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5615b9affe00 0x5615b9bfbdb0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5615b9bfe6b0 msgr2=0x5615b9c00aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5615b9bfe6b0 0x5615b9c00aa0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3e0036b90 msgr2=0x7fd3e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3e0036b90 0x7fd3e0039050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4000c00 tx=0x7fd4e40013b0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 msgr2=0x5615b9bf5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 --2- 172.21.15.100:0/1289532964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615b9aff4c0 0x5615b9bf5df0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec025c20 tx=0x7fd4ec002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4f920e640 1 -- 172.21.15.100:0/1289532964 reap_dead start 2024-09-18T01:25:33.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 shutdown_connections 2024-09-18T01:25:33.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 >> 172.21.15.100:0/1289532964 conn(0x5615b9afadf0 msgr2=0x5615b9be8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 shutdown_connections 2024-09-18T01:25:33.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.224+0000 7fd4faf19800 1 -- 172.21.15.100:0/1289532964 wait complete. 2024-09-18T01:25:33.238 INFO:teuthology.orchestra.run.smithi100.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"2d75eca1-60da-4ca3-af9b-0b09072c949e","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"153b7754-209b-4898-8796-577da7c1273d.4237.1","marker":"153b7754-209b-4898-8796-577da7c1273d.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-18T01:25:32.700651Z","creation_time":"2024-09-18T01:25:29.863166Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-18T01:25:33.238 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2d75eca1-60da-4ca3-af9b-0b09072c949e', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '153b7754-209b-4898-8796-577da7c1273d.4237.1', 'marker': '153b7754-209b-4898-8796-577da7c1273d.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:25:32.700651Z', 'creation_time': '2024-09-18T01:25:29.863166Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T01:25:33.238 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-18T01:25:33.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-18T01:25:33.238 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-18T01:25:33.280 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:33.280 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.280+0000 7f793cfa2800 1 Processor -- start 2024-09-18T01:25:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.280+0000 7f793cfa2800 1 -- start start 2024-09-18T01:25:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.280+0000 7f793cfa2800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558bfea9c4b0 0x558bfea9c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.280+0000 7f793cfa2800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558bfe95cb30 con 0x558bfea9cdf0 2024-09-18T01:25:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.280+0000 7f793cfa2800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x558bfe93e360 con 0x558bfea9c4b0 2024-09-18T01:25:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.281+0000 7f793aa96640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558bfea9c4b0 0x558bfea9c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.281+0000 7f793a295640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x558bfea9cdf0 0x558bfeaa1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37464/0 (socket says 172.21.15.100:37464) 2024-09-18T01:25:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.281+0000 7f793a295640 1 -- 172.21.15.100:0/3808446090 learned_addr learned my addr 172.21.15.100:0/3808446090 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.281+0000 7f793aa96640 1 -- 172.21.15.100:0/3808446090 >> v1:172.21.15.92:6789/0 conn(0x558bfea9cdf0 legacy=0x558bfeaa1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.281+0000 7f793aa96640 1 -- 172.21.15.100:0/3808446090 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bfe964e00 con 0x558bfea9c4b0 2024-09-18T01:25:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.283+0000 7f793aa96640 1 --2- 172.21.15.100:0/3808446090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 0x558bfea9c8b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f792c00a470 tx=0x7f792c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b564066d9e36ab67 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.283+0000 7f7939a94640 1 -- 172.21.15.100:0/3808446090 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f792c053570 con 0x558bfea9c4b0 2024-09-18T01:25:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.283+0000 7f7939a94640 1 -- 172.21.15.100:0/3808446090 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c058070 con 0x558bfea9c4b0 2024-09-18T01:25:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.283+0000 7f7939a94640 1 -- 172.21.15.100:0/3808446090 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f792c053880 con 0x558bfea9c4b0 2024-09-18T01:25:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.283+0000 7f793cfa2800 1 -- 172.21.15.100:0/3808446090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 msgr2=0x558bfea9c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.283+0000 7f793cfa2800 1 --2- 172.21.15.100:0/3808446090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 0x558bfea9c8b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f792c00a470 tx=0x7f792c045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.283+0000 7f793cfa2800 1 -- 172.21.15.100:0/3808446090 shutdown_connections 2024-09-18T01:25:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.283+0000 7f793cfa2800 1 --2- 172.21.15.100:0/3808446090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 0x558bfea9c8b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.283+0000 7f793cfa2800 1 -- 172.21.15.100:0/3808446090 >> 172.21.15.100:0/3808446090 conn(0x558bfea97de0 msgr2=0x558bfea9a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.283+0000 7f793cfa2800 1 -- 172.21.15.100:0/3808446090 shutdown_connections 2024-09-18T01:25:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.283+0000 7f793cfa2800 1 -- 172.21.15.100:0/3808446090 wait complete. 2024-09-18T01:25:33.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.297+0000 7f793cfa2800 1 Processor -- start 2024-09-18T01:25:33.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.297+0000 7f793cfa2800 1 -- start start 2024-09-18T01:25:33.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.297+0000 7f793cfa2800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 0x558bfea10d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.297+0000 7f793cfa2800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558bfe9e9320 con 0x558bfea9c4b0 2024-09-18T01:25:33.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.297+0000 7f793aa96640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 0x558bfea10d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.297+0000 7f793aa96640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 0x558bfea10d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38862/0 (socket says 172.21.15.100:38862) 2024-09-18T01:25:33.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.297+0000 7f793aa96640 1 -- 172.21.15.100:0/3356054556 learned_addr learned my addr 172.21.15.100:0/3356054556 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.298+0000 7f793aa96640 1 -- 172.21.15.100:0/3356054556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bfe936bc0 con 0x558bfea9c4b0 2024-09-18T01:25:33.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.298+0000 7f793aa96640 1 --2- 172.21.15.100:0/3356054556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 0x558bfea10d70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f792c025c20 tx=0x7f792c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d23a989ac130c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.298+0000 7f7828e09640 1 -- 172.21.15.100:0/3356054556 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f792c05c580 con 0x558bfea9c4b0 2024-09-18T01:25:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.298+0000 7f7828e09640 1 -- 172.21.15.100:0/3356054556 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c063030 con 0x558bfea9c4b0 2024-09-18T01:25:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.298+0000 7f7828e09640 1 -- 172.21.15.100:0/3356054556 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f792c05c850 con 0x558bfea9c4b0 2024-09-18T01:25:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.299+0000 7f793cfa2800 1 -- 172.21.15.100:0/3356054556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 msgr2=0x558bfea10d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.299+0000 7f793cfa2800 1 --2- 172.21.15.100:0/3356054556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 0x558bfea10d70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f792c025c20 tx=0x7f792c051000 comp rx=0 tx=0).stop 2024-09-18T01:25:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.299+0000 7f793cfa2800 1 -- 172.21.15.100:0/3356054556 shutdown_connections 2024-09-18T01:25:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.299+0000 7f793cfa2800 1 --2- 172.21.15.100:0/3356054556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 0x558bfea10d70 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.299+0000 7f793cfa2800 1 -- 172.21.15.100:0/3356054556 >> 172.21.15.100:0/3356054556 conn(0x558bfea97de0 msgr2=0x558bfeb87120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.299+0000 7f793cfa2800 1 -- 172.21.15.100:0/3356054556 shutdown_connections 2024-09-18T01:25:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.299+0000 7f793cfa2800 1 -- 172.21.15.100:0/3356054556 wait complete. 2024-09-18T01:25:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.299+0000 7f793cfa2800 1 Processor -- start 2024-09-18T01:25:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.299+0000 7f793cfa2800 1 -- start start 2024-09-18T01:25:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.299+0000 7f793cfa2800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 0x558bfeb8cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.299+0000 7f793cfa2800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558bfeaa34d0 con 0x558bfea9c4b0 2024-09-18T01:25:33.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.299+0000 7f793aa96640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 0x558bfeb8cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.299+0000 7f793aa96640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 0x558bfeb8cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38878/0 (socket says 172.21.15.100:38878) 2024-09-18T01:25:33.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.299+0000 7f793aa96640 1 -- 172.21.15.100:0/1624376711 learned_addr learned my addr 172.21.15.100:0/1624376711 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.300+0000 7f793aa96640 1 -- 172.21.15.100:0/1624376711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bfe94afe0 con 0x558bfea9c4b0 2024-09-18T01:25:33.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.300+0000 7f793aa96640 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 0x558bfeb8cec0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x558bfea10470 tx=0x7f792c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.300+0000 7f7827606640 1 -- 172.21.15.100:0/1624376711 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f792c054ad0 con 0x558bfea9c4b0 2024-09-18T01:25:33.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.300+0000 7f7827606640 1 -- 172.21.15.100:0/1624376711 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c054c70 con 0x558bfea9c4b0 2024-09-18T01:25:33.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.300+0000 7f7827606640 1 -- 172.21.15.100:0/1624376711 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f792c068420 con 0x558bfea9c4b0 2024-09-18T01:25:33.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.300+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558bfeb8b5b0 con 0x558bfea9c4b0 2024-09-18T01:25:33.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.300+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bfeb8bad0 con 0x558bfea9c4b0 2024-09-18T01:25:33.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.301+0000 7f7827606640 1 -- 172.21.15.100:0/1624376711 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f792c0685c0 con 0x558bfea9c4b0 2024-09-18T01:25:33.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.301+0000 7f7827606640 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7820036b40 0x7f7820039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.301+0000 7f7827606640 1 -- 172.21.15.100:0/1624376711 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f792c070030 con 0x558bfea9c4b0 2024-09-18T01:25:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.301+0000 7f793a295640 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7820036b40 0x7f7820039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.301+0000 7f793cfa2800 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558bfea9cdf0 0x558bfeb9d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.301+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfeb9dae0 con 0x558bfea9cdf0 2024-09-18T01:25:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.301+0000 7f793b297640 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558bfea9cdf0 0x558bfeb9d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.302+0000 7f793a295640 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7820036b40 0x7f7820039000 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7930000f60 tx=0x7f79300012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.302+0000 7f793b297640 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558bfea9cdf0 0x558bfeb9d5a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.302+0000 7f793b297640 1 -- 172.21.15.100:0/1624376711 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfea9cdf0 2024-09-18T01:25:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.302+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfeb9e330 con 0x558bfea9cdf0 2024-09-18T01:25:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.302+0000 7f793b297640 1 -- 172.21.15.100:0/1624376711 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfea9cdf0 2024-09-18T01:25:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.302+0000 7f793cfa2800 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558bfeb9fd60 0x558bfeba2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.302+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfeba2920 con 0x558bfeb9fd60 2024-09-18T01:25:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.302+0000 7f793aa96640 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558bfeb9fd60 0x558bfeba2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.303+0000 7f793aa96640 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558bfeb9fd60 0x558bfeba2190 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.303+0000 7f793aa96640 1 -- 172.21.15.100:0/1624376711 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f792c051070 con 0x558bfeb9fd60 2024-09-18T01:25:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.303+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfeb9eb80 con 0x558bfea9cdf0 2024-09-18T01:25:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.303+0000 7f793b297640 1 -- 172.21.15.100:0/1624376711 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfea9cdf0 2024-09-18T01:25:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.303+0000 7f793cfa2800 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558bfeba3d80 0x558bfeba6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.303+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfeba6860 con 0x558bfeba3d80 2024-09-18T01:25:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.303+0000 7f793a295640 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558bfeba3d80 0x558bfeba6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.304+0000 7f793a295640 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558bfeba3d80 0x558bfeba6170 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.304+0000 7f793a295640 1 -- 172.21.15.100:0/1624376711 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7930009050 con 0x558bfeba3d80 2024-09-18T01:25:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.304+0000 7f793cfa2800 1 Processor -- start 2024-09-18T01:25:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.304+0000 7f793cfa2800 1 -- start start 2024-09-18T01:25:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.305+0000 7f793cfa2800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebb4610 0x558bfebb4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.305+0000 7f793cfa2800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558bfeb8d400 con 0x558bfebb4610 2024-09-18T01:25:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.305+0000 7f793aa96640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebb4610 0x558bfebb4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.305+0000 7f793aa96640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebb4610 0x558bfebb4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38882/0 (socket says 172.21.15.100:38882) 2024-09-18T01:25:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.305+0000 7f793aa96640 1 -- 172.21.15.100:0/3371662573 learned_addr learned my addr 172.21.15.100:0/3371662573 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.305+0000 7f793aa96640 1 -- 172.21.15.100:0/3371662573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bfebb4f70 con 0x558bfebb4610 2024-09-18T01:25:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.305+0000 7f793aa96640 1 --2- 172.21.15.100:0/3371662573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebb4610 0x558bfebb4a30 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f792c025c20 tx=0x7f792c074860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.305+0000 7f7824e01640 1 -- 172.21.15.100:0/3371662573 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f792c095070 con 0x558bfebb4610 2024-09-18T01:25:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.305+0000 7f7824e01640 1 -- 172.21.15.100:0/3371662573 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c05e730 con 0x558bfebb4610 2024-09-18T01:25:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.305+0000 7f7824e01640 1 -- 172.21.15.100:0/3371662573 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f792c07db00 con 0x558bfebb4610 2024-09-18T01:25:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.305+0000 7f793cfa2800 1 -- 172.21.15.100:0/3371662573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558bfebb5200 con 0x558bfebb4610 2024-09-18T01:25:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.305+0000 7f793cfa2800 1 -- 172.21.15.100:0/3371662573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bfebb5200 con 0x558bfebb4610 2024-09-18T01:25:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.306+0000 7f7824e01640 1 -- 172.21.15.100:0/3371662573 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f792c098070 con 0x558bfebb4610 2024-09-18T01:25:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.306+0000 7f7824e01640 1 --2- 172.21.15.100:0/3371662573 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7814036b40 0x7f7814039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.306+0000 7f7824e01640 1 -- 172.21.15.100:0/3371662573 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f792c090e00 con 0x558bfebb4610 2024-09-18T01:25:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.306+0000 7f793a295640 1 --2- 172.21.15.100:0/3371662573 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7814036b40 0x7f7814039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.306+0000 7f793cfa2800 1 Processor -- start 2024-09-18T01:25:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.307+0000 7f793cfa2800 1 -- start start 2024-09-18T01:25:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.307+0000 7f793a295640 1 --2- 172.21.15.100:0/3371662573 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7814036b40 0x7f7814039000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f793000bf50 tx=0x7f793000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.307+0000 7f793cfa2800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebc0f50 0x558bfebc1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.307+0000 7f793cfa2800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558bfe938580 con 0x558bfebc0f50 2024-09-18T01:25:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.307+0000 7f793aa96640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebc0f50 0x558bfebc1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.307+0000 7f793aa96640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebc0f50 0x558bfebc1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38884/0 (socket says 172.21.15.100:38884) 2024-09-18T01:25:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.307+0000 7f793aa96640 1 -- 172.21.15.100:0/1058583167 learned_addr learned my addr 172.21.15.100:0/1058583167 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.307+0000 7f793aa96640 1 -- 172.21.15.100:0/1058583167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bfebc1900 con 0x558bfebc0f50 2024-09-18T01:25:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.307+0000 7f793aa96640 1 --2- 172.21.15.100:0/1058583167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebc0f50 0x558bfebc1330 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f792c067f90 tx=0x7f792c07a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bd5e00efda76e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.307+0000 7f781e7fc640 1 -- 172.21.15.100:0/1058583167 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f792c093bc0 con 0x558bfebc0f50 2024-09-18T01:25:33.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.307+0000 7f781e7fc640 1 -- 172.21.15.100:0/1058583167 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c06c0d0 con 0x558bfebc0f50 2024-09-18T01:25:33.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.307+0000 7f781e7fc640 1 -- 172.21.15.100:0/1058583167 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f792c093d60 con 0x558bfebc0f50 2024-09-18T01:25:33.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.308+0000 7f793cfa2800 1 -- 172.21.15.100:0/1058583167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebc0f50 msgr2=0x558bfebc1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.308+0000 7f793cfa2800 1 --2- 172.21.15.100:0/1058583167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebc0f50 0x558bfebc1330 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f792c067f90 tx=0x7f792c07a360 comp rx=0 tx=0).stop 2024-09-18T01:25:33.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.308+0000 7f793cfa2800 1 -- 172.21.15.100:0/1058583167 shutdown_connections 2024-09-18T01:25:33.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.308+0000 7f793cfa2800 1 --2- 172.21.15.100:0/1058583167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebc0f50 0x558bfebc1330 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.308+0000 7f793cfa2800 1 -- 172.21.15.100:0/1058583167 >> 172.21.15.100:0/1058583167 conn(0x558bfebbd300 msgr2=0x558bfebbb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.308+0000 7f793cfa2800 1 -- 172.21.15.100:0/1058583167 shutdown_connections 2024-09-18T01:25:33.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.308+0000 7f793cfa2800 1 -- 172.21.15.100:0/1058583167 wait complete. 2024-09-18T01:25:33.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.308+0000 7f793cfa2800 1 Processor -- start 2024-09-18T01:25:33.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.308+0000 7f793cfa2800 1 -- start start 2024-09-18T01:25:33.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.308+0000 7f793cfa2800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebc0f50 0x558bfebc8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.308+0000 7f793cfa2800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558bfebc1900 con 0x558bfebc0f50 2024-09-18T01:25:33.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.308+0000 7f793aa96640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebc0f50 0x558bfebc8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.308+0000 7f793aa96640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebc0f50 0x558bfebc8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38898/0 (socket says 172.21.15.100:38898) 2024-09-18T01:25:33.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.308+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 learned_addr learned my addr 172.21.15.100:0/2466179845 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.309+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bfebc85b0 con 0x558bfebc0f50 2024-09-18T01:25:33.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.309+0000 7f793aa96640 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebc0f50 0x558bfebc8070 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f792c07aa30 tx=0x7f792c067f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.309+0000 7f781cff9640 1 -- 172.21.15.100:0/2466179845 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f792c08ad00 con 0x558bfebc0f50 2024-09-18T01:25:33.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.309+0000 7f781cff9640 1 -- 172.21.15.100:0/2466179845 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c05c450 con 0x558bfebc0f50 2024-09-18T01:25:33.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.309+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558bfebc85b0 con 0x558bfebc0f50 2024-09-18T01:25:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.309+0000 7f781cff9640 1 -- 172.21.15.100:0/2466179845 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f792c05c770 con 0x558bfebc0f50 2024-09-18T01:25:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.309+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bfebc85b0 con 0x558bfebc0f50 2024-09-18T01:25:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.310+0000 7f781cff9640 1 -- 172.21.15.100:0/2466179845 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f792c0ae040 con 0x558bfebc0f50 2024-09-18T01:25:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.310+0000 7f781cff9640 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7804036af0 0x7f7804038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.310+0000 7f781cff9640 1 -- 172.21.15.100:0/2466179845 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f792c0ac020 con 0x558bfebc0f50 2024-09-18T01:25:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.310+0000 7f793a295640 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7804036af0 0x7f7804038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.310+0000 7f793cfa2800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.310+0000 7f793cfa2800 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558bfebd37b0 0x558bfebd5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.310+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd63c0 con 0x558bfebd37b0 2024-09-18T01:25:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.311+0000 7f793b297640 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558bfebd37b0 0x558bfebd5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.311+0000 7f793a295640 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7804036af0 0x7f7804038fb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7930001b60 tx=0x7f7930010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.311+0000 7f793b297640 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558bfebd37b0 0x558bfebd5c70 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.311+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.311+0000 7f793cfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.311+0000 7f793cfa2800 20 realm 2024-09-18T01:25:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.311+0000 7f793cfa2800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.311+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd67d0 con 0x558bfebd37b0 2024-09-18T01:25:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.311+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.311+0000 7f793cfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.311+0000 7f793cfa2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.311+0000 7f793cfa2800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.311+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd70a0 con 0x558bfebd37b0 2024-09-18T01:25:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.312+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.312+0000 7f793cfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.312+0000 7f793cfa2800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.312+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebd37b0 2024-09-18T01:25:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.312+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.312+0000 7f793cfa2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:33.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.312+0000 7f793cfa2800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.312+0000 7f793cfa2800 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558bfebd7f70 0x558bfebda360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.312+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfebdaaa0 con 0x558bfebd7f70 2024-09-18T01:25:33.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.312+0000 7f793aa96640 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558bfebd7f70 0x558bfebda360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.312+0000 7f793aa96640 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558bfebd7f70 0x558bfebda360 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.313+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.313+0000 7f793cfa2800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:33.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.313+0000 7f793cfa2800 20 searching for the correct realm 2024-09-18T01:25:33.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.313+0000 7f793cfa2800 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558bfebdcb00 0x558bfebdefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.313+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebdf670 con 0x558bfebdcb00 2024-09-18T01:25:33.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.313+0000 7f793a295640 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558bfebdcb00 0x558bfebdefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.313+0000 7f793a295640 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558bfebdcb00 0x558bfebdefa0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.313+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.313+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebdf670 con 0x558bfebd7f70 2024-09-18T01:25:33.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.314+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.314+0000 7f793aa96640 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f792c0b1040 0x7f792c09a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.314+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebdf670 con 0x7f792c0b1040 2024-09-18T01:25:33.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.314+0000 7f793b297640 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f792c0b1040 0x7f792c09a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.314+0000 7f793b297640 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f792c0b1040 0x7f792c09a8a0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.314+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.314+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebd37b0 2024-09-18T01:25:33.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.315+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.315+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebd37b0 2024-09-18T01:25:33.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.315+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.315+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x7f792c0b1040 2024-09-18T01:25:33.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.315+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.315+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x7f792c0b1040 2024-09-18T01:25:33.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.315+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.315+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebd7f70 2024-09-18T01:25:33.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.315+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.315+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebdcb00 2024-09-18T01:25:33.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.316+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.316+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebd37b0 2024-09-18T01:25:33.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.316+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.316+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x7f792c0b1040 2024-09-18T01:25:33.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.316+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.316+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebd37b0 2024-09-18T01:25:33.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.316+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.316+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebd7f70 2024-09-18T01:25:33.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.316+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.317+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebdcb00 2024-09-18T01:25:33.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.317+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.317+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebdcb00 2024-09-18T01:25:33.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.317+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.317+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x7f792c0b1040 2024-09-18T01:25:33.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.317+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.317+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebdcb00 2024-09-18T01:25:33.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.317+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.317+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebdcb00 2024-09-18T01:25:33.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.318+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.318+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebd37b0 2024-09-18T01:25:33.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.318+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.318+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebd37b0 2024-09-18T01:25:33.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.318+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.318+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x7f792c0b1040 2024-09-18T01:25:33.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.318+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.318+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebdcb00 2024-09-18T01:25:33.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.319+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.319+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebd7f70 2024-09-18T01:25:33.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.319+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.319+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebd37b0 2024-09-18T01:25:33.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.319+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.319+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x7f792c0b1040 2024-09-18T01:25:33.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.319+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.319+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebdcb00 2024-09-18T01:25:33.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.319+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.319+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x7f792c0b1040 2024-09-18T01:25:33.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.320+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.320+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebd7f70 2024-09-18T01:25:33.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.320+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.320+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebdcb00 2024-09-18T01:25:33.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.320+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.320+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x7f792c0b1040 2024-09-18T01:25:33.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.320+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.320+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebd37b0 2024-09-18T01:25:33.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebd7440 con 0x558bfebd7f70 2024-09-18T01:25:33.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793cfa2800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:33.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793cfa2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:33.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793cfa2800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:33.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793cfa2800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:33.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793cfa2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:33.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793cfa2800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:33.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793cfa2800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfebdb420 con 0x558bfebd37b0 2024-09-18T01:25:33.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793cfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793cfa2800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfebdb810 con 0x558bfebd37b0 2024-09-18T01:25:33.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793cfa2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:33.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793cfa2800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.321+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfebdb810 con 0x7f792c0b1040 2024-09-18T01:25:33.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:33.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 20 zone default found 2024-09-18T01:25:33.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 4 Realm: () 2024-09-18T01:25:33.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:33.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:33.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:33.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 20 zonegroup default 2024-09-18T01:25:33.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfebdbc30 con 0x7f792c0b1040 2024-09-18T01:25:33.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfebdc070 con 0x558bfebdcb00 2024-09-18T01:25:33.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.322+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe14d0 con 0x558bfebdcb00 2024-09-18T01:25:33.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.323+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.323+0000 7f793cfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.323+0000 7f793cfa2800 20 started sync module instance, tier type = 2024-09-18T01:25:33.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.323+0000 7f793cfa2800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:33.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.323+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe0970 con 0x558bfebd7f70 2024-09-18T01:25:33.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.324+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.324+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94059762683232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe1d20 con 0x558bfebd7f70 2024-09-18T01:25:33.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.324+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe2570 con 0x558bfebd37b0 2024-09-18T01:25:33.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.325+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94059762683232] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.325+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.325+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94059762688192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe2990 con 0x558bfebd37b0 2024-09-18T01:25:33.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.325+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe31e0 con 0x558bfebdcb00 2024-09-18T01:25:33.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.326+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94059762688192] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.326+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.326+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94059762689728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe35d0 con 0x558bfebdcb00 2024-09-18T01:25:33.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.326+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe3fd0 con 0x558bfebd7f70 2024-09-18T01:25:33.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.327+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.327+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94059762697152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebd7f70 2024-09-18T01:25:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.327+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe56d0 con 0x558bfebd37b0 2024-09-18T01:25:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.327+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94059762689728] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.328+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.328+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94059762700704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe5ac0 con 0x558bfebd37b0 2024-09-18T01:25:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.328+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe64c0 con 0x7f792c0b1040 2024-09-18T01:25:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.328+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94059762697152] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.329+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.329+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94059762698208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe6480 con 0x7f792c0b1040 2024-09-18T01:25:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.329+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe6ed0 con 0x7f792c0b1040 2024-09-18T01:25:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.329+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94059762700704] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.330+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94059762698208] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.330+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.330+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94059762706976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe6480 con 0x7f792c0b1040 2024-09-18T01:25:33.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.330+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe6e40 con 0x7f792c0b1040 2024-09-18T01:25:33.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.331+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94059762706976] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.331+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.331+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94059762704336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe63f0 con 0x7f792c0b1040 2024-09-18T01:25:33.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.331+0000 7f793cfa2800 20 add_watcher() i=0 2024-09-18T01:25:33.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.331+0000 7f793cfa2800 20 add_watcher() i=1 2024-09-18T01:25:33.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.331+0000 7f793cfa2800 20 add_watcher() i=2 2024-09-18T01:25:33.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.331+0000 7f793cfa2800 20 add_watcher() i=3 2024-09-18T01:25:33.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.331+0000 7f793cfa2800 20 add_watcher() i=4 2024-09-18T01:25:33.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.331+0000 7f793cfa2800 20 add_watcher() i=5 2024-09-18T01:25:33.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.331+0000 7f793cfa2800 20 add_watcher() i=6 2024-09-18T01:25:33.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.332+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94059762704336] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.332+0000 7f793cfa2800 20 add_watcher() i=7 2024-09-18T01:25:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.332+0000 7f793cfa2800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.332+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558bfebea7a0 con 0x558bfebd37b0 2024-09-18T01:25:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.333+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.333+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94059762709184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe7c00 con 0x558bfebd37b0 2024-09-18T01:25:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.334+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94059762709184] v33'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.334+0000 7f77f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.334+0000 7f793cfa2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.334+0000 7f793cfa2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.334+0000 7f793cfa2800 5 note: GC not initialized 2024-09-18T01:25:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.334+0000 7f776bfff640 20 reqs_thread_entry: start 2024-09-18T01:25:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.334+0000 7f793cfa2800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.334+0000 7f793cfa2800 20 Filter name: none 2024-09-18T01:25:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.334+0000 7f7769ffb640 20 reqs_thread_entry: start 2024-09-18T01:25:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.335+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfec1cff0 con 0x7f792c0b1040 2024-09-18T01:25:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.335+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(62 [pgnls start_epoch 33 out=254b] v33'47 uv30 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.335+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebdb420 con 0x7f792c0b1040 2024-09-18T01:25:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.335+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(63 [pgnls start_epoch 33 out=131b] v33'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.335+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebdb420 con 0x558bfebdcb00 2024-09-18T01:25:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.336+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 [pgnls start_epoch 33 out=295b] v33'35 uv27 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.336+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebdb420 con 0x7f792c0b1040 2024-09-18T01:25:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.336+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(65 [pgnls start_epoch 33 out=172b] v33'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.336+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebdb420 con 0x558bfebd37b0 2024-09-18T01:25:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.336+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(66 [pgnls start_epoch 33 out=335b] v33'152 uv29 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.336+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebdb420 con 0x558bfebd7f70 2024-09-18T01:25:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.337+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(67 [pgnls start_epoch 33 out=213b] v33'22 uv22 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.337+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebdcb00 2024-09-18T01:25:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.337+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(68 [pgnls start_epoch 33 out=254b] v33'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.337+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebdcb00 2024-09-18T01:25:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.337+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(69 [pgnls start_epoch 33 out=295b] v33'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.337+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebdcb00 2024-09-18T01:25:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.337+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(70 [pgnls start_epoch 33 out=213b] v33'16 uv16 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.337+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebd7f70 2024-09-18T01:25:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.338+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(71 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.338+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebd7f70 2024-09-18T01:25:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.338+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(72 [pgnls start_epoch 33 out=336b] v33'33 uv25 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.338+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebdcb00 2024-09-18T01:25:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.338+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(73 [pgnls start_epoch 33 out=131b] v33'29 uv21 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.338+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebdcb00 2024-09-18T01:25:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.338+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(74 [pgnls start_epoch 33 out=254b] v33'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.338+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebdcb00 2024-09-18T01:25:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.339+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(75 [pgnls start_epoch 33 out=90b] v33'29 uv21 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.339+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebd37b0 2024-09-18T01:25:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.339+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(76 [pgnls start_epoch 33 out=213b] v33'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.339+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebdcb00 2024-09-18T01:25:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.339+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(77 [pgnls start_epoch 33 out=254b] v33'16 uv16 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.339+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebd37b0 2024-09-18T01:25:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.339+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(78 [pgnls start_epoch 33 out=254b] v33'20 uv20 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.339+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebdcb00 2024-09-18T01:25:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.340+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(79 [pgnls start_epoch 33 out=213b] v33'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.340+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebdcb00 2024-09-18T01:25:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.340+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(80 [pgnls start_epoch 33 out=172b] v33'40 uv24 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.340+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebd37b0 2024-09-18T01:25:33.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.340+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(81 [pgnls start_epoch 33 out=295b] v33'47 uv39 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.340+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebd7f70 2024-09-18T01:25:33.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.341+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(82 [pgnls start_epoch 33 out=276b] v33'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.341+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebd7f70 2024-09-18T01:25:33.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.341+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(83 [pgnls start_epoch 33 out=172b] v33'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.341+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebd37b0 2024-09-18T01:25:33.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.341+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(84 [pgnls start_epoch 33 out=295b] v33'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.341+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x7f792c0b1040 2024-09-18T01:25:33.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.342+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(85 [pgnls start_epoch 33 out=172b] v33'35 uv18 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.342+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebd7f70 2024-09-18T01:25:33.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.342+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(86 [pgnls start_epoch 33 out=213b] v33'49 uv25 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.342+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x7f792c0b1040 2024-09-18T01:25:33.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.343+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(87 [pgnls start_epoch 33 out=172b] v33'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.343+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebdcb00 2024-09-18T01:25:33.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.343+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(88 [pgnls start_epoch 33 out=172b] v33'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.343+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebdcb00 2024-09-18T01:25:33.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.344+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(89 [pgnls start_epoch 33 out=90b] v33'19 uv11 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.344+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebdcb00 2024-09-18T01:25:33.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.344+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(90 [pgnls start_epoch 33 out=90b] v33'43 uv19 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.344+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebd37b0 2024-09-18T01:25:33.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.344+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(91 [pgnls start_epoch 33 out=131b] v33'13 uv12 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.344+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x558bfebd7f70 2024-09-18T01:25:33.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.344+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(92 [pgnls start_epoch 33 out=295b] v33'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.344+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe4c90 con 0x7f792c0b1040 2024-09-18T01:25:33.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.345+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(93 [pgnls start_epoch 33 out=213b] v33'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.358 INFO:teuthology.orchestra.run.smithi100.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-18T01:25:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.347+0000 7f77f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.347+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94059762709184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfec1b460 con 0x558bfebd37b0 2024-09-18T01:25:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.348+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94059762709184] v33'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.348+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94059762683232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfec1b460 con 0x558bfebd7f70 2024-09-18T01:25:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.349+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94059762683232] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.349+0000 7f793cfa2800 20 remove_watcher() i=0 2024-09-18T01:25:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.349+0000 7f793cfa2800 2 removed watcher, disabling cache 2024-09-18T01:25:33.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.349+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94059762688192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe0d60 con 0x558bfebd37b0 2024-09-18T01:25:33.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.350+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94059762688192] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.350+0000 7f793cfa2800 20 remove_watcher() i=1 2024-09-18T01:25:33.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.350+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94059762689728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe0d60 con 0x558bfebdcb00 2024-09-18T01:25:33.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.351+0000 7f793a295640 1 -- 172.21.15.100:0/2466179845 <== osd.3 v2:172.21.15.100:6816/595195757 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94059762689728] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7930009050 con 0x558bfebdcb00 2024-09-18T01:25:33.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.351+0000 7f793cfa2800 20 remove_watcher() i=2 2024-09-18T01:25:33.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.351+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94059762697152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe26c0 con 0x558bfebd7f70 2024-09-18T01:25:33.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.352+0000 7f793aa96640 1 -- 172.21.15.100:0/2466179845 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94059762697152] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c0a5030 con 0x558bfebd7f70 2024-09-18T01:25:33.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.352+0000 7f793cfa2800 20 remove_watcher() i=3 2024-09-18T01:25:33.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.352+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94059762700704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe43c0 con 0x558bfebd37b0 2024-09-18T01:25:33.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.353+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94059762700704] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x558bfebd37b0 2024-09-18T01:25:33.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.353+0000 7f793cfa2800 20 remove_watcher() i=4 2024-09-18T01:25:33.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.353+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94059762698208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe51a0 con 0x7f792c0b1040 2024-09-18T01:25:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.354+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94059762698208] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.354+0000 7f793cfa2800 20 remove_watcher() i=5 2024-09-18T01:25:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.354+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94059762706976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe51a0 con 0x7f792c0b1040 2024-09-18T01:25:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.355+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94059762706976] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.355+0000 7f793cfa2800 20 remove_watcher() i=6 2024-09-18T01:25:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.355+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94059762704336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558bfebe6a20 con 0x7f792c0b1040 2024-09-18T01:25:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94059762704336] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793400a4a0 con 0x7f792c0b1040 2024-09-18T01:25:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 20 remove_watcher() i=7 2024-09-18T01:25:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f792c0b1040 msgr2=0x7f792c09a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f792c0b1040 0x7f792c09a8a0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558bfebd37b0 msgr2=0x558bfebd5c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558bfebd37b0 0x558bfebd5c70 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558bfebd7f70 msgr2=0x558bfebda360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558bfebd7f70 0x558bfebda360 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558bfebdcb00 msgr2=0x558bfebdefa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x558bfebdcb00 0x558bfebdefa0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7804036af0 msgr2=0x7f7804038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7804036af0 0x7f7804038fb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7930001b60 tx=0x7f7930010000 comp rx=0 tx=0).stop 2024-09-18T01:25:33.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebc0f50 msgr2=0x558bfebc8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 --2- 172.21.15.100:0/2466179845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebc0f50 0x558bfebc8070 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f792c07aa30 tx=0x7f792c067f20 comp rx=0 tx=0).stop 2024-09-18T01:25:33.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 reap_dead start 2024-09-18T01:25:33.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793b297640 1 -- 172.21.15.100:0/2466179845 reap_dead start 2024-09-18T01:25:33.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 shutdown_connections 2024-09-18T01:25:33.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 >> 172.21.15.100:0/2466179845 conn(0x558bfebbd300 msgr2=0x558bfebbb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.356+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 shutdown_connections 2024-09-18T01:25:33.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/2466179845 wait complete. 2024-09-18T01:25:33.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/3371662573 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7814036b40 msgr2=0x7f7814039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 --2- 172.21.15.100:0/3371662573 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7814036b40 0x7f7814039000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f793000bf50 tx=0x7f793000f000 comp rx=0 tx=0).stop 2024-09-18T01:25:33.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/3371662573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebb4610 msgr2=0x558bfebb4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 --2- 172.21.15.100:0/3371662573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebb4610 0x558bfebb4a30 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f792c025c20 tx=0x7f792c074860 comp rx=0 tx=0).stop 2024-09-18T01:25:33.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/3371662573 shutdown_connections 2024-09-18T01:25:33.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 --2- 172.21.15.100:0/3371662573 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7814036b40 0x7f7814039000 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 --2- 172.21.15.100:0/3371662573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfebb4610 0x558bfebb4a30 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/3371662573 >> 172.21.15.100:0/3371662573 conn(0x558bfeba95a0 msgr2=0x558bfebac120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/3371662573 shutdown_connections 2024-09-18T01:25:33.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/3371662573 wait complete. 2024-09-18T01:25:33.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558bfeba3d80 msgr2=0x558bfeba6170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x558bfeba3d80 0x558bfeba6170 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558bfea9cdf0 msgr2=0x558bfeb9d5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558bfea9cdf0 0x558bfeb9d5a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558bfeb9fd60 msgr2=0x558bfeba2190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558bfeb9fd60 0x558bfeba2190 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7820036b40 msgr2=0x7f7820039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7820036b40 0x7f7820039000 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7930000f60 tx=0x7f79300012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 msgr2=0x558bfeb8cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 --2- 172.21.15.100:0/1624376711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bfea9c4b0 0x558bfeb8cec0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x558bfea10470 tx=0x7f792c002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793b297640 1 -- 172.21.15.100:0/1624376711 reap_dead start 2024-09-18T01:25:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 shutdown_connections 2024-09-18T01:25:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 >> 172.21.15.100:0/1624376711 conn(0x558bfea97de0 msgr2=0x558bfeb859b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 shutdown_connections 2024-09-18T01:25:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.357+0000 7f793cfa2800 1 -- 172.21.15.100:0/1624376711 wait complete. 2024-09-18T01:25:33.369 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-18T01:25:33.369 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-18T01:25:33.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-18T01:25:33.370 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-18T01:25:33.454 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:33.454 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:33.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.454+0000 7fbb75213800 1 Processor -- start 2024-09-18T01:25:33.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.454+0000 7fbb75213800 1 -- start start 2024-09-18T01:25:33.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.454+0000 7fbb75213800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x564c519c5990 0x564c519c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.454+0000 7fbb75213800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564c51881b30 con 0x564c519c1550 2024-09-18T01:25:33.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.454+0000 7fbb75213800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x564c51863360 con 0x564c519c5990 2024-09-18T01:25:33.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.454+0000 7fbb6bfff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x564c519c5990 0x564c519c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.454+0000 7fbb7099c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x564c519c1550 0x564c519c1950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37478/0 (socket says 172.21.15.100:37478) 2024-09-18T01:25:33.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.454+0000 7fbb7099c640 1 -- 172.21.15.100:0/419236213 learned_addr learned my addr 172.21.15.100:0/419236213 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:33.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.455+0000 7fbb6bfff640 1 -- 172.21.15.100:0/419236213 >> v1:172.21.15.92:6789/0 conn(0x564c519c1550 legacy=0x564c519c1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.455+0000 7fbb6b7fe640 1 -- 172.21.15.100:0/419236213 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1164254288 0 0) 0x564c51881b30 con 0x564c519c1550 2024-09-18T01:25:33.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.455+0000 7fbb6bfff640 1 -- 172.21.15.100:0/419236213 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c51889e00 con 0x564c519c5990 2024-09-18T01:25:33.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.456+0000 7fbb6bfff640 1 --2- 172.21.15.100:0/419236213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c5990 0x564c519c7d80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00a470 tx=0x7fbb5c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d27a7d2f859449d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.457+0000 7fbb6b7fe640 1 -- 172.21.15.100:0/419236213 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb5c053570 con 0x564c519c5990 2024-09-18T01:25:33.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.457+0000 7fbb6b7fe640 1 -- 172.21.15.100:0/419236213 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb5c058070 con 0x564c519c5990 2024-09-18T01:25:33.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.457+0000 7fbb6b7fe640 1 -- 172.21.15.100:0/419236213 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb5c053880 con 0x564c519c5990 2024-09-18T01:25:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.457+0000 7fbb75213800 1 -- 172.21.15.100:0/419236213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c5990 msgr2=0x564c519c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.457+0000 7fbb75213800 1 --2- 172.21.15.100:0/419236213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c5990 0x564c519c7d80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00a470 tx=0x7fbb5c045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.457+0000 7fbb75213800 1 -- 172.21.15.100:0/419236213 shutdown_connections 2024-09-18T01:25:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.457+0000 7fbb75213800 1 --2- 172.21.15.100:0/419236213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c5990 0x564c519c7d80 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.457+0000 7fbb75213800 1 -- 172.21.15.100:0/419236213 >> 172.21.15.100:0/419236213 conn(0x564c519bcde0 msgr2=0x564c519bf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.457+0000 7fbb75213800 1 -- 172.21.15.100:0/419236213 shutdown_connections 2024-09-18T01:25:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.457+0000 7fbb75213800 1 -- 172.21.15.100:0/419236213 wait complete. 2024-09-18T01:25:33.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.471+0000 7fbb75213800 1 Processor -- start 2024-09-18T01:25:33.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.471+0000 7fbb75213800 1 -- start start 2024-09-18T01:25:33.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.471+0000 7fbb75213800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c1550 0x564c51ab0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.471+0000 7fbb75213800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564c5190e330 con 0x564c519c1550 2024-09-18T01:25:33.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.471+0000 7fbb7099c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c1550 0x564c51ab0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.471+0000 7fbb7099c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c1550 0x564c51ab0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38906/0 (socket says 172.21.15.100:38906) 2024-09-18T01:25:33.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.471+0000 7fbb7099c640 1 -- 172.21.15.100:0/4245191613 learned_addr learned my addr 172.21.15.100:0/4245191613 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.472+0000 7fbb7099c640 1 -- 172.21.15.100:0/4245191613 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c5185bbc0 con 0x564c519c1550 2024-09-18T01:25:33.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.472+0000 7fbb7099c640 1 --2- 172.21.15.100:0/4245191613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c1550 0x564c51ab0550 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400b240 tx=0x7fbb6400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d3fb1ef6c7d749 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.472+0000 7fba5ee05640 1 -- 172.21.15.100:0/4245191613 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb64008070 con 0x564c519c1550 2024-09-18T01:25:33.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.472+0000 7fba5ee05640 1 -- 172.21.15.100:0/4245191613 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb6400d500 con 0x564c519c1550 2024-09-18T01:25:33.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.472+0000 7fba5ee05640 1 -- 172.21.15.100:0/4245191613 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb6400d860 con 0x564c519c1550 2024-09-18T01:25:33.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.473+0000 7fbb75213800 1 -- 172.21.15.100:0/4245191613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c1550 msgr2=0x564c51ab0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.473+0000 7fbb75213800 1 --2- 172.21.15.100:0/4245191613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c1550 0x564c51ab0550 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400b240 tx=0x7fbb6400b700 comp rx=0 tx=0).stop 2024-09-18T01:25:33.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.473+0000 7fbb75213800 1 -- 172.21.15.100:0/4245191613 shutdown_connections 2024-09-18T01:25:33.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.473+0000 7fbb75213800 1 --2- 172.21.15.100:0/4245191613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c1550 0x564c51ab0550 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.473+0000 7fbb75213800 1 -- 172.21.15.100:0/4245191613 >> 172.21.15.100:0/4245191613 conn(0x564c519bcde0 msgr2=0x564c51aabf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.473+0000 7fbb75213800 1 -- 172.21.15.100:0/4245191613 shutdown_connections 2024-09-18T01:25:33.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.473+0000 7fbb75213800 1 -- 172.21.15.100:0/4245191613 wait complete. 2024-09-18T01:25:33.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.473+0000 7fbb75213800 1 Processor -- start 2024-09-18T01:25:33.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.473+0000 7fbb75213800 1 -- start start 2024-09-18T01:25:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.474+0000 7fbb75213800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c1550 0x564c51ab7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.474+0000 7fbb75213800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564c519c85c0 con 0x564c519c1550 2024-09-18T01:25:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.474+0000 7fbb7099c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c1550 0x564c51ab7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.474+0000 7fbb7099c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c1550 0x564c51ab7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38922/0 (socket says 172.21.15.100:38922) 2024-09-18T01:25:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.474+0000 7fbb7099c640 1 -- 172.21.15.100:0/496671210 learned_addr learned my addr 172.21.15.100:0/496671210 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.474+0000 7fbb7099c640 1 -- 172.21.15.100:0/496671210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c5186ffe0 con 0x564c519c1550 2024-09-18T01:25:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.474+0000 7fbb7099c640 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c1550 0x564c51ab7fe0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x564c51ab13b0 tx=0x7fbb64000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.474+0000 7fba5d602640 1 -- 172.21.15.100:0/496671210 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb64019870 con 0x564c519c1550 2024-09-18T01:25:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.474+0000 7fba5d602640 1 -- 172.21.15.100:0/496671210 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb64019a10 con 0x564c519c1550 2024-09-18T01:25:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.474+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c51ab8520 con 0x564c519c1550 2024-09-18T01:25:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.474+0000 7fba5d602640 1 -- 172.21.15.100:0/496671210 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb64019d30 con 0x564c519c1550 2024-09-18T01:25:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.475+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c51ab8a40 con 0x564c519c1550 2024-09-18T01:25:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.475+0000 7fba5d602640 1 -- 172.21.15.100:0/496671210 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbb64017040 con 0x564c519c1550 2024-09-18T01:25:33.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.475+0000 7fba5d602640 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba58036b90 0x7fba58039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.475+0000 7fba5d602640 1 -- 172.21.15.100:0/496671210 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fbb64015020 con 0x564c519c1550 2024-09-18T01:25:33.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.476+0000 7fbb6bfff640 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba58036b90 0x7fba58039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.476+0000 7fbb75213800 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564c519c5990 0x564c51abf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.476+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51abf5d0 con 0x564c519c5990 2024-09-18T01:25:33.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.476+0000 7fbb7119d640 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564c519c5990 0x564c51abf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.476+0000 7fbb6bfff640 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba58036b90 0x7fba58039050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c057000 tx=0x7fbb5c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.476+0000 7fbb7119d640 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564c519c5990 0x564c51abf050 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.476+0000 7fbb7119d640 1 -- 172.21.15.100:0/496671210 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c519c5990 2024-09-18T01:25:33.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.476+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51abc620 con 0x564c519c5990 2024-09-18T01:25:33.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.477+0000 7fbb7119d640 1 -- 172.21.15.100:0/496671210 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c519c5990 2024-09-18T01:25:33.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.477+0000 7fbb75213800 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564c51ac1900 0x564c51ac3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.477+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51ac4390 con 0x564c51ac1900 2024-09-18T01:25:33.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.477+0000 7fbb7099c640 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564c51ac1900 0x564c51ac3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.477+0000 7fbb7099c640 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564c51ac1900 0x564c51ac3cf0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.477+0000 7fbb7099c640 1 -- 172.21.15.100:0/496671210 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51ac1900 2024-09-18T01:25:33.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.477+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51ac07a0 con 0x564c519c5990 2024-09-18T01:25:33.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.477+0000 7fbb7119d640 1 -- 172.21.15.100:0/496671210 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c519c5990 2024-09-18T01:25:33.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.478+0000 7fbb75213800 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564c51ac57f0 0x564c51ac7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.478+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51ac82e0 con 0x564c51ac57f0 2024-09-18T01:25:33.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.478+0000 7fbb6bfff640 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564c51ac57f0 0x564c51ac7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.478+0000 7fbb6bfff640 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564c51ac57f0 0x564c51ac7be0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.478+0000 7fbb6bfff640 1 -- 172.21.15.100:0/496671210 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51ac57f0 2024-09-18T01:25:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.479+0000 7fbb75213800 1 Processor -- start 2024-09-18T01:25:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.479+0000 7fbb75213800 1 -- start start 2024-09-18T01:25:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.479+0000 7fbb75213800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51936680 0x564c51ad9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.479+0000 7fbb75213800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564c5185d580 con 0x564c51936680 2024-09-18T01:25:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.479+0000 7fbb7099c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51936680 0x564c51ad9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.479+0000 7fbb7099c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51936680 0x564c51ad9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38936/0 (socket says 172.21.15.100:38936) 2024-09-18T01:25:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.479+0000 7fbb7099c640 1 -- 172.21.15.100:0/3987016241 learned_addr learned my addr 172.21.15.100:0/3987016241 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.479+0000 7fbb7099c640 1 -- 172.21.15.100:0/3987016241 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c51ada360 con 0x564c51936680 2024-09-18T01:25:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.479+0000 7fbb7099c640 1 --2- 172.21.15.100:0/3987016241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51936680 0x564c51ad9e20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbb6404b770 tx=0x7fbb6401aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.479+0000 7fba567fc640 1 -- 172.21.15.100:0/3987016241 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb6400eaa0 con 0x564c51936680 2024-09-18T01:25:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.479+0000 7fba567fc640 1 -- 172.21.15.100:0/3987016241 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb64034070 con 0x564c51936680 2024-09-18T01:25:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.479+0000 7fbb75213800 1 -- 172.21.15.100:0/3987016241 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c51ada590 con 0x564c51936680 2024-09-18T01:25:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.479+0000 7fba567fc640 1 -- 172.21.15.100:0/3987016241 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb6400ed70 con 0x564c51936680 2024-09-18T01:25:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.480+0000 7fbb75213800 1 -- 172.21.15.100:0/3987016241 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c51adaa90 con 0x564c51936680 2024-09-18T01:25:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.480+0000 7fba567fc640 1 -- 172.21.15.100:0/3987016241 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbb64036020 con 0x564c51936680 2024-09-18T01:25:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.480+0000 7fba567fc640 1 --2- 172.21.15.100:0/3987016241 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba48036b90 0x7fba48039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.480+0000 7fba567fc640 1 -- 172.21.15.100:0/3987016241 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fbb6404ecc0 con 0x564c51936680 2024-09-18T01:25:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.480+0000 7fbb6bfff640 1 --2- 172.21.15.100:0/3987016241 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba48036b90 0x7fba48039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.481+0000 7fbb75213800 1 Processor -- start 2024-09-18T01:25:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.481+0000 7fbb75213800 1 -- start start 2024-09-18T01:25:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.481+0000 7fbb6bfff640 1 --2- 172.21.15.100:0/3987016241 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba48036b90 0x7fba48039050 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x564c51abc540 tx=0x7fbb5c005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.481+0000 7fbb75213800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51ae3d90 0x564c51ae4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.481+0000 7fbb75213800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564c51ab0d00 con 0x564c51ae3d90 2024-09-18T01:25:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.481+0000 7fbb7099c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51ae3d90 0x564c51ae4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.481+0000 7fbb7099c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51ae3d90 0x564c51ae4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38940/0 (socket says 172.21.15.100:38940) 2024-09-18T01:25:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.481+0000 7fbb7099c640 1 -- 172.21.15.100:0/2241018195 learned_addr learned my addr 172.21.15.100:0/2241018195 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.481+0000 7fbb7099c640 1 -- 172.21.15.100:0/2241018195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c51ae46d0 con 0x564c51ae3d90 2024-09-18T01:25:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.481+0000 7fbb7099c640 1 --2- 172.21.15.100:0/2241018195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51ae3d90 0x564c51ae4190 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbb64001540 tx=0x7fbb6400fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddb8157d4a5c87e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.481+0000 7fba47fff640 1 -- 172.21.15.100:0/2241018195 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb6405c020 con 0x564c51ae3d90 2024-09-18T01:25:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.481+0000 7fba47fff640 1 -- 172.21.15.100:0/2241018195 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb6403f7d0 con 0x564c51ae3d90 2024-09-18T01:25:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.481+0000 7fba47fff640 1 -- 172.21.15.100:0/2241018195 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb6403f980 con 0x564c51ae3d90 2024-09-18T01:25:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.482+0000 7fbb75213800 1 -- 172.21.15.100:0/2241018195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51ae3d90 msgr2=0x564c51ae4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.482+0000 7fbb75213800 1 --2- 172.21.15.100:0/2241018195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51ae3d90 0x564c51ae4190 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbb64001540 tx=0x7fbb6400fa20 comp rx=0 tx=0).stop 2024-09-18T01:25:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.482+0000 7fbb75213800 1 -- 172.21.15.100:0/2241018195 shutdown_connections 2024-09-18T01:25:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.482+0000 7fbb75213800 1 --2- 172.21.15.100:0/2241018195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51ae3d90 0x564c51ae4190 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.482+0000 7fbb75213800 1 -- 172.21.15.100:0/2241018195 >> 172.21.15.100:0/2241018195 conn(0x564c51ae0140 msgr2=0x564c51ade240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.482+0000 7fbb75213800 1 -- 172.21.15.100:0/2241018195 shutdown_connections 2024-09-18T01:25:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.482+0000 7fbb75213800 1 -- 172.21.15.100:0/2241018195 wait complete. 2024-09-18T01:25:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.482+0000 7fbb75213800 1 Processor -- start 2024-09-18T01:25:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.482+0000 7fbb75213800 1 -- start start 2024-09-18T01:25:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.482+0000 7fbb75213800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51ae3d90 0x564c51ad7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.482+0000 7fbb75213800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564c51ae4bf0 con 0x564c51ae3d90 2024-09-18T01:25:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.483+0000 7fbb7099c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51ae3d90 0x564c51ad7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.483+0000 7fbb7099c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51ae3d90 0x564c51ad7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38950/0 (socket says 172.21.15.100:38950) 2024-09-18T01:25:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.483+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 learned_addr learned my addr 172.21.15.100:0/886660703 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.483+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c51ad5e40 con 0x564c51ae3d90 2024-09-18T01:25:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.483+0000 7fbb7099c640 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51ae3d90 0x564c51ad7750 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbb64027630 tx=0x7fbb6404a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.483+0000 7fba467fc640 1 -- 172.21.15.100:0/886660703 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb6403f980 con 0x564c51ae3d90 2024-09-18T01:25:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.483+0000 7fba467fc640 1 -- 172.21.15.100:0/886660703 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb640456b0 con 0x564c51ae3d90 2024-09-18T01:25:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.483+0000 7fba467fc640 1 -- 172.21.15.100:0/886660703 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb64045860 con 0x564c51ae3d90 2024-09-18T01:25:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.483+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c51ad5e40 con 0x564c51ae3d90 2024-09-18T01:25:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.483+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c51ad5e40 con 0x564c51ae3d90 2024-09-18T01:25:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.484+0000 7fba467fc640 1 -- 172.21.15.100:0/886660703 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbb6405f020 con 0x564c51ae3d90 2024-09-18T01:25:33.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.484+0000 7fba467fc640 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba3c036b90 0x7fba3c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.484+0000 7fba467fc640 1 -- 172.21.15.100:0/886660703 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fbb64067190 con 0x564c51ae3d90 2024-09-18T01:25:33.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.484+0000 7fbb6bfff640 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba3c036b90 0x7fba3c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.485+0000 7fbb6bfff640 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba3c036b90 0x7fba3c039050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x564c51ac86e0 tx=0x7fbb5c06b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.485+0000 7fbb75213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.485+0000 7fbb75213800 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564c51af8930 0x564c51afadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.485+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51afb540 con 0x564c51af8930 2024-09-18T01:25:33.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.485+0000 7fbb7119d640 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564c51af8930 0x564c51afadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb7119d640 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564c51af8930 0x564c51afadf0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb75213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb75213800 20 realm 2024-09-18T01:25:33.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb75213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51afb950 con 0x564c51af8930 2024-09-18T01:25:33.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb75213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb75213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:33.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb75213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc220 con 0x564c51af8930 2024-09-18T01:25:33.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb75213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb75213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51af8930 2024-09-18T01:25:33.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb75213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:33.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb75213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.486+0000 7fbb75213800 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564c51afd320 0x564c51aff710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.487+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51affd20 con 0x564c51afd320 2024-09-18T01:25:33.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.487+0000 7fbb7099c640 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564c51afd320 0x564c51aff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.487+0000 7fbb7099c640 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564c51afd320 0x564c51aff710 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.487+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.487+0000 7fbb75213800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:33.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.487+0000 7fbb75213800 20 searching for the correct realm 2024-09-18T01:25:33.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.487+0000 7fbb75213800 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564c51b01cd0 0x564c51b04190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.487+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51b04860 con 0x564c51b01cd0 2024-09-18T01:25:33.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.487+0000 7fbb6bfff640 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564c51b01cd0 0x564c51b04190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.488+0000 7fbb6bfff640 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564c51b01cd0 0x564c51b04190 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.488+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51b01cd0 2024-09-18T01:25:33.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.488+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51b04860 con 0x564c51afd320 2024-09-18T01:25:33.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.488+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.488+0000 7fbb7099c640 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbb64061050 0x7fbb6406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.488+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51b04860 con 0x7fbb64061050 2024-09-18T01:25:33.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.488+0000 7fbb7119d640 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbb64061050 0x7fbb6406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.489+0000 7fbb7119d640 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbb64061050 0x7fbb6406d900 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.489+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.489+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51af8930 2024-09-18T01:25:33.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.489+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.489+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51af8930 2024-09-18T01:25:33.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.489+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.489+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x7fbb64061050 2024-09-18T01:25:33.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.490+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.490+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x7fbb64061050 2024-09-18T01:25:33.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.490+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.490+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51afd320 2024-09-18T01:25:33.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.490+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.490+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51b01cd0 2024-09-18T01:25:33.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.490+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51b01cd0 2024-09-18T01:25:33.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.490+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51af8930 2024-09-18T01:25:33.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.491+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.491+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x7fbb64061050 2024-09-18T01:25:33.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.491+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.491+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51af8930 2024-09-18T01:25:33.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.491+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.491+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51afd320 2024-09-18T01:25:33.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.491+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.491+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51b01cd0 2024-09-18T01:25:33.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.492+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51b01cd0 2024-09-18T01:25:33.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.492+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51b01cd0 2024-09-18T01:25:33.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.492+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51b01cd0 2024-09-18T01:25:33.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.492+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x7fbb64061050 2024-09-18T01:25:33.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.492+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.492+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51b01cd0 2024-09-18T01:25:33.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.492+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51b01cd0 2024-09-18T01:25:33.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.492+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51b01cd0 2024-09-18T01:25:33.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.492+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51b01cd0 2024-09-18T01:25:33.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.492+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51af8930 2024-09-18T01:25:33.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.493+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.493+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51af8930 2024-09-18T01:25:33.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.493+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.493+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x7fbb64061050 2024-09-18T01:25:33.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.493+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.493+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51b01cd0 2024-09-18T01:25:33.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.494+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51b01cd0 2024-09-18T01:25:33.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.494+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51afd320 2024-09-18T01:25:33.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.494+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.494+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51af8930 2024-09-18T01:25:33.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.494+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.494+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x7fbb64061050 2024-09-18T01:25:33.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.494+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.494+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51b01cd0 2024-09-18T01:25:33.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.495+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51b01cd0 2024-09-18T01:25:33.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.495+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x7fbb64061050 2024-09-18T01:25:33.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.495+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.495+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51afd320 2024-09-18T01:25:33.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.495+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.495+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51b01cd0 2024-09-18T01:25:33.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51b01cd0 2024-09-18T01:25:33.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x7fbb64061050 2024-09-18T01:25:33.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51af8930 2024-09-18T01:25:33.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c51afc5c0 con 0x564c51afd320 2024-09-18T01:25:33.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb75213800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb75213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb75213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb75213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb75213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb75213800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb75213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.496+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51b005e0 con 0x564c51af8930 2024-09-18T01:25:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51b009d0 con 0x564c51af8930 2024-09-18T01:25:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51b009d0 con 0x7fbb64061050 2024-09-18T01:25:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 20 zone default found 2024-09-18T01:25:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 4 Realm: () 2024-09-18T01:25:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 20 zonegroup default 2024-09-18T01:25:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51b04ce0 con 0x7fbb64061050 2024-09-18T01:25:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.497+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51b066c0 con 0x564c51b01cd0 2024-09-18T01:25:33.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.498+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51b01cd0 2024-09-18T01:25:33.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.498+0000 7fbb75213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.498+0000 7fbb75213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.498+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51b06a60 con 0x564c51b01cd0 2024-09-18T01:25:33.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.498+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51b01cd0 2024-09-18T01:25:33.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.498+0000 7fbb75213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.498+0000 7fbb75213800 20 started sync module instance, tier type = 2024-09-18T01:25:33.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.498+0000 7fbb75213800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:33.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.498+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b05b60 con 0x564c51afd320 2024-09-18T01:25:33.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.499+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.499+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94885788014256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b06e00 con 0x564c51afd320 2024-09-18T01:25:33.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.499+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b07690 con 0x564c51af8930 2024-09-18T01:25:33.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.500+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94885788014256] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.500+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.500+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94885788016512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b07a80 con 0x564c51af8930 2024-09-18T01:25:33.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.500+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b08480 con 0x564c51b01cd0 2024-09-18T01:25:33.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.501+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51b01cd0 2024-09-18T01:25:33.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.501+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94885788024720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b08d50 con 0x564c51b01cd0 2024-09-18T01:25:33.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.501+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b09830 con 0x564c51afd320 2024-09-18T01:25:33.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.501+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94885788016512] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.502+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94885788024720] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51b01cd0 2024-09-18T01:25:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.502+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.502+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94885788027040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b09340 con 0x564c51afd320 2024-09-18T01:25:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.502+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b0a100 con 0x564c51af8930 2024-09-18T01:25:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.503+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.503+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94885788032080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b0a070 con 0x564c51af8930 2024-09-18T01:25:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.503+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b0b0d0 con 0x7fbb64061050 2024-09-18T01:25:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.503+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94885788027040] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.504+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94885788032080] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.504+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.504+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94885788036032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b0b090 con 0x7fbb64061050 2024-09-18T01:25:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.504+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b0b970 con 0x7fbb64061050 2024-09-18T01:25:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.505+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(56 notify.6 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.505+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94885788038336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b0b090 con 0x7fbb64061050 2024-09-18T01:25:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.505+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b0c420 con 0x7fbb64061050 2024-09-18T01:25:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.505+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94885788036032] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.506+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94885788038336] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.506+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.506+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94885788039392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b071a0 con 0x7fbb64061050 2024-09-18T01:25:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.506+0000 7fbb75213800 20 add_watcher() i=0 2024-09-18T01:25:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.506+0000 7fbb75213800 20 add_watcher() i=1 2024-09-18T01:25:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.506+0000 7fbb75213800 20 add_watcher() i=2 2024-09-18T01:25:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.506+0000 7fbb75213800 20 add_watcher() i=3 2024-09-18T01:25:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.506+0000 7fbb75213800 20 add_watcher() i=4 2024-09-18T01:25:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.506+0000 7fbb75213800 20 add_watcher() i=5 2024-09-18T01:25:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.506+0000 7fbb75213800 20 add_watcher() i=6 2024-09-18T01:25:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.507+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94885788039392] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.507+0000 7fbb75213800 20 add_watcher() i=7 2024-09-18T01:25:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.507+0000 7fbb75213800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.507+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51b0f450 con 0x564c51af8930 2024-09-18T01:25:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.507+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.507+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94885788041008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b0c8d0 con 0x564c51af8930 2024-09-18T01:25:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.508+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94885788041008] v33'154 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.508+0000 7fba26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fbb75213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fbb75213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fbb75213800 5 note: GC not initialized 2024-09-18T01:25:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fba25fe3640 20 reqs_thread_entry: start 2024-09-18T01:25:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fbb75213800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fbb75213800 20 Filter name: none 2024-09-18T01:25:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fb9977fe640 20 reqs_thread_entry: start 2024-09-18T01:25:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fbb75213800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fbb75213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51b42730 con 0x564c51af8930 2024-09-18T01:25:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fbb75213800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fbb75213800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fbb75213800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fbb75213800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.509+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51b451c0 con 0x564c51afd320 2024-09-18T01:25:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 20 disabling bucket name=myfoo 2024-09-18T01:25:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:25:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51b431a0 con 0x564c51afd320 2024-09-18T01:25:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-18T01:25:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 : miss 2024-09-18T01:25:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:65 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51b45ac0 con 0x7fbb64061050 2024-09-18T01:25:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(65 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:33.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:33.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:33.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:33.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:33.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.510+0000 7fbb75213800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 2024-09-18T01:25:33.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.511+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:66 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b4d600 con 0x7fbb64061050 2024-09-18T01:25:33.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(66 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb75213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:33.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb75213800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:33.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb75213800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:33.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb75213800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1, ofs0, ns] 2024-09-18T01:25:33.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94885788279168 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51b48cb0 con 0x564c51af8930 2024-09-18T01:25:33.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== watch-notify(notify (1) cookie 94885788016512 notify 141733920793 ret 0) ==== 794+0+0 (crc 0 0 0) 0x564c51b45eb0 con 0x564c51af8930 2024-09-18T01:25:33.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fba47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920793 cookie 94885788016512 notifier 4601 bl.length()=752 2024-09-18T01:25:33.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(67 notify.1 [notify cookie 94885788279168 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fba47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:33.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fba47fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:33.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fba47fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:33.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fba47fff640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fba34003ea0 con 0x564c51af8930 2024-09-18T01:25:33.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== watch-notify(notify_complete (2) cookie 94885788279168 notify 141733920793 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564c51b45000 con 0x564c51af8930 2024-09-18T01:25:33.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb75213800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): orig_sources= new_sources= 2024-09-18T01:25:33.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb75213800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): potential sources added=[] removed=[] 2024-09-18T01:25:33.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb75213800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): orig_dests= new_dests= 2024-09-18T01:25:33.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb75213800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): potential dests added=[] removed=[] 2024-09-18T01:25:33.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.512+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b487c0 con 0x564c51af8930 2024-09-18T01:25:33.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.513+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v33'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.513+0000 7fbb75213800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:33.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.513+0000 7fbb75213800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:33.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.513+0000 7fbb75213800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:33.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.514+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94885788257584 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c51b487c0 con 0x564c51af8930 2024-09-18T01:25:33.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.514+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== watch-notify(notify (1) cookie 94885788032080 notify 141733920794 ret 0) ==== 609+0+0 (crc 0 0 0) 0x564c51b45000 con 0x564c51af8930 2024-09-18T01:25:33.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.514+0000 7fba47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 94885788032080 notifier 4601 bl.length()=567 2024-09-18T01:25:33.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.514+0000 7fba47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:33.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.514+0000 7fba47fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:33.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.514+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(70 notify.4 [notify cookie 94885788257584 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.514+0000 7fba47fff640 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fba34003ea0 con 0x564c51af8930 2024-09-18T01:25:33.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.514+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.514+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== watch-notify(notify_complete (2) cookie 94885788257584 notify 141733920794 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbb6c0434f0 con 0x564c51af8930 2024-09-18T01:25:33.529 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:33.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.515+0000 7fba26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:33.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.515+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94885788041008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b40480 con 0x564c51af8930 2024-09-18T01:25:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.516+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94885788041008] v33'155 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.516+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94885788014256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b40480 con 0x564c51afd320 2024-09-18T01:25:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.517+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94885788014256] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.517+0000 7fbb75213800 20 remove_watcher() i=0 2024-09-18T01:25:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.517+0000 7fbb75213800 2 removed watcher, disabling cache 2024-09-18T01:25:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.517+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94885788016512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b40480 con 0x564c51af8930 2024-09-18T01:25:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.518+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94885788016512] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.518+0000 7fbb75213800 20 remove_watcher() i=1 2024-09-18T01:25:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.518+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94885788024720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b40480 con 0x564c51b01cd0 2024-09-18T01:25:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.519+0000 7fbb6bfff640 1 -- 172.21.15.100:0/886660703 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94885788024720] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb5c051070 con 0x564c51b01cd0 2024-09-18T01:25:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.519+0000 7fbb75213800 20 remove_watcher() i=2 2024-09-18T01:25:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.519+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94885788027040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b05f80 con 0x564c51afd320 2024-09-18T01:25:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.520+0000 7fbb7099c640 1 -- 172.21.15.100:0/886660703 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94885788027040] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6402d070 con 0x564c51afd320 2024-09-18T01:25:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.520+0000 7fbb75213800 20 remove_watcher() i=3 2024-09-18T01:25:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.520+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94885788032080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b088a0 con 0x564c51af8930 2024-09-18T01:25:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.521+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94885788032080] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x564c51af8930 2024-09-18T01:25:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.521+0000 7fbb75213800 20 remove_watcher() i=4 2024-09-18T01:25:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.521+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94885788036032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b05f80 con 0x7fbb64061050 2024-09-18T01:25:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.522+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94885788036032] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.522+0000 7fbb75213800 20 remove_watcher() i=5 2024-09-18T01:25:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.522+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94885788038336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b09c50 con 0x7fbb64061050 2024-09-18T01:25:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.523+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94885788038336] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.523+0000 7fbb75213800 20 remove_watcher() i=6 2024-09-18T01:25:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.523+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94885788039392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c51b088a0 con 0x7fbb64061050 2024-09-18T01:25:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94885788039392] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00a4a0 con 0x7fbb64061050 2024-09-18T01:25:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 20 remove_watcher() i=7 2024-09-18T01:25:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbb64061050 msgr2=0x7fbb6406d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbb64061050 0x7fbb6406d900 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564c51af8930 msgr2=0x564c51afadf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564c51af8930 0x564c51afadf0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564c51afd320 msgr2=0x564c51aff710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564c51afd320 0x564c51aff710 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564c51b01cd0 msgr2=0x564c51b04190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x564c51b01cd0 0x564c51b04190 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba3c036b90 msgr2=0x7fba3c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba3c036b90 0x7fba3c039050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x564c51ac86e0 tx=0x7fbb5c06b040 comp rx=0 tx=0).stop 2024-09-18T01:25:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51ae3d90 msgr2=0x564c51ad7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 --2- 172.21.15.100:0/886660703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51ae3d90 0x564c51ad7750 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbb64027630 tx=0x7fbb6404a650 comp rx=0 tx=0).stop 2024-09-18T01:25:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 reap_dead start 2024-09-18T01:25:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb7119d640 1 -- 172.21.15.100:0/886660703 reap_dead start 2024-09-18T01:25:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 shutdown_connections 2024-09-18T01:25:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 >> 172.21.15.100:0/886660703 conn(0x564c51ae0140 msgr2=0x564c51ade210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 shutdown_connections 2024-09-18T01:25:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/886660703 wait complete. 2024-09-18T01:25:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/3987016241 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba48036b90 msgr2=0x7fba48039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 --2- 172.21.15.100:0/3987016241 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba48036b90 0x7fba48039050 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x564c51abc540 tx=0x7fbb5c005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/3987016241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51936680 msgr2=0x564c51ad9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 --2- 172.21.15.100:0/3987016241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51936680 0x564c51ad9e20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbb6404b770 tx=0x7fbb6401aee0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/3987016241 shutdown_connections 2024-09-18T01:25:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 --2- 172.21.15.100:0/3987016241 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba48036b90 0x7fba48039050 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 --2- 172.21.15.100:0/3987016241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c51936680 0x564c51ad9e20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/3987016241 >> 172.21.15.100:0/3987016241 conn(0x564c51acb020 msgr2=0x564c51acdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/3987016241 shutdown_connections 2024-09-18T01:25:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.524+0000 7fbb75213800 1 -- 172.21.15.100:0/3987016241 wait complete. 2024-09-18T01:25:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564c51ac57f0 msgr2=0x564c51ac7be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb75213800 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x564c51ac57f0 0x564c51ac7be0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564c519c5990 msgr2=0x564c51abf050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb75213800 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x564c519c5990 0x564c51abf050 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564c51ac1900 msgr2=0x564c51ac3cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb75213800 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x564c51ac1900 0x564c51ac3cf0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba58036b90 msgr2=0x7fba58039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb75213800 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fba58036b90 0x7fba58039050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c057000 tx=0x7fbb5c052000 comp rx=0 tx=0).stop 2024-09-18T01:25:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c1550 msgr2=0x564c51ab7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb75213800 1 --2- 172.21.15.100:0/496671210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c519c1550 0x564c51ab7fe0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x564c51ab13b0 tx=0x7fbb64000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb7119d640 1 -- 172.21.15.100:0/496671210 reap_dead start 2024-09-18T01:25:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 shutdown_connections 2024-09-18T01:25:33.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 >> 172.21.15.100:0/496671210 conn(0x564c519bcde0 msgr2=0x564c51aaa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 shutdown_connections 2024-09-18T01:25:33.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.525+0000 7fbb75213800 1 -- 172.21.15.100:0/496671210 wait complete. 2024-09-18T01:25:33.540 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:33.542 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-18T01:25:33.542 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-18T01:25:33.543 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-18T01:25:33.588 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:33.588 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:33.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.586+0000 7fcf64324800 1 Processor -- start 2024-09-18T01:25:33.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.586+0000 7fcf64324800 1 -- start start 2024-09-18T01:25:33.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.586+0000 7fcf64324800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56149d6bc900 0x56149d6becf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.586+0000 7fcf64324800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56149d578b30 con 0x56149d6b84c0 2024-09-18T01:25:33.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.586+0000 7fcf64324800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x56149d55a360 con 0x56149d6bc900 2024-09-18T01:25:33.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.587+0000 7fcf578df640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56149d6bc900 0x56149d6becf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.587+0000 7fcf600e0640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x56149d6b84c0 0x56149d6b88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37480/0 (socket says 172.21.15.100:37480) 2024-09-18T01:25:33.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.587+0000 7fcf600e0640 1 -- 172.21.15.100:0/1793568233 learned_addr learned my addr 172.21.15.100:0/1793568233 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:33.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.587+0000 7fcf578df640 1 -- 172.21.15.100:0/1793568233 >> v1:172.21.15.92:6789/0 conn(0x56149d6b84c0 legacy=0x56149d6b88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.587+0000 7fcf578df640 1 -- 172.21.15.100:0/1793568233 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149d580e00 con 0x56149d6bc900 2024-09-18T01:25:33.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.587+0000 7fcf5f8df640 1 -- 172.21.15.100:0/1793568233 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913380222 0 0) 0x56149d578b30 con 0x56149d6b84c0 2024-09-18T01:25:33.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.589+0000 7fcf578df640 1 --2- 172.21.15.100:0/1793568233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6bc900 0x56149d6becf0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800a470 tx=0x7fcf48045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1705380656ee7e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.589+0000 7fcf5f8df640 1 -- 172.21.15.100:0/1793568233 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf48053570 con 0x56149d6bc900 2024-09-18T01:25:33.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.589+0000 7fcf5f8df640 1 -- 172.21.15.100:0/1793568233 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf48058070 con 0x56149d6bc900 2024-09-18T01:25:33.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.589+0000 7fcf5f8df640 1 -- 172.21.15.100:0/1793568233 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf48053880 con 0x56149d6bc900 2024-09-18T01:25:33.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.589+0000 7fcf64324800 1 -- 172.21.15.100:0/1793568233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6bc900 msgr2=0x56149d6becf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.589+0000 7fcf64324800 1 --2- 172.21.15.100:0/1793568233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6bc900 0x56149d6becf0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800a470 tx=0x7fcf48045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:33.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.589+0000 7fcf64324800 1 -- 172.21.15.100:0/1793568233 shutdown_connections 2024-09-18T01:25:33.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.589+0000 7fcf64324800 1 --2- 172.21.15.100:0/1793568233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6bc900 0x56149d6becf0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.589+0000 7fcf64324800 1 -- 172.21.15.100:0/1793568233 >> 172.21.15.100:0/1793568233 conn(0x56149d6b3df0 msgr2=0x56149d6b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.590+0000 7fcf64324800 1 -- 172.21.15.100:0/1793568233 shutdown_connections 2024-09-18T01:25:33.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.590+0000 7fcf64324800 1 -- 172.21.15.100:0/1793568233 wait complete. 2024-09-18T01:25:33.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.603+0000 7fcf64324800 1 Processor -- start 2024-09-18T01:25:33.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.603+0000 7fcf64324800 1 -- start start 2024-09-18T01:25:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.603+0000 7fcf64324800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6b84c0 0x56149d7a7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.603+0000 7fcf64324800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56149d605330 con 0x56149d6b84c0 2024-09-18T01:25:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.604+0000 7fcf600e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6b84c0 0x56149d7a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.604+0000 7fcf600e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6b84c0 0x56149d7a7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38964/0 (socket says 172.21.15.100:38964) 2024-09-18T01:25:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.604+0000 7fcf600e0640 1 -- 172.21.15.100:0/2664300499 learned_addr learned my addr 172.21.15.100:0/2664300499 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.604+0000 7fcf600e0640 1 -- 172.21.15.100:0/2664300499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149d552bc0 con 0x56149d6b84c0 2024-09-18T01:25:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.604+0000 7fcf600e0640 1 --2- 172.21.15.100:0/2664300499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6b84c0 0x56149d7a7560 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000d450 tx=0x7fcf5000d540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb2120ddeb9c68e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.604+0000 7fce4e60c640 1 -- 172.21.15.100:0/2664300499 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf5000a420 con 0x56149d6b84c0 2024-09-18T01:25:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.604+0000 7fce4e60c640 1 -- 172.21.15.100:0/2664300499 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5000a5c0 con 0x56149d6b84c0 2024-09-18T01:25:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.604+0000 7fce4e60c640 1 -- 172.21.15.100:0/2664300499 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf5000a920 con 0x56149d6b84c0 2024-09-18T01:25:33.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.605+0000 7fcf64324800 1 -- 172.21.15.100:0/2664300499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6b84c0 msgr2=0x56149d7a7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.605+0000 7fcf64324800 1 --2- 172.21.15.100:0/2664300499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6b84c0 0x56149d7a7560 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000d450 tx=0x7fcf5000d540 comp rx=0 tx=0).stop 2024-09-18T01:25:33.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.605+0000 7fcf64324800 1 -- 172.21.15.100:0/2664300499 shutdown_connections 2024-09-18T01:25:33.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.605+0000 7fcf64324800 1 --2- 172.21.15.100:0/2664300499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6b84c0 0x56149d7a7560 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.605+0000 7fcf64324800 1 -- 172.21.15.100:0/2664300499 >> 172.21.15.100:0/2664300499 conn(0x56149d6b3df0 msgr2=0x56149d7a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.605+0000 7fcf64324800 1 -- 172.21.15.100:0/2664300499 shutdown_connections 2024-09-18T01:25:33.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.605+0000 7fcf64324800 1 -- 172.21.15.100:0/2664300499 wait complete. 2024-09-18T01:25:33.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.605+0000 7fcf64324800 1 Processor -- start 2024-09-18T01:25:33.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.605+0000 7fcf64324800 1 -- start start 2024-09-18T01:25:33.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.606+0000 7fcf64324800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6b84c0 0x56149d7ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.606+0000 7fcf64324800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56149d6bf530 con 0x56149d6b84c0 2024-09-18T01:25:33.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.606+0000 7fcf600e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6b84c0 0x56149d7ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.606+0000 7fcf600e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6b84c0 0x56149d7ade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38972/0 (socket says 172.21.15.100:38972) 2024-09-18T01:25:33.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.606+0000 7fcf600e0640 1 -- 172.21.15.100:0/3515866615 learned_addr learned my addr 172.21.15.100:0/3515866615 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.606+0000 7fcf600e0640 1 -- 172.21.15.100:0/3515866615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149d566fe0 con 0x56149d6b84c0 2024-09-18T01:25:33.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.606+0000 7fcf600e0640 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6b84c0 0x56149d7ade80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x56149d7a83c0 tx=0x7fcf50000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.606+0000 7fce4ce09640 1 -- 172.21.15.100:0/3515866615 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf50027070 con 0x56149d6b84c0 2024-09-18T01:25:33.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.607+0000 7fce4ce09640 1 -- 172.21.15.100:0/3515866615 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf50022530 con 0x56149d6b84c0 2024-09-18T01:25:33.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.607+0000 7fce4ce09640 1 -- 172.21.15.100:0/3515866615 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf50022850 con 0x56149d6b84c0 2024-09-18T01:25:33.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.607+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56149d7ae3c0 con 0x56149d6b84c0 2024-09-18T01:25:33.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.607+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56149d7ae8e0 con 0x56149d6b84c0 2024-09-18T01:25:33.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.607+0000 7fce4ce09640 1 -- 172.21.15.100:0/3515866615 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcf5002a070 con 0x56149d6b84c0 2024-09-18T01:25:33.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.608+0000 7fce4ce09640 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce48036b40 0x7fce48039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.608+0000 7fce4ce09640 1 -- 172.21.15.100:0/3515866615 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fcf5004de90 con 0x56149d6b84c0 2024-09-18T01:25:33.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.608+0000 7fcf578df640 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce48036b40 0x7fce48039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.608+0000 7fcf64324800 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56149d6bc900 0x56149d7b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.608+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7b5470 con 0x56149d6bc900 2024-09-18T01:25:33.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.608+0000 7fcf608e1640 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56149d6bc900 0x56149d7b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.608+0000 7fcf578df640 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce48036b40 0x7fce48039000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcf48057000 tx=0x7fcf48052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.608+0000 7fcf608e1640 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56149d6bc900 0x56149d7b4ef0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.608+0000 7fcf608e1640 1 -- 172.21.15.100:0/3515866615 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d6bc900 2024-09-18T01:25:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.608+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7b24c0 con 0x56149d6bc900 2024-09-18T01:25:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.609+0000 7fcf608e1640 1 -- 172.21.15.100:0/3515866615 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d6bc900 2024-09-18T01:25:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.609+0000 7fcf64324800 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56149d7b77a0 0x56149d7b9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.609+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7ba230 con 0x56149d7b77a0 2024-09-18T01:25:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.609+0000 7fcf600e0640 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56149d7b77a0 0x56149d7b9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.609+0000 7fcf600e0640 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56149d7b77a0 0x56149d7b9b90 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.609+0000 7fcf600e0640 1 -- 172.21.15.100:0/3515866615 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcf50029030 con 0x56149d7b77a0 2024-09-18T01:25:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.609+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7b6640 con 0x56149d6bc900 2024-09-18T01:25:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.610+0000 7fcf608e1640 1 -- 172.21.15.100:0/3515866615 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d6bc900 2024-09-18T01:25:33.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.610+0000 7fcf64324800 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56149d7bb690 0x56149d7bda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.610+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7be180 con 0x56149d7bb690 2024-09-18T01:25:33.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.610+0000 7fcf578df640 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56149d7bb690 0x56149d7bda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.610+0000 7fcf578df640 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56149d7bb690 0x56149d7bda80 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.610+0000 7fcf578df640 1 -- 172.21.15.100:0/3515866615 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcf48051070 con 0x56149d7bb690 2024-09-18T01:25:33.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.611+0000 7fcf64324800 1 Processor -- start 2024-09-18T01:25:33.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.611+0000 7fcf64324800 1 -- start start 2024-09-18T01:25:33.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.611+0000 7fcf64324800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7cbf30 0x56149d7cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.611+0000 7fcf64324800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56149d554580 con 0x56149d7cbf30 2024-09-18T01:25:33.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.611+0000 7fcf600e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7cbf30 0x56149d7cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.611+0000 7fcf600e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7cbf30 0x56149d7cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38976/0 (socket says 172.21.15.100:38976) 2024-09-18T01:25:33.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.611+0000 7fcf600e0640 1 -- 172.21.15.100:0/2384087604 learned_addr learned my addr 172.21.15.100:0/2384087604 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.611+0000 7fcf600e0640 1 -- 172.21.15.100:0/2384087604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149d7cc890 con 0x56149d7cbf30 2024-09-18T01:25:33.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.612+0000 7fcf600e0640 1 --2- 172.21.15.100:0/2384087604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7cbf30 0x56149d7cc350 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcf5004c220 tx=0x7fcf50045140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.612+0000 7fce45ffb640 1 -- 172.21.15.100:0/2384087604 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf50034070 con 0x56149d7cbf30 2024-09-18T01:25:33.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.612+0000 7fce45ffb640 1 -- 172.21.15.100:0/2384087604 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf50045c50 con 0x56149d7cbf30 2024-09-18T01:25:33.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.612+0000 7fcf64324800 1 -- 172.21.15.100:0/2384087604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56149d7ccb20 con 0x56149d7cbf30 2024-09-18T01:25:33.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.612+0000 7fce45ffb640 1 -- 172.21.15.100:0/2384087604 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf500095a0 con 0x56149d7cbf30 2024-09-18T01:25:33.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.612+0000 7fcf64324800 1 -- 172.21.15.100:0/2384087604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56149d7cf800 con 0x56149d7cbf30 2024-09-18T01:25:33.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.612+0000 7fce45ffb640 1 -- 172.21.15.100:0/2384087604 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcf5003f060 con 0x56149d7cbf30 2024-09-18T01:25:33.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.613+0000 7fce45ffb640 1 --2- 172.21.15.100:0/2384087604 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce38036b90 0x7fce38039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.613+0000 7fce45ffb640 1 -- 172.21.15.100:0/2384087604 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fcf50039c60 con 0x56149d7cbf30 2024-09-18T01:25:33.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.613+0000 7fcf578df640 1 --2- 172.21.15.100:0/2384087604 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce38036b90 0x7fce38039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.613+0000 7fcf64324800 1 Processor -- start 2024-09-18T01:25:33.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.613+0000 7fcf64324800 1 -- start start 2024-09-18T01:25:33.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.613+0000 7fcf578df640 1 --2- 172.21.15.100:0/2384087604 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce38036b90 0x7fce38039050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x56149d7b23e0 tx=0x7fcf48005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.613+0000 7fcf64324800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7d8c00 0x56149d7d9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.613+0000 7fcf64324800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56149d7a7d10 con 0x56149d7d8c00 2024-09-18T01:25:33.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.613+0000 7fcf600e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7d8c00 0x56149d7d9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.613+0000 7fcf600e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7d8c00 0x56149d7d9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:38986/0 (socket says 172.21.15.100:38986) 2024-09-18T01:25:33.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.613+0000 7fcf600e0640 1 -- 172.21.15.100:0/3972729320 learned_addr learned my addr 172.21.15.100:0/3972729320 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.614+0000 7fcf600e0640 1 -- 172.21.15.100:0/3972729320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149d7d95d0 con 0x56149d7d8c00 2024-09-18T01:25:33.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.614+0000 7fcf600e0640 1 --2- 172.21.15.100:0/3972729320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7d8c00 0x56149d7d9000 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000f010 tx=0x7fcf50029a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d38fa149aa3ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.614+0000 7fce3f7fe640 1 -- 172.21.15.100:0/3972729320 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf50020500 con 0x56149d7d8c00 2024-09-18T01:25:33.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.614+0000 7fce3f7fe640 1 -- 172.21.15.100:0/3972729320 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5004bee0 con 0x56149d7d8c00 2024-09-18T01:25:33.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.614+0000 7fce3f7fe640 1 -- 172.21.15.100:0/3972729320 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf5002a9e0 con 0x56149d7d8c00 2024-09-18T01:25:33.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.614+0000 7fcf64324800 1 -- 172.21.15.100:0/3972729320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7d8c00 msgr2=0x56149d7d9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.614+0000 7fcf64324800 1 --2- 172.21.15.100:0/3972729320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7d8c00 0x56149d7d9000 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000f010 tx=0x7fcf50029a10 comp rx=0 tx=0).stop 2024-09-18T01:25:33.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.614+0000 7fcf64324800 1 -- 172.21.15.100:0/3972729320 shutdown_connections 2024-09-18T01:25:33.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.614+0000 7fcf64324800 1 --2- 172.21.15.100:0/3972729320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7d8c00 0x56149d7d9000 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.614+0000 7fcf64324800 1 -- 172.21.15.100:0/3972729320 >> 172.21.15.100:0/3972729320 conn(0x56149d7d4f60 msgr2=0x56149d7d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.614+0000 7fcf64324800 1 -- 172.21.15.100:0/3972729320 shutdown_connections 2024-09-18T01:25:33.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.614+0000 7fcf64324800 1 -- 172.21.15.100:0/3972729320 wait complete. 2024-09-18T01:25:33.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.615+0000 7fcf64324800 1 Processor -- start 2024-09-18T01:25:33.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.615+0000 7fcf64324800 1 -- start start 2024-09-18T01:25:33.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.615+0000 7fcf64324800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7d8c00 0x56149d7e4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.615+0000 7fcf64324800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56149d7d99d0 con 0x56149d7d8c00 2024-09-18T01:25:33.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.615+0000 7fcf600e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7d8c00 0x56149d7e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.615+0000 7fcf600e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7d8c00 0x56149d7e4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:39000/0 (socket says 172.21.15.100:39000) 2024-09-18T01:25:33.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.615+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 learned_addr learned my addr 172.21.15.100:0/1069823588 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:33.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.615+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149d7e4580 con 0x56149d7d8c00 2024-09-18T01:25:33.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.615+0000 7fcf600e0640 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7d8c00 0x56149d7e4040 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcf50029a50 tx=0x7fcf5003cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.616+0000 7fce3dffb640 1 -- 172.21.15.100:0/1069823588 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf50066070 con 0x56149d7d8c00 2024-09-18T01:25:33.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.616+0000 7fce3dffb640 1 -- 172.21.15.100:0/1069823588 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf50009a70 con 0x56149d7d8c00 2024-09-18T01:25:33.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.616+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56149d7e4580 con 0x56149d7d8c00 2024-09-18T01:25:33.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.616+0000 7fce3dffb640 1 -- 172.21.15.100:0/1069823588 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf500292c0 con 0x56149d7d8c00 2024-09-18T01:25:33.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.616+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56149d7e4580 con 0x56149d7d8c00 2024-09-18T01:25:33.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.616+0000 7fce3dffb640 1 -- 172.21.15.100:0/1069823588 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcf50069070 con 0x56149d7d8c00 2024-09-18T01:25:33.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.617+0000 7fce3dffb640 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce30036b90 0x7fce30039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.617+0000 7fce3dffb640 1 -- 172.21.15.100:0/1069823588 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fcf5006ccb0 con 0x56149d7d8c00 2024-09-18T01:25:33.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.617+0000 7fcf578df640 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce30036b90 0x7fce30039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.617+0000 7fcf578df640 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce30036b90 0x7fce30039050 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x56149d7be580 tx=0x7fcf48053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.617+0000 7fcf64324800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.617+0000 7fcf64324800 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56149d7ef650 0x56149d7f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.617+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f2260 con 0x56149d7ef650 2024-09-18T01:25:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.617+0000 7fcf608e1640 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56149d7ef650 0x56149d7f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf608e1640 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56149d7ef650 0x56149d7f1b10 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf64324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf64324800 20 realm 2024-09-18T01:25:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf64324800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f2670 con 0x56149d7ef650 2024-09-18T01:25:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf64324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf64324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf64324800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f2f40 con 0x56149d7ef650 2024-09-18T01:25:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf64324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf64324800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.618+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7ef650 2024-09-18T01:25:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.619+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.619+0000 7fcf64324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.619+0000 7fcf64324800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.619+0000 7fcf64324800 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56149d7f4040 0x56149d7f6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.619+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f6a40 con 0x56149d7f4040 2024-09-18T01:25:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.619+0000 7fcf600e0640 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56149d7f4040 0x56149d7f6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.619+0000 7fcf600e0640 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56149d7f4040 0x56149d7f6430 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.619+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.619+0000 7fcf64324800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.619+0000 7fcf64324800 20 searching for the correct realm 2024-09-18T01:25:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.619+0000 7fcf64324800 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56149d7f8a20 0x56149d7faee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.619+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7fb5b0 con 0x56149d7f8a20 2024-09-18T01:25:33.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.619+0000 7fcf578df640 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56149d7f8a20 0x56149d7faee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.620+0000 7fcf578df640 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56149d7f8a20 0x56149d7faee0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.620+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf4807c040 con 0x56149d7f8a20 2024-09-18T01:25:33.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.620+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7fb5b0 con 0x56149d7f4040 2024-09-18T01:25:33.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.620+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.620+0000 7fcf600e0640 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcf5006b070 0x7fcf5004c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:33.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.620+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7fb5b0 con 0x7fcf5006b070 2024-09-18T01:25:33.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.620+0000 7fcf608e1640 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcf5006b070 0x7fcf5004c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:33.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.621+0000 7fcf608e1640 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcf5006b070 0x7fcf5004c5a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:33.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.621+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.621+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7ef650 2024-09-18T01:25:33.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.621+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.621+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7ef650 2024-09-18T01:25:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.621+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.621+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x7fcf5006b070 2024-09-18T01:25:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.622+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.622+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x7fcf5006b070 2024-09-18T01:25:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.622+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.622+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7f4040 2024-09-18T01:25:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.622+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.622+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7f8a20 2024-09-18T01:25:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.622+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf4807c040 con 0x56149d7f8a20 2024-09-18T01:25:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.622+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7ef650 2024-09-18T01:25:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.622+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.623+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x7fcf5006b070 2024-09-18T01:25:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.623+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.623+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7ef650 2024-09-18T01:25:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.623+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.623+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7f4040 2024-09-18T01:25:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.623+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.623+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7f8a20 2024-09-18T01:25:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.623+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf4807c040 con 0x56149d7f8a20 2024-09-18T01:25:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.623+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7f8a20 2024-09-18T01:25:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.624+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf4807c040 con 0x56149d7f8a20 2024-09-18T01:25:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.624+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x7fcf5006b070 2024-09-18T01:25:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.624+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.624+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7f8a20 2024-09-18T01:25:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.624+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf4807c040 con 0x56149d7f8a20 2024-09-18T01:25:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.624+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7f8a20 2024-09-18T01:25:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.624+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf4807c040 con 0x56149d7f8a20 2024-09-18T01:25:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.624+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7ef650 2024-09-18T01:25:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.625+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.625+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7ef650 2024-09-18T01:25:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.625+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.625+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x7fcf5006b070 2024-09-18T01:25:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.625+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.625+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7f8a20 2024-09-18T01:25:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.625+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf4807c040 con 0x56149d7f8a20 2024-09-18T01:25:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.625+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7f4040 2024-09-18T01:25:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.626+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.626+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7ef650 2024-09-18T01:25:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.626+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.626+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x7fcf5006b070 2024-09-18T01:25:33.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.626+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.626+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7f8a20 2024-09-18T01:25:33.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.626+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf4807c040 con 0x56149d7f8a20 2024-09-18T01:25:33.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.626+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x7fcf5006b070 2024-09-18T01:25:33.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.627+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.627+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7f4040 2024-09-18T01:25:33.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.627+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.627+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7f8a20 2024-09-18T01:25:33.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.627+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf4807c040 con 0x56149d7f8a20 2024-09-18T01:25:33.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.627+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x7fcf5006b070 2024-09-18T01:25:33.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.627+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.627+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7ef650 2024-09-18T01:25:33.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f32e0 con 0x56149d7f4040 2024-09-18T01:25:33.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf64324800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:33.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf64324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:33.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf64324800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:33.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf64324800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:33.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf64324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:33.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf64324800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:33.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf64324800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f6e50 con 0x56149d7ef650 2024-09-18T01:25:33.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf64324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf64324800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f7240 con 0x56149d7ef650 2024-09-18T01:25:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf64324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf64324800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.628+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7f7240 con 0x7fcf5006b070 2024-09-18T01:25:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 20 zone default found 2024-09-18T01:25:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 4 Realm: () 2024-09-18T01:25:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 20 zonegroup default 2024-09-18T01:25:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7fba30 con 0x7fcf5006b070 2024-09-18T01:25:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7fd410 con 0x56149d7f8a20 2024-09-18T01:25:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf4807c040 con 0x56149d7f8a20 2024-09-18T01:25:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d7fd7b0 con 0x56149d7f8a20 2024-09-18T01:25:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf4807c040 con 0x56149d7f8a20 2024-09-18T01:25:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 20 started sync module instance, tier type = 2024-09-18T01:25:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.629+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d7fc8b0 con 0x56149d7f4040 2024-09-18T01:25:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.630+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(44 notify.0 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.630+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94646541730816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d7fdb50 con 0x56149d7f4040 2024-09-18T01:25:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.631+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d7fe400 con 0x56149d7ef650 2024-09-18T01:25:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.631+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94646541730816] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.632+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.632+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94646541737712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d7fe7f0 con 0x56149d7ef650 2024-09-18T01:25:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.632+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d7ff230 con 0x56149d7f8a20 2024-09-18T01:25:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.633+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94646541737712] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.633+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf4807c040 con 0x56149d7f8a20 2024-09-18T01:25:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.633+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94646541741312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d7ff620 con 0x56149d7f8a20 2024-09-18T01:25:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.633+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d800060 con 0x56149d7f4040 2024-09-18T01:25:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.634+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(50 notify.3 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.634+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94646541747280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d800d20 con 0x56149d7f4040 2024-09-18T01:25:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.634+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d801740 con 0x56149d7ef650 2024-09-18T01:25:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.634+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94646541741312] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf4807c040 con 0x56149d7f8a20 2024-09-18T01:25:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.635+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94646541747280] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.635+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.635+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94646541750832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d800870 con 0x56149d7ef650 2024-09-18T01:25:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.635+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d801fe0 con 0x7fcf5006b070 2024-09-18T01:25:33.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.636+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94646541750832] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.636+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(54 notify.5 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.636+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94646541733024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d800870 con 0x7fcf5006b070 2024-09-18T01:25:33.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.636+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d802630 con 0x7fcf5006b070 2024-09-18T01:25:33.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.637+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94646541733024] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.638+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(56 notify.6 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.638+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94646541754624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d8025f0 con 0x7fcf5006b070 2024-09-18T01:25:33.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.638+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d803030 con 0x7fcf5006b070 2024-09-18T01:25:33.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.639+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94646541754624] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.639+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(58 notify.7 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.639+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94646541757184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d802ff0 con 0x7fcf5006b070 2024-09-18T01:25:33.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.639+0000 7fcf64324800 20 add_watcher() i=0 2024-09-18T01:25:33.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.639+0000 7fcf64324800 20 add_watcher() i=1 2024-09-18T01:25:33.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.639+0000 7fcf64324800 20 add_watcher() i=2 2024-09-18T01:25:33.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.639+0000 7fcf64324800 20 add_watcher() i=3 2024-09-18T01:25:33.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.639+0000 7fcf64324800 20 add_watcher() i=4 2024-09-18T01:25:33.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.639+0000 7fcf64324800 20 add_watcher() i=5 2024-09-18T01:25:33.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.639+0000 7fcf64324800 20 add_watcher() i=6 2024-09-18T01:25:33.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.640+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94646541757184] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.640+0000 7fcf64324800 20 add_watcher() i=7 2024-09-18T01:25:33.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.640+0000 7fcf64324800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:33.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.640+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d806480 con 0x56149d7ef650 2024-09-18T01:25:33.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.640+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.640+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94646541753056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d8039d0 con 0x56149d7ef650 2024-09-18T01:25:33.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.641+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94646541753056] v33'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.641+0000 7fce167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:33.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.641+0000 7fcf64324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:33.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.641+0000 7fcf64324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:33.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.641+0000 7fcf64324800 5 note: GC not initialized 2024-09-18T01:25:33.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.641+0000 7fce157e2640 20 reqs_thread_entry: start 2024-09-18T01:25:33.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.641+0000 7fcf64324800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:33.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.642+0000 7fcf64324800 20 Filter name: none 2024-09-18T01:25:33.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.642+0000 7fcd86ffd640 20 reqs_thread_entry: start 2024-09-18T01:25:33.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.642+0000 7fcf64324800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:33.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.642+0000 7fcf64324800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.642+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d8398a0 con 0x56149d7ef650 2024-09-18T01:25:33.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.642+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.642+0000 7fcf64324800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:33.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.642+0000 7fcf64324800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:33.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.642+0000 7fcf64324800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:33.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.642+0000 7fcf64324800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:33.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.642+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d83c330 con 0x56149d7f4040 2024-09-18T01:25:33.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.643+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.643+0000 7fcf64324800 20 enabling bucket name=myfoo 2024-09-18T01:25:33.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.643+0000 7fcf64324800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:25:33.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.643+0000 7fcf64324800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.643+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d83a310 con 0x56149d7f4040 2024-09-18T01:25:33.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.643+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.643+0000 7fcf64324800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:33.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.643+0000 7fcf64324800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-18T01:25:33.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.643+0000 7fcf64324800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:33.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.643+0000 7fcf64324800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 : miss 2024-09-18T01:25:33.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.643+0000 7fcf64324800 20 rados->read ofs=0 len=0 2024-09-18T01:25:33.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.643+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:65 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d83cbd0 con 0x7fcf5006b070 2024-09-18T01:25:33.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.644+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(65 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.644+0000 7fcf64324800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:33.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.644+0000 7fcf64324800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:33.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.644+0000 7fcf64324800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:33.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.644+0000 7fcf64324800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:33.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.644+0000 7fcf64324800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:33.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.644+0000 7fcf64324800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 2024-09-18T01:25:33.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.644+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:66 8.1e 8:7dcfcc7d:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d844700 con 0x7fcf5006b070 2024-09-18T01:25:33.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.645+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(66 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fcf64324800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:33.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fcf64324800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:33.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fcf64324800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:33.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fcf64324800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1, ofs0, ns] 2024-09-18T01:25:33.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94646541996688 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d83ecb0 con 0x56149d7ef650 2024-09-18T01:25:33.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== watch-notify(notify (1) cookie 94646541737712 notify 141733920795 ret 0) ==== 794+0+0 (crc 0 0 0) 0x56149d83cfc0 con 0x56149d7ef650 2024-09-18T01:25:33.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fce3f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920795 cookie 94646541737712 notifier 4608 bl.length()=752 2024-09-18T01:25:33.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(67 notify.1 [notify cookie 94646541996688 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fce3f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 info.flags=0x17 2024-09-18T01:25:33.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fce3f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.1 to cache LRU end 2024-09-18T01:25:33.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fce3f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:33.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fce3f7fe640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fce24003ea0 con 0x56149d7ef650 2024-09-18T01:25:33.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== watch-notify(notify_complete (2) cookie 94646541996688 notify 141733920795 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56149d83c110 con 0x56149d7ef650 2024-09-18T01:25:33.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fcf64324800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): orig_sources= new_sources= 2024-09-18T01:25:33.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fcf64324800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): potential sources added=[] removed=[] 2024-09-18T01:25:33.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fcf64324800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): orig_dests= new_dests= 2024-09-18T01:25:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fcf64324800 20 handle_bi_update(): bucket=:myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.1]): potential dests added=[] removed=[] 2024-09-18T01:25:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.646+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d83f880 con 0x56149d7ef650 2024-09-18T01:25:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.647+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v33'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.647+0000 7fcf64324800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.647+0000 7fcf64324800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.647+0000 7fcf64324800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.647+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94646541975200 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56149d83f880 con 0x56149d7ef650 2024-09-18T01:25:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.648+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== watch-notify(notify (1) cookie 94646541750832 notify 141733920796 ret 0) ==== 609+0+0 (crc 0 0 0) 0x56149d83c110 con 0x56149d7ef650 2024-09-18T01:25:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.648+0000 7fce3f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920796 cookie 94646541750832 notifier 4608 bl.length()=567 2024-09-18T01:25:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.648+0000 7fce3f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.648+0000 7fce3f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:33.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.648+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(70 notify.4 [notify cookie 94646541975200 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.648+0000 7fce3f7fe640 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fce24003ea0 con 0x56149d7ef650 2024-09-18T01:25:33.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.648+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.648+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== watch-notify(notify_complete (2) cookie 94646541975200 notify 141733920796 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcf580434f0 con 0x56149d7ef650 2024-09-18T01:25:33.662 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:33.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.649+0000 7fce167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:33.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.649+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94646541753056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d8375f0 con 0x56149d7ef650 2024-09-18T01:25:33.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.650+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94646541753056] v33'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.650+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94646541730816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d8375f0 con 0x56149d7f4040 2024-09-18T01:25:33.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.651+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94646541730816] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.651+0000 7fcf64324800 20 remove_watcher() i=0 2024-09-18T01:25:33.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.651+0000 7fcf64324800 2 removed watcher, disabling cache 2024-09-18T01:25:33.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.651+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94646541737712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d8375f0 con 0x56149d7ef650 2024-09-18T01:25:33.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.652+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94646541737712] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.652+0000 7fcf64324800 20 remove_watcher() i=1 2024-09-18T01:25:33.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.652+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94646541741312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d8375f0 con 0x56149d7f8a20 2024-09-18T01:25:33.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.653+0000 7fcf578df640 1 -- 172.21.15.100:0/1069823588 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94646541741312] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf4807c040 con 0x56149d7f8a20 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.653+0000 7fcf64324800 20 remove_watcher() i=2 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.653+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94646541747280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d8375f0 con 0x56149d7f4040 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.654+0000 7fcf600e0640 1 -- 172.21.15.100:0/1069823588 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94646541747280] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf50072070 con 0x56149d7f4040 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.654+0000 7fcf64324800 20 remove_watcher() i=3 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.654+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94646541750832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d8375f0 con 0x56149d7ef650 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.655+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94646541750832] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x56149d7ef650 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.655+0000 7fcf64324800 20 remove_watcher() i=4 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.655+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94646541733024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d8375f0 con 0x7fcf5006b070 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.656+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94646541733024] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.656+0000 7fcf64324800 20 remove_watcher() i=5 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.656+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94646541754624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d8375f0 con 0x7fcf5006b070 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.657+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94646541754624] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.657+0000 7fcf64324800 20 remove_watcher() i=6 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.657+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94646541757184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56149d8375f0 con 0x7fcf5006b070 2024-09-18T01:25:33.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94646541757184] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x7fcf5006b070 2024-09-18T01:25:33.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 20 remove_watcher() i=7 2024-09-18T01:25:33.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcf5006b070 msgr2=0x7fcf5004c5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcf5006b070 0x7fcf5004c5a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56149d7ef650 msgr2=0x56149d7f1b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56149d7ef650 0x56149d7f1b10 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56149d7f4040 msgr2=0x56149d7f6430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56149d7f4040 0x56149d7f6430 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56149d7f8a20 msgr2=0x56149d7faee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56149d7f8a20 0x56149d7faee0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce30036b90 msgr2=0x7fce30039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce30036b90 0x7fce30039050 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x56149d7be580 tx=0x7fcf48053000 comp rx=0 tx=0).stop 2024-09-18T01:25:33.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7d8c00 msgr2=0x56149d7e4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 --2- 172.21.15.100:0/1069823588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7d8c00 0x56149d7e4040 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcf50029a50 tx=0x7fcf5003cfa0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 reap_dead start 2024-09-18T01:25:33.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf608e1640 1 -- 172.21.15.100:0/1069823588 reap_dead start 2024-09-18T01:25:33.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 shutdown_connections 2024-09-18T01:25:33.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 >> 172.21.15.100:0/1069823588 conn(0x56149d7d4f60 msgr2=0x56149d7d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 shutdown_connections 2024-09-18T01:25:33.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.658+0000 7fcf64324800 1 -- 172.21.15.100:0/1069823588 wait complete. 2024-09-18T01:25:33.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/2384087604 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce38036b90 msgr2=0x7fce38039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 --2- 172.21.15.100:0/2384087604 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce38036b90 0x7fce38039050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x56149d7b23e0 tx=0x7fcf48005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:33.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/2384087604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7cbf30 msgr2=0x56149d7cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 --2- 172.21.15.100:0/2384087604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7cbf30 0x56149d7cc350 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcf5004c220 tx=0x7fcf50045140 comp rx=0 tx=0).stop 2024-09-18T01:25:33.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/2384087604 shutdown_connections 2024-09-18T01:25:33.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 --2- 172.21.15.100:0/2384087604 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce38036b90 0x7fce38039050 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 --2- 172.21.15.100:0/2384087604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d7cbf30 0x56149d7cc350 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/2384087604 >> 172.21.15.100:0/2384087604 conn(0x56149d7c0ec0 msgr2=0x56149d7c3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/2384087604 shutdown_connections 2024-09-18T01:25:33.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/2384087604 wait complete. 2024-09-18T01:25:33.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56149d7bb690 msgr2=0x56149d7bda80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56149d7bb690 0x56149d7bda80 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56149d6bc900 msgr2=0x56149d7b4ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56149d6bc900 0x56149d7b4ef0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56149d7b77a0 msgr2=0x56149d7b9b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56149d7b77a0 0x56149d7b9b90 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce48036b40 msgr2=0x7fce48039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fce48036b40 0x7fce48039000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcf48057000 tx=0x7fcf48052000 comp rx=0 tx=0).stop 2024-09-18T01:25:33.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6b84c0 msgr2=0x56149d7ade80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:33.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 --2- 172.21.15.100:0/3515866615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56149d6b84c0 0x56149d7ade80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x56149d7a83c0 tx=0x7fcf50000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:33.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf608e1640 1 -- 172.21.15.100:0/3515866615 reap_dead start 2024-09-18T01:25:33.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 shutdown_connections 2024-09-18T01:25:33.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 >> 172.21.15.100:0/3515866615 conn(0x56149d6b3df0 msgr2=0x56149d7a1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:33.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 shutdown_connections 2024-09-18T01:25:33.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:33.659+0000 7fcf64324800 1 -- 172.21.15.100:0/3515866615 wait complete. 2024-09-18T01:25:33.673 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:33.680 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-18T01:25:33.924 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-18T01:25:33.930 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:48.931 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-18T01:25:48.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-18T01:25:48.932 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-18T01:25:48.982 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:48.983 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:48.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.982+0000 7fdb66739800 1 Processor -- start 2024-09-18T01:25:48.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.982+0000 7fdb66739800 1 -- start start 2024-09-18T01:25:48.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.983+0000 7fdb66739800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x565343b57df0 0x565343be95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:48.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.983+0000 7fdb66739800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565343aa3b30 con 0x565343be9b20 2024-09-18T01:25:48.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.983+0000 7fdb66739800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x565343a85360 con 0x565343b57df0 2024-09-18T01:25:48.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.983+0000 7fdb623d1640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x565343b57df0 0x565343be95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:48.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.983+0000 7fdb61bd0640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x565343be9b20 0x565343bebf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:43672/0 (socket says 172.21.15.100:43672) 2024-09-18T01:25:48.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.983+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1583839768 learned_addr learned my addr 172.21.15.100:0/1583839768 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:48.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.983+0000 7fdb623d1640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x565343b57df0 0x565343be95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52324/0 (socket says 172.21.15.100:52324) 2024-09-18T01:25:48.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.983+0000 7fdb623d1640 1 -- 172.21.15.100:0/1583839768 >> v1:172.21.15.92:6789/0 conn(0x565343be9b20 legacy=0x565343bebf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:48.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.983+0000 7fdb623d1640 1 -- 172.21.15.100:0/1583839768 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565343aabe00 con 0x565343b57df0 2024-09-18T01:25:48.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.985+0000 7fdb623d1640 1 --2- 172.21.15.100:0/1583839768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 0x565343be95e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400a470 tx=0x7fdb54045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a98ad04f0e3e73 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:48.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.986+0000 7fdb613cf640 1 -- 172.21.15.100:0/1583839768 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb54053570 con 0x565343b57df0 2024-09-18T01:25:48.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.986+0000 7fdb613cf640 1 -- 172.21.15.100:0/1583839768 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb54058070 con 0x565343b57df0 2024-09-18T01:25:48.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.986+0000 7fdb613cf640 1 -- 172.21.15.100:0/1583839768 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb54053880 con 0x565343b57df0 2024-09-18T01:25:48.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.986+0000 7fdb66739800 1 -- 172.21.15.100:0/1583839768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 msgr2=0x565343be95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:48.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.986+0000 7fdb66739800 1 --2- 172.21.15.100:0/1583839768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 0x565343be95e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400a470 tx=0x7fdb54045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:48.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.986+0000 7fdb66739800 1 -- 172.21.15.100:0/1583839768 shutdown_connections 2024-09-18T01:25:48.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.986+0000 7fdb66739800 1 --2- 172.21.15.100:0/1583839768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 0x565343be95e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:48.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.986+0000 7fdb66739800 1 -- 172.21.15.100:0/1583839768 >> 172.21.15.100:0/1583839768 conn(0x565343bdedf0 msgr2=0x565343be1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:48.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.986+0000 7fdb66739800 1 -- 172.21.15.100:0/1583839768 shutdown_connections 2024-09-18T01:25:48.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:48.986+0000 7fdb66739800 1 -- 172.21.15.100:0/1583839768 wait complete. 2024-09-18T01:25:49.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.002+0000 7fdb66739800 1 Processor -- start 2024-09-18T01:25:49.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.002+0000 7fdb66739800 1 -- start start 2024-09-18T01:25:49.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.002+0000 7fdb66739800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 0x565343cd5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.002+0000 7fdb66739800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x565343b30330 con 0x565343b57df0 2024-09-18T01:25:49.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.002+0000 7fdb623d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 0x565343cd5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.002+0000 7fdb623d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 0x565343cd5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52338/0 (socket says 172.21.15.100:52338) 2024-09-18T01:25:49.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.002+0000 7fdb623d1640 1 -- 172.21.15.100:0/3637270449 learned_addr learned my addr 172.21.15.100:0/3637270449 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.003+0000 7fdb623d1640 1 -- 172.21.15.100:0/3637270449 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565343a7dbc0 con 0x565343b57df0 2024-09-18T01:25:49.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.003+0000 7fdb623d1640 1 --2- 172.21.15.100:0/3637270449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 0x565343cd5a60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdb54025c20 tx=0x7fdb54051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deafdafedbe93f9f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.003+0000 7fda50608640 1 -- 172.21.15.100:0/3637270449 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb5405c580 con 0x565343b57df0 2024-09-18T01:25:49.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.003+0000 7fda50608640 1 -- 172.21.15.100:0/3637270449 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb54063030 con 0x565343b57df0 2024-09-18T01:25:49.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.003+0000 7fda50608640 1 -- 172.21.15.100:0/3637270449 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb5405c850 con 0x565343b57df0 2024-09-18T01:25:49.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.004+0000 7fdb66739800 1 -- 172.21.15.100:0/3637270449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 msgr2=0x565343cd5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.004+0000 7fdb66739800 1 --2- 172.21.15.100:0/3637270449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 0x565343cd5a60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdb54025c20 tx=0x7fdb54051000 comp rx=0 tx=0).stop 2024-09-18T01:25:49.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.004+0000 7fdb66739800 1 -- 172.21.15.100:0/3637270449 shutdown_connections 2024-09-18T01:25:49.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.004+0000 7fdb66739800 1 --2- 172.21.15.100:0/3637270449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 0x565343cd5a60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.004+0000 7fdb66739800 1 -- 172.21.15.100:0/3637270449 >> 172.21.15.100:0/3637270449 conn(0x565343bdedf0 msgr2=0x565343cd1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.004+0000 7fdb66739800 1 -- 172.21.15.100:0/3637270449 shutdown_connections 2024-09-18T01:25:49.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.004+0000 7fdb66739800 1 -- 172.21.15.100:0/3637270449 wait complete. 2024-09-18T01:25:49.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.004+0000 7fdb66739800 1 Processor -- start 2024-09-18T01:25:49.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.004+0000 7fdb66739800 1 -- start start 2024-09-18T01:25:49.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.005+0000 7fdb66739800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 0x565343cdd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.005+0000 7fdb66739800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x565343bed900 con 0x565343b57df0 2024-09-18T01:25:49.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.005+0000 7fdb623d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 0x565343cdd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.005+0000 7fdb623d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 0x565343cdd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52346/0 (socket says 172.21.15.100:52346) 2024-09-18T01:25:49.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.005+0000 7fdb623d1640 1 -- 172.21.15.100:0/3086863908 learned_addr learned my addr 172.21.15.100:0/3086863908 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.005+0000 7fdb623d1640 1 -- 172.21.15.100:0/3086863908 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565343a91fe0 con 0x565343b57df0 2024-09-18T01:25:49.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.005+0000 7fdb623d1640 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 0x565343cdd3c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x565343cd68c0 tx=0x7fdb54002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.006+0000 7fda4ee05640 1 -- 172.21.15.100:0/3086863908 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb54054ad0 con 0x565343b57df0 2024-09-18T01:25:49.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.006+0000 7fda4ee05640 1 -- 172.21.15.100:0/3086863908 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb54054c70 con 0x565343b57df0 2024-09-18T01:25:49.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.006+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565343cdd900 con 0x565343b57df0 2024-09-18T01:25:49.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.006+0000 7fda4ee05640 1 -- 172.21.15.100:0/3086863908 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb54068420 con 0x565343b57df0 2024-09-18T01:25:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.006+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565343cdde20 con 0x565343b57df0 2024-09-18T01:25:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.006+0000 7fda4ee05640 1 -- 172.21.15.100:0/3086863908 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb540685c0 con 0x565343b57df0 2024-09-18T01:25:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.007+0000 7fda4ee05640 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda48036b40 0x7fda48039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.007+0000 7fda4ee05640 1 -- 172.21.15.100:0/3086863908 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fdb54070030 con 0x565343b57df0 2024-09-18T01:25:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.007+0000 7fdb61bd0640 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda48036b40 0x7fda48039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.007+0000 7fdb66739800 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x565343be9b20 0x565343ce4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.007+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343ce4a00 con 0x565343be9b20 2024-09-18T01:25:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.007+0000 7fdb62bd2640 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x565343be9b20 0x565343ce4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.007+0000 7fdb61bd0640 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda48036b40 0x7fda48039000 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdb58000f60 tx=0x7fdb580012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.007+0000 7fdb62bd2640 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x565343be9b20 0x565343ce4430 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.008+0000 7fdb62bd2640 1 -- 172.21.15.100:0/3086863908 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343be9b20 2024-09-18T01:25:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.008+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343ce19e0 con 0x565343be9b20 2024-09-18T01:25:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.008+0000 7fdb62bd2640 1 -- 172.21.15.100:0/3086863908 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343be9b20 2024-09-18T01:25:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.008+0000 7fdb66739800 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565343ce6d60 0x565343ce9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.008+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343ce9840 con 0x565343ce6d60 2024-09-18T01:25:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.008+0000 7fdb623d1640 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565343ce6d60 0x565343ce9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.008+0000 7fdb623d1640 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565343ce6d60 0x565343ce9150 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.009+0000 7fdb623d1640 1 -- 172.21.15.100:0/3086863908 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb54051070 con 0x565343ce6d60 2024-09-18T01:25:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.009+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343ce5bd0 con 0x565343be9b20 2024-09-18T01:25:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.009+0000 7fdb62bd2640 1 -- 172.21.15.100:0/3086863908 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343be9b20 2024-09-18T01:25:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.009+0000 7fdb66739800 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x565343ceaca0 0x565343ced090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.009+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343ced780 con 0x565343ceaca0 2024-09-18T01:25:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.009+0000 7fdb61bd0640 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x565343ceaca0 0x565343ced090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.010+0000 7fdb61bd0640 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x565343ceaca0 0x565343ced090 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.010+0000 7fdb61bd0640 1 -- 172.21.15.100:0/3086863908 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb58009050 con 0x565343ceaca0 2024-09-18T01:25:49.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.010+0000 7fdb66739800 1 Processor -- start 2024-09-18T01:25:49.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.010+0000 7fdb66739800 1 -- start start 2024-09-18T01:25:49.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.011+0000 7fdb66739800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343cfb4f0 0x565343cfb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.011+0000 7fdb66739800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x565343a7f580 con 0x565343cfb4f0 2024-09-18T01:25:49.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.011+0000 7fdb623d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343cfb4f0 0x565343cfb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.011+0000 7fdb623d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343cfb4f0 0x565343cfb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52362/0 (socket says 172.21.15.100:52362) 2024-09-18T01:25:49.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.011+0000 7fdb623d1640 1 -- 172.21.15.100:0/3145850656 learned_addr learned my addr 172.21.15.100:0/3145850656 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.011+0000 7fdb623d1640 1 -- 172.21.15.100:0/3145850656 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565343cfbe50 con 0x565343cfb4f0 2024-09-18T01:25:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.011+0000 7fdb623d1640 1 --2- 172.21.15.100:0/3145850656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343cfb4f0 0x565343cfb910 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdb5408f160 tx=0x7fdb5405ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.011+0000 7fda47fff640 1 -- 172.21.15.100:0/3145850656 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb5407db00 con 0x565343cfb4f0 2024-09-18T01:25:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.011+0000 7fda47fff640 1 -- 172.21.15.100:0/3145850656 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5407dca0 con 0x565343cfb4f0 2024-09-18T01:25:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.011+0000 7fda47fff640 1 -- 172.21.15.100:0/3145850656 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb5405fad0 con 0x565343cfb4f0 2024-09-18T01:25:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.011+0000 7fdb66739800 1 -- 172.21.15.100:0/3145850656 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565343cfc0e0 con 0x565343cfb4f0 2024-09-18T01:25:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.012+0000 7fdb66739800 1 -- 172.21.15.100:0/3145850656 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565343cfedc0 con 0x565343cfb4f0 2024-09-18T01:25:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.012+0000 7fda47fff640 1 -- 172.21.15.100:0/3145850656 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb54089070 con 0x565343cfb4f0 2024-09-18T01:25:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.013+0000 7fda47fff640 1 --2- 172.21.15.100:0/3145850656 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda3c036be0 0x7fda3c0390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.013+0000 7fda47fff640 1 -- 172.21.15.100:0/3145850656 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fdb5409eab0 con 0x565343cfb4f0 2024-09-18T01:25:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.013+0000 7fdb61bd0640 1 --2- 172.21.15.100:0/3145850656 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda3c036be0 0x7fda3c0390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.013+0000 7fdb66739800 1 Processor -- start 2024-09-18T01:25:49.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.013+0000 7fdb66739800 1 -- start start 2024-09-18T01:25:49.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.013+0000 7fdb61bd0640 1 --2- 172.21.15.100:0/3145850656 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda3c036be0 0x7fda3c0390a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800bf50 tx=0x7fdb5800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.013+0000 7fdb66739800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343d07f40 0x565343d08340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.013+0000 7fdb66739800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x565343cd61b0 con 0x565343d07f40 2024-09-18T01:25:49.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.013+0000 7fdb623d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343d07f40 0x565343d08340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.013+0000 7fdb623d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343d07f40 0x565343d08340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52364/0 (socket says 172.21.15.100:52364) 2024-09-18T01:25:49.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.013+0000 7fdb623d1640 1 -- 172.21.15.100:0/2561256713 learned_addr learned my addr 172.21.15.100:0/2561256713 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.014+0000 7fdb623d1640 1 -- 172.21.15.100:0/2561256713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565343d08910 con 0x565343d07f40 2024-09-18T01:25:49.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.014+0000 7fdb623d1640 1 --2- 172.21.15.100:0/2561256713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343d07f40 0x565343d08340 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdb5408cb80 tx=0x7fdb5408c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f06aab6615ea84 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.014+0000 7fda45ffb640 1 -- 172.21.15.100:0/2561256713 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb540ac020 con 0x565343d07f40 2024-09-18T01:25:49.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.014+0000 7fda45ffb640 1 -- 172.21.15.100:0/2561256713 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb54004280 con 0x565343d07f40 2024-09-18T01:25:49.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.014+0000 7fda45ffb640 1 -- 172.21.15.100:0/2561256713 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb5405c450 con 0x565343d07f40 2024-09-18T01:25:49.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.014+0000 7fdb66739800 1 -- 172.21.15.100:0/2561256713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343d07f40 msgr2=0x565343d08340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.014+0000 7fdb66739800 1 --2- 172.21.15.100:0/2561256713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343d07f40 0x565343d08340 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdb5408cb80 tx=0x7fdb5408c630 comp rx=0 tx=0).stop 2024-09-18T01:25:49.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.014+0000 7fdb66739800 1 -- 172.21.15.100:0/2561256713 shutdown_connections 2024-09-18T01:25:49.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.014+0000 7fdb66739800 1 --2- 172.21.15.100:0/2561256713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343d07f40 0x565343d08340 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.014+0000 7fdb66739800 1 -- 172.21.15.100:0/2561256713 >> 172.21.15.100:0/2561256713 conn(0x565343d042f0 msgr2=0x565343d023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.015+0000 7fdb66739800 1 -- 172.21.15.100:0/2561256713 shutdown_connections 2024-09-18T01:25:49.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.015+0000 7fdb66739800 1 -- 172.21.15.100:0/2561256713 wait complete. 2024-09-18T01:25:49.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.015+0000 7fdb66739800 1 Processor -- start 2024-09-18T01:25:49.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.015+0000 7fdb66739800 1 -- start start 2024-09-18T01:25:49.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.015+0000 7fdb66739800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343d07f40 0x565343d0f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.015+0000 7fdb66739800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x565343d08da0 con 0x565343d07f40 2024-09-18T01:25:49.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.015+0000 7fdb623d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343d07f40 0x565343d0f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.015+0000 7fdb623d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343d07f40 0x565343d0f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52366/0 (socket says 172.21.15.100:52366) 2024-09-18T01:25:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.015+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 learned_addr learned my addr 172.21.15.100:0/1229156208 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.015+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565343d0f700 con 0x565343d07f40 2024-09-18T01:25:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.016+0000 7fdb623d1640 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343d07f40 0x565343d0f1c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdb54004430 tx=0x7fdb54073fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.016+0000 7fda33fff640 1 -- 172.21.15.100:0/1229156208 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb540c1070 con 0x565343d07f40 2024-09-18T01:25:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.016+0000 7fda33fff640 1 -- 172.21.15.100:0/1229156208 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb54009c40 con 0x565343d07f40 2024-09-18T01:25:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.016+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565343d0f700 con 0x565343d07f40 2024-09-18T01:25:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.016+0000 7fda33fff640 1 -- 172.21.15.100:0/1229156208 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb5405fc70 con 0x565343d07f40 2024-09-18T01:25:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.016+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565343d0f700 con 0x565343d07f40 2024-09-18T01:25:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.017+0000 7fda33fff640 1 -- 172.21.15.100:0/1229156208 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb540c4070 con 0x565343d07f40 2024-09-18T01:25:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.017+0000 7fda33fff640 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda2c036b90 0x7fda2c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.017+0000 7fda33fff640 1 -- 172.21.15.100:0/1229156208 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fdb540b8030 con 0x565343d07f40 2024-09-18T01:25:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.017+0000 7fdb61bd0640 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda2c036b90 0x7fda2c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.017+0000 7fdb66739800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.017+0000 7fdb66739800 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x565343d1a760 0x565343d1cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.017+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d1d370 con 0x565343d1a760 2024-09-18T01:25:49.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.018+0000 7fdb62bd2640 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x565343d1a760 0x565343d1cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.018+0000 7fdb61bd0640 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda2c036b90 0x7fda2c039050 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdb58001b60 tx=0x7fdb58010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.018+0000 7fdb62bd2640 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x565343d1a760 0x565343d1cc20 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.018+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.018+0000 7fdb66739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.018+0000 7fdb66739800 20 realm 2024-09-18T01:25:49.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.018+0000 7fdb66739800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.018+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d1d780 con 0x565343d1a760 2024-09-18T01:25:49.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.018+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.018+0000 7fdb66739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.018+0000 7fdb66739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:49.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.018+0000 7fdb66739800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.018+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e050 con 0x565343d1a760 2024-09-18T01:25:49.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.019+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.019+0000 7fdb66739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.019+0000 7fdb66739800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.019+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1a760 2024-09-18T01:25:49.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.019+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.019+0000 7fdb66739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:49.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.019+0000 7fdb66739800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.019+0000 7fdb66739800 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565343d1eee0 0x565343d212d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.019+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d21a30 con 0x565343d1eee0 2024-09-18T01:25:49.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.019+0000 7fdb623d1640 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565343d1eee0 0x565343d212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.019+0000 7fdb623d1640 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565343d1eee0 0x565343d212d0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.020+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.020+0000 7fdb66739800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:49.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.020+0000 7fdb66739800 20 searching for the correct realm 2024-09-18T01:25:49.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.020+0000 7fdb66739800 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x565343d23ae0 0x565343d25fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.020+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d26670 con 0x565343d23ae0 2024-09-18T01:25:49.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.020+0000 7fdb61bd0640 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x565343d23ae0 0x565343d25fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.020+0000 7fdb61bd0640 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x565343d23ae0 0x565343d25fa0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.020+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.020+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d26670 con 0x565343d1eee0 2024-09-18T01:25:49.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.021+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.021+0000 7fdb623d1640 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fdb540c6060 0x7fdb540c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.021+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d26670 con 0x7fdb540c6060 2024-09-18T01:25:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.021+0000 7fdb62bd2640 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fdb540c6060 0x7fdb540c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.021+0000 7fdb62bd2640 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fdb540c6060 0x7fdb540c1590 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.022+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.022+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1a760 2024-09-18T01:25:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.022+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.022+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1a760 2024-09-18T01:25:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.022+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.022+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x7fdb540c6060 2024-09-18T01:25:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.023+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.023+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x7fdb540c6060 2024-09-18T01:25:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.023+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.023+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1eee0 2024-09-18T01:25:49.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.023+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.023+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d23ae0 2024-09-18T01:25:49.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.023+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.023+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1a760 2024-09-18T01:25:49.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.024+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.024+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1eee0 2024-09-18T01:25:49.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.024+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.024+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1a760 2024-09-18T01:25:49.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.024+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.024+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1eee0 2024-09-18T01:25:49.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.024+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.024+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d23ae0 2024-09-18T01:25:49.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.025+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.025+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d23ae0 2024-09-18T01:25:49.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.025+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.025+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x7fdb540c6060 2024-09-18T01:25:49.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.025+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.025+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d23ae0 2024-09-18T01:25:49.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.025+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.025+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d23ae0 2024-09-18T01:25:49.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.026+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.026+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1a760 2024-09-18T01:25:49.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.026+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.026+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1a760 2024-09-18T01:25:49.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.026+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.026+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x7fdb540c6060 2024-09-18T01:25:49.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.027+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.027+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d23ae0 2024-09-18T01:25:49.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.027+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.027+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1eee0 2024-09-18T01:25:49.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.027+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.027+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1a760 2024-09-18T01:25:49.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.027+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.027+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x7fdb540c6060 2024-09-18T01:25:49.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.028+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.028+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d23ae0 2024-09-18T01:25:49.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.028+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.028+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1eee0 2024-09-18T01:25:49.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.028+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.028+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1eee0 2024-09-18T01:25:49.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.028+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.028+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d23ae0 2024-09-18T01:25:49.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.029+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.029+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x7fdb540c6060 2024-09-18T01:25:49.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.029+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.029+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1a760 2024-09-18T01:25:49.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.029+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.029+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565343d1e3f0 con 0x565343d1eee0 2024-09-18T01:25:49.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb66739800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:49.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb66739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:49.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb66739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:49.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb66739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:49.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb66739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:49.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb66739800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:49.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb66739800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d223e0 con 0x565343d1a760 2024-09-18T01:25:49.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb66739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb66739800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d227d0 con 0x565343d1a760 2024-09-18T01:25:49.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb66739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb66739800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.030+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d227d0 con 0x7fdb540c6060 2024-09-18T01:25:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 20 zone default found 2024-09-18T01:25:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 4 Realm: () 2024-09-18T01:25:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 20 zonegroup default 2024-09-18T01:25:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d22bf0 con 0x7fdb540c6060 2024-09-18T01:25:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d22bf0 con 0x565343d23ae0 2024-09-18T01:25:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d284d0 con 0x565343d23ae0 2024-09-18T01:25:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 20 started sync module instance, tier type = 2024-09-18T01:25:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:49.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.031+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d27970 con 0x565343d1eee0 2024-09-18T01:25:49.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.033+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.033+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94915620142432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d28d20 con 0x565343d1eee0 2024-09-18T01:25:49.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.033+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d29570 con 0x565343d1a760 2024-09-18T01:25:49.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.034+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94915620142432] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.034+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.034+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94915620145264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d29670 con 0x565343d1a760 2024-09-18T01:25:49.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.034+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2a130 con 0x565343d23ae0 2024-09-18T01:25:49.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.035+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94915620145264] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.035+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.035+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94915620150272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2a520 con 0x565343d23ae0 2024-09-18T01:25:49.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.035+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2af80 con 0x565343d1eee0 2024-09-18T01:25:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.036+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94915620150272] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.037+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.037+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94915620147392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2b820 con 0x565343d1eee0 2024-09-18T01:25:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.037+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2c1e0 con 0x565343d1a760 2024-09-18T01:25:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.038+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94915620147392] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.038+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.038+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94915620156752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2c1e0 con 0x565343d1a760 2024-09-18T01:25:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.038+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2cba0 con 0x7fdb540c6060 2024-09-18T01:25:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.040+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94915620156752] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.041+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.041+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94915620161744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2c1e0 con 0x7fdb540c6060 2024-09-18T01:25:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.041+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2d5b0 con 0x7fdb540c6060 2024-09-18T01:25:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.042+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94915620161744] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.042+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.042+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94915620158768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2d790 con 0x7fdb540c6060 2024-09-18T01:25:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.042+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2dfe0 con 0x7fdb540c6060 2024-09-18T01:25:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.043+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94915620158768] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.044+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.045+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94915620164800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2de50 con 0x7fdb540c6060 2024-09-18T01:25:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.045+0000 7fdb66739800 20 add_watcher() i=0 2024-09-18T01:25:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.045+0000 7fdb66739800 20 add_watcher() i=1 2024-09-18T01:25:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.045+0000 7fdb66739800 20 add_watcher() i=2 2024-09-18T01:25:49.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.045+0000 7fdb66739800 20 add_watcher() i=3 2024-09-18T01:25:49.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.045+0000 7fdb66739800 20 add_watcher() i=4 2024-09-18T01:25:49.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.045+0000 7fdb66739800 20 add_watcher() i=5 2024-09-18T01:25:49.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.045+0000 7fdb66739800 20 add_watcher() i=6 2024-09-18T01:25:49.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.046+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94915620164800] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.046+0000 7fdb66739800 20 add_watcher() i=7 2024-09-18T01:25:49.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.046+0000 7fdb66739800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:49.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.046+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d31390 con 0x565343d1a760 2024-09-18T01:25:49.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.046+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.046+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94915620165920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2e8b0 con 0x565343d1a760 2024-09-18T01:25:49.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.047+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94915620165920] v35'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.047+0000 7fda18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:49.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.047+0000 7fdb66739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:49.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.047+0000 7fdb66739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:49.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.047+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d39b90 con 0x565343d1a760 2024-09-18T01:25:49.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.048+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'48 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.048+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3a100 con 0x7fdb540c6060 2024-09-18T01:25:49.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.049+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.050+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3a670 con 0x565343d23ae0 2024-09-18T01:25:49.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.050+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.050+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3aec0 con 0x565343d1a760 2024-09-18T01:25:49.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.051+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'159 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.051+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d37ba0 con 0x565343d1eee0 2024-09-18T01:25:49.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.052+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'50 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.052+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d37b70 con 0x565343d23ae0 2024-09-18T01:25:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.053+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'41 uv16 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.053+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3ba20 con 0x565343d1a760 2024-09-18T01:25:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.055+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.055+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3c0b0 con 0x7fdb540c6060 2024-09-18T01:25:49.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.056+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'36 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.056+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3c0b0 con 0x565343d1eee0 2024-09-18T01:25:49.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.057+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.057+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3c0b0 con 0x565343d23ae0 2024-09-18T01:25:49.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.058+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.058+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3c620 con 0x565343d1eee0 2024-09-18T01:25:49.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.059+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'51 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.059+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3c620 con 0x7fdb540c6060 2024-09-18T01:25:49.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.060+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.060+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3c6b0 con 0x565343d1eee0 2024-09-18T01:25:49.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.061+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.061+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3c740 con 0x7fdb540c6060 2024-09-18T01:25:49.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.063+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'48 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.063+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3c740 con 0x565343d1a760 2024-09-18T01:25:49.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.064+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'160 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.064+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3c770 con 0x565343d23ae0 2024-09-18T01:25:49.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.065+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'44 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.065+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3cd20 con 0x565343d1eee0 2024-09-18T01:25:49.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.066+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'52 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.066+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3ccb0 con 0x565343d23ae0 2024-09-18T01:25:49.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.067+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'30 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.067+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3ccb0 con 0x565343d1a760 2024-09-18T01:25:49.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.068+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.068+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3ccb0 con 0x565343d1a760 2024-09-18T01:25:49.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.069+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'161 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.069+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3ccb0 con 0x565343d23ae0 2024-09-18T01:25:49.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.070+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'45 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.070+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3ccb0 con 0x565343d1eee0 2024-09-18T01:25:49.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.071+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'34 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.071+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3ccb0 con 0x565343d23ae0 2024-09-18T01:25:49.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.072+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.072+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3d070 con 0x565343d23ae0 2024-09-18T01:25:49.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.073+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'36 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.073+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3d070 con 0x565343d23ae0 2024-09-18T01:25:49.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.074+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.074+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3ba20 con 0x565343d23ae0 2024-09-18T01:25:49.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.075+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'42 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.075+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3ba20 con 0x7fdb540c6060 2024-09-18T01:25:49.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.076+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.076+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3ba20 con 0x565343d23ae0 2024-09-18T01:25:49.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.077+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.077+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3ba20 con 0x7fdb540c6060 2024-09-18T01:25:49.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.078+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'37 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.078+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3ba20 con 0x565343d23ae0 2024-09-18T01:25:49.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.079+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.079+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3ba20 con 0x7fdb540c6060 2024-09-18T01:25:49.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.080+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'49 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.080+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d3ba20 con 0x565343d1eee0 2024-09-18T01:25:49.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.081+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.081+0000 7fd9937fe640 20 reqs_thread_entry: start 2024-09-18T01:25:49.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.082+0000 7fdb66739800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:49.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.082+0000 7fdb66739800 20 Filter name: none 2024-09-18T01:25:49.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.082+0000 7fd9917fa640 20 reqs_thread_entry: start 2024-09-18T01:25:49.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.082+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b680 con 0x565343d1a760 2024-09-18T01:25:49.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.082+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv17 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.082+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1a760 2024-09-18T01:25:49.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.082+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv17 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.082+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1a760 2024-09-18T01:25:49.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.083+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv17 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.083+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x7fdb540c6060 2024-09-18T01:25:49.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.083+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.083+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x7fdb540c6060 2024-09-18T01:25:49.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.083+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.083+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x7fdb540c6060 2024-09-18T01:25:49.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.084+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.084+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d23ae0 2024-09-18T01:25:49.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.084+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.084+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d23ae0 2024-09-18T01:25:49.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.084+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.084+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d23ae0 2024-09-18T01:25:49.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.084+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.084+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1a760 2024-09-18T01:25:49.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.085+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv17 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.085+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1a760 2024-09-18T01:25:49.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.085+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv17 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.085+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1a760 2024-09-18T01:25:49.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.085+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv17 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.085+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1eee0 2024-09-18T01:25:49.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.085+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.085+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1eee0 2024-09-18T01:25:49.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.086+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv13 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.086+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1eee0 2024-09-18T01:25:49.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.086+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.086+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d23ae0 2024-09-18T01:25:49.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.086+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv16 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.086+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d23ae0 2024-09-18T01:25:49.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.087+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv16 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.087+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d23ae0 2024-09-18T01:25:49.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.087+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv16 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.087+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1a760 2024-09-18T01:25:49.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.087+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.087+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1a760 2024-09-18T01:25:49.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.087+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.087+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1a760 2024-09-18T01:25:49.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.088+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.088+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x7fdb540c6060 2024-09-18T01:25:49.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.088+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.088+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x7fdb540c6060 2024-09-18T01:25:49.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.088+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv13 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.088+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x7fdb540c6060 2024-09-18T01:25:49.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.089+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.089+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1eee0 2024-09-18T01:25:49.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.089+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.089+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1eee0 2024-09-18T01:25:49.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.089+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.089+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1eee0 2024-09-18T01:25:49.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.090+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.090+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d23ae0 2024-09-18T01:25:49.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.090+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.090+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d23ae0 2024-09-18T01:25:49.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.090+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.090+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d23ae0 2024-09-18T01:25:49.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.090+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.090+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1eee0 2024-09-18T01:25:49.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.091+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.091+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1eee0 2024-09-18T01:25:49.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.091+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.091+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1eee0 2024-09-18T01:25:49.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.091+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.091+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x7fdb540c6060 2024-09-18T01:25:49.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.092+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.092+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x7fdb540c6060 2024-09-18T01:25:49.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.092+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.092+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x7fdb540c6060 2024-09-18T01:25:49.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.092+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.092+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1eee0 2024-09-18T01:25:49.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.092+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.092+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1eee0 2024-09-18T01:25:49.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.093+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.093+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d3b640 con 0x565343d1eee0 2024-09-18T01:25:49.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.093+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 32 ==== osd_op_reply(132 gc.12 [call out=1702b] v0'0 uv24 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.093+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b90 con 0x7fdb540c6060 2024-09-18T01:25:49.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.093+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.093+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x7fdb540c6060 2024-09-18T01:25:49.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.094+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.094+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x7fdb540c6060 2024-09-18T01:25:49.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.094+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.094+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d1a760 2024-09-18T01:25:49.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.094+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.094+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d1a760 2024-09-18T01:25:49.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.094+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.094+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d1a760 2024-09-18T01:25:49.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.095+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.095+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.095+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.095+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d23ae0 2024-09-18T01:25:49.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.095+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.095+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.095+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.095+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d1eee0 2024-09-18T01:25:49.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.096+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.096+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d1eee0 2024-09-18T01:25:49.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.096+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv19 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.096+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d1eee0 2024-09-18T01:25:49.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.096+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.096+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.096+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.096+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d23ae0 2024-09-18T01:25:49.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.097+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv19 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.097+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.097+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.097+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d1a760 2024-09-18T01:25:49.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.097+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.097+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d1a760 2024-09-18T01:25:49.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.097+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.097+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d1a760 2024-09-18T01:25:49.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.098+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.098+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d1a760 2024-09-18T01:25:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.098+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.098+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d1a760 2024-09-18T01:25:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.098+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.098+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d1a760 2024-09-18T01:25:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.098+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.098+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.099+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.099+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d23ae0 2024-09-18T01:25:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.099+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.099+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.099+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.099+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d1eee0 2024-09-18T01:25:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.099+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.099+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d1eee0 2024-09-18T01:25:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.100+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.100+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d1eee0 2024-09-18T01:25:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.100+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.100+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.100+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.100+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d23ae0 2024-09-18T01:25:49.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.100+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.100+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.100+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.100+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.101+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.101+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d23ae0 2024-09-18T01:25:49.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.101+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.101+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.101+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.101+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.101+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.101+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d23ae0 2024-09-18T01:25:49.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.102+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.102+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.102+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.102+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.102+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.102+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d23ae0 2024-09-18T01:25:49.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.102+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.102+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.103+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.103+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x7fdb540c6060 2024-09-18T01:25:49.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.103+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.103+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x7fdb540c6060 2024-09-18T01:25:49.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.103+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.103+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x7fdb540c6060 2024-09-18T01:25:49.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.104+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.104+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.104+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.104+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d23ae0 2024-09-18T01:25:49.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.104+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.105+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.105+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.105+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x7fdb540c6060 2024-09-18T01:25:49.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.105+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.105+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x7fdb540c6060 2024-09-18T01:25:49.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.105+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.105+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x7fdb540c6060 2024-09-18T01:25:49.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.106+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.106+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.106+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.106+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d23ae0 2024-09-18T01:25:49.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.106+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.106+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d23ae0 2024-09-18T01:25:49.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.106+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.106+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x7fdb540c6060 2024-09-18T01:25:49.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.107+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.107+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x7fdb540c6060 2024-09-18T01:25:49.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.107+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.107+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x7fdb540c6060 2024-09-18T01:25:49.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.107+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.108+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d1eee0 2024-09-18T01:25:49.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.108+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.108+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d67b40 con 0x565343d1eee0 2024-09-18T01:25:49.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.108+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.108+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565343d68b50 con 0x565343d1eee0 2024-09-18T01:25:49.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.108+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.109+0000 7fda18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:49.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.109+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94915620165920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d17c40 con 0x565343d1a760 2024-09-18T01:25:49.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.110+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94915620165920] v35'162 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.110+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94915620142432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d674b0 con 0x565343d1eee0 2024-09-18T01:25:49.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.111+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94915620142432] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.111+0000 7fdb66739800 20 remove_watcher() i=0 2024-09-18T01:25:49.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.111+0000 7fdb66739800 2 removed watcher, disabling cache 2024-09-18T01:25:49.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.111+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94915620145264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d27d60 con 0x565343d1a760 2024-09-18T01:25:49.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.113+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94915620145264] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.113+0000 7fdb66739800 20 remove_watcher() i=1 2024-09-18T01:25:49.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.113+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94915620150272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d27d60 con 0x565343d23ae0 2024-09-18T01:25:49.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.114+0000 7fdb61bd0640 1 -- 172.21.15.100:0/1229156208 <== osd.3 v2:172.21.15.100:6816/595195757 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94915620150272] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb58009050 con 0x565343d23ae0 2024-09-18T01:25:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.114+0000 7fdb66739800 20 remove_watcher() i=2 2024-09-18T01:25:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.114+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94915620147392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d27d60 con 0x565343d1eee0 2024-09-18T01:25:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.115+0000 7fdb623d1640 1 -- 172.21.15.100:0/1229156208 <== osd.2 v2:172.21.15.100:6808/3104327688 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94915620147392] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb540c3030 con 0x565343d1eee0 2024-09-18T01:25:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.115+0000 7fdb66739800 20 remove_watcher() i=3 2024-09-18T01:25:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.115+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94915620156752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d27d60 con 0x565343d1a760 2024-09-18T01:25:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.116+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.1 v2:172.21.15.100:6800/170575980 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94915620156752] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x565343d1a760 2024-09-18T01:25:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.116+0000 7fdb66739800 20 remove_watcher() i=4 2024-09-18T01:25:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.116+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94915620161744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2b550 con 0x7fdb540c6060 2024-09-18T01:25:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.117+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94915620161744] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.117+0000 7fdb66739800 20 remove_watcher() i=5 2024-09-18T01:25:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.117+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94915620158768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d27d60 con 0x7fdb540c6060 2024-09-18T01:25:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.118+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94915620158768] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.118+0000 7fdb66739800 20 remove_watcher() i=6 2024-09-18T01:25:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.118+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94915620164800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565343d2bd30 con 0x7fdb540c6060 2024-09-18T01:25:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.119+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 <== osd.0 v2:172.21.15.92:6800/2777570747 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94915620164800] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5c00a4a0 con 0x7fdb540c6060 2024-09-18T01:25:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 20 remove_watcher() i=7 2024-09-18T01:25:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fdb540c6060 msgr2=0x7fdb540c1590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fdb540c6060 0x7fdb540c1590 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x565343d1a760 msgr2=0x565343d1cc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x565343d1a760 0x565343d1cc20 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565343d1eee0 msgr2=0x565343d212d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565343d1eee0 0x565343d212d0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x565343d23ae0 msgr2=0x565343d25fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x565343d23ae0 0x565343d25fa0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda2c036b90 msgr2=0x7fda2c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda2c036b90 0x7fda2c039050 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdb58001b60 tx=0x7fdb58010000 comp rx=0 tx=0).stop 2024-09-18T01:25:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343d07f40 msgr2=0x565343d0f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb62bd2640 1 -- 172.21.15.100:0/1229156208 reap_dead start 2024-09-18T01:25:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343d07f40 0x565343d0f1c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdb54004430 tx=0x7fdb54073fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 shutdown_connections 2024-09-18T01:25:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 --2- 172.21.15.100:0/1229156208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343d07f40 0x565343d0f1c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 >> 172.21.15.100:0/1229156208 conn(0x565343d042f0 msgr2=0x565343d023c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 shutdown_connections 2024-09-18T01:25:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/1229156208 wait complete. 2024-09-18T01:25:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/3145850656 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda3c036be0 msgr2=0x7fda3c0390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 --2- 172.21.15.100:0/3145850656 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda3c036be0 0x7fda3c0390a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800bf50 tx=0x7fdb5800f000 comp rx=0 tx=0).stop 2024-09-18T01:25:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/3145850656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343cfb4f0 msgr2=0x565343cfb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 --2- 172.21.15.100:0/3145850656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343cfb4f0 0x565343cfb910 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdb5408f160 tx=0x7fdb5405ce10 comp rx=0 tx=0).stop 2024-09-18T01:25:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/3145850656 shutdown_connections 2024-09-18T01:25:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 --2- 172.21.15.100:0/3145850656 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda3c036be0 0x7fda3c0390a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 --2- 172.21.15.100:0/3145850656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343cfb4f0 0x565343cfb910 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/3145850656 >> 172.21.15.100:0/3145850656 conn(0x565343cf0480 msgr2=0x565343cf3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/3145850656 shutdown_connections 2024-09-18T01:25:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.120+0000 7fdb66739800 1 -- 172.21.15.100:0/3145850656 wait complete. 2024-09-18T01:25:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x565343ceaca0 msgr2=0x565343ced090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb66739800 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x565343ceaca0 0x565343ced090 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x565343be9b20 msgr2=0x565343ce4430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb66739800 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x565343be9b20 0x565343ce4430 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565343ce6d60 msgr2=0x565343ce9150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb66739800 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565343ce6d60 0x565343ce9150 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda48036b40 msgr2=0x7fda48039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb66739800 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fda48036b40 0x7fda48039000 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdb58000f60 tx=0x7fdb580012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 msgr2=0x565343cdd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb66739800 1 --2- 172.21.15.100:0/3086863908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565343b57df0 0x565343cdd3c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x565343cd68c0 tx=0x7fdb54002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb62bd2640 1 -- 172.21.15.100:0/3086863908 reap_dead start 2024-09-18T01:25:49.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 shutdown_connections 2024-09-18T01:25:49.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 >> 172.21.15.100:0/3086863908 conn(0x565343bdedf0 msgr2=0x565343ccfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 shutdown_connections 2024-09-18T01:25:49.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.121+0000 7fdb66739800 1 -- 172.21.15.100:0/3086863908 wait complete. 2024-09-18T01:25:49.130 INFO:teuthology.orchestra.run.smithi100.stdout:[{"tag":"153b7754-209b-4898-8796-577da7c1273d.4237.17625608472269284896\u0000","time":"2024-09-18T01:25:48.928962+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_7","key":"","instance":""}]}] 2024-09-18T01:25:49.130 DEBUG:tasks.util.rgw: json result: [{'tag': '153b7754-209b-4898-8796-577da7c1273d.4237.17625608472269284896\x00', 'time': '2024-09-18T01:25:48.928962+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_7', 'key': '', 'instance': ''}]}] 2024-09-18T01:25:49.130 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-18T01:25:49.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-18T01:25:49.131 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-18T01:25:49.173 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:49.173 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:49.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.172+0000 7f5d14a10800 1 Processor -- start 2024-09-18T01:25:49.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.172+0000 7f5d14a10800 1 -- start start 2024-09-18T01:25:49.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.172+0000 7f5d14a10800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56267976fe00 0x5626797ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.172+0000 7f5d14a10800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5626796bbb30 con 0x5626797ff6f0 2024-09-18T01:25:49.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.172+0000 7f5d14a10800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x56267969d360 con 0x56267976fe00 2024-09-18T01:25:49.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.173+0000 7f5d100f7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56267976fe00 0x5626797ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.173+0000 7f5d07fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5626797ff6f0 0x562679801ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:43676/0 (socket says 172.21.15.100:43676) 2024-09-18T01:25:49.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.173+0000 7f5d100f7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56267976fe00 0x5626797ff1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52374/0 (socket says 172.21.15.100:52374) 2024-09-18T01:25:49.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.173+0000 7f5d07fff640 1 -- 172.21.15.100:0/2646906574 learned_addr learned my addr 172.21.15.100:0/2646906574 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:49.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.173+0000 7f5d100f7640 1 -- 172.21.15.100:0/2646906574 >> v1:172.21.15.92:6789/0 conn(0x5626797ff6f0 legacy=0x562679801ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.173+0000 7f5d100f7640 1 -- 172.21.15.100:0/2646906574 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626796c3e00 con 0x56267976fe00 2024-09-18T01:25:49.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.175+0000 7f5d100f7640 1 --2- 172.21.15.100:0/2646906574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 0x5626797ff1b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000a470 tx=0x7f5d00045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91a6bca46cf3738 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.175+0000 7f5d0f8f6640 1 -- 172.21.15.100:0/2646906574 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d00053570 con 0x56267976fe00 2024-09-18T01:25:49.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.175+0000 7f5d0f8f6640 1 -- 172.21.15.100:0/2646906574 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d00058070 con 0x56267976fe00 2024-09-18T01:25:49.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.175+0000 7f5d0f8f6640 1 -- 172.21.15.100:0/2646906574 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d00053880 con 0x56267976fe00 2024-09-18T01:25:49.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.176+0000 7f5d14a10800 1 -- 172.21.15.100:0/2646906574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 msgr2=0x5626797ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.176+0000 7f5d14a10800 1 --2- 172.21.15.100:0/2646906574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 0x5626797ff1b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000a470 tx=0x7f5d00045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:49.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.176+0000 7f5d14a10800 1 -- 172.21.15.100:0/2646906574 shutdown_connections 2024-09-18T01:25:49.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.176+0000 7f5d14a10800 1 --2- 172.21.15.100:0/2646906574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 0x5626797ff1b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.176+0000 7f5d14a10800 1 -- 172.21.15.100:0/2646906574 >> 172.21.15.100:0/2646906574 conn(0x5626797f6de0 msgr2=0x5626797f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.176+0000 7f5d14a10800 1 -- 172.21.15.100:0/2646906574 shutdown_connections 2024-09-18T01:25:49.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.176+0000 7f5d14a10800 1 -- 172.21.15.100:0/2646906574 wait complete. 2024-09-18T01:25:49.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.189+0000 7f5d14a10800 1 Processor -- start 2024-09-18T01:25:49.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.189+0000 7f5d14a10800 1 -- start start 2024-09-18T01:25:49.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.190+0000 7f5d14a10800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 0x5626798eb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.190+0000 7f5d14a10800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562679748320 con 0x56267976fe00 2024-09-18T01:25:49.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.190+0000 7f5d100f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 0x5626798eb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.190+0000 7f5d100f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 0x5626798eb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52380/0 (socket says 172.21.15.100:52380) 2024-09-18T01:25:49.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.190+0000 7f5d100f7640 1 -- 172.21.15.100:0/715845913 learned_addr learned my addr 172.21.15.100:0/715845913 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.190+0000 7f5d100f7640 1 -- 172.21.15.100:0/715845913 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562679695bc0 con 0x56267976fe00 2024-09-18T01:25:49.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.190+0000 7f5d100f7640 1 --2- 172.21.15.100:0/715845913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 0x5626798eb850 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5d00025c20 tx=0x7f5d00051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d955009d5320dd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.191+0000 7f5bfe60c640 1 -- 172.21.15.100:0/715845913 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d0005c580 con 0x56267976fe00 2024-09-18T01:25:49.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.191+0000 7f5bfe60c640 1 -- 172.21.15.100:0/715845913 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d00063030 con 0x56267976fe00 2024-09-18T01:25:49.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.191+0000 7f5bfe60c640 1 -- 172.21.15.100:0/715845913 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d0005c850 con 0x56267976fe00 2024-09-18T01:25:49.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.191+0000 7f5d14a10800 1 -- 172.21.15.100:0/715845913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 msgr2=0x5626798eb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.191+0000 7f5d14a10800 1 --2- 172.21.15.100:0/715845913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 0x5626798eb850 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5d00025c20 tx=0x7f5d00051000 comp rx=0 tx=0).stop 2024-09-18T01:25:49.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.191+0000 7f5d14a10800 1 -- 172.21.15.100:0/715845913 shutdown_connections 2024-09-18T01:25:49.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.191+0000 7f5d14a10800 1 --2- 172.21.15.100:0/715845913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 0x5626798eb850 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.191+0000 7f5d14a10800 1 -- 172.21.15.100:0/715845913 >> 172.21.15.100:0/715845913 conn(0x5626797f6de0 msgr2=0x5626798e7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.191+0000 7f5d14a10800 1 -- 172.21.15.100:0/715845913 shutdown_connections 2024-09-18T01:25:49.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.191+0000 7f5d14a10800 1 -- 172.21.15.100:0/715845913 wait complete. 2024-09-18T01:25:49.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.192+0000 7f5d14a10800 1 Processor -- start 2024-09-18T01:25:49.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.192+0000 7f5d14a10800 1 -- start start 2024-09-18T01:25:49.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.192+0000 7f5d14a10800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 0x5626798f31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.192+0000 7f5d14a10800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5626798035f0 con 0x56267976fe00 2024-09-18T01:25:49.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.192+0000 7f5d100f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 0x5626798f31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.192+0000 7f5d100f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 0x5626798f31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52384/0 (socket says 172.21.15.100:52384) 2024-09-18T01:25:49.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.192+0000 7f5d100f7640 1 -- 172.21.15.100:0/1615834079 learned_addr learned my addr 172.21.15.100:0/1615834079 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.192+0000 7f5d100f7640 1 -- 172.21.15.100:0/1615834079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626796a9fe0 con 0x56267976fe00 2024-09-18T01:25:49.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.193+0000 7f5d100f7640 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 0x5626798f31b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x5626798ec6b0 tx=0x7f5d00002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.193+0000 7f5bfce09640 1 -- 172.21.15.100:0/1615834079 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d00054ad0 con 0x56267976fe00 2024-09-18T01:25:49.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.193+0000 7f5bfce09640 1 -- 172.21.15.100:0/1615834079 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d00054c70 con 0x56267976fe00 2024-09-18T01:25:49.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.193+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626798f36f0 con 0x56267976fe00 2024-09-18T01:25:49.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.193+0000 7f5bfce09640 1 -- 172.21.15.100:0/1615834079 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d00068420 con 0x56267976fe00 2024-09-18T01:25:49.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.193+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626798f3c10 con 0x56267976fe00 2024-09-18T01:25:49.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.194+0000 7f5bfce09640 1 -- 172.21.15.100:0/1615834079 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5d000685c0 con 0x56267976fe00 2024-09-18T01:25:49.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.194+0000 7f5bfce09640 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5bf8036b40 0x7f5bf8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.194+0000 7f5bfce09640 1 -- 172.21.15.100:0/1615834079 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f5d00070030 con 0x56267976fe00 2024-09-18T01:25:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.194+0000 7f5d07fff640 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5bf8036b40 0x7f5bf8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.194+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5626797ff6f0 0x5626798fa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.194+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626798fa7a0 con 0x5626797ff6f0 2024-09-18T01:25:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.194+0000 7f5d108f8640 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5626797ff6f0 0x5626798fa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.194+0000 7f5d07fff640 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5bf8036b40 0x7f5bf8039000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8000f60 tx=0x7f5cf80012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.195+0000 7f5d108f8640 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5626797ff6f0 0x5626798fa220 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.195+0000 7f5d108f8640 1 -- 172.21.15.100:0/1615834079 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x5626797ff6f0 2024-09-18T01:25:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.195+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626798f77f0 con 0x5626797ff6f0 2024-09-18T01:25:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.195+0000 7f5d108f8640 1 -- 172.21.15.100:0/1615834079 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d0800a4a0 con 0x5626797ff6f0 2024-09-18T01:25:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.195+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5626798fcaf0 0x5626798feee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.195+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626798ff580 con 0x5626798fcaf0 2024-09-18T01:25:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.195+0000 7f5d100f7640 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5626798fcaf0 0x5626798feee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.195+0000 7f5d100f7640 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5626798fcaf0 0x5626798feee0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.196+0000 7f5d100f7640 1 -- 172.21.15.100:0/1615834079 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d00051070 con 0x5626798fcaf0 2024-09-18T01:25:49.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.196+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626798fb990 con 0x5626797ff6f0 2024-09-18T01:25:49.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.196+0000 7f5d108f8640 1 -- 172.21.15.100:0/1615834079 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d0800a4a0 con 0x5626797ff6f0 2024-09-18T01:25:49.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.196+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5626799009e0 0x562679902dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.196+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626799034d0 con 0x5626799009e0 2024-09-18T01:25:49.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.196+0000 7f5d07fff640 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5626799009e0 0x562679902dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.197+0000 7f5d07fff640 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5626799009e0 0x562679902dd0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.197+0000 7f5d07fff640 1 -- 172.21.15.100:0/1615834079 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5cf8009050 con 0x5626799009e0 2024-09-18T01:25:49.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.198+0000 7f5d14a10800 1 Processor -- start 2024-09-18T01:25:49.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.198+0000 7f5d14a10800 1 -- start start 2024-09-18T01:25:49.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.198+0000 7f5d14a10800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562679911280 0x5626799116a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.198+0000 7f5d14a10800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562679697580 con 0x562679911280 2024-09-18T01:25:49.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.198+0000 7f5d100f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562679911280 0x5626799116a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.198+0000 7f5d100f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562679911280 0x5626799116a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52398/0 (socket says 172.21.15.100:52398) 2024-09-18T01:25:49.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.198+0000 7f5d100f7640 1 -- 172.21.15.100:0/640025865 learned_addr learned my addr 172.21.15.100:0/640025865 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.198+0000 7f5d100f7640 1 -- 172.21.15.100:0/640025865 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562679911be0 con 0x562679911280 2024-09-18T01:25:49.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.199+0000 7f5d100f7640 1 --2- 172.21.15.100:0/640025865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562679911280 0x5626799116a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5d0008f210 tx=0x7f5d0008f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.199+0000 7f5bf5ffb640 1 -- 172.21.15.100:0/640025865 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d00095070 con 0x562679911280 2024-09-18T01:25:49.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.199+0000 7f5bf5ffb640 1 -- 172.21.15.100:0/640025865 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d0005fc00 con 0x562679911280 2024-09-18T01:25:49.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.199+0000 7f5d14a10800 1 -- 172.21.15.100:0/640025865 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562679911e70 con 0x562679911280 2024-09-18T01:25:49.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.199+0000 7f5bf5ffb640 1 -- 172.21.15.100:0/640025865 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d0005e770 con 0x562679911280 2024-09-18T01:25:49.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.199+0000 7f5d14a10800 1 -- 172.21.15.100:0/640025865 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562679914b50 con 0x562679911280 2024-09-18T01:25:49.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.200+0000 7f5bf5ffb640 1 -- 172.21.15.100:0/640025865 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5d00098070 con 0x562679911280 2024-09-18T01:25:49.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.200+0000 7f5bf5ffb640 1 --2- 172.21.15.100:0/640025865 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5be8036b40 0x7f5be8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.200+0000 7f5bf5ffb640 1 -- 172.21.15.100:0/640025865 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f5d0008d050 con 0x562679911280 2024-09-18T01:25:49.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.200+0000 7f5d07fff640 1 --2- 172.21.15.100:0/640025865 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5be8036b40 0x7f5be8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.200+0000 7f5d14a10800 1 Processor -- start 2024-09-18T01:25:49.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.200+0000 7f5d14a10800 1 -- start start 2024-09-18T01:25:49.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.200+0000 7f5d07fff640 1 --2- 172.21.15.100:0/640025865 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5be8036b40 0x7f5be8039000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800bf50 tx=0x7f5cf800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.200+0000 7f5d14a10800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267991dcf0 0x56267991e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.200+0000 7f5d14a10800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5626798ebfa0 con 0x56267991dcf0 2024-09-18T01:25:49.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.201+0000 7f5d100f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267991dcf0 0x56267991e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.201+0000 7f5d100f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267991dcf0 0x56267991e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52400/0 (socket says 172.21.15.100:52400) 2024-09-18T01:25:49.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.201+0000 7f5d100f7640 1 -- 172.21.15.100:0/243977030 learned_addr learned my addr 172.21.15.100:0/243977030 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.201+0000 7f5d100f7640 1 -- 172.21.15.100:0/243977030 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56267991e6c0 con 0x56267991dcf0 2024-09-18T01:25:49.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.201+0000 7f5d100f7640 1 --2- 172.21.15.100:0/243977030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267991dcf0 0x56267991e0f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5d00054830 tx=0x7f5d000857b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420eb2a59dab9eb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.201+0000 7f5bef7fe640 1 -- 172.21.15.100:0/243977030 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d000ad070 con 0x56267991dcf0 2024-09-18T01:25:49.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.201+0000 7f5bef7fe640 1 -- 172.21.15.100:0/243977030 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d0007db00 con 0x56267991dcf0 2024-09-18T01:25:49.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.201+0000 7f5bef7fe640 1 -- 172.21.15.100:0/243977030 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d000890d0 con 0x56267991dcf0 2024-09-18T01:25:49.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.202+0000 7f5d14a10800 1 -- 172.21.15.100:0/243977030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267991dcf0 msgr2=0x56267991e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.202+0000 7f5d14a10800 1 --2- 172.21.15.100:0/243977030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267991dcf0 0x56267991e0f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5d00054830 tx=0x7f5d000857b0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.202+0000 7f5d14a10800 1 -- 172.21.15.100:0/243977030 shutdown_connections 2024-09-18T01:25:49.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.202+0000 7f5d14a10800 1 --2- 172.21.15.100:0/243977030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267991dcf0 0x56267991e0f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.202+0000 7f5d14a10800 1 -- 172.21.15.100:0/243977030 >> 172.21.15.100:0/243977030 conn(0x56267991a0a0 msgr2=0x5626799181a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.202+0000 7f5d14a10800 1 -- 172.21.15.100:0/243977030 shutdown_connections 2024-09-18T01:25:49.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.202+0000 7f5d14a10800 1 -- 172.21.15.100:0/243977030 wait complete. 2024-09-18T01:25:49.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.202+0000 7f5d14a10800 1 Processor -- start 2024-09-18T01:25:49.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.202+0000 7f5d14a10800 1 -- start start 2024-09-18T01:25:49.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.202+0000 7f5d14a10800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267991dcf0 0x562679924f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.202+0000 7f5d14a10800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56267991eb50 con 0x56267991dcf0 2024-09-18T01:25:49.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.202+0000 7f5d100f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267991dcf0 0x562679924f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.202+0000 7f5d100f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267991dcf0 0x562679924f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52406/0 (socket says 172.21.15.100:52406) 2024-09-18T01:25:49.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.202+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 learned_addr learned my addr 172.21.15.100:0/1681185025 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.203+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626799254d0 con 0x56267991dcf0 2024-09-18T01:25:49.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.203+0000 7f5d100f7640 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267991dcf0 0x562679924f90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5d0005ca40 tx=0x7f5d00079f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.203+0000 7f5bedffb640 1 -- 172.21.15.100:0/1681185025 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d000b8020 con 0x56267991dcf0 2024-09-18T01:25:49.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.203+0000 7f5bedffb640 1 -- 172.21.15.100:0/1681185025 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d00090990 con 0x56267991dcf0 2024-09-18T01:25:49.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.203+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626799254d0 con 0x56267991dcf0 2024-09-18T01:25:49.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.203+0000 7f5bedffb640 1 -- 172.21.15.100:0/1681185025 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d000ad040 con 0x56267991dcf0 2024-09-18T01:25:49.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.203+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626799254d0 con 0x56267991dcf0 2024-09-18T01:25:49.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.204+0000 7f5bedffb640 1 -- 172.21.15.100:0/1681185025 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5d000bb020 con 0x56267991dcf0 2024-09-18T01:25:49.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.204+0000 7f5bedffb640 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5be0036b40 0x7f5be0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.204+0000 7f5bedffb640 1 -- 172.21.15.100:0/1681185025 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f5d000a5070 con 0x56267991dcf0 2024-09-18T01:25:49.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.204+0000 7f5d07fff640 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5be0036b40 0x7f5be0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.205+0000 7f5d07fff640 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5be0036b40 0x7f5be0039000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8001b60 tx=0x7f5cf8010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.205+0000 7f5d14a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.205+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562679930730 0x562679932bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.205+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679933340 con 0x562679930730 2024-09-18T01:25:49.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.205+0000 7f5d108f8640 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562679930730 0x562679932bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.205+0000 7f5d108f8640 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562679930730 0x562679932bf0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.205+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.205+0000 7f5d14a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.205+0000 7f5d14a10800 20 realm 2024-09-18T01:25:49.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.205+0000 7f5d14a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.205+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679933750 con 0x562679930730 2024-09-18T01:25:49.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d14a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d14a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:49.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d14a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679934020 con 0x562679930730 2024-09-18T01:25:49.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d14a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d14a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679930730 2024-09-18T01:25:49.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d14a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:49.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d14a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562679935120 0x562679937510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679937b20 con 0x562679935120 2024-09-18T01:25:49.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d100f7640 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562679935120 0x562679937510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.206+0000 7f5d100f7640 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562679935120 0x562679937510 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.207+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.207+0000 7f5d14a10800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:49.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.207+0000 7f5d14a10800 20 searching for the correct realm 2024-09-18T01:25:49.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.207+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562679939ad0 0x56267993bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.207+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56267993c660 con 0x562679939ad0 2024-09-18T01:25:49.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.207+0000 7f5d07fff640 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562679939ad0 0x56267993bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.207+0000 7f5d07fff640 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562679939ad0 0x56267993bf90 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.207+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.207+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56267993c660 con 0x562679935120 2024-09-18T01:25:49.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.208+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.208+0000 7f5d100f7640 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f5d000bd020 0x7f5d00004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.208+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56267993c660 con 0x7f5d000bd020 2024-09-18T01:25:49.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.208+0000 7f5d108f8640 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f5d000bd020 0x7f5d00004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.208+0000 7f5d108f8640 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f5d000bd020 0x7f5d00004cb0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.209+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.209+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679930730 2024-09-18T01:25:49.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.209+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.209+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679930730 2024-09-18T01:25:49.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.209+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.209+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x7f5d000bd020 2024-09-18T01:25:49.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.209+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.209+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x7f5d000bd020 2024-09-18T01:25:49.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.210+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.210+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679935120 2024-09-18T01:25:49.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.210+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.210+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679939ad0 2024-09-18T01:25:49.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.210+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.210+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679930730 2024-09-18T01:25:49.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.210+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.210+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679935120 2024-09-18T01:25:49.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.211+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.211+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679930730 2024-09-18T01:25:49.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.211+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.211+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679935120 2024-09-18T01:25:49.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.211+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.211+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679939ad0 2024-09-18T01:25:49.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.211+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.211+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679939ad0 2024-09-18T01:25:49.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.211+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.211+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x7f5d000bd020 2024-09-18T01:25:49.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.212+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.212+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679939ad0 2024-09-18T01:25:49.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.212+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.212+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679939ad0 2024-09-18T01:25:49.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.212+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.212+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679930730 2024-09-18T01:25:49.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.212+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.212+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679930730 2024-09-18T01:25:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.213+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.213+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x7f5d000bd020 2024-09-18T01:25:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.213+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.213+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679939ad0 2024-09-18T01:25:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.213+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.213+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679935120 2024-09-18T01:25:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.214+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.214+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679930730 2024-09-18T01:25:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.214+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.214+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x7f5d000bd020 2024-09-18T01:25:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.214+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.214+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679939ad0 2024-09-18T01:25:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.214+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.214+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679935120 2024-09-18T01:25:49.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.215+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.215+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679935120 2024-09-18T01:25:49.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.215+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.215+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679939ad0 2024-09-18T01:25:49.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.215+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.215+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x7f5d000bd020 2024-09-18T01:25:49.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.215+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.215+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679930730 2024-09-18T01:25:49.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626799343c0 con 0x562679935120 2024-09-18T01:25:49.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d14a10800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d14a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d14a10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d14a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d14a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d14a10800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d14a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626799383e0 con 0x562679930730 2024-09-18T01:25:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d14a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d14a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626799387d0 con 0x562679930730 2024-09-18T01:25:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d14a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d14a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.216+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626799387d0 con 0x7f5d000bd020 2024-09-18T01:25:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d14a10800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d14a10800 20 zone default found 2024-09-18T01:25:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d14a10800 4 Realm: () 2024-09-18T01:25:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d14a10800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d14a10800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d14a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d14a10800 20 zonegroup default 2024-09-18T01:25:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d14a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267993cae0 con 0x7f5d000bd020 2024-09-18T01:25:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d14a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d14a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267993e4c0 con 0x562679939ad0 2024-09-18T01:25:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d14a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.217+0000 7f5d14a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.218+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267993e860 con 0x562679939ad0 2024-09-18T01:25:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.218+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.218+0000 7f5d14a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.218+0000 7f5d14a10800 20 started sync module instance, tier type = 2024-09-18T01:25:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.218+0000 7f5d14a10800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.218+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267993d960 con 0x562679935120 2024-09-18T01:25:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.219+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.219+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94723248477360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267993ec00 con 0x562679935120 2024-09-18T01:25:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.219+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267993f4d0 con 0x562679930730 2024-09-18T01:25:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.220+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94723248477360] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.220+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.220+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94723248484256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267993f8c0 con 0x562679930730 2024-09-18T01:25:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.220+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626799402e0 con 0x562679939ad0 2024-09-18T01:25:49.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.221+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94723248484256] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.221+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.221+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94723248487888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626799406d0 con 0x562679939ad0 2024-09-18T01:25:49.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.222+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626799410f0 con 0x562679935120 2024-09-18T01:25:49.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.222+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.223+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94723248493792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679941db0 con 0x562679935120 2024-09-18T01:25:49.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.223+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626799428a0 con 0x562679930730 2024-09-18T01:25:49.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.223+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94723248487888] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.223+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94723248493792] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.224+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.224+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94723248497520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679941900 con 0x562679930730 2024-09-18T01:25:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.224+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679943140 con 0x7f5d000bd020 2024-09-18T01:25:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.225+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.225+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94723248497520] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.225+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94723248499776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679943510 con 0x7f5d000bd020 2024-09-18T01:25:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.225+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267993dd80 con 0x7f5d000bd020 2024-09-18T01:25:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.226+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94723248499776] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.226+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.226+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94723248500832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679943930 con 0x7f5d000bd020 2024-09-18T01:25:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.226+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679944180 con 0x7f5d000bd020 2024-09-18T01:25:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.228+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(58 notify.7 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.228+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94723248500832] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.228+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94723248503568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679944570 con 0x7f5d000bd020 2024-09-18T01:25:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.228+0000 7f5d14a10800 20 add_watcher() i=0 2024-09-18T01:25:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.228+0000 7f5d14a10800 20 add_watcher() i=1 2024-09-18T01:25:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.228+0000 7f5d14a10800 20 add_watcher() i=2 2024-09-18T01:25:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.228+0000 7f5d14a10800 20 add_watcher() i=3 2024-09-18T01:25:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.228+0000 7f5d14a10800 20 add_watcher() i=4 2024-09-18T01:25:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.228+0000 7f5d14a10800 20 add_watcher() i=5 2024-09-18T01:25:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.228+0000 7f5d14a10800 20 add_watcher() i=6 2024-09-18T01:25:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.229+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94723248503568] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.229+0000 7f5d14a10800 20 add_watcher() i=7 2024-09-18T01:25:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.229+0000 7f5d14a10800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.229+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679944570 con 0x562679930730 2024-09-18T01:25:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.229+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.229+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94723248506080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679944100 con 0x562679930730 2024-09-18T01:25:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.230+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94723248506080] v35'163 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.230+0000 7f5bc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.231+0000 7f5d14a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.231+0000 7f5d14a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.231+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679950050 con 0x562679930730 2024-09-18T01:25:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.232+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'49 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.232+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679950720 con 0x7f5d000bd020 2024-09-18T01:25:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.233+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.234+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679950b40 con 0x562679939ad0 2024-09-18T01:25:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.235+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.235+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679951560 con 0x562679930730 2024-09-18T01:25:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.236+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'164 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.236+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994bd30 con 0x562679935120 2024-09-18T01:25:49.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.236+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'53 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.237+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994bd00 con 0x562679939ad0 2024-09-18T01:25:49.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.237+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'43 uv16 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.237+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626799520c0 con 0x562679930730 2024-09-18T01:25:49.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.239+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.239+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952570 con 0x7f5d000bd020 2024-09-18T01:25:49.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.240+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.240+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952570 con 0x562679935120 2024-09-18T01:25:49.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.241+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.241+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952930 con 0x562679939ad0 2024-09-18T01:25:49.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.242+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.242+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952930 con 0x562679935120 2024-09-18T01:25:49.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.242+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'54 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.242+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952930 con 0x7f5d000bd020 2024-09-18T01:25:49.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.244+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.244+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952930 con 0x562679935120 2024-09-18T01:25:49.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.245+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.245+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952930 con 0x7f5d000bd020 2024-09-18T01:25:49.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.246+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'50 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.246+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952930 con 0x562679930730 2024-09-18T01:25:49.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.247+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'165 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.247+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952930 con 0x562679939ad0 2024-09-18T01:25:49.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.248+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'47 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.248+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626799529c0 con 0x562679935120 2024-09-18T01:25:49.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.249+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'55 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.249+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626799529c0 con 0x562679939ad0 2024-09-18T01:25:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.250+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'31 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.250+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952a50 con 0x562679930730 2024-09-18T01:25:49.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.251+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.251+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952a50 con 0x562679930730 2024-09-18T01:25:49.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.252+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'166 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.252+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952a50 con 0x562679939ad0 2024-09-18T01:25:49.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.254+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'48 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.254+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952ae0 con 0x562679935120 2024-09-18T01:25:49.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.255+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'35 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.255+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952ae0 con 0x562679939ad0 2024-09-18T01:25:49.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.255+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.255+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952cb0 con 0x562679939ad0 2024-09-18T01:25:49.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.256+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.256+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952570 con 0x562679939ad0 2024-09-18T01:25:49.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.257+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.257+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952570 con 0x562679939ad0 2024-09-18T01:25:49.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.258+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'44 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.258+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952570 con 0x7f5d000bd020 2024-09-18T01:25:49.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.260+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.260+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952570 con 0x562679939ad0 2024-09-18T01:25:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.261+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.261+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952570 con 0x7f5d000bd020 2024-09-18T01:25:49.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.262+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'39 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.262+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952570 con 0x562679939ad0 2024-09-18T01:25:49.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.263+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.263+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952570 con 0x7f5d000bd020 2024-09-18T01:25:49.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.264+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'51 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.264+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679952570 con 0x562679935120 2024-09-18T01:25:49.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.266+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.266+0000 7f5bc57e2640 20 reqs_thread_entry: start 2024-09-18T01:25:49.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.266+0000 7f5d14a10800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:49.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.266+0000 7f5d14a10800 20 Filter name: none 2024-09-18T01:25:49.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.266+0000 7f5b36ffd640 20 reqs_thread_entry: start 2024-09-18T01:25:49.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.266+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-18T01:25:49.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.266+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:94 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679939ad0 2024-09-18T01:25:49.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.267+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(94 gc.5 [call] v35'45 uv45 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.267+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:95 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679939ad0 2024-09-18T01:25:49.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.267+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 27 ==== osd_op_reply(95 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.267+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.267+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:96 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679939ad0 2024-09-18T01:25:49.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.268+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 28 ==== osd_op_reply(96 gc.5 [call out=24b] v0'0 uv45 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.268+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:97 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679939ad0 2024-09-18T01:25:49.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.268+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 29 ==== osd_op_reply(97 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.268+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.268+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:98 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679939ad0 2024-09-18T01:25:49.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.268+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 30 ==== osd_op_reply(98 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.268+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.268+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:99 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679939ad0 2024-09-18T01:25:49.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.269+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 31 ==== osd_op_reply(99 gc.5 [call] v35'46 uv46 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.269+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-18T01:25:49.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.269+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:100 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679930730 2024-09-18T01:25:49.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.270+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(100 gc.6 [call] v35'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.271+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:101 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679930730 2024-09-18T01:25:49.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.271+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(101 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.271+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.271+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:102 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679930730 2024-09-18T01:25:49.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.271+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(102 gc.6 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.271+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:103 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679930730 2024-09-18T01:25:49.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.271+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(103 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.271+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.271+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:104 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679930730 2024-09-18T01:25:49.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.272+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(104 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.272+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.272+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:105 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679930730 2024-09-18T01:25:49.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.273+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(105 gc.6 [call] v35'29 uv29 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.273+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-18T01:25:49.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.273+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:106 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x7f5d000bd020 2024-09-18T01:25:49.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.274+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(106 gc.7 [call] v35'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.274+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:107 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x7f5d000bd020 2024-09-18T01:25:49.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.274+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(107 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.274+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.274+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:108 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x7f5d000bd020 2024-09-18T01:25:49.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.275+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(108 gc.7 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.275+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:109 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x7f5d000bd020 2024-09-18T01:25:49.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.275+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(109 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.275+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.275+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:110 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x7f5d000bd020 2024-09-18T01:25:49.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.275+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(110 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.275+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.275+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:111 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x7f5d000bd020 2024-09-18T01:25:49.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.276+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(111 gc.7 [call] v35'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.276+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-18T01:25:49.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.276+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:112 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.278+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(112 gc.8 [call] v35'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.278+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:113 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.278+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== osd_op_reply(113 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.278+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.278+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:114 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.278+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 23 ==== osd_op_reply(114 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.278+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:115 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.278+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 24 ==== osd_op_reply(115 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.279+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.279+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:116 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.279+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 25 ==== osd_op_reply(116 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.279+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.279+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:117 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.280+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 26 ==== osd_op_reply(117 gc.8 [call] v35'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.280+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-18T01:25:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.280+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:118 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679939ad0 2024-09-18T01:25:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.281+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 32 ==== osd_op_reply(118 gc.9 [call] v35'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.281+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:119 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679939ad0 2024-09-18T01:25:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.281+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 33 ==== osd_op_reply(119 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.281+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.281+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:120 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679939ad0 2024-09-18T01:25:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.282+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 34 ==== osd_op_reply(120 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.282+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679939ad0 2024-09-18T01:25:49.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.282+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 35 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.282+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.282+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679939ad0 2024-09-18T01:25:49.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.282+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 36 ==== osd_op_reply(122 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.282+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.282+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679939ad0 2024-09-18T01:25:49.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.283+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 37 ==== osd_op_reply(123 gc.9 [call] v35'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.283+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-18T01:25:49.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.283+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.286+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 27 ==== osd_op_reply(124 gc.10 [call] v35'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.286+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.286+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 28 ==== osd_op_reply(125 gc.10 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.286+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.286+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.286+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 29 ==== osd_op_reply(126 gc.10 [call out=24b] v0'0 uv56 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.286+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:127 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.287+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 30 ==== osd_op_reply(127 gc.10 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.287+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.287+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:128 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.287+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 31 ==== osd_op_reply(128 gc.10 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.287+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.287+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:129 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.288+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 32 ==== osd_op_reply(129 gc.10 [call] v35'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.288+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-18T01:25:49.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.288+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:130 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x7f5d000bd020 2024-09-18T01:25:49.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.289+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 29 ==== osd_op_reply(130 gc.11 [call] v35'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.289+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:131 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x7f5d000bd020 2024-09-18T01:25:49.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.289+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 30 ==== osd_op_reply(131 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.289+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.289+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:132 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x7f5d000bd020 2024-09-18T01:25:49.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.290+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 31 ==== osd_op_reply(132 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.290+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:133 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x7f5d000bd020 2024-09-18T01:25:49.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.290+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 32 ==== osd_op_reply(133 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.290+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.290+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:134 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x7f5d000bd020 2024-09-18T01:25:49.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.290+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 33 ==== osd_op_reply(134 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.290+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.290+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:135 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x7f5d000bd020 2024-09-18T01:25:49.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.291+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 34 ==== osd_op_reply(135 gc.11 [call] v35'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.291+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-18T01:25:49.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.291+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:136 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.292+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 33 ==== osd_op_reply(136 gc.12 [call] v35'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.292+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:137 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.293+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 34 ==== osd_op_reply(137 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.293+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.293+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:138 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.293+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 35 ==== osd_op_reply(138 gc.12 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.293+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:139 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.293+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 36 ==== osd_op_reply(139 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.293+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.293+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:140 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267994b280 con 0x562679935120 2024-09-18T01:25:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.293+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 37 ==== osd_op_reply(140 gc.12 [call out=1702b] v0'0 uv27 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.293+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-18T01:25:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 20 garbage collection: RGWGC::process iterating over entry tag='153b7754-209b-4898-8796-577da7c1273d.4237.17625608472269284896', time=2024-09-18T01:25:48.928962+0000, chain.objs.size()=7 2024-09-18T01:25:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_1 2024-09-18T01:25:49.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:141 3.3bs0 3:de628215:::153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267997f330 con 0x562679939ad0 2024-09-18T01:25:49.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_2 2024-09-18T01:25:49.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:142 3.12s0 3:496b5f8e:::153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679981f80 con 0x562679935120 2024-09-18T01:25:49.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_3 2024-09-18T01:25:49.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:143 3.10s0 3:0b943fcb:::153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679984850 con 0x562679930730 2024-09-18T01:25:49.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_4 2024-09-18T01:25:49.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:144 3.as0 3:5075a9c4:::153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626799870c0 con 0x562679939ad0 2024-09-18T01:25:49.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_5 2024-09-18T01:25:49.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:145 3.2bs0 3:d4ca26db:::153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679989b30 con 0x562679930730 2024-09-18T01:25:49.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_6 2024-09-18T01:25:49.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:146 3.2bs0 3:d602acb9:::153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267998c4e0 con 0x562679930730 2024-09-18T01:25:49.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_7 2024-09-18T01:25:49.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.294+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:147 3.30s0 3:0feb0723:::153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267998ed50 con 0x562679939ad0 2024-09-18T01:25:49.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.296+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 38 ==== osd_op_reply(142 153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_2 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.298+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 38 ==== osd_op_reply(144 153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_4 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.298+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 39 ==== osd_op_reply(141 153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_1 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.298+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(145 153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_5 [call] v35'3 uv3 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.301+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 40 ==== osd_op_reply(147 153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_7 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.301+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 34 ==== osd_op_reply(146 153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_6 [call] v35'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.302+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 35 ==== osd_op_reply(143 153b7754-209b-4898-8796-577da7c1273d.4237.1__shadow_.DPUzc_g6NSgOZL0cN2iEw22bksPq_8X_3 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.302+0000 7f5d14a10800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-18T01:25:49.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.302+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:148 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679989b30 con 0x562679935120 2024-09-18T01:25:49.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.306+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 39 ==== osd_op_reply(148 gc.12 [call] v35'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.306+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:149 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679989b30 con 0x562679935120 2024-09-18T01:25:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.308+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 40 ==== osd_op_reply(149 gc.12 [call] v35'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.308+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-18T01:25:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.308+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:150 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679989b30 con 0x7f5d000bd020 2024-09-18T01:25:49.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.311+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 35 ==== osd_op_reply(150 gc.13 [call] v35'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.311+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:151 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679989b30 con 0x7f5d000bd020 2024-09-18T01:25:49.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.311+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 36 ==== osd_op_reply(151 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.311+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.311+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:152 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679989b30 con 0x7f5d000bd020 2024-09-18T01:25:49.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.312+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 37 ==== osd_op_reply(152 gc.13 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.312+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:153 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679989b30 con 0x7f5d000bd020 2024-09-18T01:25:49.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.312+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 38 ==== osd_op_reply(153 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.312+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.312+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:154 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679989b30 con 0x7f5d000bd020 2024-09-18T01:25:49.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.312+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 39 ==== osd_op_reply(154 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.312+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.312+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:155 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679989b30 con 0x7f5d000bd020 2024-09-18T01:25:49.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.313+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 40 ==== osd_op_reply(155 gc.13 [call] v35'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.313+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-18T01:25:49.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.313+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:156 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679989b30 con 0x562679930730 2024-09-18T01:25:49.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.314+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 36 ==== osd_op_reply(156 gc.14 [call] v35'167 uv167 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.315+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:157 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679989b30 con 0x562679930730 2024-09-18T01:25:49.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.315+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 37 ==== osd_op_reply(157 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.315+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.315+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:158 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679983840 con 0x562679930730 2024-09-18T01:25:49.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.315+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 38 ==== osd_op_reply(158 gc.14 [call out=24b] v0'0 uv167 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.315+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:159 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267997cd40 con 0x562679930730 2024-09-18T01:25:49.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.315+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 39 ==== osd_op_reply(159 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.315+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.315+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:160 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267997cd40 con 0x562679930730 2024-09-18T01:25:49.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.315+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 40 ==== osd_op_reply(160 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.315+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.315+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:161 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267997cd40 con 0x562679930730 2024-09-18T01:25:49.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.316+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 41 ==== osd_op_reply(161 gc.14 [call] v35'168 uv168 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.316+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-18T01:25:49.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.316+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:162 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267997cd40 con 0x562679939ad0 2024-09-18T01:25:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.318+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 41 ==== osd_op_reply(162 gc.15 [call] v35'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.318+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:163 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267997cd40 con 0x562679939ad0 2024-09-18T01:25:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.318+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 42 ==== osd_op_reply(163 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.318+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.318+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:164 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267997cd40 con 0x562679939ad0 2024-09-18T01:25:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.318+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 43 ==== osd_op_reply(164 gc.15 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.318+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:165 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267997cd40 con 0x562679939ad0 2024-09-18T01:25:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.318+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 44 ==== osd_op_reply(165 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.318+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.318+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:166 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267997cd40 con 0x562679939ad0 2024-09-18T01:25:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.318+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 45 ==== osd_op_reply(166 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.318+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.319+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:167 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267997cd40 con 0x562679939ad0 2024-09-18T01:25:49.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.320+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 46 ==== osd_op_reply(167 gc.15 [call] v35'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.320+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-18T01:25:49.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.320+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:168 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267997cd40 con 0x562679935120 2024-09-18T01:25:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.321+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 41 ==== osd_op_reply(168 gc.16 [call] v35'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.321+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:169 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267997cd40 con 0x562679935120 2024-09-18T01:25:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.321+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 42 ==== osd_op_reply(169 gc.16 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.321+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.321+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:170 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56267997cd40 con 0x562679935120 2024-09-18T01:25:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.321+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 43 ==== osd_op_reply(170 gc.16 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.321+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:171 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.321+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 44 ==== osd_op_reply(171 gc.16 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.321+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.321+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:172 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.322+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 45 ==== osd_op_reply(172 gc.16 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.322+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.322+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:173 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.322+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 46 ==== osd_op_reply(173 gc.16 [call] v35'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.322+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-18T01:25:49.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.322+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:174 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.323+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 47 ==== osd_op_reply(174 gc.17 [call] v35'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.323+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:175 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.324+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 48 ==== osd_op_reply(175 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.324+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.324+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:176 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.324+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 49 ==== osd_op_reply(176 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.324+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:177 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.324+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 50 ==== osd_op_reply(177 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.324+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.324+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:178 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.324+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 51 ==== osd_op_reply(178 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.324+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.324+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:179 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.325+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 52 ==== osd_op_reply(179 gc.17 [call] v35'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.325+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-18T01:25:49.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.325+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:180 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.327+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 42 ==== osd_op_reply(180 gc.18 [call] v35'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.327+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:181 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.327+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 43 ==== osd_op_reply(181 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.327+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.327+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:182 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.327+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 44 ==== osd_op_reply(182 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.327+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:183 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.327+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 45 ==== osd_op_reply(183 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.327+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.327+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:184 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.328+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 46 ==== osd_op_reply(184 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.328+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.328+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:185 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.329+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 47 ==== osd_op_reply(185 gc.18 [call] v35'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.329+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-18T01:25:49.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.329+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:186 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.329+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 48 ==== osd_op_reply(186 gc.19 [call] v35'169 uv169 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.330+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:187 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.330+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 49 ==== osd_op_reply(187 gc.19 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.330+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.330+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:188 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.330+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 50 ==== osd_op_reply(188 gc.19 [call out=24b] v0'0 uv169 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.330+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:189 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.330+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 51 ==== osd_op_reply(189 gc.19 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.330+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.330+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:190 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.331+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 52 ==== osd_op_reply(190 gc.19 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.331+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.331+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:191 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.331+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 53 ==== osd_op_reply(191 gc.19 [call] v35'170 uv170 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.331+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-18T01:25:49.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.331+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:192 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.333+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 53 ==== osd_op_reply(192 gc.20 [call] v35'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.333+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:193 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.333+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 54 ==== osd_op_reply(193 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.333+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.333+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:194 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.333+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 55 ==== osd_op_reply(194 gc.20 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.333+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:195 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.333+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 56 ==== osd_op_reply(195 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.333+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.333+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:196 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.334+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 57 ==== osd_op_reply(196 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.334+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.334+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:197 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.335+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 58 ==== osd_op_reply(197 gc.20 [call] v35'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.335+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-18T01:25:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.335+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:198 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.336+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 47 ==== osd_op_reply(198 gc.21 [call] v35'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.336+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:199 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.336+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 48 ==== osd_op_reply(199 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.336+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.336+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:200 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.336+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 49 ==== osd_op_reply(200 gc.21 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.336+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:201 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.337+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 50 ==== osd_op_reply(201 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.337+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.337+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:202 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.337+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 51 ==== osd_op_reply(202 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.337+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.337+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:203 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.338+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 52 ==== osd_op_reply(203 gc.21 [call] v35'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.338+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-18T01:25:49.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.338+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:204 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.339+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 59 ==== osd_op_reply(204 gc.22 [call] v35'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.339+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:205 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.339+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 60 ==== osd_op_reply(205 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.339+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.339+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:206 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.339+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 61 ==== osd_op_reply(206 gc.22 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.339+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:207 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.340+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 62 ==== osd_op_reply(207 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.340+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.340+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:208 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.340+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 63 ==== osd_op_reply(208 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.340+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.340+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:209 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.341+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 64 ==== osd_op_reply(209 gc.22 [call] v35'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.341+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-18T01:25:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.341+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:210 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.342+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 65 ==== osd_op_reply(210 gc.23 [call] v35'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.342+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:211 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.342+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 66 ==== osd_op_reply(211 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.342+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.342+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:212 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.342+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 67 ==== osd_op_reply(212 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.342+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:213 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.343+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 68 ==== osd_op_reply(213 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.343+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.343+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:214 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.343+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 69 ==== osd_op_reply(214 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.343+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.343+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:215 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.344+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 70 ==== osd_op_reply(215 gc.23 [call] v35'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.344+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-18T01:25:49.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.344+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:216 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.345+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 71 ==== osd_op_reply(216 gc.24 [call] v35'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.345+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:217 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.345+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 72 ==== osd_op_reply(217 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.345+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.345+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:218 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.345+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 73 ==== osd_op_reply(218 gc.24 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.345+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:219 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.345+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 74 ==== osd_op_reply(219 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.345+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.345+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:220 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.346+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 75 ==== osd_op_reply(220 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.346+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.346+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:221 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.346+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 76 ==== osd_op_reply(221 gc.24 [call] v35'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.346+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-18T01:25:49.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.346+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:222 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.347+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 77 ==== osd_op_reply(222 gc.25 [call] v35'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.347+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:223 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.348+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 78 ==== osd_op_reply(223 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.348+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.348+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:224 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.348+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 79 ==== osd_op_reply(224 gc.25 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.348+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:225 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.348+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 80 ==== osd_op_reply(225 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.348+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.348+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:226 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.348+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 81 ==== osd_op_reply(226 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.348+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.348+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:227 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.349+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 82 ==== osd_op_reply(227 gc.25 [call] v35'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.349+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-18T01:25:49.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.349+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:228 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.351+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 41 ==== osd_op_reply(228 gc.26 [call] v35'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.351+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:229 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.351+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 42 ==== osd_op_reply(229 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.351+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.351+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:230 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.351+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 43 ==== osd_op_reply(230 gc.26 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.351+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:231 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.352+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 44 ==== osd_op_reply(231 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.352+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.352+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:232 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.352+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 45 ==== osd_op_reply(232 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.352+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.352+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:233 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.353+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 46 ==== osd_op_reply(233 gc.26 [call] v35'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.353+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-18T01:25:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.353+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:234 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.354+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 83 ==== osd_op_reply(234 gc.27 [call] v35'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.354+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:235 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.354+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 84 ==== osd_op_reply(235 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.354+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.354+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:236 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.355+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 85 ==== osd_op_reply(236 gc.27 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.355+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:237 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.355+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 86 ==== osd_op_reply(237 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.355+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.355+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:238 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.355+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 87 ==== osd_op_reply(238 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.355+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.355+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:239 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.356+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 88 ==== osd_op_reply(239 gc.27 [call] v35'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.356+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-18T01:25:49.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.356+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:240 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.357+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 47 ==== osd_op_reply(240 gc.28 [call] v35'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.357+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:241 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.357+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 48 ==== osd_op_reply(241 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.357+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.357+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:242 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.358+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 49 ==== osd_op_reply(242 gc.28 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.358+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:243 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.358+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 50 ==== osd_op_reply(243 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.358+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.358+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:244 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.358+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 51 ==== osd_op_reply(244 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.358+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.358+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:245 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.359+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 52 ==== osd_op_reply(245 gc.28 [call] v35'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.359+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-18T01:25:49.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.359+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:246 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.360+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 89 ==== osd_op_reply(246 gc.29 [call] v35'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.360+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:247 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.361+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 90 ==== osd_op_reply(247 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.361+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.361+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:248 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.361+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 91 ==== osd_op_reply(248 gc.29 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.361+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:249 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.361+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 92 ==== osd_op_reply(249 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.361+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.361+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:250 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.361+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 93 ==== osd_op_reply(250 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.361+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.361+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:251 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.362+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 94 ==== osd_op_reply(251 gc.29 [call] v35'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.362+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-18T01:25:49.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.362+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:252 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.364+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 53 ==== osd_op_reply(252 gc.30 [call] v35'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.364+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:253 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.364+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 54 ==== osd_op_reply(253 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.364+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.364+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:254 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.364+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 55 ==== osd_op_reply(254 gc.30 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.364+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:255 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.364+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 56 ==== osd_op_reply(255 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.364+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.364+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:256 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.365+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 57 ==== osd_op_reply(256 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.365+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.365+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:257 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.366+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 58 ==== osd_op_reply(257 gc.30 [call] v35'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.366+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-18T01:25:49.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.366+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:258 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.369+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 53 ==== osd_op_reply(258 gc.31 [call] v35'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.369+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:259 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.369+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 54 ==== osd_op_reply(259 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.369+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.369+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:260 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.369+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 55 ==== osd_op_reply(260 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.369+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:261 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.370+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 56 ==== osd_op_reply(261 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.370+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.370+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:262 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.370+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 57 ==== osd_op_reply(262 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.370+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.370+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:263 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.371+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 58 ==== osd_op_reply(263 gc.31 [call] v35'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.371+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-18T01:25:49.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.371+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:264 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.372+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 54 ==== osd_op_reply(264 gc.0 [call] v35'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.372+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:265 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.373+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 55 ==== osd_op_reply(265 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.373+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.373+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:266 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.373+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 56 ==== osd_op_reply(266 gc.0 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.373+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:267 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.373+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 57 ==== osd_op_reply(267 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.373+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.373+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:268 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.373+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 58 ==== osd_op_reply(268 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.373+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.373+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:269 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.374+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 59 ==== osd_op_reply(269 gc.0 [call] v35'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.374+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-18T01:25:49.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.374+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:270 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.375+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 59 ==== osd_op_reply(270 gc.1 [call] v35'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.375+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:271 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.376+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 60 ==== osd_op_reply(271 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.376+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.376+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:272 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.376+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 61 ==== osd_op_reply(272 gc.1 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.376+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:273 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.376+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 62 ==== osd_op_reply(273 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.376+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.376+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:274 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.377+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 63 ==== osd_op_reply(274 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.377+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.377+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:275 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x7f5d000bd020 2024-09-18T01:25:49.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.378+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 64 ==== osd_op_reply(275 gc.1 [call] v35'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.378+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-18T01:25:49.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.378+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:276 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.379+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 95 ==== osd_op_reply(276 gc.2 [call] v35'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.379+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:277 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.379+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 96 ==== osd_op_reply(277 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.379+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.379+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:278 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.379+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 97 ==== osd_op_reply(278 gc.2 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.379+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:279 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.379+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 98 ==== osd_op_reply(279 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.379+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.379+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:280 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.380+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 99 ==== osd_op_reply(280 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.380+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.380+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:281 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679939ad0 2024-09-18T01:25:49.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.380+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 100 ==== osd_op_reply(281 gc.2 [call] v35'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.380+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-18T01:25:49.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.380+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:282 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.381+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 60 ==== osd_op_reply(282 gc.3 [call] v35'171 uv171 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.381+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:283 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.382+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 61 ==== osd_op_reply(283 gc.3 [call out=15b] v0'0 uv171 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.382+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.382+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:284 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.382+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 62 ==== osd_op_reply(284 gc.3 [call out=24b] v0'0 uv171 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.382+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:285 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.382+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 63 ==== osd_op_reply(285 gc.3 [call out=15b] v0'0 uv171 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.382+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.382+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:286 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.382+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 64 ==== osd_op_reply(286 gc.3 [call out=15b] v0'0 uv171 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.382+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.382+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:287 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679930730 2024-09-18T01:25:49.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.383+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 65 ==== osd_op_reply(287 gc.3 [call] v35'172 uv172 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.383+0000 7f5d14a10800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-18T01:25:49.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.383+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:288 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.384+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 59 ==== osd_op_reply(288 gc.4 [call] v35'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.384+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:289 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.385+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 60 ==== osd_op_reply(289 gc.4 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.385+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.385+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:290 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.385+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 61 ==== osd_op_reply(290 gc.4 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.385+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:291 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.385+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 62 ==== osd_op_reply(291 gc.4 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.385+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:25:49.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.385+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:292 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.385+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 63 ==== osd_op_reply(292 gc.4 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.385+0000 7f5d14a10800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:25:49.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.385+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:293 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562679987460 con 0x562679935120 2024-09-18T01:25:49.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.386+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 64 ==== osd_op_reply(293 gc.4 [call] v35'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.387+0000 7f5bc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:49.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.387+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94723248506080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994f3f0 con 0x562679930730 2024-09-18T01:25:49.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.388+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94723248506080] v35'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.388+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94723248477360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994f3f0 con 0x562679935120 2024-09-18T01:25:49.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.389+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 65 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94723248477360] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.389+0000 7f5d14a10800 20 remove_watcher() i=0 2024-09-18T01:25:49.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.389+0000 7f5d14a10800 2 removed watcher, disabling cache 2024-09-18T01:25:49.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.389+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94723248484256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994f3f0 con 0x562679930730 2024-09-18T01:25:49.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.390+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94723248484256] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.390+0000 7f5d14a10800 20 remove_watcher() i=1 2024-09-18T01:25:49.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.390+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94723248487888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994f3f0 con 0x562679939ad0 2024-09-18T01:25:49.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.391+0000 7f5d07fff640 1 -- 172.21.15.100:0/1681185025 <== osd.3 v2:172.21.15.100:6816/595195757 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94723248487888] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x562679939ad0 2024-09-18T01:25:49.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.391+0000 7f5d14a10800 20 remove_watcher() i=2 2024-09-18T01:25:49.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.392+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94723248493792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994f3f0 con 0x562679935120 2024-09-18T01:25:49.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.392+0000 7f5d100f7640 1 -- 172.21.15.100:0/1681185025 <== osd.2 v2:172.21.15.100:6808/3104327688 66 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94723248493792] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d000b0040 con 0x562679935120 2024-09-18T01:25:49.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.392+0000 7f5d14a10800 20 remove_watcher() i=3 2024-09-18T01:25:49.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.392+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94723248497520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626799414e0 con 0x562679930730 2024-09-18T01:25:49.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.394+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.1 v2:172.21.15.100:6800/170575980 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94723248497520] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x562679930730 2024-09-18T01:25:49.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.394+0000 7f5d14a10800 20 remove_watcher() i=4 2024-09-18T01:25:49.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.394+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94723248499776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994f3f0 con 0x7f5d000bd020 2024-09-18T01:25:49.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.395+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 65 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94723248499776] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.395+0000 7f5d14a10800 20 remove_watcher() i=5 2024-09-18T01:25:49.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.395+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94723248500832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994f3f0 con 0x7f5d000bd020 2024-09-18T01:25:49.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.396+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 66 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94723248500832] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.396+0000 7f5d14a10800 20 remove_watcher() i=6 2024-09-18T01:25:49.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.396+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94723248503568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56267994f3f0 con 0x7f5d000bd020 2024-09-18T01:25:49.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 <== osd.0 v2:172.21.15.92:6800/2777570747 67 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94723248503568] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a4a0 con 0x7f5d000bd020 2024-09-18T01:25:49.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 20 remove_watcher() i=7 2024-09-18T01:25:49.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f5d000bd020 msgr2=0x7f5d00004cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f5d000bd020 0x7f5d00004cb0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562679930730 msgr2=0x562679932bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562679930730 0x562679932bf0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562679935120 msgr2=0x562679937510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562679935120 0x562679937510 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562679939ad0 msgr2=0x56267993bf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562679939ad0 0x56267993bf90 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5be0036b40 msgr2=0x7f5be0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5be0036b40 0x7f5be0039000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8001b60 tx=0x7f5cf8010000 comp rx=0 tx=0).stop 2024-09-18T01:25:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267991dcf0 msgr2=0x562679924f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1681185025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267991dcf0 0x562679924f90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5d0005ca40 tx=0x7f5d00079f50 comp rx=0 tx=0).stop 2024-09-18T01:25:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 reap_dead start 2024-09-18T01:25:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d108f8640 1 -- 172.21.15.100:0/1681185025 reap_dead start 2024-09-18T01:25:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 shutdown_connections 2024-09-18T01:25:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 >> 172.21.15.100:0/1681185025 conn(0x56267991a0a0 msgr2=0x562679918170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 shutdown_connections 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.397+0000 7f5d14a10800 1 -- 172.21.15.100:0/1681185025 wait complete. 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/640025865 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5be8036b40 msgr2=0x7f5be8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 --2- 172.21.15.100:0/640025865 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5be8036b40 0x7f5be8039000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800bf50 tx=0x7f5cf800f000 comp rx=0 tx=0).stop 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/640025865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562679911280 msgr2=0x5626799116a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 --2- 172.21.15.100:0/640025865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562679911280 0x5626799116a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5d0008f210 tx=0x7f5d0008f3c0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/640025865 shutdown_connections 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 --2- 172.21.15.100:0/640025865 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5be8036b40 0x7f5be8039000 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 --2- 172.21.15.100:0/640025865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562679911280 0x5626799116a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/640025865 >> 172.21.15.100:0/640025865 conn(0x562679906210 msgr2=0x562679908d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/640025865 shutdown_connections 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/640025865 wait complete. 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5626799009e0 msgr2=0x562679902dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5626799009e0 0x562679902dd0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5626797ff6f0 msgr2=0x5626798fa220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5626797ff6f0 0x5626798fa220 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5626798fcaf0 msgr2=0x5626798feee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5626798fcaf0 0x5626798feee0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5bf8036b40 msgr2=0x7f5bf8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5bf8036b40 0x7f5bf8039000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8000f60 tx=0x7f5cf80012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 msgr2=0x5626798f31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 --2- 172.21.15.100:0/1615834079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56267976fe00 0x5626798f31b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x5626798ec6b0 tx=0x7f5d00002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d108f8640 1 -- 172.21.15.100:0/1615834079 reap_dead start 2024-09-18T01:25:49.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 shutdown_connections 2024-09-18T01:25:49.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 >> 172.21.15.100:0/1615834079 conn(0x5626797f6de0 msgr2=0x5626798e5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 shutdown_connections 2024-09-18T01:25:49.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.398+0000 7f5d14a10800 1 -- 172.21.15.100:0/1615834079 wait complete. 2024-09-18T01:25:49.408 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-18T01:25:49.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-18T01:25:49.408 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-18T01:25:49.491 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:49.491 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:49.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.491+0000 7fbb11e13800 1 Processor -- start 2024-09-18T01:25:49.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.491+0000 7fbb11e13800 1 -- start start 2024-09-18T01:25:49.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.491+0000 7fbb11e13800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56084fa70900 0x56084fa72cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.491+0000 7fbb11e13800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56084f92cb30 con 0x56084fa6c4c0 2024-09-18T01:25:49.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.491+0000 7fbb11e13800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x56084f90e360 con 0x56084fa70900 2024-09-18T01:25:49.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.491+0000 7fbb07fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56084fa70900 0x56084fa72cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.491+0000 7fbb07fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56084fa70900 0x56084fa72cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52410/0 (socket says 172.21.15.100:52410) 2024-09-18T01:25:49.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.491+0000 7fbb07fff640 1 -- 172.21.15.100:0/3538086070 learned_addr learned my addr 172.21.15.100:0/3538086070 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.492+0000 7fbb07fff640 1 -- 172.21.15.100:0/3538086070 >> v1:172.21.15.92:6789/0 conn(0x56084fa6c4c0 legacy=0x56084fa6c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.492+0000 7fbb07fff640 1 -- 172.21.15.100:0/3538086070 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56084f934e00 con 0x56084fa70900 2024-09-18T01:25:49.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.493+0000 7fbb07fff640 1 --2- 172.21.15.100:0/3538086070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa70900 0x56084fa72cf0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800a6b0 tx=0x7fbaf8047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcf872f5c2d1fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.494+0000 7fbb0cd2b640 1 -- 172.21.15.100:0/3538086070 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaf800a200 con 0x56084fa70900 2024-09-18T01:25:49.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.494+0000 7fbb0cd2b640 1 -- 172.21.15.100:0/3538086070 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf800a3a0 con 0x56084fa70900 2024-09-18T01:25:49.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.494+0000 7fbb0cd2b640 1 -- 172.21.15.100:0/3538086070 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaf8008700 con 0x56084fa70900 2024-09-18T01:25:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.494+0000 7fbb11e13800 1 -- 172.21.15.100:0/3538086070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa70900 msgr2=0x56084fa72cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.494+0000 7fbb11e13800 1 --2- 172.21.15.100:0/3538086070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa70900 0x56084fa72cf0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800a6b0 tx=0x7fbaf8047e30 comp rx=0 tx=0).stop 2024-09-18T01:25:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.494+0000 7fbb11e13800 1 -- 172.21.15.100:0/3538086070 shutdown_connections 2024-09-18T01:25:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.494+0000 7fbb11e13800 1 --2- 172.21.15.100:0/3538086070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa70900 0x56084fa72cf0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.494+0000 7fbb11e13800 1 -- 172.21.15.100:0/3538086070 >> 172.21.15.100:0/3538086070 conn(0x56084fa67df0 msgr2=0x56084fa6a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.494+0000 7fbb11e13800 1 -- 172.21.15.100:0/3538086070 shutdown_connections 2024-09-18T01:25:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.494+0000 7fbb11e13800 1 -- 172.21.15.100:0/3538086070 wait complete. 2024-09-18T01:25:49.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.507+0000 7fbb11e13800 1 Processor -- start 2024-09-18T01:25:49.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.508+0000 7fbb11e13800 1 -- start start 2024-09-18T01:25:49.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.508+0000 7fbb11e13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa6c4c0 0x56084fb5a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.508+0000 7fbb11e13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56084f9b9330 con 0x56084fa6c4c0 2024-09-18T01:25:49.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.508+0000 7fbb0d52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa6c4c0 0x56084fb5a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.508+0000 7fbb0d52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa6c4c0 0x56084fb5a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52412/0 (socket says 172.21.15.100:52412) 2024-09-18T01:25:49.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.508+0000 7fbb0d52c640 1 -- 172.21.15.100:0/1269807626 learned_addr learned my addr 172.21.15.100:0/1269807626 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.508+0000 7fbb0d52c640 1 -- 172.21.15.100:0/1269807626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56084f906bc0 con 0x56084fa6c4c0 2024-09-18T01:25:49.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.509+0000 7fbb0d52c640 1 --2- 172.21.15.100:0/1269807626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa6c4c0 0x56084fb5a5e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbb00001d00 tx=0x7fbb0000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c8744a7f756daf server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.509+0000 7fb9fb606640 1 -- 172.21.15.100:0/1269807626 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0000f400 con 0x56084fa6c4c0 2024-09-18T01:25:49.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.509+0000 7fb9fb606640 1 -- 172.21.15.100:0/1269807626 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb00001e50 con 0x56084fa6c4c0 2024-09-18T01:25:49.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.509+0000 7fb9fb606640 1 -- 172.21.15.100:0/1269807626 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0000f600 con 0x56084fa6c4c0 2024-09-18T01:25:49.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.509+0000 7fbb11e13800 1 -- 172.21.15.100:0/1269807626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa6c4c0 msgr2=0x56084fb5a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.509+0000 7fbb11e13800 1 --2- 172.21.15.100:0/1269807626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa6c4c0 0x56084fb5a5e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbb00001d00 tx=0x7fbb0000b5b0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.509+0000 7fbb11e13800 1 -- 172.21.15.100:0/1269807626 shutdown_connections 2024-09-18T01:25:49.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.509+0000 7fbb11e13800 1 --2- 172.21.15.100:0/1269807626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa6c4c0 0x56084fb5a5e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.509+0000 7fbb11e13800 1 -- 172.21.15.100:0/1269807626 >> 172.21.15.100:0/1269807626 conn(0x56084fa67df0 msgr2=0x56084fb55fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.509+0000 7fbb11e13800 1 -- 172.21.15.100:0/1269807626 shutdown_connections 2024-09-18T01:25:49.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.509+0000 7fbb11e13800 1 -- 172.21.15.100:0/1269807626 wait complete. 2024-09-18T01:25:49.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.510+0000 7fbb11e13800 1 Processor -- start 2024-09-18T01:25:49.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.510+0000 7fbb11e13800 1 -- start start 2024-09-18T01:25:49.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.510+0000 7fbb11e13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa6c4c0 0x56084fb61ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.510+0000 7fbb11e13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56084fa734d0 con 0x56084fa6c4c0 2024-09-18T01:25:49.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.510+0000 7fbb0d52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa6c4c0 0x56084fb61ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.510+0000 7fbb0d52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa6c4c0 0x56084fb61ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52418/0 (socket says 172.21.15.100:52418) 2024-09-18T01:25:49.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.510+0000 7fbb0d52c640 1 -- 172.21.15.100:0/1794884698 learned_addr learned my addr 172.21.15.100:0/1794884698 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.510+0000 7fbb0d52c640 1 -- 172.21.15.100:0/1794884698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56084f91afe0 con 0x56084fa6c4c0 2024-09-18T01:25:49.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.511+0000 7fbb0d52c640 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa6c4c0 0x56084fb61ff0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbb00002000 tx=0x7fbb00000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.511+0000 7fb9f9e03640 1 -- 172.21.15.100:0/1794884698 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0001a5b0 con 0x56084fa6c4c0 2024-09-18T01:25:49.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.511+0000 7fb9f9e03640 1 -- 172.21.15.100:0/1794884698 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0001a750 con 0x56084fa6c4c0 2024-09-18T01:25:49.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.511+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56084fb62530 con 0x56084fa6c4c0 2024-09-18T01:25:49.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.511+0000 7fb9f9e03640 1 -- 172.21.15.100:0/1794884698 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0001aa70 con 0x56084fa6c4c0 2024-09-18T01:25:49.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.511+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56084fb62ab0 con 0x56084fa6c4c0 2024-09-18T01:25:49.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.512+0000 7fb9f9e03640 1 -- 172.21.15.100:0/1794884698 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbb00017070 con 0x56084fa6c4c0 2024-09-18T01:25:49.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.512+0000 7fb9f9e03640 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9f4036b40 0x7fb9f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.512+0000 7fb9f9e03640 1 -- 172.21.15.100:0/1794884698 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fbb00015020 con 0x56084fa6c4c0 2024-09-18T01:25:49.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.512+0000 7fbb07fff640 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9f4036b40 0x7fb9f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.512+0000 7fbb11e13800 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56084fa70900 0x56084fb69060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.512+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fb69630 con 0x56084fa70900 2024-09-18T01:25:49.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.512+0000 7fbb0dd2d640 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56084fa70900 0x56084fb69060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.512+0000 7fbb07fff640 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9f4036b40 0x7fb9f4039000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8058000 tx=0x7fbaf8053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.512+0000 7fbb0dd2d640 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56084fa70900 0x56084fb69060 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.513+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/1794884698 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fa70900 2024-09-18T01:25:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.513+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fb66630 con 0x56084fa70900 2024-09-18T01:25:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.513+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/1794884698 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fa70900 2024-09-18T01:25:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.513+0000 7fbb11e13800 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56084fb6b960 0x56084fb6dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.513+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fb6e3f0 con 0x56084fb6b960 2024-09-18T01:25:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.513+0000 7fbb0d52c640 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56084fb6b960 0x56084fb6dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.513+0000 7fbb0d52c640 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56084fb6b960 0x56084fb6dd50 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.514+0000 7fbb0d52c640 1 -- 172.21.15.100:0/1794884698 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbb0002e070 con 0x56084fb6b960 2024-09-18T01:25:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.514+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fb6a7d0 con 0x56084fa70900 2024-09-18T01:25:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.514+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/1794884698 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fa70900 2024-09-18T01:25:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.514+0000 7fbb11e13800 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56084fb6f850 0x56084fb71c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.514+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fb72340 con 0x56084fb6f850 2024-09-18T01:25:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.514+0000 7fbb07fff640 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56084fb6f850 0x56084fb71c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.515+0000 7fbb07fff640 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56084fb6f850 0x56084fb71c40 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.515+0000 7fbb07fff640 1 -- 172.21.15.100:0/1794884698 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fb6f850 2024-09-18T01:25:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.515+0000 7fbb11e13800 1 Processor -- start 2024-09-18T01:25:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.515+0000 7fbb11e13800 1 -- start start 2024-09-18T01:25:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.515+0000 7fbb11e13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb800f0 0x56084fb80510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.515+0000 7fbb11e13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56084f908580 con 0x56084fb800f0 2024-09-18T01:25:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.516+0000 7fbb0d52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb800f0 0x56084fb80510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.516+0000 7fbb0d52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb800f0 0x56084fb80510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52426/0 (socket says 172.21.15.100:52426) 2024-09-18T01:25:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.516+0000 7fbb0d52c640 1 -- 172.21.15.100:0/576403832 learned_addr learned my addr 172.21.15.100:0/576403832 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.516+0000 7fbb0d52c640 1 -- 172.21.15.100:0/576403832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56084fb80a50 con 0x56084fb800f0 2024-09-18T01:25:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.516+0000 7fbb0d52c640 1 --2- 172.21.15.100:0/576403832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb800f0 0x56084fb80510 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbb0004b0a0 tx=0x7fbb00044500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.516+0000 7fb9f2ffd640 1 -- 172.21.15.100:0/576403832 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0000e6c0 con 0x56084fb800f0 2024-09-18T01:25:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.516+0000 7fb9f2ffd640 1 -- 172.21.15.100:0/576403832 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0000e860 con 0x56084fb800f0 2024-09-18T01:25:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.516+0000 7fb9f2ffd640 1 -- 172.21.15.100:0/576403832 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0000eb80 con 0x56084fb800f0 2024-09-18T01:25:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.516+0000 7fbb11e13800 1 -- 172.21.15.100:0/576403832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56084fb80c80 con 0x56084fb800f0 2024-09-18T01:25:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.516+0000 7fbb11e13800 1 -- 172.21.15.100:0/576403832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56084fb80c80 con 0x56084fb800f0 2024-09-18T01:25:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.517+0000 7fb9f2ffd640 1 -- 172.21.15.100:0/576403832 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbb0000e070 con 0x56084fb800f0 2024-09-18T01:25:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.517+0000 7fb9f2ffd640 1 --2- 172.21.15.100:0/576403832 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9e8036b40 0x7fb9e8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.517+0000 7fb9f2ffd640 1 -- 172.21.15.100:0/576403832 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fbb0003dd00 con 0x56084fb800f0 2024-09-18T01:25:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.517+0000 7fbb07fff640 1 --2- 172.21.15.100:0/576403832 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9e8036b40 0x7fb9e8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.518+0000 7fbb11e13800 1 Processor -- start 2024-09-18T01:25:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.518+0000 7fbb11e13800 1 -- start start 2024-09-18T01:25:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.518+0000 7fbb07fff640 1 --2- 172.21.15.100:0/576403832 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9e8036b40 0x7fb9e8039000 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x56084fb66550 tx=0x7fbaf8005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.518+0000 7fbb11e13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb90c40 0x56084fb91040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.518+0000 7fbb11e13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56084fb5ad90 con 0x56084fb90c40 2024-09-18T01:25:49.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.518+0000 7fbb0d52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb90c40 0x56084fb91040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.518+0000 7fbb0d52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb90c40 0x56084fb91040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52428/0 (socket says 172.21.15.100:52428) 2024-09-18T01:25:49.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.518+0000 7fbb0d52c640 1 -- 172.21.15.100:0/2941929378 learned_addr learned my addr 172.21.15.100:0/2941929378 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.518+0000 7fbb0d52c640 1 -- 172.21.15.100:0/2941929378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56084fb91610 con 0x56084fb90c40 2024-09-18T01:25:49.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.519+0000 7fbb0d52c640 1 --2- 172.21.15.100:0/2941929378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb90c40 0x56084fb91040 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbb00031f60 tx=0x7fbb00031f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca27e833db5f1ae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.519+0000 7fb9f0ff9640 1 -- 172.21.15.100:0/2941929378 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0005c070 con 0x56084fb90c40 2024-09-18T01:25:49.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.519+0000 7fb9f0ff9640 1 -- 172.21.15.100:0/2941929378 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0001b5b0 con 0x56084fb90c40 2024-09-18T01:25:49.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.519+0000 7fb9f0ff9640 1 -- 172.21.15.100:0/2941929378 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0002ce10 con 0x56084fb90c40 2024-09-18T01:25:49.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.519+0000 7fbb11e13800 1 -- 172.21.15.100:0/2941929378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb90c40 msgr2=0x56084fb91040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.519+0000 7fbb11e13800 1 --2- 172.21.15.100:0/2941929378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb90c40 0x56084fb91040 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbb00031f60 tx=0x7fbb00031f90 comp rx=0 tx=0).stop 2024-09-18T01:25:49.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.519+0000 7fbb11e13800 1 -- 172.21.15.100:0/2941929378 shutdown_connections 2024-09-18T01:25:49.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.519+0000 7fbb11e13800 1 --2- 172.21.15.100:0/2941929378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb90c40 0x56084fb91040 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.519+0000 7fbb11e13800 1 -- 172.21.15.100:0/2941929378 >> 172.21.15.100:0/2941929378 conn(0x56084fb88b90 msgr2=0x56084fb86c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.519+0000 7fbb11e13800 1 -- 172.21.15.100:0/2941929378 shutdown_connections 2024-09-18T01:25:49.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.519+0000 7fbb11e13800 1 -- 172.21.15.100:0/2941929378 wait complete. 2024-09-18T01:25:49.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.519+0000 7fbb11e13800 1 Processor -- start 2024-09-18T01:25:49.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.520+0000 7fbb11e13800 1 -- start start 2024-09-18T01:25:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.520+0000 7fbb11e13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb90c40 0x56084fb97ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.520+0000 7fbb11e13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56084fb91b90 con 0x56084fb90c40 2024-09-18T01:25:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.520+0000 7fbb0d52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb90c40 0x56084fb97ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.520+0000 7fbb0d52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb90c40 0x56084fb97ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52436/0 (socket says 172.21.15.100:52436) 2024-09-18T01:25:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.520+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 learned_addr learned my addr 172.21.15.100:0/439469353 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.520+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56084fb98410 con 0x56084fb90c40 2024-09-18T01:25:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.521+0000 7fbb0d52c640 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb90c40 0x56084fb97ed0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbb0001ac70 tx=0x7fbb00015f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.521+0000 7fb9deffd640 1 -- 172.21.15.100:0/439469353 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb00072070 con 0x56084fb90c40 2024-09-18T01:25:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.521+0000 7fb9deffd640 1 -- 172.21.15.100:0/439469353 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0003f120 con 0x56084fb90c40 2024-09-18T01:25:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.521+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56084fb98410 con 0x56084fb90c40 2024-09-18T01:25:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.521+0000 7fb9deffd640 1 -- 172.21.15.100:0/439469353 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0004b450 con 0x56084fb90c40 2024-09-18T01:25:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.521+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56084fb988b0 con 0x56084fb90c40 2024-09-18T01:25:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.522+0000 7fb9deffd640 1 -- 172.21.15.100:0/439469353 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbb00075070 con 0x56084fb90c40 2024-09-18T01:25:49.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.522+0000 7fb9deffd640 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9d8036b40 0x7fb9d8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.522+0000 7fb9deffd640 1 -- 172.21.15.100:0/439469353 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fbb00078d90 con 0x56084fb90c40 2024-09-18T01:25:49.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.522+0000 7fbb11e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.522+0000 7fbb07fff640 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9d8036b40 0x7fb9d8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.522+0000 7fbb11e13800 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56084fba33f0 0x56084fba58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.522+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fba6000 con 0x56084fba33f0 2024-09-18T01:25:49.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.522+0000 7fbb0dd2d640 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56084fba33f0 0x56084fba58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.522+0000 7fbb07fff640 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9d8036b40 0x7fb9d8039000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8047e70 tx=0x7fbaf800a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.522+0000 7fbb0dd2d640 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56084fba33f0 0x56084fba58b0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 20 realm 2024-09-18T01:25:49.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fba6410 con 0x56084fba33f0 2024-09-18T01:25:49.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:49.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fba6cb0 con 0x56084fba33f0 2024-09-18T01:25:49.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba33f0 2024-09-18T01:25:49.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:49.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56084fba7b80 0x56084fba9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.523+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbaa6b0 con 0x56084fba7b80 2024-09-18T01:25:49.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.524+0000 7fbb0d52c640 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56084fba7b80 0x56084fba9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.524+0000 7fbb0d52c640 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56084fba7b80 0x56084fba9f70 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.524+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbb00074030 con 0x56084fba7b80 2024-09-18T01:25:49.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.524+0000 7fbb11e13800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:49.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.524+0000 7fbb11e13800 20 searching for the correct realm 2024-09-18T01:25:49.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.524+0000 7fbb11e13800 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56084fbac750 0x56084fbaec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.524+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fbaf2e0 con 0x56084fbac750 2024-09-18T01:25:49.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.524+0000 7fbb07fff640 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56084fbac750 0x56084fbaec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.524+0000 7fbb07fff640 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56084fbac750 0x56084fbaec10 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.525+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.525+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fbaf2e0 con 0x56084fba7b80 2024-09-18T01:25:49.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.525+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb00074030 con 0x56084fba7b80 2024-09-18T01:25:49.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.525+0000 7fbb0d52c640 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbb00077060 0x7fbb00031450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.525+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fbaf2e0 con 0x7fbb00077060 2024-09-18T01:25:49.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.525+0000 7fbb0dd2d640 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbb00077060 0x7fbb00031450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.526+0000 7fbb0dd2d640 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbb00077060 0x7fbb00031450 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.526+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.526+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba33f0 2024-09-18T01:25:49.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.526+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.526+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba33f0 2024-09-18T01:25:49.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.526+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.526+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x7fbb00077060 2024-09-18T01:25:49.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.527+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.527+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x7fbb00077060 2024-09-18T01:25:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.527+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.527+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba7b80 2024-09-18T01:25:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.527+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.527+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fbac750 2024-09-18T01:25:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.527+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.527+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba33f0 2024-09-18T01:25:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.528+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.528+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba7b80 2024-09-18T01:25:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.528+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.528+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba33f0 2024-09-18T01:25:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.528+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.528+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba7b80 2024-09-18T01:25:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.528+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.528+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fbac750 2024-09-18T01:25:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.529+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.529+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fbac750 2024-09-18T01:25:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.529+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.529+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x7fbb00077060 2024-09-18T01:25:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.529+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.529+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fbac750 2024-09-18T01:25:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.529+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.529+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fbac750 2024-09-18T01:25:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.530+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.530+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba33f0 2024-09-18T01:25:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.530+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.530+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba33f0 2024-09-18T01:25:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.530+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.530+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x7fbb00077060 2024-09-18T01:25:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.531+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.531+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fbac750 2024-09-18T01:25:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.531+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.531+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba7b80 2024-09-18T01:25:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.531+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.531+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba33f0 2024-09-18T01:25:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.531+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.531+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x7fbb00077060 2024-09-18T01:25:49.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.532+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.532+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fbac750 2024-09-18T01:25:49.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.532+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.532+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba7b80 2024-09-18T01:25:49.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.532+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.532+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba7b80 2024-09-18T01:25:49.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.532+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.532+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fbac750 2024-09-18T01:25:49.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.533+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.533+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x7fbb00077060 2024-09-18T01:25:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.533+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.533+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba33f0 2024-09-18T01:25:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.533+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.533+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56084fba7050 con 0x56084fba7b80 2024-09-18T01:25:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.533+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.533+0000 7fbb11e13800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbab050 con 0x56084fba33f0 2024-09-18T01:25:49.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbab440 con 0x56084fba33f0 2024-09-18T01:25:49.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:49.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbab440 con 0x7fbb00077060 2024-09-18T01:25:49.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:49.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 20 zone default found 2024-09-18T01:25:49.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 4 Realm: () 2024-09-18T01:25:49.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 20 zonegroup default 2024-09-18T01:25:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.534+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbab860 con 0x7fbb00077060 2024-09-18T01:25:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.535+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.535+0000 7fbb11e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.535+0000 7fbb11e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.535+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbab860 con 0x56084fbac750 2024-09-18T01:25:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.535+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.535+0000 7fbb11e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.535+0000 7fbb11e13800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.535+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb1140 con 0x56084fbac750 2024-09-18T01:25:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.535+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.535+0000 7fbb11e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.535+0000 7fbb11e13800 20 started sync module instance, tier type = 2024-09-18T01:25:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.535+0000 7fbb11e13800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.535+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb05e0 con 0x56084fba7b80 2024-09-18T01:25:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.536+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.536+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94593697384960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb1990 con 0x56084fba7b80 2024-09-18T01:25:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.536+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb21e0 con 0x56084fba33f0 2024-09-18T01:25:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.537+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94593697384960] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.538+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.538+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94593697387744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb21e0 con 0x56084fba33f0 2024-09-18T01:25:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.538+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb2c80 con 0x56084fbac750 2024-09-18T01:25:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.539+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94593697387744] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.539+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.539+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94593697389872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb2150 con 0x56084fbac750 2024-09-18T01:25:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.539+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb3b40 con 0x56084fba7b80 2024-09-18T01:25:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.540+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.540+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94593697398496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb47b0 con 0x56084fba7b80 2024-09-18T01:25:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.540+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb51f0 con 0x56084fba33f0 2024-09-18T01:25:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.540+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94593697389872] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.541+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94593697398496] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.541+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.541+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94593697399552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb3070 con 0x56084fba33f0 2024-09-18T01:25:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.541+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb5a90 con 0x7fbb00077060 2024-09-18T01:25:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.542+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.542+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94593697404304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb59b0 con 0x7fbb00077060 2024-09-18T01:25:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.542+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb6990 con 0x7fbb00077060 2024-09-18T01:25:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.543+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94593697399552] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.544+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94593697404304] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.544+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.544+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94593697406592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb64a0 con 0x7fbb00077060 2024-09-18T01:25:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.544+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb6e60 con 0x7fbb00077060 2024-09-18T01:25:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.545+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94593697406592] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.547+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.547+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94593697402048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb6e60 con 0x7fbb00077060 2024-09-18T01:25:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.547+0000 7fbb11e13800 20 add_watcher() i=0 2024-09-18T01:25:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.547+0000 7fbb11e13800 20 add_watcher() i=1 2024-09-18T01:25:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.547+0000 7fbb11e13800 20 add_watcher() i=2 2024-09-18T01:25:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.547+0000 7fbb11e13800 20 add_watcher() i=3 2024-09-18T01:25:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.547+0000 7fbb11e13800 20 add_watcher() i=4 2024-09-18T01:25:49.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.547+0000 7fbb11e13800 20 add_watcher() i=5 2024-09-18T01:25:49.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.547+0000 7fbb11e13800 20 add_watcher() i=6 2024-09-18T01:25:49.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.548+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94593697402048] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.548+0000 7fbb11e13800 20 add_watcher() i=7 2024-09-18T01:25:49.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.548+0000 7fbb11e13800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:49.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.548+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbba1e0 con 0x56084fba33f0 2024-09-18T01:25:49.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.549+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.549+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94593697422272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb6fd0 con 0x56084fba33f0 2024-09-18T01:25:49.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.550+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94593697422272] v35'174 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.550+0000 7fb9c3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:49.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.550+0000 7fbb11e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:49.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.550+0000 7fbb11e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:49.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.550+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc2940 con 0x56084fba33f0 2024-09-18T01:25:49.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.551+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'52 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.551+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc2fb0 con 0x7fbb00077060 2024-09-18T01:25:49.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.552+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.552+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc3390 con 0x56084fbac750 2024-09-18T01:25:49.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.553+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.553+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc3db0 con 0x56084fba33f0 2024-09-18T01:25:49.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.554+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'175 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.554+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc08f0 con 0x56084fba7b80 2024-09-18T01:25:49.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.555+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'62 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.555+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc0990 con 0x56084fbac750 2024-09-18T01:25:49.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.556+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'49 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.556+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4dc0 con 0x56084fba33f0 2024-09-18T01:25:49.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.557+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.557+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4f90 con 0x7fbb00077060 2024-09-18T01:25:49.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.558+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'44 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.558+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4f90 con 0x56084fba7b80 2024-09-18T01:25:49.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.559+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.559+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc50b0 con 0x56084fbac750 2024-09-18T01:25:49.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.560+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.560+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc55b0 con 0x56084fba7b80 2024-09-18T01:25:49.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.561+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'63 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.561+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc55b0 con 0x7fbb00077060 2024-09-18T01:25:49.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.563+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.563+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc55b0 con 0x56084fba7b80 2024-09-18T01:25:49.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.564+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.564+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc5640 con 0x7fbb00077060 2024-09-18T01:25:49.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.565+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'56 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.565+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc5640 con 0x56084fba33f0 2024-09-18T01:25:49.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.566+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'176 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.566+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc5640 con 0x56084fbac750 2024-09-18T01:25:49.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.567+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.567+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc5af0 con 0x56084fba7b80 2024-09-18T01:25:49.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.568+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'64 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.568+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc5af0 con 0x56084fbac750 2024-09-18T01:25:49.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.569+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.569+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc5af0 con 0x56084fba33f0 2024-09-18T01:25:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.571+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.571+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc5780 con 0x56084fba33f0 2024-09-18T01:25:49.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.572+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'177 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.572+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc5780 con 0x56084fbac750 2024-09-18T01:25:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.573+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.573+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc5780 con 0x56084fba7b80 2024-09-18T01:25:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.574+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.574+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbbe840 con 0x56084fbac750 2024-09-18T01:25:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.575+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.575+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbbe840 con 0x56084fbac750 2024-09-18T01:25:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.575+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'40 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.576+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbbe840 con 0x56084fbac750 2024-09-18T01:25:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.576+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.576+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbbe840 con 0x56084fbac750 2024-09-18T01:25:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.577+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'50 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.577+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbbe840 con 0x7fbb00077060 2024-09-18T01:25:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.578+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.579+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbbe840 con 0x56084fbac750 2024-09-18T01:25:49.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.579+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.579+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbbe840 con 0x7fbb00077060 2024-09-18T01:25:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.581+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'45 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.581+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbbe840 con 0x56084fbac750 2024-09-18T01:25:49.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.582+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.582+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbbe840 con 0x7fbb00077060 2024-09-18T01:25:49.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.583+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'57 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.583+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbbe840 con 0x56084fba7b80 2024-09-18T01:25:49.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.584+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.584+0000 7fb9c2fe5640 20 reqs_thread_entry: start 2024-09-18T01:25:49.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.584+0000 7fbb11e13800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:49.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.585+0000 7fbb11e13800 20 Filter name: none 2024-09-18T01:25:49.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.585+0000 7fb9c0fe1640 20 reqs_thread_entry: start 2024-09-18T01:25:49.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.585+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbf0f40 con 0x56084fba33f0 2024-09-18T01:25:49.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.585+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.585+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbeff30 con 0x56084fba33f0 2024-09-18T01:25:49.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.585+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.585+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbf0f40 con 0x56084fba33f0 2024-09-18T01:25:49.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.586+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.586+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbf0f40 con 0x7fbb00077060 2024-09-18T01:25:49.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.586+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.586+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbeff30 con 0x7fbb00077060 2024-09-18T01:25:49.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.587+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.587+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbf0f40 con 0x7fbb00077060 2024-09-18T01:25:49.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.587+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.587+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbf0f40 con 0x56084fbac750 2024-09-18T01:25:49.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.587+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.587+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbeff30 con 0x56084fbac750 2024-09-18T01:25:49.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.588+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.588+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbf0f40 con 0x56084fbac750 2024-09-18T01:25:49.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.588+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.588+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbf0f40 con 0x56084fba33f0 2024-09-18T01:25:49.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.588+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv172 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.588+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbeff30 con 0x56084fba33f0 2024-09-18T01:25:49.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.588+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv172 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.588+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbf0f40 con 0x56084fba33f0 2024-09-18T01:25:49.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.589+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv172 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.589+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbf0f40 con 0x56084fba7b80 2024-09-18T01:25:49.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.589+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.589+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbeff30 con 0x56084fba7b80 2024-09-18T01:25:49.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.589+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv61 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.589+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbf0f40 con 0x56084fba7b80 2024-09-18T01:25:49.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.589+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.589+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbf0f40 con 0x56084fbac750 2024-09-18T01:25:49.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.590+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv46 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.590+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbeff30 con 0x56084fbac750 2024-09-18T01:25:49.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.590+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv46 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.590+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbf0f40 con 0x56084fbac750 2024-09-18T01:25:49.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.590+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv46 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.590+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbf0f40 con 0x56084fba33f0 2024-09-18T01:25:49.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.590+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.590+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbeff30 con 0x56084fba33f0 2024-09-18T01:25:49.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.591+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv29 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.591+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc47b0 con 0x56084fba33f0 2024-09-18T01:25:49.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.591+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.591+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.591+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.591+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.592+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv41 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.592+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.592+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.592+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.592+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.592+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.593+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.593+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.593+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.593+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.593+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.593+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.593+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.593+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.594+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.594+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.594+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.594+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.594+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.594+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.595+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.595+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.595+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.595+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.595+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.595+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.596+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.596+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.596+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.596+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.596+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.596+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.596+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.597+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.597+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.597+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.597+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.597+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.598+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.598+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba33f0 2024-09-18T01:25:49.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.598+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv168 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.598+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba33f0 2024-09-18T01:25:49.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.598+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv168 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.598+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba33f0 2024-09-18T01:25:49.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.599+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv168 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.599+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.599+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.599+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.599+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.599+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.599+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.599+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.600+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.600+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.600+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.600+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.600+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.600+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.600+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.601+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.601+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.601+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.601+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.601+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba33f0 2024-09-18T01:25:49.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.601+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.601+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba33f0 2024-09-18T01:25:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.602+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.602+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba33f0 2024-09-18T01:25:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.602+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.602+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba33f0 2024-09-18T01:25:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.602+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.602+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba33f0 2024-09-18T01:25:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.602+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv170 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.602+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba33f0 2024-09-18T01:25:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.602+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.602+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.603+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.603+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.603+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.603+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.603+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.603+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.603+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.603+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.604+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.604+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.604+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.604+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.604+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.604+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.605+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.605+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.605+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.605+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.605+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.605+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.605+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.605+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.605+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.605+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.606+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.606+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.606+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.606+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.606+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.606+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.607+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.607+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.607+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.607+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.607+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.607+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.608+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.608+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.608+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.608+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.608+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.608+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.609+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.609+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.609+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.609+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.609+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.609+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.610+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.610+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.610+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.610+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.610+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.610+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.611+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.611+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.611+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.611+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fbac750 2024-09-18T01:25:49.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.611+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.611+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.612+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.612+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.612+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.612+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x7fbb00077060 2024-09-18T01:25:49.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.612+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.612+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.613+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.613+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.613+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.613+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4790 con 0x56084fba7b80 2024-09-18T01:25:49.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.613+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.614+0000 7fb9c3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:49.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.614+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94593697422272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbc4730 con 0x56084fba33f0 2024-09-18T01:25:49.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.615+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94593697422272] v35'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.615+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94593697384960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb9bc0 con 0x56084fba7b80 2024-09-18T01:25:49.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.616+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94593697384960] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.616+0000 7fbb11e13800 20 remove_watcher() i=0 2024-09-18T01:25:49.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.616+0000 7fbb11e13800 2 removed watcher, disabling cache 2024-09-18T01:25:49.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.616+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94593697387744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb9bc0 con 0x56084fba33f0 2024-09-18T01:25:49.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.617+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94593697387744] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.617+0000 7fbb11e13800 20 remove_watcher() i=1 2024-09-18T01:25:49.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.617+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94593697389872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb9bc0 con 0x56084fbac750 2024-09-18T01:25:49.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.619+0000 7fbb07fff640 1 -- 172.21.15.100:0/439469353 <== osd.3 v2:172.21.15.100:6816/595195757 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94593697389872] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf8008970 con 0x56084fbac750 2024-09-18T01:25:49.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.619+0000 7fbb11e13800 20 remove_watcher() i=2 2024-09-18T01:25:49.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.619+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94593697398496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb1d30 con 0x56084fba7b80 2024-09-18T01:25:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.620+0000 7fbb0d52c640 1 -- 172.21.15.100:0/439469353 <== osd.2 v2:172.21.15.100:6808/3104327688 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94593697398496] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb00086040 con 0x56084fba7b80 2024-09-18T01:25:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.620+0000 7fbb11e13800 20 remove_watcher() i=3 2024-09-18T01:25:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.620+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94593697399552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb9bc0 con 0x56084fba33f0 2024-09-18T01:25:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.621+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.1 v2:172.21.15.100:6800/170575980 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94593697399552] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x56084fba33f0 2024-09-18T01:25:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.621+0000 7fbb11e13800 20 remove_watcher() i=4 2024-09-18T01:25:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.621+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94593697404304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb1d30 con 0x7fbb00077060 2024-09-18T01:25:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.622+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94593697404304] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.622+0000 7fbb11e13800 20 remove_watcher() i=5 2024-09-18T01:25:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.622+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94593697406592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb9bc0 con 0x7fbb00077060 2024-09-18T01:25:49.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.623+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94593697406592] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.623+0000 7fbb11e13800 20 remove_watcher() i=6 2024-09-18T01:25:49.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.623+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94593697402048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56084fbb4390 con 0x7fbb00077060 2024-09-18T01:25:49.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.624+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 <== osd.0 v2:172.21.15.92:6800/2777570747 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94593697402048] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb0800a4a0 con 0x7fbb00077060 2024-09-18T01:25:49.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.624+0000 7fbb11e13800 20 remove_watcher() i=7 2024-09-18T01:25:49.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbb00077060 msgr2=0x7fbb00031450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fbb00077060 0x7fbb00031450 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56084fba33f0 msgr2=0x56084fba58b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56084fba33f0 0x56084fba58b0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56084fba7b80 msgr2=0x56084fba9f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56084fba7b80 0x56084fba9f70 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56084fbac750 msgr2=0x56084fbaec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56084fbac750 0x56084fbaec10 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9d8036b40 msgr2=0x7fb9d8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9d8036b40 0x7fb9d8039000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8047e70 tx=0x7fbaf800a000 comp rx=0 tx=0).stop 2024-09-18T01:25:49.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb90c40 msgr2=0x56084fb97ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/439469353 reap_dead start 2024-09-18T01:25:49.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb90c40 0x56084fb97ed0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbb0001ac70 tx=0x7fbb00015f60 comp rx=0 tx=0).stop 2024-09-18T01:25:49.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 shutdown_connections 2024-09-18T01:25:49.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 --2- 172.21.15.100:0/439469353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb90c40 0x56084fb97ed0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 >> 172.21.15.100:0/439469353 conn(0x56084fb88b90 msgr2=0x56084fb86c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 shutdown_connections 2024-09-18T01:25:49.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/439469353 wait complete. 2024-09-18T01:25:49.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/576403832 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9e8036b40 msgr2=0x7fb9e8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 --2- 172.21.15.100:0/576403832 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9e8036b40 0x7fb9e8039000 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x56084fb66550 tx=0x7fbaf8005ac0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/576403832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb800f0 msgr2=0x56084fb80510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 --2- 172.21.15.100:0/576403832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb800f0 0x56084fb80510 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbb0004b0a0 tx=0x7fbb00044500 comp rx=0 tx=0).stop 2024-09-18T01:25:49.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/576403832 shutdown_connections 2024-09-18T01:25:49.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 --2- 172.21.15.100:0/576403832 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9e8036b40 0x7fb9e8039000 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 --2- 172.21.15.100:0/576403832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fb800f0 0x56084fb80510 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/576403832 >> 172.21.15.100:0/576403832 conn(0x56084fb75080 msgr2=0x56084fb77c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/576403832 shutdown_connections 2024-09-18T01:25:49.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.625+0000 7fbb11e13800 1 -- 172.21.15.100:0/576403832 wait complete. 2024-09-18T01:25:49.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56084fb6f850 msgr2=0x56084fb71c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb11e13800 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56084fb6f850 0x56084fb71c40 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56084fa70900 msgr2=0x56084fb69060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb11e13800 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56084fa70900 0x56084fb69060 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56084fb6b960 msgr2=0x56084fb6dd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb11e13800 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56084fb6b960 0x56084fb6dd50 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9f4036b40 msgr2=0x7fb9f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb11e13800 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fb9f4036b40 0x7fb9f4039000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8058000 tx=0x7fbaf8053000 comp rx=0 tx=0).stop 2024-09-18T01:25:49.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa6c4c0 msgr2=0x56084fb61ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb11e13800 1 --2- 172.21.15.100:0/1794884698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56084fa6c4c0 0x56084fb61ff0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbb00002000 tx=0x7fbb00000bc0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb0dd2d640 1 -- 172.21.15.100:0/1794884698 reap_dead start 2024-09-18T01:25:49.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 shutdown_connections 2024-09-18T01:25:49.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 >> 172.21.15.100:0/1794884698 conn(0x56084fa67df0 msgr2=0x56084fb548d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 shutdown_connections 2024-09-18T01:25:49.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.626+0000 7fbb11e13800 1 -- 172.21.15.100:0/1794884698 wait complete. 2024-09-18T01:25:49.635 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-18T01:25:49.635 DEBUG:tasks.util.rgw: json result: [] 2024-09-18T01:25:49.635 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-18T01:25:49.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-18T01:25:49.636 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-18T01:25:49.719 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:49.719 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.718+0000 7fd663b26800 1 Processor -- start 2024-09-18T01:25:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.718+0000 7fd663b26800 1 -- start start 2024-09-18T01:25:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.718+0000 7fd663b26800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ebdea0cd90 0x55ebdea0f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.718+0000 7fd663b26800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ebde8c5b30 con 0x55ebde97a610 2024-09-18T01:25:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.719+0000 7fd663b26800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55ebde8a7360 con 0x55ebdea0cd90 2024-09-18T01:25:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.719+0000 7fd65efe2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ebdea0cd90 0x55ebdea0f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.719+0000 7fd65efe2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ebdea0cd90 0x55ebdea0f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52452/0 (socket says 172.21.15.100:52452) 2024-09-18T01:25:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.719+0000 7fd65f7e3640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55ebde97a610 0x55ebdea0b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:43702/0 (socket says 172.21.15.100:43702) 2024-09-18T01:25:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.719+0000 7fd65efe2640 1 -- 172.21.15.100:0/3071507817 learned_addr learned my addr 172.21.15.100:0/3071507817 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.719+0000 7fd65efe2640 1 -- 172.21.15.100:0/3071507817 >> v1:172.21.15.92:6789/0 conn(0x55ebde97a610 legacy=0x55ebdea0b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.719+0000 7fd65efe2640 1 -- 172.21.15.100:0/3071507817 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebde8cde00 con 0x55ebdea0cd90 2024-09-18T01:25:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.721+0000 7fd65efe2640 1 --2- 172.21.15.100:0/3071507817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdea0cd90 0x55ebdea0f180 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd65400a520 tx=0x7fd654045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c149cad9a2254620 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.721+0000 7fd65e7e1640 1 -- 172.21.15.100:0/3071507817 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd654055070 con 0x55ebdea0cd90 2024-09-18T01:25:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.721+0000 7fd65e7e1640 1 -- 172.21.15.100:0/3071507817 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6540515b0 con 0x55ebdea0cd90 2024-09-18T01:25:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.721+0000 7fd65e7e1640 1 -- 172.21.15.100:0/3071507817 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6540518d0 con 0x55ebdea0cd90 2024-09-18T01:25:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.722+0000 7fd663b26800 1 -- 172.21.15.100:0/3071507817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdea0cd90 msgr2=0x55ebdea0f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.722+0000 7fd663b26800 1 --2- 172.21.15.100:0/3071507817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdea0cd90 0x55ebdea0f180 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd65400a520 tx=0x7fd654045ba0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.722+0000 7fd663b26800 1 -- 172.21.15.100:0/3071507817 shutdown_connections 2024-09-18T01:25:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.722+0000 7fd663b26800 1 --2- 172.21.15.100:0/3071507817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdea0cd90 0x55ebdea0f180 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.722+0000 7fd663b26800 1 -- 172.21.15.100:0/3071507817 >> 172.21.15.100:0/3071507817 conn(0x55ebdea00de0 msgr2=0x55ebdea03200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.722+0000 7fd663b26800 1 -- 172.21.15.100:0/3071507817 shutdown_connections 2024-09-18T01:25:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.722+0000 7fd663b26800 1 -- 172.21.15.100:0/3071507817 wait complete. 2024-09-18T01:25:49.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.735+0000 7fd663b26800 1 Processor -- start 2024-09-18T01:25:49.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.735+0000 7fd663b26800 1 -- start start 2024-09-18T01:25:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.735+0000 7fd663b26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebde97a610 0x55ebdeaf7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.735+0000 7fd663b26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ebde952330 con 0x55ebde97a610 2024-09-18T01:25:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.736+0000 7fd65f7e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebde97a610 0x55ebdeaf7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.736+0000 7fd65f7e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebde97a610 0x55ebdeaf7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52462/0 (socket says 172.21.15.100:52462) 2024-09-18T01:25:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.736+0000 7fd65f7e3640 1 -- 172.21.15.100:0/3530475103 learned_addr learned my addr 172.21.15.100:0/3530475103 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.736+0000 7fd65f7e3640 1 -- 172.21.15.100:0/3530475103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebde89fbc0 con 0x55ebde97a610 2024-09-18T01:25:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.736+0000 7fd65f7e3640 1 --2- 172.21.15.100:0/3530475103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebde97a610 0x55ebdeaf7a90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd650001650 tx=0x7fd650001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a4de0e9f4f149 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.736+0000 7fd54d60a640 1 -- 172.21.15.100:0/3530475103 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd650013420 con 0x55ebde97a610 2024-09-18T01:25:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.736+0000 7fd54d60a640 1 -- 172.21.15.100:0/3530475103 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6500135c0 con 0x55ebde97a610 2024-09-18T01:25:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.736+0000 7fd54d60a640 1 -- 172.21.15.100:0/3530475103 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6500138c0 con 0x55ebde97a610 2024-09-18T01:25:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.737+0000 7fd663b26800 1 -- 172.21.15.100:0/3530475103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebde97a610 msgr2=0x55ebdeaf7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.737+0000 7fd663b26800 1 --2- 172.21.15.100:0/3530475103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebde97a610 0x55ebdeaf7a90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd650001650 tx=0x7fd650001b10 comp rx=0 tx=0).stop 2024-09-18T01:25:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.737+0000 7fd663b26800 1 -- 172.21.15.100:0/3530475103 shutdown_connections 2024-09-18T01:25:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.737+0000 7fd663b26800 1 --2- 172.21.15.100:0/3530475103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebde97a610 0x55ebdeaf7a90 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.737+0000 7fd663b26800 1 -- 172.21.15.100:0/3530475103 >> 172.21.15.100:0/3530475103 conn(0x55ebdea00de0 msgr2=0x55ebdeaf3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.737+0000 7fd663b26800 1 -- 172.21.15.100:0/3530475103 shutdown_connections 2024-09-18T01:25:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.737+0000 7fd663b26800 1 -- 172.21.15.100:0/3530475103 wait complete. 2024-09-18T01:25:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.737+0000 7fd663b26800 1 Processor -- start 2024-09-18T01:25:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.738+0000 7fd663b26800 1 -- start start 2024-09-18T01:25:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.738+0000 7fd663b26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebde97a610 0x55ebdeaff4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.738+0000 7fd663b26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ebdea0f990 con 0x55ebde97a610 2024-09-18T01:25:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.738+0000 7fd65f7e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebde97a610 0x55ebdeaff4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.738+0000 7fd65f7e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebde97a610 0x55ebdeaff4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52470/0 (socket says 172.21.15.100:52470) 2024-09-18T01:25:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.738+0000 7fd65f7e3640 1 -- 172.21.15.100:0/1415225100 learned_addr learned my addr 172.21.15.100:0/1415225100 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.738+0000 7fd65f7e3640 1 -- 172.21.15.100:0/1415225100 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebde8b3fe0 con 0x55ebde97a610 2024-09-18T01:25:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.738+0000 7fd65f7e3640 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebde97a610 0x55ebdeaff4c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd650000f80 tx=0x7fd650001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.738+0000 7fd54be07640 1 -- 172.21.15.100:0/1415225100 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd650022020 con 0x55ebde97a610 2024-09-18T01:25:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.738+0000 7fd54be07640 1 -- 172.21.15.100:0/1415225100 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd650006830 con 0x55ebde97a610 2024-09-18T01:25:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.738+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebdeaffa00 con 0x55ebde97a610 2024-09-18T01:25:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.738+0000 7fd54be07640 1 -- 172.21.15.100:0/1415225100 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd650004bb0 con 0x55ebde97a610 2024-09-18T01:25:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.739+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebdeafff20 con 0x55ebde97a610 2024-09-18T01:25:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.739+0000 7fd54be07640 1 -- 172.21.15.100:0/1415225100 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd650025020 con 0x55ebde97a610 2024-09-18T01:25:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.740+0000 7fd54be07640 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd544036b40 0x7fd544039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.740+0000 7fd54be07640 1 -- 172.21.15.100:0/1415225100 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd650018030 con 0x55ebde97a610 2024-09-18T01:25:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.740+0000 7fd65efe2640 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd544036b40 0x7fd544039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.740+0000 7fd663b26800 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ebdea0cd90 0x55ebdeb06530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.740+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb06b00 con 0x55ebdea0cd90 2024-09-18T01:25:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.740+0000 7fd65ffe4640 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ebdea0cd90 0x55ebdeb06530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.740+0000 7fd65efe2640 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd544036b40 0x7fd544039000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd654057000 tx=0x7fd654052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.740+0000 7fd65ffe4640 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ebdea0cd90 0x55ebdeb06530 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.740+0000 7fd65ffe4640 1 -- 172.21.15.100:0/1415225100 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd6580083e0 con 0x55ebdea0cd90 2024-09-18T01:25:49.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.740+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb03ae0 con 0x55ebdea0cd90 2024-09-18T01:25:49.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.741+0000 7fd65ffe4640 1 -- 172.21.15.100:0/1415225100 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd6580083e0 con 0x55ebdea0cd90 2024-09-18T01:25:49.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.741+0000 7fd663b26800 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ebdeb08de0 0x55ebdeb0b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.741+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb0b8c0 con 0x55ebdeb08de0 2024-09-18T01:25:49.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.741+0000 7fd65f7e3640 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ebdeb08de0 0x55ebdeb0b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.741+0000 7fd65f7e3640 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ebdeb08de0 0x55ebdeb0b1d0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.741+0000 7fd65f7e3640 1 -- 172.21.15.100:0/1415225100 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb08de0 2024-09-18T01:25:49.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.741+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb07c80 con 0x55ebdea0cd90 2024-09-18T01:25:49.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.742+0000 7fd65ffe4640 1 -- 172.21.15.100:0/1415225100 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd6580083e0 con 0x55ebdea0cd90 2024-09-18T01:25:49.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.742+0000 7fd663b26800 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ebdeb0cd20 0x55ebdeb0f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.742+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb0f850 con 0x55ebdeb0cd20 2024-09-18T01:25:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.742+0000 7fd65efe2640 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ebdeb0cd20 0x55ebdeb0f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.742+0000 7fd65efe2640 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ebdeb0cd20 0x55ebdeb0f110 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.743+0000 7fd65efe2640 1 -- 172.21.15.100:0/1415225100 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb0cd20 2024-09-18T01:25:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.743+0000 7fd663b26800 1 Processor -- start 2024-09-18T01:25:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.743+0000 7fd663b26800 1 -- start start 2024-09-18T01:25:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.743+0000 7fd663b26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb1d560 0x55ebdeb1d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.743+0000 7fd663b26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ebde8a1580 con 0x55ebdeb1d560 2024-09-18T01:25:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.743+0000 7fd65f7e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb1d560 0x55ebdeb1d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.743+0000 7fd65f7e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb1d560 0x55ebdeb1d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52476/0 (socket says 172.21.15.100:52476) 2024-09-18T01:25:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.743+0000 7fd65f7e3640 1 -- 172.21.15.100:0/328108603 learned_addr learned my addr 172.21.15.100:0/328108603 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.744+0000 7fd65f7e3640 1 -- 172.21.15.100:0/328108603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebdeb1dec0 con 0x55ebdeb1d560 2024-09-18T01:25:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.744+0000 7fd65f7e3640 1 --2- 172.21.15.100:0/328108603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb1d560 0x55ebdeb1d980 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd65001d510 tx=0x7fd650044500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.744+0000 7fd549602640 1 -- 172.21.15.100:0/328108603 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd65000f3f0 con 0x55ebdeb1d560 2024-09-18T01:25:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.744+0000 7fd549602640 1 -- 172.21.15.100:0/328108603 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd650044690 con 0x55ebdeb1d560 2024-09-18T01:25:49.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.744+0000 7fd663b26800 1 -- 172.21.15.100:0/328108603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebdeb1e150 con 0x55ebdeb1d560 2024-09-18T01:25:49.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.744+0000 7fd549602640 1 -- 172.21.15.100:0/328108603 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd650044970 con 0x55ebdeb1d560 2024-09-18T01:25:49.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.744+0000 7fd663b26800 1 -- 172.21.15.100:0/328108603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebdeb20e30 con 0x55ebdeb1d560 2024-09-18T01:25:49.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.745+0000 7fd549602640 1 -- 172.21.15.100:0/328108603 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd650010070 con 0x55ebdeb1d560 2024-09-18T01:25:49.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.745+0000 7fd549602640 1 --2- 172.21.15.100:0/328108603 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd538036b90 0x7fd538039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.745+0000 7fd549602640 1 -- 172.21.15.100:0/328108603 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd65003cd00 con 0x55ebdeb1d560 2024-09-18T01:25:49.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.745+0000 7fd65efe2640 1 --2- 172.21.15.100:0/328108603 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd538036b90 0x7fd538039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.745+0000 7fd663b26800 1 Processor -- start 2024-09-18T01:25:49.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.745+0000 7fd663b26800 1 -- start start 2024-09-18T01:25:49.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.745+0000 7fd65efe2640 1 --2- 172.21.15.100:0/328108603 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd538036b90 0x7fd538039050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd654005570 tx=0x7fd654005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.746+0000 7fd663b26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb2a060 0x55ebdeb2a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.746+0000 7fd663b26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ebdeaf8240 con 0x55ebdeb2a060 2024-09-18T01:25:49.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.746+0000 7fd65f7e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb2a060 0x55ebdeb2a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.746+0000 7fd65f7e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb2a060 0x55ebdeb2a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52490/0 (socket says 172.21.15.100:52490) 2024-09-18T01:25:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.746+0000 7fd65f7e3640 1 -- 172.21.15.100:0/3132553599 learned_addr learned my addr 172.21.15.100:0/3132553599 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.746+0000 7fd65f7e3640 1 -- 172.21.15.100:0/3132553599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebdeb2a9a0 con 0x55ebdeb2a060 2024-09-18T01:25:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.746+0000 7fd65f7e3640 1 --2- 172.21.15.100:0/3132553599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb2a060 0x55ebdeb2a460 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd650010670 tx=0x7fd65004b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cecf7841f30ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.746+0000 7fd542ffd640 1 -- 172.21.15.100:0/3132553599 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd650005070 con 0x55ebdeb2a060 2024-09-18T01:25:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.746+0000 7fd542ffd640 1 -- 172.21.15.100:0/3132553599 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd650026e60 con 0x55ebdeb2a060 2024-09-18T01:25:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.746+0000 7fd542ffd640 1 -- 172.21.15.100:0/3132553599 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd65003f2e0 con 0x55ebdeb2a060 2024-09-18T01:25:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.747+0000 7fd663b26800 1 -- 172.21.15.100:0/3132553599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb2a060 msgr2=0x55ebdeb2a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.747+0000 7fd663b26800 1 --2- 172.21.15.100:0/3132553599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb2a060 0x55ebdeb2a460 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd650010670 tx=0x7fd65004b410 comp rx=0 tx=0).stop 2024-09-18T01:25:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.747+0000 7fd663b26800 1 -- 172.21.15.100:0/3132553599 shutdown_connections 2024-09-18T01:25:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.747+0000 7fd663b26800 1 --2- 172.21.15.100:0/3132553599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb2a060 0x55ebdeb2a460 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.747+0000 7fd663b26800 1 -- 172.21.15.100:0/3132553599 >> 172.21.15.100:0/3132553599 conn(0x55ebdeb26410 msgr2=0x55ebdeb24510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.747+0000 7fd663b26800 1 -- 172.21.15.100:0/3132553599 shutdown_connections 2024-09-18T01:25:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.747+0000 7fd663b26800 1 -- 172.21.15.100:0/3132553599 wait complete. 2024-09-18T01:25:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.747+0000 7fd663b26800 1 Processor -- start 2024-09-18T01:25:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.747+0000 7fd663b26800 1 -- start start 2024-09-18T01:25:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.747+0000 7fd663b26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb2a060 0x55ebdeb312c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.747+0000 7fd663b26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ebdeb2aec0 con 0x55ebdeb2a060 2024-09-18T01:25:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.747+0000 7fd65f7e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb2a060 0x55ebdeb312c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.747+0000 7fd65f7e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb2a060 0x55ebdeb312c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52498/0 (socket says 172.21.15.100:52498) 2024-09-18T01:25:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.747+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 learned_addr learned my addr 172.21.15.100:0/2574381819 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.748+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebdeb31800 con 0x55ebdeb2a060 2024-09-18T01:25:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.748+0000 7fd65f7e3640 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb2a060 0x55ebdeb312c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd65004b580 tx=0x7fd65004eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.748+0000 7fd5417fa640 1 -- 172.21.15.100:0/2574381819 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd65003e120 con 0x55ebdeb2a060 2024-09-18T01:25:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.748+0000 7fd5417fa640 1 -- 172.21.15.100:0/2574381819 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd650069030 con 0x55ebdeb2a060 2024-09-18T01:25:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.748+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebdeb31800 con 0x55ebdeb2a060 2024-09-18T01:25:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.748+0000 7fd5417fa640 1 -- 172.21.15.100:0/2574381819 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd650044b10 con 0x55ebdeb2a060 2024-09-18T01:25:49.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.748+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebdeb31800 con 0x55ebdeb2a060 2024-09-18T01:25:49.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.749+0000 7fd5417fa640 1 -- 172.21.15.100:0/2574381819 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd650060040 con 0x55ebdeb2a060 2024-09-18T01:25:49.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.749+0000 7fd5417fa640 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd528036af0 0x7fd528038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.749+0000 7fd5417fa640 1 -- 172.21.15.100:0/2574381819 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd650053040 con 0x55ebdeb2a060 2024-09-18T01:25:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.749+0000 7fd65efe2640 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd528036af0 0x7fd528038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.750+0000 7fd65efe2640 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd528036af0 0x7fd528038fb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd654045be0 tx=0x7fd65406d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.750+0000 7fd663b26800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.750+0000 7fd663b26800 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ebdeb3c940 0x55ebdeb3ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.750+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb3f550 con 0x55ebdeb3c940 2024-09-18T01:25:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.750+0000 7fd65ffe4640 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ebdeb3c940 0x55ebdeb3ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.750+0000 7fd65ffe4640 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ebdeb3c940 0x55ebdeb3ee00 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd6580083e0 con 0x55ebdeb3c940 2024-09-18T01:25:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 20 realm 2024-09-18T01:25:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb3f960 con 0x55ebdeb3c940 2024-09-18T01:25:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd6580083e0 con 0x55ebdeb3c940 2024-09-18T01:25:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb3c940 2024-09-18T01:25:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd6580083e0 con 0x55ebdeb3c940 2024-09-18T01:25:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb405d0 con 0x55ebdeb3c940 2024-09-18T01:25:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd6580083e0 con 0x55ebdeb3c940 2024-09-18T01:25:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ebdeb40f90 0x55ebdeb43380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb43990 con 0x55ebdeb40f90 2024-09-18T01:25:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.751+0000 7fd65f7e3640 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ebdeb40f90 0x55ebdeb43380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.752+0000 7fd65f7e3640 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ebdeb40f90 0x55ebdeb43380 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.752+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.752+0000 7fd663b26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.752+0000 7fd663b26800 20 searching for the correct realm 2024-09-18T01:25:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.752+0000 7fd663b26800 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ebdeb45940 0x55ebdeb47e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.752+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb484d0 con 0x55ebdeb45940 2024-09-18T01:25:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.752+0000 7fd65efe2640 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ebdeb45940 0x55ebdeb47e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.752+0000 7fd65efe2640 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ebdeb45940 0x55ebdeb47e00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.753+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.753+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb484d0 con 0x55ebdeb40f90 2024-09-18T01:25:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.753+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.753+0000 7fd65f7e3640 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd650027020 0x7fd6500351a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.753+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb484d0 con 0x7fd650027020 2024-09-18T01:25:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.753+0000 7fd65ffe4640 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd650027020 0x7fd6500351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.754+0000 7fd65ffe4640 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd650027020 0x7fd6500351a0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.754+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd6580083e0 con 0x7fd650027020 2024-09-18T01:25:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.754+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb3c940 2024-09-18T01:25:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.754+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6580083e0 con 0x55ebdeb3c940 2024-09-18T01:25:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.754+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb3c940 2024-09-18T01:25:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.754+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd658026040 con 0x55ebdeb3c940 2024-09-18T01:25:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.754+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x7fd650027020 2024-09-18T01:25:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.755+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd658026040 con 0x7fd650027020 2024-09-18T01:25:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.755+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x7fd650027020 2024-09-18T01:25:49.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.755+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd658026040 con 0x7fd650027020 2024-09-18T01:25:49.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.755+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb40f90 2024-09-18T01:25:49.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.755+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.755+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb45940 2024-09-18T01:25:49.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.755+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.755+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb3c940 2024-09-18T01:25:49.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.756+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd658026040 con 0x55ebdeb3c940 2024-09-18T01:25:49.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.756+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb40f90 2024-09-18T01:25:49.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.756+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.756+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb3c940 2024-09-18T01:25:49.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.756+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd658026040 con 0x55ebdeb3c940 2024-09-18T01:25:49.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.756+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb40f90 2024-09-18T01:25:49.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.756+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.756+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb45940 2024-09-18T01:25:49.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.757+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.757+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb45940 2024-09-18T01:25:49.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.757+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.757+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x7fd650027020 2024-09-18T01:25:49.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.757+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd658026040 con 0x7fd650027020 2024-09-18T01:25:49.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.757+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb45940 2024-09-18T01:25:49.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.757+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.757+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb45940 2024-09-18T01:25:49.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.757+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.757+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb3c940 2024-09-18T01:25:49.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.758+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd658026040 con 0x55ebdeb3c940 2024-09-18T01:25:49.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.758+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb3c940 2024-09-18T01:25:49.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.758+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd658026040 con 0x55ebdeb3c940 2024-09-18T01:25:49.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.758+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x7fd650027020 2024-09-18T01:25:49.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.758+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd658026040 con 0x7fd650027020 2024-09-18T01:25:49.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.758+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb45940 2024-09-18T01:25:49.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.758+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.758+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb40f90 2024-09-18T01:25:49.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.759+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.759+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb3c940 2024-09-18T01:25:49.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.759+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd658026040 con 0x55ebdeb3c940 2024-09-18T01:25:49.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.759+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x7fd650027020 2024-09-18T01:25:49.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.759+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.759+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb45940 2024-09-18T01:25:49.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.759+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.760+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb40f90 2024-09-18T01:25:49.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.760+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.760+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb40f90 2024-09-18T01:25:49.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.760+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.760+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb45940 2024-09-18T01:25:49.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.760+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.760+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x7fd650027020 2024-09-18T01:25:49.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb3c940 2024-09-18T01:25:49.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb40230 con 0x55ebdeb40f90 2024-09-18T01:25:49.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd663b26800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd663b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd663b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd663b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd663b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd663b26800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd663b26800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb44250 con 0x55ebdeb3c940 2024-09-18T01:25:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd663b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd663b26800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb44640 con 0x55ebdeb3c940 2024-09-18T01:25:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd663b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.761+0000 7fd663b26800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb44640 con 0x7fd650027020 2024-09-18T01:25:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd663b26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd663b26800 20 zone default found 2024-09-18T01:25:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd663b26800 4 Realm: () 2024-09-18T01:25:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd663b26800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd663b26800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd663b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd663b26800 20 zonegroup default 2024-09-18T01:25:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd663b26800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb48950 con 0x7fd650027020 2024-09-18T01:25:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd663b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd663b26800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4a330 con 0x55ebdeb45940 2024-09-18T01:25:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.762+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.763+0000 7fd663b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.763+0000 7fd663b26800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.763+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4a6d0 con 0x55ebdeb45940 2024-09-18T01:25:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.763+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.763+0000 7fd663b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.763+0000 7fd663b26800 20 started sync module instance, tier type = 2024-09-18T01:25:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.763+0000 7fd663b26800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.763+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb497d0 con 0x55ebdeb40f90 2024-09-18T01:25:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.764+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.764+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94471542051616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4aa70 con 0x55ebdeb40f90 2024-09-18T01:25:49.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.764+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4b300 con 0x55ebdeb3c940 2024-09-18T01:25:49.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.765+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94471542051616] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.765+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.765+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94471542053824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4b6f0 con 0x55ebdeb3c940 2024-09-18T01:25:49.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.765+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4c110 con 0x55ebdeb45940 2024-09-18T01:25:49.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.766+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.766+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94471542062080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4c9b0 con 0x55ebdeb45940 2024-09-18T01:25:49.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.766+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4d490 con 0x55ebdeb40f90 2024-09-18T01:25:49.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.767+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94471542053824] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.767+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.767+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94471542058512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4dd30 con 0x55ebdeb40f90 2024-09-18T01:25:49.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.767+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4e6f0 con 0x55ebdeb3c940 2024-09-18T01:25:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.768+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94471542062080] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.769+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94471542058512] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.769+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.769+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94471542069376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4dca0 con 0x55ebdeb3c940 2024-09-18T01:25:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.769+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4eba0 con 0x7fd650027020 2024-09-18T01:25:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.770+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.770+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94471542073072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4efc0 con 0x7fd650027020 2024-09-18T01:25:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.770+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4faa0 con 0x7fd650027020 2024-09-18T01:25:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.770+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94471542069376] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.771+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94471542073072] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.771+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.771+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94471542076848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4eb10 con 0x7fd650027020 2024-09-18T01:25:49.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.771+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb50130 con 0x7fd650027020 2024-09-18T01:25:49.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.772+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(58 notify.7 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.772+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94471542076848] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.772+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94471542078592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb50550 con 0x7fd650027020 2024-09-18T01:25:49.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.772+0000 7fd663b26800 20 add_watcher() i=0 2024-09-18T01:25:49.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.772+0000 7fd663b26800 20 add_watcher() i=1 2024-09-18T01:25:49.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.772+0000 7fd663b26800 20 add_watcher() i=2 2024-09-18T01:25:49.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.772+0000 7fd663b26800 20 add_watcher() i=3 2024-09-18T01:25:49.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.772+0000 7fd663b26800 20 add_watcher() i=4 2024-09-18T01:25:49.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.772+0000 7fd663b26800 20 add_watcher() i=5 2024-09-18T01:25:49.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.772+0000 7fd663b26800 20 add_watcher() i=6 2024-09-18T01:25:49.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.773+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94471542078592] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.773+0000 7fd663b26800 20 add_watcher() i=7 2024-09-18T01:25:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.773+0000 7fd663b26800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.773+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb53580 con 0x55ebdeb3c940 2024-09-18T01:25:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.774+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.774+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94471542079648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb50970 con 0x55ebdeb3c940 2024-09-18T01:25:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.775+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94471542079648] v35'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.775+0000 7fd515fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.775+0000 7fd663b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.775+0000 7fd663b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.775+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5bde0 con 0x55ebdeb3c940 2024-09-18T01:25:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.776+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'53 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.776+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5c4b0 con 0x7fd650027020 2024-09-18T01:25:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.778+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.778+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5c910 con 0x55ebdeb45940 2024-09-18T01:25:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.779+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.779+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5d220 con 0x55ebdeb3c940 2024-09-18T01:25:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.779+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'180 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.779+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5d660 con 0x55ebdeb40f90 2024-09-18T01:25:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.780+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'65 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.780+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5d6f0 con 0x55ebdeb45940 2024-09-18T01:25:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.781+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'51 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.781+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5e110 con 0x55ebdeb3c940 2024-09-18T01:25:49.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.783+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.783+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5e110 con 0x7fd650027020 2024-09-18T01:25:49.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.784+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'46 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.784+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5e110 con 0x55ebdeb40f90 2024-09-18T01:25:49.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.785+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.785+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5e1a0 con 0x55ebdeb45940 2024-09-18T01:25:49.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.786+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.786+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5e750 con 0x55ebdeb40f90 2024-09-18T01:25:49.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.787+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'66 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.787+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5e710 con 0x7fd650027020 2024-09-18T01:25:49.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.788+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.788+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5e710 con 0x55ebdeb40f90 2024-09-18T01:25:49.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.789+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.789+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5e710 con 0x7fd650027020 2024-09-18T01:25:49.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.790+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'58 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.790+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5e710 con 0x55ebdeb3c940 2024-09-18T01:25:49.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.791+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'181 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.791+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5e710 con 0x55ebdeb45940 2024-09-18T01:25:49.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.793+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.793+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed40 con 0x55ebdeb40f90 2024-09-18T01:25:49.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.794+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'67 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.794+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x55ebdeb45940 2024-09-18T01:25:49.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.795+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.795+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x55ebdeb3c940 2024-09-18T01:25:49.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.796+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.796+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x55ebdeb3c940 2024-09-18T01:25:49.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.797+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'182 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.797+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x55ebdeb45940 2024-09-18T01:25:49.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.798+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.798+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x55ebdeb40f90 2024-09-18T01:25:49.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.799+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.799+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x55ebdeb45940 2024-09-18T01:25:49.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.800+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.800+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x55ebdeb45940 2024-09-18T01:25:49.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.800+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'41 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.801+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x55ebdeb45940 2024-09-18T01:25:49.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.801+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.801+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x55ebdeb45940 2024-09-18T01:25:49.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.802+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'52 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.802+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x7fd650027020 2024-09-18T01:25:49.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.804+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.804+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x55ebdeb45940 2024-09-18T01:25:49.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.805+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.805+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x7fd650027020 2024-09-18T01:25:49.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.806+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'47 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.806+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x55ebdeb45940 2024-09-18T01:25:49.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.807+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.807+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x7fd650027020 2024-09-18T01:25:49.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.808+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'59 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.808+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ed20 con 0x55ebdeb40f90 2024-09-18T01:25:49.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.809+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.809+0000 7fd514fe1640 20 reqs_thread_entry: start 2024-09-18T01:25:49.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.809+0000 7fd663b26800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:49.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.809+0000 7fd663b26800 20 Filter name: none 2024-09-18T01:25:49.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.809+0000 7fd48e7fc640 20 reqs_thread_entry: start 2024-09-18T01:25:49.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.809+0000 7fd663b26800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:49.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.809+0000 7fd663b26800 20 rados->read ofs=0 len=0 2024-09-18T01:25:49.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.809+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb899d0 con 0x55ebdeb3c940 2024-09-18T01:25:49.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.810+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.810+0000 7fd663b26800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.810+0000 7fd663b26800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.810+0000 7fd663b26800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.810+0000 7fd663b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.810+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb89980 con 0x55ebdeb40f90 2024-09-18T01:25:49.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.810+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.813 INFO:teuthology.orchestra.run.smithi100.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-18T01:25:49.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.811+0000 7fd515fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:49.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.811+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94471542079648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb899e0 con 0x55ebdeb3c940 2024-09-18T01:25:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.812+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94471542079648] v35'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.812+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94471542051616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb5ac90 con 0x55ebdeb40f90 2024-09-18T01:25:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.813+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94471542051616] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.813+0000 7fd663b26800 20 remove_watcher() i=0 2024-09-18T01:25:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.813+0000 7fd663b26800 2 removed watcher, disabling cache 2024-09-18T01:25:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.813+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94471542053824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb49320 con 0x55ebdeb3c940 2024-09-18T01:25:49.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.814+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94471542053824] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.814+0000 7fd663b26800 20 remove_watcher() i=1 2024-09-18T01:25:49.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.814+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94471542062080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb49320 con 0x55ebdeb45940 2024-09-18T01:25:49.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.815+0000 7fd65efe2640 1 -- 172.21.15.100:0/2574381819 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94471542062080] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd654057030 con 0x55ebdeb45940 2024-09-18T01:25:49.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.815+0000 7fd663b26800 20 remove_watcher() i=2 2024-09-18T01:25:49.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.815+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94471542058512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb49320 con 0x55ebdeb40f90 2024-09-18T01:25:49.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.816+0000 7fd65f7e3640 1 -- 172.21.15.100:0/2574381819 <== osd.2 v2:172.21.15.100:6808/3104327688 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94471542058512] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd65001b070 con 0x55ebdeb40f90 2024-09-18T01:25:49.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.816+0000 7fd663b26800 20 remove_watcher() i=3 2024-09-18T01:25:49.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.816+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94471542069376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4ae10 con 0x55ebdeb3c940 2024-09-18T01:25:49.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.817+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94471542069376] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x55ebdeb3c940 2024-09-18T01:25:49.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.817+0000 7fd663b26800 20 remove_watcher() i=4 2024-09-18T01:25:49.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.817+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94471542073072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4d880 con 0x7fd650027020 2024-09-18T01:25:49.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.819+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94471542073072] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.819+0000 7fd663b26800 20 remove_watcher() i=5 2024-09-18T01:25:49.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.819+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94471542076848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4d880 con 0x7fd650027020 2024-09-18T01:25:49.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.820+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94471542076848] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.820+0000 7fd663b26800 20 remove_watcher() i=6 2024-09-18T01:25:49.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.820+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94471542078592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ebdeb4d880 con 0x7fd650027020 2024-09-18T01:25:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94471542078592] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd658037040 con 0x7fd650027020 2024-09-18T01:25:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 20 remove_watcher() i=7 2024-09-18T01:25:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd650027020 msgr2=0x7fd6500351a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd650027020 0x7fd6500351a0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ebdeb3c940 msgr2=0x55ebdeb3ee00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ebdeb3c940 0x55ebdeb3ee00 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ebdeb40f90 msgr2=0x55ebdeb43380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ebdeb40f90 0x55ebdeb43380 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ebdeb45940 msgr2=0x55ebdeb47e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ebdeb45940 0x55ebdeb47e00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd528036af0 msgr2=0x7fd528038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd528036af0 0x7fd528038fb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd654045be0 tx=0x7fd65406d040 comp rx=0 tx=0).stop 2024-09-18T01:25:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb2a060 msgr2=0x55ebdeb312c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 --2- 172.21.15.100:0/2574381819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb2a060 0x55ebdeb312c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd65004b580 tx=0x7fd65004eea0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 reap_dead start 2024-09-18T01:25:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd65ffe4640 1 -- 172.21.15.100:0/2574381819 reap_dead start 2024-09-18T01:25:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 shutdown_connections 2024-09-18T01:25:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 >> 172.21.15.100:0/2574381819 conn(0x55ebdeb26410 msgr2=0x55ebdeb244e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 shutdown_connections 2024-09-18T01:25:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.821+0000 7fd663b26800 1 -- 172.21.15.100:0/2574381819 wait complete. 2024-09-18T01:25:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/328108603 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd538036b90 msgr2=0x7fd538039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 --2- 172.21.15.100:0/328108603 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd538036b90 0x7fd538039050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd654005570 tx=0x7fd654005ac0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/328108603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb1d560 msgr2=0x55ebdeb1d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 --2- 172.21.15.100:0/328108603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb1d560 0x55ebdeb1d980 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd65001d510 tx=0x7fd650044500 comp rx=0 tx=0).stop 2024-09-18T01:25:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/328108603 shutdown_connections 2024-09-18T01:25:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 --2- 172.21.15.100:0/328108603 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd538036b90 0x7fd538039050 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 --2- 172.21.15.100:0/328108603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebdeb1d560 0x55ebdeb1d980 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/328108603 >> 172.21.15.100:0/328108603 conn(0x55ebdeb124f0 msgr2=0x55ebdeb15070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/328108603 shutdown_connections 2024-09-18T01:25:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/328108603 wait complete. 2024-09-18T01:25:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ebdeb0cd20 msgr2=0x55ebdeb0f110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ebdeb0cd20 0x55ebdeb0f110 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ebdea0cd90 msgr2=0x55ebdeb06530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ebdea0cd90 0x55ebdeb06530 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ebdeb08de0 msgr2=0x55ebdeb0b1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ebdeb08de0 0x55ebdeb0b1d0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd544036b40 msgr2=0x7fd544039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd544036b40 0x7fd544039000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd654057000 tx=0x7fd654052000 comp rx=0 tx=0).stop 2024-09-18T01:25:49.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebde97a610 msgr2=0x55ebdeaff4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 --2- 172.21.15.100:0/1415225100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebde97a610 0x55ebdeaff4c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd650000f80 tx=0x7fd650001250 comp rx=0 tx=0).stop 2024-09-18T01:25:49.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd65ffe4640 1 -- 172.21.15.100:0/1415225100 reap_dead start 2024-09-18T01:25:49.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 shutdown_connections 2024-09-18T01:25:49.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 >> 172.21.15.100:0/1415225100 conn(0x55ebdea00de0 msgr2=0x55ebdeaf1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 shutdown_connections 2024-09-18T01:25:49.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.822+0000 7fd663b26800 1 -- 172.21.15.100:0/1415225100 wait complete. 2024-09-18T01:25:49.831 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-18T01:25:49.840 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-18T01:25:49.845 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:49.878 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:49.892 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:49.937 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-18T01:25:49.942 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:49.943 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-18T01:25:49.943 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-18T01:25:49.943 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-18T01:25:49.988 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:49.988 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.987+0000 7f8a0f52d800 1 Processor -- start 2024-09-18T01:25:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.988+0000 7f8a0f52d800 1 -- start start 2024-09-18T01:25:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.988+0000 7f8a0f52d800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5620d6f83d40 0x5620d6f86130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.988+0000 7f8a0f52d800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5620d6e3cb30 con 0x5620d6ef1610 2024-09-18T01:25:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.988+0000 7f8a0f52d800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5620d6e1e360 con 0x5620d6f83d40 2024-09-18T01:25:49.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.988+0000 7f8a03fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5620d6f83d40 0x5620d6f86130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:49.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.988+0000 7f8a03fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5620d6f83d40 0x5620d6f86130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52514/0 (socket says 172.21.15.100:52514) 2024-09-18T01:25:49.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.988+0000 7f8a0b280640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5620d6ef1610 0x5620d6f82620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:43716/0 (socket says 172.21.15.100:43716) 2024-09-18T01:25:49.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.988+0000 7f8a03fff640 1 -- 172.21.15.100:0/1405748503 learned_addr learned my addr 172.21.15.100:0/1405748503 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:49.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.988+0000 7f8a03fff640 1 -- 172.21.15.100:0/1405748503 >> v1:172.21.15.92:6789/0 conn(0x5620d6ef1610 legacy=0x5620d6f82620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.988+0000 7f8a03fff640 1 -- 172.21.15.100:0/1405748503 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d6e44e00 con 0x5620d6f83d40 2024-09-18T01:25:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.990+0000 7f8a03fff640 1 --2- 172.21.15.100:0/1405748503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6f83d40 0x5620d6f86130 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f89f400a520 tx=0x7f89f4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e5708afceb6a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.990+0000 7f8a0aa7f640 1 -- 172.21.15.100:0/1405748503 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89f4055070 con 0x5620d6f83d40 2024-09-18T01:25:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.990+0000 7f8a0aa7f640 1 -- 172.21.15.100:0/1405748503 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89f40515b0 con 0x5620d6f83d40 2024-09-18T01:25:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.990+0000 7f8a0aa7f640 1 -- 172.21.15.100:0/1405748503 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89f40518d0 con 0x5620d6f83d40 2024-09-18T01:25:49.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.991+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1405748503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6f83d40 msgr2=0x5620d6f86130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:49.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.991+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/1405748503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6f83d40 0x5620d6f86130 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f89f400a520 tx=0x7f89f4045ba0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.991+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1405748503 shutdown_connections 2024-09-18T01:25:49.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.991+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/1405748503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6f83d40 0x5620d6f86130 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:49.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.991+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1405748503 >> 172.21.15.100:0/1405748503 conn(0x5620d6f77db0 msgr2=0x5620d6f7a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:49.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.991+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1405748503 shutdown_connections 2024-09-18T01:25:49.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:49.991+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1405748503 wait complete. 2024-09-18T01:25:50.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.004+0000 7f8a0f52d800 1 Processor -- start 2024-09-18T01:25:50.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.005+0000 7f8a0f52d800 1 -- start start 2024-09-18T01:25:50.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.005+0000 7f8a0f52d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6ef1610 0x5620d706eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.005+0000 7f8a0f52d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5620d6ec9360 con 0x5620d6ef1610 2024-09-18T01:25:50.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.005+0000 7f8a0b280640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6ef1610 0x5620d706eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.005+0000 7f8a0b280640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6ef1610 0x5620d706eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52518/0 (socket says 172.21.15.100:52518) 2024-09-18T01:25:50.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.005+0000 7f8a0b280640 1 -- 172.21.15.100:0/1672664948 learned_addr learned my addr 172.21.15.100:0/1672664948 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.005+0000 7f8a0b280640 1 -- 172.21.15.100:0/1672664948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d6e16bc0 con 0x5620d6ef1610 2024-09-18T01:25:50.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.006+0000 7f8a0b280640 1 --2- 172.21.15.100:0/1672664948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6ef1610 0x5620d706eae0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f89fc001e40 tx=0x7f89fc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fac9268d6e3a7f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.006+0000 7f88f960a640 1 -- 172.21.15.100:0/1672664948 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89fc00e5c0 con 0x5620d6ef1610 2024-09-18T01:25:50.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.006+0000 7f88f960a640 1 -- 172.21.15.100:0/1672664948 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89fc006070 con 0x5620d6ef1610 2024-09-18T01:25:50.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.006+0000 7f88f960a640 1 -- 172.21.15.100:0/1672664948 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89fc00e910 con 0x5620d6ef1610 2024-09-18T01:25:50.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.006+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1672664948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6ef1610 msgr2=0x5620d706eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.006+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/1672664948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6ef1610 0x5620d706eae0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f89fc001e40 tx=0x7f89fc001e70 comp rx=0 tx=0).stop 2024-09-18T01:25:50.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.006+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1672664948 shutdown_connections 2024-09-18T01:25:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.006+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/1672664948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6ef1610 0x5620d706eae0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.006+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1672664948 >> 172.21.15.100:0/1672664948 conn(0x5620d6f77db0 msgr2=0x5620d706a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.007+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1672664948 shutdown_connections 2024-09-18T01:25:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.007+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1672664948 wait complete. 2024-09-18T01:25:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.007+0000 7f8a0f52d800 1 Processor -- start 2024-09-18T01:25:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.007+0000 7f8a0f52d800 1 -- start start 2024-09-18T01:25:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.007+0000 7f8a0f52d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6ef1610 0x5620d70764f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.007+0000 7f8a0f52d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5620d6f86910 con 0x5620d6ef1610 2024-09-18T01:25:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.007+0000 7f8a0b280640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6ef1610 0x5620d70764f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.007+0000 7f8a0b280640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6ef1610 0x5620d70764f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52526/0 (socket says 172.21.15.100:52526) 2024-09-18T01:25:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.007+0000 7f8a0b280640 1 -- 172.21.15.100:0/3861805884 learned_addr learned my addr 172.21.15.100:0/3861805884 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.008+0000 7f8a0b280640 1 -- 172.21.15.100:0/3861805884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d6e2afe0 con 0x5620d6ef1610 2024-09-18T01:25:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.008+0000 7f8a0b280640 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6ef1610 0x5620d70764f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f89fc004000 tx=0x7f89fc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.008+0000 7f88f7e07640 1 -- 172.21.15.100:0/3861805884 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89fc01a7c0 con 0x5620d6ef1610 2024-09-18T01:25:50.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.008+0000 7f88f7e07640 1 -- 172.21.15.100:0/3861805884 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89fc01a960 con 0x5620d6ef1610 2024-09-18T01:25:50.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.008+0000 7f88f7e07640 1 -- 172.21.15.100:0/3861805884 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89fc01acc0 con 0x5620d6ef1610 2024-09-18T01:25:50.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.008+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620d7076a30 con 0x5620d6ef1610 2024-09-18T01:25:50.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.008+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d7076f50 con 0x5620d6ef1610 2024-09-18T01:25:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.009+0000 7f88f7e07640 1 -- 172.21.15.100:0/3861805884 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f89fc017070 con 0x5620d6ef1610 2024-09-18T01:25:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.009+0000 7f88f7e07640 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88f0036b40 0x7f88f0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.009+0000 7f88f7e07640 1 -- 172.21.15.100:0/3861805884 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f89fc015020 con 0x5620d6ef1610 2024-09-18T01:25:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.009+0000 7f8a03fff640 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88f0036b40 0x7f88f0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.009+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5620d6f83d40 0x5620d707d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.009+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d707dae0 con 0x5620d6f83d40 2024-09-18T01:25:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.009+0000 7f8a0ba81640 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5620d6f83d40 0x5620d707d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.010+0000 7f8a03fff640 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88f0036b40 0x7f88f0039000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f89f4057000 tx=0x7f89f4052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.010+0000 7f8a0ba81640 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5620d6f83d40 0x5620d707d560 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.010+0000 7f8a0ba81640 1 -- 172.21.15.100:0/3861805884 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d6f83d40 2024-09-18T01:25:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.010+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d707ab30 con 0x5620d6f83d40 2024-09-18T01:25:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.010+0000 7f8a0ba81640 1 -- 172.21.15.100:0/3861805884 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d6f83d40 2024-09-18T01:25:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.010+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5620d707fe30 0x5620d7082220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.010+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d7082910 con 0x5620d707fe30 2024-09-18T01:25:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.010+0000 7f8a0b280640 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5620d707fe30 0x5620d7082220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.011+0000 7f8a0b280640 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5620d707fe30 0x5620d7082220 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.011+0000 7f8a0b280640 1 -- 172.21.15.100:0/3861805884 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f89fc02e070 con 0x5620d707fe30 2024-09-18T01:25:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.011+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d707ecd0 con 0x5620d6f83d40 2024-09-18T01:25:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.011+0000 7f8a0ba81640 1 -- 172.21.15.100:0/3861805884 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d6f83d40 2024-09-18T01:25:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.011+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5620d7083d70 0x5620d7086160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.011+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d7086860 con 0x5620d7083d70 2024-09-18T01:25:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.012+0000 7f8a03fff640 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5620d7083d70 0x5620d7086160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.012+0000 7f8a03fff640 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5620d7083d70 0x5620d7086160 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.012+0000 7f8a03fff640 1 -- 172.21.15.100:0/3861805884 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f89f4057030 con 0x5620d7083d70 2024-09-18T01:25:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.013+0000 7f8a0f52d800 1 Processor -- start 2024-09-18T01:25:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.013+0000 7f8a0f52d800 1 -- start start 2024-09-18T01:25:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.013+0000 7f8a0f52d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7094610 0x5620d7094a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.013+0000 7f8a0f52d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5620d6e18580 con 0x5620d7094610 2024-09-18T01:25:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.013+0000 7f8a0b280640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7094610 0x5620d7094a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.013+0000 7f8a0b280640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7094610 0x5620d7094a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52536/0 (socket says 172.21.15.100:52536) 2024-09-18T01:25:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.013+0000 7f8a0b280640 1 -- 172.21.15.100:0/2029925792 learned_addr learned my addr 172.21.15.100:0/2029925792 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.013+0000 7f8a0b280640 1 -- 172.21.15.100:0/2029925792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d7094f70 con 0x5620d7094610 2024-09-18T01:25:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.013+0000 7f8a0b280640 1 --2- 172.21.15.100:0/2029925792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7094610 0x5620d7094a30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f89fc01dfb0 tx=0x7f89fc01d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.014+0000 7f88f5602640 1 -- 172.21.15.100:0/2029925792 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89fc013340 con 0x5620d7094610 2024-09-18T01:25:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.014+0000 7f88f5602640 1 -- 172.21.15.100:0/2029925792 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89fc0134e0 con 0x5620d7094610 2024-09-18T01:25:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.014+0000 7f8a0f52d800 1 -- 172.21.15.100:0/2029925792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620d7095200 con 0x5620d7094610 2024-09-18T01:25:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.014+0000 7f88f5602640 1 -- 172.21.15.100:0/2029925792 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89fc044e30 con 0x5620d7094610 2024-09-18T01:25:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.014+0000 7f8a0f52d800 1 -- 172.21.15.100:0/2029925792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d7097ee0 con 0x5620d7094610 2024-09-18T01:25:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.014+0000 7f88f5602640 1 -- 172.21.15.100:0/2029925792 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f89fc044fd0 con 0x5620d7094610 2024-09-18T01:25:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.015+0000 7f88f5602640 1 --2- 172.21.15.100:0/2029925792 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88e4036b40 0x7f88e4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.015+0000 7f88f5602640 1 -- 172.21.15.100:0/2029925792 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f89fc03cd60 con 0x5620d7094610 2024-09-18T01:25:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.015+0000 7f8a03fff640 1 --2- 172.21.15.100:0/2029925792 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88e4036b40 0x7f88e4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.015+0000 7f8a0f52d800 1 Processor -- start 2024-09-18T01:25:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.015+0000 7f8a0f52d800 1 -- start start 2024-09-18T01:25:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.015+0000 7f8a03fff640 1 --2- 172.21.15.100:0/2029925792 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88e4036b40 0x7f88e4039000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5620d707e3e0 tx=0x7f89f4005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.015+0000 7f8a0f52d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d70a1060 0x5620d70a1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.015+0000 7f8a0f52d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5620d706f290 con 0x5620d70a1060 2024-09-18T01:25:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.015+0000 7f8a0b280640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d70a1060 0x5620d70a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.015+0000 7f8a0b280640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d70a1060 0x5620d70a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52544/0 (socket says 172.21.15.100:52544) 2024-09-18T01:25:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.015+0000 7f8a0b280640 1 -- 172.21.15.100:0/1256186375 learned_addr learned my addr 172.21.15.100:0/1256186375 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.016+0000 7f8a0b280640 1 -- 172.21.15.100:0/1256186375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d70a1a30 con 0x5620d70a1060 2024-09-18T01:25:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.016+0000 7f8a0b280640 1 --2- 172.21.15.100:0/1256186375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d70a1060 0x5620d70a1460 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f89fc02c140 tx=0x7f89fc01bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13ff50856e3a57f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.016+0000 7f88eeffd640 1 -- 172.21.15.100:0/1256186375 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89fc05c030 con 0x5620d70a1060 2024-09-18T01:25:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.016+0000 7f88eeffd640 1 -- 172.21.15.100:0/1256186375 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89fc0452c0 con 0x5620d70a1060 2024-09-18T01:25:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.016+0000 7f88eeffd640 1 -- 172.21.15.100:0/1256186375 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89fc045d50 con 0x5620d70a1060 2024-09-18T01:25:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.016+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1256186375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d70a1060 msgr2=0x5620d70a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.016+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/1256186375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d70a1060 0x5620d70a1460 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f89fc02c140 tx=0x7f89fc01bb40 comp rx=0 tx=0).stop 2024-09-18T01:25:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.016+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1256186375 shutdown_connections 2024-09-18T01:25:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.016+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/1256186375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d70a1060 0x5620d70a1460 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.016+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1256186375 >> 172.21.15.100:0/1256186375 conn(0x5620d709d410 msgr2=0x5620d709b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.017+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1256186375 shutdown_connections 2024-09-18T01:25:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.017+0000 7f8a0f52d800 1 -- 172.21.15.100:0/1256186375 wait complete. 2024-09-18T01:25:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.017+0000 7f8a0f52d800 1 Processor -- start 2024-09-18T01:25:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.017+0000 7f8a0f52d800 1 -- start start 2024-09-18T01:25:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.017+0000 7f8a0f52d800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d70a1060 0x5620d70a83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.017+0000 7f8a0f52d800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5620d70a1ec0 con 0x5620d70a1060 2024-09-18T01:25:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.017+0000 7f8a0b280640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d70a1060 0x5620d70a83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.017+0000 7f8a0b280640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d70a1060 0x5620d70a83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52550/0 (socket says 172.21.15.100:52550) 2024-09-18T01:25:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.017+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 learned_addr learned my addr 172.21.15.100:0/611616237 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.017+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d70a88e0 con 0x5620d70a1060 2024-09-18T01:25:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.018+0000 7f8a0b280640 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d70a1060 0x5620d70a83a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f89fc05d040 tx=0x7f89fc02c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.018+0000 7f88ed7fa640 1 -- 172.21.15.100:0/611616237 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89fc070070 con 0x5620d70a1060 2024-09-18T01:25:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.018+0000 7f88ed7fa640 1 -- 172.21.15.100:0/611616237 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89fc013c20 con 0x5620d70a1060 2024-09-18T01:25:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.018+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620d70a88e0 con 0x5620d70a1060 2024-09-18T01:25:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.018+0000 7f88ed7fa640 1 -- 172.21.15.100:0/611616237 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89fc04da40 con 0x5620d70a1060 2024-09-18T01:25:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.018+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d70a88e0 con 0x5620d70a1060 2024-09-18T01:25:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.019+0000 7f88ed7fa640 1 -- 172.21.15.100:0/611616237 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f89fc073070 con 0x5620d70a1060 2024-09-18T01:25:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.019+0000 7f88ed7fa640 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88d4036b90 0x7f88d4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.019+0000 7f88ed7fa640 1 -- 172.21.15.100:0/611616237 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f89fc068070 con 0x5620d70a1060 2024-09-18T01:25:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.019+0000 7f8a03fff640 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88d4036b90 0x7f88d4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.019+0000 7f8a0f52d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.019+0000 7f8a03fff640 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88d4036b90 0x7f88d4039050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f89f4051990 tx=0x7f89f406d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.019+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5620d70b3a60 0x5620d70b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.019+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b6670 con 0x5620d70b3a60 2024-09-18T01:25:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.019+0000 7f8a0ba81640 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5620d70b3a60 0x5620d70b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0ba81640 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5620d70b3a60 0x5620d70b5f20 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0f52d800 20 realm 2024-09-18T01:25:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0f52d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b6a80 con 0x5620d70b3a60 2024-09-18T01:25:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0f52d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0f52d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b7350 con 0x5620d70b3a60 2024-09-18T01:25:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0f52d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.020+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b3a60 2024-09-18T01:25:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.021+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.021+0000 7f8a0f52d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.021+0000 7f8a0f52d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.021+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5620d70b8450 0x5620d70ba840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.021+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d70bae50 con 0x5620d70b8450 2024-09-18T01:25:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.021+0000 7f8a0b280640 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5620d70b8450 0x5620d70ba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.021+0000 7f8a0b280640 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5620d70b8450 0x5620d70ba840 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.021+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.021+0000 7f8a0f52d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.021+0000 7f8a0f52d800 20 searching for the correct realm 2024-09-18T01:25:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.021+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5620d70bcde0 0x5620d70bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.021+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70bf970 con 0x5620d70bcde0 2024-09-18T01:25:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.021+0000 7f8a03fff640 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5620d70bcde0 0x5620d70bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.022+0000 7f8a03fff640 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5620d70bcde0 0x5620d70bf2a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.022+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f4057030 con 0x5620d70bcde0 2024-09-18T01:25:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.022+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70bf970 con 0x5620d70b8450 2024-09-18T01:25:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.022+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.022+0000 7f8a0b280640 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f89fc075060 0x7f89fc02c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.022+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70bf970 con 0x7f89fc075060 2024-09-18T01:25:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.022+0000 7f8a0ba81640 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f89fc075060 0x7f89fc02c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.023+0000 7f8a0ba81640 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f89fc075060 0x7f89fc02c5d0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.023+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.023+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b3a60 2024-09-18T01:25:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.023+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.023+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b3a60 2024-09-18T01:25:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.024+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.024+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x7f89fc075060 2024-09-18T01:25:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.024+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.024+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x7f89fc075060 2024-09-18T01:25:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.024+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.024+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b8450 2024-09-18T01:25:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.024+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.024+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70bcde0 2024-09-18T01:25:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.025+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f4057030 con 0x5620d70bcde0 2024-09-18T01:25:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.025+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b3a60 2024-09-18T01:25:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.025+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.025+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b8450 2024-09-18T01:25:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.025+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.025+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b3a60 2024-09-18T01:25:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.025+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.025+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b8450 2024-09-18T01:25:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.026+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.026+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70bcde0 2024-09-18T01:25:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.026+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f4057030 con 0x5620d70bcde0 2024-09-18T01:25:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.026+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70bcde0 2024-09-18T01:25:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.026+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f4057030 con 0x5620d70bcde0 2024-09-18T01:25:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.026+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x7f89fc075060 2024-09-18T01:25:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.026+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.026+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70bcde0 2024-09-18T01:25:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.027+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f4057030 con 0x5620d70bcde0 2024-09-18T01:25:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.027+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70bcde0 2024-09-18T01:25:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.027+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f4057030 con 0x5620d70bcde0 2024-09-18T01:25:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.027+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b3a60 2024-09-18T01:25:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.027+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.027+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b3a60 2024-09-18T01:25:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.027+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.027+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x7f89fc075060 2024-09-18T01:25:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.028+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.028+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70bcde0 2024-09-18T01:25:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.028+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f4057030 con 0x5620d70bcde0 2024-09-18T01:25:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.028+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b8450 2024-09-18T01:25:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.028+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.028+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b3a60 2024-09-18T01:25:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.028+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.028+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x7f89fc075060 2024-09-18T01:25:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.029+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.029+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70bcde0 2024-09-18T01:25:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.029+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f4057030 con 0x5620d70bcde0 2024-09-18T01:25:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.029+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b8450 2024-09-18T01:25:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.029+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.029+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b8450 2024-09-18T01:25:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.029+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.029+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70bcde0 2024-09-18T01:25:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.029+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f4057030 con 0x5620d70bcde0 2024-09-18T01:25:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.030+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x7f89fc075060 2024-09-18T01:25:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.030+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.030+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b3a60 2024-09-18T01:25:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.030+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.030+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5620d70b76f0 con 0x5620d70b8450 2024-09-18T01:25:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.030+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.030+0000 7f8a0f52d800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.030+0000 7f8a0f52d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.030+0000 7f8a0f52d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.030+0000 7f8a0f52d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.030+0000 7f8a0f52d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.030+0000 7f8a0f52d800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.030+0000 7f8a0f52d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.030+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d70bb710 con 0x5620d70b3a60 2024-09-18T01:25:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d70bbb00 con 0x5620d70b3a60 2024-09-18T01:25:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d70bbb00 con 0x7f89fc075060 2024-09-18T01:25:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 20 zone default found 2024-09-18T01:25:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 4 Realm: () 2024-09-18T01:25:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 20 zonegroup default 2024-09-18T01:25:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d70bb340 con 0x7f89fc075060 2024-09-18T01:25:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.031+0000 7f8a0f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.032+0000 7f8a0f52d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.032+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d70bb370 con 0x5620d70bcde0 2024-09-18T01:25:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.032+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f89f4057030 con 0x5620d70bcde0 2024-09-18T01:25:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.032+0000 7f8a0f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.032+0000 7f8a0f52d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.032+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c18e0 con 0x5620d70bcde0 2024-09-18T01:25:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.032+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f89f4057030 con 0x5620d70bcde0 2024-09-18T01:25:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.032+0000 7f8a0f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.032+0000 7f8a0f52d800 20 started sync module instance, tier type = 2024-09-18T01:25:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.032+0000 7f8a0f52d800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.032+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c0c70 con 0x5620d70b8450 2024-09-18T01:25:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.033+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.033+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94699046834272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c08d0 con 0x5620d70b8450 2024-09-18T01:25:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.033+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c2810 con 0x5620d70b3a60 2024-09-18T01:25:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.034+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94699046834272] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.034+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.034+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94699046839136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c2c30 con 0x5620d70b3a60 2024-09-18T01:25:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.035+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c35f0 con 0x5620d70bcde0 2024-09-18T01:25:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.036+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f4057030 con 0x5620d70bcde0 2024-09-18T01:25:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.036+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94699046839136] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.036+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94699046842688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c3e40 con 0x5620d70bcde0 2024-09-18T01:25:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.036+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c27c0 con 0x5620d70b8450 2024-09-18T01:25:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.037+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94699046842688] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f4057030 con 0x5620d70bcde0 2024-09-18T01:25:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.037+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.037+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94699046844816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c48b0 con 0x5620d70b8450 2024-09-18T01:25:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.037+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c52d0 con 0x5620d70b3a60 2024-09-18T01:25:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.038+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94699046844816] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.038+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.038+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94699046849984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c48b0 con 0x5620d70b3a60 2024-09-18T01:25:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.038+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c5ce0 con 0x7f89fc075060 2024-09-18T01:25:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.039+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94699046849984] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.040+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.040+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94699046853168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c48b0 con 0x7f89fc075060 2024-09-18T01:25:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.040+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c66f0 con 0x7f89fc075060 2024-09-18T01:25:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.041+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94699046853168] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.041+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.041+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94699046847968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c66f0 con 0x7f89fc075060 2024-09-18T01:25:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.041+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c70b0 con 0x7f89fc075060 2024-09-18T01:25:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.042+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94699046847968] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.042+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.042+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94699046858208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c66f0 con 0x7f89fc075060 2024-09-18T01:25:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.042+0000 7f8a0f52d800 20 add_watcher() i=0 2024-09-18T01:25:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.042+0000 7f8a0f52d800 20 add_watcher() i=1 2024-09-18T01:25:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.042+0000 7f8a0f52d800 20 add_watcher() i=2 2024-09-18T01:25:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.042+0000 7f8a0f52d800 20 add_watcher() i=3 2024-09-18T01:25:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.042+0000 7f8a0f52d800 20 add_watcher() i=4 2024-09-18T01:25:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.042+0000 7f8a0f52d800 20 add_watcher() i=5 2024-09-18T01:25:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.042+0000 7f8a0f52d800 20 add_watcher() i=6 2024-09-18T01:25:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.043+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94699046858208] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.043+0000 7f8a0f52d800 20 add_watcher() i=7 2024-09-18T01:25:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.043+0000 7f8a0f52d800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.043+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d70ca4d0 con 0x5620d70b3a60 2024-09-18T01:25:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.043+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.043+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94699046855696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c79d0 con 0x5620d70b3a60 2024-09-18T01:25:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.044+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94699046855696] v35'184 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.045+0000 7f88c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.045+0000 7f8a0f52d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.045+0000 7f8a0f52d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.045+0000 7f8a0f52d800 5 note: GC not initialized 2024-09-18T01:25:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.045+0000 7f88c0fe1640 20 reqs_thread_entry: start 2024-09-18T01:25:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.045+0000 7f8a0f52d800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.045+0000 7f8a0f52d800 20 Filter name: none 2024-09-18T01:25:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.045+0000 7f883a7fc640 20 reqs_thread_entry: start 2024-09-18T01:25:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.045+0000 7f8a0f52d800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:25:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.045+0000 7f8a0f52d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.045+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d70fdd20 con 0x5620d70b8450 2024-09-18T01:25:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0f52d800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0f52d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:25:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0f52d800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0f52d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 : miss 2024-09-18T01:25:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0f52d800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.8 8:159c71d7:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d70ff930 con 0x5620d70b3a60 2024-09-18T01:25:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(63 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0f52d800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0f52d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 info.flags=0x17 2024-09-18T01:25:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0f52d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 to cache LRU end 2024-09-18T01:25:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0f52d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0f52d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0f52d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 2024-09-18T01:25:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0f52d800 20 get_obj_state: octx=0x7f89fc045a20 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5620d7101ff8 s->prefetch_data=0 2024-09-18T01:25:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.046+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 3.10s0 3:0b134fe9:::153b7754-209b-4898-8796-577da7c1273d.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5620d71030f0 con 0x5620d70b3a60 2024-09-18T01:25:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.047+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 153b7754-209b-4898-8796-577da7c1273d.4237.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.047+0000 7f8a0f52d800 10 manifest: total_size = 5 2024-09-18T01:25:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.047+0000 7f8a0f52d800 20 get_obj_state: setting s->obj_tag to _W4-V5D3fIviiomKXIJE94lMTqJDP5ys 2024-09-18T01:25:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.047+0000 7f88c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.047+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94699046855696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d71030f0 con 0x5620d70b3a60 2024-09-18T01:25:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.048+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94699046855696] v35'185 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.048+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94699046834272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d71030f0 con 0x5620d70b8450 2024-09-18T01:25:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.049+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94699046834272] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.049+0000 7f8a0f52d800 20 remove_watcher() i=0 2024-09-18T01:25:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.049+0000 7f8a0f52d800 2 removed watcher, disabling cache 2024-09-18T01:25:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.049+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94699046839136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d71030f0 con 0x5620d70b3a60 2024-09-18T01:25:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.051+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94699046839136] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.051+0000 7f8a0f52d800 20 remove_watcher() i=1 2024-09-18T01:25:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.051+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94699046842688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d71030f0 con 0x5620d70bcde0 2024-09-18T01:25:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.052+0000 7f8a03fff640 1 -- 172.21.15.100:0/611616237 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94699046842688] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f4057030 con 0x5620d70bcde0 2024-09-18T01:25:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.052+0000 7f8a0f52d800 20 remove_watcher() i=2 2024-09-18T01:25:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.052+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94699046844816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c1060 con 0x5620d70b8450 2024-09-18T01:25:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.053+0000 7f8a0b280640 1 -- 172.21.15.100:0/611616237 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94699046844816] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89fc072030 con 0x5620d70b8450 2024-09-18T01:25:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.053+0000 7f8a0f52d800 20 remove_watcher() i=3 2024-09-18T01:25:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.053+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94699046849984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c3990 con 0x5620d70b3a60 2024-09-18T01:25:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.054+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94699046849984] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x5620d70b3a60 2024-09-18T01:25:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.055+0000 7f8a0f52d800 20 remove_watcher() i=4 2024-09-18T01:25:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.055+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94699046853168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c1060 con 0x7f89fc075060 2024-09-18T01:25:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.056+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94699046853168] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.056+0000 7f8a0f52d800 20 remove_watcher() i=5 2024-09-18T01:25:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.056+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94699046847968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c5a30 con 0x7f89fc075060 2024-09-18T01:25:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.057+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94699046847968] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.057+0000 7f8a0f52d800 20 remove_watcher() i=6 2024-09-18T01:25:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.057+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94699046858208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5620d70c1060 con 0x7f89fc075060 2024-09-18T01:25:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94699046858208] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0400a4a0 con 0x7f89fc075060 2024-09-18T01:25:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 20 remove_watcher() i=7 2024-09-18T01:25:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f89fc075060 msgr2=0x7f89fc02c5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f89fc075060 0x7f89fc02c5d0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5620d70b3a60 msgr2=0x5620d70b5f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5620d70b3a60 0x5620d70b5f20 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5620d70b8450 msgr2=0x5620d70ba840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5620d70b8450 0x5620d70ba840 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5620d70bcde0 msgr2=0x5620d70bf2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5620d70bcde0 0x5620d70bf2a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88d4036b90 msgr2=0x7f88d4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88d4036b90 0x7f88d4039050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f89f4051990 tx=0x7f89f406d040 comp rx=0 tx=0).stop 2024-09-18T01:25:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d70a1060 msgr2=0x5620d70a83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/611616237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d70a1060 0x5620d70a83a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f89fc05d040 tx=0x7f89fc02c200 comp rx=0 tx=0).stop 2024-09-18T01:25:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 reap_dead start 2024-09-18T01:25:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0ba81640 1 -- 172.21.15.100:0/611616237 reap_dead start 2024-09-18T01:25:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 shutdown_connections 2024-09-18T01:25:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 >> 172.21.15.100:0/611616237 conn(0x5620d709d410 msgr2=0x5620d709b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 shutdown_connections 2024-09-18T01:25:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.058+0000 7f8a0f52d800 1 -- 172.21.15.100:0/611616237 wait complete. 2024-09-18T01:25:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/2029925792 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88e4036b40 msgr2=0x7f88e4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/2029925792 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88e4036b40 0x7f88e4039000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5620d707e3e0 tx=0x7f89f4005ac0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/2029925792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7094610 msgr2=0x5620d7094a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/2029925792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7094610 0x5620d7094a30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f89fc01dfb0 tx=0x7f89fc01d820 comp rx=0 tx=0).stop 2024-09-18T01:25:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/2029925792 shutdown_connections 2024-09-18T01:25:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/2029925792 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88e4036b40 0x7f88e4039000 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/2029925792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7094610 0x5620d7094a30 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/2029925792 >> 172.21.15.100:0/2029925792 conn(0x5620d70895a0 msgr2=0x5620d708c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/2029925792 shutdown_connections 2024-09-18T01:25:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/2029925792 wait complete. 2024-09-18T01:25:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5620d7083d70 msgr2=0x5620d7086160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5620d7083d70 0x5620d7086160 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5620d6f83d40 msgr2=0x5620d707d560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5620d6f83d40 0x5620d707d560 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5620d707fe30 msgr2=0x5620d7082220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5620d707fe30 0x5620d7082220 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88f0036b40 msgr2=0x7f88f0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f88f0036b40 0x7f88f0039000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f89f4057000 tx=0x7f89f4052000 comp rx=0 tx=0).stop 2024-09-18T01:25:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6ef1610 msgr2=0x5620d70764f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 --2- 172.21.15.100:0/3861805884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d6ef1610 0x5620d70764f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f89fc004000 tx=0x7f89fc000bc0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0ba81640 1 -- 172.21.15.100:0/3861805884 reap_dead start 2024-09-18T01:25:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 shutdown_connections 2024-09-18T01:25:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 >> 172.21.15.100:0/3861805884 conn(0x5620d6f77db0 msgr2=0x5620d7068d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 shutdown_connections 2024-09-18T01:25:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.059+0000 7f8a0f52d800 1 -- 172.21.15.100:0/3861805884 wait complete. 2024-09-18T01:25:50.070 INFO:teuthology.orchestra.run.smithi100.stdout:fooFoofooFooFULL_CONTROL 2024-09-18T01:25:50.070 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-18T01:25:50.072 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-18T01:25:50.077 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:50.077 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-18T01:25:50.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-18T01:25:50.078 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-18T01:25:50.123 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:50.123 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:50.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.122+0000 7f0defe0f800 1 Processor -- start 2024-09-18T01:25:50.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.122+0000 7f0defe0f800 1 -- start start 2024-09-18T01:25:50.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.122+0000 7f0defe0f800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55be230b2d90 0x55be23142280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.122+0000 7f0defe0f800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55be22ffeb30 con 0x55be231427c0 2024-09-18T01:25:50.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.122+0000 7f0defe0f800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55be22fe0360 con 0x55be230b2d90 2024-09-18T01:25:50.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.123+0000 7f0deb4e7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55be230b2d90 0x55be23142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.123+0000 7f0de3fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55be231427c0 0x55be23144bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:43728/0 (socket says 172.21.15.100:43728) 2024-09-18T01:25:50.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.123+0000 7f0de3fff640 1 -- 172.21.15.100:0/253074601 learned_addr learned my addr 172.21.15.100:0/253074601 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:50.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.123+0000 7f0deb4e7640 1 -- 172.21.15.100:0/253074601 >> v1:172.21.15.92:6789/0 conn(0x55be231427c0 legacy=0x55be23144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.123+0000 7f0deace6640 1 -- 172.21.15.100:0/253074601 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3973340544 0 0) 0x55be22ffeb30 con 0x55be231427c0 2024-09-18T01:25:50.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.123+0000 7f0deb4e7640 1 -- 172.21.15.100:0/253074601 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be23006e00 con 0x55be230b2d90 2024-09-18T01:25:50.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.125+0000 7f0deb4e7640 1 --2- 172.21.15.100:0/253074601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 0x55be23142280 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00a470 tx=0x7f0ddc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e14cb7eb626eb59 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.125+0000 7f0deace6640 1 -- 172.21.15.100:0/253074601 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc053570 con 0x55be230b2d90 2024-09-18T01:25:50.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.125+0000 7f0deace6640 1 -- 172.21.15.100:0/253074601 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ddc058070 con 0x55be230b2d90 2024-09-18T01:25:50.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.125+0000 7f0deace6640 1 -- 172.21.15.100:0/253074601 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc053880 con 0x55be230b2d90 2024-09-18T01:25:50.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.126+0000 7f0defe0f800 1 -- 172.21.15.100:0/253074601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 msgr2=0x55be23142280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.126+0000 7f0defe0f800 1 --2- 172.21.15.100:0/253074601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 0x55be23142280 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00a470 tx=0x7f0ddc045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.126+0000 7f0defe0f800 1 -- 172.21.15.100:0/253074601 shutdown_connections 2024-09-18T01:25:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.126+0000 7f0defe0f800 1 --2- 172.21.15.100:0/253074601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 0x55be23142280 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.126+0000 7f0defe0f800 1 -- 172.21.15.100:0/253074601 >> 172.21.15.100:0/253074601 conn(0x55be23139dd0 msgr2=0x55be2313c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.126+0000 7f0defe0f800 1 -- 172.21.15.100:0/253074601 shutdown_connections 2024-09-18T01:25:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.126+0000 7f0defe0f800 1 -- 172.21.15.100:0/253074601 wait complete. 2024-09-18T01:25:50.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.139+0000 7f0defe0f800 1 Processor -- start 2024-09-18T01:25:50.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.140+0000 7f0defe0f800 1 -- start start 2024-09-18T01:25:50.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.140+0000 7f0defe0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 0x55be2313fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.140+0000 7f0defe0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55be2308b360 con 0x55be230b2d90 2024-09-18T01:25:50.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.140+0000 7f0deb4e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 0x55be2313fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.140+0000 7f0deb4e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 0x55be2313fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52576/0 (socket says 172.21.15.100:52576) 2024-09-18T01:25:50.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.140+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1920607468 learned_addr learned my addr 172.21.15.100:0/1920607468 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.140+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1920607468 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be22fd8bc0 con 0x55be230b2d90 2024-09-18T01:25:50.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.140+0000 7f0deb4e7640 1 --2- 172.21.15.100:0/1920607468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 0x55be2313fbb0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc025c20 tx=0x7f0ddc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b3d9e7267e8595 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.141+0000 7f0cd960a640 1 -- 172.21.15.100:0/1920607468 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc053440 con 0x55be230b2d90 2024-09-18T01:25:50.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.141+0000 7f0cd960a640 1 -- 172.21.15.100:0/1920607468 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ddc063070 con 0x55be230b2d90 2024-09-18T01:25:50.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.141+0000 7f0cd960a640 1 -- 172.21.15.100:0/1920607468 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc053730 con 0x55be230b2d90 2024-09-18T01:25:50.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.142+0000 7f0defe0f800 1 -- 172.21.15.100:0/1920607468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 msgr2=0x55be2313fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.142+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1920607468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 0x55be2313fbb0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc025c20 tx=0x7f0ddc051000 comp rx=0 tx=0).stop 2024-09-18T01:25:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.142+0000 7f0defe0f800 1 -- 172.21.15.100:0/1920607468 shutdown_connections 2024-09-18T01:25:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.142+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1920607468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 0x55be2313fbb0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.142+0000 7f0defe0f800 1 -- 172.21.15.100:0/1920607468 >> 172.21.15.100:0/1920607468 conn(0x55be23139dd0 msgr2=0x55be2322a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.142+0000 7f0defe0f800 1 -- 172.21.15.100:0/1920607468 shutdown_connections 2024-09-18T01:25:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.142+0000 7f0defe0f800 1 -- 172.21.15.100:0/1920607468 wait complete. 2024-09-18T01:25:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.142+0000 7f0defe0f800 1 Processor -- start 2024-09-18T01:25:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.142+0000 7f0defe0f800 1 -- start start 2024-09-18T01:25:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.142+0000 7f0defe0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 0x55be232382b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.142+0000 7f0defe0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55be23146660 con 0x55be230b2d90 2024-09-18T01:25:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.143+0000 7f0deb4e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 0x55be232382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.143+0000 7f0deb4e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 0x55be232382b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52580/0 (socket says 172.21.15.100:52580) 2024-09-18T01:25:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.143+0000 7f0deb4e7640 1 -- 172.21.15.100:0/3009721962 learned_addr learned my addr 172.21.15.100:0/3009721962 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.143+0000 7f0deb4e7640 1 -- 172.21.15.100:0/3009721962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be22fecfe0 con 0x55be230b2d90 2024-09-18T01:25:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.143+0000 7f0deb4e7640 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 0x55be232382b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00a470 tx=0x7f0ddc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.143+0000 7f0cd7e07640 1 -- 172.21.15.100:0/3009721962 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc068470 con 0x55be230b2d90 2024-09-18T01:25:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.143+0000 7f0cd7e07640 1 -- 172.21.15.100:0/3009721962 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ddc068610 con 0x55be230b2d90 2024-09-18T01:25:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.143+0000 7f0cd7e07640 1 -- 172.21.15.100:0/3009721962 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc0688f0 con 0x55be230b2d90 2024-09-18T01:25:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.143+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be232387f0 con 0x55be230b2d90 2024-09-18T01:25:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.143+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be23238cb0 con 0x55be230b2d90 2024-09-18T01:25:50.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.144+0000 7f0cd7e07640 1 -- 172.21.15.100:0/3009721962 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0ddc07a060 con 0x55be230b2d90 2024-09-18T01:25:50.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.144+0000 7f0cd7e07640 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cd0036b40 0x7f0cd0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.144+0000 7f0cd7e07640 1 -- 172.21.15.100:0/3009721962 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f0ddc090cd0 con 0x55be230b2d90 2024-09-18T01:25:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.144+0000 7f0de3fff640 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cd0036b40 0x7f0cd0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.144+0000 7f0defe0f800 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55be231427c0 0x55be2323f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.144+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be2323f840 con 0x55be231427c0 2024-09-18T01:25:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.145+0000 7f0debce8640 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55be231427c0 0x55be2323f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.145+0000 7f0de3fff640 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cd0036b40 0x7f0cd0039000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4000c00 tx=0x7f0dd40013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.145+0000 7f0debce8640 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55be231427c0 0x55be2323f250 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.145+0000 7f0debce8640 1 -- 172.21.15.100:0/3009721962 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be231427c0 2024-09-18T01:25:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.145+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be2323c8d0 con 0x55be231427c0 2024-09-18T01:25:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.145+0000 7f0debce8640 1 -- 172.21.15.100:0/3009721962 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be231427c0 2024-09-18T01:25:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.145+0000 7f0defe0f800 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55be23241b40 0x55be23243f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.145+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be23244600 con 0x55be23241b40 2024-09-18T01:25:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.146+0000 7f0deb4e7640 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55be23241b40 0x55be23243f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.146+0000 7f0deb4e7640 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55be23241b40 0x55be23243f30 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.146+0000 7f0deb4e7640 1 -- 172.21.15.100:0/3009721962 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0ddc051070 con 0x55be23241b40 2024-09-18T01:25:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.146+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be23240920 con 0x55be231427c0 2024-09-18T01:25:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.146+0000 7f0debce8640 1 -- 172.21.15.100:0/3009721962 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be231427c0 2024-09-18T01:25:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.146+0000 7f0defe0f800 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55be23245a40 0x55be23247e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.146+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be23248490 con 0x55be23245a40 2024-09-18T01:25:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.147+0000 7f0de3fff640 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55be23245a40 0x55be23247e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.147+0000 7f0de3fff640 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55be23245a40 0x55be23247e30 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.147+0000 7f0de3fff640 1 -- 172.21.15.100:0/3009721962 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0dd400f670 con 0x55be23245a40 2024-09-18T01:25:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.148+0000 7f0defe0f800 1 Processor -- start 2024-09-18T01:25:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.148+0000 7f0defe0f800 1 -- start start 2024-09-18T01:25:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.148+0000 7f0defe0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be23256240 0x55be23256660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.148+0000 7f0defe0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55be22fda580 con 0x55be23256240 2024-09-18T01:25:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.148+0000 7f0deb4e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be23256240 0x55be23256660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.148+0000 7f0deb4e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be23256240 0x55be23256660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52586/0 (socket says 172.21.15.100:52586) 2024-09-18T01:25:50.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.148+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1700927881 learned_addr learned my addr 172.21.15.100:0/1700927881 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.149+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1700927881 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be23256ba0 con 0x55be23256240 2024-09-18T01:25:50.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.149+0000 7f0deb4e7640 1 --2- 172.21.15.100:0/1700927881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be23256240 0x55be23256660 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc08efb0 tx=0x7f0ddc07cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.149+0000 7f0cd5602640 1 -- 172.21.15.100:0/1700927881 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc074cc0 con 0x55be23256240 2024-09-18T01:25:50.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.149+0000 7f0cd5602640 1 -- 172.21.15.100:0/1700927881 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ddc074e60 con 0x55be23256240 2024-09-18T01:25:50.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.149+0000 7f0cd5602640 1 -- 172.21.15.100:0/1700927881 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc068ae0 con 0x55be23256240 2024-09-18T01:25:50.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.149+0000 7f0defe0f800 1 -- 172.21.15.100:0/1700927881 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be23256dd0 con 0x55be23256240 2024-09-18T01:25:50.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.149+0000 7f0defe0f800 1 -- 172.21.15.100:0/1700927881 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be23256dd0 con 0x55be23256240 2024-09-18T01:25:50.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.150+0000 7f0cd5602640 1 -- 172.21.15.100:0/1700927881 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0ddc068c80 con 0x55be23256240 2024-09-18T01:25:50.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.150+0000 7f0cd5602640 1 --2- 172.21.15.100:0/1700927881 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cc4036b40 0x7f0cc4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.150+0000 7f0cd5602640 1 -- 172.21.15.100:0/1700927881 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f0ddc08b030 con 0x55be23256240 2024-09-18T01:25:50.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.150+0000 7f0de3fff640 1 --2- 172.21.15.100:0/1700927881 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cc4036b40 0x7f0cc4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.150+0000 7f0defe0f800 1 Processor -- start 2024-09-18T01:25:50.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.150+0000 7f0de3fff640 1 --2- 172.21.15.100:0/1700927881 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cc4036b40 0x7f0cc4039000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55be2323fce0 tx=0x7f0dd4006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.150+0000 7f0defe0f800 1 -- start start 2024-09-18T01:25:50.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.150+0000 7f0defe0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be232629b0 0x55be23262db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.150+0000 7f0defe0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55be2313e220 con 0x55be232629b0 2024-09-18T01:25:50.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.151+0000 7f0deb4e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be232629b0 0x55be23262db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.151+0000 7f0deb4e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be232629b0 0x55be23262db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52588/0 (socket says 172.21.15.100:52588) 2024-09-18T01:25:50.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.151+0000 7f0deb4e7640 1 -- 172.21.15.100:0/2142043897 learned_addr learned my addr 172.21.15.100:0/2142043897 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.151+0000 7f0deb4e7640 1 -- 172.21.15.100:0/2142043897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be23263380 con 0x55be232629b0 2024-09-18T01:25:50.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.151+0000 7f0deb4e7640 1 --2- 172.21.15.100:0/2142043897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be232629b0 0x55be23262db0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc05c720 tx=0x7f0ddc05d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1d86c79c83676f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.151+0000 7f0cceffd640 1 -- 172.21.15.100:0/2142043897 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc04dde0 con 0x55be232629b0 2024-09-18T01:25:50.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.151+0000 7f0cceffd640 1 -- 172.21.15.100:0/2142043897 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ddc0ac070 con 0x55be232629b0 2024-09-18T01:25:50.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.151+0000 7f0cceffd640 1 -- 172.21.15.100:0/2142043897 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc072500 con 0x55be232629b0 2024-09-18T01:25:50.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.152+0000 7f0defe0f800 1 -- 172.21.15.100:0/2142043897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be232629b0 msgr2=0x55be23262db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.152+0000 7f0defe0f800 1 --2- 172.21.15.100:0/2142043897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be232629b0 0x55be23262db0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc05c720 tx=0x7f0ddc05d6b0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.152+0000 7f0defe0f800 1 -- 172.21.15.100:0/2142043897 shutdown_connections 2024-09-18T01:25:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.152+0000 7f0defe0f800 1 --2- 172.21.15.100:0/2142043897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be232629b0 0x55be23262db0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.152+0000 7f0defe0f800 1 -- 172.21.15.100:0/2142043897 >> 172.21.15.100:0/2142043897 conn(0x55be2325ed60 msgr2=0x55be2325ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.152+0000 7f0defe0f800 1 -- 172.21.15.100:0/2142043897 shutdown_connections 2024-09-18T01:25:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.152+0000 7f0defe0f800 1 -- 172.21.15.100:0/2142043897 wait complete. 2024-09-18T01:25:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.152+0000 7f0defe0f800 1 Processor -- start 2024-09-18T01:25:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.152+0000 7f0defe0f800 1 -- start start 2024-09-18T01:25:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.152+0000 7f0defe0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be232629b0 0x55be23269c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.152+0000 7f0defe0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55be232637d0 con 0x55be232629b0 2024-09-18T01:25:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.152+0000 7f0deb4e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be232629b0 0x55be23269c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.152+0000 7f0deb4e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be232629b0 0x55be23269c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52604/0 (socket says 172.21.15.100:52604) 2024-09-18T01:25:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.152+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 learned_addr learned my addr 172.21.15.100:0/1367798959 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.153+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be2326a1b0 con 0x55be232629b0 2024-09-18T01:25:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.153+0000 7f0deb4e7640 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be232629b0 0x55be23269c70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc08d420 tx=0x7f0ddc07af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.153+0000 7f0ccd7fa640 1 -- 172.21.15.100:0/1367798959 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc04d700 con 0x55be232629b0 2024-09-18T01:25:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.153+0000 7f0ccd7fa640 1 -- 172.21.15.100:0/1367798959 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ddc083660 con 0x55be232629b0 2024-09-18T01:25:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.153+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be2326a1b0 con 0x55be232629b0 2024-09-18T01:25:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.153+0000 7f0ccd7fa640 1 -- 172.21.15.100:0/1367798959 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc083940 con 0x55be232629b0 2024-09-18T01:25:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.153+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be2326a1b0 con 0x55be232629b0 2024-09-18T01:25:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.154+0000 7f0ccd7fa640 1 -- 172.21.15.100:0/1367798959 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0ddc0a6070 con 0x55be232629b0 2024-09-18T01:25:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.154+0000 7f0ccd7fa640 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cb4036af0 0x7f0cb4038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.154+0000 7f0ccd7fa640 1 -- 172.21.15.100:0/1367798959 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f0ddc0bcd40 con 0x55be232629b0 2024-09-18T01:25:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.154+0000 7f0de3fff640 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cb4036af0 0x7f0cb4038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.155+0000 7f0de3fff640 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cb4036af0 0x7f0cb4038fb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400ffd0 tx=0x7f0dd4023040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.155+0000 7f0defe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.155+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55be232753f0 0x55be232778b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.155+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be23278000 con 0x55be232753f0 2024-09-18T01:25:50.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.155+0000 7f0debce8640 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55be232753f0 0x55be232778b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.155+0000 7f0debce8640 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55be232753f0 0x55be232778b0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 20 realm 2024-09-18T01:25:50.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be23278410 con 0x55be232753f0 2024-09-18T01:25:50.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:50.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be23278ce0 con 0x55be232753f0 2024-09-18T01:25:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be232753f0 2024-09-18T01:25:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55be23279de0 0x55be2327c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be2327c790 con 0x55be23279de0 2024-09-18T01:25:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.156+0000 7f0deb4e7640 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55be23279de0 0x55be2327c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.157+0000 7f0deb4e7640 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55be23279de0 0x55be2327c1d0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.157+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.157+0000 7f0defe0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:50.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.157+0000 7f0defe0f800 20 searching for the correct realm 2024-09-18T01:25:50.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.157+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55be2327e740 0x55be23280c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.157+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be232812d0 con 0x55be2327e740 2024-09-18T01:25:50.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.157+0000 7f0de3fff640 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55be2327e740 0x55be23280c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.157+0000 7f0de3fff640 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55be2327e740 0x55be23280c00 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.158+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd4037040 con 0x55be2327e740 2024-09-18T01:25:50.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.158+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be232812d0 con 0x55be23279de0 2024-09-18T01:25:50.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.158+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.158+0000 7f0deb4e7640 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0ddc07c070 0x7f0ddc07a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.158+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be232812d0 con 0x7f0ddc07c070 2024-09-18T01:25:50.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.158+0000 7f0debce8640 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0ddc07c070 0x7f0ddc07a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.158+0000 7f0debce8640 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0ddc07c070 0x7f0ddc07a6e0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.159+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.159+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be232753f0 2024-09-18T01:25:50.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.159+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.159+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be232753f0 2024-09-18T01:25:50.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.159+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.159+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x7f0ddc07c070 2024-09-18T01:25:50.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.160+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.160+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x7f0ddc07c070 2024-09-18T01:25:50.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.160+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.160+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be23279de0 2024-09-18T01:25:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.160+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.160+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be2327e740 2024-09-18T01:25:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.160+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd4037040 con 0x55be2327e740 2024-09-18T01:25:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.160+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be232753f0 2024-09-18T01:25:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.161+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.161+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be23279de0 2024-09-18T01:25:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.161+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.161+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be232753f0 2024-09-18T01:25:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.161+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.161+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be23279de0 2024-09-18T01:25:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.161+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.161+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be2327e740 2024-09-18T01:25:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.162+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd4037040 con 0x55be2327e740 2024-09-18T01:25:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.162+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be2327e740 2024-09-18T01:25:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.162+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd4037040 con 0x55be2327e740 2024-09-18T01:25:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.162+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x7f0ddc07c070 2024-09-18T01:25:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.162+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.162+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be2327e740 2024-09-18T01:25:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.162+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd4037040 con 0x55be2327e740 2024-09-18T01:25:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.162+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be2327e740 2024-09-18T01:25:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.163+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd4037040 con 0x55be2327e740 2024-09-18T01:25:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.163+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be232753f0 2024-09-18T01:25:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.163+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.163+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be232753f0 2024-09-18T01:25:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.163+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.163+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x7f0ddc07c070 2024-09-18T01:25:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.163+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.163+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be2327e740 2024-09-18T01:25:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.164+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd4037040 con 0x55be2327e740 2024-09-18T01:25:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.164+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be23279de0 2024-09-18T01:25:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.164+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.164+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be232753f0 2024-09-18T01:25:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.164+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.164+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x7f0ddc07c070 2024-09-18T01:25:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.165+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.165+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be2327e740 2024-09-18T01:25:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.165+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd4037040 con 0x55be2327e740 2024-09-18T01:25:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.165+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be23279de0 2024-09-18T01:25:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.165+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.165+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be23279de0 2024-09-18T01:25:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.165+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.165+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be2327e740 2024-09-18T01:25:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.165+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd4037040 con 0x55be2327e740 2024-09-18T01:25:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.165+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x7f0ddc07c070 2024-09-18T01:25:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be232753f0 2024-09-18T01:25:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be23279080 con 0x55be23279de0 2024-09-18T01:25:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0defe0f800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0defe0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0defe0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0defe0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0defe0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0defe0f800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0defe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be2327d050 con 0x55be232753f0 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0defe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0defe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.166+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be2327d440 con 0x55be232753f0 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be2327d440 con 0x7f0ddc07c070 2024-09-18T01:25:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 20 zone default found 2024-09-18T01:25:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 4 Realm: () 2024-09-18T01:25:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 20 zonegroup default 2024-09-18T01:25:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be23281750 con 0x7f0ddc07c070 2024-09-18T01:25:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.167+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be23283130 con 0x55be2327e740 2024-09-18T01:25:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.168+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0dd4037040 con 0x55be2327e740 2024-09-18T01:25:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.168+0000 7f0defe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.168+0000 7f0defe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.168+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be232834d0 con 0x55be2327e740 2024-09-18T01:25:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.168+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0dd4037040 con 0x55be2327e740 2024-09-18T01:25:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.168+0000 7f0defe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.168+0000 7f0defe0f800 20 started sync module instance, tier type = 2024-09-18T01:25:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.168+0000 7f0defe0f800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.168+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be232825d0 con 0x55be23279de0 2024-09-18T01:25:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.169+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.169+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94275121981888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23283d20 con 0x55be23279de0 2024-09-18T01:25:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.169+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23284570 con 0x55be232753f0 2024-09-18T01:25:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.170+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94275121981888] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.171+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.171+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94275121985648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be232841a0 con 0x55be232753f0 2024-09-18T01:25:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.171+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23284cb0 con 0x55be2327e740 2024-09-18T01:25:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.172+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94275121985648] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.172+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd4037040 con 0x55be2327e740 2024-09-18T01:25:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.172+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94275121989472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be232850a0 con 0x55be2327e740 2024-09-18T01:25:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.172+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23285b00 con 0x55be23279de0 2024-09-18T01:25:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.173+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.173+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94275121993184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be232863a0 con 0x55be23279de0 2024-09-18T01:25:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.173+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23286e80 con 0x55be232753f0 2024-09-18T01:25:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.173+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94275121989472] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd4037040 con 0x55be2327e740 2024-09-18T01:25:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.174+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94275121993184] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.174+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.174+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94275121998224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23285ef0 con 0x55be232753f0 2024-09-18T01:25:50.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.174+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23287720 con 0x7f0ddc07c070 2024-09-18T01:25:50.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.175+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.175+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94275122000352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23287ab0 con 0x7f0ddc07c070 2024-09-18T01:25:50.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.175+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23288300 con 0x7f0ddc07c070 2024-09-18T01:25:50.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.175+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94275121998224] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.177+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94275122000352] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.177+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.177+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94275122001408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23287ed0 con 0x7f0ddc07c070 2024-09-18T01:25:50.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.177+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23288720 con 0x7f0ddc07c070 2024-09-18T01:25:50.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.178+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(58 notify.7 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.178+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94275122001408] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.178+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94275122004144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23288980 con 0x7f0ddc07c070 2024-09-18T01:25:50.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.178+0000 7f0defe0f800 20 add_watcher() i=0 2024-09-18T01:25:50.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.178+0000 7f0defe0f800 20 add_watcher() i=1 2024-09-18T01:25:50.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.178+0000 7f0defe0f800 20 add_watcher() i=2 2024-09-18T01:25:50.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.178+0000 7f0defe0f800 20 add_watcher() i=3 2024-09-18T01:25:50.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.178+0000 7f0defe0f800 20 add_watcher() i=4 2024-09-18T01:25:50.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.178+0000 7f0defe0f800 20 add_watcher() i=5 2024-09-18T01:25:50.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.178+0000 7f0defe0f800 20 add_watcher() i=6 2024-09-18T01:25:50.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.179+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94275122004144] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.179+0000 7f0defe0f800 20 add_watcher() i=7 2024-09-18T01:25:50.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.179+0000 7f0defe0f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:50.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.179+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be2328bab0 con 0x55be232753f0 2024-09-18T01:25:50.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.179+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.179+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94275122005200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23288da0 con 0x55be232753f0 2024-09-18T01:25:50.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.180+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94275122005200] v35'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.180+0000 7f0ca1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:50.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.180+0000 7f0defe0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:50.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.180+0000 7f0defe0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:50.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0defe0f800 5 note: GC not initialized 2024-09-18T01:25:50.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0ca0fe1640 20 reqs_thread_entry: start 2024-09-18T01:25:50.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0defe0f800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:50.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0defe0f800 20 Filter name: none 2024-09-18T01:25:50.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0c1a7fc640 20 reqs_thread_entry: start 2024-09-18T01:25:50.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0defe0f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:25:50.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0defe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be232bf470 con 0x55be23279de0 2024-09-18T01:25:50.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0defe0f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:50.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0defe0f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:25:50.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0defe0f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0defe0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 : miss 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0defe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.181+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.8 8:159c71d7:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be232c1030 con 0x55be232753f0 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.182+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(63 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.182+0000 7f0defe0f800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.182+0000 7f0defe0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 info.flags=0x17 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.182+0000 7f0defe0f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 to cache LRU end 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.182+0000 7f0defe0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.182+0000 7f0defe0f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.182+0000 7f0defe0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.182+0000 7f0defe0f800 20 get_obj_state: octx=0x7f0ddc062f50 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55be232c36f8 s->prefetch_data=0 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.182+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 3.10s0 3:0b134fe9:::153b7754-209b-4898-8796-577da7c1273d.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be232c47e0 con 0x55be232753f0 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.182+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 153b7754-209b-4898-8796-577da7c1273d.4237.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.182+0000 7f0defe0f800 10 manifest: total_size = 5 2024-09-18T01:25:50.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.182+0000 7f0defe0f800 20 get_obj_state: setting s->obj_tag to _f1D3sTt2lwAiAqC7NsgEwh9u0S6yqpa 2024-09-18T01:25:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.183+0000 7f0ca1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.183+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94275122005200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be232c47e0 con 0x55be232753f0 2024-09-18T01:25:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.184+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94275122005200] v35'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.184+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94275121981888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be232c47e0 con 0x55be23279de0 2024-09-18T01:25:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.185+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94275121981888] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.185+0000 7f0defe0f800 20 remove_watcher() i=0 2024-09-18T01:25:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.185+0000 7f0defe0f800 2 removed watcher, disabling cache 2024-09-18T01:25:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.185+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94275121985648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be232c47e0 con 0x55be232753f0 2024-09-18T01:25:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.186+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94275121985648] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.186+0000 7f0defe0f800 20 remove_watcher() i=1 2024-09-18T01:25:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.187+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94275121989472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be232c47e0 con 0x55be2327e740 2024-09-18T01:25:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.188+0000 7f0de3fff640 1 -- 172.21.15.100:0/1367798959 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94275121989472] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd4037040 con 0x55be2327e740 2024-09-18T01:25:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.188+0000 7f0defe0f800 20 remove_watcher() i=2 2024-09-18T01:25:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.188+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94275121993184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be232884d0 con 0x55be23279de0 2024-09-18T01:25:50.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.189+0000 7f0deb4e7640 1 -- 172.21.15.100:0/1367798959 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94275121993184] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ddc0c1020 con 0x55be23279de0 2024-09-18T01:25:50.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.189+0000 7f0defe0f800 20 remove_watcher() i=3 2024-09-18T01:25:50.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.189+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94275121998224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be232829c0 con 0x55be232753f0 2024-09-18T01:25:50.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.190+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94275121998224] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x55be232753f0 2024-09-18T01:25:50.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.190+0000 7f0defe0f800 20 remove_watcher() i=4 2024-09-18T01:25:50.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.190+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94275122000352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23283870 con 0x7f0ddc07c070 2024-09-18T01:25:50.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.191+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94275122000352] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.191+0000 7f0defe0f800 20 remove_watcher() i=5 2024-09-18T01:25:50.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.191+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94275122001408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be23284760 con 0x7f0ddc07c070 2024-09-18T01:25:50.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.192+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94275122001408] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.192+0000 7f0defe0f800 20 remove_watcher() i=6 2024-09-18T01:25:50.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.192+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94275122004144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be232855e0 con 0x7f0ddc07c070 2024-09-18T01:25:50.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.193+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94275122004144] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de400a4a0 con 0x7f0ddc07c070 2024-09-18T01:25:50.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.193+0000 7f0defe0f800 20 remove_watcher() i=7 2024-09-18T01:25:50.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0ddc07c070 msgr2=0x7f0ddc07a6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0ddc07c070 0x7f0ddc07a6e0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55be232753f0 msgr2=0x55be232778b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55be232753f0 0x55be232778b0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55be23279de0 msgr2=0x55be2327c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55be23279de0 0x55be2327c1d0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55be2327e740 msgr2=0x55be23280c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55be2327e740 0x55be23280c00 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cb4036af0 msgr2=0x7f0cb4038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cb4036af0 0x7f0cb4038fb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400ffd0 tx=0x7f0dd4023040 comp rx=0 tx=0).stop 2024-09-18T01:25:50.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be232629b0 msgr2=0x55be23269c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1367798959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be232629b0 0x55be23269c70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc08d420 tx=0x7f0ddc07af30 comp rx=0 tx=0).stop 2024-09-18T01:25:50.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 reap_dead start 2024-09-18T01:25:50.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0debce8640 1 -- 172.21.15.100:0/1367798959 reap_dead start 2024-09-18T01:25:50.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 shutdown_connections 2024-09-18T01:25:50.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 >> 172.21.15.100:0/1367798959 conn(0x55be2325ed60 msgr2=0x55be2325ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 shutdown_connections 2024-09-18T01:25:50.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1367798959 wait complete. 2024-09-18T01:25:50.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1700927881 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cc4036b40 msgr2=0x7f0cc4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1700927881 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cc4036b40 0x7f0cc4039000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55be2323fce0 tx=0x7f0dd4006000 comp rx=0 tx=0).stop 2024-09-18T01:25:50.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1700927881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be23256240 msgr2=0x55be23256660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1700927881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be23256240 0x55be23256660 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc08efb0 tx=0x7f0ddc07cad0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1700927881 shutdown_connections 2024-09-18T01:25:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1700927881 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cc4036b40 0x7f0cc4039000 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 --2- 172.21.15.100:0/1700927881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be23256240 0x55be23256660 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1700927881 >> 172.21.15.100:0/1700927881 conn(0x55be2324b1d0 msgr2=0x55be2324dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1700927881 shutdown_connections 2024-09-18T01:25:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.194+0000 7f0defe0f800 1 -- 172.21.15.100:0/1700927881 wait complete. 2024-09-18T01:25:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55be23245a40 msgr2=0x55be23247e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0defe0f800 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55be23245a40 0x55be23247e30 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55be231427c0 msgr2=0x55be2323f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0defe0f800 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55be231427c0 0x55be2323f250 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55be23241b40 msgr2=0x55be23243f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0defe0f800 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55be23241b40 0x55be23243f30 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cd0036b40 msgr2=0x7f0cd0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0defe0f800 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cd0036b40 0x7f0cd0039000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4000c00 tx=0x7f0dd40013b0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 msgr2=0x55be232382b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0defe0f800 1 --2- 172.21.15.100:0/3009721962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be230b2d90 0x55be232382b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00a470 tx=0x7f0ddc002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0debce8640 1 -- 172.21.15.100:0/3009721962 reap_dead start 2024-09-18T01:25:50.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 shutdown_connections 2024-09-18T01:25:50.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 >> 172.21.15.100:0/3009721962 conn(0x55be23139dd0 msgr2=0x55be23229c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 shutdown_connections 2024-09-18T01:25:50.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.195+0000 7f0defe0f800 1 -- 172.21.15.100:0/3009721962 wait complete. 2024-09-18T01:25:50.204 INFO:teuthology.orchestra.run.smithi100.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-18T01:25:50.204 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-18T01:25:50.206 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-18T01:25:50.220 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:50.278 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-18T01:25:50.278 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-18T01:25:50.278 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-18T01:25:50.279 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-18T01:25:50.279 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-18T01:25:50.279 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-18T01:25:50.279 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-18T01:25:50.324 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:50.324 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:50.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.324+0000 7fc507a10800 1 Processor -- start 2024-09-18T01:25:50.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.324+0000 7fc507a10800 1 -- start start 2024-09-18T01:25:50.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.324+0000 7fc507a10800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55c5d6a9eeb0 0x55c5d6b2e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.324+0000 7fc507a10800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c5d69eab30 con 0x55c5d6b2e6a0 2024-09-18T01:25:50.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.324+0000 7fc507a10800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55c5d69cc360 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.324+0000 7fc5030c1640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55c5d6a9eeb0 0x55c5d6b2e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.324+0000 7fc5030c1640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55c5d6a9eeb0 0x55c5d6b2e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52618/0 (socket says 172.21.15.100:52618) 2024-09-18T01:25:50.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.324+0000 7fc4fbfff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55c5d6b2e6a0 0x55c5d6b30ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:43738/0 (socket says 172.21.15.100:43738) 2024-09-18T01:25:50.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.324+0000 7fc5030c1640 1 -- 172.21.15.100:0/1673477289 learned_addr learned my addr 172.21.15.100:0/1673477289 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.325+0000 7fc5030c1640 1 -- 172.21.15.100:0/1673477289 >> v1:172.21.15.92:6789/0 conn(0x55c5d6b2e6a0 legacy=0x55c5d6b30ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.325+0000 7fc5030c1640 1 -- 172.21.15.100:0/1673477289 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d69f2e00 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.326+0000 7fc5030c1640 1 --2- 172.21.15.100:0/1673477289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 0x55c5d6b2e160 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400a520 tx=0x7fc4f4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82668cf2abc726e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.327+0000 7fc5028c0640 1 -- 172.21.15.100:0/1673477289 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f4055070 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.327+0000 7fc5028c0640 1 -- 172.21.15.100:0/1673477289 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f40515b0 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.327+0000 7fc5028c0640 1 -- 172.21.15.100:0/1673477289 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f40518d0 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.327+0000 7fc507a10800 1 -- 172.21.15.100:0/1673477289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 msgr2=0x55c5d6b2e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.327+0000 7fc507a10800 1 --2- 172.21.15.100:0/1673477289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 0x55c5d6b2e160 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400a520 tx=0x7fc4f4045ba0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.327+0000 7fc507a10800 1 -- 172.21.15.100:0/1673477289 shutdown_connections 2024-09-18T01:25:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.327+0000 7fc507a10800 1 --2- 172.21.15.100:0/1673477289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 0x55c5d6b2e160 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.327+0000 7fc507a10800 1 -- 172.21.15.100:0/1673477289 >> 172.21.15.100:0/1673477289 conn(0x55c5d6b25dd0 msgr2=0x55c5d6b281f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.327+0000 7fc507a10800 1 -- 172.21.15.100:0/1673477289 shutdown_connections 2024-09-18T01:25:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.327+0000 7fc507a10800 1 -- 172.21.15.100:0/1673477289 wait complete. 2024-09-18T01:25:50.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.341+0000 7fc507a10800 1 Processor -- start 2024-09-18T01:25:50.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.341+0000 7fc507a10800 1 -- start start 2024-09-18T01:25:50.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.341+0000 7fc507a10800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 0x55c5d6b2ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.341+0000 7fc507a10800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c5d6a77360 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.341+0000 7fc5030c1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 0x55c5d6b2ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.341+0000 7fc5030c1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 0x55c5d6b2ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52630/0 (socket says 172.21.15.100:52630) 2024-09-18T01:25:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.341+0000 7fc5030c1640 1 -- 172.21.15.100:0/1255982682 learned_addr learned my addr 172.21.15.100:0/1255982682 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.342+0000 7fc5030c1640 1 -- 172.21.15.100:0/1255982682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d69c4bc0 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.342+0000 7fc5030c1640 1 --2- 172.21.15.100:0/1255982682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 0x55c5d6b2ba90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4025da0 tx=0x7fc4f4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867906b2cd6b9c93 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.342+0000 7fc3f160a640 1 -- 172.21.15.100:0/1255982682 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f4051890 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.342+0000 7fc3f160a640 1 -- 172.21.15.100:0/1255982682 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f4051ac0 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.342+0000 7fc3f160a640 1 -- 172.21.15.100:0/1255982682 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f4051da0 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.343+0000 7fc507a10800 1 -- 172.21.15.100:0/1255982682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 msgr2=0x55c5d6b2ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.343+0000 7fc507a10800 1 --2- 172.21.15.100:0/1255982682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 0x55c5d6b2ba90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4025da0 tx=0x7fc4f4051000 comp rx=0 tx=0).stop 2024-09-18T01:25:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.343+0000 7fc507a10800 1 -- 172.21.15.100:0/1255982682 shutdown_connections 2024-09-18T01:25:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.343+0000 7fc507a10800 1 --2- 172.21.15.100:0/1255982682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 0x55c5d6b2ba90 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.343+0000 7fc507a10800 1 -- 172.21.15.100:0/1255982682 >> 172.21.15.100:0/1255982682 conn(0x55c5d6b25dd0 msgr2=0x55c5d6c16270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.343+0000 7fc507a10800 1 -- 172.21.15.100:0/1255982682 shutdown_connections 2024-09-18T01:25:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.343+0000 7fc507a10800 1 -- 172.21.15.100:0/1255982682 wait complete. 2024-09-18T01:25:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.343+0000 7fc507a10800 1 Processor -- start 2024-09-18T01:25:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.343+0000 7fc507a10800 1 -- start start 2024-09-18T01:25:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.343+0000 7fc507a10800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 0x55c5d6c242b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.343+0000 7fc507a10800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c5d6b32610 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.343+0000 7fc5030c1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 0x55c5d6c242b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.343+0000 7fc5030c1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 0x55c5d6c242b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52644/0 (socket says 172.21.15.100:52644) 2024-09-18T01:25:50.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.343+0000 7fc5030c1640 1 -- 172.21.15.100:0/2895638268 learned_addr learned my addr 172.21.15.100:0/2895638268 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.344+0000 7fc5030c1640 1 -- 172.21.15.100:0/2895638268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d69d8fe0 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.344+0000 7fc5030c1640 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 0x55c5d6c242b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4025da0 tx=0x7fc4f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.344+0000 7fc3efe07640 1 -- 172.21.15.100:0/2895638268 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f4073070 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.344+0000 7fc3efe07640 1 -- 172.21.15.100:0/2895638268 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f405a450 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.344+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5d6c247f0 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.344+0000 7fc3efe07640 1 -- 172.21.15.100:0/2895638268 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f405a730 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.344+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5d6c24d70 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.345+0000 7fc3efe07640 1 -- 172.21.15.100:0/2895638268 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc4f4076070 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.345+0000 7fc3efe07640 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3e8036b40 0x7fc3e8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.345+0000 7fc3efe07640 1 -- 172.21.15.100:0/2895638268 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fc4f4062070 con 0x55c5d6a9eeb0 2024-09-18T01:25:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.345+0000 7fc4fbfff640 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3e8036b40 0x7fc3e8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.345+0000 7fc507a10800 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c5d6b2e6a0 0x55c5d6c2b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.346+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c2b8f0 con 0x55c5d6b2e6a0 2024-09-18T01:25:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.346+0000 7fc5038c2640 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c5d6b2e6a0 0x55c5d6c2b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.346+0000 7fc4fbfff640 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3e8036b40 0x7fc3e8039000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec000f60 tx=0x7fc4ec001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.346+0000 7fc5038c2640 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c5d6b2e6a0 0x55c5d6c2b320 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.346+0000 7fc5038c2640 1 -- 172.21.15.100:0/2895638268 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6b2e6a0 2024-09-18T01:25:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.346+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c288f0 con 0x55c5d6b2e6a0 2024-09-18T01:25:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.346+0000 7fc5038c2640 1 -- 172.21.15.100:0/2895638268 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6b2e6a0 2024-09-18T01:25:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.346+0000 7fc507a10800 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c5d6c2dc40 0x55c5d6c30030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.346+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c306d0 con 0x55c5d6c2dc40 2024-09-18T01:25:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.347+0000 7fc5030c1640 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c5d6c2dc40 0x55c5d6c30030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.347+0000 7fc5030c1640 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c5d6c2dc40 0x55c5d6c30030 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.347+0000 7fc5030c1640 1 -- 172.21.15.100:0/2895638268 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c2dc40 2024-09-18T01:25:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.347+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c2cab0 con 0x55c5d6b2e6a0 2024-09-18T01:25:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.347+0000 7fc5038c2640 1 -- 172.21.15.100:0/2895638268 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6b2e6a0 2024-09-18T01:25:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.348+0000 7fc507a10800 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55c5d6c31b30 0x55c5d6c33f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.348+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c34610 con 0x55c5d6c31b30 2024-09-18T01:25:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.348+0000 7fc4fbfff640 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55c5d6c31b30 0x55c5d6c33f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.348+0000 7fc4fbfff640 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55c5d6c31b30 0x55c5d6c33f20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.349+0000 7fc4fbfff640 1 -- 172.21.15.100:0/2895638268 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc4ec00f690 con 0x55c5d6c31b30 2024-09-18T01:25:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.349+0000 7fc507a10800 1 Processor -- start 2024-09-18T01:25:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.349+0000 7fc507a10800 1 -- start start 2024-09-18T01:25:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.349+0000 7fc507a10800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c42380 0x55c5d6c427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.349+0000 7fc507a10800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c5d69c6580 con 0x55c5d6c42380 2024-09-18T01:25:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.349+0000 7fc5030c1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c42380 0x55c5d6c427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.349+0000 7fc5030c1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c42380 0x55c5d6c427a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52646/0 (socket says 172.21.15.100:52646) 2024-09-18T01:25:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.349+0000 7fc5030c1640 1 -- 172.21.15.100:0/1876757824 learned_addr learned my addr 172.21.15.100:0/1876757824 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.350+0000 7fc5030c1640 1 -- 172.21.15.100:0/1876757824 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d6c42ce0 con 0x55c5d6c42380 2024-09-18T01:25:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.350+0000 7fc5030c1640 1 --2- 172.21.15.100:0/1876757824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c42380 0x55c5d6c427a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc4f408f580 tx=0x7fc4f4067f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.350+0000 7fc3ed602640 1 -- 172.21.15.100:0/1876757824 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f406e700 con 0x55c5d6c42380 2024-09-18T01:25:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.350+0000 7fc3ed602640 1 -- 172.21.15.100:0/1876757824 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f4065910 con 0x55c5d6c42380 2024-09-18T01:25:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.350+0000 7fc507a10800 1 -- 172.21.15.100:0/1876757824 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5d6c42f70 con 0x55c5d6c42380 2024-09-18T01:25:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.350+0000 7fc3ed602640 1 -- 172.21.15.100:0/1876757824 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f4065c10 con 0x55c5d6c42380 2024-09-18T01:25:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.350+0000 7fc507a10800 1 -- 172.21.15.100:0/1876757824 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5d6c45c50 con 0x55c5d6c42380 2024-09-18T01:25:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.351+0000 7fc3ed602640 1 -- 172.21.15.100:0/1876757824 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc4f4058070 con 0x55c5d6c42380 2024-09-18T01:25:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.351+0000 7fc3ed602640 1 --2- 172.21.15.100:0/1876757824 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3dc036b40 0x7fc3dc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.351+0000 7fc3ed602640 1 -- 172.21.15.100:0/1876757824 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fc4f4002000 con 0x55c5d6c42380 2024-09-18T01:25:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.351+0000 7fc4fbfff640 1 --2- 172.21.15.100:0/1876757824 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3dc036b40 0x7fc3dc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.351+0000 7fc507a10800 1 Processor -- start 2024-09-18T01:25:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.351+0000 7fc507a10800 1 -- start start 2024-09-18T01:25:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.351+0000 7fc4fbfff640 1 --2- 172.21.15.100:0/1876757824 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3dc036b40 0x7fc3dc039000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55c5d6c28810 tx=0x7fc4ec00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.352+0000 7fc507a10800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c4ee50 0x55c5d6c4f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.352+0000 7fc507a10800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c5d6b2a070 con 0x55c5d6c4ee50 2024-09-18T01:25:50.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.352+0000 7fc5030c1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c4ee50 0x55c5d6c4f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.352+0000 7fc5030c1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c4ee50 0x55c5d6c4f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52660/0 (socket says 172.21.15.100:52660) 2024-09-18T01:25:50.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.352+0000 7fc5030c1640 1 -- 172.21.15.100:0/2139607130 learned_addr learned my addr 172.21.15.100:0/2139607130 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.352+0000 7fc5030c1640 1 -- 172.21.15.100:0/2139607130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d6c4f820 con 0x55c5d6c4ee50 2024-09-18T01:25:50.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.352+0000 7fc5030c1640 1 --2- 172.21.15.100:0/2139607130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c4ee50 0x55c5d6c4f250 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc4f408ffd0 tx=0x7fc4f409ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84eeaab20e58c15a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.352+0000 7fc3e6ffd640 1 -- 172.21.15.100:0/2139607130 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f4063b60 con 0x55c5d6c4ee50 2024-09-18T01:25:50.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.352+0000 7fc3e6ffd640 1 -- 172.21.15.100:0/2139607130 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f40b1070 con 0x55c5d6c4ee50 2024-09-18T01:25:50.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.352+0000 7fc3e6ffd640 1 -- 172.21.15.100:0/2139607130 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f407b550 con 0x55c5d6c4ee50 2024-09-18T01:25:50.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.353+0000 7fc507a10800 1 -- 172.21.15.100:0/2139607130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c4ee50 msgr2=0x55c5d6c4f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.353+0000 7fc507a10800 1 --2- 172.21.15.100:0/2139607130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c4ee50 0x55c5d6c4f250 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc4f408ffd0 tx=0x7fc4f409ae40 comp rx=0 tx=0).stop 2024-09-18T01:25:50.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.353+0000 7fc507a10800 1 -- 172.21.15.100:0/2139607130 shutdown_connections 2024-09-18T01:25:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.353+0000 7fc507a10800 1 --2- 172.21.15.100:0/2139607130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c4ee50 0x55c5d6c4f250 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.353+0000 7fc507a10800 1 -- 172.21.15.100:0/2139607130 >> 172.21.15.100:0/2139607130 conn(0x55c5d6c4b200 msgr2=0x55c5d6c49300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.353+0000 7fc507a10800 1 -- 172.21.15.100:0/2139607130 shutdown_connections 2024-09-18T01:25:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.353+0000 7fc507a10800 1 -- 172.21.15.100:0/2139607130 wait complete. 2024-09-18T01:25:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.353+0000 7fc507a10800 1 Processor -- start 2024-09-18T01:25:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.353+0000 7fc507a10800 1 -- start start 2024-09-18T01:25:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.353+0000 7fc507a10800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c4ee50 0x55c5d6c560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.353+0000 7fc507a10800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c5d6c4fc70 con 0x55c5d6c4ee50 2024-09-18T01:25:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.353+0000 7fc5030c1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c4ee50 0x55c5d6c560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.354+0000 7fc5030c1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c4ee50 0x55c5d6c560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52676/0 (socket says 172.21.15.100:52676) 2024-09-18T01:25:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.354+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 learned_addr learned my addr 172.21.15.100:0/3318298379 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.354+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d6c56610 con 0x55c5d6c4ee50 2024-09-18T01:25:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.354+0000 7fc5030c1640 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c4ee50 0x55c5d6c560d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc4f409ae80 tx=0x7fc4f409ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.354+0000 7fc3e57fa640 1 -- 172.21.15.100:0/3318298379 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f4063b60 con 0x55c5d6c4ee50 2024-09-18T01:25:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.354+0000 7fc3e57fa640 1 -- 172.21.15.100:0/3318298379 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f40bc070 con 0x55c5d6c4ee50 2024-09-18T01:25:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.354+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5d6c56610 con 0x55c5d6c4ee50 2024-09-18T01:25:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.354+0000 7fc3e57fa640 1 -- 172.21.15.100:0/3318298379 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f4079840 con 0x55c5d6c4ee50 2024-09-18T01:25:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.354+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5d6c56610 con 0x55c5d6c4ee50 2024-09-18T01:25:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.355+0000 7fc3e57fa640 1 -- 172.21.15.100:0/3318298379 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc4f404f070 con 0x55c5d6c4ee50 2024-09-18T01:25:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.355+0000 7fc3e57fa640 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3cc036b40 0x7fc3cc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.355+0000 7fc3e57fa640 1 -- 172.21.15.100:0/3318298379 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fc4f404d5c0 con 0x55c5d6c4ee50 2024-09-18T01:25:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.355+0000 7fc4fbfff640 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3cc036b40 0x7fc3cc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.356+0000 7fc4fbfff640 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3cc036b40 0x7fc3cc039000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c010 tx=0x7fc4ec010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.356+0000 7fc507a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.356+0000 7fc507a10800 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c5d6c61830 0x55c5d6c63cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.356+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c64440 con 0x55c5d6c61830 2024-09-18T01:25:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.356+0000 7fc5038c2640 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c5d6c61830 0x55c5d6c63cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.356+0000 7fc5038c2640 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c5d6c61830 0x55c5d6c63cf0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.356+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.356+0000 7fc507a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.356+0000 7fc507a10800 20 realm 2024-09-18T01:25:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.356+0000 7fc507a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.356+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c64850 con 0x55c5d6c61830 2024-09-18T01:25:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc507a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc507a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc507a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c65120 con 0x55c5d6c61830 2024-09-18T01:25:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc507a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc507a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c61830 2024-09-18T01:25:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc507a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc507a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc507a10800 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c5d6c66220 0x55c5d6c68610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c68c20 con 0x55c5d6c66220 2024-09-18T01:25:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc5030c1640 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c5d6c66220 0x55c5d6c68610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.357+0000 7fc5030c1640 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c5d6c66220 0x55c5d6c68610 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.358+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.358+0000 7fc507a10800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.358+0000 7fc507a10800 20 searching for the correct realm 2024-09-18T01:25:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.358+0000 7fc507a10800 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55c5d6c6abf0 0x55c5d6c6d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.358+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c6d750 con 0x55c5d6c6abf0 2024-09-18T01:25:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.358+0000 7fc4fbfff640 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55c5d6c6abf0 0x55c5d6c6d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.358+0000 7fc4fbfff640 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55c5d6c6abf0 0x55c5d6c6d080 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.358+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.358+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c6d750 con 0x55c5d6c66220 2024-09-18T01:25:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.359+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.359+0000 7fc5030c1640 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc4f40b8040 0x7fc4f40c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.359+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c6d750 con 0x7fc4f40b8040 2024-09-18T01:25:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.359+0000 7fc5038c2640 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc4f40b8040 0x7fc4f40c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.359+0000 7fc5038c2640 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc4f40b8040 0x7fc4f40c18a0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.360+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.360+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c61830 2024-09-18T01:25:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.360+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.360+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c61830 2024-09-18T01:25:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.360+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.360+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x7fc4f40b8040 2024-09-18T01:25:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.360+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.360+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x7fc4f40b8040 2024-09-18T01:25:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.361+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.361+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c66220 2024-09-18T01:25:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.361+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.361+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.361+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.361+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c61830 2024-09-18T01:25:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.361+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.361+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c66220 2024-09-18T01:25:50.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.362+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.362+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c61830 2024-09-18T01:25:50.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.362+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.362+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c66220 2024-09-18T01:25:50.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.362+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.362+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.362+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.362+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.362+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.362+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x7fc4f40b8040 2024-09-18T01:25:50.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.363+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.363+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.363+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.363+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.363+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.363+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c61830 2024-09-18T01:25:50.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.364+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.364+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c61830 2024-09-18T01:25:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.364+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.364+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x7fc4f40b8040 2024-09-18T01:25:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.364+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.364+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.364+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.364+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c66220 2024-09-18T01:25:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.365+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.365+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c61830 2024-09-18T01:25:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.365+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.365+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x7fc4f40b8040 2024-09-18T01:25:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.365+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.365+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.365+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.365+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c66220 2024-09-18T01:25:50.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.365+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.365+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c66220 2024-09-18T01:25:50.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.366+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.366+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.366+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.366+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x7fc4f40b8040 2024-09-18T01:25:50.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.366+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.366+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c61830 2024-09-18T01:25:50.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.366+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.366+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c654c0 con 0x55c5d6c66220 2024-09-18T01:25:50.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc507a10800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc507a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc507a10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc507a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc507a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc507a10800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc507a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c694e0 con 0x55c5d6c61830 2024-09-18T01:25:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc507a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc507a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c698d0 con 0x55c5d6c61830 2024-09-18T01:25:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc507a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc507a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.367+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c698d0 con 0x7fc4f40b8040 2024-09-18T01:25:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 20 zone default found 2024-09-18T01:25:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 4 Realm: () 2024-09-18T01:25:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 20 zonegroup default 2024-09-18T01:25:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c69140 con 0x7fc4f40b8040 2024-09-18T01:25:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c6f5b0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c6f950 con 0x55c5d6c6abf0 2024-09-18T01:25:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 20 started sync module instance, tier type = 2024-09-18T01:25:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.368+0000 7fc507a10800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.369+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c6ea50 con 0x55c5d6c66220 2024-09-18T01:25:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.370+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.370+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94308200279616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c6e6b0 con 0x55c5d6c66220 2024-09-18T01:25:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.370+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c70650 con 0x55c5d6c61830 2024-09-18T01:25:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.371+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94308200279616] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.371+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.371+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94308200283856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c70920 con 0x55c5d6c61830 2024-09-18T01:25:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.371+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c71410 con 0x55c5d6c6abf0 2024-09-18T01:25:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.372+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94308200283856] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.372+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.372+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94308200287968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c71800 con 0x55c5d6c6abf0 2024-09-18T01:25:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.372+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c72260 con 0x55c5d6c66220 2024-09-18T01:25:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.373+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.374+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94308200287968] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.374+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94308200291648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c72b00 con 0x55c5d6c66220 2024-09-18T01:25:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.374+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c70370 con 0x55c5d6c61830 2024-09-18T01:25:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.375+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94308200291648] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.375+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.375+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94308200293968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c72a70 con 0x55c5d6c61830 2024-09-18T01:25:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.375+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c73a50 con 0x7fc4f40b8040 2024-09-18T01:25:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.376+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.376+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94308200297888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c739c0 con 0x7fc4f40b8040 2024-09-18T01:25:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.376+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c749c0 con 0x7fc4f40b8040 2024-09-18T01:25:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.376+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94308200293968] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.377+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94308200297888] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.377+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.377+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94308200300144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c744c0 con 0x7fc4f40b8040 2024-09-18T01:25:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.377+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c74e70 con 0x7fc4f40b8040 2024-09-18T01:25:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.379+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(58 notify.7 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.379+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94308200300144] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.379+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94308200303040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c75290 con 0x7fc4f40b8040 2024-09-18T01:25:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.379+0000 7fc507a10800 20 add_watcher() i=0 2024-09-18T01:25:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.379+0000 7fc507a10800 20 add_watcher() i=1 2024-09-18T01:25:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.379+0000 7fc507a10800 20 add_watcher() i=2 2024-09-18T01:25:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.379+0000 7fc507a10800 20 add_watcher() i=3 2024-09-18T01:25:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.379+0000 7fc507a10800 20 add_watcher() i=4 2024-09-18T01:25:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.379+0000 7fc507a10800 20 add_watcher() i=5 2024-09-18T01:25:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.379+0000 7fc507a10800 20 add_watcher() i=6 2024-09-18T01:25:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.380+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94308200303040] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.380+0000 7fc507a10800 20 add_watcher() i=7 2024-09-18T01:25:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.380+0000 7fc507a10800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.380+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c75290 con 0x55c5d6c61830 2024-09-18T01:25:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.380+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.380+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94308200304096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c75200 con 0x55c5d6c61830 2024-09-18T01:25:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.381+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94308200304096] v35'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.381+0000 7fc3b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.381+0000 7fc507a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.381+0000 7fc507a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.381+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c80d20 con 0x55c5d6c61830 2024-09-18T01:25:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.382+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'54 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.382+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c81370 con 0x7fc4f40b8040 2024-09-18T01:25:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.384+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.384+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c817b0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.385+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.385+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c820e0 con 0x55c5d6c61830 2024-09-18T01:25:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.385+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'189 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.385+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c7ca90 con 0x55c5d6c66220 2024-09-18T01:25:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.386+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'68 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.386+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c7ca90 con 0x55c5d6c6abf0 2024-09-18T01:25:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.387+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'53 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.387+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c830a0 con 0x55c5d6c61830 2024-09-18T01:25:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.389+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.389+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c830a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.390+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'48 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.390+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c830a0 con 0x55c5d6c66220 2024-09-18T01:25:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.391+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.391+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83270 con 0x55c5d6c6abf0 2024-09-18T01:25:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.392+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.392+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83660 con 0x55c5d6c66220 2024-09-18T01:25:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.393+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'69 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.393+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83660 con 0x7fc4f40b8040 2024-09-18T01:25:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.394+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.394+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c836f0 con 0x55c5d6c66220 2024-09-18T01:25:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.395+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.395+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c836f0 con 0x7fc4f40b8040 2024-09-18T01:25:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.397+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.397+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c836f0 con 0x55c5d6c61830 2024-09-18T01:25:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.397+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'190 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.397+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c836f0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.399+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.399+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c82fe0 con 0x55c5d6c66220 2024-09-18T01:25:50.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.400+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'70 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.400+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c830a0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.401+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.401+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83e40 con 0x55c5d6c61830 2024-09-18T01:25:50.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.402+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.402+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83e40 con 0x55c5d6c61830 2024-09-18T01:25:50.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.403+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'191 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.403+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83e40 con 0x55c5d6c6abf0 2024-09-18T01:25:50.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.404+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.404+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83e40 con 0x55c5d6c66220 2024-09-18T01:25:50.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.405+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.405+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83e40 con 0x55c5d6c6abf0 2024-09-18T01:25:50.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.406+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.406+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83e40 con 0x55c5d6c6abf0 2024-09-18T01:25:50.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.407+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'42 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.407+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83e40 con 0x55c5d6c6abf0 2024-09-18T01:25:50.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.408+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.408+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83e40 con 0x55c5d6c6abf0 2024-09-18T01:25:50.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.409+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'54 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.409+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83e40 con 0x7fc4f40b8040 2024-09-18T01:25:50.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.410+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.411+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83e40 con 0x55c5d6c6abf0 2024-09-18T01:25:50.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.411+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.411+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83e40 con 0x7fc4f40b8040 2024-09-18T01:25:50.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.413+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'49 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.413+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83e40 con 0x55c5d6c6abf0 2024-09-18T01:25:50.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.414+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.414+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83e40 con 0x7fc4f40b8040 2024-09-18T01:25:50.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.415+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.415+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c83e40 con 0x55c5d6c66220 2024-09-18T01:25:50.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.417+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.417+0000 7fc3b8fe1640 20 reqs_thread_entry: start 2024-09-18T01:25:50.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.417+0000 7fc507a10800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:50.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.417+0000 7fc507a10800 20 Filter name: none 2024-09-18T01:25:50.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.417+0000 7fc3327fc640 20 reqs_thread_entry: start 2024-09-18T01:25:50.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.417+0000 7fc507a10800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:25:50.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.417+0000 7fc507a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.417+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cae9d0 con 0x55c5d6c66220 2024-09-18T01:25:50.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.417+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.417+0000 7fc507a10800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:25:50.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc507a10800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:25:50.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc507a10800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:25:50.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc507a10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 : miss 2024-09-18T01:25:50.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc507a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:95 8.8 8:159c71d7:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb0620 con 0x55c5d6c61830 2024-09-18T01:25:50.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(95 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc507a10800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:25:50.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc507a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 info.flags=0x17 2024-09-18T01:25:50.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc507a10800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 to cache LRU end 2024-09-18T01:25:50.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc507a10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:50.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc507a10800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:25:50.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc507a10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 2024-09-18T01:25:50.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:96 4.16 4:697be0c8:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2de50 con 0x55c5d6c6abf0 2024-09-18T01:25:50.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(96 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.418+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:97 4.25 4:a71806fc:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2de50 con 0x55c5d6c6abf0 2024-09-18T01:25:50.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.419+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 27 ==== osd_op_reply(97 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.419+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:98 4.30 4:0fd44118:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2de50 con 0x55c5d6c6abf0 2024-09-18T01:25:50.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.419+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 28 ==== osd_op_reply(98 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.2 [call out=426b] v0'0 uv5 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.419+0000 7fc507a10800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-18T01:25:50.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.419+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:99 4.1b 4:db3cc8c6:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2de50 con 0x55c5d6c66220 2024-09-18T01:25:50.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.419+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== osd_op_reply(99 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.419+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:100 4.1 4:80c96fc7:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2de50 con 0x55c5d6c66220 2024-09-18T01:25:50.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.420+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 23 ==== osd_op_reply(100 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.420+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:101 4.f 4:f10b74d4:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2de50 con 0x55c5d6c61830 2024-09-18T01:25:50.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.420+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(101 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.420+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 4.1c 4:3bb15e5f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2de50 con 0x7fc4f40b8040 2024-09-18T01:25:50.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.420+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(102 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.6 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.420+0000 7fc507a10800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-18T01:25:50.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.420+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:103 4.1 4:828d847c:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2de50 con 0x55c5d6c66220 2024-09-18T01:25:50.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.421+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 24 ==== osd_op_reply(103 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.7 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.421+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:104 4.3b 4:dff13bf4:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2de50 con 0x55c5d6c6abf0 2024-09-18T01:25:50.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.421+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 29 ==== osd_op_reply(104 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.8 [call out=424b] v0'0 uv5 ondisk = 0) ==== 194+0+424 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.421+0000 7fc507a10800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-18T01:25:50.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.421+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:105 4.3d 4:beeca5dc:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2de50 con 0x55c5d6c66220 2024-09-18T01:25:50.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.421+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 25 ==== osd_op_reply(105 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.421+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:106 4.33 4:ccad0193:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2de50 con 0x7fc4f40b8040 2024-09-18T01:25:50.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.422+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(106 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10 [call out=697b] v0'0 uv9 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.422+0000 7fc507a10800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-18T01:25:50.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.422+0000 7fc507a10800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-18T01:25:50.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.422+0000 7fc507a10800 20 get_obj_state: octx=0x7fc4f406ef80 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55c5d6d2d658 s->prefetch_data=0 2024-09-18T01:25:50.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.422+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:107 3.6s0 3:623d2d46:::153b7754-209b-4898-8796-577da7c1273d.4237.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2bb50 con 0x55c5d6c61830 2024-09-18T01:25:50.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.422+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(107 153b7754-209b-4898-8796-577da7c1273d.4237.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.422+0000 7fc507a10800 10 manifest: total_size = 6 2024-09-18T01:25:50.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.422+0000 7fc507a10800 20 get_obj_state: setting s->obj_tag to 153b7754-209b-4898-8796-577da7c1273d.4237.15469295134695691031 2024-09-18T01:25:50.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.422+0000 7fc507a10800 20 get_obj_state: octx=0x7fc4f406ef80 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55c5d6d2d658 s->prefetch_data=0 2024-09-18T01:25:50.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.422+0000 7fc507a10800 20 prepare_atomic_modification: state is not atomic. state=0x55c5d6d2d658 2024-09-18T01:25:50.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.422+0000 7fc507a10800 20 bucket index object: :.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.2 2024-09-18T01:25:50.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.422+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:108 4.30 4:0fd44118:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb5d30 con 0x55c5d6c6abf0 2024-09-18T01:25:50.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.424+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 30 ==== osd_op_reply(108 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.2 [stat,call,call] v35'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.424+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:109 3.6s0 3:623d2d46:::153b7754-209b-4898-8796-577da7c1273d.4237.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb5d30 con 0x55c5d6c61830 2024-09-18T01:25:50.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.425+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(109 153b7754-209b-4898-8796-577da7c1273d.4237.5_9c8454ddf7aa50116496bac348d7550d [call] v35'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.425+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:110 4.30 4:0fd44118:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb67c0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.425+0000 7fc507a10800 20 get_obj_state: octx=0x7fc4f406ef80 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55c5d6d2d658 s->prefetch_data=0 2024-09-18T01:25:50.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.425+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:111 3.8s0 3:10c6caa3:::153b7754-209b-4898-8796-577da7c1273d.4237.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb67c0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.426+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 31 ==== osd_op_reply(111 153b7754-209b-4898-8796-577da7c1273d.4237.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.426+0000 7fc507a10800 10 manifest: total_size = 3 2024-09-18T01:25:50.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.426+0000 7fc507a10800 20 get_obj_state: setting s->obj_tag to 153b7754-209b-4898-8796-577da7c1273d.4237.13084930475454821406 2024-09-18T01:25:50.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.426+0000 7fc507a10800 20 get_obj_state: octx=0x7fc4f406ef80 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55c5d6d2d658 s->prefetch_data=0 2024-09-18T01:25:50.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.426+0000 7fc507a10800 20 prepare_atomic_modification: state is not atomic. state=0x55c5d6d2d658 2024-09-18T01:25:50.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.426+0000 7fc507a10800 20 bucket index object: :.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.6 2024-09-18T01:25:50.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.426+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:112 4.1c 4:3bb15e5f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cbb440 con 0x7fc4f40b8040 2024-09-18T01:25:50.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.428+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(112 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.6 [stat,call,call] v35'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.428+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:113 3.8s0 3:10c6caa3:::153b7754-209b-4898-8796-577da7c1273d.4237.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb9420 con 0x55c5d6c6abf0 2024-09-18T01:25:50.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.430+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 32 ==== osd_op_reply(110 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.2 [stat,call,call] v35'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.430+0000 7fc3e6ffd640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-18T01:25:50.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.430+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 33 ==== osd_op_reply(113 153b7754-209b-4898-8796-577da7c1273d.4237.5_b1b9a972ccd8c962a473909b97007eb4 [call] v35'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.430+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:114 4.1c 4:3bb15e5f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb6450 con 0x7fc4f40b8040 2024-09-18T01:25:50.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.430+0000 7fc507a10800 20 get_obj_state: octx=0x7fc4f406ef80 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55c5d6d2d658 s->prefetch_data=0 2024-09-18T01:25:50.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.430+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:115 3.27s0 3:e49d1d99:::153b7754-209b-4898-8796-577da7c1273d.4237.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb6450 con 0x7fc4f40b8040 2024-09-18T01:25:50.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.431+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(115 153b7754-209b-4898-8796-577da7c1273d.4237.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+891 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.431+0000 7fc507a10800 10 manifest: total_size = 4 2024-09-18T01:25:50.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.431+0000 7fc507a10800 20 get_obj_state: setting s->obj_tag to 153b7754-209b-4898-8796-577da7c1273d.4237.431471124524711469 2024-09-18T01:25:50.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.431+0000 7fc507a10800 20 get_obj_state: octx=0x7fc4f406ef80 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55c5d6d2d658 s->prefetch_data=0 2024-09-18T01:25:50.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.431+0000 7fc507a10800 20 prepare_atomic_modification: state is not atomic. state=0x55c5d6d2d658 2024-09-18T01:25:50.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.431+0000 7fc507a10800 20 bucket index object: :.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.8 2024-09-18T01:25:50.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.431+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:116 4.3b 4:dff13bf4:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cbb420 con 0x55c5d6c6abf0 2024-09-18T01:25:50.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.432+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(114 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.6 [stat,call,call] v35'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.432+0000 7fc3e67fc640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-18T01:25:50.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.433+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 34 ==== osd_op_reply(116 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.8 [stat,call,call] v35'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.433+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:117 3.27s0 3:e49d1d99:::153b7754-209b-4898-8796-577da7c1273d.4237.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cbb420 con 0x7fc4f40b8040 2024-09-18T01:25:50.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.434+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(117 153b7754-209b-4898-8796-577da7c1273d.4237.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v35'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.434+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:118 4.3b 4:dff13bf4:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb2630 con 0x55c5d6c6abf0 2024-09-18T01:25:50.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.434+0000 7fc507a10800 20 get_obj_state: octx=0x7fc4f406ef80 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55c5d6d2d658 s->prefetch_data=0 2024-09-18T01:25:50.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.434+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:119 3.28s0 3:1716e9a1:::153b7754-209b-4898-8796-577da7c1273d.4237.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb2630 con 0x55c5d6c6abf0 2024-09-18T01:25:50.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.435+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 35 ==== osd_op_reply(119 153b7754-209b-4898-8796-577da7c1273d.4237.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.435+0000 7fc507a10800 10 manifest: total_size = 5 2024-09-18T01:25:50.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.435+0000 7fc507a10800 20 get_obj_state: setting s->obj_tag to 153b7754-209b-4898-8796-577da7c1273d.4237.2037258010559922642 2024-09-18T01:25:50.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.435+0000 7fc507a10800 20 get_obj_state: octx=0x7fc4f406ef80 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55c5d6d2d658 s->prefetch_data=0 2024-09-18T01:25:50.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.435+0000 7fc507a10800 20 prepare_atomic_modification: state is not atomic. state=0x55c5d6d2d658 2024-09-18T01:25:50.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.435+0000 7fc507a10800 20 bucket index object: :.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10 2024-09-18T01:25:50.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.435+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:120 4.33 4:ccad0193:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb3240 con 0x7fc4f40b8040 2024-09-18T01:25:50.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.436+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 36 ==== osd_op_reply(118 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.8 [stat,call,call] v35'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.436+0000 7fc3e6ffd640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-18T01:25:50.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.436+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 29 ==== osd_op_reply(120 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10 [stat,call,call] v35'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.436+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:121 3.28s0 3:1716e9a1:::153b7754-209b-4898-8796-577da7c1273d.4237.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb2d90 con 0x55c5d6c6abf0 2024-09-18T01:25:50.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.438+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 37 ==== osd_op_reply(121 153b7754-209b-4898-8796-577da7c1273d.4237.5_24d27c169c2c881eb09a065116f2aa5c [call] v35'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.438+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:122 4.33 4:ccad0193:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cba4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.438+0000 7fc507a10800 20 get_obj_state: octx=0x7fc4f406ef80 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55c5d6d2d658 s->prefetch_data=0 2024-09-18T01:25:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.438+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:123 3.10s0 3:0b134fe9:::153b7754-209b-4898-8796-577da7c1273d.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cba4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.438+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(123 153b7754-209b-4898-8796-577da7c1273d.4237.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.438+0000 7fc507a10800 10 manifest: total_size = 5 2024-09-18T01:25:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.438+0000 7fc507a10800 20 get_obj_state: setting s->obj_tag to _f1D3sTt2lwAiAqC7NsgEwh9u0S6yqpa 2024-09-18T01:25:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.438+0000 7fc507a10800 20 get_obj_state: octx=0x7fc4f406ef80 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55c5d6d2d658 s->prefetch_data=0 2024-09-18T01:25:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.438+0000 7fc507a10800 20 prepare_atomic_modification: state is not atomic. state=0x55c5d6d2d658 2024-09-18T01:25:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.438+0000 7fc507a10800 20 bucket index object: :.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10 2024-09-18T01:25:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.438+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:124 4.33 4:ccad0193:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb30e0 con 0x7fc4f40b8040 2024-09-18T01:25:50.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.439+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 30 ==== osd_op_reply(122 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10 [stat,call,call] v35'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.439+0000 7fc3e67fc640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-18T01:25:50.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.440+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 31 ==== osd_op_reply(124 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10 [stat,call,call] v35'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.440+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:125 3.10s0 3:0b134fe9:::153b7754-209b-4898-8796-577da7c1273d.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb30e0 con 0x55c5d6c61830 2024-09-18T01:25:50.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.441+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(125 153b7754-209b-4898-8796-577da7c1273d.4237.5_bb3aec0fdcdbc2974890f805c585d432 [call] v35'6 uv6 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.441+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:126 4.33 4:ccad0193:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb30e0 con 0x7fc4f40b8040 2024-09-18T01:25:50.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.441+0000 7fc507a10800 20 list_objects_ordered: starting attempt 1 2024-09-18T01:25:50.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.441+0000 7fc507a10800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-18T01:25:50.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.441+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:127 4.16 4:697be0c8:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb30e0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.441+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:128 4.25 4:a71806fc:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2d920 con 0x55c5d6c6abf0 2024-09-18T01:25:50.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.441+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:129 4.30 4:0fd44118:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2d920 con 0x55c5d6c6abf0 2024-09-18T01:25:50.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.441+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:130 4.1b 4:db3cc8c6:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cc23c0 con 0x55c5d6c66220 2024-09-18T01:25:50.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:131 4.1 4:80c96fc7:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cc23c0 con 0x55c5d6c66220 2024-09-18T01:25:50.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 38 ==== osd_op_reply(127 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:132 4.f 4:f10b74d4:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cc4d20 con 0x55c5d6c61830 2024-09-18T01:25:50.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 39 ==== osd_op_reply(128 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 40 ==== osd_op_reply(129 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.2 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 26 ==== osd_op_reply(130 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:133 4.1c 4:3bb15e5f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cc4d20 con 0x7fc4f40b8040 2024-09-18T01:25:50.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:134 4.1 4:828d847c:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cbfef0 con 0x55c5d6c66220 2024-09-18T01:25:50.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 27 ==== osd_op_reply(131 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:135 4.3b 4:dff13bf4:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cc5640 con 0x55c5d6c6abf0 2024-09-18T01:25:50.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(132 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:136 4.3d 4:beeca5dc:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2bef0 con 0x55c5d6c66220 2024-09-18T01:25:50.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:137 4.33 4:ccad0193:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cc2d00 con 0x7fc4f40b8040 2024-09-18T01:25:50.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 32 ==== osd_op_reply(133 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.442+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 28 ==== osd_op_reply(134 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.7 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 41 ==== osd_op_reply(135 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 29 ==== osd_op_reply(136 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 33 ==== osd_op_reply(126 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10 [stat,call,call] v35'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc3e6ffd640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-18T01:25:50.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 34 ==== osd_op_reply(137 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-18T01:25:50.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-18T01:25:50.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-18T01:25:50.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-18T01:25:50.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.5])"; uploads.size()=0; is_truncated=0 2024-09-18T01:25:50.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:138 4.16 4:697be0c8:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2bed0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:139 4.25 4:a71806fc:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cc2850 con 0x55c5d6c6abf0 2024-09-18T01:25:50.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:140 4.30 4:0fd44118:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cc2c40 con 0x55c5d6c6abf0 2024-09-18T01:25:50.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:141 4.1b 4:db3cc8c6:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2bed0 con 0x55c5d6c66220 2024-09-18T01:25:50.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:142 4.1 4:80c96fc7:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cc2850 con 0x55c5d6c66220 2024-09-18T01:25:50.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:143 4.f 4:f10b74d4:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cc2c40 con 0x55c5d6c61830 2024-09-18T01:25:50.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:144 4.1c 4:3bb15e5f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cc4ab0 con 0x7fc4f40b8040 2024-09-18T01:25:50.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:145 4.1 4:828d847c:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cc8fc0 con 0x55c5d6c66220 2024-09-18T01:25:50.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:146 4.3b 4:dff13bf4:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6ccb980 con 0x55c5d6c6abf0 2024-09-18T01:25:50.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:147 4.3d 4:beeca5dc:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2bed0 con 0x55c5d6c66220 2024-09-18T01:25:50.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.443+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:148 4.33 4:ccad0193:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cd0610 con 0x7fc4f40b8040 2024-09-18T01:25:50.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.444+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 30 ==== osd_op_reply(141 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.444+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 34 ==== osd_op_reply(143 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.444+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 35 ==== osd_op_reply(148 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.444+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 36 ==== osd_op_reply(144 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.444+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 42 ==== osd_op_reply(138 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.444+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 43 ==== osd_op_reply(139 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.444+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 31 ==== osd_op_reply(142 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.444+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 44 ==== osd_op_reply(140 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.2 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.444+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 45 ==== osd_op_reply(146 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.444+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 32 ==== osd_op_reply(147 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.444+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 33 ==== osd_op_reply(145 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.7 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.444+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2bed0 con 0x55c5d6c66220 2024-09-18T01:25:50.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.445+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 34 ==== osd_op_reply(149 foo.buckets [call] v35'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.445+0000 7fc507a10800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-18T01:25:50.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.445+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2bed0 con 0x55c5d6c66220 2024-09-18T01:25:50.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.446+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 35 ==== osd_op_reply(150 myfoo [call,call,delete] v35'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.446+0000 7fc507a10800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-18T01:25:50.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.446+0000 7fc507a10800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:25:50.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.447+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94308201059440 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2bed0 con 0x7fc4f40b8040 2024-09-18T01:25:50.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.447+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 37 ==== watch-notify(notify (1) cookie 94308200300144 notify 150323855372 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55c5d6cae510 con 0x7fc4f40b8040 2024-09-18T01:25:50.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.447+0000 7fc3e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855372 cookie 94308200300144 notifier 4657 bl.length()=149 2024-09-18T01:25:50.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.447+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 38 ==== osd_op_reply(151 notify.6 [notify cookie 94308201059440 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.447+0000 7fc3e6ffd640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc3c8003d60 con 0x7fc4f40b8040 2024-09-18T01:25:50.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.447+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 39 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.447+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 40 ==== watch-notify(notify_complete (2) cookie 94308201059440 notify 150323855372 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5d6c80980 con 0x7fc4f40b8040 2024-09-18T01:25:50.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.448+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:153 8.8 8:159c71d7:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2bed0 con 0x55c5d6c61830 2024-09-18T01:25:50.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.448+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 35 ==== osd_op_reply(153 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 [call,call,delete] v35'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc507a10800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5 from cache 2024-09-18T01:25:50.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc507a10800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.5, ofs0, ns] 2024-09-18T01:25:50.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:154 7.0 7:05bf5b68:::notify.1:head [notify cookie 94308201059440 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2bed0 con 0x55c5d6c61830 2024-09-18T01:25:50.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 36 ==== watch-notify(notify (1) cookie 94308200283856 notify 150323855393 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55c5d6c80980 con 0x55c5d6c61830 2024-09-18T01:25:50.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc3e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855393 cookie 94308200283856 notifier 4657 bl.length()=206 2024-09-18T01:25:50.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc3e6ffd640 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:155 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc3c8003d60 con 0x55c5d6c61830 2024-09-18T01:25:50.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 37 ==== osd_op_reply(154 notify.1 [notify cookie 94308201059440 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 38 ==== watch-notify(notify_complete (2) cookie 94308201059440 notify 150323855393 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5d6c80780 con 0x55c5d6c61830 2024-09-18T01:25:50.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 39 ==== osd_op_reply(155 notify.1 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:156 4.16 4:697be0c8:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2bed0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:157 4.25 4:a71806fc:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6ccffc0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:158 4.30 4:0fd44118:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb30e0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:159 4.1b 4:db3cc8c6:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cad910 con 0x55c5d6c66220 2024-09-18T01:25:50.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:160 4.1 4:80c96fc7:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2bed0 con 0x55c5d6c66220 2024-09-18T01:25:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:161 4.f 4:f10b74d4:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6caee30 con 0x55c5d6c61830 2024-09-18T01:25:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:162 4.1c 4:3bb15e5f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6caf700 con 0x7fc4f40b8040 2024-09-18T01:25:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:163 4.1 4:828d847c:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb30e0 con 0x55c5d6c66220 2024-09-18T01:25:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.449+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:164 4.3b 4:dff13bf4:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cad910 con 0x55c5d6c6abf0 2024-09-18T01:25:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.450+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:165 4.3d 4:beeca5dc:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2bed0 con 0x55c5d6c66220 2024-09-18T01:25:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.450+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:166 4.33 4:ccad0193:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cad910 con 0x7fc4f40b8040 2024-09-18T01:25:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.451+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 36 ==== osd_op_reply(159 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.3 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.451+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 46 ==== osd_op_reply(158 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.2 [delete] v35'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.451+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 47 ==== osd_op_reply(156 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.0 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.451+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 48 ==== osd_op_reply(157 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.1 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.451+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 41 ==== osd_op_reply(162 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.6 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.452+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 40 ==== osd_op_reply(161 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.5 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.452+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 42 ==== osd_op_reply(166 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.10 [delete] v35'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.452+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 37 ==== osd_op_reply(160 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.4 [delete] v35'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.452+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 49 ==== osd_op_reply(164 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.8 [delete] v35'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.452+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 38 ==== osd_op_reply(163 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.7 [delete] v35'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.452+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 39 ==== osd_op_reply(165 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.5.9 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.452+0000 7fc507a10800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/153b7754-209b-4898-8796-577da7c1273d.4237.5 : miss 2024-09-18T01:25:50.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.452+0000 7fc507a10800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.452+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:167 6.d 6:b0208e9b:::pubsub..bucket.myfoo%2f153b7754-209b-4898-8796-577da7c1273d.4237.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6caf700 con 0x55c5d6c61830 2024-09-18T01:25:50.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.452+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 41 ==== osd_op_reply(167 pubsub..bucket.myfoo/153b7754-209b-4898-8796-577da7c1273d.4237.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.452+0000 7fc507a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.452+0000 7fc507a10800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/153b7754-209b-4898-8796-577da7c1273d.4237.5 info.flags=0x0 2024-09-18T01:25:50.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.452+0000 7fc507a10800 10 adding default.rgw.log++pubsub..bucket.myfoo/153b7754-209b-4898-8796-577da7c1273d.4237.5 to cache LRU end 2024-09-18T01:25:50.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.452+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:168 6.d 6:b0208e9b:::pubsub..bucket.myfoo%2f153b7754-209b-4898-8796-577da7c1273d.4237.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6cb30e0 con 0x55c5d6c61830 2024-09-18T01:25:50.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.453+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 42 ==== osd_op_reply(168 pubsub..bucket.myfoo/153b7754-209b-4898-8796-577da7c1273d.4237.5 [delete] v35'33 uv29 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.453+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6caee30 con 0x55c5d6c66220 2024-09-18T01:25:50.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.454+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 40 ==== osd_op_reply(169 foo.buckets [call] v35'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.455+0000 7fc3b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.455+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94308200304096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6d2bed0 con 0x55c5d6c61830 2024-09-18T01:25:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.456+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 43 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94308200304096] v35'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.456+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94308200279616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c74de0 con 0x55c5d6c66220 2024-09-18T01:25:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.457+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 41 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94308200279616] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.457+0000 7fc507a10800 20 remove_watcher() i=0 2024-09-18T01:25:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.457+0000 7fc507a10800 2 removed watcher, disabling cache 2024-09-18T01:25:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.457+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94308200283856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c74de0 con 0x55c5d6c61830 2024-09-18T01:25:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.459+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 44 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94308200283856] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.459+0000 7fc507a10800 20 remove_watcher() i=1 2024-09-18T01:25:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.459+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94308200287968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c74de0 con 0x55c5d6c6abf0 2024-09-18T01:25:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.460+0000 7fc4fbfff640 1 -- 172.21.15.100:0/3318298379 <== osd.3 v2:172.21.15.100:6816/595195757 50 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94308200287968] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec037040 con 0x55c5d6c6abf0 2024-09-18T01:25:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.460+0000 7fc507a10800 20 remove_watcher() i=2 2024-09-18T01:25:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.460+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94308200291648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c74de0 con 0x55c5d6c66220 2024-09-18T01:25:50.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.461+0000 7fc5030c1640 1 -- 172.21.15.100:0/3318298379 <== osd.2 v2:172.21.15.100:6808/3104327688 42 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94308200291648] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f407f070 con 0x55c5d6c66220 2024-09-18T01:25:50.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.461+0000 7fc507a10800 20 remove_watcher() i=3 2024-09-18T01:25:50.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.461+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94308200293968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c71d40 con 0x55c5d6c61830 2024-09-18T01:25:50.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.462+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.1 v2:172.21.15.100:6800/170575980 45 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94308200293968] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x55c5d6c61830 2024-09-18T01:25:50.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.462+0000 7fc507a10800 20 remove_watcher() i=4 2024-09-18T01:25:50.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.462+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94308200297888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c74de0 con 0x7fc4f40b8040 2024-09-18T01:25:50.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.463+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 43 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94308200297888] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.463+0000 7fc507a10800 20 remove_watcher() i=5 2024-09-18T01:25:50.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.463+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94308200300144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c72650 con 0x7fc4f40b8040 2024-09-18T01:25:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.464+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 44 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94308200300144] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.464+0000 7fc507a10800 20 remove_watcher() i=6 2024-09-18T01:25:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.464+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94308200303040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c5d6c71d40 con 0x7fc4f40b8040 2024-09-18T01:25:50.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 <== osd.0 v2:172.21.15.92:6800/2777570747 45 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94308200303040] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4fc00a4a0 con 0x7fc4f40b8040 2024-09-18T01:25:50.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 20 remove_watcher() i=7 2024-09-18T01:25:50.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc4f40b8040 msgr2=0x7fc4f40c18a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fc4f40b8040 0x7fc4f40c18a0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c5d6c61830 msgr2=0x55c5d6c63cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c5d6c61830 0x55c5d6c63cf0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c5d6c66220 msgr2=0x55c5d6c68610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c5d6c66220 0x55c5d6c68610 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55c5d6c6abf0 msgr2=0x55c5d6c6d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55c5d6c6abf0 0x55c5d6c6d080 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3cc036b40 msgr2=0x7fc3cc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3cc036b40 0x7fc3cc039000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c010 tx=0x7fc4ec010000 comp rx=0 tx=0).stop 2024-09-18T01:25:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c4ee50 msgr2=0x55c5d6c560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc5038c2640 1 -- 172.21.15.100:0/3318298379 reap_dead start 2024-09-18T01:25:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c4ee50 0x55c5d6c560d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc4f409ae80 tx=0x7fc4f409ef20 comp rx=0 tx=0).stop 2024-09-18T01:25:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 shutdown_connections 2024-09-18T01:25:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 --2- 172.21.15.100:0/3318298379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c4ee50 0x55c5d6c560d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 >> 172.21.15.100:0/3318298379 conn(0x55c5d6c4b200 msgr2=0x55c5d6c492d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 shutdown_connections 2024-09-18T01:25:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/3318298379 wait complete. 2024-09-18T01:25:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/1876757824 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3dc036b40 msgr2=0x7fc3dc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 --2- 172.21.15.100:0/1876757824 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3dc036b40 0x7fc3dc039000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55c5d6c28810 tx=0x7fc4ec00f000 comp rx=0 tx=0).stop 2024-09-18T01:25:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/1876757824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c42380 msgr2=0x55c5d6c427a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 --2- 172.21.15.100:0/1876757824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c42380 0x55c5d6c427a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc4f408f580 tx=0x7fc4f4067f30 comp rx=0 tx=0).stop 2024-09-18T01:25:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/1876757824 shutdown_connections 2024-09-18T01:25:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 --2- 172.21.15.100:0/1876757824 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3dc036b40 0x7fc3dc039000 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 --2- 172.21.15.100:0/1876757824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6c42380 0x55c5d6c427a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/1876757824 >> 172.21.15.100:0/1876757824 conn(0x55c5d6c37310 msgr2=0x55c5d6c39e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/1876757824 shutdown_connections 2024-09-18T01:25:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.466+0000 7fc507a10800 1 -- 172.21.15.100:0/1876757824 wait complete. 2024-09-18T01:25:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55c5d6c31b30 msgr2=0x55c5d6c33f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc507a10800 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55c5d6c31b30 0x55c5d6c33f20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c5d6b2e6a0 msgr2=0x55c5d6c2b320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc507a10800 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55c5d6b2e6a0 0x55c5d6c2b320 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c5d6c2dc40 msgr2=0x55c5d6c30030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc507a10800 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55c5d6c2dc40 0x55c5d6c30030 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3e8036b40 msgr2=0x7fc3e8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc507a10800 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc3e8036b40 0x7fc3e8039000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec000f60 tx=0x7fc4ec001370 comp rx=0 tx=0).stop 2024-09-18T01:25:50.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 msgr2=0x55c5d6c242b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc507a10800 1 --2- 172.21.15.100:0/2895638268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c5d6a9eeb0 0x55c5d6c242b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4025da0 tx=0x7fc4f4002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc5038c2640 1 -- 172.21.15.100:0/2895638268 reap_dead start 2024-09-18T01:25:50.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 shutdown_connections 2024-09-18T01:25:50.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 >> 172.21.15.100:0/2895638268 conn(0x55c5d6b25dd0 msgr2=0x55c5d6b2a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 shutdown_connections 2024-09-18T01:25:50.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.467+0000 7fc507a10800 1 -- 172.21.15.100:0/2895638268 wait complete. 2024-09-18T01:25:50.476 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-18T01:25:50.476 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-18T01:25:50.477 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-18T01:25:50.522 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:50.522 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:50.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.522+0000 7f9932535800 1 Processor -- start 2024-09-18T01:25:50.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.522+0000 7f9932535800 1 -- start start 2024-09-18T01:25:50.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.522+0000 7f9932535800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55b1781a3a10 0x55b1781a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.522+0000 7f9932535800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b17805eb30 con 0x55b17819f710 2024-09-18T01:25:50.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.522+0000 7f9932535800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55b178040360 con 0x55b1781a3a10 2024-09-18T01:25:50.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.522+0000 7f9927fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55b1781a3a10 0x55b1781a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.522+0000 7f992e2ee640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55b17819f710 0x55b17819fb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:43746/0 (socket says 172.21.15.100:43746) 2024-09-18T01:25:50.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.522+0000 7f992e2ee640 1 -- 172.21.15.100:0/666569021 learned_addr learned my addr 172.21.15.100:0/666569021 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:50.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.523+0000 7f9927fff640 1 -- 172.21.15.100:0/666569021 >> v1:172.21.15.92:6789/0 conn(0x55b17819f710 legacy=0x55b17819fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.523+0000 7f9927fff640 1 -- 172.21.15.100:0/666569021 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b178066e00 con 0x55b1781a3a10 2024-09-18T01:25:50.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.525+0000 7f9927fff640 1 --2- 172.21.15.100:0/666569021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1781a3a10 0x55b1781a5e00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f991800a470 tx=0x7f9918045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e52e6fc505d73c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.525+0000 7f992daed640 1 -- 172.21.15.100:0/666569021 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9918053570 con 0x55b1781a3a10 2024-09-18T01:25:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.525+0000 7f992daed640 1 -- 172.21.15.100:0/666569021 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9918058070 con 0x55b1781a3a10 2024-09-18T01:25:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.525+0000 7f992daed640 1 -- 172.21.15.100:0/666569021 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9918053880 con 0x55b1781a3a10 2024-09-18T01:25:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.525+0000 7f9932535800 1 -- 172.21.15.100:0/666569021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1781a3a10 msgr2=0x55b1781a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.525+0000 7f9932535800 1 --2- 172.21.15.100:0/666569021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1781a3a10 0x55b1781a5e00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f991800a470 tx=0x7f9918045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.525+0000 7f9932535800 1 -- 172.21.15.100:0/666569021 shutdown_connections 2024-09-18T01:25:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.525+0000 7f9932535800 1 --2- 172.21.15.100:0/666569021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1781a3a10 0x55b1781a5e00 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.525+0000 7f9932535800 1 -- 172.21.15.100:0/666569021 >> 172.21.15.100:0/666569021 conn(0x55b17819afe0 msgr2=0x55b17819d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.525+0000 7f9932535800 1 -- 172.21.15.100:0/666569021 shutdown_connections 2024-09-18T01:25:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.525+0000 7f9932535800 1 -- 172.21.15.100:0/666569021 wait complete. 2024-09-18T01:25:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.539+0000 7f9932535800 1 Processor -- start 2024-09-18T01:25:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.539+0000 7f9932535800 1 -- start start 2024-09-18T01:25:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.539+0000 7f9932535800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b17819f710 0x55b17828e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.539+0000 7f9932535800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b1780eb360 con 0x55b17819f710 2024-09-18T01:25:50.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.539+0000 7f992e2ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b17819f710 0x55b17828e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.539+0000 7f992e2ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b17819f710 0x55b17828e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52696/0 (socket says 172.21.15.100:52696) 2024-09-18T01:25:50.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.540+0000 7f992e2ee640 1 -- 172.21.15.100:0/1711908974 learned_addr learned my addr 172.21.15.100:0/1711908974 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.540+0000 7f992e2ee640 1 -- 172.21.15.100:0/1711908974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b178038bc0 con 0x55b17819f710 2024-09-18T01:25:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.540+0000 7f992e2ee640 1 --2- 172.21.15.100:0/1711908974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b17819f710 0x55b17828e870 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9920001e10 tx=0x7f992000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13f3ff79a07eda3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.540+0000 7f981c608640 1 -- 172.21.15.100:0/1711908974 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9920012020 con 0x55b17819f710 2024-09-18T01:25:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.540+0000 7f981c608640 1 -- 172.21.15.100:0/1711908974 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992000e5a0 con 0x55b17819f710 2024-09-18T01:25:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.540+0000 7f981c608640 1 -- 172.21.15.100:0/1711908974 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f992000e8e0 con 0x55b17819f710 2024-09-18T01:25:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.541+0000 7f9932535800 1 -- 172.21.15.100:0/1711908974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b17819f710 msgr2=0x55b17828e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.541+0000 7f9932535800 1 --2- 172.21.15.100:0/1711908974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b17819f710 0x55b17828e870 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9920001e10 tx=0x7f992000b780 comp rx=0 tx=0).stop 2024-09-18T01:25:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.541+0000 7f9932535800 1 -- 172.21.15.100:0/1711908974 shutdown_connections 2024-09-18T01:25:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.541+0000 7f9932535800 1 --2- 172.21.15.100:0/1711908974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b17819f710 0x55b17828e870 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.541+0000 7f9932535800 1 -- 172.21.15.100:0/1711908974 >> 172.21.15.100:0/1711908974 conn(0x55b17819afe0 msgr2=0x55b17828a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.541+0000 7f9932535800 1 -- 172.21.15.100:0/1711908974 shutdown_connections 2024-09-18T01:25:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.541+0000 7f9932535800 1 -- 172.21.15.100:0/1711908974 wait complete. 2024-09-18T01:25:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.541+0000 7f9932535800 1 Processor -- start 2024-09-18T01:25:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.541+0000 7f9932535800 1 -- start start 2024-09-18T01:25:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.541+0000 7f9932535800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b17819f710 0x55b1781156e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.541+0000 7f9932535800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b1781a6640 con 0x55b17819f710 2024-09-18T01:25:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.542+0000 7f992e2ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b17819f710 0x55b1781156e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.542+0000 7f992e2ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b17819f710 0x55b1781156e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52712/0 (socket says 172.21.15.100:52712) 2024-09-18T01:25:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.542+0000 7f992e2ee640 1 -- 172.21.15.100:0/765853059 learned_addr learned my addr 172.21.15.100:0/765853059 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.542+0000 7f992e2ee640 1 -- 172.21.15.100:0/765853059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b17804cfe0 con 0x55b17819f710 2024-09-18T01:25:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.542+0000 7f992e2ee640 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b17819f710 0x55b1781156e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9920001e10 tx=0x7f9920000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.542+0000 7f981ae05640 1 -- 172.21.15.100:0/765853059 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9920012030 con 0x55b17819f710 2024-09-18T01:25:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.542+0000 7f981ae05640 1 -- 172.21.15.100:0/765853059 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992001a7a0 con 0x55b17819f710 2024-09-18T01:25:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.542+0000 7f981ae05640 1 -- 172.21.15.100:0/765853059 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f992001aac0 con 0x55b17819f710 2024-09-18T01:25:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.542+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b178113dd0 con 0x55b17819f710 2024-09-18T01:25:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.542+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1781142f0 con 0x55b17819f710 2024-09-18T01:25:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.543+0000 7f981ae05640 1 -- 172.21.15.100:0/765853059 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9920015020 con 0x55b17819f710 2024-09-18T01:25:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.543+0000 7f981ae05640 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9814036b40 0x7f9814039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.544+0000 7f981ae05640 1 -- 172.21.15.100:0/765853059 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f9920020030 con 0x55b17819f710 2024-09-18T01:25:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.544+0000 7f9927fff640 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9814036b40 0x7f9814039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.544+0000 7f9932535800 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b1781a3a10 0x55b17829f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.544+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b17829fb80 con 0x55b1781a3a10 2024-09-18T01:25:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.544+0000 7f992eaef640 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b1781a3a10 0x55b17829f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.544+0000 7f9927fff640 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9814036b40 0x7f9814039000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9918057000 tx=0x7f9918052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.544+0000 7f992eaef640 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b1781a3a10 0x55b17829f640 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.544+0000 7f992eaef640 1 -- 172.21.15.100:0/765853059 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1781a3a10 2024-09-18T01:25:50.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.544+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782a03d0 con 0x55b1781a3a10 2024-09-18T01:25:50.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.545+0000 7f992eaef640 1 -- 172.21.15.100:0/765853059 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1781a3a10 2024-09-18T01:25:50.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.545+0000 7f9932535800 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b1782a1d20 0x55b1782a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.545+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782a4970 con 0x55b1782a1d20 2024-09-18T01:25:50.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.545+0000 7f992e2ee640 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b1782a1d20 0x55b1782a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.545+0000 7f992e2ee640 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b1782a1d20 0x55b1782a41e0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.545+0000 7f992e2ee640 1 -- 172.21.15.100:0/765853059 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f992000dcd0 con 0x55b1782a1d20 2024-09-18T01:25:50.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.545+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782a0c20 con 0x55b1781a3a10 2024-09-18T01:25:50.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.546+0000 7f992eaef640 1 -- 172.21.15.100:0/765853059 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1781a3a10 2024-09-18T01:25:50.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.546+0000 7f9932535800 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b1782a5dd0 0x55b1782a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.546+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782a88b0 con 0x55b1782a5dd0 2024-09-18T01:25:50.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.546+0000 7f9927fff640 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b1782a5dd0 0x55b1782a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.546+0000 7f9927fff640 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b1782a5dd0 0x55b1782a81c0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.547+0000 7f9927fff640 1 -- 172.21.15.100:0/765853059 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9918051070 con 0x55b1782a5dd0 2024-09-18T01:25:50.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.547+0000 7f9932535800 1 Processor -- start 2024-09-18T01:25:50.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.547+0000 7f9932535800 1 -- start start 2024-09-18T01:25:50.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.547+0000 7f9932535800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782b6660 0x55b1782b6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.547+0000 7f9932535800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b178115c20 con 0x55b1782b6660 2024-09-18T01:25:50.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.547+0000 7f992e2ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782b6660 0x55b1782b6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.547+0000 7f992e2ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782b6660 0x55b1782b6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52728/0 (socket says 172.21.15.100:52728) 2024-09-18T01:25:50.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.547+0000 7f992e2ee640 1 -- 172.21.15.100:0/1238835225 learned_addr learned my addr 172.21.15.100:0/1238835225 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.548+0000 7f992e2ee640 1 -- 172.21.15.100:0/1238835225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1782b6fc0 con 0x55b1782b6660 2024-09-18T01:25:50.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.548+0000 7f992e2ee640 1 --2- 172.21.15.100:0/1238835225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782b6660 0x55b1782b6a80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9920001750 tx=0x7f992002c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.548+0000 7f9813fff640 1 -- 172.21.15.100:0/1238835225 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99200490c0 con 0x55b1782b6660 2024-09-18T01:25:50.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.548+0000 7f9813fff640 1 -- 172.21.15.100:0/1238835225 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9920049260 con 0x55b1782b6660 2024-09-18T01:25:50.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.548+0000 7f9813fff640 1 -- 172.21.15.100:0/1238835225 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9920017c50 con 0x55b1782b6660 2024-09-18T01:25:50.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.548+0000 7f9932535800 1 -- 172.21.15.100:0/1238835225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1782b7250 con 0x55b1782b6660 2024-09-18T01:25:50.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.548+0000 7f9932535800 1 -- 172.21.15.100:0/1238835225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1782b9f30 con 0x55b1782b6660 2024-09-18T01:25:50.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.549+0000 7f9813fff640 1 -- 172.21.15.100:0/1238835225 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f992003c060 con 0x55b1782b6660 2024-09-18T01:25:50.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.549+0000 7f9813fff640 1 --2- 172.21.15.100:0/1238835225 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9808036b40 0x7f9808039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.549+0000 7f9813fff640 1 -- 172.21.15.100:0/1238835225 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f9920036d20 con 0x55b1782b6660 2024-09-18T01:25:50.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.549+0000 7f9927fff640 1 --2- 172.21.15.100:0/1238835225 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9808036b40 0x7f9808039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.549+0000 7f9932535800 1 Processor -- start 2024-09-18T01:25:50.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.549+0000 7f9932535800 1 -- start start 2024-09-18T01:25:50.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.549+0000 7f9927fff640 1 --2- 172.21.15.100:0/1238835225 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9808036b40 0x7f9808039000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55b178114710 tx=0x7f9918005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.550+0000 7f9932535800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782c3100 0x55b1782c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.550+0000 7f9932535800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b17803a580 con 0x55b1782c3100 2024-09-18T01:25:50.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.550+0000 7f992e2ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782c3100 0x55b1782c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.550+0000 7f992e2ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782c3100 0x55b1782c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52738/0 (socket says 172.21.15.100:52738) 2024-09-18T01:25:50.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.550+0000 7f992e2ee640 1 -- 172.21.15.100:0/3863429489 learned_addr learned my addr 172.21.15.100:0/3863429489 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.550+0000 7f992e2ee640 1 -- 172.21.15.100:0/3863429489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1782c3ad0 con 0x55b1782c3100 2024-09-18T01:25:50.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.550+0000 7f992e2ee640 1 --2- 172.21.15.100:0/3863429489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782c3100 0x55b1782c3500 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9920049d60 tx=0x7f992003fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a7121d4e93bb8b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.550+0000 7f9811ffb640 1 -- 172.21.15.100:0/3863429489 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f992003f480 con 0x55b1782c3100 2024-09-18T01:25:50.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.550+0000 7f9811ffb640 1 -- 172.21.15.100:0/3863429489 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9920051070 con 0x55b1782c3100 2024-09-18T01:25:50.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.550+0000 7f9811ffb640 1 -- 172.21.15.100:0/3863429489 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f992003f750 con 0x55b1782c3100 2024-09-18T01:25:50.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.551+0000 7f9932535800 1 -- 172.21.15.100:0/3863429489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782c3100 msgr2=0x55b1782c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.551+0000 7f9932535800 1 --2- 172.21.15.100:0/3863429489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782c3100 0x55b1782c3500 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9920049d60 tx=0x7f992003fe20 comp rx=0 tx=0).stop 2024-09-18T01:25:50.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.551+0000 7f9932535800 1 -- 172.21.15.100:0/3863429489 shutdown_connections 2024-09-18T01:25:50.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.551+0000 7f9932535800 1 --2- 172.21.15.100:0/3863429489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782c3100 0x55b1782c3500 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.551+0000 7f9932535800 1 -- 172.21.15.100:0/3863429489 >> 172.21.15.100:0/3863429489 conn(0x55b1782bf4b0 msgr2=0x55b1782bd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.551+0000 7f9932535800 1 -- 172.21.15.100:0/3863429489 shutdown_connections 2024-09-18T01:25:50.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.551+0000 7f9932535800 1 -- 172.21.15.100:0/3863429489 wait complete. 2024-09-18T01:25:50.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.551+0000 7f9932535800 1 Processor -- start 2024-09-18T01:25:50.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.551+0000 7f9932535800 1 -- start start 2024-09-18T01:25:50.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.551+0000 7f9932535800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782c3100 0x55b1782ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.551+0000 7f9932535800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b1782c3ad0 con 0x55b1782c3100 2024-09-18T01:25:50.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.552+0000 7f992e2ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782c3100 0x55b1782ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.552+0000 7f992e2ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782c3100 0x55b1782ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52750/0 (socket says 172.21.15.100:52750) 2024-09-18T01:25:50.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.552+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 learned_addr learned my addr 172.21.15.100:0/1174290481 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.552+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1782ca710 con 0x55b1782c3100 2024-09-18T01:25:50.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.552+0000 7f992e2ee640 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782c3100 0x55b1782ca1d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f992003fee0 tx=0x7f9920034f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.552+0000 7f97fffff640 1 -- 172.21.15.100:0/1174290481 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f992004c400 con 0x55b1782c3100 2024-09-18T01:25:50.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.552+0000 7f97fffff640 1 -- 172.21.15.100:0/1174290481 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9920069030 con 0x55b1782c3100 2024-09-18T01:25:50.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.552+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1782ca710 con 0x55b1782c3100 2024-09-18T01:25:50.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.552+0000 7f97fffff640 1 -- 172.21.15.100:0/1174290481 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f992004c6d0 con 0x55b1782c3100 2024-09-18T01:25:50.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.552+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1782ca710 con 0x55b1782c3100 2024-09-18T01:25:50.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.553+0000 7f97fffff640 1 -- 172.21.15.100:0/1174290481 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9920060040 con 0x55b1782c3100 2024-09-18T01:25:50.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.553+0000 7f97fffff640 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f97f8036b40 0x7f97f8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.553+0000 7f97fffff640 1 -- 172.21.15.100:0/1174290481 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f992006fd30 con 0x55b1782c3100 2024-09-18T01:25:50.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.553+0000 7f9927fff640 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f97f8036b40 0x7f97f8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.554+0000 7f9927fff640 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f97f8036b40 0x7f97f8039000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9918053570 tx=0x7f9918053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.554+0000 7f9932535800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.554+0000 7f9932535800 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b1782d59b0 0x55b1782d7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.554+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d85c0 con 0x55b1782d59b0 2024-09-18T01:25:50.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.554+0000 7f992eaef640 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b1782d59b0 0x55b1782d7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.554+0000 7f992eaef640 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b1782d59b0 0x55b1782d7e70 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 20 realm 2024-09-18T01:25:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d89d0 con 0x55b1782d59b0 2024-09-18T01:25:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d92a0 con 0x55b1782d59b0 2024-09-18T01:25:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782d59b0 2024-09-18T01:25:50.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:50.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b1782da3a0 0x55b1782dc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.555+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782dcda0 con 0x55b1782da3a0 2024-09-18T01:25:50.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.556+0000 7f992e2ee640 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b1782da3a0 0x55b1782dc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.556+0000 7f992e2ee640 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b1782da3a0 0x55b1782dc790 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.556+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.556+0000 7f9932535800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:50.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.556+0000 7f9932535800 20 searching for the correct realm 2024-09-18T01:25:50.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.556+0000 7f9932535800 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b1782ded50 0x55b1782e1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.556+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e18e0 con 0x55b1782ded50 2024-09-18T01:25:50.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.556+0000 7f9927fff640 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b1782ded50 0x55b1782e1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.556+0000 7f9927fff640 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b1782ded50 0x55b1782e1210 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.557+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9918051070 con 0x55b1782ded50 2024-09-18T01:25:50.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.557+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e18e0 con 0x55b1782da3a0 2024-09-18T01:25:50.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.557+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.557+0000 7f992e2ee640 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f992003e070 0x7f99200245c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.557+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e18e0 con 0x7f992003e070 2024-09-18T01:25:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.557+0000 7f992eaef640 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f992003e070 0x7f99200245c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.558+0000 7f992eaef640 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f992003e070 0x7f99200245c0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.558+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.558+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782d59b0 2024-09-18T01:25:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.558+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.558+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782d59b0 2024-09-18T01:25:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.558+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.558+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x7f992003e070 2024-09-18T01:25:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.559+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.559+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x7f992003e070 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.559+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.559+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782da3a0 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.559+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.559+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782ded50 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.559+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9918051070 con 0x55b1782ded50 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.559+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782d59b0 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.560+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.560+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782da3a0 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.560+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.560+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782d59b0 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.560+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.560+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782da3a0 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.560+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.560+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782ded50 2024-09-18T01:25:50.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.561+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9918051070 con 0x55b1782ded50 2024-09-18T01:25:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.561+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782ded50 2024-09-18T01:25:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.561+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9918051070 con 0x55b1782ded50 2024-09-18T01:25:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.561+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x7f992003e070 2024-09-18T01:25:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.561+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.561+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782ded50 2024-09-18T01:25:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.561+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9918051070 con 0x55b1782ded50 2024-09-18T01:25:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.561+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782ded50 2024-09-18T01:25:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.561+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9918051070 con 0x55b1782ded50 2024-09-18T01:25:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.561+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782d59b0 2024-09-18T01:25:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.562+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.562+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782d59b0 2024-09-18T01:25:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.562+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.562+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x7f992003e070 2024-09-18T01:25:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.562+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.562+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782ded50 2024-09-18T01:25:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.562+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9918051070 con 0x55b1782ded50 2024-09-18T01:25:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.562+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782da3a0 2024-09-18T01:25:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.563+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.563+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782d59b0 2024-09-18T01:25:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.563+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.563+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x7f992003e070 2024-09-18T01:25:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.563+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.563+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782ded50 2024-09-18T01:25:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.564+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9918051070 con 0x55b1782ded50 2024-09-18T01:25:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.564+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782da3a0 2024-09-18T01:25:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.564+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.564+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782da3a0 2024-09-18T01:25:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.564+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.564+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782ded50 2024-09-18T01:25:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.564+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9918051070 con 0x55b1782ded50 2024-09-18T01:25:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.564+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x7f992003e070 2024-09-18T01:25:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782d59b0 2024-09-18T01:25:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b1782d9640 con 0x55b1782da3a0 2024-09-18T01:25:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f9932535800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f9932535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f9932535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f9932535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f9932535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f9932535800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f9932535800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782dd660 con 0x55b1782d59b0 2024-09-18T01:25:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f9932535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f9932535800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782dda50 con 0x55b1782d59b0 2024-09-18T01:25:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f9932535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f9932535800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.565+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782dda50 con 0x7f992003e070 2024-09-18T01:25:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 20 zone default found 2024-09-18T01:25:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 4 Realm: () 2024-09-18T01:25:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 20 zonegroup default 2024-09-18T01:25:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782dd2b0 con 0x7f992003e070 2024-09-18T01:25:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e37a0 con 0x55b1782ded50 2024-09-18T01:25:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9918051070 con 0x55b1782ded50 2024-09-18T01:25:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.566+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e3c30 con 0x55b1782ded50 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.567+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9918051070 con 0x55b1782ded50 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.567+0000 7f9932535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.567+0000 7f9932535800 20 started sync module instance, tier type = 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.567+0000 7f9932535800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.567+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e2be0 con 0x55b1782da3a0 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.568+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.568+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94220713865168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e2840 con 0x55b1782da3a0 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.568+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e4a70 con 0x55b1782d59b0 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.569+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94220713865168] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.569+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.569+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94220713869456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e4e60 con 0x55b1782d59b0 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.569+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e5880 con 0x55b1782ded50 2024-09-18T01:25:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.570+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94220713869456] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.571+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9918051070 con 0x55b1782ded50 2024-09-18T01:25:50.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.571+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94220713874288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e5c70 con 0x55b1782ded50 2024-09-18T01:25:50.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.571+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e66a0 con 0x55b1782da3a0 2024-09-18T01:25:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.572+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94220713874288] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9918051070 con 0x55b1782ded50 2024-09-18T01:25:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.572+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.572+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94220713870512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e6f70 con 0x55b1782da3a0 2024-09-18T01:25:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.572+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e7930 con 0x55b1782d59b0 2024-09-18T01:25:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.573+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94220713870512] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.573+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.573+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94220713880736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e7930 con 0x55b1782d59b0 2024-09-18T01:25:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.573+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e82f0 con 0x7f992003e070 2024-09-18T01:25:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.574+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94220713880736] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.574+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.574+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94220713883232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e82f0 con 0x7f992003e070 2024-09-18T01:25:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.574+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e8cf0 con 0x7f992003e070 2024-09-18T01:25:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.575+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94220713883232] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.575+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.575+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94220713887744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e8ed0 con 0x7f992003e070 2024-09-18T01:25:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.575+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e9720 con 0x7f992003e070 2024-09-18T01:25:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.576+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94220713887744] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.577+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.577+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94220713889488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e97a0 con 0x7f992003e070 2024-09-18T01:25:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.577+0000 7f9932535800 20 add_watcher() i=0 2024-09-18T01:25:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.577+0000 7f9932535800 20 add_watcher() i=1 2024-09-18T01:25:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.577+0000 7f9932535800 20 add_watcher() i=2 2024-09-18T01:25:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.577+0000 7f9932535800 20 add_watcher() i=3 2024-09-18T01:25:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.577+0000 7f9932535800 20 add_watcher() i=4 2024-09-18T01:25:50.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.577+0000 7f9932535800 20 add_watcher() i=5 2024-09-18T01:25:50.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.577+0000 7f9932535800 20 add_watcher() i=6 2024-09-18T01:25:50.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.578+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94220713889488] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.578+0000 7f9932535800 20 add_watcher() i=7 2024-09-18T01:25:50.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.578+0000 7f9932535800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:50.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.578+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1782ecac0 con 0x55b1782d59b0 2024-09-18T01:25:50.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.578+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.578+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94220713890912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e9d30 con 0x55b1782d59b0 2024-09-18T01:25:50.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.579+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94220713890912] v35'193 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.579+0000 7f97e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:50.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.579+0000 7f9932535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:50.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.579+0000 7f9932535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:50.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.579+0000 7f9932535800 5 note: GC not initialized 2024-09-18T01:25:50.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.579+0000 7f975f7fe640 20 reqs_thread_entry: start 2024-09-18T01:25:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.579+0000 7f9932535800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.580+0000 7f9932535800 20 Filter name: none 2024-09-18T01:25:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.580+0000 7f975d7fa640 20 reqs_thread_entry: start 2024-09-18T01:25:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.580+0000 7f9932535800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.580+0000 7f9932535800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.580+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b17831ff40 con 0x55b1782d59b0 2024-09-18T01:25:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.580+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.580+0000 7f9932535800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.580+0000 7f9932535800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.580+0000 7f9932535800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.580+0000 7f9932535800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.580+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b178326190 con 0x55b1782d59b0 2024-09-18T01:25:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.581+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v35'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.581+0000 7f9932535800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.581+0000 7f9932535800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.581+0000 7f9932535800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.581+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94220714138480 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b1783219c0 con 0x55b1782d59b0 2024-09-18T01:25:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.582+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== watch-notify(notify (1) cookie 94220713880736 notify 150323855394 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f9928018c10 con 0x55b1782d59b0 2024-09-18T01:25:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.582+0000 7f9811ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855394 cookie 94220713880736 notifier 4664 bl.length()=579 2024-09-18T01:25:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.582+0000 7f9811ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.582+0000 7f9811ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.582+0000 7f9811ffb640 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f97f4003ea0 con 0x55b1782d59b0 2024-09-18T01:25:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.582+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(64 notify.4 [notify cookie 94220714138480 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.582+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.582+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== watch-notify(notify_complete (2) cookie 94220714138480 notify 150323855394 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9928018de0 con 0x55b1782d59b0 2024-09-18T01:25:50.595 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:50.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.583+0000 7f97e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:50.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.583+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94220713890912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b17831dcb0 con 0x55b1782d59b0 2024-09-18T01:25:50.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.584+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94220713890912] v35'194 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.584+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94220713865168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b17831dcb0 con 0x55b1782da3a0 2024-09-18T01:25:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.585+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94220713865168] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.585+0000 7f9932535800 20 remove_watcher() i=0 2024-09-18T01:25:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.585+0000 7f9932535800 2 removed watcher, disabling cache 2024-09-18T01:25:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.585+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94220713869456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b17831dcb0 con 0x55b1782d59b0 2024-09-18T01:25:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.586+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94220713869456] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.586+0000 7f9932535800 20 remove_watcher() i=1 2024-09-18T01:25:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.586+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94220713874288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b17831dcb0 con 0x55b1782ded50 2024-09-18T01:25:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.588+0000 7f9927fff640 1 -- 172.21.15.100:0/1174290481 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94220713874288] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9918051070 con 0x55b1782ded50 2024-09-18T01:25:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.588+0000 7f9932535800 20 remove_watcher() i=2 2024-09-18T01:25:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.588+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94220713870512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e2fd0 con 0x55b1782da3a0 2024-09-18T01:25:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.589+0000 7f992e2ee640 1 -- 172.21.15.100:0/1174290481 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94220713870512] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9920075070 con 0x55b1782da3a0 2024-09-18T01:25:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.589+0000 7f9932535800 20 remove_watcher() i=3 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.589+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94220713880736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e4540 con 0x55b1782d59b0 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.590+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94220713880736] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x55b1782d59b0 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.590+0000 7f9932535800 20 remove_watcher() i=4 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.590+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94220713883232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e5370 con 0x7f992003e070 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.591+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94220713883232] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.591+0000 7f9932535800 20 remove_watcher() i=5 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.591+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94220713887744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e6ca0 con 0x7f992003e070 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.592+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94220713887744] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.592+0000 7f9932535800 20 remove_watcher() i=6 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.592+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94220713889488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b1782e5370 con 0x7f992003e070 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.593+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94220713889488] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992800a4a0 con 0x7f992003e070 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.593+0000 7f9932535800 20 remove_watcher() i=7 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f992003e070 msgr2=0x7f99200245c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f992003e070 0x7f99200245c0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b1782d59b0 msgr2=0x55b1782d7e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b1782d59b0 0x55b1782d7e70 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b1782da3a0 msgr2=0x55b1782dc790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b1782da3a0 0x55b1782dc790 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b1782ded50 msgr2=0x55b1782e1210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b1782ded50 0x55b1782e1210 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f97f8036b40 msgr2=0x7f97f8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f97f8036b40 0x7f97f8039000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9918053570 tx=0x7f9918053000 comp rx=0 tx=0).stop 2024-09-18T01:25:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782c3100 msgr2=0x55b1782ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f992eaef640 1 -- 172.21.15.100:0/1174290481 reap_dead start 2024-09-18T01:25:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782c3100 0x55b1782ca1d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f992003fee0 tx=0x7f9920034f90 comp rx=0 tx=0).stop 2024-09-18T01:25:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 shutdown_connections 2024-09-18T01:25:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 --2- 172.21.15.100:0/1174290481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782c3100 0x55b1782ca1d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 >> 172.21.15.100:0/1174290481 conn(0x55b1782bf4b0 msgr2=0x55b1782bd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 shutdown_connections 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1174290481 wait complete. 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1238835225 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9808036b40 msgr2=0x7f9808039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 --2- 172.21.15.100:0/1238835225 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9808036b40 0x7f9808039000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55b178114710 tx=0x7f9918005a00 comp rx=0 tx=0).stop 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1238835225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782b6660 msgr2=0x55b1782b6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 --2- 172.21.15.100:0/1238835225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782b6660 0x55b1782b6a80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9920001750 tx=0x7f992002c4e0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1238835225 shutdown_connections 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 --2- 172.21.15.100:0/1238835225 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9808036b40 0x7f9808039000 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 --2- 172.21.15.100:0/1238835225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1782b6660 0x55b1782b6a80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1238835225 >> 172.21.15.100:0/1238835225 conn(0x55b1782ab5f0 msgr2=0x55b1782ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1238835225 shutdown_connections 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.594+0000 7f9932535800 1 -- 172.21.15.100:0/1238835225 wait complete. 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b1782a5dd0 msgr2=0x55b1782a81c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f9932535800 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b1782a5dd0 0x55b1782a81c0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b1781a3a10 msgr2=0x55b17829f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f9932535800 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b1781a3a10 0x55b17829f640 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b1782a1d20 msgr2=0x55b1782a41e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f9932535800 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b1782a1d20 0x55b1782a41e0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9814036b40 msgr2=0x7f9814039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f9932535800 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9814036b40 0x7f9814039000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9918057000 tx=0x7f9918052000 comp rx=0 tx=0).stop 2024-09-18T01:25:50.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b17819f710 msgr2=0x55b1781156e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f9932535800 1 --2- 172.21.15.100:0/765853059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b17819f710 0x55b1781156e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9920001e10 tx=0x7f9920000ed0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f992eaef640 1 -- 172.21.15.100:0/765853059 reap_dead start 2024-09-18T01:25:50.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 shutdown_connections 2024-09-18T01:25:50.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 >> 172.21.15.100:0/765853059 conn(0x55b17819afe0 msgr2=0x55b178288ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 shutdown_connections 2024-09-18T01:25:50.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.595+0000 7f9932535800 1 -- 172.21.15.100:0/765853059 wait complete. 2024-09-18T01:25:50.605 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:50.605 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-18T01:25:50.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-18T01:25:50.606 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-18T01:25:50.651 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:50.651 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:50.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.651+0000 7fca13811800 1 Processor -- start 2024-09-18T01:25:50.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.651+0000 7fca13811800 1 -- start start 2024-09-18T01:25:50.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.651+0000 7fca13811800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5635268a4630 0x563526935600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.651+0000 7fca13811800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5635267efb30 con 0x563526935b40 2024-09-18T01:25:50.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.651+0000 7fca13811800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5635267d1360 con 0x5635268a4630 2024-09-18T01:25:50.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.652+0000 7fca0ee67640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5635268a4630 0x563526935600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.652+0000 7fca0e666640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x563526935b40 0x563526937f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:43748/0 (socket says 172.21.15.100:43748) 2024-09-18T01:25:50.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.652+0000 7fca0e666640 1 -- 172.21.15.100:0/235026877 learned_addr learned my addr 172.21.15.100:0/235026877 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:50.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.652+0000 7fca0ee67640 1 --2- 172.21.15.100:0/235026877 >> v2:172.21.15.92:3300/0 conn(0x5635268a4630 0x563526935600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52766/0 (socket says 172.21.15.100:52766) 2024-09-18T01:25:50.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.652+0000 7fca0ee67640 1 -- 172.21.15.100:0/235026877 >> v1:172.21.15.92:6789/0 conn(0x563526935b40 legacy=0x563526937f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.652+0000 7fca0ee67640 1 -- 172.21.15.100:0/235026877 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635267f7e00 con 0x5635268a4630 2024-09-18T01:25:50.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.654+0000 7fca0ee67640 1 --2- 172.21.15.100:0/235026877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635268a4630 0x563526935600 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fca0000a470 tx=0x7fca00045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343d3f92713d10bb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.654+0000 7fca0de65640 1 -- 172.21.15.100:0/235026877 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca00053570 con 0x5635268a4630 2024-09-18T01:25:50.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.654+0000 7fca0de65640 1 -- 172.21.15.100:0/235026877 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca00058070 con 0x5635268a4630 2024-09-18T01:25:50.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.654+0000 7fca0de65640 1 -- 172.21.15.100:0/235026877 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca00053880 con 0x5635268a4630 2024-09-18T01:25:50.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.655+0000 7fca13811800 1 -- 172.21.15.100:0/235026877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635268a4630 msgr2=0x563526935600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.655+0000 7fca13811800 1 --2- 172.21.15.100:0/235026877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635268a4630 0x563526935600 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fca0000a470 tx=0x7fca00045a20 comp rx=0 tx=0).stop 2024-09-18T01:25:50.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.655+0000 7fca13811800 1 -- 172.21.15.100:0/235026877 shutdown_connections 2024-09-18T01:25:50.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.655+0000 7fca13811800 1 --2- 172.21.15.100:0/235026877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635268a4630 0x563526935600 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.655+0000 7fca13811800 1 -- 172.21.15.100:0/235026877 >> 172.21.15.100:0/235026877 conn(0x56352692adb0 msgr2=0x56352692d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.655+0000 7fca13811800 1 -- 172.21.15.100:0/235026877 shutdown_connections 2024-09-18T01:25:50.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.655+0000 7fca13811800 1 -- 172.21.15.100:0/235026877 wait complete. 2024-09-18T01:25:50.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.668+0000 7fca13811800 1 Processor -- start 2024-09-18T01:25:50.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.668+0000 7fca13811800 1 -- start start 2024-09-18T01:25:50.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.668+0000 7fca13811800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635268a4630 0x563526a21a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.668+0000 7fca13811800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56352687c360 con 0x5635268a4630 2024-09-18T01:25:50.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.669+0000 7fca0ee67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635268a4630 0x563526a21a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.669+0000 7fca0ee67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635268a4630 0x563526a21a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52778/0 (socket says 172.21.15.100:52778) 2024-09-18T01:25:50.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.669+0000 7fca0ee67640 1 -- 172.21.15.100:0/1163083448 learned_addr learned my addr 172.21.15.100:0/1163083448 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.669+0000 7fca0ee67640 1 -- 172.21.15.100:0/1163083448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635267c9bc0 con 0x5635268a4630 2024-09-18T01:25:50.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.669+0000 7fca0ee67640 1 --2- 172.21.15.100:0/1163083448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635268a4630 0x563526a21a70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fca00025c20 tx=0x7fca00051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e2784bf906510d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.669+0000 7fc8fce09640 1 -- 172.21.15.100:0/1163083448 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca00053ba0 con 0x5635268a4630 2024-09-18T01:25:50.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.669+0000 7fc8fce09640 1 -- 172.21.15.100:0/1163083448 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca00063030 con 0x5635268a4630 2024-09-18T01:25:50.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.669+0000 7fc8fce09640 1 -- 172.21.15.100:0/1163083448 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca00053440 con 0x5635268a4630 2024-09-18T01:25:50.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.670+0000 7fca13811800 1 -- 172.21.15.100:0/1163083448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635268a4630 msgr2=0x563526a21a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.670+0000 7fca13811800 1 --2- 172.21.15.100:0/1163083448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635268a4630 0x563526a21a70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fca00025c20 tx=0x7fca00051000 comp rx=0 tx=0).stop 2024-09-18T01:25:50.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.670+0000 7fca13811800 1 -- 172.21.15.100:0/1163083448 shutdown_connections 2024-09-18T01:25:50.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.670+0000 7fca13811800 1 --2- 172.21.15.100:0/1163083448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635268a4630 0x563526a21a70 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.670+0000 7fca13811800 1 -- 172.21.15.100:0/1163083448 >> 172.21.15.100:0/1163083448 conn(0x56352692adb0 msgr2=0x563526a1d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.670+0000 7fca13811800 1 -- 172.21.15.100:0/1163083448 shutdown_connections 2024-09-18T01:25:50.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.670+0000 7fca13811800 1 -- 172.21.15.100:0/1163083448 wait complete. 2024-09-18T01:25:50.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.670+0000 7fca13811800 1 Processor -- start 2024-09-18T01:25:50.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.670+0000 7fca13811800 1 -- start start 2024-09-18T01:25:50.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.671+0000 7fca13811800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526935b40 0x563526a294d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.671+0000 7fca13811800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563526939920 con 0x563526935b40 2024-09-18T01:25:50.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.671+0000 7fca0ee67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526935b40 0x563526a294d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.671+0000 7fca0ee67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526935b40 0x563526a294d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52782/0 (socket says 172.21.15.100:52782) 2024-09-18T01:25:50.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.671+0000 7fca0ee67640 1 -- 172.21.15.100:0/3624358760 learned_addr learned my addr 172.21.15.100:0/3624358760 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.671+0000 7fca0ee67640 1 -- 172.21.15.100:0/3624358760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635267ddfe0 con 0x563526935b40 2024-09-18T01:25:50.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.671+0000 7fca0ee67640 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526935b40 0x563526a294d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x563526a228d0 tx=0x7fca00002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.671+0000 7fc8fb606640 1 -- 172.21.15.100:0/3624358760 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca00078070 con 0x563526935b40 2024-09-18T01:25:50.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.672+0000 7fc8fb606640 1 -- 172.21.15.100:0/3624358760 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca00053440 con 0x563526935b40 2024-09-18T01:25:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.672+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563526a29a10 con 0x563526935b40 2024-09-18T01:25:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.672+0000 7fc8fb606640 1 -- 172.21.15.100:0/3624358760 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca00053720 con 0x563526935b40 2024-09-18T01:25:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.672+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563526a29f90 con 0x563526935b40 2024-09-18T01:25:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.672+0000 7fc8fb606640 1 -- 172.21.15.100:0/3624358760 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca0007b070 con 0x563526935b40 2024-09-18T01:25:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.673+0000 7fc8fb606640 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8f4036b40 0x7fc8f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.673+0000 7fc8fb606640 1 -- 172.21.15.100:0/3624358760 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fca00070070 con 0x563526935b40 2024-09-18T01:25:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.673+0000 7fca0e666640 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8f4036b40 0x7fc8f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.673+0000 7fca13811800 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563526a2e530 0x563526a30920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.673+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a30f40 con 0x563526a2e530 2024-09-18T01:25:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.673+0000 7fca0f668640 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563526a2e530 0x563526a30920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.673+0000 7fca0e666640 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8f4036b40 0x7fc8f4039000 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8000f60 tx=0x7fc9f80012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.673+0000 7fca0f668640 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563526a2e530 0x563526a30920 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.674+0000 7fca0f668640 1 -- 172.21.15.100:0/3624358760 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a2e530 2024-09-18T01:25:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.674+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a2db10 con 0x563526a2e530 2024-09-18T01:25:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.674+0000 7fca0f668640 1 -- 172.21.15.100:0/3624358760 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a2e530 2024-09-18T01:25:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.674+0000 7fca13811800 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563526a33290 0x563526a35680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.674+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a35d70 con 0x563526a33290 2024-09-18T01:25:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.674+0000 7fca0ee67640 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563526a33290 0x563526a35680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.674+0000 7fca0ee67640 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563526a33290 0x563526a35680 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.675+0000 7fca0ee67640 1 -- 172.21.15.100:0/3624358760 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca0007a030 con 0x563526a33290 2024-09-18T01:25:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.675+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a32130 con 0x563526a2e530 2024-09-18T01:25:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.675+0000 7fca0f668640 1 -- 172.21.15.100:0/3624358760 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a2e530 2024-09-18T01:25:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.675+0000 7fca13811800 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563526a371d0 0x563526a395c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.675+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a39cc0 con 0x563526a371d0 2024-09-18T01:25:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.675+0000 7fca0e666640 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563526a371d0 0x563526a395c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.676+0000 7fca0e666640 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563526a371d0 0x563526a395c0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.676+0000 7fca0e666640 1 -- 172.21.15.100:0/3624358760 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a371d0 2024-09-18T01:25:50.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.676+0000 7fca13811800 1 Processor -- start 2024-09-18T01:25:50.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.676+0000 7fca13811800 1 -- start start 2024-09-18T01:25:50.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.676+0000 7fca13811800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a47a70 0x563526a47e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.676+0000 7fca13811800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5635267cb580 con 0x563526a47a70 2024-09-18T01:25:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.677+0000 7fca0ee67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a47a70 0x563526a47e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.677+0000 7fca0ee67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a47a70 0x563526a47e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52794/0 (socket says 172.21.15.100:52794) 2024-09-18T01:25:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.677+0000 7fca0ee67640 1 -- 172.21.15.100:0/2815251969 learned_addr learned my addr 172.21.15.100:0/2815251969 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.677+0000 7fca0ee67640 1 -- 172.21.15.100:0/2815251969 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563526a483d0 con 0x563526a47a70 2024-09-18T01:25:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.677+0000 7fca0ee67640 1 --2- 172.21.15.100:0/2815251969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a47a70 0x563526a47e90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fca0006afd0 tx=0x7fca00009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.677+0000 7fc8f8e01640 1 -- 172.21.15.100:0/2815251969 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca00094030 con 0x563526a47a70 2024-09-18T01:25:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.677+0000 7fc8f8e01640 1 -- 172.21.15.100:0/2815251969 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0005e630 con 0x563526a47a70 2024-09-18T01:25:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.677+0000 7fc8f8e01640 1 -- 172.21.15.100:0/2815251969 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca00009720 con 0x563526a47a70 2024-09-18T01:25:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.677+0000 7fca13811800 1 -- 172.21.15.100:0/2815251969 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563526a48660 con 0x563526a47a70 2024-09-18T01:25:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.678+0000 7fca13811800 1 -- 172.21.15.100:0/2815251969 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563526a48660 con 0x563526a47a70 2024-09-18T01:25:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.678+0000 7fc8f8e01640 1 -- 172.21.15.100:0/2815251969 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca00097070 con 0x563526a47a70 2024-09-18T01:25:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.678+0000 7fc8f8e01640 1 --2- 172.21.15.100:0/2815251969 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8e8036b90 0x7fc8e8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.678+0000 7fc8f8e01640 1 -- 172.21.15.100:0/2815251969 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fca00095070 con 0x563526a47a70 2024-09-18T01:25:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.678+0000 7fca0e666640 1 --2- 172.21.15.100:0/2815251969 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8e8036b90 0x7fc8e8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.679+0000 7fca13811800 1 Processor -- start 2024-09-18T01:25:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.679+0000 7fca13811800 1 -- start start 2024-09-18T01:25:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.679+0000 7fca0e666640 1 --2- 172.21.15.100:0/2815251969 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8e8036b90 0x7fc8e8039050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800bf50 tx=0x7fc9f800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.679+0000 7fca13811800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a54370 0x563526a54770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.679+0000 7fca13811800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563526a221c0 con 0x563526a54370 2024-09-18T01:25:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.679+0000 7fca0ee67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a54370 0x563526a54770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.679+0000 7fca0ee67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a54370 0x563526a54770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52796/0 (socket says 172.21.15.100:52796) 2024-09-18T01:25:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.679+0000 7fca0ee67640 1 -- 172.21.15.100:0/1112336797 learned_addr learned my addr 172.21.15.100:0/1112336797 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.679+0000 7fca0ee67640 1 -- 172.21.15.100:0/1112336797 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563526a54d40 con 0x563526a54370 2024-09-18T01:25:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.680+0000 7fca0ee67640 1 --2- 172.21.15.100:0/1112336797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a54370 0x563526a54770 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fca0009bfd0 tx=0x7fca0005aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ace9f6bfb4fbcf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.680+0000 7fc8f27fc640 1 -- 172.21.15.100:0/1112336797 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca000098c0 con 0x563526a54370 2024-09-18T01:25:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.680+0000 7fc8f27fc640 1 -- 172.21.15.100:0/1112336797 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca000ad070 con 0x563526a54370 2024-09-18T01:25:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.680+0000 7fc8f27fc640 1 -- 172.21.15.100:0/1112336797 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca0006ae10 con 0x563526a54370 2024-09-18T01:25:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.680+0000 7fca13811800 1 -- 172.21.15.100:0/1112336797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a54370 msgr2=0x563526a54770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.680+0000 7fca13811800 1 --2- 172.21.15.100:0/1112336797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a54370 0x563526a54770 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fca0009bfd0 tx=0x7fca0005aa10 comp rx=0 tx=0).stop 2024-09-18T01:25:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.680+0000 7fca13811800 1 -- 172.21.15.100:0/1112336797 shutdown_connections 2024-09-18T01:25:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.680+0000 7fca13811800 1 --2- 172.21.15.100:0/1112336797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a54370 0x563526a54770 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.680+0000 7fca13811800 1 -- 172.21.15.100:0/1112336797 >> 172.21.15.100:0/1112336797 conn(0x563526a50720 msgr2=0x563526a4e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.681+0000 7fca13811800 1 -- 172.21.15.100:0/1112336797 shutdown_connections 2024-09-18T01:25:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.681+0000 7fca13811800 1 -- 172.21.15.100:0/1112336797 wait complete. 2024-09-18T01:25:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.681+0000 7fca13811800 1 Processor -- start 2024-09-18T01:25:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.681+0000 7fca13811800 1 -- start start 2024-09-18T01:25:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.681+0000 7fca13811800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a54370 0x563526a5b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.681+0000 7fca13811800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563526a551d0 con 0x563526a54370 2024-09-18T01:25:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.681+0000 7fca0ee67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a54370 0x563526a5b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.681+0000 7fca0ee67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a54370 0x563526a5b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52812/0 (socket says 172.21.15.100:52812) 2024-09-18T01:25:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.681+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 learned_addr learned my addr 172.21.15.100:0/2953575202 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.682+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563526a5bbd0 con 0x563526a54370 2024-09-18T01:25:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.682+0000 7fca0ee67640 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a54370 0x563526a5b690 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fca000aa040 tx=0x7fca0008cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.682+0000 7fc8f0ff9640 1 -- 172.21.15.100:0/2953575202 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca0007ce20 con 0x563526a54370 2024-09-18T01:25:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.682+0000 7fc8f0ff9640 1 -- 172.21.15.100:0/2953575202 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0005ab30 con 0x563526a54370 2024-09-18T01:25:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.682+0000 7fc8f0ff9640 1 -- 172.21.15.100:0/2953575202 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca0007d8a0 con 0x563526a54370 2024-09-18T01:25:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.682+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563526a5bbd0 con 0x563526a54370 2024-09-18T01:25:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.682+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563526a5bbd0 con 0x563526a54370 2024-09-18T01:25:50.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.683+0000 7fc8f0ff9640 1 -- 172.21.15.100:0/2953575202 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca000c2060 con 0x563526a54370 2024-09-18T01:25:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.683+0000 7fc8f0ff9640 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8d8036b90 0x7fc8d8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.683+0000 7fc8f0ff9640 1 -- 172.21.15.100:0/2953575202 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fca00088030 con 0x563526a54370 2024-09-18T01:25:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.683+0000 7fca0e666640 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8d8036b90 0x7fc8d8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.684+0000 7fca0e666640 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8d8036b90 0x7fc8d8039050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8001b60 tx=0x7fc9f8010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.684+0000 7fca13811800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.684+0000 7fca13811800 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563526a66c20 0x563526a690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.684+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a69830 con 0x563526a66c20 2024-09-18T01:25:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.684+0000 7fca0f668640 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563526a66c20 0x563526a690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.684+0000 7fca0f668640 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563526a66c20 0x563526a690e0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.684+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.684+0000 7fca13811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.684+0000 7fca13811800 20 realm 2024-09-18T01:25:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.684+0000 7fca13811800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.684+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a69c40 con 0x563526a66c20 2024-09-18T01:25:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca13811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca13811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca13811800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a510 con 0x563526a66c20 2024-09-18T01:25:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca13811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca13811800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a66c20 2024-09-18T01:25:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca13811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca13811800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca13811800 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563526a6b610 0x563526a6da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a6e010 con 0x563526a6b610 2024-09-18T01:25:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca0ee67640 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563526a6b610 0x563526a6da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.685+0000 7fca0ee67640 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563526a6b610 0x563526a6da00 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.686+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.686+0000 7fca13811800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.686+0000 7fca13811800 20 searching for the correct realm 2024-09-18T01:25:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.686+0000 7fca13811800 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563526a6ffc0 0x563526a72480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.686+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a72b50 con 0x563526a6ffc0 2024-09-18T01:25:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.686+0000 7fca0e666640 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563526a6ffc0 0x563526a72480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.686+0000 7fca0e666640 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563526a6ffc0 0x563526a72480 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.686+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a6ffc0 2024-09-18T01:25:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.686+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a72b50 con 0x563526a6b610 2024-09-18T01:25:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.687+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.687+0000 7fca0ee67640 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fca0005e880 0x7fca0004e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.687+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a72b50 con 0x7fca0005e880 2024-09-18T01:25:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.687+0000 7fca0f668640 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fca0005e880 0x7fca0004e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.687+0000 7fca0f668640 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fca0005e880 0x7fca0004e140 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.687+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.687+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a66c20 2024-09-18T01:25:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.688+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.688+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a66c20 2024-09-18T01:25:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.688+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.688+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x7fca0005e880 2024-09-18T01:25:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.688+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.688+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x7fca0005e880 2024-09-18T01:25:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.689+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.689+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6b610 2024-09-18T01:25:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.689+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.689+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6ffc0 2024-09-18T01:25:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.689+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a6ffc0 2024-09-18T01:25:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.689+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a66c20 2024-09-18T01:25:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.689+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.689+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6b610 2024-09-18T01:25:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.689+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.689+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a66c20 2024-09-18T01:25:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.690+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.690+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6b610 2024-09-18T01:25:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.690+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.690+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6ffc0 2024-09-18T01:25:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.690+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a6ffc0 2024-09-18T01:25:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.690+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6ffc0 2024-09-18T01:25:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.690+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a6ffc0 2024-09-18T01:25:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.690+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x7fca0005e880 2024-09-18T01:25:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.691+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.691+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6ffc0 2024-09-18T01:25:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.691+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a6ffc0 2024-09-18T01:25:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.691+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6ffc0 2024-09-18T01:25:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.691+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a6ffc0 2024-09-18T01:25:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.691+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a66c20 2024-09-18T01:25:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.691+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.691+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a66c20 2024-09-18T01:25:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.692+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.692+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x7fca0005e880 2024-09-18T01:25:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.692+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.692+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6ffc0 2024-09-18T01:25:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.692+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a6ffc0 2024-09-18T01:25:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.692+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6b610 2024-09-18T01:25:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.692+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.692+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a66c20 2024-09-18T01:25:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.693+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.693+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x7fca0005e880 2024-09-18T01:25:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.693+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.693+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6ffc0 2024-09-18T01:25:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.693+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a6ffc0 2024-09-18T01:25:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.693+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6b610 2024-09-18T01:25:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.693+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.693+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6b610 2024-09-18T01:25:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.694+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.694+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6ffc0 2024-09-18T01:25:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.694+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a6ffc0 2024-09-18T01:25:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.694+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x7fca0005e880 2024-09-18T01:25:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.694+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.694+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a66c20 2024-09-18T01:25:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.694+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.694+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563526a6a8b0 con 0x563526a6b610 2024-09-18T01:25:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca13811800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca13811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca13811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca13811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca13811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca13811800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca13811800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a6e8d0 con 0x563526a66c20 2024-09-18T01:25:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca13811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca13811800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a6ecc0 con 0x563526a66c20 2024-09-18T01:25:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca13811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca13811800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.695+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a6ecc0 con 0x7fca0005e880 2024-09-18T01:25:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 20 zone default found 2024-09-18T01:25:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 4 Realm: () 2024-09-18T01:25:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 20 zonegroup default 2024-09-18T01:25:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a72fd0 con 0x7fca0005e880 2024-09-18T01:25:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a749b0 con 0x563526a6ffc0 2024-09-18T01:25:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a6ffc0 2024-09-18T01:25:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a74d50 con 0x563526a6ffc0 2024-09-18T01:25:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.696+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a6ffc0 2024-09-18T01:25:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.697+0000 7fca13811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.697+0000 7fca13811800 20 started sync module instance, tier type = 2024-09-18T01:25:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.697+0000 7fca13811800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.697+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a73e50 con 0x563526a6b610 2024-09-18T01:25:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.698+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.698+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94786281748896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a750f0 con 0x563526a6b610 2024-09-18T01:25:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.698+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a75ab0 con 0x563526a66c20 2024-09-18T01:25:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.699+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94786281748896] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.699+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.699+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94786281756160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a75ed0 con 0x563526a66c20 2024-09-18T01:25:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.699+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a76890 con 0x563526a6ffc0 2024-09-18T01:25:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.700+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94786281756160] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.700+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a6ffc0 2024-09-18T01:25:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.700+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94786281757216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a75e40 con 0x563526a6ffc0 2024-09-18T01:25:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.700+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a77700 con 0x563526a6b610 2024-09-18T01:25:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.701+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.701+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94786281757216] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a6ffc0 2024-09-18T01:25:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.701+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94786281763408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a77f50 con 0x563526a6b610 2024-09-18T01:25:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.701+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a78910 con 0x563526a66c20 2024-09-18T01:25:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.702+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94786281763408] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.702+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.702+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94786281766016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a78910 con 0x563526a66c20 2024-09-18T01:25:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.703+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a792d0 con 0x7fca0005e880 2024-09-18T01:25:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.704+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94786281766016] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.704+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.704+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94786281768512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a792d0 con 0x7fca0005e880 2024-09-18T01:25:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.704+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a79c90 con 0x7fca0005e880 2024-09-18T01:25:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.705+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94786281768512] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.705+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.705+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94786281771008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a79c90 con 0x7fca0005e880 2024-09-18T01:25:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.705+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a7a650 con 0x7fca0005e880 2024-09-18T01:25:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.706+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94786281771008] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.706+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.706+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94786281773504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a7a650 con 0x7fca0005e880 2024-09-18T01:25:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.706+0000 7fca13811800 20 add_watcher() i=0 2024-09-18T01:25:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.706+0000 7fca13811800 20 add_watcher() i=1 2024-09-18T01:25:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.706+0000 7fca13811800 20 add_watcher() i=2 2024-09-18T01:25:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.706+0000 7fca13811800 20 add_watcher() i=3 2024-09-18T01:25:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.706+0000 7fca13811800 20 add_watcher() i=4 2024-09-18T01:25:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.706+0000 7fca13811800 20 add_watcher() i=5 2024-09-18T01:25:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.706+0000 7fca13811800 20 add_watcher() i=6 2024-09-18T01:25:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.707+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94786281773504] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.707+0000 7fca13811800 20 add_watcher() i=7 2024-09-18T01:25:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.707+0000 7fca13811800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.707+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526a7dae0 con 0x563526a66c20 2024-09-18T01:25:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.707+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.707+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94786281776144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a7aed0 con 0x563526a66c20 2024-09-18T01:25:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.708+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94786281776144] v35'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.709+0000 7fc8c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.709+0000 7fca13811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.709+0000 7fca13811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.709+0000 7fca13811800 5 note: GC not initialized 2024-09-18T01:25:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.709+0000 7fc83ffff640 20 reqs_thread_entry: start 2024-09-18T01:25:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.709+0000 7fca13811800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.709+0000 7fca13811800 20 Filter name: none 2024-09-18T01:25:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.709+0000 7fc83dffb640 20 reqs_thread_entry: start 2024-09-18T01:25:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.709+0000 7fca13811800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.709+0000 7fca13811800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.709+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526ab0f80 con 0x563526a66c20 2024-09-18T01:25:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.710+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.710+0000 7fca13811800 20 rados_obj.operate() r=0 bl.length=403 2024-09-18T01:25:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.710+0000 7fca13811800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.710+0000 7fca13811800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.710+0000 7fca13811800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.710+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526ab71e0 con 0x563526a66c20 2024-09-18T01:25:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.711+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v35'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.711+0000 7fca13811800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.711+0000 7fca13811800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.711+0000 7fca13811800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:25:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.711+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94786282023840 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563526ab2a00 con 0x563526a66c20 2024-09-18T01:25:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.711+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== watch-notify(notify (1) cookie 94786281766016 notify 150323855395 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fca08018c10 con 0x563526a66c20 2024-09-18T01:25:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.711+0000 7fc8f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855395 cookie 94786281766016 notifier 4671 bl.length()=567 2024-09-18T01:25:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.711+0000 7fc8f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:25:50.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.711+0000 7fc8f27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:50.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.711+0000 7fc8f27fc640 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc8d4003ea0 con 0x563526a66c20 2024-09-18T01:25:50.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.711+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(64 notify.4 [notify cookie 94786282023840 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.712+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== watch-notify(notify_complete (2) cookie 94786282023840 notify 150323855395 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fca08018de0 con 0x563526a66c20 2024-09-18T01:25:50.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.712+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.723 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:25:27.051941Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:25:27.051931Z","tags":[],"group_ids":[]} 2024-09-18T01:25:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.712+0000 7fc8c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.712+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94786281776144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526aaecf0 con 0x563526a66c20 2024-09-18T01:25:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.713+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94786281776144] v35'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.713+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94786281748896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526aaecf0 con 0x563526a6b610 2024-09-18T01:25:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.714+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94786281748896] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.714+0000 7fca13811800 20 remove_watcher() i=0 2024-09-18T01:25:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.714+0000 7fca13811800 2 removed watcher, disabling cache 2024-09-18T01:25:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.714+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94786281756160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526aaecf0 con 0x563526a66c20 2024-09-18T01:25:50.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.716+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94786281756160] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.716+0000 7fca13811800 20 remove_watcher() i=1 2024-09-18T01:25:50.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.716+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94786281757216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526aaecf0 con 0x563526a6ffc0 2024-09-18T01:25:50.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.717+0000 7fca0e666640 1 -- 172.21.15.100:0/2953575202 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94786281757216] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f8009050 con 0x563526a6ffc0 2024-09-18T01:25:50.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.717+0000 7fca13811800 20 remove_watcher() i=2 2024-09-18T01:25:50.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.717+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94786281763408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a739a0 con 0x563526a6b610 2024-09-18T01:25:50.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.718+0000 7fca0ee67640 1 -- 172.21.15.100:0/2953575202 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94786281763408] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0008b040 con 0x563526a6b610 2024-09-18T01:25:50.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.718+0000 7fca13811800 20 remove_watcher() i=3 2024-09-18T01:25:50.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.718+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94786281766016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a77250 con 0x563526a66c20 2024-09-18T01:25:50.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.720+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94786281766016] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x563526a66c20 2024-09-18T01:25:50.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.720+0000 7fca13811800 20 remove_watcher() i=4 2024-09-18T01:25:50.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.720+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94786281768512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a77c80 con 0x7fca0005e880 2024-09-18T01:25:50.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.721+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94786281768512] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.721+0000 7fca13811800 20 remove_watcher() i=5 2024-09-18T01:25:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.721+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94786281771008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a77c80 con 0x7fca0005e880 2024-09-18T01:25:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.722+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94786281771008] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.722+0000 7fca13811800 20 remove_watcher() i=6 2024-09-18T01:25:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.722+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94786281773504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563526a79000 con 0x7fca0005e880 2024-09-18T01:25:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94786281773504] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x7fca0005e880 2024-09-18T01:25:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 20 remove_watcher() i=7 2024-09-18T01:25:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fca0005e880 msgr2=0x7fca0004e140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fca0005e880 0x7fca0004e140 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563526a66c20 msgr2=0x563526a690e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563526a66c20 0x563526a690e0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563526a6b610 msgr2=0x563526a6da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563526a6b610 0x563526a6da00 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563526a6ffc0 msgr2=0x563526a72480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563526a6ffc0 0x563526a72480 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8d8036b90 msgr2=0x7fc8d8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8d8036b90 0x7fc8d8039050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8001b60 tx=0x7fc9f8010000 comp rx=0 tx=0).stop 2024-09-18T01:25:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a54370 msgr2=0x563526a5b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a54370 0x563526a5b690 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fca000aa040 tx=0x7fca0008cea0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca0f668640 1 -- 172.21.15.100:0/2953575202 reap_dead start 2024-09-18T01:25:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 shutdown_connections 2024-09-18T01:25:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 --2- 172.21.15.100:0/2953575202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a54370 0x563526a5b690 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 >> 172.21.15.100:0/2953575202 conn(0x563526a50720 msgr2=0x563526a4e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 shutdown_connections 2024-09-18T01:25:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 -- 172.21.15.100:0/2953575202 wait complete. 2024-09-18T01:25:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 -- 172.21.15.100:0/2815251969 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8e8036b90 msgr2=0x7fc8e8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 --2- 172.21.15.100:0/2815251969 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8e8036b90 0x7fc8e8039050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800bf50 tx=0x7fc9f800f000 comp rx=0 tx=0).stop 2024-09-18T01:25:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 -- 172.21.15.100:0/2815251969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a47a70 msgr2=0x563526a47e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.725+0000 7fca13811800 1 --2- 172.21.15.100:0/2815251969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a47a70 0x563526a47e90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fca0006afd0 tx=0x7fca00009cd0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 -- 172.21.15.100:0/2815251969 shutdown_connections 2024-09-18T01:25:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 --2- 172.21.15.100:0/2815251969 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8e8036b90 0x7fc8e8039050 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 --2- 172.21.15.100:0/2815251969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526a47a70 0x563526a47e90 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 -- 172.21.15.100:0/2815251969 >> 172.21.15.100:0/2815251969 conn(0x563526a3ca00 msgr2=0x563526a3f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 -- 172.21.15.100:0/2815251969 shutdown_connections 2024-09-18T01:25:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 -- 172.21.15.100:0/2815251969 wait complete. 2024-09-18T01:25:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563526a371d0 msgr2=0x563526a395c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563526a371d0 0x563526a395c0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563526a2e530 msgr2=0x563526a30920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563526a2e530 0x563526a30920 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563526a33290 msgr2=0x563526a35680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563526a33290 0x563526a35680 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8f4036b40 msgr2=0x7fc8f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc8f4036b40 0x7fc8f4039000 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8000f60 tx=0x7fc9f80012b0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526935b40 msgr2=0x563526a294d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 --2- 172.21.15.100:0/3624358760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563526935b40 0x563526a294d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x563526a228d0 tx=0x7fca00002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca0f668640 1 -- 172.21.15.100:0/3624358760 reap_dead start 2024-09-18T01:25:50.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 shutdown_connections 2024-09-18T01:25:50.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 >> 172.21.15.100:0/3624358760 conn(0x56352692adb0 msgr2=0x563526a1bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 shutdown_connections 2024-09-18T01:25:50.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.726+0000 7fca13811800 1 -- 172.21.15.100:0/3624358760 wait complete. 2024-09-18T01:25:50.736 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:25:27.051941Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:25:27.051931Z', 'tags': [], 'group_ids': []} 2024-09-18T01:25:50.747 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:50.748 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-18T01:25:50.748 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-18T01:25:50.748 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-18T01:25:50.792 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:25:50.792 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:25:50.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.792+0000 7f85fa119800 1 Processor -- start 2024-09-18T01:25:50.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.792+0000 7f85fa119800 1 -- start start 2024-09-18T01:25:50.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.792+0000 7f85fa119800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x563ab06885f0 0x563ab0717290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.792+0000 7f85fa119800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563ab05d3b30 con 0x563ab07177d0 2024-09-18T01:25:50.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.792+0000 7f85fa119800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x563ab05b5360 con 0x563ab06885f0 2024-09-18T01:25:50.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.792+0000 7f85f7c0d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x563ab06885f0 0x563ab0717290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.792+0000 7f85f740c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x563ab07177d0 0x563ab0719bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:43750/0 (socket says 172.21.15.100:43750) 2024-09-18T01:25:50.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.792+0000 7f85f740c640 1 -- 172.21.15.100:0/1842988944 learned_addr learned my addr 172.21.15.100:0/1842988944 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:25:50.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.793+0000 7f85f6c0b640 1 -- 172.21.15.100:0/1842988944 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1338023022 0 0) 0x563ab05d3b30 con 0x563ab07177d0 2024-09-18T01:25:50.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.793+0000 7f85f6c0b640 1 -- 172.21.15.100:0/1842988944 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85e0001e10 con 0x563ab07177d0 2024-09-18T01:25:50.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.793+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1842988944 >> v1:172.21.15.92:6789/0 conn(0x563ab07177d0 legacy=0x563ab0719bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.793+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1842988944 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ab05dbe00 con 0x563ab06885f0 2024-09-18T01:25:50.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.795+0000 7f85f7c0d640 1 --2- 172.21.15.100:0/1842988944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 0x563ab0717290 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f85e800a470 tx=0x7f85e8045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdd0dfe4c12c97e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.795+0000 7f85f6c0b640 1 -- 172.21.15.100:0/1842988944 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8059070 con 0x563ab06885f0 2024-09-18T01:25:50.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.795+0000 7f85f6c0b640 1 -- 172.21.15.100:0/1842988944 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e8054570 con 0x563ab06885f0 2024-09-18T01:25:50.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.795+0000 7f85f6c0b640 1 -- 172.21.15.100:0/1842988944 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8054870 con 0x563ab06885f0 2024-09-18T01:25:50.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.795+0000 7f85fa119800 1 -- 172.21.15.100:0/1842988944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 msgr2=0x563ab0717290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.795+0000 7f85fa119800 1 --2- 172.21.15.100:0/1842988944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 0x563ab0717290 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f85e800a470 tx=0x7f85e8045920 comp rx=0 tx=0).stop 2024-09-18T01:25:50.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.795+0000 7f85fa119800 1 -- 172.21.15.100:0/1842988944 shutdown_connections 2024-09-18T01:25:50.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.796+0000 7f85fa119800 1 --2- 172.21.15.100:0/1842988944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 0x563ab0717290 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.796+0000 7f85fa119800 1 -- 172.21.15.100:0/1842988944 >> 172.21.15.100:0/1842988944 conn(0x563ab070ede0 msgr2=0x563ab0711200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.796+0000 7f85fa119800 1 -- 172.21.15.100:0/1842988944 shutdown_connections 2024-09-18T01:25:50.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.796+0000 7f85fa119800 1 -- 172.21.15.100:0/1842988944 wait complete. 2024-09-18T01:25:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.809+0000 7f85fa119800 1 Processor -- start 2024-09-18T01:25:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.809+0000 7f85fa119800 1 -- start start 2024-09-18T01:25:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.809+0000 7f85fa119800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 0x563ab08036c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.809+0000 7f85fa119800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563ab0660330 con 0x563ab06885f0 2024-09-18T01:25:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.810+0000 7f85f7c0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 0x563ab08036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.810+0000 7f85f7c0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 0x563ab08036c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52836/0 (socket says 172.21.15.100:52836) 2024-09-18T01:25:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.810+0000 7f85f7c0d640 1 -- 172.21.15.100:0/3315213948 learned_addr learned my addr 172.21.15.100:0/3315213948 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.810+0000 7f85f7c0d640 1 -- 172.21.15.100:0/3315213948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ab05adbc0 con 0x563ab06885f0 2024-09-18T01:25:50.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.810+0000 7f85f7c0d640 1 --2- 172.21.15.100:0/3315213948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 0x563ab08036c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f85e8025b20 tx=0x7f85e804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5bea495b7813bc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.810+0000 7f84e5e0b640 1 -- 172.21.15.100:0/3315213948 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8062070 con 0x563ab06885f0 2024-09-18T01:25:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.810+0000 7f84e5e0b640 1 -- 172.21.15.100:0/3315213948 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e800a170 con 0x563ab06885f0 2024-09-18T01:25:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.810+0000 7f84e5e0b640 1 -- 172.21.15.100:0/3315213948 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8059040 con 0x563ab06885f0 2024-09-18T01:25:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.811+0000 7f85fa119800 1 -- 172.21.15.100:0/3315213948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 msgr2=0x563ab08036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.811+0000 7f85fa119800 1 --2- 172.21.15.100:0/3315213948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 0x563ab08036c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f85e8025b20 tx=0x7f85e804e000 comp rx=0 tx=0).stop 2024-09-18T01:25:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.811+0000 7f85fa119800 1 -- 172.21.15.100:0/3315213948 shutdown_connections 2024-09-18T01:25:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.811+0000 7f85fa119800 1 --2- 172.21.15.100:0/3315213948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 0x563ab08036c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.811+0000 7f85fa119800 1 -- 172.21.15.100:0/3315213948 >> 172.21.15.100:0/3315213948 conn(0x563ab070ede0 msgr2=0x563ab07ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.811+0000 7f85fa119800 1 -- 172.21.15.100:0/3315213948 shutdown_connections 2024-09-18T01:25:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.811+0000 7f85fa119800 1 -- 172.21.15.100:0/3315213948 wait complete. 2024-09-18T01:25:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.811+0000 7f85fa119800 1 Processor -- start 2024-09-18T01:25:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.811+0000 7f85fa119800 1 -- start start 2024-09-18T01:25:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.812+0000 7f85fa119800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 0x563ab080b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.812+0000 7f85fa119800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563ab071b670 con 0x563ab06885f0 2024-09-18T01:25:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.812+0000 7f85f7c0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 0x563ab080b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.812+0000 7f85f7c0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 0x563ab080b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52850/0 (socket says 172.21.15.100:52850) 2024-09-18T01:25:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.812+0000 7f85f7c0d640 1 -- 172.21.15.100:0/122819240 learned_addr learned my addr 172.21.15.100:0/122819240 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.812+0000 7f85f7c0d640 1 -- 172.21.15.100:0/122819240 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ab05c1fe0 con 0x563ab06885f0 2024-09-18T01:25:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.813+0000 7f85f7c0d640 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 0x563ab080b060 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f85e8045960 tx=0x7f85e8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.813+0000 7f84dffff640 1 -- 172.21.15.100:0/122819240 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e806c070 con 0x563ab06885f0 2024-09-18T01:25:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.813+0000 7f84dffff640 1 -- 172.21.15.100:0/122819240 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e8054bf0 con 0x563ab06885f0 2024-09-18T01:25:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.813+0000 7f84dffff640 1 -- 172.21.15.100:0/122819240 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8062070 con 0x563ab06885f0 2024-09-18T01:25:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.813+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ab080b5a0 con 0x563ab06885f0 2024-09-18T01:25:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.813+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ab080bac0 con 0x563ab06885f0 2024-09-18T01:25:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.814+0000 7f84dffff640 1 -- 172.21.15.100:0/122819240 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f85e8065040 con 0x563ab06885f0 2024-09-18T01:25:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.814+0000 7f84dffff640 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84e0036b90 0x7f84e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.814+0000 7f84dffff640 1 -- 172.21.15.100:0/122819240 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f85e808f400 con 0x563ab06885f0 2024-09-18T01:25:50.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.814+0000 7f85f740c640 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84e0036b90 0x7f84e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.814+0000 7f85fa119800 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563ab07177d0 0x563ab08120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.814+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab0812610 con 0x563ab07177d0 2024-09-18T01:25:50.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.814+0000 7f85f840e640 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563ab07177d0 0x563ab08120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.814+0000 7f85f740c640 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84e0036b90 0x7f84e0039050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f85ec000f60 tx=0x7f85ec0010a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.815+0000 7f85f840e640 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563ab07177d0 0x563ab08120d0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.815+0000 7f85f840e640 1 -- 172.21.15.100:0/122819240 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab07177d0 2024-09-18T01:25:50.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.815+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab080f680 con 0x563ab07177d0 2024-09-18T01:25:50.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.815+0000 7f85f840e640 1 -- 172.21.15.100:0/122819240 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab07177d0 2024-09-18T01:25:50.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.815+0000 7f85fa119800 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563ab0814900 0x563ab0816cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.815+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab0817390 con 0x563ab0814900 2024-09-18T01:25:50.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.815+0000 7f85f7c0d640 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563ab0814900 0x563ab0816cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.815+0000 7f85f7c0d640 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563ab0814900 0x563ab0816cf0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.816+0000 7f85f7c0d640 1 -- 172.21.15.100:0/122819240 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f85e805c040 con 0x563ab0814900 2024-09-18T01:25:50.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.816+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab08137a0 con 0x563ab07177d0 2024-09-18T01:25:50.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.816+0000 7f85f840e640 1 -- 172.21.15.100:0/122819240 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab07177d0 2024-09-18T01:25:50.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.816+0000 7f85fa119800 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563ab08187f0 0x563ab081abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.816+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab081b2e0 con 0x563ab08187f0 2024-09-18T01:25:50.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.816+0000 7f85f740c640 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563ab08187f0 0x563ab081abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.817+0000 7f85f740c640 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563ab08187f0 0x563ab081abe0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.817+0000 7f85f740c640 1 -- 172.21.15.100:0/122819240 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f85ec009050 con 0x563ab08187f0 2024-09-18T01:25:50.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.818+0000 7f85fa119800 1 Processor -- start 2024-09-18T01:25:50.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.818+0000 7f85fa119800 1 -- start start 2024-09-18T01:25:50.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.818+0000 7f85fa119800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab0829090 0x563ab08294b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.818+0000 7f85fa119800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563ab05af580 con 0x563ab0829090 2024-09-18T01:25:50.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.818+0000 7f85f7c0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab0829090 0x563ab08294b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.818+0000 7f85f7c0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab0829090 0x563ab08294b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52864/0 (socket says 172.21.15.100:52864) 2024-09-18T01:25:50.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.818+0000 7f85f7c0d640 1 -- 172.21.15.100:0/2427360287 learned_addr learned my addr 172.21.15.100:0/2427360287 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.818+0000 7f85f7c0d640 1 -- 172.21.15.100:0/2427360287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ab08299f0 con 0x563ab0829090 2024-09-18T01:25:50.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.819+0000 7f85f7c0d640 1 --2- 172.21.15.100:0/2427360287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab0829090 0x563ab08294b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f85e806ffd0 tx=0x7f85e8068f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.819+0000 7f84dd7fa640 1 -- 172.21.15.100:0/2427360287 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8059040 con 0x563ab0829090 2024-09-18T01:25:50.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.819+0000 7f84dd7fa640 1 -- 172.21.15.100:0/2427360287 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e8068420 con 0x563ab0829090 2024-09-18T01:25:50.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.819+0000 7f85fa119800 1 -- 172.21.15.100:0/2427360287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ab0829c80 con 0x563ab0829090 2024-09-18T01:25:50.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.819+0000 7f84dd7fa640 1 -- 172.21.15.100:0/2427360287 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8068740 con 0x563ab0829090 2024-09-18T01:25:50.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.819+0000 7f85fa119800 1 -- 172.21.15.100:0/2427360287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ab082c960 con 0x563ab0829090 2024-09-18T01:25:50.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.819+0000 7f84dd7fa640 1 -- 172.21.15.100:0/2427360287 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f85e8073110 con 0x563ab0829090 2024-09-18T01:25:50.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.820+0000 7f84dd7fa640 1 --2- 172.21.15.100:0/2427360287 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84d0036b40 0x7f84d0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.820+0000 7f84dd7fa640 1 -- 172.21.15.100:0/2427360287 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f85e804d050 con 0x563ab0829090 2024-09-18T01:25:50.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.820+0000 7f85f740c640 1 --2- 172.21.15.100:0/2427360287 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84d0036b40 0x7f84d0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.820+0000 7f85fa119800 1 Processor -- start 2024-09-18T01:25:50.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.820+0000 7f85fa119800 1 -- start start 2024-09-18T01:25:50.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.820+0000 7f85f740c640 1 --2- 172.21.15.100:0/2427360287 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84d0036b40 0x7f84d0039000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00bf90 tx=0x7f85ec00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.820+0000 7f85fa119800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab07144c0 0x563ab07148c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.820+0000 7f85fa119800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563ab0803db0 con 0x563ab07144c0 2024-09-18T01:25:50.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.820+0000 7f85f7c0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab07144c0 0x563ab07148c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.820+0000 7f85f7c0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab07144c0 0x563ab07148c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52872/0 (socket says 172.21.15.100:52872) 2024-09-18T01:25:50.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.820+0000 7f85f7c0d640 1 -- 172.21.15.100:0/2643236017 learned_addr learned my addr 172.21.15.100:0/2643236017 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.821+0000 7f85f7c0d640 1 -- 172.21.15.100:0/2643236017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ab0714e90 con 0x563ab07144c0 2024-09-18T01:25:50.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.821+0000 7f85f7c0d640 1 --2- 172.21.15.100:0/2643236017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab07144c0 0x563ab07148c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f85e8087370 tx=0x7f85e8067fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977fa4d01c3e7b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.821+0000 7f84d6ffd640 1 -- 172.21.15.100:0/2643236017 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8064710 con 0x563ab07144c0 2024-09-18T01:25:50.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.821+0000 7f84d6ffd640 1 -- 172.21.15.100:0/2643236017 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e809d030 con 0x563ab07144c0 2024-09-18T01:25:50.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.821+0000 7f84d6ffd640 1 -- 172.21.15.100:0/2643236017 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8086d10 con 0x563ab07144c0 2024-09-18T01:25:50.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.821+0000 7f85fa119800 1 -- 172.21.15.100:0/2643236017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab07144c0 msgr2=0x563ab07148c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.821+0000 7f85fa119800 1 --2- 172.21.15.100:0/2643236017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab07144c0 0x563ab07148c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f85e8087370 tx=0x7f85e8067fd0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.821+0000 7f85fa119800 1 -- 172.21.15.100:0/2643236017 shutdown_connections 2024-09-18T01:25:50.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.821+0000 7f85fa119800 1 --2- 172.21.15.100:0/2643236017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab07144c0 0x563ab07148c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.821+0000 7f85fa119800 1 -- 172.21.15.100:0/2643236017 >> 172.21.15.100:0/2643236017 conn(0x563ab0831eb0 msgr2=0x563ab082ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.821+0000 7f85fa119800 1 -- 172.21.15.100:0/2643236017 shutdown_connections 2024-09-18T01:25:50.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.821+0000 7f85fa119800 1 -- 172.21.15.100:0/2643236017 wait complete. 2024-09-18T01:25:50.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.822+0000 7f85fa119800 1 Processor -- start 2024-09-18T01:25:50.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.822+0000 7f85fa119800 1 -- start start 2024-09-18T01:25:50.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.822+0000 7f85fa119800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab07144c0 0x563ab083efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.822+0000 7f85fa119800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563ab0713070 con 0x563ab07144c0 2024-09-18T01:25:50.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.822+0000 7f85f7c0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab07144c0 0x563ab083efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.822+0000 7f85f7c0d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab07144c0 0x563ab083efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:52880/0 (socket says 172.21.15.100:52880) 2024-09-18T01:25:50.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.822+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 learned_addr learned my addr 172.21.15.100:0/1994414223 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:25:50.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.822+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ab083f4f0 con 0x563ab07144c0 2024-09-18T01:25:50.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.823+0000 7f85f7c0d640 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab07144c0 0x563ab083efb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f85e8068010 tx=0x7f85e8093f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.823+0000 7f84d57fa640 1 -- 172.21.15.100:0/1994414223 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8065330 con 0x563ab07144c0 2024-09-18T01:25:50.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.823+0000 7f84d57fa640 1 -- 172.21.15.100:0/1994414223 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e80654d0 con 0x563ab07144c0 2024-09-18T01:25:50.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.823+0000 7f84d57fa640 1 -- 172.21.15.100:0/1994414223 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8073580 con 0x563ab07144c0 2024-09-18T01:25:50.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.823+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ab083f4f0 con 0x563ab07144c0 2024-09-18T01:25:50.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.823+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ab083f4f0 con 0x563ab07144c0 2024-09-18T01:25:50.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.824+0000 7f84d57fa640 1 -- 172.21.15.100:0/1994414223 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f85e80b3030 con 0x563ab07144c0 2024-09-18T01:25:50.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.824+0000 7f84d57fa640 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84c0036b40 0x7f84c0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.824+0000 7f84d57fa640 1 -- 172.21.15.100:0/1994414223 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f85e80b1070 con 0x563ab07144c0 2024-09-18T01:25:50.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.824+0000 7f85f740c640 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84c0036b40 0x7f84c0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.824+0000 7f85f740c640 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84c0036b40 0x7f84c0039000 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x563ab080f5c0 tx=0x7f85ec010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.824+0000 7f85fa119800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.825+0000 7f85fa119800 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563ab084a780 0x563ab084cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.825+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab084d390 con 0x563ab084a780 2024-09-18T01:25:50.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.825+0000 7f85f840e640 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563ab084a780 0x563ab084cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.825+0000 7f85f840e640 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563ab084a780 0x563ab084cc40 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.825+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.825+0000 7f85fa119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.825+0000 7f85fa119800 20 realm 2024-09-18T01:25:50.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.825+0000 7f85fa119800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.825+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab084d7a0 con 0x563ab084a780 2024-09-18T01:25:50.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.825+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.825+0000 7f85fa119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.825+0000 7f85fa119800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:25:50.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.825+0000 7f85fa119800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.825+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e070 con 0x563ab084a780 2024-09-18T01:25:50.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.826+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.826+0000 7f85fa119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.826+0000 7f85fa119800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.826+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084a780 2024-09-18T01:25:50.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.826+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.826+0000 7f85fa119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:50.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.826+0000 7f85fa119800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.826+0000 7f85fa119800 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563ab084f170 0x563ab0851560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.826+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab0851b70 con 0x563ab084f170 2024-09-18T01:25:50.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.826+0000 7f85f7c0d640 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563ab084f170 0x563ab0851560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.826+0000 7f85f7c0d640 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563ab084f170 0x563ab0851560 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.826+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.826+0000 7f85fa119800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:25:50.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.827+0000 7f85fa119800 20 searching for the correct realm 2024-09-18T01:25:50.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.827+0000 7f85fa119800 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563ab0853b20 0x563ab0855fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.827+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab08566b0 con 0x563ab0853b20 2024-09-18T01:25:50.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.827+0000 7f85f740c640 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563ab0853b20 0x563ab0855fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.827+0000 7f85f740c640 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563ab0853b20 0x563ab0855fe0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.827+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.827+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab08566b0 con 0x563ab084f170 2024-09-18T01:25:50.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.827+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.827+0000 7f85f7c0d640 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f85e8099040 0x7f85e8085870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:25:50.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.827+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab08566b0 con 0x7f85e8099040 2024-09-18T01:25:50.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.828+0000 7f85f840e640 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f85e8099040 0x7f85e8085870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:25:50.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.828+0000 7f85f840e640 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f85e8099040 0x7f85e8085870 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:25:50.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.828+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.828+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084a780 2024-09-18T01:25:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.829+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.829+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084a780 2024-09-18T01:25:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.829+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.829+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x7f85e8099040 2024-09-18T01:25:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.829+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.829+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x7f85e8099040 2024-09-18T01:25:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.829+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.830+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084f170 2024-09-18T01:25:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.830+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.830+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab0853b20 2024-09-18T01:25:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.830+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.830+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084a780 2024-09-18T01:25:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.830+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.830+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084f170 2024-09-18T01:25:50.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.830+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.830+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084a780 2024-09-18T01:25:50.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.831+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.831+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084f170 2024-09-18T01:25:50.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.831+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.831+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab0853b20 2024-09-18T01:25:50.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.831+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.831+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab0853b20 2024-09-18T01:25:50.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.831+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.831+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x7f85e8099040 2024-09-18T01:25:50.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.832+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.832+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab0853b20 2024-09-18T01:25:50.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.832+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.832+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab0853b20 2024-09-18T01:25:50.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.832+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.832+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084a780 2024-09-18T01:25:50.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.833+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.833+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084a780 2024-09-18T01:25:50.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.833+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.833+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x7f85e8099040 2024-09-18T01:25:50.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.833+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.833+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab0853b20 2024-09-18T01:25:50.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.833+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.833+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084f170 2024-09-18T01:25:50.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.834+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.834+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084a780 2024-09-18T01:25:50.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.834+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.834+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x7f85e8099040 2024-09-18T01:25:50.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.834+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.834+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab0853b20 2024-09-18T01:25:50.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.834+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.834+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084f170 2024-09-18T01:25:50.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.835+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.835+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084f170 2024-09-18T01:25:50.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.835+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.835+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab0853b20 2024-09-18T01:25:50.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.835+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.835+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x7f85e8099040 2024-09-18T01:25:50.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.835+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.835+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084a780 2024-09-18T01:25:50.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563ab084e410 con 0x563ab084f170 2024-09-18T01:25:50.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85fa119800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:25:50.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85fa119800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:25:50.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85fa119800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:25:50.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85fa119800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:25:50.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85fa119800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:25:50.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85fa119800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:25:50.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85fa119800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab0852430 con 0x563ab084a780 2024-09-18T01:25:50.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85fa119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85fa119800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab0852820 con 0x563ab084a780 2024-09-18T01:25:50.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85fa119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:25:50.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85fa119800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.836+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab0852820 con 0x7f85e8099040 2024-09-18T01:25:50.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:25:50.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 20 zone default found 2024-09-18T01:25:50.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 4 Realm: () 2024-09-18T01:25:50.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:25:50.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:25:50.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:25:50.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 20 zonegroup default 2024-09-18T01:25:50.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab0856b30 con 0x7f85e8099040 2024-09-18T01:25:50.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab0858510 con 0x563ab0853b20 2024-09-18T01:25:50.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.837+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab08588b0 con 0x563ab0853b20 2024-09-18T01:25:50.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.838+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.838+0000 7f85fa119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:25:50.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.838+0000 7f85fa119800 20 started sync module instance, tier type = 2024-09-18T01:25:50.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.838+0000 7f85fa119800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:25:50.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.838+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab08579b0 con 0x563ab084f170 2024-09-18T01:25:50.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.839+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.839+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94810069630368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab0859100 con 0x563ab084f170 2024-09-18T01:25:50.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.839+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab0859950 con 0x563ab084a780 2024-09-18T01:25:50.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.840+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94810069630368] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.840+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.840+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94810069634128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab0859950 con 0x563ab084a780 2024-09-18T01:25:50.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.840+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab085a3f0 con 0x563ab0853b20 2024-09-18T01:25:50.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.841+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.841+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94810069638880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab085ac80 con 0x563ab0853b20 2024-09-18T01:25:50.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.841+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab085b7a0 con 0x563ab084f170 2024-09-18T01:25:50.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.842+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94810069634128] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.843+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.843+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94810069643888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab085bb90 con 0x563ab084f170 2024-09-18T01:25:50.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.843+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94810069638880] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.843+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab085c5b0 con 0x563ab084a780 2024-09-18T01:25:50.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.844+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.844+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94810069643888] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.844+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94810069641232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab085c0a0 con 0x563ab084a780 2024-09-18T01:25:50.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.844+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab085cb90 con 0x7f85e8099040 2024-09-18T01:25:50.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.845+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.845+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94810069649120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab085cfb0 con 0x7f85e8099040 2024-09-18T01:25:50.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.845+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab085da00 con 0x7f85e8099040 2024-09-18T01:25:50.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.845+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94810069641232] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.846+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94810069649120] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.847+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.847+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94810069652720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab085cb00 con 0x7f85e8099040 2024-09-18T01:25:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.847+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab085e090 con 0x7f85e8099040 2024-09-18T01:25:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.848+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(58 notify.7 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.848+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94810069654496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab085e4b0 con 0x7f85e8099040 2024-09-18T01:25:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.848+0000 7f85fa119800 20 add_watcher() i=0 2024-09-18T01:25:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.848+0000 7f85fa119800 20 add_watcher() i=1 2024-09-18T01:25:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.848+0000 7f85fa119800 20 add_watcher() i=2 2024-09-18T01:25:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.848+0000 7f85fa119800 20 add_watcher() i=3 2024-09-18T01:25:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.848+0000 7f85fa119800 20 add_watcher() i=4 2024-09-18T01:25:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.848+0000 7f85fa119800 20 add_watcher() i=5 2024-09-18T01:25:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.848+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94810069652720] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.848+0000 7f85fa119800 20 add_watcher() i=6 2024-09-18T01:25:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.849+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94810069654496] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.849+0000 7f85fa119800 20 add_watcher() i=7 2024-09-18T01:25:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.849+0000 7f85fa119800 2 all 8 watchers are set, enabling cache 2024-09-18T01:25:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.849+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab08614e0 con 0x563ab084a780 2024-09-18T01:25:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.849+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.849+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94810069655552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab085e8d0 con 0x563ab084a780 2024-09-18T01:25:50.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.850+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94810069655552] v35'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.850+0000 7f84adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:50.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.850+0000 7f85fa119800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:25:50.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.850+0000 7f85fa119800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:25:50.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.850+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab0869d50 con 0x563ab084a780 2024-09-18T01:25:50.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.851+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'55 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.851+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086a3a0 con 0x7f85e8099040 2024-09-18T01:25:50.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.853+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.853+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086a820 con 0x563ab0853b20 2024-09-18T01:25:50.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.854+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.854+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086b240 con 0x563ab084a780 2024-09-18T01:25:50.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.855+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'198 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.855+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab0865a20 con 0x563ab084f170 2024-09-18T01:25:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.856+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'71 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.856+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab0865a20 con 0x563ab0853b20 2024-09-18T01:25:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.857+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'55 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.857+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086bda0 con 0x563ab084a780 2024-09-18T01:25:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.858+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.858+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086c250 con 0x7f85e8099040 2024-09-18T01:25:50.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.859+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'50 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.859+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086c250 con 0x563ab084f170 2024-09-18T01:25:50.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.860+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.860+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086c650 con 0x563ab0853b20 2024-09-18T01:25:50.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.861+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.861+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cb00 con 0x563ab084f170 2024-09-18T01:25:50.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.862+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'72 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.862+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cb00 con 0x7f85e8099040 2024-09-18T01:25:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.864+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.864+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cb00 con 0x563ab084f170 2024-09-18T01:25:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.865+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.865+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cb00 con 0x7f85e8099040 2024-09-18T01:25:50.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.866+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'62 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.866+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cb00 con 0x563ab084a780 2024-09-18T01:25:50.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.867+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'199 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.867+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cb00 con 0x563ab0853b20 2024-09-18T01:25:50.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.868+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.868+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cb00 con 0x563ab084f170 2024-09-18T01:25:50.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.869+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'73 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.869+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cb00 con 0x563ab0853b20 2024-09-18T01:25:50.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.870+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.870+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cb90 con 0x563ab084a780 2024-09-18T01:25:50.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.872+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.872+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cb90 con 0x563ab084a780 2024-09-18T01:25:50.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.873+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'200 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.873+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cb90 con 0x563ab0853b20 2024-09-18T01:25:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.874+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.874+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cc20 con 0x563ab084f170 2024-09-18T01:25:50.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.875+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.875+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cc20 con 0x563ab0853b20 2024-09-18T01:25:50.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.876+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.876+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cc20 con 0x563ab0853b20 2024-09-18T01:25:50.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.877+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'43 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.877+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cc90 con 0x563ab0853b20 2024-09-18T01:25:50.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.878+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.878+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cc90 con 0x563ab0853b20 2024-09-18T01:25:50.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.878+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'56 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.879+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cc90 con 0x7f85e8099040 2024-09-18T01:25:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.880+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.880+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cc90 con 0x563ab0853b20 2024-09-18T01:25:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.881+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.881+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cc90 con 0x7f85e8099040 2024-09-18T01:25:50.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.882+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'51 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.882+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cc90 con 0x563ab0853b20 2024-09-18T01:25:50.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.883+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.883+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cc90 con 0x7f85e8099040 2024-09-18T01:25:50.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.884+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'63 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.884+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086cc90 con 0x563ab084f170 2024-09-18T01:25:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.885+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.886+0000 7f84acfe1640 20 reqs_thread_entry: start 2024-09-18T01:25:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.886+0000 7f85fa119800 20 init_complete bucket index max shards: 11 2024-09-18T01:25:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.886+0000 7f85fa119800 20 Filter name: none 2024-09-18T01:25:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.886+0000 7f84267fc640 20 reqs_thread_entry: start 2024-09-18T01:25:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.886+0000 7f85fa119800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:25:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.886+0000 7f85fa119800 20 rados->read ofs=0 len=0 2024-09-18T01:25:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.886+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab0897ac0 con 0x563ab084a780 2024-09-18T01:25:50.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.886+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.886+0000 7f85fa119800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:25:50.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.886+0000 7f85fa119800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:25:50.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.886+0000 7f85fa119800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:25:50.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.886+0000 7f85fa119800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:25:50.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.886+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563ab0897a80 con 0x563ab084f170 2024-09-18T01:25:50.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.887+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.889 INFO:teuthology.orchestra.run.smithi100.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-18T01:25:50.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.887+0000 7f84adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:25:50.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.888+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94810069655552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086b240 con 0x563ab084a780 2024-09-18T01:25:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.888+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94810069655552] v35'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.889+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94810069630368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab086b240 con 0x563ab084f170 2024-09-18T01:25:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.890+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94810069630368] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.890+0000 7f85fa119800 20 remove_watcher() i=0 2024-09-18T01:25:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.890+0000 7f85fa119800 2 removed watcher, disabling cache 2024-09-18T01:25:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.890+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94810069634128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab0857da0 con 0x563ab084a780 2024-09-18T01:25:50.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.891+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94810069634128] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.891+0000 7f85fa119800 20 remove_watcher() i=1 2024-09-18T01:25:50.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.891+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94810069638880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab0857da0 con 0x563ab0853b20 2024-09-18T01:25:50.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.892+0000 7f85f740c640 1 -- 172.21.15.100:0/1994414223 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94810069638880] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85ec009050 con 0x563ab0853b20 2024-09-18T01:25:50.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.892+0000 7f85fa119800 20 remove_watcher() i=2 2024-09-18T01:25:50.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.892+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94810069643888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab0857da0 con 0x563ab084f170 2024-09-18T01:25:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.893+0000 7f85f7c0d640 1 -- 172.21.15.100:0/1994414223 <== osd.2 v2:172.21.15.100:6808/3104327688 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94810069643888] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e805c040 con 0x563ab084f170 2024-09-18T01:25:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.893+0000 7f85fa119800 20 remove_watcher() i=3 2024-09-18T01:25:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.893+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94810069641232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab0857da0 con 0x563ab084a780 2024-09-18T01:25:50.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.894+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94810069641232] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x563ab084a780 2024-09-18T01:25:50.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.894+0000 7f85fa119800 20 remove_watcher() i=4 2024-09-18T01:25:50.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.894+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94810069649120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab0857da0 con 0x7f85e8099040 2024-09-18T01:25:50.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.895+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94810069649120] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.895+0000 7f85fa119800 20 remove_watcher() i=5 2024-09-18T01:25:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.895+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94810069652720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab085c6e0 con 0x7f85e8099040 2024-09-18T01:25:50.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.897+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94810069652720] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.897+0000 7f85fa119800 20 remove_watcher() i=6 2024-09-18T01:25:50.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.897+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94810069654496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563ab0857da0 con 0x7f85e8099040 2024-09-18T01:25:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94810069654496] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e8099040 2024-09-18T01:25:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 20 remove_watcher() i=7 2024-09-18T01:25:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f85e8099040 msgr2=0x7f85e8085870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f85e8099040 0x7f85e8085870 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563ab084a780 msgr2=0x563ab084cc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563ab084a780 0x563ab084cc40 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563ab084f170 msgr2=0x563ab0851560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563ab084f170 0x563ab0851560 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563ab0853b20 msgr2=0x563ab0855fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563ab0853b20 0x563ab0855fe0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84c0036b40 msgr2=0x7f84c0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84c0036b40 0x7f84c0039000 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x563ab080f5c0 tx=0x7f85ec010000 comp rx=0 tx=0).stop 2024-09-18T01:25:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab07144c0 msgr2=0x563ab083efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 --2- 172.21.15.100:0/1994414223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab07144c0 0x563ab083efb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f85e8068010 tx=0x7f85e8093f90 comp rx=0 tx=0).stop 2024-09-18T01:25:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 reap_dead start 2024-09-18T01:25:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85f840e640 1 -- 172.21.15.100:0/1994414223 reap_dead start 2024-09-18T01:25:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 shutdown_connections 2024-09-18T01:25:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 >> 172.21.15.100:0/1994414223 conn(0x563ab0831eb0 msgr2=0x563ab082ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 shutdown_connections 2024-09-18T01:25:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 -- 172.21.15.100:0/1994414223 wait complete. 2024-09-18T01:25:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 -- 172.21.15.100:0/2427360287 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84d0036b40 msgr2=0x7f84d0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 --2- 172.21.15.100:0/2427360287 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84d0036b40 0x7f84d0039000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00bf90 tx=0x7f85ec00f000 comp rx=0 tx=0).stop 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 -- 172.21.15.100:0/2427360287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab0829090 msgr2=0x563ab08294b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.898+0000 7f85fa119800 1 --2- 172.21.15.100:0/2427360287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab0829090 0x563ab08294b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f85e806ffd0 tx=0x7f85e8068f10 comp rx=0 tx=0).stop 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 -- 172.21.15.100:0/2427360287 shutdown_connections 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 --2- 172.21.15.100:0/2427360287 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84d0036b40 0x7f84d0039000 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 --2- 172.21.15.100:0/2427360287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab0829090 0x563ab08294b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 -- 172.21.15.100:0/2427360287 >> 172.21.15.100:0/2427360287 conn(0x563ab081e020 msgr2=0x563ab0820ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 -- 172.21.15.100:0/2427360287 shutdown_connections 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 -- 172.21.15.100:0/2427360287 wait complete. 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563ab08187f0 msgr2=0x563ab081abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563ab08187f0 0x563ab081abe0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563ab07177d0 msgr2=0x563ab08120d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563ab07177d0 0x563ab08120d0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563ab0814900 msgr2=0x563ab0816cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563ab0814900 0x563ab0816cf0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84e0036b90 msgr2=0x7f84e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f84e0036b90 0x7f84e0039050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f85ec000f60 tx=0x7f85ec0010a0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 msgr2=0x563ab080b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:25:50.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 --2- 172.21.15.100:0/122819240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ab06885f0 0x563ab080b060 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f85e8045960 tx=0x7f85e8002fb0 comp rx=0 tx=0).stop 2024-09-18T01:25:50.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85f840e640 1 -- 172.21.15.100:0/122819240 reap_dead start 2024-09-18T01:25:50.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 shutdown_connections 2024-09-18T01:25:50.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 >> 172.21.15.100:0/122819240 conn(0x563ab070ede0 msgr2=0x563ab07fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:25:50.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 shutdown_connections 2024-09-18T01:25:50.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:25:50.899+0000 7f85fa119800 1 -- 172.21.15.100:0/122819240 wait complete. 2024-09-18T01:25:50.908 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-18T01:25:50.926 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:25:50.969 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-18T01:26:25.970 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-18T01:26:25.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-18T01:26:25.971 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-18T01:26:26.023 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:26:26.023 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:26:26.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.022+0000 7f9d44324800 1 Processor -- start 2024-09-18T01:26:26.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.022+0000 7f9d44324800 1 -- start start 2024-09-18T01:26:26.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.022+0000 7f9d44324800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5594e8a37550 0x5594e8a37950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.022+0000 7f9d44324800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5594e88f7b30 con 0x5594e8a37e90 2024-09-18T01:26:26.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.022+0000 7f9d44324800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5594e88d9360 con 0x5594e8a37550 2024-09-18T01:26:26.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.022+0000 7f9d400e0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5594e8a37550 0x5594e8a37950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.023+0000 7f9d400e0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5594e8a37550 0x5594e8a37950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44462/0 (socket says 172.21.15.100:44462) 2024-09-18T01:26:26.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.023+0000 7f9d400e0640 1 -- 172.21.15.100:0/2837648781 learned_addr learned my addr 172.21.15.100:0/2837648781 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.023+0000 7f9d37fff640 1 --1- 172.21.15.100:0/2837648781 >> v1:172.21.15.92:6789/0 conn(0x5594e8a37e90 0x5594e8a3ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:51664/0 (socket says 172.21.15.100:51664) 2024-09-18T01:26:26.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.023+0000 7f9d400e0640 1 -- 172.21.15.100:0/2837648781 >> v1:172.21.15.92:6789/0 conn(0x5594e8a37e90 legacy=0x5594e8a3ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.023+0000 7f9d400e0640 1 -- 172.21.15.100:0/2837648781 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594e88ffe00 con 0x5594e8a37550 2024-09-18T01:26:26.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.025+0000 7f9d400e0640 1 --2- 172.21.15.100:0/2837648781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 0x5594e8a37950 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000a520 tx=0x7f9d30045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee7ee353df0adbb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.025+0000 7f9d3f8df640 1 -- 172.21.15.100:0/2837648781 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d30055070 con 0x5594e8a37550 2024-09-18T01:26:26.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.025+0000 7f9d3f8df640 1 -- 172.21.15.100:0/2837648781 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d300515b0 con 0x5594e8a37550 2024-09-18T01:26:26.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.025+0000 7f9d3f8df640 1 -- 172.21.15.100:0/2837648781 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d300518d0 con 0x5594e8a37550 2024-09-18T01:26:26.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.025+0000 7f9d44324800 1 -- 172.21.15.100:0/2837648781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 msgr2=0x5594e8a37950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.025+0000 7f9d44324800 1 --2- 172.21.15.100:0/2837648781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 0x5594e8a37950 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000a520 tx=0x7f9d30045ba0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.026+0000 7f9d44324800 1 -- 172.21.15.100:0/2837648781 shutdown_connections 2024-09-18T01:26:26.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.026+0000 7f9d44324800 1 --2- 172.21.15.100:0/2837648781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 0x5594e8a37950 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.026+0000 7f9d44324800 1 -- 172.21.15.100:0/2837648781 >> 172.21.15.100:0/2837648781 conn(0x5594e8a32de0 msgr2=0x5594e8a35200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.026+0000 7f9d44324800 1 -- 172.21.15.100:0/2837648781 shutdown_connections 2024-09-18T01:26:26.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.026+0000 7f9d44324800 1 -- 172.21.15.100:0/2837648781 wait complete. 2024-09-18T01:26:26.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.041+0000 7f9d44324800 1 Processor -- start 2024-09-18T01:26:26.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.041+0000 7f9d44324800 1 -- start start 2024-09-18T01:26:26.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.041+0000 7f9d44324800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 0x5594e8b278f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.041+0000 7f9d44324800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5594e8984330 con 0x5594e8a37550 2024-09-18T01:26:26.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.042+0000 7f9d400e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 0x5594e8b278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.042+0000 7f9d400e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 0x5594e8b278f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44470/0 (socket says 172.21.15.100:44470) 2024-09-18T01:26:26.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.042+0000 7f9d400e0640 1 -- 172.21.15.100:0/332024651 learned_addr learned my addr 172.21.15.100:0/332024651 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.042+0000 7f9d400e0640 1 -- 172.21.15.100:0/332024651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594e88d1bc0 con 0x5594e8a37550 2024-09-18T01:26:26.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.042+0000 7f9d400e0640 1 --2- 172.21.15.100:0/332024651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 0x5594e8b278f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9d30025da0 tx=0x7f9d30051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba40233ca8c5ec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.043+0000 7f9c2e60c640 1 -- 172.21.15.100:0/332024651 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d30051950 con 0x5594e8a37550 2024-09-18T01:26:26.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.043+0000 7f9c2e60c640 1 -- 172.21.15.100:0/332024651 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d30051af0 con 0x5594e8a37550 2024-09-18T01:26:26.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.043+0000 7f9c2e60c640 1 -- 172.21.15.100:0/332024651 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d30051dd0 con 0x5594e8a37550 2024-09-18T01:26:26.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.043+0000 7f9d44324800 1 -- 172.21.15.100:0/332024651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 msgr2=0x5594e8b278f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.043+0000 7f9d44324800 1 --2- 172.21.15.100:0/332024651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 0x5594e8b278f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9d30025da0 tx=0x7f9d30051000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.043+0000 7f9d44324800 1 -- 172.21.15.100:0/332024651 shutdown_connections 2024-09-18T01:26:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.043+0000 7f9d44324800 1 --2- 172.21.15.100:0/332024651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 0x5594e8b278f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.043+0000 7f9d44324800 1 -- 172.21.15.100:0/332024651 >> 172.21.15.100:0/332024651 conn(0x5594e8a32de0 msgr2=0x5594e8b25da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.043+0000 7f9d44324800 1 -- 172.21.15.100:0/332024651 shutdown_connections 2024-09-18T01:26:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.043+0000 7f9d44324800 1 -- 172.21.15.100:0/332024651 wait complete. 2024-09-18T01:26:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.044+0000 7f9d44324800 1 Processor -- start 2024-09-18T01:26:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.044+0000 7f9d44324800 1 -- start start 2024-09-18T01:26:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.044+0000 7f9d44324800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 0x5594e8b2f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.044+0000 7f9d44324800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5594e8a3e570 con 0x5594e8a37550 2024-09-18T01:26:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.044+0000 7f9d400e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 0x5594e8b2f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.044+0000 7f9d400e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 0x5594e8b2f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44474/0 (socket says 172.21.15.100:44474) 2024-09-18T01:26:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.044+0000 7f9d400e0640 1 -- 172.21.15.100:0/3521751081 learned_addr learned my addr 172.21.15.100:0/3521751081 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.045+0000 7f9d400e0640 1 -- 172.21.15.100:0/3521751081 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594e88e5fe0 con 0x5594e8a37550 2024-09-18T01:26:26.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.045+0000 7f9d400e0640 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 0x5594e8b2f1c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9d30067040 tx=0x7f9d30002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.045+0000 7f9c2ce09640 1 -- 172.21.15.100:0/3521751081 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d30073070 con 0x5594e8a37550 2024-09-18T01:26:26.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.045+0000 7f9c2ce09640 1 -- 172.21.15.100:0/3521751081 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3005a450 con 0x5594e8a37550 2024-09-18T01:26:26.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.045+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594e8b2f700 con 0x5594e8a37550 2024-09-18T01:26:26.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.045+0000 7f9c2ce09640 1 -- 172.21.15.100:0/3521751081 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d3005a730 con 0x5594e8a37550 2024-09-18T01:26:26.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.045+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594e8b2fc80 con 0x5594e8a37550 2024-09-18T01:26:26.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.046+0000 7f9c2ce09640 1 -- 172.21.15.100:0/3521751081 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9d30076070 con 0x5594e8a37550 2024-09-18T01:26:26.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.046+0000 7f9c2ce09640 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c28036b40 0x7f9c28039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.046+0000 7f9c2ce09640 1 -- 172.21.15.100:0/3521751081 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f9d30062070 con 0x5594e8a37550 2024-09-18T01:26:26.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.047+0000 7f9d37fff640 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c28036b40 0x7f9c28039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.047+0000 7f9d44324800 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5594e8a37e90 0x5594e8b36230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.047+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b367b0 con 0x5594e8a37e90 2024-09-18T01:26:26.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.047+0000 7f9d408e1640 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5594e8a37e90 0x5594e8b36230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.047+0000 7f9d37fff640 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c28036b40 0x7f9c28039000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9d28000f60 tx=0x7f9d28001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.047+0000 7f9d408e1640 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5594e8a37e90 0x5594e8b36230 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.047+0000 7f9d408e1640 1 -- 172.21.15.100:0/3521751081 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8a37e90 2024-09-18T01:26:26.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.047+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b337e0 con 0x5594e8a37e90 2024-09-18T01:26:26.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.048+0000 7f9d408e1640 1 -- 172.21.15.100:0/3521751081 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8a37e90 2024-09-18T01:26:26.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.048+0000 7f9d44324800 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5594e8b38ae0 0x5594e8b3aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.048+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b3b570 con 0x5594e8b38ae0 2024-09-18T01:26:26.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.048+0000 7f9d400e0640 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5594e8b38ae0 0x5594e8b3aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.048+0000 7f9d400e0640 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5594e8b38ae0 0x5594e8b3aed0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.048+0000 7f9d400e0640 1 -- 172.21.15.100:0/3521751081 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b38ae0 2024-09-18T01:26:26.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.048+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b37980 con 0x5594e8a37e90 2024-09-18T01:26:26.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.049+0000 7f9d408e1640 1 -- 172.21.15.100:0/3521751081 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8a37e90 2024-09-18T01:26:26.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.049+0000 7f9d44324800 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5594e8b3c9d0 0x5594e8b3edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.049+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b3f4c0 con 0x5594e8b3c9d0 2024-09-18T01:26:26.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.049+0000 7f9d37fff640 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5594e8b3c9d0 0x5594e8b3edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.050+0000 7f9d37fff640 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5594e8b3c9d0 0x5594e8b3edc0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.050+0000 7f9d37fff640 1 -- 172.21.15.100:0/3521751081 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9d2800f690 con 0x5594e8b3c9d0 2024-09-18T01:26:26.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.050+0000 7f9d44324800 1 Processor -- start 2024-09-18T01:26:26.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.050+0000 7f9d44324800 1 -- start start 2024-09-18T01:26:26.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.050+0000 7f9d44324800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b4d270 0x5594e8b4d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.051+0000 7f9d44324800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5594e88d3580 con 0x5594e8b4d270 2024-09-18T01:26:26.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.051+0000 7f9d400e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b4d270 0x5594e8b4d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.051+0000 7f9d400e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b4d270 0x5594e8b4d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44484/0 (socket says 172.21.15.100:44484) 2024-09-18T01:26:26.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.051+0000 7f9d400e0640 1 -- 172.21.15.100:0/2587436454 learned_addr learned my addr 172.21.15.100:0/2587436454 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.051+0000 7f9d400e0640 1 -- 172.21.15.100:0/2587436454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594e8b4dbd0 con 0x5594e8b4d270 2024-09-18T01:26:26.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.051+0000 7f9d400e0640 1 --2- 172.21.15.100:0/2587436454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b4d270 0x5594e8b4d690 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9d3008f5b0 tx=0x7f9d3006ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.051+0000 7f9c25ffb640 1 -- 172.21.15.100:0/2587436454 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d30065bb0 con 0x5594e8b4d270 2024-09-18T01:26:26.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.051+0000 7f9c25ffb640 1 -- 172.21.15.100:0/2587436454 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d30065d50 con 0x5594e8b4d270 2024-09-18T01:26:26.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.051+0000 7f9d44324800 1 -- 172.21.15.100:0/2587436454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594e8b4de60 con 0x5594e8b4d270 2024-09-18T01:26:26.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.051+0000 7f9c25ffb640 1 -- 172.21.15.100:0/2587436454 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d3006e4f0 con 0x5594e8b4d270 2024-09-18T01:26:26.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.052+0000 7f9d44324800 1 -- 172.21.15.100:0/2587436454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594e8b50b40 con 0x5594e8b4d270 2024-09-18T01:26:26.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.052+0000 7f9c25ffb640 1 -- 172.21.15.100:0/2587436454 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9d30058070 con 0x5594e8b4d270 2024-09-18T01:26:26.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.053+0000 7f9c25ffb640 1 --2- 172.21.15.100:0/2587436454 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c18036b90 0x7f9c18039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.053+0000 7f9c25ffb640 1 -- 172.21.15.100:0/2587436454 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f9d300880e0 con 0x5594e8b4d270 2024-09-18T01:26:26.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.053+0000 7f9d37fff640 1 --2- 172.21.15.100:0/2587436454 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c18036b90 0x7f9c18039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.053+0000 7f9d44324800 1 Processor -- start 2024-09-18T01:26:26.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.053+0000 7f9d44324800 1 -- start start 2024-09-18T01:26:26.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.053+0000 7f9d37fff640 1 --2- 172.21.15.100:0/2587436454 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c18036b90 0x7f9c18039050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5594e8b33720 tx=0x7f9d2800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.053+0000 7f9d44324800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b59d70 0x5594e8b5a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.053+0000 7f9d44324800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5594e8b27fe0 con 0x5594e8b59d70 2024-09-18T01:26:26.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.053+0000 7f9d400e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b59d70 0x5594e8b5a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.053+0000 7f9d400e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b59d70 0x5594e8b5a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44494/0 (socket says 172.21.15.100:44494) 2024-09-18T01:26:26.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.053+0000 7f9d400e0640 1 -- 172.21.15.100:0/846450259 learned_addr learned my addr 172.21.15.100:0/846450259 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.054+0000 7f9d400e0640 1 -- 172.21.15.100:0/846450259 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594e8b5a740 con 0x5594e8b59d70 2024-09-18T01:26:26.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.054+0000 7f9d400e0640 1 --2- 172.21.15.100:0/846450259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b59d70 0x5594e8b5a170 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9d30065f20 tx=0x7f9d30078bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1e32c194b65dc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.054+0000 7f9c1f7fe640 1 -- 172.21.15.100:0/846450259 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d3006e690 con 0x5594e8b59d70 2024-09-18T01:26:26.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.054+0000 7f9c1f7fe640 1 -- 172.21.15.100:0/846450259 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d300813a0 con 0x5594e8b59d70 2024-09-18T01:26:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.054+0000 7f9c1f7fe640 1 -- 172.21.15.100:0/846450259 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d3005ac40 con 0x5594e8b59d70 2024-09-18T01:26:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.054+0000 7f9d44324800 1 -- 172.21.15.100:0/846450259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b59d70 msgr2=0x5594e8b5a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.054+0000 7f9d44324800 1 --2- 172.21.15.100:0/846450259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b59d70 0x5594e8b5a170 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9d30065f20 tx=0x7f9d30078bb0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.054+0000 7f9d44324800 1 -- 172.21.15.100:0/846450259 shutdown_connections 2024-09-18T01:26:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.054+0000 7f9d44324800 1 --2- 172.21.15.100:0/846450259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b59d70 0x5594e8b5a170 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.054+0000 7f9d44324800 1 -- 172.21.15.100:0/846450259 >> 172.21.15.100:0/846450259 conn(0x5594e8b56120 msgr2=0x5594e8b54220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.054+0000 7f9d44324800 1 -- 172.21.15.100:0/846450259 shutdown_connections 2024-09-18T01:26:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.054+0000 7f9d44324800 1 -- 172.21.15.100:0/846450259 wait complete. 2024-09-18T01:26:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.055+0000 7f9d44324800 1 Processor -- start 2024-09-18T01:26:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.055+0000 7f9d44324800 1 -- start start 2024-09-18T01:26:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.055+0000 7f9d44324800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b59d70 0x5594e8b61010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.055+0000 7f9d44324800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5594e8b5ab90 con 0x5594e8b59d70 2024-09-18T01:26:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.055+0000 7f9d400e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b59d70 0x5594e8b61010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.055+0000 7f9d400e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b59d70 0x5594e8b61010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44502/0 (socket says 172.21.15.100:44502) 2024-09-18T01:26:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.055+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 learned_addr learned my addr 172.21.15.100:0/2448415671 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.056+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594e8b61550 con 0x5594e8b59d70 2024-09-18T01:26:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.056+0000 7f9d400e0640 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b59d70 0x5594e8b61010 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9d30065f20 tx=0x7f9d30081ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.056+0000 7f9c1dffb640 1 -- 172.21.15.100:0/2448415671 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d30078450 con 0x5594e8b59d70 2024-09-18T01:26:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.056+0000 7f9c1dffb640 1 -- 172.21.15.100:0/2448415671 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d300ba030 con 0x5594e8b59d70 2024-09-18T01:26:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.056+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594e8b61550 con 0x5594e8b59d70 2024-09-18T01:26:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.056+0000 7f9c1dffb640 1 -- 172.21.15.100:0/2448415671 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d30063b30 con 0x5594e8b59d70 2024-09-18T01:26:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.056+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594e8b61550 con 0x5594e8b59d70 2024-09-18T01:26:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.057+0000 7f9c1dffb640 1 -- 172.21.15.100:0/2448415671 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9d3008f020 con 0x5594e8b59d70 2024-09-18T01:26:26.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.057+0000 7f9c1dffb640 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c10036b40 0x7f9c10039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.057+0000 7f9c1dffb640 1 -- 172.21.15.100:0/2448415671 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f9d300c0d30 con 0x5594e8b59d70 2024-09-18T01:26:26.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.057+0000 7f9d37fff640 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c10036b40 0x7f9c10039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.057+0000 7f9d44324800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.057+0000 7f9d44324800 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5594e8b6c5d0 0x5594e8b6ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.057+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b6f1e0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.058+0000 7f9d408e1640 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5594e8b6c5d0 0x5594e8b6ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.058+0000 7f9d37fff640 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c10036b40 0x7f9c10039000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x5594e8b3f8c0 tx=0x7f9d28010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.058+0000 7f9d408e1640 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5594e8b6c5d0 0x5594e8b6ea90 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.058+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.058+0000 7f9d44324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.058+0000 7f9d44324800 20 realm 2024-09-18T01:26:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.058+0000 7f9d44324800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.058+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b6f5f0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.058+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.058+0000 7f9d44324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.058+0000 7f9d44324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:26:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.058+0000 7f9d44324800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.058+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b6fec0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.059+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.059+0000 7f9d44324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.059+0000 7f9d44324800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.059+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b6c5d0 2024-09-18T01:26:26.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.059+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.059+0000 7f9d44324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:26.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.059+0000 7f9d44324800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.059+0000 7f9d44324800 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5594e8b70d50 0x5594e8b73140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.059+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b738a0 con 0x5594e8b70d50 2024-09-18T01:26:26.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.059+0000 7f9d400e0640 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5594e8b70d50 0x5594e8b73140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.059+0000 7f9d400e0640 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5594e8b70d50 0x5594e8b73140 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.060+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.060+0000 7f9d44324800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:26:26.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.060+0000 7f9d44324800 20 searching for the correct realm 2024-09-18T01:26:26.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.060+0000 7f9d44324800 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5594e8b75950 0x5594e8b77e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.060+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b784e0 con 0x5594e8b75950 2024-09-18T01:26:26.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.060+0000 7f9d37fff640 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5594e8b75950 0x5594e8b77e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.060+0000 7f9d37fff640 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5594e8b75950 0x5594e8b77e10 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.060+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.060+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b784e0 con 0x5594e8b70d50 2024-09-18T01:26:26.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.061+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.061+0000 7f9d400e0640 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9d30078070 0x7f9d3007e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.061+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b784e0 con 0x7f9d30078070 2024-09-18T01:26:26.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.061+0000 7f9d408e1640 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9d30078070 0x7f9d3007e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.061+0000 7f9d408e1640 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9d30078070 0x7f9d3007e250 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.062+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.062+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b6c5d0 2024-09-18T01:26:26.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.062+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.062+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b6c5d0 2024-09-18T01:26:26.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.062+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.062+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x7f9d30078070 2024-09-18T01:26:26.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.063+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.063+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x7f9d30078070 2024-09-18T01:26:26.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.063+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.063+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b70d50 2024-09-18T01:26:26.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.063+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.063+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b75950 2024-09-18T01:26:26.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.064+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.064+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b6c5d0 2024-09-18T01:26:26.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.064+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.064+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b70d50 2024-09-18T01:26:26.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.064+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.064+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b6c5d0 2024-09-18T01:26:26.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.064+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.064+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b70d50 2024-09-18T01:26:26.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.065+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.065+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b75950 2024-09-18T01:26:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.065+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.065+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b75950 2024-09-18T01:26:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.065+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.065+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x7f9d30078070 2024-09-18T01:26:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.066+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.066+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b75950 2024-09-18T01:26:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.066+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.066+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b75950 2024-09-18T01:26:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.066+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.066+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b6c5d0 2024-09-18T01:26:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.066+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.066+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b6c5d0 2024-09-18T01:26:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.066+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.066+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x7f9d30078070 2024-09-18T01:26:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.067+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.067+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b75950 2024-09-18T01:26:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.067+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.067+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b70d50 2024-09-18T01:26:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.067+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.067+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b6c5d0 2024-09-18T01:26:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.068+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.068+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x7f9d30078070 2024-09-18T01:26:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.068+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.068+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b75950 2024-09-18T01:26:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.068+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.068+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b70d50 2024-09-18T01:26:26.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.068+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.068+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b70d50 2024-09-18T01:26:26.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.069+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.069+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b75950 2024-09-18T01:26:26.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.069+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.069+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x7f9d30078070 2024-09-18T01:26:26.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.069+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.069+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b6c5d0 2024-09-18T01:26:26.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b70260 con 0x5594e8b70d50 2024-09-18T01:26:26.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d44324800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:26:26.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d44324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:26:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d44324800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:26:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d44324800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:26:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d44324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:26:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d44324800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:26:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d44324800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b74250 con 0x5594e8b6c5d0 2024-09-18T01:26:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d44324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d44324800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b74640 con 0x5594e8b6c5d0 2024-09-18T01:26:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d44324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:26.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d44324800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.070+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b74640 con 0x7f9d30078070 2024-09-18T01:26:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:26:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 20 zone default found 2024-09-18T01:26:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 4 Realm: () 2024-09-18T01:26:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:26:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:26:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:26:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 20 zonegroup default 2024-09-18T01:26:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b74a60 con 0x7f9d30078070 2024-09-18T01:26:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b74a60 con 0x5594e8b75950 2024-09-18T01:26:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.071+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7a340 con 0x5594e8b75950 2024-09-18T01:26:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.072+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.072+0000 7f9d44324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.072+0000 7f9d44324800 20 started sync module instance, tier type = 2024-09-18T01:26:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.072+0000 7f9d44324800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:26:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.072+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b797e0 con 0x5594e8b70d50 2024-09-18T01:26:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.073+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.073+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94098047867904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7ab90 con 0x5594e8b70d50 2024-09-18T01:26:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.073+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7b3e0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.074+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94098047867904] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.074+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.074+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94098047870688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7b460 con 0x5594e8b6c5d0 2024-09-18T01:26:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.074+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7bf50 con 0x5594e8b75950 2024-09-18T01:26:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.075+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94098047870688] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.076+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.076+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94098047875616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7c340 con 0x5594e8b75950 2024-09-18T01:26:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.076+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7cd40 con 0x5594e8b70d50 2024-09-18T01:26:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.077+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94098047875616] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.077+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.077+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94098047872816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7d130 con 0x5594e8b70d50 2024-09-18T01:26:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.077+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7db50 con 0x5594e8b6c5d0 2024-09-18T01:26:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.078+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94098047872816] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.078+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.079+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94098047882816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7db10 con 0x5594e8b6c5d0 2024-09-18T01:26:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.079+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7e590 con 0x7f9d30078070 2024-09-18T01:26:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.080+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.080+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94098047882816] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.080+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94098047885536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7e500 con 0x7f9d30078070 2024-09-18T01:26:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.080+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7c870 con 0x7f9d30078070 2024-09-18T01:26:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.081+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94098047885536] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.081+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.081+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94098047879280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7f000 con 0x7f9d30078070 2024-09-18T01:26:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.081+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7fa20 con 0x7f9d30078070 2024-09-18T01:26:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.082+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94098047879280] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.082+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.082+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94098047890704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7f9e0 con 0x7f9d30078070 2024-09-18T01:26:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.082+0000 7f9d44324800 20 add_watcher() i=0 2024-09-18T01:26:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.082+0000 7f9d44324800 20 add_watcher() i=1 2024-09-18T01:26:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.082+0000 7f9d44324800 20 add_watcher() i=2 2024-09-18T01:26:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.082+0000 7f9d44324800 20 add_watcher() i=3 2024-09-18T01:26:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.082+0000 7f9d44324800 20 add_watcher() i=4 2024-09-18T01:26:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.082+0000 7f9d44324800 20 add_watcher() i=5 2024-09-18T01:26:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.082+0000 7f9d44324800 20 add_watcher() i=6 2024-09-18T01:26:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.083+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94098047890704] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.083+0000 7f9d44324800 20 add_watcher() i=7 2024-09-18T01:26:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.083+0000 7f9d44324800 2 all 8 watchers are set, enabling cache 2024-09-18T01:26:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.083+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b82e70 con 0x5594e8b6c5d0 2024-09-18T01:26:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.084+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.084+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94098047887664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b80320 con 0x5594e8b6c5d0 2024-09-18T01:26:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.085+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94098047887664] v35'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.085+0000 7f9bf67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.085+0000 7f9d44324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:26:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.085+0000 7f9d44324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:26:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.085+0000 7f9d44324800 5 note: GC not initialized 2024-09-18T01:26:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.085+0000 7f9bf57e2640 20 reqs_thread_entry: start 2024-09-18T01:26:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.086+0000 7f9d44324800 20 init_complete bucket index max shards: 11 2024-09-18T01:26:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.086+0000 7f9d44324800 20 Filter name: none 2024-09-18T01:26:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.086+0000 7f9b66ffd640 20 reqs_thread_entry: start 2024-09-18T01:26:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.086+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb6690 con 0x5594e8b6c5d0 2024-09-18T01:26:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.086+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.086+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb6690 con 0x5594e8b70d50 2024-09-18T01:26:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.086+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.086+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb6650 con 0x5594e8b6c5d0 2024-09-18T01:26:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.087+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.087+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb6650 con 0x5594e8b75950 2024-09-18T01:26:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.087+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.087+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb6ba0 con 0x5594e8b75950 2024-09-18T01:26:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.087+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.087+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb6ff0 con 0x5594e8b75950 2024-09-18T01:26:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.087+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.087+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb6ff0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.088+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.088+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb6ff0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.088+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.088+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb6ff0 con 0x5594e8b75950 2024-09-18T01:26:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.088+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.088+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb6fa0 con 0x5594e8b75950 2024-09-18T01:26:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.088+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.088+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb6f80 con 0x7f9d30078070 2024-09-18T01:26:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.089+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.089+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8a00 con 0x5594e8b6c5d0 2024-09-18T01:26:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.089+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.089+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8a00 con 0x5594e8b70d50 2024-09-18T01:26:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.089+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.089+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8a00 con 0x5594e8b75950 2024-09-18T01:26:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.090+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.090+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8a00 con 0x7f9d30078070 2024-09-18T01:26:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.090+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.090+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x7f9d30078070 2024-09-18T01:26:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.090+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.090+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x5594e8b75950 2024-09-18T01:26:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.091+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.091+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x7f9d30078070 2024-09-18T01:26:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.091+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.091+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x5594e8b6c5d0 2024-09-18T01:26:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.091+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.091+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x5594e8b75950 2024-09-18T01:26:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.091+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.091+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x7f9d30078070 2024-09-18T01:26:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.092+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.092+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x5594e8b70d50 2024-09-18T01:26:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.092+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.092+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x7f9d30078070 2024-09-18T01:26:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.093+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.093+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x5594e8b6c5d0 2024-09-18T01:26:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.093+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.093+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x5594e8b6c5d0 2024-09-18T01:26:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.093+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.093+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x5594e8b75950 2024-09-18T01:26:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.093+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.093+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x5594e8b6c5d0 2024-09-18T01:26:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.094+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.094+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x5594e8b6c5d0 2024-09-18T01:26:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.094+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.094+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x5594e8b75950 2024-09-18T01:26:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.094+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.094+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x5594e8b75950 2024-09-18T01:26:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.094+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.094+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x5594e8b75950 2024-09-18T01:26:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.094+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.094+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb8980 con 0x7f9d30078070 2024-09-18T01:26:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.095+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.096+0000 7f9bf67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.096+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94098047887664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8bb4900 con 0x5594e8b6c5d0 2024-09-18T01:26:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.097+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94098047887664] v35'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.097+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94098047867904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7e930 con 0x5594e8b70d50 2024-09-18T01:26:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.098+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94098047867904] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.098+0000 7f9d44324800 20 remove_watcher() i=0 2024-09-18T01:26:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.098+0000 7f9d44324800 2 removed watcher, disabling cache 2024-09-18T01:26:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.098+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94098047870688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7e930 con 0x5594e8b6c5d0 2024-09-18T01:26:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.099+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94098047870688] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.099+0000 7f9d44324800 20 remove_watcher() i=1 2024-09-18T01:26:26.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.099+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94098047875616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7e930 con 0x5594e8b75950 2024-09-18T01:26:26.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.100+0000 7f9d37fff640 1 -- 172.21.15.100:0/2448415671 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94098047875616] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d28037040 con 0x5594e8b75950 2024-09-18T01:26:26.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.100+0000 7f9d44324800 20 remove_watcher() i=2 2024-09-18T01:26:26.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.101+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94098047872816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7e930 con 0x5594e8b70d50 2024-09-18T01:26:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.102+0000 7f9d400e0640 1 -- 172.21.15.100:0/2448415671 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94098047872816] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d30075030 con 0x5594e8b70d50 2024-09-18T01:26:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.102+0000 7f9d44324800 20 remove_watcher() i=3 2024-09-18T01:26:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.102+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94098047882816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7af30 con 0x5594e8b6c5d0 2024-09-18T01:26:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.104+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94098047882816] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x5594e8b6c5d0 2024-09-18T01:26:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.104+0000 7f9d44324800 20 remove_watcher() i=4 2024-09-18T01:26:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.104+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94098047885536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7e930 con 0x7f9d30078070 2024-09-18T01:26:26.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.105+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94098047885536] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.105+0000 7f9d44324800 20 remove_watcher() i=5 2024-09-18T01:26:26.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.105+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94098047879280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7af30 con 0x7f9d30078070 2024-09-18T01:26:26.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.107+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94098047879280] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.107+0000 7f9d44324800 20 remove_watcher() i=6 2024-09-18T01:26:26.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.107+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94098047890704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594e8b7e930 con 0x7f9d30078070 2024-09-18T01:26:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94098047890704] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3800a4a0 con 0x7f9d30078070 2024-09-18T01:26:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 20 remove_watcher() i=7 2024-09-18T01:26:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9d30078070 msgr2=0x7f9d3007e250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9d30078070 0x7f9d3007e250 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5594e8b6c5d0 msgr2=0x5594e8b6ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5594e8b6c5d0 0x5594e8b6ea90 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5594e8b70d50 msgr2=0x5594e8b73140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5594e8b70d50 0x5594e8b73140 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5594e8b75950 msgr2=0x5594e8b77e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5594e8b75950 0x5594e8b77e10 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c10036b40 msgr2=0x7f9c10039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c10036b40 0x7f9c10039000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x5594e8b3f8c0 tx=0x7f9d28010000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b59d70 msgr2=0x5594e8b61010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 --2- 172.21.15.100:0/2448415671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b59d70 0x5594e8b61010 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9d30065f20 tx=0x7f9d30081ee0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 reap_dead start 2024-09-18T01:26:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d408e1640 1 -- 172.21.15.100:0/2448415671 reap_dead start 2024-09-18T01:26:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 shutdown_connections 2024-09-18T01:26:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 >> 172.21.15.100:0/2448415671 conn(0x5594e8b56120 msgr2=0x5594e8b541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 shutdown_connections 2024-09-18T01:26:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.108+0000 7f9d44324800 1 -- 172.21.15.100:0/2448415671 wait complete. 2024-09-18T01:26:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/2587436454 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c18036b90 msgr2=0x7f9c18039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 --2- 172.21.15.100:0/2587436454 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c18036b90 0x7f9c18039050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5594e8b33720 tx=0x7f9d2800f000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/2587436454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b4d270 msgr2=0x5594e8b4d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 --2- 172.21.15.100:0/2587436454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b4d270 0x5594e8b4d690 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9d3008f5b0 tx=0x7f9d3006ef80 comp rx=0 tx=0).stop 2024-09-18T01:26:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/2587436454 shutdown_connections 2024-09-18T01:26:26.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 --2- 172.21.15.100:0/2587436454 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c18036b90 0x7f9c18039050 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 --2- 172.21.15.100:0/2587436454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8b4d270 0x5594e8b4d690 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/2587436454 >> 172.21.15.100:0/2587436454 conn(0x5594e8b42200 msgr2=0x5594e8b44d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/2587436454 shutdown_connections 2024-09-18T01:26:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/2587436454 wait complete. 2024-09-18T01:26:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5594e8b3c9d0 msgr2=0x5594e8b3edc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5594e8b3c9d0 0x5594e8b3edc0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5594e8a37e90 msgr2=0x5594e8b36230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5594e8a37e90 0x5594e8b36230 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5594e8b38ae0 msgr2=0x5594e8b3aed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5594e8b38ae0 0x5594e8b3aed0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c28036b40 msgr2=0x7f9c28039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9c28036b40 0x7f9c28039000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9d28000f60 tx=0x7f9d28001370 comp rx=0 tx=0).stop 2024-09-18T01:26:26.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 msgr2=0x5594e8b2f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 --2- 172.21.15.100:0/3521751081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594e8a37550 0x5594e8b2f1c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9d30067040 tx=0x7f9d30002fb0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d408e1640 1 -- 172.21.15.100:0/3521751081 reap_dead start 2024-09-18T01:26:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 shutdown_connections 2024-09-18T01:26:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 >> 172.21.15.100:0/3521751081 conn(0x5594e8a32de0 msgr2=0x5594e8b21240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 shutdown_connections 2024-09-18T01:26:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.109+0000 7f9d44324800 1 -- 172.21.15.100:0/3521751081 wait complete. 2024-09-18T01:26:26.120 INFO:teuthology.orchestra.run.smithi100.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-18T01:26:26.120 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-18T01:26:26.120 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-18T01:26:26.120 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-18T01:26:26.121 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-18T01:26:26.163 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:26:26.163 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:26:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.162+0000 7f90ebe0f800 1 Processor -- start 2024-09-18T01:26:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.162+0000 7f90ebe0f800 1 -- start start 2024-09-18T01:26:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.162+0000 7f90ebe0f800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x561207669970 0x56120766bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.162+0000 7f90ebe0f800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561207524b30 con 0x5612075d8d60 2024-09-18T01:26:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.162+0000 7f90ebe0f800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x561207506360 con 0x561207669970 2024-09-18T01:26:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.162+0000 7f90e3fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x561207669970 0x56120766bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.162+0000 7f90e3fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x561207669970 0x56120766bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44512/0 (socket says 172.21.15.100:44512) 2024-09-18T01:26:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.162+0000 7f90e3fff640 1 -- 172.21.15.100:0/3995667441 learned_addr learned my addr 172.21.15.100:0/3995667441 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.162+0000 7f90e9903640 1 --1- 172.21.15.100:0/3995667441 >> v1:172.21.15.92:6789/0 conn(0x5612075d8d60 0x561207668250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:51680/0 (socket says 172.21.15.100:51680) 2024-09-18T01:26:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.163+0000 7f90e9102640 1 -- 172.21.15.100:0/3995667441 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1527455671 0 0) 0x561207524b30 con 0x5612075d8d60 2024-09-18T01:26:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.163+0000 7f90e9102640 1 -- 172.21.15.100:0/3995667441 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90d8001e10 con 0x5612075d8d60 2024-09-18T01:26:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.163+0000 7f90e3fff640 1 -- 172.21.15.100:0/3995667441 >> v1:172.21.15.92:6789/0 conn(0x5612075d8d60 legacy=0x561207668250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.163+0000 7f90e3fff640 1 -- 172.21.15.100:0/3995667441 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120752ce00 con 0x561207669970 2024-09-18T01:26:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.164+0000 7f90e3fff640 1 --2- 172.21.15.100:0/3995667441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207669970 0x56120766bd60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f90d400a520 tx=0x7f90d4045aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc07c760556c76a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.165+0000 7f90e9102640 1 -- 172.21.15.100:0/3995667441 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90d4056020 con 0x561207669970 2024-09-18T01:26:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.165+0000 7f90e9102640 1 -- 172.21.15.100:0/3995667441 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d4052550 con 0x561207669970 2024-09-18T01:26:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.165+0000 7f90e9102640 1 -- 172.21.15.100:0/3995667441 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90d4052870 con 0x561207669970 2024-09-18T01:26:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.165+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3995667441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207669970 msgr2=0x56120766bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.165+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/3995667441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207669970 0x56120766bd60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f90d400a520 tx=0x7f90d4045aa0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.165+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3995667441 shutdown_connections 2024-09-18T01:26:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.165+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/3995667441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207669970 0x56120766bd60 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.166+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3995667441 >> 172.21.15.100:0/3995667441 conn(0x56120765fde0 msgr2=0x561207662200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.166+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3995667441 shutdown_connections 2024-09-18T01:26:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.166+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3995667441 wait complete. 2024-09-18T01:26:26.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.179+0000 7f90ebe0f800 1 Processor -- start 2024-09-18T01:26:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.179+0000 7f90ebe0f800 1 -- start start 2024-09-18T01:26:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.179+0000 7f90ebe0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612075d8d60 0x561207754600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.179+0000 7f90ebe0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5612075b1320 con 0x5612075d8d60 2024-09-18T01:26:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.180+0000 7f90e9903640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612075d8d60 0x561207754600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.180+0000 7f90e9903640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612075d8d60 0x561207754600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44520/0 (socket says 172.21.15.100:44520) 2024-09-18T01:26:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.180+0000 7f90e9903640 1 -- 172.21.15.100:0/3403666445 learned_addr learned my addr 172.21.15.100:0/3403666445 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.180+0000 7f90e9903640 1 -- 172.21.15.100:0/3403666445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612074febc0 con 0x5612075d8d60 2024-09-18T01:26:26.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.180+0000 7f90e9903640 1 --2- 172.21.15.100:0/3403666445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612075d8d60 0x561207754600 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00b260 tx=0x7f90dc00b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bc2c3689066b3d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.180+0000 7f8fd7e07640 1 -- 172.21.15.100:0/3403666445 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90dc00e5c0 con 0x5612075d8d60 2024-09-18T01:26:26.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.180+0000 7f8fd7e07640 1 -- 172.21.15.100:0/3403666445 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90dc006070 con 0x5612075d8d60 2024-09-18T01:26:26.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.180+0000 7f8fd7e07640 1 -- 172.21.15.100:0/3403666445 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90dc00e8d0 con 0x5612075d8d60 2024-09-18T01:26:26.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.181+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3403666445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612075d8d60 msgr2=0x561207754600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.181+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/3403666445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612075d8d60 0x561207754600 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00b260 tx=0x7f90dc00b720 comp rx=0 tx=0).stop 2024-09-18T01:26:26.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.181+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3403666445 shutdown_connections 2024-09-18T01:26:26.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.181+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/3403666445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612075d8d60 0x561207754600 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.181+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3403666445 >> 172.21.15.100:0/3403666445 conn(0x56120765fde0 msgr2=0x56120774ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.181+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3403666445 shutdown_connections 2024-09-18T01:26:26.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.181+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3403666445 wait complete. 2024-09-18T01:26:26.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.182+0000 7f90ebe0f800 1 Processor -- start 2024-09-18T01:26:26.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.182+0000 7f90ebe0f800 1 -- start start 2024-09-18T01:26:26.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.182+0000 7f90ebe0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612075d8d60 0x561207665b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.182+0000 7f90ebe0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56120766c630 con 0x5612075d8d60 2024-09-18T01:26:26.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.182+0000 7f90e9903640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612075d8d60 0x561207665b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.182+0000 7f90e9903640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612075d8d60 0x561207665b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44534/0 (socket says 172.21.15.100:44534) 2024-09-18T01:26:26.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.182+0000 7f90e9903640 1 -- 172.21.15.100:0/3284385303 learned_addr learned my addr 172.21.15.100:0/3284385303 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.182+0000 7f90e9903640 1 -- 172.21.15.100:0/3284385303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561207512fe0 con 0x5612075d8d60 2024-09-18T01:26:26.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.182+0000 7f90e9903640 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612075d8d60 0x561207665b80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f90dc000f60 tx=0x7f90dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.183+0000 7f8fd6604640 1 -- 172.21.15.100:0/3284385303 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90dc01a880 con 0x5612075d8d60 2024-09-18T01:26:26.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.183+0000 7f8fd6604640 1 -- 172.21.15.100:0/3284385303 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90dc01aa40 con 0x5612075d8d60 2024-09-18T01:26:26.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.183+0000 7f8fd6604640 1 -- 172.21.15.100:0/3284385303 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90dc01ad60 con 0x5612075d8d60 2024-09-18T01:26:26.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.183+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561207664270 con 0x5612075d8d60 2024-09-18T01:26:26.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.183+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561207664790 con 0x5612075d8d60 2024-09-18T01:26:26.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.184+0000 7f8fd6604640 1 -- 172.21.15.100:0/3284385303 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f90dc017070 con 0x5612075d8d60 2024-09-18T01:26:26.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.184+0000 7f8fd6604640 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fd0036b40 0x7f8fd0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.184+0000 7f8fd6604640 1 -- 172.21.15.100:0/3284385303 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f90dc015020 con 0x5612075d8d60 2024-09-18T01:26:26.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.184+0000 7f90e3fff640 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fd0036b40 0x7f8fd0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.184+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561207669970 0x5612077653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.184+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561207765920 con 0x561207669970 2024-09-18T01:26:26.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.184+0000 7f90ea104640 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561207669970 0x5612077653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.184+0000 7f90e3fff640 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fd0036b40 0x7f8fd0039000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f90d400a520 tx=0x7f90d4052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.184+0000 7f90ea104640 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561207669970 0x5612077653e0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.185+0000 7f90ea104640 1 -- 172.21.15.100:0/3284385303 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x561207669970 2024-09-18T01:26:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.185+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561207766170 con 0x561207669970 2024-09-18T01:26:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.185+0000 7f90ea104640 1 -- 172.21.15.100:0/3284385303 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90e400a4a0 con 0x561207669970 2024-09-18T01:26:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.185+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561207767ba0 0x561207769ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.185+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56120776a780 con 0x561207767ba0 2024-09-18T01:26:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.185+0000 7f90e9903640 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561207767ba0 0x561207769ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.185+0000 7f90e9903640 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561207767ba0 0x561207769ff0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.186+0000 7f90e9903640 1 -- 172.21.15.100:0/3284385303 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f90dc02e070 con 0x561207767ba0 2024-09-18T01:26:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.186+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077669c0 con 0x561207669970 2024-09-18T01:26:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.186+0000 7f90ea104640 1 -- 172.21.15.100:0/3284385303 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90e400a4a0 con 0x561207669970 2024-09-18T01:26:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.186+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56120776bbe0 0x56120776dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.186+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56120776e690 con 0x56120776bbe0 2024-09-18T01:26:26.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.186+0000 7f90e3fff640 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56120776bbe0 0x56120776dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.187+0000 7f90e3fff640 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56120776bbe0 0x56120776dfd0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.187+0000 7f90e3fff640 1 -- 172.21.15.100:0/3284385303 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f90d4050050 con 0x56120776bbe0 2024-09-18T01:26:26.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.187+0000 7f90ebe0f800 1 Processor -- start 2024-09-18T01:26:26.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.188+0000 7f90ebe0f800 1 -- start start 2024-09-18T01:26:26.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.188+0000 7f90ebe0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56120777c440 0x56120777c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.188+0000 7f90ebe0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5612076660c0 con 0x56120777c440 2024-09-18T01:26:26.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.188+0000 7f90e9903640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56120777c440 0x56120777c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.188+0000 7f90e9903640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56120777c440 0x56120777c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44544/0 (socket says 172.21.15.100:44544) 2024-09-18T01:26:26.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.188+0000 7f90e9903640 1 -- 172.21.15.100:0/1604319923 learned_addr learned my addr 172.21.15.100:0/1604319923 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.188+0000 7f90e9903640 1 -- 172.21.15.100:0/1604319923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120777cda0 con 0x56120777c440 2024-09-18T01:26:26.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.188+0000 7f90e9903640 1 --2- 172.21.15.100:0/1604319923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56120777c440 0x56120777c860 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f90dc04b790 tx=0x7f90dc04cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.189+0000 7f8fcf7fe640 1 -- 172.21.15.100:0/1604319923 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90dc017ab0 con 0x56120777c440 2024-09-18T01:26:26.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.189+0000 7f8fcf7fe640 1 -- 172.21.15.100:0/1604319923 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90dc017c50 con 0x56120777c440 2024-09-18T01:26:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.189+0000 7f8fcf7fe640 1 -- 172.21.15.100:0/1604319923 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90dc01d450 con 0x56120777c440 2024-09-18T01:26:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.189+0000 7f90ebe0f800 1 -- 172.21.15.100:0/1604319923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56120777d030 con 0x56120777c440 2024-09-18T01:26:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.189+0000 7f90ebe0f800 1 -- 172.21.15.100:0/1604319923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120777fd10 con 0x56120777c440 2024-09-18T01:26:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.189+0000 7f8fcf7fe640 1 -- 172.21.15.100:0/1604319923 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f90dc039030 con 0x56120777c440 2024-09-18T01:26:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.190+0000 7f8fcf7fe640 1 --2- 172.21.15.100:0/1604319923 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fc4036b90 0x7f8fc4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.190+0000 7f8fcf7fe640 1 -- 172.21.15.100:0/1604319923 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f90dc037070 con 0x56120777c440 2024-09-18T01:26:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.190+0000 7f90e3fff640 1 --2- 172.21.15.100:0/1604319923 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fc4036b90 0x7f8fc4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.190+0000 7f90ebe0f800 1 Processor -- start 2024-09-18T01:26:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.190+0000 7f90ebe0f800 1 -- start start 2024-09-18T01:26:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.190+0000 7f90e3fff640 1 --2- 172.21.15.100:0/1604319923 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fc4036b90 0x7f8fc4039050 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x561207664bf0 tx=0x7f90d4005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.190+0000 7f90ebe0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207788e20 0x561207789220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.190+0000 7f90ebe0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561207500580 con 0x561207788e20 2024-09-18T01:26:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.190+0000 7f90e9903640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207788e20 0x561207789220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.190+0000 7f90e9903640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207788e20 0x561207789220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44560/0 (socket says 172.21.15.100:44560) 2024-09-18T01:26:26.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.190+0000 7f90e9903640 1 -- 172.21.15.100:0/2266690323 learned_addr learned my addr 172.21.15.100:0/2266690323 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.191+0000 7f90e9903640 1 -- 172.21.15.100:0/2266690323 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612077897f0 con 0x561207788e20 2024-09-18T01:26:26.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.191+0000 7f90e9903640 1 --2- 172.21.15.100:0/2266690323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207788e20 0x561207789220 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f90dc003f70 tx=0x7f90dc045e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9808f5fc8879b7fb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.191+0000 7f8fcd7fa640 1 -- 172.21.15.100:0/2266690323 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90dc044dc0 con 0x561207788e20 2024-09-18T01:26:26.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.191+0000 7f8fcd7fa640 1 -- 172.21.15.100:0/2266690323 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90dc05c070 con 0x561207788e20 2024-09-18T01:26:26.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.191+0000 7f8fcd7fa640 1 -- 172.21.15.100:0/2266690323 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90dc0450f0 con 0x561207788e20 2024-09-18T01:26:26.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.191+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2266690323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207788e20 msgr2=0x561207789220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.191+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/2266690323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207788e20 0x561207789220 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f90dc003f70 tx=0x7f90dc045e20 comp rx=0 tx=0).stop 2024-09-18T01:26:26.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.191+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2266690323 shutdown_connections 2024-09-18T01:26:26.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.191+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/2266690323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207788e20 0x561207789220 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.191+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2266690323 >> 172.21.15.100:0/2266690323 conn(0x561207785210 msgr2=0x561207783310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.191+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2266690323 shutdown_connections 2024-09-18T01:26:26.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.191+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2266690323 wait complete. 2024-09-18T01:26:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.192+0000 7f90ebe0f800 1 Processor -- start 2024-09-18T01:26:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.192+0000 7f90ebe0f800 1 -- start start 2024-09-18T01:26:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.192+0000 7f90ebe0f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207788e20 0x561207790020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.192+0000 7f90ebe0f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561207789820 con 0x561207788e20 2024-09-18T01:26:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.192+0000 7f90e9903640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207788e20 0x561207790020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.192+0000 7f90e9903640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207788e20 0x561207790020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44568/0 (socket says 172.21.15.100:44568) 2024-09-18T01:26:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.192+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 learned_addr learned my addr 172.21.15.100:0/2777012045 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.193+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561207790560 con 0x561207788e20 2024-09-18T01:26:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.193+0000 7f90e9903640 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207788e20 0x561207790020 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00efb0 tx=0x7f90dc003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.193+0000 7f8fbb7fe640 1 -- 172.21.15.100:0/2777012045 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90dc020dd0 con 0x561207788e20 2024-09-18T01:26:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.193+0000 7f8fbb7fe640 1 -- 172.21.15.100:0/2777012045 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90dc045520 con 0x561207788e20 2024-09-18T01:26:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.193+0000 7f8fbb7fe640 1 -- 172.21.15.100:0/2777012045 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90dc045820 con 0x561207788e20 2024-09-18T01:26:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.193+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561207790560 con 0x561207788e20 2024-09-18T01:26:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.193+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561207790560 con 0x561207788e20 2024-09-18T01:26:26.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.194+0000 7f8fbb7fe640 1 -- 172.21.15.100:0/2777012045 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f90dc072060 con 0x561207788e20 2024-09-18T01:26:26.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.194+0000 7f8fbb7fe640 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fb4036b40 0x7f8fb4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.194+0000 7f8fbb7fe640 1 -- 172.21.15.100:0/2777012045 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f90dc075d10 con 0x561207788e20 2024-09-18T01:26:26.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.194+0000 7f90e3fff640 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fb4036b40 0x7f8fb4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.194+0000 7f90ebe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.194+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56120779b6c0 0x56120779db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.194+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56120779e2d0 con 0x56120779b6c0 2024-09-18T01:26:26.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.194+0000 7f90ea104640 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56120779b6c0 0x56120779db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90e3fff640 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fb4036b40 0x7f8fb4039000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90d4077040 tx=0x7f90d4053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ea104640 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56120779b6c0 0x56120779db80 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ebe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ebe0f800 20 realm 2024-09-18T01:26:26.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ebe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56120779e6e0 con 0x56120779b6c0 2024-09-18T01:26:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ebe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ebe0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:26:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ebe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56120779ef80 con 0x56120779b6c0 2024-09-18T01:26:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ebe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ebe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.195+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x56120779b6c0 2024-09-18T01:26:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.196+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.196+0000 7f90ebe0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.196+0000 7f90ebe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.196+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5612077a0080 0x5612077a2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.196+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077a29f0 con 0x5612077a0080 2024-09-18T01:26:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.196+0000 7f90e9903640 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5612077a0080 0x5612077a2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.196+0000 7f90e9903640 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5612077a0080 0x5612077a2470 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.196+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.196+0000 7f90ebe0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:26:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.196+0000 7f90ebe0f800 20 searching for the correct realm 2024-09-18T01:26:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.196+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5612077a4a60 0x5612077a6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.196+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612077a75f0 con 0x5612077a4a60 2024-09-18T01:26:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.197+0000 7f90e3fff640 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5612077a4a60 0x5612077a6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.197+0000 7f90e3fff640 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5612077a4a60 0x5612077a6f20 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.197+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.197+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612077a75f0 con 0x5612077a0080 2024-09-18T01:26:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.197+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.197+0000 7f90e9903640 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f90dc00f070 0x7f90dc04d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.197+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612077a75f0 con 0x7f90dc00f070 2024-09-18T01:26:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.198+0000 7f90ea104640 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f90dc00f070 0x7f90dc04d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.198+0000 7f90ea104640 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f90dc00f070 0x7f90dc04d910 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.199+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.199+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x56120779b6c0 2024-09-18T01:26:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.199+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.199+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x56120779b6c0 2024-09-18T01:26:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.199+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.199+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x7f90dc00f070 2024-09-18T01:26:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.199+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.199+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x7f90dc00f070 2024-09-18T01:26:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.200+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.200+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a0080 2024-09-18T01:26:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.200+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.200+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a4a60 2024-09-18T01:26:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.200+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.200+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x56120779b6c0 2024-09-18T01:26:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.200+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.200+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a0080 2024-09-18T01:26:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.201+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.201+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x56120779b6c0 2024-09-18T01:26:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.201+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.201+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a0080 2024-09-18T01:26:26.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.201+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.201+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a4a60 2024-09-18T01:26:26.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.201+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.201+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a4a60 2024-09-18T01:26:26.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.201+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.201+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x7f90dc00f070 2024-09-18T01:26:26.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.202+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.202+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a4a60 2024-09-18T01:26:26.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.202+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.202+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a4a60 2024-09-18T01:26:26.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.202+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.202+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x56120779b6c0 2024-09-18T01:26:26.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.202+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.202+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x56120779b6c0 2024-09-18T01:26:26.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.203+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.203+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x7f90dc00f070 2024-09-18T01:26:26.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.203+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.203+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a4a60 2024-09-18T01:26:26.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.203+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.203+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a0080 2024-09-18T01:26:26.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.203+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.204+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x56120779b6c0 2024-09-18T01:26:26.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.204+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.204+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x7f90dc00f070 2024-09-18T01:26:26.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.204+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.204+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a4a60 2024-09-18T01:26:26.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.204+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.204+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a0080 2024-09-18T01:26:26.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.204+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.205+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a0080 2024-09-18T01:26:26.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.205+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.205+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a4a60 2024-09-18T01:26:26.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.205+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.205+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x7f90dc00f070 2024-09-18T01:26:26.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.205+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.205+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x56120779b6c0 2024-09-18T01:26:26.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56120779f320 con 0x5612077a0080 2024-09-18T01:26:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ebe0f800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:26:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ebe0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:26:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ebe0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:26:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ebe0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:26:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ebe0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:26:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ebe0f800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:26:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ebe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077a3360 con 0x56120779b6c0 2024-09-18T01:26:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ebe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ebe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077a3750 con 0x56120779b6c0 2024-09-18T01:26:26.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ebe0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:26.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ebe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.206+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077a3750 con 0x7f90dc00f070 2024-09-18T01:26:26.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:26:26.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 20 zone default found 2024-09-18T01:26:26.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 4 Realm: () 2024-09-18T01:26:26.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:26:26.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:26:26.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:26:26.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 20 zonegroup default 2024-09-18T01:26:26.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077a3b70 con 0x7f90dc00f070 2024-09-18T01:26:26.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077a3b70 con 0x5612077a4a60 2024-09-18T01:26:26.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.207+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077a9450 con 0x5612077a4a60 2024-09-18T01:26:26.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.208+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.208+0000 7f90ebe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.208+0000 7f90ebe0f800 20 started sync module instance, tier type = 2024-09-18T01:26:26.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.208+0000 7f90ebe0f800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:26:26.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.208+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077a88f0 con 0x5612077a0080 2024-09-18T01:26:26.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.209+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.209+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94635434872080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077a9ca0 con 0x5612077a0080 2024-09-18T01:26:26.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.209+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077aa4f0 con 0x56120779b6c0 2024-09-18T01:26:26.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.210+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94635434872080] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.210+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.210+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94635434874864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077aa4f0 con 0x56120779b6c0 2024-09-18T01:26:26.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.210+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077aaf90 con 0x5612077a4a60 2024-09-18T01:26:26.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.212+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.212+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94635434879616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077ab820 con 0x5612077a4a60 2024-09-18T01:26:26.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.212+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94635434874864] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.212+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077aa080 con 0x5612077a0080 2024-09-18T01:26:26.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.213+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94635434879616] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.213+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.213+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94635434884624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077ac6e0 con 0x5612077a0080 2024-09-18T01:26:26.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.213+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077acf90 con 0x56120779b6c0 2024-09-18T01:26:26.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.214+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94635434884624] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.214+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.214+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94635434885680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077acb00 con 0x56120779b6c0 2024-09-18T01:26:26.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.214+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077ada10 con 0x7f90dc00f070 2024-09-18T01:26:26.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.215+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.215+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94635434890528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077ad980 con 0x7f90dc00f070 2024-09-18T01:26:26.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.215+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077ae970 con 0x7f90dc00f070 2024-09-18T01:26:26.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.215+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94635434885680] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.216+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94635434890528] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.217+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.217+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94635434892800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077ae450 con 0x7f90dc00f070 2024-09-18T01:26:26.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.217+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077aee20 con 0x7f90dc00f070 2024-09-18T01:26:26.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.218+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(58 notify.7 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.218+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94635434895728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077af240 con 0x7f90dc00f070 2024-09-18T01:26:26.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.218+0000 7f90ebe0f800 20 add_watcher() i=0 2024-09-18T01:26:26.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.218+0000 7f90ebe0f800 20 add_watcher() i=1 2024-09-18T01:26:26.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.218+0000 7f90ebe0f800 20 add_watcher() i=2 2024-09-18T01:26:26.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.218+0000 7f90ebe0f800 20 add_watcher() i=3 2024-09-18T01:26:26.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.218+0000 7f90ebe0f800 20 add_watcher() i=4 2024-09-18T01:26:26.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.218+0000 7f90ebe0f800 20 add_watcher() i=5 2024-09-18T01:26:26.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.218+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94635434892800] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.218+0000 7f90ebe0f800 20 add_watcher() i=6 2024-09-18T01:26:26.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.219+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94635434895728] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.219+0000 7f90ebe0f800 20 add_watcher() i=7 2024-09-18T01:26:26.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.219+0000 7f90ebe0f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:26:26.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.219+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077af240 con 0x56120779b6c0 2024-09-18T01:26:26.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.219+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.219+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94635434896784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077af1b0 con 0x56120779b6c0 2024-09-18T01:26:26.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.220+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94635434896784] v35'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.220+0000 7f8f9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.220+0000 7f90ebe0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:26:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.220+0000 7f90ebe0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:26:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.220+0000 7f90ebe0f800 5 note: GC not initialized 2024-09-18T01:26:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.221+0000 7f8f9a7fc640 20 reqs_thread_entry: start 2024-09-18T01:26:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.221+0000 7f90ebe0f800 20 init_complete bucket index max shards: 11 2024-09-18T01:26:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.221+0000 7f90ebe0f800 20 Filter name: none 2024-09-18T01:26:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.221+0000 7f8f0bfff640 20 reqs_thread_entry: start 2024-09-18T01:26:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.221+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e5a60 con 0x56120779b6c0 2024-09-18T01:26:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.221+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.221+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e5a60 con 0x5612077a0080 2024-09-18T01:26:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.221+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.221+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e5a20 con 0x56120779b6c0 2024-09-18T01:26:26.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.222+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.222+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e5a20 con 0x5612077a4a60 2024-09-18T01:26:26.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.222+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.222+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e5f30 con 0x5612077a4a60 2024-09-18T01:26:26.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.222+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.222+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e5f70 con 0x5612077a4a60 2024-09-18T01:26:26.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.222+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.222+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e5f30 con 0x56120779b6c0 2024-09-18T01:26:26.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.222+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.223+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e5f30 con 0x56120779b6c0 2024-09-18T01:26:26.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.223+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.223+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e5ee0 con 0x5612077a4a60 2024-09-18T01:26:26.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.223+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.223+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e5ee0 con 0x5612077a4a60 2024-09-18T01:26:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.223+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.223+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e5ee0 con 0x7f90dc00f070 2024-09-18T01:26:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.224+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.224+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x56120779b6c0 2024-09-18T01:26:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.224+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.224+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x5612077a0080 2024-09-18T01:26:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.224+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.224+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x5612077a4a60 2024-09-18T01:26:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.225+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.225+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x7f90dc00f070 2024-09-18T01:26:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.225+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.225+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x7f90dc00f070 2024-09-18T01:26:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.225+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.225+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x5612077a4a60 2024-09-18T01:26:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.225+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.225+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x7f90dc00f070 2024-09-18T01:26:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.226+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.226+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x56120779b6c0 2024-09-18T01:26:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.226+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.226+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x5612077a4a60 2024-09-18T01:26:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.226+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.226+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x7f90dc00f070 2024-09-18T01:26:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.227+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.227+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x5612077a0080 2024-09-18T01:26:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.227+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.227+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x7f90dc00f070 2024-09-18T01:26:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.227+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.227+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x56120779b6c0 2024-09-18T01:26:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.227+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.227+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x56120779b6c0 2024-09-18T01:26:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.228+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.228+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x5612077a4a60 2024-09-18T01:26:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.228+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.228+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x56120779b6c0 2024-09-18T01:26:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.228+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.228+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x56120779b6c0 2024-09-18T01:26:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.228+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.228+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x5612077a4a60 2024-09-18T01:26:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.228+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.228+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x5612077a4a60 2024-09-18T01:26:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.229+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.229+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x5612077a4a60 2024-09-18T01:26:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.229+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.229+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7b30 con 0x7f90dc00f070 2024-09-18T01:26:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.229+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.230+0000 7f8f9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.230+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94635434896784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077e7680 con 0x56120779b6c0 2024-09-18T01:26:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.231+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94635434896784] v35'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.231+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94635434872080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077aed90 con 0x5612077a0080 2024-09-18T01:26:26.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.232+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94635434872080] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.232+0000 7f90ebe0f800 20 remove_watcher() i=0 2024-09-18T01:26:26.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.232+0000 7f90ebe0f800 2 removed watcher, disabling cache 2024-09-18T01:26:26.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.232+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94635434874864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077aed90 con 0x56120779b6c0 2024-09-18T01:26:26.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.234+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94635434874864] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.234+0000 7f90ebe0f800 20 remove_watcher() i=1 2024-09-18T01:26:26.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.234+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94635434879616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077a97f0 con 0x5612077a4a60 2024-09-18T01:26:26.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.235+0000 7f90e3fff640 1 -- 172.21.15.100:0/2777012045 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94635434879616] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90d4050050 con 0x5612077a4a60 2024-09-18T01:26:26.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.235+0000 7f90ebe0f800 20 remove_watcher() i=2 2024-09-18T01:26:26.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.235+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94635434884624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077aed90 con 0x5612077a0080 2024-09-18T01:26:26.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.236+0000 7f90e9903640 1 -- 172.21.15.100:0/2777012045 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94635434884624] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90dc02e070 con 0x5612077a0080 2024-09-18T01:26:26.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.236+0000 7f90ebe0f800 20 remove_watcher() i=3 2024-09-18T01:26:26.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.236+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94635434885680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077a97f0 con 0x56120779b6c0 2024-09-18T01:26:26.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.237+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94635434885680] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x56120779b6c0 2024-09-18T01:26:26.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.237+0000 7f90ebe0f800 20 remove_watcher() i=4 2024-09-18T01:26:26.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.237+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94635434890528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077aed90 con 0x7f90dc00f070 2024-09-18T01:26:26.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.238+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94635434890528] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.238+0000 7f90ebe0f800 20 remove_watcher() i=5 2024-09-18T01:26:26.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.238+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94635434892800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077a97f0 con 0x7f90dc00f070 2024-09-18T01:26:26.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.239+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94635434892800] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.239+0000 7f90ebe0f800 20 remove_watcher() i=6 2024-09-18T01:26:26.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.239+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94635434895728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612077a97f0 con 0x7f90dc00f070 2024-09-18T01:26:26.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.240+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94635434895728] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e400a4a0 con 0x7f90dc00f070 2024-09-18T01:26:26.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.240+0000 7f90ebe0f800 20 remove_watcher() i=7 2024-09-18T01:26:26.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.240+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f90dc00f070 msgr2=0x7f90dc04d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.240+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f90dc00f070 0x7f90dc04d910 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.240+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56120779b6c0 msgr2=0x56120779db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.240+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56120779b6c0 0x56120779db80 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.240+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5612077a0080 msgr2=0x5612077a2470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.240+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5612077a0080 0x5612077a2470 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.240+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5612077a4a60 msgr2=0x5612077a6f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.240+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5612077a4a60 0x5612077a6f20 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fb4036b40 msgr2=0x7f8fb4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fb4036b40 0x7f8fb4039000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90d4077040 tx=0x7f90d4053000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207788e20 msgr2=0x561207790020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/2777012045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561207788e20 0x561207790020 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00efb0 tx=0x7f90dc003f00 comp rx=0 tx=0).stop 2024-09-18T01:26:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ea104640 1 -- 172.21.15.100:0/2777012045 reap_dead start 2024-09-18T01:26:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 shutdown_connections 2024-09-18T01:26:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 >> 172.21.15.100:0/2777012045 conn(0x561207785210 msgr2=0x5612077832e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 shutdown_connections 2024-09-18T01:26:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/2777012045 wait complete. 2024-09-18T01:26:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/1604319923 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fc4036b90 msgr2=0x7f8fc4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/1604319923 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fc4036b90 0x7f8fc4039050 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x561207664bf0 tx=0x7f90d4005ac0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/1604319923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56120777c440 msgr2=0x56120777c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/1604319923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56120777c440 0x56120777c860 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f90dc04b790 tx=0x7f90dc04cf20 comp rx=0 tx=0).stop 2024-09-18T01:26:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/1604319923 shutdown_connections 2024-09-18T01:26:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/1604319923 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fc4036b90 0x7f8fc4039050 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/1604319923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56120777c440 0x56120777c860 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/1604319923 >> 172.21.15.100:0/1604319923 conn(0x5612077713d0 msgr2=0x561207773f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/1604319923 shutdown_connections 2024-09-18T01:26:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/1604319923 wait complete. 2024-09-18T01:26:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56120776bbe0 msgr2=0x56120776dfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56120776bbe0 0x56120776dfd0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561207669970 msgr2=0x5612077653e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561207669970 0x5612077653e0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561207767ba0 msgr2=0x561207769ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.241+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561207767ba0 0x561207769ff0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.242+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fd0036b40 msgr2=0x7f8fd0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.242+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8fd0036b40 0x7f8fd0039000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f90d400a520 tx=0x7f90d4052000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.242+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612075d8d60 msgr2=0x561207665b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.242+0000 7f90ebe0f800 1 --2- 172.21.15.100:0/3284385303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612075d8d60 0x561207665b80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f90dc000f60 tx=0x7f90dc000ed0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.242+0000 7f90ea104640 1 -- 172.21.15.100:0/3284385303 reap_dead start 2024-09-18T01:26:26.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.242+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 shutdown_connections 2024-09-18T01:26:26.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.242+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 >> 172.21.15.100:0/3284385303 conn(0x56120765fde0 msgr2=0x56120774e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.242+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 shutdown_connections 2024-09-18T01:26:26.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.242+0000 7f90ebe0f800 1 -- 172.21.15.100:0/3284385303 wait complete. 2024-09-18T01:26:26.253 INFO:teuthology.orchestra.run.smithi100.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-18T01:26:26.253 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-18T01:26:26.254 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-18T01:26:26.254 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-18T01:26:26.254 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-18T01:26:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:26:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:26:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.337+0000 7f4eee416800 1 Processor -- start 2024-09-18T01:26:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.337+0000 7f4eee416800 1 -- start start 2024-09-18T01:26:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.337+0000 7f4eee416800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55f81084e860 0x55f810850c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.337+0000 7f4eee416800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f810709b30 con 0x55f8107bde90 2024-09-18T01:26:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.337+0000 7f4eee416800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55f8106eb360 con 0x55f81084e860 2024-09-18T01:26:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.337+0000 7f4ee93f0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55f81084e860 0x55f810850c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.337+0000 7f4ee93f0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55f81084e860 0x55f810850c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44582/0 (socket says 172.21.15.100:44582) 2024-09-18T01:26:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.337+0000 7f4ee9bf1640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55f8107bde90 0x55f81084d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:51684/0 (socket says 172.21.15.100:51684) 2024-09-18T01:26:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.337+0000 7f4ee93f0640 1 -- 172.21.15.100:0/1872162695 learned_addr learned my addr 172.21.15.100:0/1872162695 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.338+0000 7f4ee93f0640 1 -- 172.21.15.100:0/1872162695 >> v1:172.21.15.92:6789/0 conn(0x55f8107bde90 legacy=0x55f81084d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.338+0000 7f4ee93f0640 1 -- 172.21.15.100:0/1872162695 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f810711e00 con 0x55f81084e860 2024-09-18T01:26:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.339+0000 7f4ee93f0640 1 --2- 172.21.15.100:0/1872162695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084e860 0x55f810850c70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000a520 tx=0x7f4ee0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953e914aa87183aa server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.340+0000 7f4ee8bef640 1 -- 172.21.15.100:0/1872162695 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee0055070 con 0x55f81084e860 2024-09-18T01:26:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.340+0000 7f4ee8bef640 1 -- 172.21.15.100:0/1872162695 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee00515b0 con 0x55f81084e860 2024-09-18T01:26:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.340+0000 7f4ee8bef640 1 -- 172.21.15.100:0/1872162695 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee00518d0 con 0x55f81084e860 2024-09-18T01:26:26.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.340+0000 7f4eee416800 1 -- 172.21.15.100:0/1872162695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084e860 msgr2=0x55f810850c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.340+0000 7f4eee416800 1 --2- 172.21.15.100:0/1872162695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084e860 0x55f810850c70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000a520 tx=0x7f4ee0045ba0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.340+0000 7f4eee416800 1 -- 172.21.15.100:0/1872162695 shutdown_connections 2024-09-18T01:26:26.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.340+0000 7f4eee416800 1 --2- 172.21.15.100:0/1872162695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084e860 0x55f810850c70 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.340+0000 7f4eee416800 1 -- 172.21.15.100:0/1872162695 >> 172.21.15.100:0/1872162695 conn(0x55f810844df0 msgr2=0x55f810847210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.340+0000 7f4eee416800 1 -- 172.21.15.100:0/1872162695 shutdown_connections 2024-09-18T01:26:26.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.340+0000 7f4eee416800 1 -- 172.21.15.100:0/1872162695 wait complete. 2024-09-18T01:26:26.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.354+0000 7f4eee416800 1 Processor -- start 2024-09-18T01:26:26.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.354+0000 7f4eee416800 1 -- start start 2024-09-18T01:26:26.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.354+0000 7f4eee416800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8107bde90 0x55f810939860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.354+0000 7f4eee416800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f810796330 con 0x55f8107bde90 2024-09-18T01:26:26.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.354+0000 7f4ee9bf1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8107bde90 0x55f810939860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.354+0000 7f4ee9bf1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8107bde90 0x55f810939860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44594/0 (socket says 172.21.15.100:44594) 2024-09-18T01:26:26.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.354+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/1768162435 learned_addr learned my addr 172.21.15.100:0/1768162435 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.355+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/1768162435 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8106e3bc0 con 0x55f8107bde90 2024-09-18T01:26:26.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.355+0000 7f4ee9bf1640 1 --2- 172.21.15.100:0/1768162435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8107bde90 0x55f810939860 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4edc001e40 tx=0x7f4edc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf57199fe14d19b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.355+0000 7f4dd7e07640 1 -- 172.21.15.100:0/1768162435 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc00e5c0 con 0x55f8107bde90 2024-09-18T01:26:26.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.355+0000 7f4dd7e07640 1 -- 172.21.15.100:0/1768162435 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc006070 con 0x55f8107bde90 2024-09-18T01:26:26.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.355+0000 7f4dd7e07640 1 -- 172.21.15.100:0/1768162435 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc00e910 con 0x55f8107bde90 2024-09-18T01:26:26.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.356+0000 7f4eee416800 1 -- 172.21.15.100:0/1768162435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8107bde90 msgr2=0x55f810939860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.356+0000 7f4eee416800 1 --2- 172.21.15.100:0/1768162435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8107bde90 0x55f810939860 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4edc001e40 tx=0x7f4edc001e70 comp rx=0 tx=0).stop 2024-09-18T01:26:26.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.356+0000 7f4eee416800 1 -- 172.21.15.100:0/1768162435 shutdown_connections 2024-09-18T01:26:26.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.356+0000 7f4eee416800 1 --2- 172.21.15.100:0/1768162435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8107bde90 0x55f810939860 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.356+0000 7f4eee416800 1 -- 172.21.15.100:0/1768162435 >> 172.21.15.100:0/1768162435 conn(0x55f810844df0 msgr2=0x55f810935220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.356+0000 7f4eee416800 1 -- 172.21.15.100:0/1768162435 shutdown_connections 2024-09-18T01:26:26.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.356+0000 7f4eee416800 1 -- 172.21.15.100:0/1768162435 wait complete. 2024-09-18T01:26:26.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.356+0000 7f4eee416800 1 Processor -- start 2024-09-18T01:26:26.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.356+0000 7f4eee416800 1 -- start start 2024-09-18T01:26:26.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.356+0000 7f4eee416800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084e860 0x55f8109414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.356+0000 7f4eee416800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f8108515f0 con 0x55f81084e860 2024-09-18T01:26:26.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.356+0000 7f4ee9bf1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084e860 0x55f8109414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.357+0000 7f4ee9bf1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084e860 0x55f8109414a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44600/0 (socket says 172.21.15.100:44600) 2024-09-18T01:26:26.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.357+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/122942728 learned_addr learned my addr 172.21.15.100:0/122942728 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.357+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/122942728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8106f7fe0 con 0x55f81084e860 2024-09-18T01:26:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.357+0000 7f4ee9bf1640 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084e860 0x55f8109414a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4edc004000 tx=0x7f4edc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.357+0000 7f4dd6604640 1 -- 172.21.15.100:0/122942728 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc01a690 con 0x55f81084e860 2024-09-18T01:26:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.357+0000 7f4dd6604640 1 -- 172.21.15.100:0/122942728 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc01a830 con 0x55f81084e860 2024-09-18T01:26:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.357+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8109419e0 con 0x55f81084e860 2024-09-18T01:26:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.357+0000 7f4dd6604640 1 -- 172.21.15.100:0/122942728 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc01ab90 con 0x55f81084e860 2024-09-18T01:26:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.357+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f810941f00 con 0x55f81084e860 2024-09-18T01:26:26.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.358+0000 7f4dd6604640 1 -- 172.21.15.100:0/122942728 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4edc017070 con 0x55f81084e860 2024-09-18T01:26:26.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.358+0000 7f4dd6604640 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4dd0036b40 0x7f4dd0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.359+0000 7f4dd6604640 1 -- 172.21.15.100:0/122942728 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4edc015020 con 0x55f81084e860 2024-09-18T01:26:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.359+0000 7f4ee93f0640 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4dd0036b40 0x7f4dd0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.359+0000 7f4eee416800 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55f810946500 0x55f8109488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.359+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f810948e70 con 0x55f810946500 2024-09-18T01:26:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.359+0000 7f4eea3f2640 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55f810946500 0x55f8109488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.359+0000 7f4ee93f0640 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4dd0036b40 0x7f4dd0039000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0057000 tx=0x7f4ee0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.359+0000 7f4eea3f2640 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55f810946500 0x55f8109488f0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.359+0000 7f4eea3f2640 1 -- 172.21.15.100:0/122942728 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810946500 2024-09-18T01:26:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.359+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f810945ae0 con 0x55f810946500 2024-09-18T01:26:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.360+0000 7f4eea3f2640 1 -- 172.21.15.100:0/122942728 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810946500 2024-09-18T01:26:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.360+0000 7f4eee416800 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55f81094b1c0 0x55f81094d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.360+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f81094dca0 con 0x55f81094b1c0 2024-09-18T01:26:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.360+0000 7f4ee9bf1640 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55f81094b1c0 0x55f81094d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.360+0000 7f4ee9bf1640 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55f81094b1c0 0x55f81094d5b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.360+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/122942728 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4edc02e070 con 0x55f81094b1c0 2024-09-18T01:26:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.360+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f81094a060 con 0x55f810946500 2024-09-18T01:26:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.361+0000 7f4eea3f2640 1 -- 172.21.15.100:0/122942728 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810946500 2024-09-18T01:26:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.361+0000 7f4eee416800 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55f81094f100 0x55f8109514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.361+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f810951bf0 con 0x55f81094f100 2024-09-18T01:26:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.361+0000 7f4ee93f0640 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55f81094f100 0x55f8109514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.361+0000 7f4ee93f0640 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55f81094f100 0x55f8109514f0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.362+0000 7f4ee93f0640 1 -- 172.21.15.100:0/122942728 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81094f100 2024-09-18T01:26:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.362+0000 7f4eee416800 1 Processor -- start 2024-09-18T01:26:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.362+0000 7f4eee416800 1 -- start start 2024-09-18T01:26:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.362+0000 7f4eee416800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81095f9a0 0x55f81095fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.362+0000 7f4eee416800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f8106e5580 con 0x55f81095f9a0 2024-09-18T01:26:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.362+0000 7f4ee9bf1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81095f9a0 0x55f81095fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.362+0000 7f4ee9bf1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81095f9a0 0x55f81095fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44606/0 (socket says 172.21.15.100:44606) 2024-09-18T01:26:26.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.362+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/3820603511 learned_addr learned my addr 172.21.15.100:0/3820603511 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.363+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/3820603511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f810960300 con 0x55f81095f9a0 2024-09-18T01:26:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.363+0000 7f4ee9bf1640 1 --2- 172.21.15.100:0/3820603511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81095f9a0 0x55f81095fdc0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4edc04b620 tx=0x7f4edc028f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.363+0000 7f4dcf7fe640 1 -- 172.21.15.100:0/3820603511 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc01cc70 con 0x55f81095f9a0 2024-09-18T01:26:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.363+0000 7f4dcf7fe640 1 -- 172.21.15.100:0/3820603511 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc01ce10 con 0x55f81095f9a0 2024-09-18T01:26:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.363+0000 7f4dcf7fe640 1 -- 172.21.15.100:0/3820603511 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc04b9d0 con 0x55f81095f9a0 2024-09-18T01:26:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.363+0000 7f4eee416800 1 -- 172.21.15.100:0/3820603511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f810960590 con 0x55f81095f9a0 2024-09-18T01:26:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.363+0000 7f4eee416800 1 -- 172.21.15.100:0/3820603511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f810963060 con 0x55f81095f9a0 2024-09-18T01:26:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.364+0000 7f4dcf7fe640 1 -- 172.21.15.100:0/3820603511 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4edc04bb70 con 0x55f81095f9a0 2024-09-18T01:26:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.364+0000 7f4dcf7fe640 1 --2- 172.21.15.100:0/3820603511 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4dc4036b90 0x7f4dc4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.364+0000 7f4dcf7fe640 1 -- 172.21.15.100:0/3820603511 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4edc04ed70 con 0x55f81095f9a0 2024-09-18T01:26:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.364+0000 7f4ee93f0640 1 --2- 172.21.15.100:0/3820603511 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4dc4036b90 0x7f4dc4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.364+0000 7f4eee416800 1 Processor -- start 2024-09-18T01:26:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.364+0000 7f4eee416800 1 -- start start 2024-09-18T01:26:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.365+0000 7f4ee93f0640 1 --2- 172.21.15.100:0/3820603511 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4dc4036b90 0x7f4dc4039050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55f810949770 tx=0x7f4ee0005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.365+0000 7f4eee416800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084a370 0x55f81084a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.365+0000 7f4eee416800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f81093a010 con 0x55f81084a370 2024-09-18T01:26:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.365+0000 7f4ee9bf1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084a370 0x55f81084a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.365+0000 7f4ee9bf1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084a370 0x55f81084a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44616/0 (socket says 172.21.15.100:44616) 2024-09-18T01:26:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.365+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/1806820403 learned_addr learned my addr 172.21.15.100:0/1806820403 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.365+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/1806820403 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f81084ad40 con 0x55f81084a370 2024-09-18T01:26:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.365+0000 7f4ee9bf1640 1 --2- 172.21.15.100:0/1806820403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084a370 0x55f81084a770 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4edc01bbf0 tx=0x7f4edc044510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a161bed5ad633d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.365+0000 7f4dcd7fa640 1 -- 172.21.15.100:0/1806820403 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc03f2d0 con 0x55f81084a370 2024-09-18T01:26:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.365+0000 7f4dcd7fa640 1 -- 172.21.15.100:0/1806820403 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc044f30 con 0x55f81084a370 2024-09-18T01:26:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.365+0000 7f4dcd7fa640 1 -- 172.21.15.100:0/1806820403 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc00f450 con 0x55f81084a370 2024-09-18T01:26:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.366+0000 7f4eee416800 1 -- 172.21.15.100:0/1806820403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084a370 msgr2=0x55f81084a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.366+0000 7f4eee416800 1 --2- 172.21.15.100:0/1806820403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084a370 0x55f81084a770 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4edc01bbf0 tx=0x7f4edc044510 comp rx=0 tx=0).stop 2024-09-18T01:26:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.366+0000 7f4eee416800 1 -- 172.21.15.100:0/1806820403 shutdown_connections 2024-09-18T01:26:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.366+0000 7f4eee416800 1 --2- 172.21.15.100:0/1806820403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084a370 0x55f81084a770 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.366+0000 7f4eee416800 1 -- 172.21.15.100:0/1806820403 >> 172.21.15.100:0/1806820403 conn(0x55f810968640 msgr2=0x55f810966740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.366+0000 7f4eee416800 1 -- 172.21.15.100:0/1806820403 shutdown_connections 2024-09-18T01:26:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.366+0000 7f4eee416800 1 -- 172.21.15.100:0/1806820403 wait complete. 2024-09-18T01:26:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.366+0000 7f4eee416800 1 Processor -- start 2024-09-18T01:26:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.366+0000 7f4eee416800 1 -- start start 2024-09-18T01:26:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.366+0000 7f4eee416800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084a370 0x55f8109756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.366+0000 7f4eee416800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f810848f20 con 0x55f81084a370 2024-09-18T01:26:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.367+0000 7f4ee9bf1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084a370 0x55f8109756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.367+0000 7f4ee9bf1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084a370 0x55f8109756c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44620/0 (socket says 172.21.15.100:44620) 2024-09-18T01:26:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.367+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 learned_addr learned my addr 172.21.15.100:0/909018987 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.367+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f810975c00 con 0x55f81084a370 2024-09-18T01:26:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.367+0000 7f4ee9bf1640 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084a370 0x55f8109756c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4edc019c90 tx=0x7f4edc02df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.367+0000 7f4dbb7fe640 1 -- 172.21.15.100:0/909018987 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc003a30 con 0x55f81084a370 2024-09-18T01:26:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.367+0000 7f4dbb7fe640 1 -- 172.21.15.100:0/909018987 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc06a030 con 0x55f81084a370 2024-09-18T01:26:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.367+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f810975c00 con 0x55f81084a370 2024-09-18T01:26:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.367+0000 7f4dbb7fe640 1 -- 172.21.15.100:0/909018987 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc003d00 con 0x55f81084a370 2024-09-18T01:26:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.367+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f810975c00 con 0x55f81084a370 2024-09-18T01:26:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.368+0000 7f4dbb7fe640 1 -- 172.21.15.100:0/909018987 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4edc061040 con 0x55f81084a370 2024-09-18T01:26:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.368+0000 7f4dbb7fe640 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4db4036b40 0x7f4db4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.368+0000 7f4dbb7fe640 1 -- 172.21.15.100:0/909018987 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4edc054040 con 0x55f81084a370 2024-09-18T01:26:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.368+0000 7f4ee93f0640 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4db4036b40 0x7f4db4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.368+0000 7f4eee416800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4eee416800 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55f810980cb0 0x55f810983170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f8109838c0 con 0x55f810980cb0 2024-09-18T01:26:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4eea3f2640 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55f810980cb0 0x55f810983170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4ee93f0640 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4db4036b40 0x7f4db4039000 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0051990 tx=0x7f4ee006d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4eea3f2640 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55f810980cb0 0x55f810983170 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4eee416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4eee416800 20 realm 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4eee416800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f810983cd0 con 0x55f810980cb0 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4eee416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4eee416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4eee416800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.369+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f8109845a0 con 0x55f810980cb0 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.370+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.370+0000 7f4eee416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.370+0000 7f4eee416800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.370+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810980cb0 2024-09-18T01:26:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.370+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.370+0000 7f4eee416800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.370+0000 7f4eee416800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.370+0000 7f4eee416800 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55f810985430 0x55f810987820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.370+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f810987f80 con 0x55f810985430 2024-09-18T01:26:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.370+0000 7f4ee9bf1640 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55f810985430 0x55f810987820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.370+0000 7f4ee9bf1640 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55f810985430 0x55f810987820 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.370+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.371+0000 7f4eee416800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:26:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.371+0000 7f4eee416800 20 searching for the correct realm 2024-09-18T01:26:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.371+0000 7f4eee416800 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55f81098a030 0x55f81098c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.371+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f81098cbc0 con 0x55f81098a030 2024-09-18T01:26:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.371+0000 7f4ee93f0640 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55f81098a030 0x55f81098c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.371+0000 7f4ee93f0640 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55f81098a030 0x55f81098c4f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.371+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81098a030 2024-09-18T01:26:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.371+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f81098cbc0 con 0x55f810985430 2024-09-18T01:26:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.371+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.371+0000 7f4ee9bf1640 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4edc046040 0x7f4edc0318a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.371+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f81098cbc0 con 0x7f4edc046040 2024-09-18T01:26:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.372+0000 7f4eea3f2640 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4edc046040 0x7f4edc0318a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.372+0000 7f4eea3f2640 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4edc046040 0x7f4edc0318a0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.372+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.372+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810980cb0 2024-09-18T01:26:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.373+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.373+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810980cb0 2024-09-18T01:26:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.373+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.373+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x7f4edc046040 2024-09-18T01:26:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.373+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.373+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x7f4edc046040 2024-09-18T01:26:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.373+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.373+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810985430 2024-09-18T01:26:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.374+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.374+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f81098a030 2024-09-18T01:26:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.374+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81098a030 2024-09-18T01:26:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.374+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810980cb0 2024-09-18T01:26:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.374+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.374+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810985430 2024-09-18T01:26:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.374+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.374+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810980cb0 2024-09-18T01:26:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.375+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.375+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810985430 2024-09-18T01:26:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.375+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.375+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f81098a030 2024-09-18T01:26:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.375+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81098a030 2024-09-18T01:26:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.375+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f81098a030 2024-09-18T01:26:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.375+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81098a030 2024-09-18T01:26:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.375+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x7f4edc046040 2024-09-18T01:26:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.376+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.376+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f81098a030 2024-09-18T01:26:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.376+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81098a030 2024-09-18T01:26:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.376+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f81098a030 2024-09-18T01:26:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.376+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81098a030 2024-09-18T01:26:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.376+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810980cb0 2024-09-18T01:26:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.376+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.376+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810980cb0 2024-09-18T01:26:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.377+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.377+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x7f4edc046040 2024-09-18T01:26:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.377+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.377+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f81098a030 2024-09-18T01:26:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.377+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81098a030 2024-09-18T01:26:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.377+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810985430 2024-09-18T01:26:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.377+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.377+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810980cb0 2024-09-18T01:26:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.378+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.378+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x7f4edc046040 2024-09-18T01:26:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.378+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.378+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f81098a030 2024-09-18T01:26:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.378+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81098a030 2024-09-18T01:26:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.378+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810985430 2024-09-18T01:26:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.379+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.379+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810985430 2024-09-18T01:26:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.379+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.379+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f81098a030 2024-09-18T01:26:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.379+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81098a030 2024-09-18T01:26:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.379+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x7f4edc046040 2024-09-18T01:26:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.379+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.379+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810980cb0 2024-09-18T01:26:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f810984940 con 0x55f810985430 2024-09-18T01:26:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eee416800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:26:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eee416800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:26:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eee416800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:26:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eee416800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:26:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eee416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:26:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eee416800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:26:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eee416800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f810988930 con 0x55f810980cb0 2024-09-18T01:26:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eee416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eee416800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f810988d20 con 0x55f810980cb0 2024-09-18T01:26:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eee416800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eee416800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.380+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f810988d20 con 0x7f4edc046040 2024-09-18T01:26:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eee416800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:26:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eee416800 20 zone default found 2024-09-18T01:26:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eee416800 4 Realm: () 2024-09-18T01:26:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eee416800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:26:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eee416800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:26:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eee416800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eee416800 20 zonegroup default 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eee416800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f810989140 con 0x7f4edc046040 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eee416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eee416800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f810989140 con 0x55f81098a030 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81098a030 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.381+0000 7f4eee416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.382+0000 7f4eee416800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.382+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f81098ea20 con 0x55f81098a030 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.382+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81098a030 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.382+0000 7f4eee416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.382+0000 7f4eee416800 20 started sync module instance, tier type = 2024-09-18T01:26:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.382+0000 7f4eee416800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:26:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.382+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f81098dec0 con 0x55f810985430 2024-09-18T01:26:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.383+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.383+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94523918705248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f81098e680 con 0x55f810985430 2024-09-18T01:26:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.383+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f81098f780 con 0x55f810980cb0 2024-09-18T01:26:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.384+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94523918705248] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.384+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.384+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94523918708160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f81098fb70 con 0x55f810980cb0 2024-09-18T01:26:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.384+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f8109905b0 con 0x55f81098a030 2024-09-18T01:26:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.386+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94523918708160] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.386+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81098a030 2024-09-18T01:26:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.386+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94523918712960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f8109909a0 con 0x55f81098a030 2024-09-18T01:26:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.386+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f8109913a0 con 0x55f810985430 2024-09-18T01:26:26.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.387+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.387+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94523918718864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810992060 con 0x55f810985430 2024-09-18T01:26:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.387+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94523918712960] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81098a030 2024-09-18T01:26:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.387+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f81098f220 con 0x55f810980cb0 2024-09-18T01:26:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.388+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94523918718864] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.389+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.389+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94523918719920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810992a50 con 0x55f810980cb0 2024-09-18T01:26:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.389+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810993410 con 0x7f4edc046040 2024-09-18T01:26:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.390+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94523918719920] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.390+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.390+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94523918722944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810993410 con 0x7f4edc046040 2024-09-18T01:26:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.390+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810993dd0 con 0x7f4edc046040 2024-09-18T01:26:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.391+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94523918722944] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.391+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.391+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94523918725440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810993dd0 con 0x7f4edc046040 2024-09-18T01:26:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.391+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810994790 con 0x7f4edc046040 2024-09-18T01:26:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.392+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94523918725440] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.393+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.393+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94523918727936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810994790 con 0x7f4edc046040 2024-09-18T01:26:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.393+0000 7f4eee416800 20 add_watcher() i=0 2024-09-18T01:26:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.393+0000 7f4eee416800 20 add_watcher() i=1 2024-09-18T01:26:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.393+0000 7f4eee416800 20 add_watcher() i=2 2024-09-18T01:26:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.393+0000 7f4eee416800 20 add_watcher() i=3 2024-09-18T01:26:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.393+0000 7f4eee416800 20 add_watcher() i=4 2024-09-18T01:26:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.393+0000 7f4eee416800 20 add_watcher() i=5 2024-09-18T01:26:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.393+0000 7f4eee416800 20 add_watcher() i=6 2024-09-18T01:26:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.394+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94523918727936] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.394+0000 7f4eee416800 20 add_watcher() i=7 2024-09-18T01:26:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.394+0000 7f4eee416800 2 all 8 watchers are set, enabling cache 2024-09-18T01:26:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.394+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f810997aa0 con 0x55f810980cb0 2024-09-18T01:26:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.394+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.394+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94523918730320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810994d20 con 0x55f810980cb0 2024-09-18T01:26:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.395+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94523918730320] v35'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.395+0000 7f4d9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.396+0000 7f4eee416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:26:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.396+0000 7f4eee416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:26:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.396+0000 7f4eee416800 5 note: GC not initialized 2024-09-18T01:26:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.396+0000 7f4d9a7fc640 20 reqs_thread_entry: start 2024-09-18T01:26:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.396+0000 7f4eee416800 20 init_complete bucket index max shards: 11 2024-09-18T01:26:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.396+0000 7f4eee416800 20 Filter name: none 2024-09-18T01:26:26.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.396+0000 7f4d0bfff640 20 reqs_thread_entry: start 2024-09-18T01:26:26.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.396+0000 7f4eee416800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.396+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f8109caa40 con 0x55f810980cb0 2024-09-18T01:26:26.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.396+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.397+0000 7f4eee416800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:26:26.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.397+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f8109cbf90 con 0x7f4edc046040 2024-09-18T01:26:26.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.397+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.398+0000 7f4d9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:26.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.398+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94523918730320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810996ee0 con 0x55f810980cb0 2024-09-18T01:26:26.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.399+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94523918730320] v35'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.399+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94523918705248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810994450 con 0x55f810985430 2024-09-18T01:26:26.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.400+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94523918705248] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.400+0000 7f4eee416800 20 remove_watcher() i=0 2024-09-18T01:26:26.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.400+0000 7f4eee416800 2 removed watcher, disabling cache 2024-09-18T01:26:26.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.400+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94523918708160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810994450 con 0x55f810980cb0 2024-09-18T01:26:26.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.402+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94523918708160] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.402+0000 7f4eee416800 20 remove_watcher() i=1 2024-09-18T01:26:26.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.402+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94523918712960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f81098edc0 con 0x55f81098a030 2024-09-18T01:26:26.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.403+0000 7f4ee93f0640 1 -- 172.21.15.100:0/909018987 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94523918712960] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee0057030 con 0x55f81098a030 2024-09-18T01:26:26.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.403+0000 7f4eee416800 20 remove_watcher() i=2 2024-09-18T01:26:26.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.403+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94523918718864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810994450 con 0x55f810985430 2024-09-18T01:26:26.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.404+0000 7f4ee9bf1640 1 -- 172.21.15.100:0/909018987 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94523918718864] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc02e070 con 0x55f810985430 2024-09-18T01:26:26.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.404+0000 7f4eee416800 20 remove_watcher() i=3 2024-09-18T01:26:26.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.404+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94523918719920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810994450 con 0x55f810980cb0 2024-09-18T01:26:26.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.405+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94523918719920] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x55f810980cb0 2024-09-18T01:26:26.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.405+0000 7f4eee416800 20 remove_watcher() i=4 2024-09-18T01:26:26.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.405+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94523918722944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810991bf0 con 0x7f4edc046040 2024-09-18T01:26:26.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.406+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94523918722944] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.406+0000 7f4eee416800 20 remove_watcher() i=5 2024-09-18T01:26:26.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.406+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94523918725440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810994450 con 0x7f4edc046040 2024-09-18T01:26:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.407+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94523918725440] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.407+0000 7f4eee416800 20 remove_watcher() i=6 2024-09-18T01:26:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.408+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94523918727936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f810992780 con 0x7f4edc046040 2024-09-18T01:26:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94523918727936] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee400a4a0 con 0x7f4edc046040 2024-09-18T01:26:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 20 remove_watcher() i=7 2024-09-18T01:26:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4edc046040 msgr2=0x7f4edc0318a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f4edc046040 0x7f4edc0318a0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55f810980cb0 msgr2=0x55f810983170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55f810980cb0 0x55f810983170 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55f810985430 msgr2=0x55f810987820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55f810985430 0x55f810987820 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55f81098a030 msgr2=0x55f81098c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55f81098a030 0x55f81098c4f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4db4036b40 msgr2=0x7f4db4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4db4036b40 0x7f4db4039000 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0051990 tx=0x7f4ee006d040 comp rx=0 tx=0).stop 2024-09-18T01:26:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084a370 msgr2=0x55f8109756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 --2- 172.21.15.100:0/909018987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084a370 0x55f8109756c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4edc019c90 tx=0x7f4edc02df10 comp rx=0 tx=0).stop 2024-09-18T01:26:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 reap_dead start 2024-09-18T01:26:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eea3f2640 1 -- 172.21.15.100:0/909018987 reap_dead start 2024-09-18T01:26:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 shutdown_connections 2024-09-18T01:26:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 >> 172.21.15.100:0/909018987 conn(0x55f810968640 msgr2=0x55f810966710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 shutdown_connections 2024-09-18T01:26:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/909018987 wait complete. 2024-09-18T01:26:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/3820603511 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4dc4036b90 msgr2=0x7f4dc4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 --2- 172.21.15.100:0/3820603511 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4dc4036b90 0x7f4dc4039050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55f810949770 tx=0x7f4ee0005ac0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/3820603511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81095f9a0 msgr2=0x55f81095fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 --2- 172.21.15.100:0/3820603511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81095f9a0 0x55f81095fdc0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4edc04b620 tx=0x7f4edc028f10 comp rx=0 tx=0).stop 2024-09-18T01:26:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/3820603511 shutdown_connections 2024-09-18T01:26:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 --2- 172.21.15.100:0/3820603511 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4dc4036b90 0x7f4dc4039050 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 --2- 172.21.15.100:0/3820603511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81095f9a0 0x55f81095fdc0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/3820603511 >> 172.21.15.100:0/3820603511 conn(0x55f810954930 msgr2=0x55f8109574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/3820603511 shutdown_connections 2024-09-18T01:26:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.409+0000 7f4eee416800 1 -- 172.21.15.100:0/3820603511 wait complete. 2024-09-18T01:26:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55f81094f100 msgr2=0x55f8109514f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eee416800 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55f81094f100 0x55f8109514f0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55f810946500 msgr2=0x55f8109488f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eee416800 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55f810946500 0x55f8109488f0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55f81094b1c0 msgr2=0x55f81094d5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eee416800 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55f81094b1c0 0x55f81094d5b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4dd0036b40 msgr2=0x7f4dd0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eee416800 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4dd0036b40 0x7f4dd0039000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0057000 tx=0x7f4ee0052000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084e860 msgr2=0x55f8109414a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eee416800 1 --2- 172.21.15.100:0/122942728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f81084e860 0x55f8109414a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4edc004000 tx=0x7f4edc000bc0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eea3f2640 1 -- 172.21.15.100:0/122942728 reap_dead start 2024-09-18T01:26:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 shutdown_connections 2024-09-18T01:26:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 >> 172.21.15.100:0/122942728 conn(0x55f810844df0 msgr2=0x55f810933ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 shutdown_connections 2024-09-18T01:26:26.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.410+0000 7f4eee416800 1 -- 172.21.15.100:0/122942728 wait complete. 2024-09-18T01:26:26.420 INFO:teuthology.orchestra.run.smithi100.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-18T01:26:26.421 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-18T01:26:26.421 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-18T01:26:26.421 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-18T01:26:26.421 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-18T01:26:26.467 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:26:26.467 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:26:26.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.466+0000 7ff49f40f800 1 Processor -- start 2024-09-18T01:26:26.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.466+0000 7ff49f40f800 1 -- start start 2024-09-18T01:26:26.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.466+0000 7ff49f40f800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5562927be630 0x55629284d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.466+0000 7ff49f40f800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556292709b30 con 0x55629284d740 2024-09-18T01:26:26.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.466+0000 7ff49f40f800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5562926eb360 con 0x5562927be630 2024-09-18T01:26:26.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.466+0000 7ff49aaee640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5562927be630 0x55629284d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.466+0000 7ff49a2ed640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55629284d740 0x55629284fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:51698/0 (socket says 172.21.15.100:51698) 2024-09-18T01:26:26.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.466+0000 7ff49aaee640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5562927be630 0x55629284d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44628/0 (socket says 172.21.15.100:44628) 2024-09-18T01:26:26.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.466+0000 7ff49a2ed640 1 -- 172.21.15.100:0/2741300509 learned_addr learned my addr 172.21.15.100:0/2741300509 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:26:26.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.466+0000 7ff49aaee640 1 -- 172.21.15.100:0/2741300509 >> v1:172.21.15.92:6789/0 conn(0x55629284d740 legacy=0x55629284fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.466+0000 7ff49aaee640 1 -- 172.21.15.100:0/2741300509 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556292711e00 con 0x5562927be630 2024-09-18T01:26:26.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.468+0000 7ff49aaee640 1 --2- 172.21.15.100:0/2741300509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 0x55629284d200 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff494005fd0 tx=0x7ff494045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6adc8485bf5071 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.468+0000 7ff499aec640 1 -- 172.21.15.100:0/2741300509 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff494058530 con 0x5562927be630 2024-09-18T01:26:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.468+0000 7ff499aec640 1 -- 172.21.15.100:0/2741300509 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4940586d0 con 0x5562927be630 2024-09-18T01:26:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.468+0000 7ff499aec640 1 -- 172.21.15.100:0/2741300509 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4940589d0 con 0x5562927be630 2024-09-18T01:26:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.469+0000 7ff49f40f800 1 -- 172.21.15.100:0/2741300509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 msgr2=0x55629284d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.469+0000 7ff49f40f800 1 --2- 172.21.15.100:0/2741300509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 0x55629284d200 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff494005fd0 tx=0x7ff494045c30 comp rx=0 tx=0).stop 2024-09-18T01:26:26.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.469+0000 7ff49f40f800 1 -- 172.21.15.100:0/2741300509 shutdown_connections 2024-09-18T01:26:26.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.469+0000 7ff49f40f800 1 --2- 172.21.15.100:0/2741300509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 0x55629284d200 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.469+0000 7ff49f40f800 1 -- 172.21.15.100:0/2741300509 >> 172.21.15.100:0/2741300509 conn(0x556292844db0 msgr2=0x5562928471d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.469+0000 7ff49f40f800 1 -- 172.21.15.100:0/2741300509 shutdown_connections 2024-09-18T01:26:26.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.469+0000 7ff49f40f800 1 -- 172.21.15.100:0/2741300509 wait complete. 2024-09-18T01:26:26.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.483+0000 7ff49f40f800 1 Processor -- start 2024-09-18T01:26:26.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.483+0000 7ff49f40f800 1 -- start start 2024-09-18T01:26:26.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.483+0000 7ff49f40f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 0x55629284ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.483+0000 7ff49f40f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556292796360 con 0x5562927be630 2024-09-18T01:26:26.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.483+0000 7ff49aaee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 0x55629284ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.483+0000 7ff49aaee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 0x55629284ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44630/0 (socket says 172.21.15.100:44630) 2024-09-18T01:26:26.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.483+0000 7ff49aaee640 1 -- 172.21.15.100:0/1723831622 learned_addr learned my addr 172.21.15.100:0/1723831622 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.484+0000 7ff49aaee640 1 -- 172.21.15.100:0/1723831622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562926e3bc0 con 0x5562927be630 2024-09-18T01:26:26.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.484+0000 7ff49aaee640 1 --2- 172.21.15.100:0/1723831622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 0x55629284ab30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff49400a3f0 tx=0x7ff494051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a49d925037868f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.484+0000 7ff388e09640 1 -- 172.21.15.100:0/1723831622 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4940589b0 con 0x5562927be630 2024-09-18T01:26:26.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.484+0000 7ff388e09640 1 -- 172.21.15.100:0/1723831622 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff494068070 con 0x5562927be630 2024-09-18T01:26:26.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.484+0000 7ff388e09640 1 -- 172.21.15.100:0/1723831622 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff494058c80 con 0x5562927be630 2024-09-18T01:26:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.485+0000 7ff49f40f800 1 -- 172.21.15.100:0/1723831622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 msgr2=0x55629284ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.485+0000 7ff49f40f800 1 --2- 172.21.15.100:0/1723831622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 0x55629284ab30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff49400a3f0 tx=0x7ff494051000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.485+0000 7ff49f40f800 1 -- 172.21.15.100:0/1723831622 shutdown_connections 2024-09-18T01:26:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.485+0000 7ff49f40f800 1 --2- 172.21.15.100:0/1723831622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 0x55629284ab30 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.485+0000 7ff49f40f800 1 -- 172.21.15.100:0/1723831622 >> 172.21.15.100:0/1723831622 conn(0x556292844db0 msgr2=0x5562929352d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.485+0000 7ff49f40f800 1 -- 172.21.15.100:0/1723831622 shutdown_connections 2024-09-18T01:26:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.485+0000 7ff49f40f800 1 -- 172.21.15.100:0/1723831622 wait complete. 2024-09-18T01:26:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.485+0000 7ff49f40f800 1 Processor -- start 2024-09-18T01:26:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.485+0000 7ff49f40f800 1 -- start start 2024-09-18T01:26:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.485+0000 7ff49f40f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 0x5562929433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.485+0000 7ff49f40f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556292851610 con 0x5562927be630 2024-09-18T01:26:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.486+0000 7ff49aaee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 0x5562929433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.486+0000 7ff49aaee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 0x5562929433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44632/0 (socket says 172.21.15.100:44632) 2024-09-18T01:26:26.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.486+0000 7ff49aaee640 1 -- 172.21.15.100:0/1326425053 learned_addr learned my addr 172.21.15.100:0/1326425053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.486+0000 7ff49aaee640 1 -- 172.21.15.100:0/1326425053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562926f7fe0 con 0x5562927be630 2024-09-18T01:26:26.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.486+0000 7ff49aaee640 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 0x5562929433f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff494065040 tx=0x7ff494003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.486+0000 7ff387606640 1 -- 172.21.15.100:0/1326425053 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff494063650 con 0x5562927be630 2024-09-18T01:26:26.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.486+0000 7ff387606640 1 -- 172.21.15.100:0/1326425053 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4940637f0 con 0x5562927be630 2024-09-18T01:26:26.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.486+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556292943930 con 0x5562927be630 2024-09-18T01:26:26.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.486+0000 7ff387606640 1 -- 172.21.15.100:0/1326425053 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff494063af0 con 0x5562927be630 2024-09-18T01:26:26.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.486+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556292943e50 con 0x5562927be630 2024-09-18T01:26:26.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.487+0000 7ff387606640 1 -- 172.21.15.100:0/1326425053 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff494074020 con 0x5562927be630 2024-09-18T01:26:26.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.487+0000 7ff387606640 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff380036b40 0x7ff380039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.487+0000 7ff387606640 1 -- 172.21.15.100:0/1326425053 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff494090aa0 con 0x5562927be630 2024-09-18T01:26:26.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.488+0000 7ff49a2ed640 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff380036b40 0x7ff380039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.488+0000 7ff49f40f800 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55629284d740 0x55629294a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.488+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55629294a9a0 con 0x55629284d740 2024-09-18T01:26:26.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.488+0000 7ff49b2ef640 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55629284d740 0x55629294a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.488+0000 7ff49a2ed640 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff380036b40 0x7ff380039000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff484001d90 tx=0x7ff4840012f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.488+0000 7ff49b2ef640 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55629284d740 0x55629294a460 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.488+0000 7ff49b2ef640 1 -- 172.21.15.100:0/1326425053 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff48c0083e0 con 0x55629284d740 2024-09-18T01:26:26.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.488+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556292947a10 con 0x55629284d740 2024-09-18T01:26:26.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.489+0000 7ff49b2ef640 1 -- 172.21.15.100:0/1326425053 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff48c0083e0 con 0x55629284d740 2024-09-18T01:26:26.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.489+0000 7ff49f40f800 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55629294cc70 0x55629294f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.489+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55629294f750 con 0x55629294cc70 2024-09-18T01:26:26.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.489+0000 7ff49aaee640 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55629294cc70 0x55629294f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.489+0000 7ff49aaee640 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55629294cc70 0x55629294f060 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.489+0000 7ff49aaee640 1 -- 172.21.15.100:0/1326425053 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff49406c3f0 con 0x55629294cc70 2024-09-18T01:26:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.489+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55629294bb10 con 0x55629284d740 2024-09-18T01:26:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.490+0000 7ff49b2ef640 1 -- 172.21.15.100:0/1326425053 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff48c0083e0 con 0x55629284d740 2024-09-18T01:26:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.490+0000 7ff49f40f800 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556292950bb0 0x556292952fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.490+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556292953660 con 0x556292950bb0 2024-09-18T01:26:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.490+0000 7ff49a2ed640 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556292950bb0 0x556292952fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.490+0000 7ff49a2ed640 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556292950bb0 0x556292952fa0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.491+0000 7ff49a2ed640 1 -- 172.21.15.100:0/1326425053 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff484009050 con 0x556292950bb0 2024-09-18T01:26:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.491+0000 7ff49f40f800 1 Processor -- start 2024-09-18T01:26:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.491+0000 7ff49f40f800 1 -- start start 2024-09-18T01:26:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.491+0000 7ff49f40f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556292961410 0x556292961830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.491+0000 7ff49f40f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5562926e5580 con 0x556292961410 2024-09-18T01:26:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.491+0000 7ff49aaee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556292961410 0x556292961830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.491+0000 7ff49aaee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556292961410 0x556292961830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44642/0 (socket says 172.21.15.100:44642) 2024-09-18T01:26:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.491+0000 7ff49aaee640 1 -- 172.21.15.100:0/2160362309 learned_addr learned my addr 172.21.15.100:0/2160362309 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.492+0000 7ff49aaee640 1 -- 172.21.15.100:0/2160362309 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556292961d70 con 0x556292961410 2024-09-18T01:26:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.492+0000 7ff49aaee640 1 --2- 172.21.15.100:0/2160362309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556292961410 0x556292961830 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff49408ee80 tx=0x7ff49407ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.492+0000 7ff384e01640 1 -- 172.21.15.100:0/2160362309 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49406b700 con 0x556292961410 2024-09-18T01:26:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.492+0000 7ff384e01640 1 -- 172.21.15.100:0/2160362309 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49406b8a0 con 0x556292961410 2024-09-18T01:26:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.492+0000 7ff384e01640 1 -- 172.21.15.100:0/2160362309 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4940901c0 con 0x556292961410 2024-09-18T01:26:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.492+0000 7ff49f40f800 1 -- 172.21.15.100:0/2160362309 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556292962000 con 0x556292961410 2024-09-18T01:26:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.492+0000 7ff49f40f800 1 -- 172.21.15.100:0/2160362309 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556292964ce0 con 0x556292961410 2024-09-18T01:26:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.493+0000 7ff384e01640 1 -- 172.21.15.100:0/2160362309 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff494090360 con 0x556292961410 2024-09-18T01:26:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.493+0000 7ff384e01640 1 --2- 172.21.15.100:0/2160362309 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff374036b90 0x7ff374039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.493+0000 7ff384e01640 1 -- 172.21.15.100:0/2160362309 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff494086040 con 0x556292961410 2024-09-18T01:26:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.493+0000 7ff49a2ed640 1 --2- 172.21.15.100:0/2160362309 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff374036b90 0x7ff374039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.493+0000 7ff49f40f800 1 Processor -- start 2024-09-18T01:26:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.494+0000 7ff49f40f800 1 -- start start 2024-09-18T01:26:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.494+0000 7ff49a2ed640 1 --2- 172.21.15.100:0/2160362309 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff374036b90 0x7ff374039050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55629294b220 tx=0x7ff48400f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.494+0000 7ff49f40f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629296de60 0x55629296e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.494+0000 7ff49f40f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556292849110 con 0x55629296de60 2024-09-18T01:26:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.494+0000 7ff49aaee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629296de60 0x55629296e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.494+0000 7ff49aaee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629296de60 0x55629296e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44646/0 (socket says 172.21.15.100:44646) 2024-09-18T01:26:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.494+0000 7ff49aaee640 1 -- 172.21.15.100:0/2182528434 learned_addr learned my addr 172.21.15.100:0/2182528434 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.494+0000 7ff49aaee640 1 -- 172.21.15.100:0/2182528434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55629296e830 con 0x55629296de60 2024-09-18T01:26:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.494+0000 7ff49aaee640 1 --2- 172.21.15.100:0/2182528434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629296de60 0x55629296e260 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff49407ffb0 tx=0x7ff49404fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec199b695a08c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.494+0000 7ff37e7fc640 1 -- 172.21.15.100:0/2182528434 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49404faf0 con 0x55629296de60 2024-09-18T01:26:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.495+0000 7ff37e7fc640 1 -- 172.21.15.100:0/2182528434 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49407e8c0 con 0x55629296de60 2024-09-18T01:26:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.495+0000 7ff37e7fc640 1 -- 172.21.15.100:0/2182528434 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff494090650 con 0x55629296de60 2024-09-18T01:26:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.495+0000 7ff49f40f800 1 -- 172.21.15.100:0/2182528434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629296de60 msgr2=0x55629296e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.495+0000 7ff49f40f800 1 --2- 172.21.15.100:0/2182528434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629296de60 0x55629296e260 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff49407ffb0 tx=0x7ff49404fcf0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.495+0000 7ff49f40f800 1 -- 172.21.15.100:0/2182528434 shutdown_connections 2024-09-18T01:26:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.495+0000 7ff49f40f800 1 --2- 172.21.15.100:0/2182528434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629296de60 0x55629296e260 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.495+0000 7ff49f40f800 1 -- 172.21.15.100:0/2182528434 >> 172.21.15.100:0/2182528434 conn(0x55629296a210 msgr2=0x556292968310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.495+0000 7ff49f40f800 1 -- 172.21.15.100:0/2182528434 shutdown_connections 2024-09-18T01:26:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.495+0000 7ff49f40f800 1 -- 172.21.15.100:0/2182528434 wait complete. 2024-09-18T01:26:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.495+0000 7ff49f40f800 1 Processor -- start 2024-09-18T01:26:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.495+0000 7ff49f40f800 1 -- start start 2024-09-18T01:26:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.495+0000 7ff49f40f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629296de60 0x5562929751a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.495+0000 7ff49f40f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55629296ecc0 con 0x55629296de60 2024-09-18T01:26:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.496+0000 7ff49aaee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629296de60 0x5562929751a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.496+0000 7ff49aaee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629296de60 0x5562929751a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44660/0 (socket says 172.21.15.100:44660) 2024-09-18T01:26:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.496+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 learned_addr learned my addr 172.21.15.100:0/83235138 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.496+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562929756e0 con 0x55629296de60 2024-09-18T01:26:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.496+0000 7ff49aaee640 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629296de60 0x5562929751a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff49407bf00 tx=0x7ff49407be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.496+0000 7ff37cff9640 1 -- 172.21.15.100:0/83235138 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49404f520 con 0x55629296de60 2024-09-18T01:26:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.496+0000 7ff37cff9640 1 -- 172.21.15.100:0/83235138 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49404f6c0 con 0x55629296de60 2024-09-18T01:26:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.496+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562929756e0 con 0x55629296de60 2024-09-18T01:26:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.496+0000 7ff37cff9640 1 -- 172.21.15.100:0/83235138 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff494065930 con 0x55629296de60 2024-09-18T01:26:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.496+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562929756e0 con 0x55629296de60 2024-09-18T01:26:26.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.497+0000 7ff37cff9640 1 -- 172.21.15.100:0/83235138 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff4940bd030 con 0x55629296de60 2024-09-18T01:26:26.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.497+0000 7ff37cff9640 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff364036b40 0x7ff364039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.497+0000 7ff37cff9640 1 -- 172.21.15.100:0/83235138 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff4940bb070 con 0x55629296de60 2024-09-18T01:26:26.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.497+0000 7ff49a2ed640 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff364036b40 0x7ff364039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.498+0000 7ff49f40f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.498+0000 7ff49f40f800 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556292980760 0x556292982c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.498+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556292983370 con 0x556292980760 2024-09-18T01:26:26.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.498+0000 7ff49b2ef640 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556292980760 0x556292982c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.498+0000 7ff49a2ed640 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff364036b40 0x7ff364039000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x556292953a60 tx=0x7ff484010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.498+0000 7ff49b2ef640 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556292980760 0x556292982c20 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.498+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff48c0083e0 con 0x556292980760 2024-09-18T01:26:26.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.498+0000 7ff49f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.498+0000 7ff49f40f800 20 realm 2024-09-18T01:26:26.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.498+0000 7ff49f40f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.498+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5562929837a0 con 0x556292980760 2024-09-18T01:26:26.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.498+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff48c0083e0 con 0x556292980760 2024-09-18T01:26:26.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.498+0000 7ff49f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.498+0000 7ff49f40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:26:26.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.499+0000 7ff49f40f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.499+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292980760 2024-09-18T01:26:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.499+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff48c0083e0 con 0x556292980760 2024-09-18T01:26:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.499+0000 7ff49f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.499+0000 7ff49f40f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.499+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556292984410 con 0x556292980760 2024-09-18T01:26:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.499+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff48c0083e0 con 0x556292980760 2024-09-18T01:26:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.499+0000 7ff49f40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.499+0000 7ff49f40f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.499+0000 7ff49f40f800 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556292984dd0 0x5562929871c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.499+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556292987700 con 0x556292984dd0 2024-09-18T01:26:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.499+0000 7ff49aaee640 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556292984dd0 0x5562929871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.499+0000 7ff49aaee640 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556292984dd0 0x5562929871c0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.500+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.500+0000 7ff49f40f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:26:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.500+0000 7ff49f40f800 20 searching for the correct realm 2024-09-18T01:26:26.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.500+0000 7ff49f40f800 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556292989760 0x55629298bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.500+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55629298c2f0 con 0x556292989760 2024-09-18T01:26:26.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.500+0000 7ff49a2ed640 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556292989760 0x55629298bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.500+0000 7ff49a2ed640 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556292989760 0x55629298bc20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.500+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff484009050 con 0x556292989760 2024-09-18T01:26:26.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.500+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55629298c2f0 con 0x556292984dd0 2024-09-18T01:26:26.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.501+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.501+0000 7ff49aaee640 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff4940602a0 0x7ff4940bf890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.501+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55629298c2f0 con 0x7ff4940602a0 2024-09-18T01:26:26.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.501+0000 7ff49b2ef640 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff4940602a0 0x7ff4940bf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.501+0000 7ff49b2ef640 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff4940602a0 0x7ff4940bf890 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.501+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff48c0083e0 con 0x7ff4940602a0 2024-09-18T01:26:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.501+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292980760 2024-09-18T01:26:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.502+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48c0083e0 con 0x556292980760 2024-09-18T01:26:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.502+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292980760 2024-09-18T01:26:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.502+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48c026040 con 0x556292980760 2024-09-18T01:26:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.502+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x7ff4940602a0 2024-09-18T01:26:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.502+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48c026040 con 0x7ff4940602a0 2024-09-18T01:26:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.502+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x7ff4940602a0 2024-09-18T01:26:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.502+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48c026040 con 0x7ff4940602a0 2024-09-18T01:26:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.502+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292984dd0 2024-09-18T01:26:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.503+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.503+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292989760 2024-09-18T01:26:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.503+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff484009050 con 0x556292989760 2024-09-18T01:26:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.503+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292980760 2024-09-18T01:26:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.503+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48c026040 con 0x556292980760 2024-09-18T01:26:26.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.503+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292984dd0 2024-09-18T01:26:26.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.503+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.503+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292980760 2024-09-18T01:26:26.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.504+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48c026040 con 0x556292980760 2024-09-18T01:26:26.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.504+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292984dd0 2024-09-18T01:26:26.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.504+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.504+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292989760 2024-09-18T01:26:26.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.504+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff484009050 con 0x556292989760 2024-09-18T01:26:26.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.504+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292989760 2024-09-18T01:26:26.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.504+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff484009050 con 0x556292989760 2024-09-18T01:26:26.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.504+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x7ff4940602a0 2024-09-18T01:26:26.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.505+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48c026040 con 0x7ff4940602a0 2024-09-18T01:26:26.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.505+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292989760 2024-09-18T01:26:26.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.505+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff484009050 con 0x556292989760 2024-09-18T01:26:26.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.505+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292989760 2024-09-18T01:26:26.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.505+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff484009050 con 0x556292989760 2024-09-18T01:26:26.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.505+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292980760 2024-09-18T01:26:26.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.506+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48c026040 con 0x556292980760 2024-09-18T01:26:26.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.506+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292980760 2024-09-18T01:26:26.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.506+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff48c026040 con 0x556292980760 2024-09-18T01:26:26.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.506+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x7ff4940602a0 2024-09-18T01:26:26.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.506+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48c026040 con 0x7ff4940602a0 2024-09-18T01:26:26.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.506+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292989760 2024-09-18T01:26:26.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.506+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff484009050 con 0x556292989760 2024-09-18T01:26:26.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.506+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292984dd0 2024-09-18T01:26:26.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.507+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.507+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292980760 2024-09-18T01:26:26.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.507+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48c026040 con 0x556292980760 2024-09-18T01:26:26.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.507+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x7ff4940602a0 2024-09-18T01:26:26.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.507+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48c037040 con 0x7ff4940602a0 2024-09-18T01:26:26.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.507+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292989760 2024-09-18T01:26:26.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.507+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff484009050 con 0x556292989760 2024-09-18T01:26:26.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.507+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292984dd0 2024-09-18T01:26:26.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.508+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.508+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292984dd0 2024-09-18T01:26:26.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.508+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.508+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292989760 2024-09-18T01:26:26.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.508+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff484009050 con 0x556292989760 2024-09-18T01:26:26.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.508+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x7ff4940602a0 2024-09-18T01:26:26.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.508+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48c037040 con 0x7ff4940602a0 2024-09-18T01:26:26.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.508+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292980760 2024-09-18T01:26:26.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff48c037040 con 0x556292980760 2024-09-18T01:26:26.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556292984070 con 0x556292984dd0 2024-09-18T01:26:26.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49f40f800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:26:26.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49f40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:26:26.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49f40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:26:26.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49f40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:26:26.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49f40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:26:26.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49f40f800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:26:26.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49f40f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556292988060 con 0x556292980760 2024-09-18T01:26:26.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x556292980760 2024-09-18T01:26:26.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49f40f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556292988450 con 0x556292980760 2024-09-18T01:26:26.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff48c037040 con 0x556292980760 2024-09-18T01:26:26.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49f40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:26.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49f40f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.509+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556292988450 con 0x7ff4940602a0 2024-09-18T01:26:26.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff48c037040 con 0x7ff4940602a0 2024-09-18T01:26:26.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:26:26.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 20 zone default found 2024-09-18T01:26:26.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 4 Realm: () 2024-09-18T01:26:26.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:26:26.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:26:26.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:26:26.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 20 zonegroup default 2024-09-18T01:26:26.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556292988870 con 0x7ff4940602a0 2024-09-18T01:26:26.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x7ff4940602a0 2024-09-18T01:26:26.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556292988c80 con 0x556292989760 2024-09-18T01:26:26.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff484009050 con 0x556292989760 2024-09-18T01:26:26.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.510+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55629298e150 con 0x556292989760 2024-09-18T01:26:26.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.511+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff484009050 con 0x556292989760 2024-09-18T01:26:26.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.511+0000 7ff49f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.511+0000 7ff49f40f800 20 started sync module instance, tier type = 2024-09-18T01:26:26.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.511+0000 7ff49f40f800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:26:26.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.511+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55629298d5f0 con 0x556292984dd0 2024-09-18T01:26:26.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.512+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.512+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93881854646800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55629298ea10 con 0x556292984dd0 2024-09-18T01:26:26.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.512+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55629298f260 con 0x556292980760 2024-09-18T01:26:26.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.513+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93881854646800] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.513+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x556292980760 2024-09-18T01:26:26.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.513+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93881854651824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55629298f680 con 0x556292980760 2024-09-18T01:26:26.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.513+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55629298fed0 con 0x556292989760 2024-09-18T01:26:26.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.514+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93881854651824] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x556292980760 2024-09-18T01:26:26.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.515+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff484009050 con 0x556292989760 2024-09-18T01:26:26.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.515+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93881854653360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556292990270 con 0x556292989760 2024-09-18T01:26:26.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.515+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556292990c90 con 0x556292984dd0 2024-09-18T01:26:26.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.515+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.515+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93881854660784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556292991980 con 0x556292984dd0 2024-09-18T01:26:26.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.516+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5562929923b0 con 0x556292980760 2024-09-18T01:26:26.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.516+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93881854653360] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff484009050 con 0x556292989760 2024-09-18T01:26:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.517+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x556292980760 2024-09-18T01:26:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.517+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93881854654512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556292992370 con 0x556292980760 2024-09-18T01:26:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.517+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556292992df0 con 0x7ff4940602a0 2024-09-18T01:26:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.517+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93881854660784] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.518+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x7ff4940602a0 2024-09-18T01:26:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.518+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93881854661840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556292992df0 con 0x7ff4940602a0 2024-09-18T01:26:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.518+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5562929937f0 con 0x7ff4940602a0 2024-09-18T01:26:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.518+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93881854654512] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x556292980760 2024-09-18T01:26:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.519+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93881854661840] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x7ff4940602a0 2024-09-18T01:26:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.519+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x7ff4940602a0 2024-09-18T01:26:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.519+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93881854664384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556292992940 con 0x7ff4940602a0 2024-09-18T01:26:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.519+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556292993e80 con 0x7ff4940602a0 2024-09-18T01:26:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.520+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93881854664384] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x7ff4940602a0 2024-09-18T01:26:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.520+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x7ff4940602a0 2024-09-18T01:26:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.520+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93881854669568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556292993e80 con 0x7ff4940602a0 2024-09-18T01:26:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.520+0000 7ff49f40f800 20 add_watcher() i=0 2024-09-18T01:26:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.520+0000 7ff49f40f800 20 add_watcher() i=1 2024-09-18T01:26:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.520+0000 7ff49f40f800 20 add_watcher() i=2 2024-09-18T01:26:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.520+0000 7ff49f40f800 20 add_watcher() i=3 2024-09-18T01:26:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.520+0000 7ff49f40f800 20 add_watcher() i=4 2024-09-18T01:26:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.520+0000 7ff49f40f800 20 add_watcher() i=5 2024-09-18T01:26:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.520+0000 7ff49f40f800 20 add_watcher() i=6 2024-09-18T01:26:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.524+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93881854669568] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x7ff4940602a0 2024-09-18T01:26:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.524+0000 7ff49f40f800 20 add_watcher() i=7 2024-09-18T01:26:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.524+0000 7ff49f40f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:26:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.524+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556292996fd0 con 0x556292980760 2024-09-18T01:26:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.524+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff48c037040 con 0x556292980760 2024-09-18T01:26:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.524+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93881854671312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5562929942a0 con 0x556292980760 2024-09-18T01:26:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.525+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93881854671312] v35'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x556292980760 2024-09-18T01:26:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.525+0000 7ff3517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.525+0000 7ff49f40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:26:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.525+0000 7ff49f40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:26:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.525+0000 7ff49f40f800 5 note: GC not initialized 2024-09-18T01:26:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.525+0000 7ff2cbfff640 20 reqs_thread_entry: start 2024-09-18T01:26:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.525+0000 7ff49f40f800 20 init_complete bucket index max shards: 11 2024-09-18T01:26:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.525+0000 7ff49f40f800 20 Filter name: none 2024-09-18T01:26:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.525+0000 7ff2c9ffb640 20 reqs_thread_entry: start 2024-09-18T01:26:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.526+0000 7ff49f40f800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.526+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5562929c9fe0 con 0x556292980760 2024-09-18T01:26:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.526+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff48c037040 con 0x556292980760 2024-09-18T01:26:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.526+0000 7ff49f40f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:26:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.526+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5562929cb530 con 0x7ff4940602a0 2024-09-18T01:26:26.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.526+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7ff48c037040 con 0x7ff4940602a0 2024-09-18T01:26:26.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.527+0000 7ff3517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:26.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.527+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93881854671312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556292995fa0 con 0x556292980760 2024-09-18T01:26:26.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.528+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93881854671312] v35'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x556292980760 2024-09-18T01:26:26.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.528+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93881854646800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5562929939d0 con 0x556292984dd0 2024-09-18T01:26:26.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.529+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93881854646800] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.529+0000 7ff49f40f800 20 remove_watcher() i=0 2024-09-18T01:26:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.529+0000 7ff49f40f800 2 removed watcher, disabling cache 2024-09-18T01:26:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.529+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93881854651824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5562929939d0 con 0x556292980760 2024-09-18T01:26:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.530+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93881854651824] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x556292980760 2024-09-18T01:26:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.531+0000 7ff49f40f800 20 remove_watcher() i=1 2024-09-18T01:26:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.531+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93881854653360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55629298edb0 con 0x556292989760 2024-09-18T01:26:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.532+0000 7ff49a2ed640 1 -- 172.21.15.100:0/83235138 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93881854653360] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff484009050 con 0x556292989760 2024-09-18T01:26:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.532+0000 7ff49f40f800 20 remove_watcher() i=2 2024-09-18T01:26:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.532+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93881854660784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5562929939d0 con 0x556292984dd0 2024-09-18T01:26:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.533+0000 7ff49aaee640 1 -- 172.21.15.100:0/83235138 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93881854660784] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49406c3f0 con 0x556292984dd0 2024-09-18T01:26:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.533+0000 7ff49f40f800 20 remove_watcher() i=3 2024-09-18T01:26:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.533+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93881854654512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55629298f3b0 con 0x556292980760 2024-09-18T01:26:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.534+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93881854654512] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x556292980760 2024-09-18T01:26:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.534+0000 7ff49f40f800 20 remove_watcher() i=4 2024-09-18T01:26:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.534+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93881854661840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5562929939d0 con 0x7ff4940602a0 2024-09-18T01:26:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.535+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93881854661840] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x7ff4940602a0 2024-09-18T01:26:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.535+0000 7ff49f40f800 20 remove_watcher() i=5 2024-09-18T01:26:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.535+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93881854664384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55629298f3b0 con 0x7ff4940602a0 2024-09-18T01:26:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.536+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93881854664384] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x7ff4940602a0 2024-09-18T01:26:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.536+0000 7ff49f40f800 20 remove_watcher() i=6 2024-09-18T01:26:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.536+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93881854669568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5562929939d0 con 0x7ff4940602a0 2024-09-18T01:26:26.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.537+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93881854669568] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48c037040 con 0x7ff4940602a0 2024-09-18T01:26:26.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.537+0000 7ff49f40f800 20 remove_watcher() i=7 2024-09-18T01:26:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.537+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff4940602a0 msgr2=0x7ff4940bf890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.537+0000 7ff49f40f800 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff4940602a0 0x7ff4940bf890 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.537+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556292980760 msgr2=0x556292982c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.537+0000 7ff49f40f800 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556292980760 0x556292982c20 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.537+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556292984dd0 msgr2=0x5562929871c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.537+0000 7ff49f40f800 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556292984dd0 0x5562929871c0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.537+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556292989760 msgr2=0x55629298bc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.537+0000 7ff49f40f800 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556292989760 0x55629298bc20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.537+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff364036b40 msgr2=0x7ff364039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.537+0000 7ff49f40f800 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff364036b40 0x7ff364039000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x556292953a60 tx=0x7ff484010000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629296de60 msgr2=0x5562929751a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49b2ef640 1 -- 172.21.15.100:0/83235138 reap_dead start 2024-09-18T01:26:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629296de60 0x5562929751a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff49407bf00 tx=0x7ff49407be90 comp rx=0 tx=0).stop 2024-09-18T01:26:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 shutdown_connections 2024-09-18T01:26:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 --2- 172.21.15.100:0/83235138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55629296de60 0x5562929751a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 >> 172.21.15.100:0/83235138 conn(0x55629296a210 msgr2=0x5562929682e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 shutdown_connections 2024-09-18T01:26:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/83235138 wait complete. 2024-09-18T01:26:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/2160362309 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff374036b90 msgr2=0x7ff374039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 --2- 172.21.15.100:0/2160362309 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff374036b90 0x7ff374039050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55629294b220 tx=0x7ff48400f000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/2160362309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556292961410 msgr2=0x556292961830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 --2- 172.21.15.100:0/2160362309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556292961410 0x556292961830 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff49408ee80 tx=0x7ff49407ef90 comp rx=0 tx=0).stop 2024-09-18T01:26:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/2160362309 shutdown_connections 2024-09-18T01:26:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 --2- 172.21.15.100:0/2160362309 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff374036b90 0x7ff374039050 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 --2- 172.21.15.100:0/2160362309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556292961410 0x556292961830 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/2160362309 >> 172.21.15.100:0/2160362309 conn(0x5562929563a0 msgr2=0x556292958f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/2160362309 shutdown_connections 2024-09-18T01:26:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/2160362309 wait complete. 2024-09-18T01:26:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556292950bb0 msgr2=0x556292952fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556292950bb0 0x556292952fa0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55629284d740 msgr2=0x55629294a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55629284d740 0x55629294a460 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55629294cc70 msgr2=0x55629294f060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55629294cc70 0x55629294f060 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff380036b40 msgr2=0x7ff380039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff380036b40 0x7ff380039000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff484001d90 tx=0x7ff4840012f0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 msgr2=0x5562929433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49f40f800 1 --2- 172.21.15.100:0/1326425053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562927be630 0x5562929433f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff494065040 tx=0x7ff494003330 comp rx=0 tx=0).stop 2024-09-18T01:26:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.538+0000 7ff49b2ef640 1 -- 172.21.15.100:0/1326425053 reap_dead start 2024-09-18T01:26:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.539+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 shutdown_connections 2024-09-18T01:26:26.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.539+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 >> 172.21.15.100:0/1326425053 conn(0x556292844db0 msgr2=0x556292934ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.539+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 shutdown_connections 2024-09-18T01:26:26.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.539+0000 7ff49f40f800 1 -- 172.21.15.100:0/1326425053 wait complete. 2024-09-18T01:26:26.549 INFO:teuthology.orchestra.run.smithi100.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-09-18T01:26:26.549 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-18T01:26:26.549 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-18T01:26:26.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-18T01:26:26.550 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-18T01:26:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:26:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:26:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.594+0000 7f8a7c933800 1 Processor -- start 2024-09-18T01:26:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.594+0000 7f8a7c933800 1 -- start start 2024-09-18T01:26:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.594+0000 7f8a7c933800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ab02dcfd40 0x55ab02dd2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.594+0000 7f8a7c933800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ab02c88b30 con 0x55ab02d3d610 2024-09-18T01:26:26.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.594+0000 7f8a7c933800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55ab02c6a360 con 0x55ab02dcfd40 2024-09-18T01:26:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.595+0000 7f8a6fe23640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ab02dcfd40 0x55ab02dd2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.595+0000 7f8a6fe23640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ab02dcfd40 0x55ab02dd2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44676/0 (socket says 172.21.15.100:44676) 2024-09-18T01:26:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.595+0000 7f8a78624640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55ab02d3d610 0x55ab02dce620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:51710/0 (socket says 172.21.15.100:51710) 2024-09-18T01:26:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.595+0000 7f8a6fe23640 1 -- 172.21.15.100:0/1076564020 learned_addr learned my addr 172.21.15.100:0/1076564020 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.595+0000 7f8a77e23640 1 -- 172.21.15.100:0/1076564020 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3560002245 0 0) 0x55ab02c88b30 con 0x55ab02d3d610 2024-09-18T01:26:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.595+0000 7f8a77e23640 1 -- 172.21.15.100:0/1076564020 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a64001e10 con 0x55ab02d3d610 2024-09-18T01:26:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.595+0000 7f8a6fe23640 1 -- 172.21.15.100:0/1076564020 >> v1:172.21.15.92:6789/0 conn(0x55ab02d3d610 legacy=0x55ab02dce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.595+0000 7f8a6fe23640 1 -- 172.21.15.100:0/1076564020 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab02c90e00 con 0x55ab02dcfd40 2024-09-18T01:26:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.597+0000 7f8a6fe23640 1 --2- 172.21.15.100:0/1076564020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02dcfd40 0x55ab02dd2130 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000a520 tx=0x7f8a60045aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654c72bde6d1d36d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.597+0000 7f8a77e23640 1 -- 172.21.15.100:0/1076564020 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a60056020 con 0x55ab02dcfd40 2024-09-18T01:26:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.597+0000 7f8a77e23640 1 -- 172.21.15.100:0/1076564020 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a60052550 con 0x55ab02dcfd40 2024-09-18T01:26:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.597+0000 7f8a77e23640 1 -- 172.21.15.100:0/1076564020 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a60052870 con 0x55ab02dcfd40 2024-09-18T01:26:26.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.597+0000 7f8a7c933800 1 -- 172.21.15.100:0/1076564020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02dcfd40 msgr2=0x55ab02dd2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.597+0000 7f8a7c933800 1 --2- 172.21.15.100:0/1076564020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02dcfd40 0x55ab02dd2130 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000a520 tx=0x7f8a60045aa0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.598+0000 7f8a7c933800 1 -- 172.21.15.100:0/1076564020 shutdown_connections 2024-09-18T01:26:26.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.598+0000 7f8a7c933800 1 --2- 172.21.15.100:0/1076564020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02dcfd40 0x55ab02dd2130 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.598+0000 7f8a7c933800 1 -- 172.21.15.100:0/1076564020 >> 172.21.15.100:0/1076564020 conn(0x55ab02dc3db0 msgr2=0x55ab02dc61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.598+0000 7f8a7c933800 1 -- 172.21.15.100:0/1076564020 shutdown_connections 2024-09-18T01:26:26.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.598+0000 7f8a7c933800 1 -- 172.21.15.100:0/1076564020 wait complete. 2024-09-18T01:26:26.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.611+0000 7f8a7c933800 1 Processor -- start 2024-09-18T01:26:26.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.611+0000 7f8a7c933800 1 -- start start 2024-09-18T01:26:26.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.611+0000 7f8a7c933800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02d3d610 0x55ab02eba8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.611+0000 7f8a7c933800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab02d15360 con 0x55ab02d3d610 2024-09-18T01:26:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.612+0000 7f8a78624640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02d3d610 0x55ab02eba8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.612+0000 7f8a78624640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02d3d610 0x55ab02eba8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44680/0 (socket says 172.21.15.100:44680) 2024-09-18T01:26:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.612+0000 7f8a78624640 1 -- 172.21.15.100:0/3617370830 learned_addr learned my addr 172.21.15.100:0/3617370830 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.612+0000 7f8a78624640 1 -- 172.21.15.100:0/3617370830 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab02c62bc0 con 0x55ab02d3d610 2024-09-18T01:26:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.612+0000 7f8a78624640 1 --2- 172.21.15.100:0/3617370830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02d3d610 0x55ab02eba8b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800b260 tx=0x7f8a6800b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37dfd61db145fb49 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.612+0000 7f896660c640 1 -- 172.21.15.100:0/3617370830 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a6800e5c0 con 0x55ab02d3d610 2024-09-18T01:26:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.612+0000 7f896660c640 1 -- 172.21.15.100:0/3617370830 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a68006070 con 0x55ab02d3d610 2024-09-18T01:26:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.612+0000 7f896660c640 1 -- 172.21.15.100:0/3617370830 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a6800e8d0 con 0x55ab02d3d610 2024-09-18T01:26:26.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.613+0000 7f8a7c933800 1 -- 172.21.15.100:0/3617370830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02d3d610 msgr2=0x55ab02eba8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.613+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3617370830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02d3d610 0x55ab02eba8b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800b260 tx=0x7f8a6800b720 comp rx=0 tx=0).stop 2024-09-18T01:26:26.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.613+0000 7f8a7c933800 1 -- 172.21.15.100:0/3617370830 shutdown_connections 2024-09-18T01:26:26.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.613+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3617370830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02d3d610 0x55ab02eba8b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.613+0000 7f8a7c933800 1 -- 172.21.15.100:0/3617370830 >> 172.21.15.100:0/3617370830 conn(0x55ab02dc3db0 msgr2=0x55ab02eb6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.613+0000 7f8a7c933800 1 -- 172.21.15.100:0/3617370830 shutdown_connections 2024-09-18T01:26:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.613+0000 7f8a7c933800 1 -- 172.21.15.100:0/3617370830 wait complete. 2024-09-18T01:26:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.613+0000 7f8a7c933800 1 Processor -- start 2024-09-18T01:26:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.614+0000 7f8a7c933800 1 -- start start 2024-09-18T01:26:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.614+0000 7f8a7c933800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02dcfd40 0x55ab02ec24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.614+0000 7f8a7c933800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab02dd2910 con 0x55ab02dcfd40 2024-09-18T01:26:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.614+0000 7f8a78624640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02dcfd40 0x55ab02ec24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.614+0000 7f8a78624640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02dcfd40 0x55ab02ec24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44692/0 (socket says 172.21.15.100:44692) 2024-09-18T01:26:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.614+0000 7f8a78624640 1 -- 172.21.15.100:0/3030914642 learned_addr learned my addr 172.21.15.100:0/3030914642 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.614+0000 7f8a78624640 1 -- 172.21.15.100:0/3030914642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab02c76fe0 con 0x55ab02dcfd40 2024-09-18T01:26:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.615+0000 7f8a78624640 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02dcfd40 0x55ab02ec24c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8a68000f60 tx=0x7f8a68000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.615+0000 7f8964e09640 1 -- 172.21.15.100:0/3030914642 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a6801a7c0 con 0x55ab02dcfd40 2024-09-18T01:26:26.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.615+0000 7f8964e09640 1 -- 172.21.15.100:0/3030914642 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a6801a980 con 0x55ab02dcfd40 2024-09-18T01:26:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.615+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab02ec2a00 con 0x55ab02dcfd40 2024-09-18T01:26:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.615+0000 7f8964e09640 1 -- 172.21.15.100:0/3030914642 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a6801aca0 con 0x55ab02dcfd40 2024-09-18T01:26:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.615+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab02ec2f20 con 0x55ab02dcfd40 2024-09-18T01:26:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.616+0000 7f8964e09640 1 -- 172.21.15.100:0/3030914642 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8a68017070 con 0x55ab02dcfd40 2024-09-18T01:26:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.616+0000 7f8964e09640 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8960036b40 0x7f8960039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.616+0000 7f8964e09640 1 -- 172.21.15.100:0/3030914642 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f8a68015020 con 0x55ab02dcfd40 2024-09-18T01:26:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.616+0000 7f8a6fe23640 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8960036b40 0x7f8960039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.616+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab02ec7520 0x55ab02ec9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.616+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02ec9e50 con 0x55ab02ec7520 2024-09-18T01:26:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.616+0000 7f8a78e25640 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab02ec7520 0x55ab02ec9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.616+0000 7f8a6fe23640 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8960036b40 0x7f8960039000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8a60057000 tx=0x7f8a60052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.616+0000 7f8a78e25640 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab02ec7520 0x55ab02ec9910 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.617+0000 7f8a78e25640 1 -- 172.21.15.100:0/3030914642 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02ec7520 2024-09-18T01:26:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.617+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02ec6ae0 con 0x55ab02ec7520 2024-09-18T01:26:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.617+0000 7f8a78e25640 1 -- 172.21.15.100:0/3030914642 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02ec7520 2024-09-18T01:26:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.617+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab02ecc160 0x55ab02ece550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.617+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02ecebf0 con 0x55ab02ecc160 2024-09-18T01:26:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.617+0000 7f8a78624640 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab02ecc160 0x55ab02ece550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.617+0000 7f8a78624640 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab02ecc160 0x55ab02ece550 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.618+0000 7f8a78624640 1 -- 172.21.15.100:0/3030914642 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8a6802e070 con 0x55ab02ecc160 2024-09-18T01:26:26.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.618+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02ecb000 con 0x55ab02ec7520 2024-09-18T01:26:26.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.618+0000 7f8a78e25640 1 -- 172.21.15.100:0/3030914642 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02ec7520 2024-09-18T01:26:26.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.618+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ab02ed0050 0x55ab02ed2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.618+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02ed2b40 con 0x55ab02ed0050 2024-09-18T01:26:26.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.618+0000 7f8a6fe23640 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ab02ed0050 0x55ab02ed2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.619+0000 7f8a6fe23640 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ab02ed0050 0x55ab02ed2440 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.619+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3030914642 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02ed0050 2024-09-18T01:26:26.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.619+0000 7f8a7c933800 1 Processor -- start 2024-09-18T01:26:26.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.620+0000 7f8a7c933800 1 -- start start 2024-09-18T01:26:26.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.620+0000 7f8a7c933800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02ee08f0 0x55ab02ee0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.620+0000 7f8a7c933800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab02c64580 con 0x55ab02ee08f0 2024-09-18T01:26:26.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.620+0000 7f8a78624640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02ee08f0 0x55ab02ee0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.620+0000 7f8a78624640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02ee08f0 0x55ab02ee0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44700/0 (socket says 172.21.15.100:44700) 2024-09-18T01:26:26.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.620+0000 7f8a78624640 1 -- 172.21.15.100:0/974593487 learned_addr learned my addr 172.21.15.100:0/974593487 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.620+0000 7f8a78624640 1 -- 172.21.15.100:0/974593487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab02ee1250 con 0x55ab02ee08f0 2024-09-18T01:26:26.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.620+0000 7f8a78624640 1 --2- 172.21.15.100:0/974593487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02ee08f0 0x55ab02ee0d10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8a6801af70 tx=0x7f8a68041f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.621+0000 7f895dffb640 1 -- 172.21.15.100:0/974593487 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a6804a0d0 con 0x55ab02ee08f0 2024-09-18T01:26:26.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.621+0000 7f895dffb640 1 -- 172.21.15.100:0/974593487 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a6804a270 con 0x55ab02ee08f0 2024-09-18T01:26:26.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.621+0000 7f8a7c933800 1 -- 172.21.15.100:0/974593487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab02ee14e0 con 0x55ab02ee08f0 2024-09-18T01:26:26.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.621+0000 7f895dffb640 1 -- 172.21.15.100:0/974593487 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a6804bb10 con 0x55ab02ee08f0 2024-09-18T01:26:26.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.621+0000 7f8a7c933800 1 -- 172.21.15.100:0/974593487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab02ee41c0 con 0x55ab02ee08f0 2024-09-18T01:26:26.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.621+0000 7f895dffb640 1 -- 172.21.15.100:0/974593487 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8a6804bcb0 con 0x55ab02ee08f0 2024-09-18T01:26:26.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.621+0000 7f895dffb640 1 --2- 172.21.15.100:0/974593487 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8950036b40 0x7f8950039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.622+0000 7f895dffb640 1 -- 172.21.15.100:0/974593487 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f8a6804edc0 con 0x55ab02ee08f0 2024-09-18T01:26:26.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.622+0000 7f8a6fe23640 1 --2- 172.21.15.100:0/974593487 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8950036b40 0x7f8950039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.622+0000 7f8a7c933800 1 Processor -- start 2024-09-18T01:26:26.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.622+0000 7f8a7c933800 1 -- start start 2024-09-18T01:26:26.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.622+0000 7f8a6fe23640 1 --2- 172.21.15.100:0/974593487 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8950036b40 0x7f8950039000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55ab02ec6a20 tx=0x7f8a60005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.622+0000 7f8a7c933800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02eed3b0 0x55ab02eed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.622+0000 7f8a7c933800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab02ebb060 con 0x55ab02eed3b0 2024-09-18T01:26:26.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.622+0000 7f8a78624640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02eed3b0 0x55ab02eed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.622+0000 7f8a78624640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02eed3b0 0x55ab02eed7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44712/0 (socket says 172.21.15.100:44712) 2024-09-18T01:26:26.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.622+0000 7f8a78624640 1 -- 172.21.15.100:0/472841539 learned_addr learned my addr 172.21.15.100:0/472841539 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.622+0000 7f8a78624640 1 -- 172.21.15.100:0/472841539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab02eedd80 con 0x55ab02eed3b0 2024-09-18T01:26:26.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.623+0000 7f8a78624640 1 --2- 172.21.15.100:0/472841539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02eed3b0 0x55ab02eed7b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8a68026910 tx=0x7f8a68026570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522d3420e2bf4f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.623+0000 7f89577fe640 1 -- 172.21.15.100:0/472841539 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a6805d020 con 0x55ab02eed3b0 2024-09-18T01:26:26.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.623+0000 7f89577fe640 1 -- 172.21.15.100:0/472841539 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a680441a0 con 0x55ab02eed3b0 2024-09-18T01:26:26.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.623+0000 7f89577fe640 1 -- 172.21.15.100:0/472841539 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a68026bb0 con 0x55ab02eed3b0 2024-09-18T01:26:26.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.623+0000 7f8a7c933800 1 -- 172.21.15.100:0/472841539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02eed3b0 msgr2=0x55ab02eed7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.623+0000 7f8a7c933800 1 --2- 172.21.15.100:0/472841539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02eed3b0 0x55ab02eed7b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8a68026910 tx=0x7f8a68026570 comp rx=0 tx=0).stop 2024-09-18T01:26:26.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.623+0000 7f8a7c933800 1 -- 172.21.15.100:0/472841539 shutdown_connections 2024-09-18T01:26:26.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.623+0000 7f8a7c933800 1 --2- 172.21.15.100:0/472841539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02eed3b0 0x55ab02eed7b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.623+0000 7f8a7c933800 1 -- 172.21.15.100:0/472841539 >> 172.21.15.100:0/472841539 conn(0x55ab02ee9710 msgr2=0x55ab02ee7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.623+0000 7f8a7c933800 1 -- 172.21.15.100:0/472841539 shutdown_connections 2024-09-18T01:26:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.623+0000 7f8a7c933800 1 -- 172.21.15.100:0/472841539 wait complete. 2024-09-18T01:26:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.623+0000 7f8a7c933800 1 Processor -- start 2024-09-18T01:26:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.624+0000 7f8a7c933800 1 -- start start 2024-09-18T01:26:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.624+0000 7f8a7c933800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02eed3b0 0x55ab02ef46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.624+0000 7f8a7c933800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab02eee300 con 0x55ab02eed3b0 2024-09-18T01:26:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.624+0000 7f8a78624640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02eed3b0 0x55ab02ef46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.624+0000 7f8a78624640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02eed3b0 0x55ab02ef46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44720/0 (socket says 172.21.15.100:44720) 2024-09-18T01:26:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.624+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 learned_addr learned my addr 172.21.15.100:0/3308787807 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.624+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab02ef4be0 con 0x55ab02eed3b0 2024-09-18T01:26:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.624+0000 7f8a78624640 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02eed3b0 0x55ab02ef46a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8a680266e0 tx=0x7f8a68024ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.624+0000 7f8955ffb640 1 -- 172.21.15.100:0/3308787807 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a68026bb0 con 0x55ab02eed3b0 2024-09-18T01:26:26.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.625+0000 7f8955ffb640 1 -- 172.21.15.100:0/3308787807 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a680451c0 con 0x55ab02eed3b0 2024-09-18T01:26:26.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.625+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab02ef4be0 con 0x55ab02eed3b0 2024-09-18T01:26:26.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.625+0000 7f8955ffb640 1 -- 172.21.15.100:0/3308787807 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a680278b0 con 0x55ab02eed3b0 2024-09-18T01:26:26.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.625+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab02ef4be0 con 0x55ab02eed3b0 2024-09-18T01:26:26.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.625+0000 7f8955ffb640 1 -- 172.21.15.100:0/3308787807 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8a68060020 con 0x55ab02eed3b0 2024-09-18T01:26:26.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.625+0000 7f8955ffb640 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8948036b40 0x7f8948039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.626+0000 7f8955ffb640 1 -- 172.21.15.100:0/3308787807 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f8a6806a070 con 0x55ab02eed3b0 2024-09-18T01:26:26.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.626+0000 7f8a6fe23640 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8948036b40 0x7f8948039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.626+0000 7f8a7c933800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.626+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab02effc20 0x55ab02f020e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.626+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f02830 con 0x55ab02effc20 2024-09-18T01:26:26.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.626+0000 7f8a78e25640 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab02effc20 0x55ab02f020e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.626+0000 7f8a6fe23640 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8948036b40 0x7f8948039000 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8a60077040 tx=0x7f8a60053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.626+0000 7f8a78e25640 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab02effc20 0x55ab02f020e0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.626+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.626+0000 7f8a7c933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.626+0000 7f8a7c933800 20 realm 2024-09-18T01:26:26.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.626+0000 7f8a7c933800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.626+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f02c40 con 0x55ab02effc20 2024-09-18T01:26:26.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a7c933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a7c933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:26:26.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a7c933800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f03510 con 0x55ab02effc20 2024-09-18T01:26:26.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a7c933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a7c933800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02effc20 2024-09-18T01:26:26.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a7c933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:26.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a7c933800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab02f043a0 0x55ab02f06790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f06ef0 con 0x55ab02f043a0 2024-09-18T01:26:26.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a78624640 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab02f043a0 0x55ab02f06790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.627+0000 7f8a78624640 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab02f043a0 0x55ab02f06790 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.628+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.628+0000 7f8a7c933800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:26:26.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.628+0000 7f8a7c933800 20 searching for the correct realm 2024-09-18T01:26:26.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.628+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ab02f08fa0 0x55ab02f0b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.628+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f0bb30 con 0x55ab02f08fa0 2024-09-18T01:26:26.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.628+0000 7f8a6fe23640 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ab02f08fa0 0x55ab02f0b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.628+0000 7f8a6fe23640 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ab02f08fa0 0x55ab02f0b460 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.628+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02f08fa0 2024-09-18T01:26:26.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.628+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f0bb30 con 0x55ab02f043a0 2024-09-18T01:26:26.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.629+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.629+0000 7f8a78624640 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f8a6806d030 0x7f8a68007190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.629+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f0bb30 con 0x7f8a6806d030 2024-09-18T01:26:26.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.629+0000 7f8a78e25640 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f8a6806d030 0x7f8a68007190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.629+0000 7f8a78e25640 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f8a6806d030 0x7f8a68007190 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.630+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.630+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02effc20 2024-09-18T01:26:26.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.630+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.630+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02effc20 2024-09-18T01:26:26.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.630+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.630+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x7f8a6806d030 2024-09-18T01:26:26.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.631+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.631+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x7f8a6806d030 2024-09-18T01:26:26.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.631+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.631+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f043a0 2024-09-18T01:26:26.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.631+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.631+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f08fa0 2024-09-18T01:26:26.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.631+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02f08fa0 2024-09-18T01:26:26.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.631+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02effc20 2024-09-18T01:26:26.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.632+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.632+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f043a0 2024-09-18T01:26:26.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.632+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.632+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02effc20 2024-09-18T01:26:26.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.632+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.632+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f043a0 2024-09-18T01:26:26.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.632+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.632+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f08fa0 2024-09-18T01:26:26.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.632+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02f08fa0 2024-09-18T01:26:26.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.632+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f08fa0 2024-09-18T01:26:26.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.633+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02f08fa0 2024-09-18T01:26:26.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.633+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x7f8a6806d030 2024-09-18T01:26:26.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.633+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.633+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f08fa0 2024-09-18T01:26:26.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.633+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02f08fa0 2024-09-18T01:26:26.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.633+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f08fa0 2024-09-18T01:26:26.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.633+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02f08fa0 2024-09-18T01:26:26.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.633+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02effc20 2024-09-18T01:26:26.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.634+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.634+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02effc20 2024-09-18T01:26:26.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.634+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.634+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x7f8a6806d030 2024-09-18T01:26:26.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.634+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.634+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f08fa0 2024-09-18T01:26:26.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.635+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02f08fa0 2024-09-18T01:26:26.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.635+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f043a0 2024-09-18T01:26:26.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.635+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.635+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02effc20 2024-09-18T01:26:26.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.635+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.635+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x7f8a6806d030 2024-09-18T01:26:26.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.635+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.635+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f08fa0 2024-09-18T01:26:26.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.636+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02f08fa0 2024-09-18T01:26:26.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.636+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f043a0 2024-09-18T01:26:26.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.636+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.636+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f043a0 2024-09-18T01:26:26.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.636+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.636+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f08fa0 2024-09-18T01:26:26.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.636+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02f08fa0 2024-09-18T01:26:26.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.636+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x7f8a6806d030 2024-09-18T01:26:26.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02effc20 2024-09-18T01:26:26.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f038b0 con 0x55ab02f043a0 2024-09-18T01:26:26.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a7c933800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:26:26.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a7c933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:26:26.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a7c933800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:26:26.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a7c933800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:26:26.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a7c933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:26:26.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a7c933800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:26:26.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a7c933800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f078a0 con 0x55ab02effc20 2024-09-18T01:26:26.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a7c933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a7c933800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.637+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f07c90 con 0x55ab02effc20 2024-09-18T01:26:26.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:26.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f07c90 con 0x7f8a6806d030 2024-09-18T01:26:26.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:26:26.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 20 zone default found 2024-09-18T01:26:26.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 4 Realm: () 2024-09-18T01:26:26.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:26:26.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:26:26.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:26:26.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 20 zonegroup default 2024-09-18T01:26:26.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f080b0 con 0x7f8a6806d030 2024-09-18T01:26:26.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.638+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f080b0 con 0x55ab02f08fa0 2024-09-18T01:26:26.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.639+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02f08fa0 2024-09-18T01:26:26.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.639+0000 7f8a7c933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.639+0000 7f8a7c933800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.639+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f0d990 con 0x55ab02f08fa0 2024-09-18T01:26:26.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.639+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02f08fa0 2024-09-18T01:26:26.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.639+0000 7f8a7c933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.639+0000 7f8a7c933800 20 started sync module instance, tier type = 2024-09-18T01:26:26.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.639+0000 7f8a7c933800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:26:26.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.639+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f0ce30 con 0x55ab02f043a0 2024-09-18T01:26:26.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.640+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.640+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94192977105488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f0e1e0 con 0x55ab02f043a0 2024-09-18T01:26:26.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.640+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f0ea30 con 0x55ab02effc20 2024-09-18T01:26:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.641+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94192977105488] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.642+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.642+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94192977108272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f0ea30 con 0x55ab02effc20 2024-09-18T01:26:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.642+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f0f430 con 0x55ab02f08fa0 2024-09-18T01:26:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.643+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94192977108272] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.643+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02f08fa0 2024-09-18T01:26:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.643+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94192977110400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f0e9a0 con 0x55ab02f08fa0 2024-09-18T01:26:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.643+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f102f0 con 0x55ab02f043a0 2024-09-18T01:26:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.644+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.644+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94192977118944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f10fb0 con 0x55ab02f043a0 2024-09-18T01:26:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.644+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f11a00 con 0x55ab02effc20 2024-09-18T01:26:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.644+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94192977110400] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02f08fa0 2024-09-18T01:26:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.645+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94192977118944] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.645+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.645+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94192977120000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f0f820 con 0x55ab02effc20 2024-09-18T01:26:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.645+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f122a0 con 0x7f8a6806d030 2024-09-18T01:26:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.646+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.646+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94192977124720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f12640 con 0x7f8a6806d030 2024-09-18T01:26:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.646+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f13160 con 0x7f8a6806d030 2024-09-18T01:26:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.646+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94192977120000] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.647+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94192977124720] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.648+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.648+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94192977122544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f12640 con 0x7f8a6806d030 2024-09-18T01:26:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.648+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f135d0 con 0x7f8a6806d030 2024-09-18T01:26:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.649+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94192977122544] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.649+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.649+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94192977125776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f137b0 con 0x7f8a6806d030 2024-09-18T01:26:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.649+0000 7f8a7c933800 20 add_watcher() i=0 2024-09-18T01:26:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.649+0000 7f8a7c933800 20 add_watcher() i=1 2024-09-18T01:26:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.649+0000 7f8a7c933800 20 add_watcher() i=2 2024-09-18T01:26:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.649+0000 7f8a7c933800 20 add_watcher() i=3 2024-09-18T01:26:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.649+0000 7f8a7c933800 20 add_watcher() i=4 2024-09-18T01:26:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.649+0000 7f8a7c933800 20 add_watcher() i=5 2024-09-18T01:26:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.649+0000 7f8a7c933800 20 add_watcher() i=6 2024-09-18T01:26:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.650+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94192977125776] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.650+0000 7f8a7c933800 20 add_watcher() i=7 2024-09-18T01:26:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.650+0000 7f8a7c933800 2 all 8 watchers are set, enabling cache 2024-09-18T01:26:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.650+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f169a0 con 0x55ab02effc20 2024-09-18T01:26:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.650+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.650+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94192977130336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f13c30 con 0x55ab02effc20 2024-09-18T01:26:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.651+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94192977130336] v35'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.651+0000 7f892e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.651+0000 7f8a7c933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:26:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.651+0000 7f8a7c933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:26:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.651+0000 7f8a7c933800 5 note: GC not initialized 2024-09-18T01:26:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.652+0000 7f892d7e2640 20 reqs_thread_entry: start 2024-09-18T01:26:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.652+0000 7f8a7c933800 20 init_complete bucket index max shards: 11 2024-09-18T01:26:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.652+0000 7f8a7c933800 20 Filter name: none 2024-09-18T01:26:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.652+0000 7f889effd640 20 reqs_thread_entry: start 2024-09-18T01:26:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.652+0000 7f8a7c933800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.652+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f49ab0 con 0x55ab02effc20 2024-09-18T01:26:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.652+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.652+0000 7f8a7c933800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:26:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.652+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f4b000 con 0x7f8a6806d030 2024-09-18T01:26:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.653+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.654+0000 7f892e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.654+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94192977130336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f15f60 con 0x55ab02effc20 2024-09-18T01:26:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.655+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94192977130336] v35'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.655+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94192977105488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f13360 con 0x55ab02f043a0 2024-09-18T01:26:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.656+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94192977105488] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.656+0000 7f8a7c933800 20 remove_watcher() i=0 2024-09-18T01:26:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.656+0000 7f8a7c933800 2 removed watcher, disabling cache 2024-09-18T01:26:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.656+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94192977108272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f13360 con 0x55ab02effc20 2024-09-18T01:26:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.657+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94192977108272] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.657+0000 7f8a7c933800 20 remove_watcher() i=1 2024-09-18T01:26:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.657+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94192977110400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f0dd30 con 0x55ab02f08fa0 2024-09-18T01:26:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.658+0000 7f8a6fe23640 1 -- 172.21.15.100:0/3308787807 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94192977110400] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a60050050 con 0x55ab02f08fa0 2024-09-18T01:26:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.658+0000 7f8a7c933800 20 remove_watcher() i=2 2024-09-18T01:26:26.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.658+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94192977118944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f13360 con 0x55ab02f043a0 2024-09-18T01:26:26.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.659+0000 7f8a78624640 1 -- 172.21.15.100:0/3308787807 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94192977118944] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68073020 con 0x55ab02f043a0 2024-09-18T01:26:26.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.659+0000 7f8a7c933800 20 remove_watcher() i=3 2024-09-18T01:26:26.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.659+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94192977120000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f0e580 con 0x55ab02effc20 2024-09-18T01:26:26.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.661+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94192977120000] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x55ab02effc20 2024-09-18T01:26:26.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.661+0000 7f8a7c933800 20 remove_watcher() i=4 2024-09-18T01:26:26.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.661+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94192977124720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f13360 con 0x7f8a6806d030 2024-09-18T01:26:26.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.662+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94192977124720] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.662+0000 7f8a7c933800 20 remove_watcher() i=5 2024-09-18T01:26:26.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.662+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94192977122544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f0e580 con 0x7f8a6806d030 2024-09-18T01:26:26.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.663+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94192977122544] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.663+0000 7f8a7c933800 20 remove_watcher() i=6 2024-09-18T01:26:26.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.663+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94192977125776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab02f11d70 con 0x7f8a6806d030 2024-09-18T01:26:26.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.664+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94192977125776] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7000a4a0 con 0x7f8a6806d030 2024-09-18T01:26:26.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.664+0000 7f8a7c933800 20 remove_watcher() i=7 2024-09-18T01:26:26.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f8a6806d030 msgr2=0x7f8a68007190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f8a6806d030 0x7f8a68007190 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab02effc20 msgr2=0x55ab02f020e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab02effc20 0x55ab02f020e0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab02f043a0 msgr2=0x55ab02f06790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab02f043a0 0x55ab02f06790 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ab02f08fa0 msgr2=0x55ab02f0b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ab02f08fa0 0x55ab02f0b460 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8948036b40 msgr2=0x7f8948039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8948036b40 0x7f8948039000 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8a60077040 tx=0x7f8a60053000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02eed3b0 msgr2=0x55ab02ef46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3308787807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02eed3b0 0x55ab02ef46a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8a680266e0 tx=0x7f8a68024ef0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 reap_dead start 2024-09-18T01:26:26.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a78e25640 1 -- 172.21.15.100:0/3308787807 reap_dead start 2024-09-18T01:26:26.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 shutdown_connections 2024-09-18T01:26:26.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 >> 172.21.15.100:0/3308787807 conn(0x55ab02ee9710 msgr2=0x55ab02ee77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 shutdown_connections 2024-09-18T01:26:26.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/3308787807 wait complete. 2024-09-18T01:26:26.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/974593487 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8950036b40 msgr2=0x7f8950039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 --2- 172.21.15.100:0/974593487 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8950036b40 0x7f8950039000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55ab02ec6a20 tx=0x7f8a60005ac0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/974593487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02ee08f0 msgr2=0x55ab02ee0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 --2- 172.21.15.100:0/974593487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02ee08f0 0x55ab02ee0d10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8a6801af70 tx=0x7f8a68041f00 comp rx=0 tx=0).stop 2024-09-18T01:26:26.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/974593487 shutdown_connections 2024-09-18T01:26:26.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 --2- 172.21.15.100:0/974593487 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8950036b40 0x7f8950039000 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 --2- 172.21.15.100:0/974593487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02ee08f0 0x55ab02ee0d10 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/974593487 >> 172.21.15.100:0/974593487 conn(0x55ab02ed5880 msgr2=0x55ab02ed8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/974593487 shutdown_connections 2024-09-18T01:26:26.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.665+0000 7f8a7c933800 1 -- 172.21.15.100:0/974593487 wait complete. 2024-09-18T01:26:26.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ab02ed0050 msgr2=0x55ab02ed2440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ab02ed0050 0x55ab02ed2440 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab02ec7520 msgr2=0x55ab02ec9910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab02ec7520 0x55ab02ec9910 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab02ecc160 msgr2=0x55ab02ece550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab02ecc160 0x55ab02ece550 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8960036b40 msgr2=0x7f8960039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f8960036b40 0x7f8960039000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8a60057000 tx=0x7f8a60052000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02dcfd40 msgr2=0x55ab02ec24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a7c933800 1 --2- 172.21.15.100:0/3030914642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab02dcfd40 0x55ab02ec24c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8a68000f60 tx=0x7f8a68000ed0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a78e25640 1 -- 172.21.15.100:0/3030914642 reap_dead start 2024-09-18T01:26:26.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 shutdown_connections 2024-09-18T01:26:26.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 >> 172.21.15.100:0/3030914642 conn(0x55ab02dc3db0 msgr2=0x55ab02eb4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 shutdown_connections 2024-09-18T01:26:26.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.666+0000 7f8a7c933800 1 -- 172.21.15.100:0/3030914642 wait complete. 2024-09-18T01:26:26.681 INFO:teuthology.orchestra.run.smithi100.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-09-18T01:26:26.681 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-18T01:26:26.681 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-18T01:26:26.681 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-18T01:26:26.681 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-18T01:26:26.731 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:26:26.731 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:26:26.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.730+0000 7f963c011800 1 Processor -- start 2024-09-18T01:26:26.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.730+0000 7f963c011800 1 -- start start 2024-09-18T01:26:26.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.730+0000 7f963c011800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x556367ae46d0 0x556367b73160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.730+0000 7f963c011800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556367a2fb30 con 0x556367b736a0 2024-09-18T01:26:26.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.730+0000 7f963c011800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x556367a11360 con 0x556367ae46d0 2024-09-18T01:26:26.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.730+0000 7f963773d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x556367ae46d0 0x556367b73160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.730+0000 7f963773d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x556367ae46d0 0x556367b73160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44732/0 (socket says 172.21.15.100:44732) 2024-09-18T01:26:26.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.730+0000 7f962ef3c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x556367b736a0 0x556367b75ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:51722/0 (socket says 172.21.15.100:51722) 2024-09-18T01:26:26.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.730+0000 7f963773d640 1 -- 172.21.15.100:0/3586528451 learned_addr learned my addr 172.21.15.100:0/3586528451 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.730+0000 7f963773d640 1 -- 172.21.15.100:0/3586528451 >> v1:172.21.15.92:6789/0 conn(0x556367b736a0 legacy=0x556367b75ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.730+0000 7f963773d640 1 -- 172.21.15.100:0/3586528451 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556367a37e00 con 0x556367ae46d0 2024-09-18T01:26:26.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.732+0000 7f963773d640 1 --2- 172.21.15.100:0/3586528451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 0x556367b73160 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f962800a520 tx=0x7f9628045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165c02888be4ed8b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.732+0000 7f9636f3c640 1 -- 172.21.15.100:0/3586528451 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9628055070 con 0x556367ae46d0 2024-09-18T01:26:26.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.732+0000 7f9636f3c640 1 -- 172.21.15.100:0/3586528451 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96280515b0 con 0x556367ae46d0 2024-09-18T01:26:26.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.732+0000 7f9636f3c640 1 -- 172.21.15.100:0/3586528451 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96280518d0 con 0x556367ae46d0 2024-09-18T01:26:26.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.733+0000 7f963c011800 1 -- 172.21.15.100:0/3586528451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 msgr2=0x556367b73160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.733+0000 7f963c011800 1 --2- 172.21.15.100:0/3586528451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 0x556367b73160 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f962800a520 tx=0x7f9628045ba0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.733+0000 7f963c011800 1 -- 172.21.15.100:0/3586528451 shutdown_connections 2024-09-18T01:26:26.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.733+0000 7f963c011800 1 --2- 172.21.15.100:0/3586528451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 0x556367b73160 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.733+0000 7f963c011800 1 -- 172.21.15.100:0/3586528451 >> 172.21.15.100:0/3586528451 conn(0x556367b6adb0 msgr2=0x556367b6d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.733+0000 7f963c011800 1 -- 172.21.15.100:0/3586528451 shutdown_connections 2024-09-18T01:26:26.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.733+0000 7f963c011800 1 -- 172.21.15.100:0/3586528451 wait complete. 2024-09-18T01:26:26.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.747+0000 7f963c011800 1 Processor -- start 2024-09-18T01:26:26.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.747+0000 7f963c011800 1 -- start start 2024-09-18T01:26:26.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.747+0000 7f963c011800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 0x556367c5f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.747+0000 7f963c011800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556367abc360 con 0x556367ae46d0 2024-09-18T01:26:26.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.747+0000 7f963773d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 0x556367c5f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.747+0000 7f963773d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 0x556367c5f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44734/0 (socket says 172.21.15.100:44734) 2024-09-18T01:26:26.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.747+0000 7f963773d640 1 -- 172.21.15.100:0/3152183650 learned_addr learned my addr 172.21.15.100:0/3152183650 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.747+0000 7f963773d640 1 -- 172.21.15.100:0/3152183650 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556367a09bc0 con 0x556367ae46d0 2024-09-18T01:26:26.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.748+0000 7f963773d640 1 --2- 172.21.15.100:0/3152183650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 0x556367c5f900 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9628025da0 tx=0x7f9628051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2225f81cccf0f410 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.748+0000 7f952560a640 1 -- 172.21.15.100:0/3152183650 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9628051890 con 0x556367ae46d0 2024-09-18T01:26:26.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.748+0000 7f952560a640 1 -- 172.21.15.100:0/3152183650 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9628051ac0 con 0x556367ae46d0 2024-09-18T01:26:26.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.748+0000 7f952560a640 1 -- 172.21.15.100:0/3152183650 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9628051da0 con 0x556367ae46d0 2024-09-18T01:26:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.749+0000 7f963c011800 1 -- 172.21.15.100:0/3152183650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 msgr2=0x556367c5f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.749+0000 7f963c011800 1 --2- 172.21.15.100:0/3152183650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 0x556367c5f900 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9628025da0 tx=0x7f9628051000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.749+0000 7f963c011800 1 -- 172.21.15.100:0/3152183650 shutdown_connections 2024-09-18T01:26:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.749+0000 7f963c011800 1 --2- 172.21.15.100:0/3152183650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 0x556367c5f900 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.749+0000 7f963c011800 1 -- 172.21.15.100:0/3152183650 >> 172.21.15.100:0/3152183650 conn(0x556367b6adb0 msgr2=0x556367c5b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.749+0000 7f963c011800 1 -- 172.21.15.100:0/3152183650 shutdown_connections 2024-09-18T01:26:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.749+0000 7f963c011800 1 -- 172.21.15.100:0/3152183650 wait complete. 2024-09-18T01:26:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.749+0000 7f963c011800 1 Processor -- start 2024-09-18T01:26:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.749+0000 7f963c011800 1 -- start start 2024-09-18T01:26:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.749+0000 7f963c011800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 0x556367c67120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.749+0000 7f963c011800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556367b77610 con 0x556367ae46d0 2024-09-18T01:26:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.749+0000 7f963773d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 0x556367c67120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.749+0000 7f963773d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 0x556367c67120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44750/0 (socket says 172.21.15.100:44750) 2024-09-18T01:26:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.749+0000 7f963773d640 1 -- 172.21.15.100:0/2072225538 learned_addr learned my addr 172.21.15.100:0/2072225538 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.750+0000 7f963773d640 1 -- 172.21.15.100:0/2072225538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556367a1dfe0 con 0x556367ae46d0 2024-09-18T01:26:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.750+0000 7f963773d640 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 0x556367c67120 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9628025da0 tx=0x7f9628002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.750+0000 7f9523e07640 1 -- 172.21.15.100:0/2072225538 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9628073070 con 0x556367ae46d0 2024-09-18T01:26:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.750+0000 7f9523e07640 1 -- 172.21.15.100:0/2072225538 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f962805a450 con 0x556367ae46d0 2024-09-18T01:26:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.750+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556367c67660 con 0x556367ae46d0 2024-09-18T01:26:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.750+0000 7f9523e07640 1 -- 172.21.15.100:0/2072225538 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f962805a730 con 0x556367ae46d0 2024-09-18T01:26:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.750+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556367c67be0 con 0x556367ae46d0 2024-09-18T01:26:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.751+0000 7f9523e07640 1 -- 172.21.15.100:0/2072225538 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9628076070 con 0x556367ae46d0 2024-09-18T01:26:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.751+0000 7f9523e07640 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f951c036b40 0x7f951c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.751+0000 7f9523e07640 1 -- 172.21.15.100:0/2072225538 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f9628062070 con 0x556367ae46d0 2024-09-18T01:26:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.751+0000 7f962ef3c640 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f951c036b40 0x7f951c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.751+0000 7f963c011800 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556367b736a0 0x556367c6e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.751+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367c6e760 con 0x556367b736a0 2024-09-18T01:26:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.751+0000 7f9637f3e640 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556367b736a0 0x556367c6e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.752+0000 7f962ef3c640 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f951c036b40 0x7f951c039000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9620000f60 tx=0x7f9620001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.752+0000 7f9637f3e640 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556367b736a0 0x556367c6e190 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.752+0000 7f9637f3e640 1 -- 172.21.15.100:0/2072225538 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x556367b736a0 2024-09-18T01:26:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.752+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367c6b760 con 0x556367b736a0 2024-09-18T01:26:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.752+0000 7f9637f3e640 1 -- 172.21.15.100:0/2072225538 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f963000a4a0 con 0x556367b736a0 2024-09-18T01:26:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.752+0000 7f963c011800 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556367c70ab0 0x556367c72ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.752+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367c73540 con 0x556367c70ab0 2024-09-18T01:26:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.752+0000 7f963773d640 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556367c70ab0 0x556367c72ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.753+0000 7f963773d640 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556367c70ab0 0x556367c72ea0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.753+0000 7f963773d640 1 -- 172.21.15.100:0/2072225538 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f962807f070 con 0x556367c70ab0 2024-09-18T01:26:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.753+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367c6f920 con 0x556367b736a0 2024-09-18T01:26:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.753+0000 7f9637f3e640 1 -- 172.21.15.100:0/2072225538 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f963000a4a0 con 0x556367b736a0 2024-09-18T01:26:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.753+0000 7f963c011800 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556367c749a0 0x556367c76d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.753+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367c77480 con 0x556367c749a0 2024-09-18T01:26:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.753+0000 7f962ef3c640 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556367c749a0 0x556367c76d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.754+0000 7f962ef3c640 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556367c749a0 0x556367c76d90 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.754+0000 7f962ef3c640 1 -- 172.21.15.100:0/2072225538 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f962000f690 con 0x556367c749a0 2024-09-18T01:26:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.755+0000 7f963c011800 1 Processor -- start 2024-09-18T01:26:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.755+0000 7f963c011800 1 -- start start 2024-09-18T01:26:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.755+0000 7f963c011800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c851f0 0x556367c85610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.755+0000 7f963c011800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556367a0b580 con 0x556367c851f0 2024-09-18T01:26:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.755+0000 7f963773d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c851f0 0x556367c85610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.755+0000 7f963773d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c851f0 0x556367c85610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44762/0 (socket says 172.21.15.100:44762) 2024-09-18T01:26:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.755+0000 7f963773d640 1 -- 172.21.15.100:0/3699666713 learned_addr learned my addr 172.21.15.100:0/3699666713 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.755+0000 7f963773d640 1 -- 172.21.15.100:0/3699666713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556367c85b50 con 0x556367c851f0 2024-09-18T01:26:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.755+0000 7f963773d640 1 --2- 172.21.15.100:0/3699666713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c851f0 0x556367c85610 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f962808f580 tx=0x7f9628067f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.756+0000 7f9521602640 1 -- 172.21.15.100:0/3699666713 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f962806e700 con 0x556367c851f0 2024-09-18T01:26:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.756+0000 7f9521602640 1 -- 172.21.15.100:0/3699666713 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9628065910 con 0x556367c851f0 2024-09-18T01:26:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.756+0000 7f963c011800 1 -- 172.21.15.100:0/3699666713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556367c85de0 con 0x556367c851f0 2024-09-18T01:26:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.756+0000 7f9521602640 1 -- 172.21.15.100:0/3699666713 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9628065c10 con 0x556367c851f0 2024-09-18T01:26:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.756+0000 7f963c011800 1 -- 172.21.15.100:0/3699666713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556367c88ac0 con 0x556367c851f0 2024-09-18T01:26:26.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.756+0000 7f9521602640 1 -- 172.21.15.100:0/3699666713 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9628058070 con 0x556367c851f0 2024-09-18T01:26:26.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.757+0000 7f9521602640 1 --2- 172.21.15.100:0/3699666713 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9510036b40 0x7f9510039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.757+0000 7f9521602640 1 -- 172.21.15.100:0/3699666713 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f9628002000 con 0x556367c851f0 2024-09-18T01:26:26.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.757+0000 7f962ef3c640 1 --2- 172.21.15.100:0/3699666713 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9510036b40 0x7f9510039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.757+0000 7f963c011800 1 Processor -- start 2024-09-18T01:26:26.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.757+0000 7f962ef3c640 1 --2- 172.21.15.100:0/3699666713 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9510036b40 0x7f9510039000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x556367c6b680 tx=0x7f962000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.757+0000 7f963c011800 1 -- start start 2024-09-18T01:26:26.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.757+0000 7f963c011800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c91cc0 0x556367c920c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.757+0000 7f963c011800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556367c5fff0 con 0x556367c91cc0 2024-09-18T01:26:26.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.757+0000 7f963773d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c91cc0 0x556367c920c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.757+0000 7f963773d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c91cc0 0x556367c920c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44770/0 (socket says 172.21.15.100:44770) 2024-09-18T01:26:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.757+0000 7f963773d640 1 -- 172.21.15.100:0/3516641655 learned_addr learned my addr 172.21.15.100:0/3516641655 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.758+0000 7f963773d640 1 -- 172.21.15.100:0/3516641655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556367c92690 con 0x556367c91cc0 2024-09-18T01:26:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.758+0000 7f963773d640 1 --2- 172.21.15.100:0/3516641655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c91cc0 0x556367c920c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f962808ffd0 tx=0x7f962809ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c90498bd76ffdf server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.758+0000 7f951affd640 1 -- 172.21.15.100:0/3516641655 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9628063b60 con 0x556367c91cc0 2024-09-18T01:26:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.758+0000 7f951affd640 1 -- 172.21.15.100:0/3516641655 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96280b1070 con 0x556367c91cc0 2024-09-18T01:26:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.758+0000 7f951affd640 1 -- 172.21.15.100:0/3516641655 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f962807b550 con 0x556367c91cc0 2024-09-18T01:26:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.759+0000 7f963c011800 1 -- 172.21.15.100:0/3516641655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c91cc0 msgr2=0x556367c920c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.759+0000 7f963c011800 1 --2- 172.21.15.100:0/3516641655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c91cc0 0x556367c920c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f962808ffd0 tx=0x7f962809ae40 comp rx=0 tx=0).stop 2024-09-18T01:26:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.759+0000 7f963c011800 1 -- 172.21.15.100:0/3516641655 shutdown_connections 2024-09-18T01:26:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.759+0000 7f963c011800 1 --2- 172.21.15.100:0/3516641655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c91cc0 0x556367c920c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.759+0000 7f963c011800 1 -- 172.21.15.100:0/3516641655 >> 172.21.15.100:0/3516641655 conn(0x556367c8e070 msgr2=0x556367c8c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.759+0000 7f963c011800 1 -- 172.21.15.100:0/3516641655 shutdown_connections 2024-09-18T01:26:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.759+0000 7f963c011800 1 -- 172.21.15.100:0/3516641655 wait complete. 2024-09-18T01:26:26.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.759+0000 7f963c011800 1 Processor -- start 2024-09-18T01:26:26.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.759+0000 7f963c011800 1 -- start start 2024-09-18T01:26:26.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.759+0000 7f963c011800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c91cc0 0x556367c98f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.759+0000 7f963c011800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556367c92ae0 con 0x556367c91cc0 2024-09-18T01:26:26.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.759+0000 7f963773d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c91cc0 0x556367c98f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.759+0000 7f963773d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c91cc0 0x556367c98f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44772/0 (socket says 172.21.15.100:44772) 2024-09-18T01:26:26.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.759+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 learned_addr learned my addr 172.21.15.100:0/3181524151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.760+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556367c994a0 con 0x556367c91cc0 2024-09-18T01:26:26.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.760+0000 7f963773d640 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c91cc0 0x556367c98f60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f962809ae80 tx=0x7f962809ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.760+0000 7f95197fa640 1 -- 172.21.15.100:0/3181524151 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9628063b60 con 0x556367c91cc0 2024-09-18T01:26:26.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.760+0000 7f95197fa640 1 -- 172.21.15.100:0/3181524151 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96280bc070 con 0x556367c91cc0 2024-09-18T01:26:26.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.760+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556367c994a0 con 0x556367c91cc0 2024-09-18T01:26:26.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.760+0000 7f95197fa640 1 -- 172.21.15.100:0/3181524151 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9628079840 con 0x556367c91cc0 2024-09-18T01:26:26.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.760+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556367c994a0 con 0x556367c91cc0 2024-09-18T01:26:26.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.761+0000 7f95197fa640 1 -- 172.21.15.100:0/3181524151 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f962804f070 con 0x556367c91cc0 2024-09-18T01:26:26.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.761+0000 7f95197fa640 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9500036b40 0x7f9500039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.761+0000 7f95197fa640 1 -- 172.21.15.100:0/3181524151 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f962804d5c0 con 0x556367c91cc0 2024-09-18T01:26:26.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.761+0000 7f962ef3c640 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9500036b40 0x7f9500039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.761+0000 7f963c011800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.761+0000 7f963c011800 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556367ca4690 0x556367ca6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.761+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367ca72a0 con 0x556367ca4690 2024-09-18T01:26:26.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.761+0000 7f9637f3e640 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556367ca4690 0x556367ca6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f962ef3c640 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9500036b40 0x7f9500039000 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f962000c010 tx=0x7f9620010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f9637f3e640 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556367ca4690 0x556367ca6b50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f963c011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f963c011800 20 realm 2024-09-18T01:26:26.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f963c011800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367ca76b0 con 0x556367ca4690 2024-09-18T01:26:26.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f963c011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f963c011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:26:26.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f963c011800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367ca7f80 con 0x556367ca4690 2024-09-18T01:26:26.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f963c011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f963c011800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.762+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca4690 2024-09-18T01:26:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.763+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.763+0000 7f963c011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.763+0000 7f963c011800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.763+0000 7f963c011800 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556367ca8e50 0x556367cab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.763+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367cab980 con 0x556367ca8e50 2024-09-18T01:26:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.763+0000 7f963773d640 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556367ca8e50 0x556367cab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.763+0000 7f963773d640 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556367ca8e50 0x556367cab240 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.763+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.763+0000 7f963c011800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:26:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.763+0000 7f963c011800 20 searching for the correct realm 2024-09-18T01:26:26.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.763+0000 7f963c011800 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556367cada00 0x556367cafec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.763+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367cb0590 con 0x556367cada00 2024-09-18T01:26:26.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.763+0000 7f962ef3c640 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556367cada00 0x556367cafec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.764+0000 7f962ef3c640 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556367cada00 0x556367cafec0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.764+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9620037040 con 0x556367cada00 2024-09-18T01:26:26.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.764+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367cb0590 con 0x556367ca8e50 2024-09-18T01:26:26.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.764+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.764+0000 7f963773d640 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f96280b8040 0x7f96280c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.764+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367cb0590 con 0x7f96280b8040 2024-09-18T01:26:26.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.764+0000 7f9637f3e640 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f96280b8040 0x7f96280c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.765+0000 7f9637f3e640 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f96280b8040 0x7f96280c18a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.765+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.765+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca4690 2024-09-18T01:26:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.765+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.765+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca4690 2024-09-18T01:26:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.766+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.766+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x7f96280b8040 2024-09-18T01:26:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.766+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.766+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x7f96280b8040 2024-09-18T01:26:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.766+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.766+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca8e50 2024-09-18T01:26:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.766+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.766+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367cada00 2024-09-18T01:26:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.767+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9620037040 con 0x556367cada00 2024-09-18T01:26:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.767+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca4690 2024-09-18T01:26:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.767+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.767+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca8e50 2024-09-18T01:26:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.767+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.767+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca4690 2024-09-18T01:26:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.767+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.767+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca8e50 2024-09-18T01:26:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.768+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.768+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367cada00 2024-09-18T01:26:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.768+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9620037040 con 0x556367cada00 2024-09-18T01:26:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.768+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367cada00 2024-09-18T01:26:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.768+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9620037040 con 0x556367cada00 2024-09-18T01:26:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.768+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x7f96280b8040 2024-09-18T01:26:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.768+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.768+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367cada00 2024-09-18T01:26:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.769+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9620037040 con 0x556367cada00 2024-09-18T01:26:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.769+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367cada00 2024-09-18T01:26:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.769+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9620037040 con 0x556367cada00 2024-09-18T01:26:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.769+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca4690 2024-09-18T01:26:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.769+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.769+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca4690 2024-09-18T01:26:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.769+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.769+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x7f96280b8040 2024-09-18T01:26:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.770+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.770+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367cada00 2024-09-18T01:26:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.770+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9620037040 con 0x556367cada00 2024-09-18T01:26:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.770+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca8e50 2024-09-18T01:26:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.770+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.770+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca4690 2024-09-18T01:26:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.770+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.770+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x7f96280b8040 2024-09-18T01:26:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.771+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.771+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367cada00 2024-09-18T01:26:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.771+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9620037040 con 0x556367cada00 2024-09-18T01:26:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.771+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca8e50 2024-09-18T01:26:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.771+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.771+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca8e50 2024-09-18T01:26:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.771+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.771+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367cada00 2024-09-18T01:26:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.772+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9620037040 con 0x556367cada00 2024-09-18T01:26:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.772+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x7f96280b8040 2024-09-18T01:26:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.772+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.772+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca4690 2024-09-18T01:26:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.772+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.772+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556367ca8320 con 0x556367ca8e50 2024-09-18T01:26:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963c011800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:26:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963c011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:26:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963c011800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:26:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963c011800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:26:26.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963c011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:26:26.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963c011800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:26:26.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963c011800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367cac300 con 0x556367ca4690 2024-09-18T01:26:26.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963c011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963c011800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367cac6f0 con 0x556367ca4690 2024-09-18T01:26:26.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963c011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:26.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963c011800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.773+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367cac6f0 con 0x7f96280b8040 2024-09-18T01:26:26.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:26:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 20 zone default found 2024-09-18T01:26:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 4 Realm: () 2024-09-18T01:26:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:26:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:26:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:26:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 20 zonegroup default 2024-09-18T01:26:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367cacb10 con 0x7f96280b8040 2024-09-18T01:26:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367cacb10 con 0x556367cada00 2024-09-18T01:26:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9620037040 con 0x556367cada00 2024-09-18T01:26:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367cb23f0 con 0x556367cada00 2024-09-18T01:26:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9620037040 con 0x556367cada00 2024-09-18T01:26:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 20 started sync module instance, tier type = 2024-09-18T01:26:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:26:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.774+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb1890 con 0x556367ca8e50 2024-09-18T01:26:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.775+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.775+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93885431487616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb2c90 con 0x556367ca8e50 2024-09-18T01:26:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.776+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb34e0 con 0x556367ca4690 2024-09-18T01:26:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.777+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93885431487616] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.777+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.777+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93885431492656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb3900 con 0x556367ca4690 2024-09-18T01:26:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.777+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb4150 con 0x556367cada00 2024-09-18T01:26:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.778+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9620037040 con 0x556367cada00 2024-09-18T01:26:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.778+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93885431495392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb49f0 con 0x556367cada00 2024-09-18T01:26:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.778+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb54a0 con 0x556367ca8e50 2024-09-18T01:26:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.778+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93885431492656] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.779+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.779+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93885431493712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb5890 con 0x556367ca8e50 2024-09-18T01:26:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.779+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb62d0 con 0x556367ca4690 2024-09-18T01:26:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.779+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93885431495392] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9620037040 con 0x556367cada00 2024-09-18T01:26:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.780+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.780+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93885431504288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb6290 con 0x556367ca4690 2024-09-18T01:26:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.780+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb6ce0 con 0x7f96280b8040 2024-09-18T01:26:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.780+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93885431493712] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.781+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93885431504288] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.782+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.782+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93885431498048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb6830 con 0x7f96280b8040 2024-09-18T01:26:26.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.782+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb7580 con 0x7f96280b8040 2024-09-18T01:26:26.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.783+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93885431498048] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.783+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.783+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93885431500672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb6830 con 0x7f96280b8040 2024-09-18T01:26:26.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.783+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb7ba0 con 0x7f96280b8040 2024-09-18T01:26:26.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.784+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93885431500672] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.785+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.785+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93885431508880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb7ba0 con 0x7f96280b8040 2024-09-18T01:26:26.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.785+0000 7f963c011800 20 add_watcher() i=0 2024-09-18T01:26:26.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.785+0000 7f963c011800 20 add_watcher() i=1 2024-09-18T01:26:26.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.785+0000 7f963c011800 20 add_watcher() i=2 2024-09-18T01:26:26.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.785+0000 7f963c011800 20 add_watcher() i=3 2024-09-18T01:26:26.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.785+0000 7f963c011800 20 add_watcher() i=4 2024-09-18T01:26:26.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.785+0000 7f963c011800 20 add_watcher() i=5 2024-09-18T01:26:26.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.785+0000 7f963c011800 20 add_watcher() i=6 2024-09-18T01:26:26.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.786+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93885431508880] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.786+0000 7f963c011800 20 add_watcher() i=7 2024-09-18T01:26:26.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.786+0000 7f963c011800 2 all 8 watchers are set, enabling cache 2024-09-18T01:26:26.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.786+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367cbae80 con 0x556367ca4690 2024-09-18T01:26:26.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.786+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.786+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93885431511136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb8130 con 0x556367ca4690 2024-09-18T01:26:26.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.787+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93885431511136] v35'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.787+0000 7f94edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:26.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.787+0000 7f963c011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:26:26.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.787+0000 7f963c011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:26:26.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.787+0000 7f963c011800 5 note: GC not initialized 2024-09-18T01:26:26.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.787+0000 7f94ecfe1640 20 reqs_thread_entry: start 2024-09-18T01:26:26.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.788+0000 7f963c011800 20 init_complete bucket index max shards: 11 2024-09-18T01:26:26.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.788+0000 7f963c011800 20 Filter name: none 2024-09-18T01:26:26.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.788+0000 7f94667fc640 20 reqs_thread_entry: start 2024-09-18T01:26:26.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.788+0000 7f963c011800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.788+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367cede60 con 0x556367ca4690 2024-09-18T01:26:26.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.788+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.788+0000 7f963c011800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:26:26.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.788+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556367cef3b0 con 0x7f96280b8040 2024-09-18T01:26:26.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.789+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.790+0000 7f94edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:26.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.790+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93885431511136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cba2c0 con 0x556367ca4690 2024-09-18T01:26:26.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.791+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93885431511136] v35'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.791+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93885431487616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb7860 con 0x556367ca8e50 2024-09-18T01:26:26.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.792+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93885431487616] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.792+0000 7f963c011800 20 remove_watcher() i=0 2024-09-18T01:26:26.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.792+0000 7f963c011800 2 removed watcher, disabling cache 2024-09-18T01:26:26.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.792+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93885431492656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb7860 con 0x556367ca4690 2024-09-18T01:26:26.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.793+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93885431492656] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.793+0000 7f963c011800 20 remove_watcher() i=1 2024-09-18T01:26:26.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.793+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93885431495392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb3030 con 0x556367cada00 2024-09-18T01:26:26.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.794+0000 7f962ef3c640 1 -- 172.21.15.100:0/3181524151 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93885431495392] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9620037040 con 0x556367cada00 2024-09-18T01:26:26.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.794+0000 7f963c011800 20 remove_watcher() i=2 2024-09-18T01:26:26.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.794+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93885431493712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb7860 con 0x556367ca8e50 2024-09-18T01:26:26.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.795+0000 7f963773d640 1 -- 172.21.15.100:0/3181524151 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93885431493712] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962807f070 con 0x556367ca8e50 2024-09-18T01:26:26.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.795+0000 7f963c011800 20 remove_watcher() i=3 2024-09-18T01:26:26.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.795+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93885431504288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb7860 con 0x556367ca4690 2024-09-18T01:26:26.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.797+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93885431504288] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x556367ca4690 2024-09-18T01:26:26.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.797+0000 7f963c011800 20 remove_watcher() i=4 2024-09-18T01:26:26.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.797+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93885431498048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb5da0 con 0x7f96280b8040 2024-09-18T01:26:26.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.798+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93885431498048] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.798+0000 7f963c011800 20 remove_watcher() i=5 2024-09-18T01:26:26.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.798+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93885431500672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb7860 con 0x7f96280b8040 2024-09-18T01:26:26.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.799+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93885431500672] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.799+0000 7f963c011800 20 remove_watcher() i=6 2024-09-18T01:26:26.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.799+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93885431508880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556367cb4540 con 0x7f96280b8040 2024-09-18T01:26:26.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93885431508880] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x7f96280b8040 2024-09-18T01:26:26.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 20 remove_watcher() i=7 2024-09-18T01:26:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f96280b8040 msgr2=0x7f96280c18a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f96280b8040 0x7f96280c18a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556367ca4690 msgr2=0x556367ca6b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556367ca4690 0x556367ca6b50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556367ca8e50 msgr2=0x556367cab240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556367ca8e50 0x556367cab240 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556367cada00 msgr2=0x556367cafec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556367cada00 0x556367cafec0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9500036b40 msgr2=0x7f9500039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9500036b40 0x7f9500039000 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f962000c010 tx=0x7f9620010000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f9637f3e640 1 -- 172.21.15.100:0/3181524151 reap_dead start 2024-09-18T01:26:26.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c91cc0 msgr2=0x556367c98f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c91cc0 0x556367c98f60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f962809ae80 tx=0x7f962809ef20 comp rx=0 tx=0).stop 2024-09-18T01:26:26.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 shutdown_connections 2024-09-18T01:26:26.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 --2- 172.21.15.100:0/3181524151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c91cc0 0x556367c98f60 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 >> 172.21.15.100:0/3181524151 conn(0x556367c8e070 msgr2=0x556367c8c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 shutdown_connections 2024-09-18T01:26:26.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 -- 172.21.15.100:0/3181524151 wait complete. 2024-09-18T01:26:26.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 -- 172.21.15.100:0/3699666713 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9510036b40 msgr2=0x7f9510039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 --2- 172.21.15.100:0/3699666713 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9510036b40 0x7f9510039000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x556367c6b680 tx=0x7f962000f000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 -- 172.21.15.100:0/3699666713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c851f0 msgr2=0x556367c85610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 --2- 172.21.15.100:0/3699666713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c851f0 0x556367c85610 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f962808f580 tx=0x7f9628067f30 comp rx=0 tx=0).stop 2024-09-18T01:26:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.800+0000 7f963c011800 1 -- 172.21.15.100:0/3699666713 shutdown_connections 2024-09-18T01:26:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 --2- 172.21.15.100:0/3699666713 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9510036b40 0x7f9510039000 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 --2- 172.21.15.100:0/3699666713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367c851f0 0x556367c85610 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 -- 172.21.15.100:0/3699666713 >> 172.21.15.100:0/3699666713 conn(0x556367c7a180 msgr2=0x556367c7cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 -- 172.21.15.100:0/3699666713 shutdown_connections 2024-09-18T01:26:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 -- 172.21.15.100:0/3699666713 wait complete. 2024-09-18T01:26:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556367c749a0 msgr2=0x556367c76d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556367c749a0 0x556367c76d90 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556367b736a0 msgr2=0x556367c6e190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556367b736a0 0x556367c6e190 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556367c70ab0 msgr2=0x556367c72ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556367c70ab0 0x556367c72ea0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f951c036b40 msgr2=0x7f951c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f951c036b40 0x7f951c039000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9620000f60 tx=0x7f9620001370 comp rx=0 tx=0).stop 2024-09-18T01:26:26.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 msgr2=0x556367c67120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 --2- 172.21.15.100:0/2072225538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556367ae46d0 0x556367c67120 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9628025da0 tx=0x7f9628002fb0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f9637f3e640 1 -- 172.21.15.100:0/2072225538 reap_dead start 2024-09-18T01:26:26.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 shutdown_connections 2024-09-18T01:26:26.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 >> 172.21.15.100:0/2072225538 conn(0x556367b6adb0 msgr2=0x556367c59b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 shutdown_connections 2024-09-18T01:26:26.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.801+0000 7f963c011800 1 -- 172.21.15.100:0/2072225538 wait complete. 2024-09-18T01:26:26.828 INFO:teuthology.orchestra.run.smithi100.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-18T01:26:26.828 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-18T01:26:26.829 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-18T01:26:26.829 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-18T01:26:26.829 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-18T01:26:26.875 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:26:26.875 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:26:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.874+0000 7fe10950c800 1 Processor -- start 2024-09-18T01:26:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.874+0000 7fe10950c800 1 -- start start 2024-09-18T01:26:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.874+0000 7fe10950c800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56311be4adf0 0x56311bedc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.874+0000 7fe10950c800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56311bd96b30 con 0x56311bedcb60 2024-09-18T01:26:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.874+0000 7fe10950c800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x56311bd78360 con 0x56311be4adf0 2024-09-18T01:26:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.874+0000 7fe107000640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56311be4adf0 0x56311bedc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.874+0000 7fe107000640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56311be4adf0 0x56311bedc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44780/0 (socket says 172.21.15.100:44780) 2024-09-18T01:26:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.874+0000 7fe1067ff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x56311bedcb60 0x56311bedef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:51726/0 (socket says 172.21.15.100:51726) 2024-09-18T01:26:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.874+0000 7fe107000640 1 -- 172.21.15.100:0/4008979417 learned_addr learned my addr 172.21.15.100:0/4008979417 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.875+0000 7fe107000640 1 -- 172.21.15.100:0/4008979417 >> v1:172.21.15.92:6789/0 conn(0x56311bedcb60 legacy=0x56311bedef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.875+0000 7fe107000640 1 -- 172.21.15.100:0/4008979417 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311bd9ee00 con 0x56311be4adf0 2024-09-18T01:26:26.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.876+0000 7fe107000640 1 --2- 172.21.15.100:0/4008979417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 0x56311bedc620 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800a520 tx=0x7fe0f8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56be5746f9afef19 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.876+0000 7fe105ffe640 1 -- 172.21.15.100:0/4008979417 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f8055070 con 0x56311be4adf0 2024-09-18T01:26:26.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.876+0000 7fe105ffe640 1 -- 172.21.15.100:0/4008979417 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f80515b0 con 0x56311be4adf0 2024-09-18T01:26:26.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.877+0000 7fe105ffe640 1 -- 172.21.15.100:0/4008979417 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80518d0 con 0x56311be4adf0 2024-09-18T01:26:26.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.877+0000 7fe10950c800 1 -- 172.21.15.100:0/4008979417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 msgr2=0x56311bedc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.877+0000 7fe10950c800 1 --2- 172.21.15.100:0/4008979417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 0x56311bedc620 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800a520 tx=0x7fe0f8045ba0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.877+0000 7fe10950c800 1 -- 172.21.15.100:0/4008979417 shutdown_connections 2024-09-18T01:26:26.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.877+0000 7fe10950c800 1 --2- 172.21.15.100:0/4008979417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 0x56311bedc620 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.877+0000 7fe10950c800 1 -- 172.21.15.100:0/4008979417 >> 172.21.15.100:0/4008979417 conn(0x56311bed1dd0 msgr2=0x56311bed41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.877+0000 7fe10950c800 1 -- 172.21.15.100:0/4008979417 shutdown_connections 2024-09-18T01:26:26.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.877+0000 7fe10950c800 1 -- 172.21.15.100:0/4008979417 wait complete. 2024-09-18T01:26:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.891+0000 7fe10950c800 1 Processor -- start 2024-09-18T01:26:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.891+0000 7fe10950c800 1 -- start start 2024-09-18T01:26:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.891+0000 7fe10950c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 0x56311bfc8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.891+0000 7fe10950c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56311be23360 con 0x56311be4adf0 2024-09-18T01:26:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.891+0000 7fe107000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 0x56311bfc8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.891+0000 7fe107000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 0x56311bfc8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44792/0 (socket says 172.21.15.100:44792) 2024-09-18T01:26:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.891+0000 7fe107000640 1 -- 172.21.15.100:0/3841258769 learned_addr learned my addr 172.21.15.100:0/3841258769 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.892+0000 7fe107000640 1 -- 172.21.15.100:0/3841258769 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311bd70bc0 con 0x56311be4adf0 2024-09-18T01:26:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.892+0000 7fe107000640 1 --2- 172.21.15.100:0/3841258769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 0x56311bfc8ac0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8025da0 tx=0x7fe0f8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bca34a90191aa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.892+0000 7fdff4e09640 1 -- 172.21.15.100:0/3841258769 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f8051890 con 0x56311be4adf0 2024-09-18T01:26:26.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.892+0000 7fdff4e09640 1 -- 172.21.15.100:0/3841258769 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f8051ac0 con 0x56311be4adf0 2024-09-18T01:26:26.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.892+0000 7fdff4e09640 1 -- 172.21.15.100:0/3841258769 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f8051da0 con 0x56311be4adf0 2024-09-18T01:26:26.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.893+0000 7fe10950c800 1 -- 172.21.15.100:0/3841258769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 msgr2=0x56311bfc8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.893+0000 7fe10950c800 1 --2- 172.21.15.100:0/3841258769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 0x56311bfc8ac0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8025da0 tx=0x7fe0f8051000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.893+0000 7fe10950c800 1 -- 172.21.15.100:0/3841258769 shutdown_connections 2024-09-18T01:26:26.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.893+0000 7fe10950c800 1 --2- 172.21.15.100:0/3841258769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 0x56311bfc8ac0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.893+0000 7fe10950c800 1 -- 172.21.15.100:0/3841258769 >> 172.21.15.100:0/3841258769 conn(0x56311bed1dd0 msgr2=0x56311bfc4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.893+0000 7fe10950c800 1 -- 172.21.15.100:0/3841258769 shutdown_connections 2024-09-18T01:26:26.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.893+0000 7fe10950c800 1 -- 172.21.15.100:0/3841258769 wait complete. 2024-09-18T01:26:26.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.893+0000 7fe10950c800 1 Processor -- start 2024-09-18T01:26:26.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.893+0000 7fe10950c800 1 -- start start 2024-09-18T01:26:26.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.893+0000 7fe10950c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 0x56311bfd03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.893+0000 7fe10950c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56311bee0910 con 0x56311be4adf0 2024-09-18T01:26:26.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.893+0000 7fe107000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 0x56311bfd03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.893+0000 7fe107000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 0x56311bfd03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44796/0 (socket says 172.21.15.100:44796) 2024-09-18T01:26:26.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.893+0000 7fe107000640 1 -- 172.21.15.100:0/3211571368 learned_addr learned my addr 172.21.15.100:0/3211571368 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.894+0000 7fe107000640 1 -- 172.21.15.100:0/3211571368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311bd84fe0 con 0x56311be4adf0 2024-09-18T01:26:26.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.894+0000 7fe107000640 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 0x56311bfd03b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8025da0 tx=0x7fe0f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.894+0000 7fdff3606640 1 -- 172.21.15.100:0/3211571368 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f8073070 con 0x56311be4adf0 2024-09-18T01:26:26.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.894+0000 7fdff3606640 1 -- 172.21.15.100:0/3211571368 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f805a580 con 0x56311be4adf0 2024-09-18T01:26:26.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.894+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56311bfd08f0 con 0x56311be4adf0 2024-09-18T01:26:26.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.894+0000 7fdff3606640 1 -- 172.21.15.100:0/3211571368 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f805a860 con 0x56311be4adf0 2024-09-18T01:26:26.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.894+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56311bfd0e70 con 0x56311be4adf0 2024-09-18T01:26:26.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.895+0000 7fdff3606640 1 -- 172.21.15.100:0/3211571368 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe0f8076070 con 0x56311be4adf0 2024-09-18T01:26:26.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.895+0000 7fdff3606640 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfec036b40 0x7fdfec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.895+0000 7fdff3606640 1 -- 172.21.15.100:0/3211571368 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fe0f8062070 con 0x56311be4adf0 2024-09-18T01:26:26.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.895+0000 7fe1067ff640 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfec036b40 0x7fdfec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.895+0000 7fe10950c800 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56311bedcb60 0x56311bfd7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.895+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311bfd7a70 con 0x56311bedcb60 2024-09-18T01:26:26.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.896+0000 7fe107801640 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56311bedcb60 0x56311bfd7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.896+0000 7fe1067ff640 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfec036b40 0x7fdfec039000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0000f60 tx=0x7fe0f0001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.896+0000 7fe107801640 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56311bedcb60 0x56311bfd7420 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.896+0000 7fe107801640 1 -- 172.21.15.100:0/3211571368 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311bedcb60 2024-09-18T01:26:26.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.896+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311bfd49f0 con 0x56311bedcb60 2024-09-18T01:26:26.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.896+0000 7fe107801640 1 -- 172.21.15.100:0/3211571368 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311bedcb60 2024-09-18T01:26:26.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.896+0000 7fe10950c800 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56311bfd9da0 0x56311bfdc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.896+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311bfdc830 con 0x56311bfd9da0 2024-09-18T01:26:26.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.897+0000 7fe107000640 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56311bfd9da0 0x56311bfdc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.897+0000 7fe107000640 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56311bfd9da0 0x56311bfdc190 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.897+0000 7fe107000640 1 -- 172.21.15.100:0/3211571368 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe0f807f070 con 0x56311bfd9da0 2024-09-18T01:26:26.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.897+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311bfd8c40 con 0x56311bedcb60 2024-09-18T01:26:26.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.897+0000 7fe107801640 1 -- 172.21.15.100:0/3211571368 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311bedcb60 2024-09-18T01:26:26.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.897+0000 7fe10950c800 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56311bfddc90 0x56311bfe0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.897+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311bfe0780 con 0x56311bfddc90 2024-09-18T01:26:26.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.898+0000 7fe1067ff640 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56311bfddc90 0x56311bfe0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.898+0000 7fe1067ff640 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56311bfddc90 0x56311bfe0080 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.899+0000 7fe1067ff640 1 -- 172.21.15.100:0/3211571368 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe0f000f690 con 0x56311bfddc90 2024-09-18T01:26:26.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.899+0000 7fe10950c800 1 Processor -- start 2024-09-18T01:26:26.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.899+0000 7fe10950c800 1 -- start start 2024-09-18T01:26:26.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.899+0000 7fe10950c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bfee4b0 0x56311bfee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.899+0000 7fe10950c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56311bd72580 con 0x56311bfee4b0 2024-09-18T01:26:26.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.899+0000 7fe107000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bfee4b0 0x56311bfee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.899+0000 7fe107000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bfee4b0 0x56311bfee8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44810/0 (socket says 172.21.15.100:44810) 2024-09-18T01:26:26.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.899+0000 7fe107000640 1 -- 172.21.15.100:0/2154286151 learned_addr learned my addr 172.21.15.100:0/2154286151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.900+0000 7fe107000640 1 -- 172.21.15.100:0/2154286151 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311bfeee10 con 0x56311bfee4b0 2024-09-18T01:26:26.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.900+0000 7fe107000640 1 --2- 172.21.15.100:0/2154286151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bfee4b0 0x56311bfee8d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe0f805cfd0 tx=0x7fe0f8065e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.900+0000 7fdff0e01640 1 -- 172.21.15.100:0/2154286151 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f800a020 con 0x56311bfee4b0 2024-09-18T01:26:26.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.900+0000 7fdff0e01640 1 -- 172.21.15.100:0/2154286151 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f800a1c0 con 0x56311bfee4b0 2024-09-18T01:26:26.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.900+0000 7fe10950c800 1 -- 172.21.15.100:0/2154286151 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56311bfef0a0 con 0x56311bfee4b0 2024-09-18T01:26:26.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.900+0000 7fdff0e01640 1 -- 172.21.15.100:0/2154286151 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f806e4f0 con 0x56311bfee4b0 2024-09-18T01:26:26.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.900+0000 7fe10950c800 1 -- 172.21.15.100:0/2154286151 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56311bff1d80 con 0x56311bfee4b0 2024-09-18T01:26:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.901+0000 7fdff0e01640 1 -- 172.21.15.100:0/2154286151 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe0f8058070 con 0x56311bfee4b0 2024-09-18T01:26:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.901+0000 7fdff0e01640 1 --2- 172.21.15.100:0/2154286151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfe0036b90 0x7fdfe0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.901+0000 7fdff0e01640 1 -- 172.21.15.100:0/2154286151 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fe0f808c040 con 0x56311bfee4b0 2024-09-18T01:26:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.901+0000 7fe1067ff640 1 --2- 172.21.15.100:0/2154286151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfe0036b90 0x7fdfe0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.901+0000 7fe10950c800 1 Processor -- start 2024-09-18T01:26:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.901+0000 7fe10950c800 1 -- start start 2024-09-18T01:26:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.901+0000 7fe1067ff640 1 --2- 172.21.15.100:0/2154286151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfe0036b90 0x7fdfe0039050 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x56311bfd4910 tx=0x7fe0f000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.901+0000 7fe10950c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bffaef0 0x56311bffb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.901+0000 7fe10950c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56311bfc91b0 con 0x56311bffaef0 2024-09-18T01:26:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.902+0000 7fe107000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bffaef0 0x56311bffb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.902+0000 7fe107000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bffaef0 0x56311bffb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44826/0 (socket says 172.21.15.100:44826) 2024-09-18T01:26:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.902+0000 7fe107000640 1 -- 172.21.15.100:0/865705684 learned_addr learned my addr 172.21.15.100:0/865705684 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.902+0000 7fe107000640 1 -- 172.21.15.100:0/865705684 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311bffb8c0 con 0x56311bffaef0 2024-09-18T01:26:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.902+0000 7fe107000640 1 --2- 172.21.15.100:0/865705684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bffaef0 0x56311bffb2f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8050c00 tx=0x7fe0f8080530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a2c73f4d04d7c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.902+0000 7fdfea7fc640 1 -- 172.21.15.100:0/865705684 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f809d040 con 0x56311bffaef0 2024-09-18T01:26:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.902+0000 7fdfea7fc640 1 -- 172.21.15.100:0/865705684 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f8078cc0 con 0x56311bffaef0 2024-09-18T01:26:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.902+0000 7fdfea7fc640 1 -- 172.21.15.100:0/865705684 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f8086ca0 con 0x56311bffaef0 2024-09-18T01:26:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.903+0000 7fe10950c800 1 -- 172.21.15.100:0/865705684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bffaef0 msgr2=0x56311bffb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.903+0000 7fe10950c800 1 --2- 172.21.15.100:0/865705684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bffaef0 0x56311bffb2f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8050c00 tx=0x7fe0f8080530 comp rx=0 tx=0).stop 2024-09-18T01:26:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.903+0000 7fe10950c800 1 -- 172.21.15.100:0/865705684 shutdown_connections 2024-09-18T01:26:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.903+0000 7fe10950c800 1 --2- 172.21.15.100:0/865705684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bffaef0 0x56311bffb2f0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.903+0000 7fe10950c800 1 -- 172.21.15.100:0/865705684 >> 172.21.15.100:0/865705684 conn(0x56311bff72a0 msgr2=0x56311bff53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.903+0000 7fe10950c800 1 -- 172.21.15.100:0/865705684 shutdown_connections 2024-09-18T01:26:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.903+0000 7fe10950c800 1 -- 172.21.15.100:0/865705684 wait complete. 2024-09-18T01:26:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.903+0000 7fe10950c800 1 Processor -- start 2024-09-18T01:26:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.903+0000 7fe10950c800 1 -- start start 2024-09-18T01:26:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.903+0000 7fe10950c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bffaef0 0x56311c0021b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.903+0000 7fe10950c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56311bffbd10 con 0x56311bffaef0 2024-09-18T01:26:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.903+0000 7fe107000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bffaef0 0x56311c0021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.903+0000 7fe107000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bffaef0 0x56311c0021b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44834/0 (socket says 172.21.15.100:44834) 2024-09-18T01:26:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.903+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 learned_addr learned my addr 172.21.15.100:0/3187818621 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.904+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311c0026f0 con 0x56311bffaef0 2024-09-18T01:26:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.904+0000 7fe107000640 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bffaef0 0x56311c0021b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8082560 tx=0x7fe0f8090d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.904+0000 7fdfe8ff9640 1 -- 172.21.15.100:0/3187818621 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f809d040 con 0x56311bffaef0 2024-09-18T01:26:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.904+0000 7fdfe8ff9640 1 -- 172.21.15.100:0/3187818621 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f8078450 con 0x56311bffaef0 2024-09-18T01:26:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.904+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56311c0026f0 con 0x56311bffaef0 2024-09-18T01:26:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.904+0000 7fdfe8ff9640 1 -- 172.21.15.100:0/3187818621 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f8080c10 con 0x56311bffaef0 2024-09-18T01:26:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.904+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56311c0026f0 con 0x56311bffaef0 2024-09-18T01:26:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.905+0000 7fdfe8ff9640 1 -- 172.21.15.100:0/3187818621 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe0f80bd020 con 0x56311bffaef0 2024-09-18T01:26:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.905+0000 7fdfe8ff9640 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfd0036b40 0x7fdfd0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.905+0000 7fdfe8ff9640 1 -- 172.21.15.100:0/3187818621 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fe0f80bb020 con 0x56311bffaef0 2024-09-18T01:26:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.905+0000 7fe1067ff640 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfd0036b40 0x7fdfd0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.905+0000 7fe10950c800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.905+0000 7fe10950c800 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56311c00d950 0x56311c00fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.905+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311c010560 con 0x56311c00d950 2024-09-18T01:26:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.905+0000 7fe107801640 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56311c00d950 0x56311c00fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe1067ff640 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfd0036b40 0x7fdfd0039000 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x56311bfe0b80 tx=0x7fe0f0010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe107801640 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56311c00d950 0x56311c00fe10 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe10950c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe10950c800 20 realm 2024-09-18T01:26:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe10950c800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311c010970 con 0x56311c00d950 2024-09-18T01:26:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe10950c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe10950c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:26:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe10950c800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311c011210 con 0x56311c00d950 2024-09-18T01:26:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe10950c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe10950c800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.906+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c00d950 2024-09-18T01:26:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.907+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.907+0000 7fe10950c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.907+0000 7fe10950c800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.907+0000 7fe10950c800 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56311c012310 0x56311c014700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.907+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311c014c40 con 0x56311c012310 2024-09-18T01:26:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.907+0000 7fe107000640 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56311c012310 0x56311c014700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.907+0000 7fe107000640 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56311c012310 0x56311c014700 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.907+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.907+0000 7fe10950c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:26:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.907+0000 7fe10950c800 20 searching for the correct realm 2024-09-18T01:26:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.907+0000 7fe10950c800 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56311c016cc0 0x56311c019180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.907+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c019850 con 0x56311c016cc0 2024-09-18T01:26:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.907+0000 7fe1067ff640 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56311c016cc0 0x56311c019180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.908+0000 7fe1067ff640 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56311c016cc0 0x56311c019180 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.908+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f0037040 con 0x56311c016cc0 2024-09-18T01:26:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.908+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c019850 con 0x56311c012310 2024-09-18T01:26:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.908+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.908+0000 7fe107000640 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe0f8078070 0x7fe0f8063310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.908+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c019850 con 0x7fe0f8078070 2024-09-18T01:26:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.908+0000 7fe107801640 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe0f8078070 0x7fe0f8063310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.909+0000 7fe107801640 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe0f8078070 0x7fe0f8063310 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.909+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.909+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c00d950 2024-09-18T01:26:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.909+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.909+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c00d950 2024-09-18T01:26:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.909+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.909+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x7fe0f8078070 2024-09-18T01:26:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.910+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.910+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x7fe0f8078070 2024-09-18T01:26:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.910+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.910+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c012310 2024-09-18T01:26:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.910+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.910+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c016cc0 2024-09-18T01:26:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.910+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f0037040 con 0x56311c016cc0 2024-09-18T01:26:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.911+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c00d950 2024-09-18T01:26:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.911+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.911+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c012310 2024-09-18T01:26:26.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.911+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.911+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c00d950 2024-09-18T01:26:26.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.911+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.911+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c012310 2024-09-18T01:26:26.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.911+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.911+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c016cc0 2024-09-18T01:26:26.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.912+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f0037040 con 0x56311c016cc0 2024-09-18T01:26:26.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.912+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c016cc0 2024-09-18T01:26:26.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.912+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f0037040 con 0x56311c016cc0 2024-09-18T01:26:26.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.912+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x7fe0f8078070 2024-09-18T01:26:26.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.912+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.912+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c016cc0 2024-09-18T01:26:26.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.912+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f0037040 con 0x56311c016cc0 2024-09-18T01:26:26.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.912+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c016cc0 2024-09-18T01:26:26.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.913+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f0037040 con 0x56311c016cc0 2024-09-18T01:26:26.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.913+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c00d950 2024-09-18T01:26:26.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.913+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.913+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c00d950 2024-09-18T01:26:26.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.913+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.913+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x7fe0f8078070 2024-09-18T01:26:26.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.913+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.913+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c016cc0 2024-09-18T01:26:26.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.914+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f0037040 con 0x56311c016cc0 2024-09-18T01:26:26.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.914+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c012310 2024-09-18T01:26:26.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.914+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.914+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c00d950 2024-09-18T01:26:26.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.914+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.914+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x7fe0f8078070 2024-09-18T01:26:26.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.915+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.915+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c016cc0 2024-09-18T01:26:26.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.915+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f0037040 con 0x56311c016cc0 2024-09-18T01:26:26.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.915+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c012310 2024-09-18T01:26:26.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.915+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.915+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c012310 2024-09-18T01:26:26.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.915+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.915+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c016cc0 2024-09-18T01:26:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.916+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f0037040 con 0x56311c016cc0 2024-09-18T01:26:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.916+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x7fe0f8078070 2024-09-18T01:26:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.916+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.916+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c00d950 2024-09-18T01:26:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.916+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.916+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56311c0115b0 con 0x56311c012310 2024-09-18T01:26:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:26:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:26:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:26:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:26:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:26:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:26:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311c0155c0 con 0x56311c00d950 2024-09-18T01:26:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311c0159b0 con 0x56311c00d950 2024-09-18T01:26:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311c0159b0 con 0x7fe0f8078070 2024-09-18T01:26:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 zone default found 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 4 Realm: () 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 zonegroup default 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.917+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311c015dd0 con 0x7fe0f8078070 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.918+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.918+0000 7fe10950c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.918+0000 7fe10950c800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.918+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311c015dd0 con 0x56311c016cc0 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.918+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0f0037040 con 0x56311c016cc0 2024-09-18T01:26:26.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.918+0000 7fe10950c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.918+0000 7fe10950c800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.918+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311c01b6b0 con 0x56311c016cc0 2024-09-18T01:26:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.918+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0f0037040 con 0x56311c016cc0 2024-09-18T01:26:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.918+0000 7fe10950c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.918+0000 7fe10950c800 20 started sync module instance, tier type = 2024-09-18T01:26:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.918+0000 7fe10950c800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:26:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.918+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01ab50 con 0x56311c012310 2024-09-18T01:26:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.919+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.919+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94768923258688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01a7b0 con 0x56311c012310 2024-09-18T01:26:26.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.919+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01c570 con 0x56311c00d950 2024-09-18T01:26:26.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.920+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94768923258688] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.921+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.921+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94768923261600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01c570 con 0x56311c00d950 2024-09-18T01:26:26.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.921+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01cfb0 con 0x56311c016cc0 2024-09-18T01:26:26.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.922+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f0037040 con 0x56311c016cc0 2024-09-18T01:26:26.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.922+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94768923265664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01d850 con 0x56311c016cc0 2024-09-18T01:26:26.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.922+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01e330 con 0x56311c012310 2024-09-18T01:26:26.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.922+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94768923261600] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.923+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.923+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94768923270720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01e720 con 0x56311c012310 2024-09-18T01:26:26.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.923+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01f120 con 0x56311c00d950 2024-09-18T01:26:26.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.923+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94768923265664] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f0037040 con 0x56311c016cc0 2024-09-18T01:26:26.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.924+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94768923270720] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.924+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.924+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94768923263168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01ec30 con 0x56311c00d950 2024-09-18T01:26:26.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.925+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01f9f0 con 0x7fe0f8078070 2024-09-18T01:26:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.926+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94768923263168] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.926+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.926+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94768923268000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01f7e0 con 0x7fe0f8078070 2024-09-18T01:26:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.926+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c020030 con 0x7fe0f8078070 2024-09-18T01:26:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.927+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94768923268000] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.927+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.927+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94768923276560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01fea0 con 0x7fe0f8078070 2024-09-18T01:26:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.927+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c020990 con 0x7fe0f8078070 2024-09-18T01:26:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.928+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94768923276560] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.928+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.928+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94768923280480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c020950 con 0x7fe0f8078070 2024-09-18T01:26:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.928+0000 7fe10950c800 20 add_watcher() i=0 2024-09-18T01:26:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.928+0000 7fe10950c800 20 add_watcher() i=1 2024-09-18T01:26:26.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.928+0000 7fe10950c800 20 add_watcher() i=2 2024-09-18T01:26:26.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.928+0000 7fe10950c800 20 add_watcher() i=3 2024-09-18T01:26:26.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.928+0000 7fe10950c800 20 add_watcher() i=4 2024-09-18T01:26:26.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.928+0000 7fe10950c800 20 add_watcher() i=5 2024-09-18T01:26:26.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.928+0000 7fe10950c800 20 add_watcher() i=6 2024-09-18T01:26:26.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.929+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94768923280480] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.929+0000 7fe10950c800 20 add_watcher() i=7 2024-09-18T01:26:26.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.929+0000 7fe10950c800 2 all 8 watchers are set, enabling cache 2024-09-18T01:26:26.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.929+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311c023db0 con 0x56311c00d950 2024-09-18T01:26:26.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.930+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.930+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94768923277616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c0212d0 con 0x56311c00d950 2024-09-18T01:26:26.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.931+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94768923277616] v35'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.931+0000 7fdfbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:26.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.931+0000 7fe10950c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:26:26.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.931+0000 7fe10950c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:26:26.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.931+0000 7fe10950c800 5 note: GC not initialized 2024-09-18T01:26:26.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.931+0000 7fdf37fff640 20 reqs_thread_entry: start 2024-09-18T01:26:26.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.931+0000 7fe10950c800 20 init_complete bucket index max shards: 11 2024-09-18T01:26:26.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.931+0000 7fe10950c800 20 Filter name: none 2024-09-18T01:26:26.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.931+0000 7fdf35ffb640 20 reqs_thread_entry: start 2024-09-18T01:26:26.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.931+0000 7fe10950c800 20 rados->read ofs=0 len=0 2024-09-18T01:26:26.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.931+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311c056d10 con 0x56311c00d950 2024-09-18T01:26:26.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.932+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.932+0000 7fe10950c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.932+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56311c058260 con 0x7fe0f8078070 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.932+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.933+0000 7fdfbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.933+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94768923277616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c056730 con 0x56311c00d950 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.934+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94768923277616] v35'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.934+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94768923258688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c056730 con 0x56311c012310 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.935+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94768923258688] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.935+0000 7fe10950c800 20 remove_watcher() i=0 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.935+0000 7fe10950c800 2 removed watcher, disabling cache 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.935+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94768923261600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01af40 con 0x56311c00d950 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.936+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94768923261600] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.936+0000 7fe10950c800 20 remove_watcher() i=1 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.936+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94768923265664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01af40 con 0x56311c016cc0 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.937+0000 7fe1067ff640 1 -- 172.21.15.100:0/3187818621 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94768923265664] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f0037040 con 0x56311c016cc0 2024-09-18T01:26:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.937+0000 7fe10950c800 20 remove_watcher() i=2 2024-09-18T01:26:26.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.938+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94768923270720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01baa0 con 0x56311c012310 2024-09-18T01:26:26.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.938+0000 7fe107000640 1 -- 172.21.15.100:0/3187818621 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94768923270720] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f809f070 con 0x56311c012310 2024-09-18T01:26:26.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.938+0000 7fe10950c800 20 remove_watcher() i=3 2024-09-18T01:26:26.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.938+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94768923263168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01baa0 con 0x56311c00d950 2024-09-18T01:26:26.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.940+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94768923263168] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x56311c00d950 2024-09-18T01:26:26.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.940+0000 7fe10950c800 20 remove_watcher() i=4 2024-09-18T01:26:26.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.940+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94768923268000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01baa0 con 0x7fe0f8078070 2024-09-18T01:26:26.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.941+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94768923268000] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.941+0000 7fe10950c800 20 remove_watcher() i=5 2024-09-18T01:26:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.941+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94768923276560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01d3a0 con 0x7fe0f8078070 2024-09-18T01:26:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.942+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94768923276560] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.942+0000 7fe10950c800 20 remove_watcher() i=6 2024-09-18T01:26:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.942+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94768923280480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56311c01baa0 con 0x7fe0f8078070 2024-09-18T01:26:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94768923280480] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10000a4a0 con 0x7fe0f8078070 2024-09-18T01:26:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 20 remove_watcher() i=7 2024-09-18T01:26:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe0f8078070 msgr2=0x7fe0f8063310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe0f8078070 0x7fe0f8063310 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56311c00d950 msgr2=0x56311c00fe10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56311c00d950 0x56311c00fe10 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56311c012310 msgr2=0x56311c014700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56311c012310 0x56311c014700 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56311c016cc0 msgr2=0x56311c019180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x56311c016cc0 0x56311c019180 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfd0036b40 msgr2=0x7fdfd0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfd0036b40 0x7fdfd0039000 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x56311bfe0b80 tx=0x7fe0f0010000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bffaef0 msgr2=0x56311c0021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe107801640 1 -- 172.21.15.100:0/3187818621 reap_dead start 2024-09-18T01:26:26.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bffaef0 0x56311c0021b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8082560 tx=0x7fe0f8090d10 comp rx=0 tx=0).stop 2024-09-18T01:26:26.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 shutdown_connections 2024-09-18T01:26:26.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 --2- 172.21.15.100:0/3187818621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bffaef0 0x56311c0021b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 >> 172.21.15.100:0/3187818621 conn(0x56311bff72a0 msgr2=0x56311bff5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 shutdown_connections 2024-09-18T01:26:26.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.943+0000 7fe10950c800 1 -- 172.21.15.100:0/3187818621 wait complete. 2024-09-18T01:26:26.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/2154286151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfe0036b90 msgr2=0x7fdfe0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 --2- 172.21.15.100:0/2154286151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfe0036b90 0x7fdfe0039050 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x56311bfd4910 tx=0x7fe0f000f000 comp rx=0 tx=0).stop 2024-09-18T01:26:26.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/2154286151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bfee4b0 msgr2=0x56311bfee8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 --2- 172.21.15.100:0/2154286151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bfee4b0 0x56311bfee8d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe0f805cfd0 tx=0x7fe0f8065e80 comp rx=0 tx=0).stop 2024-09-18T01:26:26.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/2154286151 shutdown_connections 2024-09-18T01:26:26.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 --2- 172.21.15.100:0/2154286151 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfe0036b90 0x7fdfe0039050 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 --2- 172.21.15.100:0/2154286151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311bfee4b0 0x56311bfee8d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/2154286151 >> 172.21.15.100:0/2154286151 conn(0x56311bfe3440 msgr2=0x56311bfe5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/2154286151 shutdown_connections 2024-09-18T01:26:26.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/2154286151 wait complete. 2024-09-18T01:26:26.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56311bfddc90 msgr2=0x56311bfe0080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x56311bfddc90 0x56311bfe0080 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56311bedcb60 msgr2=0x56311bfd7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56311bedcb60 0x56311bfd7420 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56311bfd9da0 msgr2=0x56311bfdc190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56311bfd9da0 0x56311bfdc190 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfec036b40 msgr2=0x7fdfec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfec036b40 0x7fdfec039000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0000f60 tx=0x7fe0f0001370 comp rx=0 tx=0).stop 2024-09-18T01:26:26.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 msgr2=0x56311bfd03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:26.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 --2- 172.21.15.100:0/3211571368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311be4adf0 0x56311bfd03b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8025da0 tx=0x7fe0f8002fb0 comp rx=0 tx=0).stop 2024-09-18T01:26:26.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe107801640 1 -- 172.21.15.100:0/3211571368 reap_dead start 2024-09-18T01:26:26.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 shutdown_connections 2024-09-18T01:26:26.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 >> 172.21.15.100:0/3211571368 conn(0x56311bed1dd0 msgr2=0x56311bfc2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:26.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 shutdown_connections 2024-09-18T01:26:26.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:26.944+0000 7fe10950c800 1 -- 172.21.15.100:0/3211571368 wait complete. 2024-09-18T01:26:26.956 INFO:teuthology.orchestra.run.smithi100.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-09-18T01:26:26.956 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-18T01:26:26.957 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-18T01:26:26.957 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-18T01:26:26.957 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-18T01:26:27.009 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:26:27.009 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:26:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.008+0000 7f087e331800 1 Processor -- start 2024-09-18T01:26:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.008+0000 7f087e331800 1 -- start start 2024-09-18T01:26:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.008+0000 7f087e331800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55a68b8408a0 0x55a68b842cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.008+0000 7f087e331800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a68b6fbb30 con 0x55a68b7afed0 2024-09-18T01:26:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.008+0000 7f087e331800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55a68b6dd360 con 0x55a68b8408a0 2024-09-18T01:26:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.008+0000 7f0873fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55a68b8408a0 0x55a68b842cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.008+0000 7f087a024640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55a68b7afed0 0x55a68b83f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:51728/0 (socket says 172.21.15.100:51728) 2024-09-18T01:26:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.008+0000 7f087a024640 1 -- 172.21.15.100:0/1850257276 learned_addr learned my addr 172.21.15.100:0/1850257276 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:26:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.008+0000 7f0873fff640 1 -- 172.21.15.100:0/1850257276 >> v1:172.21.15.92:6789/0 conn(0x55a68b7afed0 legacy=0x55a68b83f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.008+0000 7f0873fff640 1 -- 172.21.15.100:0/1850257276 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a68b703e00 con 0x55a68b8408a0 2024-09-18T01:26:27.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.010+0000 7f0873fff640 1 --2- 172.21.15.100:0/1850257276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b8408a0 0x55a68b842cb0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f086400a470 tx=0x7f0864045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330aa08f313c4dfd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.010+0000 7f0879823640 1 -- 172.21.15.100:0/1850257276 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0864053570 con 0x55a68b8408a0 2024-09-18T01:26:27.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.011+0000 7f0879823640 1 -- 172.21.15.100:0/1850257276 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0864058070 con 0x55a68b8408a0 2024-09-18T01:26:27.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.011+0000 7f0879823640 1 -- 172.21.15.100:0/1850257276 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0864053880 con 0x55a68b8408a0 2024-09-18T01:26:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.011+0000 7f087e331800 1 -- 172.21.15.100:0/1850257276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b8408a0 msgr2=0x55a68b842cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.011+0000 7f087e331800 1 --2- 172.21.15.100:0/1850257276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b8408a0 0x55a68b842cb0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f086400a470 tx=0x7f0864045a20 comp rx=0 tx=0).stop 2024-09-18T01:26:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.011+0000 7f087e331800 1 -- 172.21.15.100:0/1850257276 shutdown_connections 2024-09-18T01:26:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.011+0000 7f087e331800 1 --2- 172.21.15.100:0/1850257276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b8408a0 0x55a68b842cb0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.011+0000 7f087e331800 1 -- 172.21.15.100:0/1850257276 >> 172.21.15.100:0/1850257276 conn(0x55a68b836e30 msgr2=0x55a68b839250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.011+0000 7f087e331800 1 -- 172.21.15.100:0/1850257276 shutdown_connections 2024-09-18T01:26:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.011+0000 7f087e331800 1 -- 172.21.15.100:0/1850257276 wait complete. 2024-09-18T01:26:27.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.024+0000 7f087e331800 1 Processor -- start 2024-09-18T01:26:27.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.025+0000 7f087e331800 1 -- start start 2024-09-18T01:26:27.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.025+0000 7f087e331800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b7afed0 0x55a68b92b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.025+0000 7f087e331800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a68b788370 con 0x55a68b7afed0 2024-09-18T01:26:27.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.025+0000 7f087a024640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b7afed0 0x55a68b92b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.025+0000 7f087a024640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b7afed0 0x55a68b92b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44852/0 (socket says 172.21.15.100:44852) 2024-09-18T01:26:27.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.025+0000 7f087a024640 1 -- 172.21.15.100:0/3429982387 learned_addr learned my addr 172.21.15.100:0/3429982387 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:27.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.025+0000 7f087a024640 1 -- 172.21.15.100:0/3429982387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a68b6d5bc0 con 0x55a68b7afed0 2024-09-18T01:26:27.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087a024640 1 --2- 172.21.15.100:0/3429982387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b7afed0 0x55a68b92b970 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f086c001e10 tx=0x7f086c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbe651a9ac980cd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f0768608640 1 -- 172.21.15.100:0/3429982387 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086c012020 con 0x55a68b7afed0 2024-09-18T01:26:27.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f0768608640 1 -- 172.21.15.100:0/3429982387 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f086c00e5a0 con 0x55a68b7afed0 2024-09-18T01:26:27.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f0768608640 1 -- 172.21.15.100:0/3429982387 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086c00e8e0 con 0x55a68b7afed0 2024-09-18T01:26:27.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087e331800 1 -- 172.21.15.100:0/3429982387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b7afed0 msgr2=0x55a68b92b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087e331800 1 --2- 172.21.15.100:0/3429982387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b7afed0 0x55a68b92b970 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f086c001e10 tx=0x7f086c00b780 comp rx=0 tx=0).stop 2024-09-18T01:26:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087e331800 1 -- 172.21.15.100:0/3429982387 shutdown_connections 2024-09-18T01:26:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087e331800 1 --2- 172.21.15.100:0/3429982387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b7afed0 0x55a68b92b970 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087e331800 1 -- 172.21.15.100:0/3429982387 >> 172.21.15.100:0/3429982387 conn(0x55a68b836e30 msgr2=0x55a68b927330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087e331800 1 -- 172.21.15.100:0/3429982387 shutdown_connections 2024-09-18T01:26:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087e331800 1 -- 172.21.15.100:0/3429982387 wait complete. 2024-09-18T01:26:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087e331800 1 Processor -- start 2024-09-18T01:26:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087e331800 1 -- start start 2024-09-18T01:26:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087e331800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b7afed0 0x55a68b933350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087e331800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a68b843630 con 0x55a68b7afed0 2024-09-18T01:26:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087a024640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b7afed0 0x55a68b933350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087a024640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b7afed0 0x55a68b933350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44866/0 (socket says 172.21.15.100:44866) 2024-09-18T01:26:27.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.027+0000 7f087a024640 1 -- 172.21.15.100:0/1256622142 learned_addr learned my addr 172.21.15.100:0/1256622142 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.028+0000 7f087a024640 1 -- 172.21.15.100:0/1256622142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a68b6e9fe0 con 0x55a68b7afed0 2024-09-18T01:26:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.028+0000 7f087a024640 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b7afed0 0x55a68b933350 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f086c00b7c0 tx=0x7f086c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.028+0000 7f0766e05640 1 -- 172.21.15.100:0/1256622142 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086c012030 con 0x55a68b7afed0 2024-09-18T01:26:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.028+0000 7f0766e05640 1 -- 172.21.15.100:0/1256622142 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f086c001470 con 0x55a68b7afed0 2024-09-18T01:26:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.028+0000 7f0766e05640 1 -- 172.21.15.100:0/1256622142 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086c01a8d0 con 0x55a68b7afed0 2024-09-18T01:26:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.028+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a68b933890 con 0x55a68b7afed0 2024-09-18T01:26:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.028+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a68b933db0 con 0x55a68b7afed0 2024-09-18T01:26:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.029+0000 7f0766e05640 1 -- 172.21.15.100:0/1256622142 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f086c015020 con 0x55a68b7afed0 2024-09-18T01:26:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.029+0000 7f0766e05640 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0760036b40 0x7f0760039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.029+0000 7f0766e05640 1 -- 172.21.15.100:0/1256622142 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f086c020030 con 0x55a68b7afed0 2024-09-18T01:26:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.029+0000 7f0873fff640 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0760036b40 0x7f0760039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.029+0000 7f087e331800 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a68b8408a0 0x55a68b93a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.029+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b93a990 con 0x55a68b8408a0 2024-09-18T01:26:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.029+0000 7f087a825640 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a68b8408a0 0x55a68b93a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.030+0000 7f0873fff640 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0760036b40 0x7f0760039000 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0864057000 tx=0x7f0864052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.030+0000 7f087a825640 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a68b8408a0 0x55a68b93a3c0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.030+0000 7f087a825640 1 -- 172.21.15.100:0/1256622142 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b8408a0 2024-09-18T01:26:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.030+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b937990 con 0x55a68b8408a0 2024-09-18T01:26:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.030+0000 7f087a825640 1 -- 172.21.15.100:0/1256622142 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b8408a0 2024-09-18T01:26:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.030+0000 7f087e331800 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a68b93cca0 0x55a68b93f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.030+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b93f730 con 0x55a68b93cca0 2024-09-18T01:26:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.030+0000 7f087a024640 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a68b93cca0 0x55a68b93f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.031+0000 7f087a024640 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a68b93cca0 0x55a68b93f090 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.031+0000 7f087a024640 1 -- 172.21.15.100:0/1256622142 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f086c02dcf0 con 0x55a68b93cca0 2024-09-18T01:26:27.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.031+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b93bb40 con 0x55a68b8408a0 2024-09-18T01:26:27.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.031+0000 7f087a825640 1 -- 172.21.15.100:0/1256622142 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b8408a0 2024-09-18T01:26:27.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.031+0000 7f087e331800 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a68b940b90 0x55a68b942f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.031+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b943680 con 0x55a68b940b90 2024-09-18T01:26:27.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.032+0000 7f0873fff640 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a68b940b90 0x55a68b942f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.032+0000 7f0873fff640 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a68b940b90 0x55a68b942f80 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.032+0000 7f0873fff640 1 -- 172.21.15.100:0/1256622142 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0864051070 con 0x55a68b940b90 2024-09-18T01:26:27.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.033+0000 7f087e331800 1 Processor -- start 2024-09-18T01:26:27.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.033+0000 7f087e331800 1 -- start start 2024-09-18T01:26:27.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.033+0000 7f087e331800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b9513f0 0x55a68b951810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.033+0000 7f087e331800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a68b6d7580 con 0x55a68b9513f0 2024-09-18T01:26:27.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.033+0000 7f087a024640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b9513f0 0x55a68b951810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.033+0000 7f087a024640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b9513f0 0x55a68b951810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44870/0 (socket says 172.21.15.100:44870) 2024-09-18T01:26:27.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.033+0000 7f087a024640 1 -- 172.21.15.100:0/4186929255 learned_addr learned my addr 172.21.15.100:0/4186929255 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:27.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.034+0000 7f087a024640 1 -- 172.21.15.100:0/4186929255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a68b951d50 con 0x55a68b9513f0 2024-09-18T01:26:27.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.034+0000 7f087a024640 1 --2- 172.21.15.100:0/4186929255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b9513f0 0x55a68b951810 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f086c04b1b0 tx=0x7f086c00db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.034+0000 7f075ffff640 1 -- 172.21.15.100:0/4186929255 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086c03c070 con 0x55a68b9513f0 2024-09-18T01:26:27.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.034+0000 7f075ffff640 1 -- 172.21.15.100:0/4186929255 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f086c017c50 con 0x55a68b9513f0 2024-09-18T01:26:27.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.034+0000 7f075ffff640 1 -- 172.21.15.100:0/4186929255 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086c01ac50 con 0x55a68b9513f0 2024-09-18T01:26:27.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.034+0000 7f087e331800 1 -- 172.21.15.100:0/4186929255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a68b951fe0 con 0x55a68b9513f0 2024-09-18T01:26:27.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.034+0000 7f087e331800 1 -- 172.21.15.100:0/4186929255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a68b951fe0 con 0x55a68b9513f0 2024-09-18T01:26:27.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.035+0000 7f075ffff640 1 -- 172.21.15.100:0/4186929255 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f086c03f070 con 0x55a68b9513f0 2024-09-18T01:26:27.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.035+0000 7f075ffff640 1 --2- 172.21.15.100:0/4186929255 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0754036b40 0x7f0754039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.035+0000 7f075ffff640 1 -- 172.21.15.100:0/4186929255 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f086c039250 con 0x55a68b9513f0 2024-09-18T01:26:27.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.035+0000 7f0873fff640 1 --2- 172.21.15.100:0/4186929255 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0754036b40 0x7f0754039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.035+0000 7f087e331800 1 Processor -- start 2024-09-18T01:26:27.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.035+0000 7f087e331800 1 -- start start 2024-09-18T01:26:27.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.035+0000 7f0873fff640 1 --2- 172.21.15.100:0/4186929255 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0754036b40 0x7f0754039000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55a68b9378b0 tx=0x7f0864005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.035+0000 7f087e331800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b95dcc0 0x55a68b95e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.035+0000 7f087e331800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a68b92c120 con 0x55a68b95dcc0 2024-09-18T01:26:27.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.036+0000 7f087a024640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b95dcc0 0x55a68b95e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.036+0000 7f087a024640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b95dcc0 0x55a68b95e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44876/0 (socket says 172.21.15.100:44876) 2024-09-18T01:26:27.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.036+0000 7f087a024640 1 -- 172.21.15.100:0/3050343521 learned_addr learned my addr 172.21.15.100:0/3050343521 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:27.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.036+0000 7f087a024640 1 -- 172.21.15.100:0/3050343521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a68b95e690 con 0x55a68b95dcc0 2024-09-18T01:26:27.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.036+0000 7f087a024640 1 --2- 172.21.15.100:0/3050343521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b95dcc0 0x55a68b95e0c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f086c024560 tx=0x7f086c0428d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ac4c5b18e1f265 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.036+0000 7f075dffb640 1 -- 172.21.15.100:0/3050343521 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086c042d90 con 0x55a68b95dcc0 2024-09-18T01:26:27.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.036+0000 7f075dffb640 1 -- 172.21.15.100:0/3050343521 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f086c039080 con 0x55a68b95dcc0 2024-09-18T01:26:27.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.036+0000 7f075dffb640 1 -- 172.21.15.100:0/3050343521 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086c03f5f0 con 0x55a68b95dcc0 2024-09-18T01:26:27.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.037+0000 7f087e331800 1 -- 172.21.15.100:0/3050343521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b95dcc0 msgr2=0x55a68b95e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.037+0000 7f087e331800 1 --2- 172.21.15.100:0/3050343521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b95dcc0 0x55a68b95e0c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f086c024560 tx=0x7f086c0428d0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.037+0000 7f087e331800 1 -- 172.21.15.100:0/3050343521 shutdown_connections 2024-09-18T01:26:27.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.037+0000 7f087e331800 1 --2- 172.21.15.100:0/3050343521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b95dcc0 0x55a68b95e0c0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.037+0000 7f087e331800 1 -- 172.21.15.100:0/3050343521 >> 172.21.15.100:0/3050343521 conn(0x55a68b95a020 msgr2=0x55a68b958120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:27.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.037+0000 7f087e331800 1 -- 172.21.15.100:0/3050343521 shutdown_connections 2024-09-18T01:26:27.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.037+0000 7f087e331800 1 -- 172.21.15.100:0/3050343521 wait complete. 2024-09-18T01:26:27.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.037+0000 7f087e331800 1 Processor -- start 2024-09-18T01:26:27.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.037+0000 7f087e331800 1 -- start start 2024-09-18T01:26:27.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.037+0000 7f087e331800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b95dcc0 0x55a68b964ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.037+0000 7f087e331800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a68b95ec50 con 0x55a68b95dcc0 2024-09-18T01:26:27.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.037+0000 7f087a024640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b95dcc0 0x55a68b964ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.037+0000 7f087a024640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b95dcc0 0x55a68b964ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44886/0 (socket says 172.21.15.100:44886) 2024-09-18T01:26:27.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.037+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 learned_addr learned my addr 172.21.15.100:0/1029775243 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:27.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.038+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a68b965530 con 0x55a68b95dcc0 2024-09-18T01:26:27.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.038+0000 7f087a024640 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b95dcc0 0x55a68b964ff0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f086c024560 tx=0x7f086c04eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.038+0000 7f074bfff640 1 -- 172.21.15.100:0/1029775243 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086c042bb0 con 0x55a68b95dcc0 2024-09-18T01:26:27.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.038+0000 7f074bfff640 1 -- 172.21.15.100:0/1029775243 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f086c04ba30 con 0x55a68b95dcc0 2024-09-18T01:26:27.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.038+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a68b965530 con 0x55a68b95dcc0 2024-09-18T01:26:27.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.038+0000 7f074bfff640 1 -- 172.21.15.100:0/1029775243 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086c03fcd0 con 0x55a68b95dcc0 2024-09-18T01:26:27.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.038+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a68b965530 con 0x55a68b95dcc0 2024-09-18T01:26:27.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.039+0000 7f074bfff640 1 -- 172.21.15.100:0/1029775243 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f086c04bc10 con 0x55a68b95dcc0 2024-09-18T01:26:27.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.039+0000 7f074bfff640 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0744036aa0 0x7f0744038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.039+0000 7f074bfff640 1 -- 172.21.15.100:0/1029775243 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f086c06ed40 con 0x55a68b95dcc0 2024-09-18T01:26:27.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.039+0000 7f0873fff640 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0744036aa0 0x7f0744038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.039+0000 7f0873fff640 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0744036aa0 0x7f0744038f60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0864053570 tx=0x7f0864053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.040+0000 7f087e331800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.040+0000 7f087e331800 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a68b970680 0x55a68b972b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.040+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b973290 con 0x55a68b970680 2024-09-18T01:26:27.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.040+0000 7f087a825640 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a68b970680 0x55a68b972b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.040+0000 7f087a825640 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a68b970680 0x55a68b972b40 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.040+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.040+0000 7f087e331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.040+0000 7f087e331800 20 realm 2024-09-18T01:26:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.040+0000 7f087e331800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.040+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9736a0 con 0x55a68b970680 2024-09-18T01:26:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.040+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087e331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087e331800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:26:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087e331800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b973f70 con 0x55a68b970680 2024-09-18T01:26:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087e331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087e331800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b970680 2024-09-18T01:26:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087e331800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087e331800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087e331800 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a68b975070 0x55a68b977460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b977a70 con 0x55a68b975070 2024-09-18T01:26:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087a024640 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a68b975070 0x55a68b977460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.041+0000 7f087a024640 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a68b975070 0x55a68b977460 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.042+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.042+0000 7f087e331800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:26:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.042+0000 7f087e331800 20 searching for the correct realm 2024-09-18T01:26:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.042+0000 7f087e331800 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a68b979a20 0x55a68b97bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.042+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b97c5b0 con 0x55a68b979a20 2024-09-18T01:26:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.042+0000 7f0873fff640 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a68b979a20 0x55a68b97bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.042+0000 7f0873fff640 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a68b979a20 0x55a68b97bee0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.042+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0864051070 con 0x55a68b979a20 2024-09-18T01:26:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.042+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b97c5b0 con 0x55a68b975070 2024-09-18T01:26:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.043+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.043+0000 7f087a024640 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f086c017050 0x7f086c039710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.043+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b97c5b0 con 0x7f086c017050 2024-09-18T01:26:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.043+0000 7f087a825640 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f086c017050 0x7f086c039710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.043+0000 7f087a825640 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f086c017050 0x7f086c039710 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.044+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.044+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b970680 2024-09-18T01:26:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.044+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.044+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b970680 2024-09-18T01:26:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.044+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.044+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x7f086c017050 2024-09-18T01:26:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.044+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.044+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x7f086c017050 2024-09-18T01:26:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.044+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.045+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b975070 2024-09-18T01:26:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.045+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.045+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b979a20 2024-09-18T01:26:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.045+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0864051070 con 0x55a68b979a20 2024-09-18T01:26:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.045+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b970680 2024-09-18T01:26:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.045+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.045+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b975070 2024-09-18T01:26:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.045+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.045+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b970680 2024-09-18T01:26:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.046+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.046+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b975070 2024-09-18T01:26:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.046+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.046+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b979a20 2024-09-18T01:26:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.046+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0864051070 con 0x55a68b979a20 2024-09-18T01:26:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.046+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b979a20 2024-09-18T01:26:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.046+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0864051070 con 0x55a68b979a20 2024-09-18T01:26:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.046+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x7f086c017050 2024-09-18T01:26:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.047+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.047+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b979a20 2024-09-18T01:26:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.047+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0864051070 con 0x55a68b979a20 2024-09-18T01:26:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.047+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b979a20 2024-09-18T01:26:27.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.047+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0864051070 con 0x55a68b979a20 2024-09-18T01:26:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.047+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b970680 2024-09-18T01:26:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.047+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.047+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b970680 2024-09-18T01:26:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.048+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.048+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x7f086c017050 2024-09-18T01:26:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.048+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.048+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b979a20 2024-09-18T01:26:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.048+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0864051070 con 0x55a68b979a20 2024-09-18T01:26:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.048+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b975070 2024-09-18T01:26:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.048+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.048+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b970680 2024-09-18T01:26:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.049+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.049+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x7f086c017050 2024-09-18T01:26:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.049+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.049+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b979a20 2024-09-18T01:26:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.049+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0864051070 con 0x55a68b979a20 2024-09-18T01:26:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.049+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b975070 2024-09-18T01:26:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.049+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.049+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b975070 2024-09-18T01:26:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.050+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.050+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b979a20 2024-09-18T01:26:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.050+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0864051070 con 0x55a68b979a20 2024-09-18T01:26:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.050+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x7f086c017050 2024-09-18T01:26:27.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.050+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.050+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b970680 2024-09-18T01:26:27.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.050+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.050+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a68b974310 con 0x55a68b975070 2024-09-18T01:26:27.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087e331800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:26:27.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087e331800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:26:27.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087e331800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:26:27.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087e331800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:26:27.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087e331800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:26:27.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087e331800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:26:27.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087e331800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b978330 con 0x55a68b970680 2024-09-18T01:26:27.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087e331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087e331800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b978720 con 0x55a68b970680 2024-09-18T01:26:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087e331800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087e331800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.051+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b978720 con 0x7f086c017050 2024-09-18T01:26:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:26:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 20 zone default found 2024-09-18T01:26:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 4 Realm: () 2024-09-18T01:26:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:26:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:26:27.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:26:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 20 zonegroup default 2024-09-18T01:26:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b97ca30 con 0x7f086c017050 2024-09-18T01:26:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b97e410 con 0x55a68b979a20 2024-09-18T01:26:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0864051070 con 0x55a68b979a20 2024-09-18T01:26:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b97e7b0 con 0x55a68b979a20 2024-09-18T01:26:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0864051070 con 0x55a68b979a20 2024-09-18T01:26:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 20 started sync module instance, tier type = 2024-09-18T01:26:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:26:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.052+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b97d8b0 con 0x55a68b975070 2024-09-18T01:26:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.053+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.053+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94173794915328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b97eb50 con 0x55a68b975070 2024-09-18T01:26:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.053+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b97f400 con 0x55a68b970680 2024-09-18T01:26:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.054+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94173794915328] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.055+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.055+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94173794922224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b97f7f0 con 0x55a68b970680 2024-09-18T01:26:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.055+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b980210 con 0x55a68b979a20 2024-09-18T01:26:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.056+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94173794922224] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.056+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0864051070 con 0x55a68b979a20 2024-09-18T01:26:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.056+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94173794925824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9805b0 con 0x55a68b979a20 2024-09-18T01:26:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.056+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b981070 con 0x55a68b975070 2024-09-18T01:26:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.057+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.057+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94173794931808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b981d30 con 0x55a68b975070 2024-09-18T01:26:27.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.057+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b982790 con 0x55a68b970680 2024-09-18T01:26:27.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.057+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94173794925824] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0864051070 con 0x55a68b979a20 2024-09-18T01:26:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.058+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.059+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94173794917584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b982790 con 0x55a68b970680 2024-09-18T01:26:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.059+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94173794931808] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.059+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b982cf0 con 0x7f086c017050 2024-09-18T01:26:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.060+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.060+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94173794932864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b982cf0 con 0x7f086c017050 2024-09-18T01:26:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.060+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b983c10 con 0x7f086c017050 2024-09-18T01:26:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.060+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94173794917584] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.061+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94173794932864] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.061+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.061+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94173794939104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b982270 con 0x7f086c017050 2024-09-18T01:26:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.061+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9841f0 con 0x7f086c017050 2024-09-18T01:26:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.062+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(58 notify.7 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.062+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94173794942272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b984610 con 0x7f086c017050 2024-09-18T01:26:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.062+0000 7f087e331800 20 add_watcher() i=0 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.062+0000 7f087e331800 20 add_watcher() i=1 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.062+0000 7f087e331800 20 add_watcher() i=2 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.062+0000 7f087e331800 20 add_watcher() i=3 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.062+0000 7f087e331800 20 add_watcher() i=4 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.062+0000 7f087e331800 20 add_watcher() i=5 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.062+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94173794939104] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.062+0000 7f087e331800 20 add_watcher() i=6 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.063+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94173794942272] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.063+0000 7f087e331800 20 add_watcher() i=7 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.063+0000 7f087e331800 2 all 8 watchers are set, enabling cache 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.063+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b987640 con 0x55a68b970680 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.064+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.064+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94173794943328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b984a30 con 0x55a68b970680 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.065+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94173794943328] v35'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.065+0000 7f0730fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.065+0000 7f087e331800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:26:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.065+0000 7f087e331800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:26:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.065+0000 7f087e331800 5 note: GC not initialized 2024-09-18T01:26:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.065+0000 7f06ab7fe640 20 reqs_thread_entry: start 2024-09-18T01:26:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.065+0000 7f087e331800 20 init_complete bucket index max shards: 11 2024-09-18T01:26:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.065+0000 7f087e331800 20 Filter name: none 2024-09-18T01:26:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.065+0000 7f06a97fa640 20 reqs_thread_entry: start 2024-09-18T01:26:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.065+0000 7f087e331800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-18T01:26:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.065+0000 7f087e331800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.065+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9ba960 con 0x7f086c017050 2024-09-18T01:26:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.066+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.066+0000 7f087e331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.066+0000 7f087e331800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-18T01:26:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.066+0000 7f087e331800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T01:26:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.066+0000 7f087e331800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-18T01:26:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.066+0000 7f087e331800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.066+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9b8fa0 con 0x55a68b970680 2024-09-18T01:26:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.066+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.066+0000 7f087e331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.066+0000 7f087e331800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-18T01:26:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.066+0000 7f087e331800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T01:26:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.066+0000 7f087e331800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-18T01:26:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.066+0000 7f087e331800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-18T01:26:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.066+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9b9890 con 0x7f086c017050 2024-09-18T01:26:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.068+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v35'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.068+0000 7f087e331800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.068+0000 7f087e331800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.068+0000 7f087e331800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.068+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94173795161056 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9be400 con 0x7f086c017050 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.068+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== watch-notify(notify (1) cookie 94173794942272 notify 150323855374 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55a68b9b9c30 con 0x7f086c017050 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.068+0000 7f075dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855374 cookie 94173794942272 notifier 4734 bl.length()=556 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.068+0000 7f075dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.068+0000 7f075dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.068+0000 7f075dffb640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f0740003ea0 con 0x7f086c017050 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.068+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(65 notify.7 [notify cookie 94173795161056 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.068+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.068+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== watch-notify(notify_complete (2) cookie 94173795161056 notify 150323855374 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a68b9ba3b0 con 0x7f086c017050 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.068+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9b9390 con 0x55a68b970680 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.069+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.069+0000 7f087e331800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-18T01:26:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.069+0000 7f087e331800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T01:26:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.069+0000 7f087e331800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-18T01:26:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.069+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94173795160976 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9be4e0 con 0x7f086c017050 2024-09-18T01:26:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.070+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== watch-notify(notify (1) cookie 94173794932864 notify 150323855375 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55a68b9ba3b0 con 0x7f086c017050 2024-09-18T01:26:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.070+0000 7f075d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855375 cookie 94173794932864 notifier 4734 bl.length()=177 2024-09-18T01:26:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.070+0000 7f075d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-18T01:26:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.070+0000 7f075d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T01:26:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.070+0000 7f075d7fa640 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f06b0003400 con 0x7f086c017050 2024-09-18T01:26:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.070+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(68 notify.5 [notify cookie 94173795160976 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.070+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.070+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== watch-notify(notify_complete (2) cookie 94173795160976 notify 150323855375 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0874026410 con 0x7f086c017050 2024-09-18T01:26:27.084 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-18T01:26:27.068548Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:26:27.068537Z","tags":[],"group_ids":[]} 2024-09-18T01:26:27.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.071+0000 7f0730fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:27.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.071+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94173794943328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9b8620 con 0x55a68b970680 2024-09-18T01:26:27.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.072+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94173794943328] v35'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.072+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94173794915328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9b8620 con 0x55a68b975070 2024-09-18T01:26:27.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.073+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94173794915328] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.073+0000 7f087e331800 20 remove_watcher() i=0 2024-09-18T01:26:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.073+0000 7f087e331800 2 removed watcher, disabling cache 2024-09-18T01:26:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.073+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94173794922224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9b8620 con 0x55a68b970680 2024-09-18T01:26:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.074+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94173794922224] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.074+0000 7f087e331800 20 remove_watcher() i=1 2024-09-18T01:26:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.074+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94173794925824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9b8620 con 0x55a68b979a20 2024-09-18T01:26:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.075+0000 7f0873fff640 1 -- 172.21.15.100:0/1029775243 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94173794925824] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0864051070 con 0x55a68b979a20 2024-09-18T01:26:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.075+0000 7f087e331800 20 remove_watcher() i=2 2024-09-18T01:26:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.075+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94173794931808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b97d400 con 0x55a68b975070 2024-09-18T01:26:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.076+0000 7f087a024640 1 -- 172.21.15.100:0/1029775243 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94173794931808] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f086c073020 con 0x55a68b975070 2024-09-18T01:26:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.076+0000 7f087e331800 20 remove_watcher() i=3 2024-09-18T01:26:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.076+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94173794917584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b97eef0 con 0x55a68b970680 2024-09-18T01:26:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.078+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94173794917584] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x55a68b970680 2024-09-18T01:26:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.078+0000 7f087e331800 20 remove_watcher() i=4 2024-09-18T01:26:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.078+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94173794932864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b97d400 con 0x7f086c017050 2024-09-18T01:26:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.079+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94173794932864] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.079+0000 7f087e331800 20 remove_watcher() i=5 2024-09-18T01:26:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.079+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94173794939104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9818c0 con 0x7f086c017050 2024-09-18T01:26:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.080+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94173794939104] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.080+0000 7f087e331800 20 remove_watcher() i=6 2024-09-18T01:26:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.080+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94173794942272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a68b9818c0 con 0x7f086c017050 2024-09-18T01:26:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94173794942272] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087400a4a0 con 0x7f086c017050 2024-09-18T01:26:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 20 remove_watcher() i=7 2024-09-18T01:26:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f086c017050 msgr2=0x7f086c039710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f086c017050 0x7f086c039710 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a68b970680 msgr2=0x55a68b972b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a68b970680 0x55a68b972b40 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a68b975070 msgr2=0x55a68b977460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a68b975070 0x55a68b977460 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a68b979a20 msgr2=0x55a68b97bee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55a68b979a20 0x55a68b97bee0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0744036aa0 msgr2=0x7f0744038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0744036aa0 0x7f0744038f60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0864053570 tx=0x7f0864053000 comp rx=0 tx=0).stop 2024-09-18T01:26:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b95dcc0 msgr2=0x55a68b964ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b95dcc0 0x55a68b964ff0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f086c024560 tx=0x7f086c04eef0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087a825640 1 -- 172.21.15.100:0/1029775243 reap_dead start 2024-09-18T01:26:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 shutdown_connections 2024-09-18T01:26:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 --2- 172.21.15.100:0/1029775243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b95dcc0 0x55a68b964ff0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 >> 172.21.15.100:0/1029775243 conn(0x55a68b95a020 msgr2=0x55a68b9580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 shutdown_connections 2024-09-18T01:26:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.081+0000 7f087e331800 1 -- 172.21.15.100:0/1029775243 wait complete. 2024-09-18T01:26:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/4186929255 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0754036b40 msgr2=0x7f0754039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 --2- 172.21.15.100:0/4186929255 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0754036b40 0x7f0754039000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55a68b9378b0 tx=0x7f0864005a00 comp rx=0 tx=0).stop 2024-09-18T01:26:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/4186929255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b9513f0 msgr2=0x55a68b951810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 --2- 172.21.15.100:0/4186929255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b9513f0 0x55a68b951810 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f086c04b1b0 tx=0x7f086c00db20 comp rx=0 tx=0).stop 2024-09-18T01:26:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/4186929255 shutdown_connections 2024-09-18T01:26:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 --2- 172.21.15.100:0/4186929255 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0754036b40 0x7f0754039000 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 --2- 172.21.15.100:0/4186929255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b9513f0 0x55a68b951810 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/4186929255 >> 172.21.15.100:0/4186929255 conn(0x55a68b946380 msgr2=0x55a68b948f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/4186929255 shutdown_connections 2024-09-18T01:26:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/4186929255 wait complete. 2024-09-18T01:26:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a68b940b90 msgr2=0x55a68b942f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55a68b940b90 0x55a68b942f80 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a68b8408a0 msgr2=0x55a68b93a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55a68b8408a0 0x55a68b93a3c0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a68b93cca0 msgr2=0x55a68b93f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55a68b93cca0 0x55a68b93f090 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0760036b40 msgr2=0x7f0760039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0760036b40 0x7f0760039000 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0864057000 tx=0x7f0864052000 comp rx=0 tx=0).stop 2024-09-18T01:26:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b7afed0 msgr2=0x55a68b933350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 --2- 172.21.15.100:0/1256622142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a68b7afed0 0x55a68b933350 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f086c00b7c0 tx=0x7f086c000ed0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087a825640 1 -- 172.21.15.100:0/1256622142 reap_dead start 2024-09-18T01:26:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 shutdown_connections 2024-09-18T01:26:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 >> 172.21.15.100:0/1256622142 conn(0x55a68b836e30 msgr2=0x55a68b925be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 shutdown_connections 2024-09-18T01:26:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.082+0000 7f087e331800 1 -- 172.21.15.100:0/1256622142 wait complete. 2024-09-18T01:26:27.094 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-18T01:26:27.068548Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:26:27.068537Z', 'tags': [], 'group_ids': []} 2024-09-18T01:26:27.109 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:26:27.114 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-18T01:26:27.114 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-18T01:26:27.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-18T01:26:27.114 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-18T01:26:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:26:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:26:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.159+0000 7f4452132800 1 Processor -- start 2024-09-18T01:26:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.159+0000 7f4452132800 1 -- start start 2024-09-18T01:26:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.159+0000 7f4452132800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560eae930e30 0x560eae9c01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.159+0000 7f4452132800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560eae87cb30 con 0x560eae9c0720 2024-09-18T01:26:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.159+0000 7f4452132800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x560eae85e360 con 0x560eae930e30 2024-09-18T01:26:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.159+0000 7f444de80640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560eae930e30 0x560eae9c01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.159+0000 7f444de80640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560eae930e30 0x560eae9c01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44890/0 (socket says 172.21.15.100:44890) 2024-09-18T01:26:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.159+0000 7f444de80640 1 -- 172.21.15.100:0/1208309530 learned_addr learned my addr 172.21.15.100:0/1208309530 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.159+0000 7f4447fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x560eae9c0720 0x560eae9c2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:51744/0 (socket says 172.21.15.100:51744) 2024-09-18T01:26:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.160+0000 7f444de80640 1 -- 172.21.15.100:0/1208309530 >> v1:172.21.15.92:6789/0 conn(0x560eae9c0720 legacy=0x560eae9c2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.160+0000 7f444de80640 1 -- 172.21.15.100:0/1208309530 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eae884e00 con 0x560eae930e30 2024-09-18T01:26:27.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.161+0000 7f444de80640 1 --2- 172.21.15.100:0/1208309530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 0x560eae9c01e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f444000a520 tx=0x7f4440045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e1e9df63fec66e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.163+0000 7f444d67f640 1 -- 172.21.15.100:0/1208309530 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4440055070 con 0x560eae930e30 2024-09-18T01:26:27.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.163+0000 7f444d67f640 1 -- 172.21.15.100:0/1208309530 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44400515b0 con 0x560eae930e30 2024-09-18T01:26:27.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.163+0000 7f444d67f640 1 -- 172.21.15.100:0/1208309530 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44400518d0 con 0x560eae930e30 2024-09-18T01:26:27.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.163+0000 7f4452132800 1 -- 172.21.15.100:0/1208309530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 msgr2=0x560eae9c01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.163+0000 7f4452132800 1 --2- 172.21.15.100:0/1208309530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 0x560eae9c01e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f444000a520 tx=0x7f4440045ba0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.163+0000 7f4452132800 1 -- 172.21.15.100:0/1208309530 shutdown_connections 2024-09-18T01:26:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.163+0000 7f4452132800 1 --2- 172.21.15.100:0/1208309530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 0x560eae9c01e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.163+0000 7f4452132800 1 -- 172.21.15.100:0/1208309530 >> 172.21.15.100:0/1208309530 conn(0x560eae9b7dd0 msgr2=0x560eae9ba1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.163+0000 7f4452132800 1 -- 172.21.15.100:0/1208309530 shutdown_connections 2024-09-18T01:26:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.163+0000 7f4452132800 1 -- 172.21.15.100:0/1208309530 wait complete. 2024-09-18T01:26:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.177+0000 7f4452132800 1 Processor -- start 2024-09-18T01:26:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.177+0000 7f4452132800 1 -- start start 2024-09-18T01:26:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.177+0000 7f4452132800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 0x560eaeaac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.177+0000 7f4452132800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560eae909360 con 0x560eae930e30 2024-09-18T01:26:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.177+0000 7f444de80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 0x560eaeaac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.177+0000 7f444de80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 0x560eaeaac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44896/0 (socket says 172.21.15.100:44896) 2024-09-18T01:26:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.177+0000 7f444de80640 1 -- 172.21.15.100:0/463359379 learned_addr learned my addr 172.21.15.100:0/463359379 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.177+0000 7f444de80640 1 -- 172.21.15.100:0/463359379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eae856bc0 con 0x560eae930e30 2024-09-18T01:26:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.177+0000 7f444de80640 1 --2- 172.21.15.100:0/463359379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 0x560eaeaac880 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4440025da0 tx=0x7f4440051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f776169ff5ba3a38 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.177+0000 7f433be07640 1 -- 172.21.15.100:0/463359379 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4440051890 con 0x560eae930e30 2024-09-18T01:26:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.177+0000 7f433be07640 1 -- 172.21.15.100:0/463359379 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4440051ac0 con 0x560eae930e30 2024-09-18T01:26:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.177+0000 7f433be07640 1 -- 172.21.15.100:0/463359379 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4440051da0 con 0x560eae930e30 2024-09-18T01:26:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.178+0000 7f4452132800 1 -- 172.21.15.100:0/463359379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 msgr2=0x560eaeaac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.178+0000 7f4452132800 1 --2- 172.21.15.100:0/463359379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 0x560eaeaac880 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4440025da0 tx=0x7f4440051000 comp rx=0 tx=0).stop 2024-09-18T01:26:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.178+0000 7f4452132800 1 -- 172.21.15.100:0/463359379 shutdown_connections 2024-09-18T01:26:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.178+0000 7f4452132800 1 --2- 172.21.15.100:0/463359379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 0x560eaeaac880 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.178+0000 7f4452132800 1 -- 172.21.15.100:0/463359379 >> 172.21.15.100:0/463359379 conn(0x560eae9b7dd0 msgr2=0x560eaeaa8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.178+0000 7f4452132800 1 -- 172.21.15.100:0/463359379 shutdown_connections 2024-09-18T01:26:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.178+0000 7f4452132800 1 -- 172.21.15.100:0/463359379 wait complete. 2024-09-18T01:26:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.178+0000 7f4452132800 1 Processor -- start 2024-09-18T01:26:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.178+0000 7f4452132800 1 -- start start 2024-09-18T01:26:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.178+0000 7f4452132800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 0x560eaeab4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.178+0000 7f4452132800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560eae9c4620 con 0x560eae930e30 2024-09-18T01:26:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.178+0000 7f444de80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 0x560eaeab4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.178+0000 7f444de80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 0x560eaeab4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44904/0 (socket says 172.21.15.100:44904) 2024-09-18T01:26:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.178+0000 7f444de80640 1 -- 172.21.15.100:0/2326495529 learned_addr learned my addr 172.21.15.100:0/2326495529 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.179+0000 7f444de80640 1 -- 172.21.15.100:0/2326495529 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eae86afe0 con 0x560eae930e30 2024-09-18T01:26:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.179+0000 7f444de80640 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 0x560eaeab4170 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4440025da0 tx=0x7f4440002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.179+0000 7f433a604640 1 -- 172.21.15.100:0/2326495529 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4440073070 con 0x560eae930e30 2024-09-18T01:26:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.179+0000 7f433a604640 1 -- 172.21.15.100:0/2326495529 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f444005a580 con 0x560eae930e30 2024-09-18T01:26:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.179+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560eaeab46b0 con 0x560eae930e30 2024-09-18T01:26:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.179+0000 7f433a604640 1 -- 172.21.15.100:0/2326495529 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f444005a860 con 0x560eae930e30 2024-09-18T01:26:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.179+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eaeab4c30 con 0x560eae930e30 2024-09-18T01:26:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.180+0000 7f433a604640 1 -- 172.21.15.100:0/2326495529 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4440076070 con 0x560eae930e30 2024-09-18T01:26:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.180+0000 7f433a604640 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4334036b40 0x7f4334039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.180+0000 7f433a604640 1 -- 172.21.15.100:0/2326495529 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4440062070 con 0x560eae930e30 2024-09-18T01:26:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.180+0000 7f4447fff640 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4334036b40 0x7f4334039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.180+0000 7f4452132800 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560eae9c0720 0x560eaeabb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.180+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeabb830 con 0x560eae9c0720 2024-09-18T01:26:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.180+0000 7f444e681640 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560eae9c0720 0x560eaeabb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.181+0000 7f4447fff640 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4334036b40 0x7f4334039000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4438000f60 tx=0x7f4438001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.181+0000 7f444e681640 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560eae9c0720 0x560eaeabb1e0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.181+0000 7f444e681640 1 -- 172.21.15.100:0/2326495529 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eae9c0720 2024-09-18T01:26:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.181+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeab87b0 con 0x560eae9c0720 2024-09-18T01:26:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.181+0000 7f444e681640 1 -- 172.21.15.100:0/2326495529 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f444800a4a0 con 0x560eae9c0720 2024-09-18T01:26:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.181+0000 7f4452132800 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560eaeabdb60 0x560eaeabff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.181+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeac0640 con 0x560eaeabdb60 2024-09-18T01:26:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.182+0000 7f444de80640 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560eaeabdb60 0x560eaeabff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.182+0000 7f444de80640 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560eaeabdb60 0x560eaeabff50 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.182+0000 7f444de80640 1 -- 172.21.15.100:0/2326495529 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f444007f070 con 0x560eaeabdb60 2024-09-18T01:26:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.182+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeabca00 con 0x560eae9c0720 2024-09-18T01:26:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.182+0000 7f444e681640 1 -- 172.21.15.100:0/2326495529 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f444800a4a0 con 0x560eae9c0720 2024-09-18T01:26:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.182+0000 7f4452132800 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560eaeac1aa0 0x560eaeac3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.182+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeac4590 con 0x560eaeac1aa0 2024-09-18T01:26:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.183+0000 7f4447fff640 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560eaeac1aa0 0x560eaeac3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.183+0000 7f4447fff640 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560eaeac1aa0 0x560eaeac3e90 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.183+0000 7f4447fff640 1 -- 172.21.15.100:0/2326495529 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f443800f690 con 0x560eaeac1aa0 2024-09-18T01:26:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.184+0000 7f4452132800 1 Processor -- start 2024-09-18T01:26:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.184+0000 7f4452132800 1 -- start start 2024-09-18T01:26:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.184+0000 7f4452132800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eaead22c0 0x560eaead26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.184+0000 7f4452132800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560eae858580 con 0x560eaead22c0 2024-09-18T01:26:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.184+0000 7f444de80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eaead22c0 0x560eaead26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.184+0000 7f444de80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eaead22c0 0x560eaead26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44916/0 (socket says 172.21.15.100:44916) 2024-09-18T01:26:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.184+0000 7f444de80640 1 -- 172.21.15.100:0/1092066954 learned_addr learned my addr 172.21.15.100:0/1092066954 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.184+0000 7f444de80640 1 -- 172.21.15.100:0/1092066954 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eaead2c20 con 0x560eaead22c0 2024-09-18T01:26:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.185+0000 7f444de80640 1 --2- 172.21.15.100:0/1092066954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eaead22c0 0x560eaead26e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f444005cfd0 tx=0x7f4440065e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.185+0000 7f43337fe640 1 -- 172.21.15.100:0/1092066954 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f444000a020 con 0x560eaead22c0 2024-09-18T01:26:27.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.185+0000 7f43337fe640 1 -- 172.21.15.100:0/1092066954 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f444000a1c0 con 0x560eaead22c0 2024-09-18T01:26:27.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.185+0000 7f43337fe640 1 -- 172.21.15.100:0/1092066954 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f444006e4f0 con 0x560eaead22c0 2024-09-18T01:26:27.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.185+0000 7f4452132800 1 -- 172.21.15.100:0/1092066954 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560eaead2eb0 con 0x560eaead22c0 2024-09-18T01:26:27.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.185+0000 7f4452132800 1 -- 172.21.15.100:0/1092066954 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eaead5b90 con 0x560eaead22c0 2024-09-18T01:26:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.186+0000 7f43337fe640 1 -- 172.21.15.100:0/1092066954 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4440058070 con 0x560eaead22c0 2024-09-18T01:26:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.186+0000 7f43337fe640 1 --2- 172.21.15.100:0/1092066954 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4328036b40 0x7f4328039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.186+0000 7f43337fe640 1 -- 172.21.15.100:0/1092066954 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f444008c040 con 0x560eaead22c0 2024-09-18T01:26:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.186+0000 7f4447fff640 1 --2- 172.21.15.100:0/1092066954 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4328036b40 0x7f4328039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.186+0000 7f4452132800 1 Processor -- start 2024-09-18T01:26:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.186+0000 7f4452132800 1 -- start start 2024-09-18T01:26:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.186+0000 7f4447fff640 1 --2- 172.21.15.100:0/1092066954 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4328036b40 0x7f4328039000 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x560eaeabc110 tx=0x7f443800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.186+0000 7f4452132800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae9bc1d0 0x560eae9bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.186+0000 7f4452132800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560eaeaacf70 con 0x560eae9bc1d0 2024-09-18T01:26:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.186+0000 7f444de80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae9bc1d0 0x560eae9bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.187+0000 7f444de80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae9bc1d0 0x560eae9bc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44918/0 (socket says 172.21.15.100:44918) 2024-09-18T01:26:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.187+0000 7f444de80640 1 -- 172.21.15.100:0/792212225 learned_addr learned my addr 172.21.15.100:0/792212225 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.187+0000 7f444de80640 1 -- 172.21.15.100:0/792212225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eae9bcba0 con 0x560eae9bc1d0 2024-09-18T01:26:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.187+0000 7f444de80640 1 --2- 172.21.15.100:0/792212225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae9bc1d0 0x560eae9bc5d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4440050c00 tx=0x7f4440082b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3761a9f4fcf92e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.187+0000 7f43317fa640 1 -- 172.21.15.100:0/792212225 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4440080950 con 0x560eae9bc1d0 2024-09-18T01:26:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.187+0000 7f43317fa640 1 -- 172.21.15.100:0/792212225 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4440078cc0 con 0x560eae9bc1d0 2024-09-18T01:26:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.187+0000 7f43317fa640 1 -- 172.21.15.100:0/792212225 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4440086ca0 con 0x560eae9bc1d0 2024-09-18T01:26:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f4452132800 1 -- 172.21.15.100:0/792212225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae9bc1d0 msgr2=0x560eae9bc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f4452132800 1 --2- 172.21.15.100:0/792212225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae9bc1d0 0x560eae9bc5d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4440050c00 tx=0x7f4440082b00 comp rx=0 tx=0).stop 2024-09-18T01:26:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f4452132800 1 -- 172.21.15.100:0/792212225 shutdown_connections 2024-09-18T01:26:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f4452132800 1 --2- 172.21.15.100:0/792212225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae9bc1d0 0x560eae9bc5d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f4452132800 1 -- 172.21.15.100:0/792212225 >> 172.21.15.100:0/792212225 conn(0x560eaeadb0b0 msgr2=0x560eaead91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f4452132800 1 -- 172.21.15.100:0/792212225 shutdown_connections 2024-09-18T01:26:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f4452132800 1 -- 172.21.15.100:0/792212225 wait complete. 2024-09-18T01:26:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f4452132800 1 Processor -- start 2024-09-18T01:26:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f4452132800 1 -- start start 2024-09-18T01:26:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f4452132800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae9bc1d0 0x560eaeae81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f4452132800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560eae9bd1b0 con 0x560eae9bc1d0 2024-09-18T01:26:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f444de80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae9bc1d0 0x560eaeae81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f444de80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae9bc1d0 0x560eaeae81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44934/0 (socket says 172.21.15.100:44934) 2024-09-18T01:26:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 learned_addr learned my addr 172.21.15.100:0/4276627578 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.188+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eaeae86f0 con 0x560eae9bc1d0 2024-09-18T01:26:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.189+0000 7f444de80640 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae9bc1d0 0x560eaeae81b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4440080900 tx=0x7f4440090d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.189+0000 7f431f7fe640 1 -- 172.21.15.100:0/4276627578 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44400be070 con 0x560eae9bc1d0 2024-09-18T01:26:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.189+0000 7f431f7fe640 1 -- 172.21.15.100:0/4276627578 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4440078450 con 0x560eae9bc1d0 2024-09-18T01:26:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.189+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560eaeae86f0 con 0x560eae9bc1d0 2024-09-18T01:26:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.189+0000 7f431f7fe640 1 -- 172.21.15.100:0/4276627578 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4440080c10 con 0x560eae9bc1d0 2024-09-18T01:26:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.189+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eaeae86f0 con 0x560eae9bc1d0 2024-09-18T01:26:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.190+0000 7f431f7fe640 1 -- 172.21.15.100:0/4276627578 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f44400c1070 con 0x560eae9bc1d0 2024-09-18T01:26:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.190+0000 7f431f7fe640 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4318036b40 0x7f4318039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.190+0000 7f431f7fe640 1 -- 172.21.15.100:0/4276627578 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f44400a9070 con 0x560eae9bc1d0 2024-09-18T01:26:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.190+0000 7f4447fff640 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4318036b40 0x7f4318039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f4447fff640 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4318036b40 0x7f4318039000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x560eaeac4990 tx=0x7f4438010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f4452132800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f4452132800 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560eaeaf36e0 0x560eaeaf5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf62f0 con 0x560eaeaf36e0 2024-09-18T01:26:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f444e681640 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560eaeaf36e0 0x560eaeaf5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f444e681640 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560eaeaf36e0 0x560eaeaf5ba0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f4452132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f4452132800 20 realm 2024-09-18T01:26:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f4452132800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf6700 con 0x560eaeaf36e0 2024-09-18T01:26:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f4452132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f4452132800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:26:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f4452132800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.191+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf6fd0 con 0x560eaeaf36e0 2024-09-18T01:26:27.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.192+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.192+0000 7f4452132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.192+0000 7f4452132800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.192+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf36e0 2024-09-18T01:26:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.192+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.192+0000 7f4452132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.192+0000 7f4452132800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.192+0000 7f4452132800 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560eaeaf80d0 0x560eaeafa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.192+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeafaad0 con 0x560eaeaf80d0 2024-09-18T01:26:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.192+0000 7f444de80640 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560eaeaf80d0 0x560eaeafa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.192+0000 7f444de80640 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560eaeaf80d0 0x560eaeafa4c0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.193+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.193+0000 7f4452132800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:26:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.193+0000 7f4452132800 20 searching for the correct realm 2024-09-18T01:26:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.193+0000 7f4452132800 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560eaeafca80 0x560eaeafef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.193+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaff610 con 0x560eaeafca80 2024-09-18T01:26:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.193+0000 7f4447fff640 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560eaeafca80 0x560eaeafef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.193+0000 7f4447fff640 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560eaeafca80 0x560eaeafef40 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.193+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.193+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaff610 con 0x560eaeaf80d0 2024-09-18T01:26:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.193+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.193+0000 7f444de80640 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f44400c3060 0x7f444008f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.194+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaff610 con 0x7f44400c3060 2024-09-18T01:26:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.194+0000 7f444e681640 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f44400c3060 0x7f444008f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.194+0000 7f444e681640 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f44400c3060 0x7f444008f700 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.194+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.194+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf36e0 2024-09-18T01:26:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.195+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.195+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf36e0 2024-09-18T01:26:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.195+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.195+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x7f44400c3060 2024-09-18T01:26:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.195+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.195+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x7f44400c3060 2024-09-18T01:26:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.195+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.195+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf80d0 2024-09-18T01:26:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.196+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.196+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeafca80 2024-09-18T01:26:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.196+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.196+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf36e0 2024-09-18T01:26:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.196+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.196+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf80d0 2024-09-18T01:26:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.196+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.196+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf36e0 2024-09-18T01:26:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.197+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.197+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf80d0 2024-09-18T01:26:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.197+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.197+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeafca80 2024-09-18T01:26:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.197+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.197+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeafca80 2024-09-18T01:26:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.197+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.197+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x7f44400c3060 2024-09-18T01:26:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.198+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.198+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeafca80 2024-09-18T01:26:27.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.198+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.198+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeafca80 2024-09-18T01:26:27.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.198+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.198+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf36e0 2024-09-18T01:26:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.198+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.198+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf36e0 2024-09-18T01:26:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.199+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.199+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x7f44400c3060 2024-09-18T01:26:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.199+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.199+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeafca80 2024-09-18T01:26:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.199+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.199+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf80d0 2024-09-18T01:26:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.199+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.199+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf36e0 2024-09-18T01:26:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.200+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.200+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x7f44400c3060 2024-09-18T01:26:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.200+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.200+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeafca80 2024-09-18T01:26:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.200+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.201+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf80d0 2024-09-18T01:26:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.201+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.201+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf80d0 2024-09-18T01:26:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.201+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.201+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeafca80 2024-09-18T01:26:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.201+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.201+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x7f44400c3060 2024-09-18T01:26:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf36e0 2024-09-18T01:26:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaf7370 con 0x560eaeaf80d0 2024-09-18T01:26:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f4452132800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:26:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f4452132800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:26:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f4452132800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:26:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f4452132800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:26:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f4452132800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:26:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f4452132800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:26:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f4452132800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeafb390 con 0x560eaeaf36e0 2024-09-18T01:26:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f4452132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f4452132800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.202+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeafb780 con 0x560eaeaf36e0 2024-09-18T01:26:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeafb780 con 0x7f44400c3060 2024-09-18T01:26:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:26:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 20 zone default found 2024-09-18T01:26:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 4 Realm: () 2024-09-18T01:26:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:26:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:26:27.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:26:27.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 20 zonegroup default 2024-09-18T01:26:27.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeaffa90 con 0x7f44400c3060 2024-09-18T01:26:27.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.203+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb01470 con 0x560eaeafca80 2024-09-18T01:26:27.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.204+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.204+0000 7f4452132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.204+0000 7f4452132800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.204+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb01810 con 0x560eaeafca80 2024-09-18T01:26:27.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.204+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.204+0000 7f4452132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:27.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.204+0000 7f4452132800 20 started sync module instance, tier type = 2024-09-18T01:26:27.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.204+0000 7f4452132800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:26:27.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.204+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb00910 con 0x560eaeaf80d0 2024-09-18T01:26:27.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.205+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.205+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94621060304128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb02060 con 0x560eaeaf80d0 2024-09-18T01:26:27.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.205+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb028b0 con 0x560eaeaf36e0 2024-09-18T01:26:27.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.206+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94621060304128] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.206+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.206+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94621060307888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb028b0 con 0x560eaeaf36e0 2024-09-18T01:26:27.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.206+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb032f0 con 0x560eaeafca80 2024-09-18T01:26:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.207+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94621060307888] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.208+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.208+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94621060310016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb02820 con 0x560eaeafca80 2024-09-18T01:26:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.208+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb041b0 con 0x560eaeaf80d0 2024-09-18T01:26:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.209+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.209+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94621060318624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb04e70 con 0x560eaeaf80d0 2024-09-18T01:26:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.209+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb058b0 con 0x560eaeaf36e0 2024-09-18T01:26:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.209+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94621060310016] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.210+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.210+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94621060322176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb05ca0 con 0x560eaeaf36e0 2024-09-18T01:26:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.210+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94621060318624] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.210+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb06660 con 0x7f44400c3060 2024-09-18T01:26:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.211+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94621060322176] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.211+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.211+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94621060314848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb061b0 con 0x7f44400c3060 2024-09-18T01:26:27.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.211+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb06f00 con 0x7f44400c3060 2024-09-18T01:26:27.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.212+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(56 notify.6 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.212+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94621060327536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb07140 con 0x7f44400c3060 2024-09-18T01:26:27.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.212+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb07b00 con 0x7f44400c3060 2024-09-18T01:26:27.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.212+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94621060314848] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.213+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(58 notify.7 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.213+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94621060319680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb07b00 con 0x7f44400c3060 2024-09-18T01:26:27.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.213+0000 7f4452132800 20 add_watcher() i=0 2024-09-18T01:26:27.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.213+0000 7f4452132800 20 add_watcher() i=1 2024-09-18T01:26:27.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.213+0000 7f4452132800 20 add_watcher() i=2 2024-09-18T01:26:27.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.213+0000 7f4452132800 20 add_watcher() i=3 2024-09-18T01:26:27.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.213+0000 7f4452132800 20 add_watcher() i=4 2024-09-18T01:26:27.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.213+0000 7f4452132800 20 add_watcher() i=5 2024-09-18T01:26:27.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.214+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94621060327536] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.214+0000 7f4452132800 20 add_watcher() i=6 2024-09-18T01:26:27.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.214+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94621060319680] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.214+0000 7f4452132800 20 add_watcher() i=7 2024-09-18T01:26:27.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.214+0000 7f4452132800 2 all 8 watchers are set, enabling cache 2024-09-18T01:26:27.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.214+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb0ab30 con 0x560eaeaf36e0 2024-09-18T01:26:27.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.215+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.215+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94621060331088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb07f20 con 0x560eaeaf36e0 2024-09-18T01:26:27.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.216+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94621060331088] v35'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.216+0000 7f42ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:27.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.216+0000 7f4452132800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:26:27.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.216+0000 7f4452132800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:26:27.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.216+0000 7f4452132800 5 note: GC not initialized 2024-09-18T01:26:27.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.216+0000 7f42fe7fc640 20 reqs_thread_entry: start 2024-09-18T01:26:27.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.216+0000 7f4452132800 20 init_complete bucket index max shards: 11 2024-09-18T01:26:27.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.216+0000 7f4452132800 20 Filter name: none 2024-09-18T01:26:27.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.217+0000 7f426ffff640 20 reqs_thread_entry: start 2024-09-18T01:26:27.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.217+0000 7f4452132800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-18T01:26:27.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.217+0000 7f4452132800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.217+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb3ddb0 con 0x7f44400c3060 2024-09-18T01:26:27.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.217+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.217+0000 7f4452132800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:26:27.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.217+0000 7f4452132800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-18T01:26:27.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.217+0000 7f4452132800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T01:26:27.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.217+0000 7f4452132800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:26:27.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.217+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb42140 con 0x560eaeaf80d0 2024-09-18T01:26:27.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.219+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v35'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.219+0000 7f4452132800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-18T01:26:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.219+0000 7f4452132800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T01:26:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.219+0000 7f4452132800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-18T01:26:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.219+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94621060569856 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb42dd0 con 0x7f44400c3060 2024-09-18T01:26:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.219+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== watch-notify(notify (1) cookie 94621060314848 notify 150323855376 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7f4448018a70 con 0x7f44400c3060 2024-09-18T01:26:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.219+0000 7f43317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855376 cookie 94621060314848 notifier 4741 bl.length()=382 2024-09-18T01:26:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.219+0000 7f43317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-18T01:26:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.219+0000 7f43317fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T01:26:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.219+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(64 notify.5 [notify cookie 94621060569856 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.219+0000 7f43317fa640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f4310003ea0 con 0x7f44400c3060 2024-09-18T01:26:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.219+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x7f44400c3060 2024-09-18T01:26:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.220+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== watch-notify(notify_complete (2) cookie 94621060569856 notify 150323855376 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4448026410 con 0x7f44400c3060 2024-09-18T01:26:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.220+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb41b00 con 0x560eaeaf36e0 2024-09-18T01:26:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.220+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.220+0000 7f4452132800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 : miss 2024-09-18T01:26:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.220+0000 7f4452132800 20 rados->read ofs=0 len=0 2024-09-18T01:26:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.220+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 8.9 8:93267c76:root::.bucket.meta.myfoo6%3a153b7754-209b-4898-8796-577da7c1273d.4237.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb3ff50 con 0x560eaeaf80d0 2024-09-18T01:26:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.220+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(67 .bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv44 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.220+0000 7f4452132800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:26:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.220+0000 7f4452132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 info.flags=0x17 2024-09-18T01:26:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.220+0000 7f4452132800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 to cache LRU end 2024-09-18T01:26:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.220+0000 7f4452132800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:26:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.220+0000 7f4452132800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:26:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.220+0000 7f4452132800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 2024-09-18T01:26:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.220+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 8.9 8:93267c76:root::.bucket.meta.myfoo6%3a153b7754-209b-4898-8796-577da7c1273d.4237.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb49b20 con 0x560eaeaf80d0 2024-09-18T01:26:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.222+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(68 .bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v35'45 uv45 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.222+0000 7f4452132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 info.flags=0x17 2024-09-18T01:26:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.222+0000 7f4452132800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 to cache LRU end 2024-09-18T01:26:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.222+0000 7f4452132800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T01:26:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.222+0000 7f4452132800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9, ofs0, ns] 2024-09-18T01:26:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.222+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [notify cookie 94621060557456 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb44210 con 0x560eaeaf36e0 2024-09-18T01:26:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.222+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== watch-notify(notify (1) cookie 94621060322176 notify 150323855400 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7f4448026410 con 0x560eaeaf36e0 2024-09-18T01:26:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.222+0000 7f43317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855400 cookie 94621060322176 notifier 4741 bl.length()=748 2024-09-18T01:26:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.222+0000 7f43317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 info.flags=0x17 2024-09-18T01:26:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.222+0000 7f43317fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 to cache LRU end 2024-09-18T01:26:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.222+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(69 notify.4 [notify cookie 94621060557456 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.222+0000 7f43317fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T01:26:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.222+0000 7f43317fa640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f4310003ea0 con 0x560eaeaf36e0 2024-09-18T01:26:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.223+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(70 notify.4 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.223+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== watch-notify(notify_complete (2) cookie 94621060557456 notify 150323855400 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4448026820 con 0x560eaeaf36e0 2024-09-18T01:26:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.223+0000 7f4452132800 20 handle_bi_update(): bucket=:myfoo6[153b7754-209b-4898-8796-577da7c1273d.4237.9]): orig_sources= new_sources= 2024-09-18T01:26:27.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.223+0000 7f4452132800 20 handle_bi_update(): bucket=:myfoo6[153b7754-209b-4898-8796-577da7c1273d.4237.9]): potential sources added=[] removed=[] 2024-09-18T01:26:27.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.223+0000 7f4452132800 20 handle_bi_update(): bucket=:myfoo6[153b7754-209b-4898-8796-577da7c1273d.4237.9]): orig_dests= new_dests= 2024-09-18T01:26:27.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.223+0000 7f4452132800 20 handle_bi_update(): bucket=:myfoo6[153b7754-209b-4898-8796-577da7c1273d.4237.9]): potential dests added=[] removed=[] 2024-09-18T01:26:27.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.223+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb49330 con 0x560eaeaf36e0 2024-09-18T01:26:27.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.224+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(71 bud.buckets [call] v35'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.224+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb49330 con 0x560eaeaf36e0 2024-09-18T01:26:27.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.225+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(72 bud.buckets [call] v35'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.225+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb49330 con 0x560eaeaf36e0 2024-09-18T01:26:27.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v35'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f4452132800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-18T01:26:27.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f4452132800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-18T01:26:27.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f4452132800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-18T01:26:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94621060557456 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb441c0 con 0x560eaeaf80d0 2024-09-18T01:26:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== watch-notify(notify (1) cookie 94621060318624 notify 150323855377 ret 0) ==== 358+0+0 (crc 0 0 0) 0x560eaead2c20 con 0x560eaeaf80d0 2024-09-18T01:26:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f43317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855377 cookie 94621060318624 notifier 4741 bl.length()=316 2024-09-18T01:26:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f43317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-18T01:26:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f43317fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-18T01:26:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(74 notify.3 [notify cookie 94621060557456 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f43317fa640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f4310003ea0 con 0x560eaeaf80d0 2024-09-18T01:26:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== watch-notify(notify_complete (2) cookie 94621060557456 notify 150323855377 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560eaeab4c30 con 0x560eaeaf80d0 2024-09-18T01:26:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f4452132800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 : hit (requested=0x17, cached=0x17) 2024-09-18T01:26:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f4452132800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 2024-09-18T01:26:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.226+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:76 8.9 8:93267c76:root::.bucket.meta.myfoo6%3a153b7754-209b-4898-8796-577da7c1273d.4237.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb48f20 con 0x560eaeaf80d0 2024-09-18T01:26:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(76 .bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v35'46 uv46 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f4452132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 info.flags=0x17 2024-09-18T01:26:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f4452132800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 to cache LRU end 2024-09-18T01:26:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f4452132800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T01:26:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f4452132800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9, ofs0, ns] 2024-09-18T01:26:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94621060598240 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb48f40 con 0x560eaeaf36e0 2024-09-18T01:26:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== watch-notify(notify (1) cookie 94621060322176 notify 150323855401 ret 0) ==== 790+0+0 (crc 0 0 0) 0x560eaeb49c60 con 0x560eaeaf36e0 2024-09-18T01:26:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(77 notify.4 [notify cookie 94621060598240 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f4330ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855401 cookie 94621060322176 notifier 4741 bl.length()=748 2024-09-18T01:26:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f4330ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 info.flags=0x17 2024-09-18T01:26:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f4330ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 to cache LRU end 2024-09-18T01:26:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f4330ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T01:26:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f4330ff9640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f4278003470 con 0x560eaeaf36e0 2024-09-18T01:26:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== watch-notify(notify_complete (2) cookie 94621060598240 notify 150323855401 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560eaeb40030 con 0x560eaeaf36e0 2024-09-18T01:26:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f4452132800 20 handle_bi_update(): bucket=:myfoo6[153b7754-209b-4898-8796-577da7c1273d.4237.9]): orig_sources= new_sources= 2024-09-18T01:26:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f4452132800 20 handle_bi_update(): bucket=:myfoo6[153b7754-209b-4898-8796-577da7c1273d.4237.9]): potential sources added=[] removed=[] 2024-09-18T01:26:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f4452132800 20 handle_bi_update(): bucket=:myfoo6[153b7754-209b-4898-8796-577da7c1273d.4237.9]): orig_dests= new_dests= 2024-09-18T01:26:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.228+0000 7f4452132800 20 handle_bi_update(): bucket=:myfoo6[153b7754-209b-4898-8796-577da7c1273d.4237.9]): potential dests added=[] removed=[] 2024-09-18T01:26:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.229+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:79 4.3d 4:bd61d7a1:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb489e0 con 0x560eaeaf80d0 2024-09-18T01:26:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.229+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== osd_op_reply(79 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.229+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 4.2a 4:56efb9e8:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb489e0 con 0x560eaeaf36e0 2024-09-18T01:26:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.229+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(80 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.229+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:81 4.d 4:b030bc0f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb489e0 con 0x560eaeafca80 2024-09-18T01:26:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.231+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(81 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.231+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:82 4.3e 4:7f82a4e5:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb43200 con 0x560eaeaf80d0 2024-09-18T01:26:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.231+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 23 ==== osd_op_reply(82 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.231+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:83 4.29 4:97d6bde0:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb43200 con 0x560eaeafca80 2024-09-18T01:26:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.231+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(83 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.231+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:84 4.e 4:730bf549:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb43640 con 0x560eaeaf80d0 2024-09-18T01:26:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 24 ==== osd_op_reply(84 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:85 4.20 4:07027eab:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb43640 con 0x560eaeaf36e0 2024-09-18T01:26:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 34 ==== osd_op_reply(85 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:86 4.36 4:6d5d4b00:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb43640 con 0x560eaeaf36e0 2024-09-18T01:26:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 35 ==== osd_op_reply(86 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:87 4.1b 4:d95c0209:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb43640 con 0x560eaeaf80d0 2024-09-18T01:26:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 25 ==== osd_op_reply(87 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:88 4.0 4:03a53d9d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb43640 con 0x560eaeafca80 2024-09-18T01:26:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(88 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9 [call out=378b] v0'0 uv9 ondisk = 0) ==== 194+0+378 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 10 cls_bucket_list_unordered: got thirteen 2024-09-18T01:26:27.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:89 4.2 4:438788aa:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb43640 con 0x560eaeaf36e0 2024-09-18T01:26:27.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 36 ==== osd_op_reply(89 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 20 get_obj_state: octx=0x7f4440086f50 obj=myfoo6:thirteen state=0x560eaeb47bb8 s->prefetch_data=0 2024-09-18T01:26:27.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:90 3.35s0 3:af58c9a6:::153b7754-209b-4898-8796-577da7c1273d.4237.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb43640 con 0x560eaeaf36e0 2024-09-18T01:26:27.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 37 ==== osd_op_reply(90 153b7754-209b-4898-8796-577da7c1273d.4237.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 10 manifest: total_size = 8 2024-09-18T01:26:27.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 20 get_obj_state: setting s->obj_tag to 153b7754-209b-4898-8796-577da7c1273d.4237.13829587431023039849 2024-09-18T01:26:27.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-18T01:26:27.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-18T01:26:27.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-18T01:26:27.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-18T01:26:27.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-18T01:26:27.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-18T01:26:27.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-18T01:26:27.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-18T01:26:27.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 20 get_obj_state: octx=0x7f4440086f50 obj=myfoo6:thirteen state=0x560eaeb47bb8 s->prefetch_data=0 2024-09-18T01:26:27.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 : hit (requested=0x17, cached=0x17) 2024-09-18T01:26:27.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 2024-09-18T01:26:27.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 20 bucket index object: :.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9 2024-09-18T01:26:27.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.232+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 4.0 4:03a53d9d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb46b70 con 0x560eaeafca80 2024-09-18T01:26:27.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.233+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(91 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9 [stat,call,call] v35'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.233+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:92 3.35s0 3:af58c9a6:::153b7754-209b-4898-8796-577da7c1273d.4237.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb47130 con 0x560eaeaf36e0 2024-09-18T01:26:27.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.236+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 38 ==== osd_op_reply(92 153b7754-209b-4898-8796-577da7c1273d.4237.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v35'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x560eaeaf36e0 2024-09-18T01:26:27.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.236+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:93 4.0 4:03a53d9d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb47130 con 0x560eaeafca80 2024-09-18T01:26:27.248 INFO:teuthology.orchestra.run.smithi100.stderr:1 objects processed in :myfoo6[153b7754-209b-4898-8796-577da7c1273d.4237.9]). Next marker thirteen 2024-09-18T01:26:27.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.236+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb47130 con 0x560eaeaf80d0 2024-09-18T01:26:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.238+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 26 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v35'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.238+0000 7f4452132800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-18T01:26:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.238+0000 7f4452132800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T01:26:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.238+0000 7f4452132800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-18T01:26:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.238+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94621060573552 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb47130 con 0x7f44400c3060 2024-09-18T01:26:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.238+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(93 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9 [stat,call,call] v35'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.238+0000 7f4330ff9640 20 handle_completion(): completion ok for obj=thirteen 2024-09-18T01:26:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.238+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== watch-notify(notify (1) cookie 94621060314848 notify 150323855377 ret 0) ==== 598+0+0 (crc 0 0 0) 0x560eaeb40030 con 0x7f44400c3060 2024-09-18T01:26:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.238+0000 7f43317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855377 cookie 94621060314848 notifier 4741 bl.length()=556 2024-09-18T01:26:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.238+0000 7f43317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-18T01:26:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.238+0000 7f43317fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T01:26:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.238+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(95 notify.5 [notify cookie 94621060573552 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4448059020 con 0x7f44400c3060 2024-09-18T01:26:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.238+0000 7f43317fa640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f4310003ea0 con 0x7f44400c3060 2024-09-18T01:26:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.240+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== watch-notify(notify_complete (2) cookie 94621060573552 notify 150323855377 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4448026820 con 0x7f44400c3060 2024-09-18T01:26:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.240+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4448059020 con 0x7f44400c3060 2024-09-18T01:26:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.240+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb470d0 con 0x560eaeaf36e0 2024-09-18T01:26:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.241+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 39 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v35'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f4448059020 con 0x560eaeaf36e0 2024-09-18T01:26:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.241+0000 7f4452132800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-18T01:26:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.241+0000 7f4452132800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T01:26:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.241+0000 7f4452132800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-18T01:26:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.241+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94621060573552 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb470d0 con 0x7f44400c3060 2024-09-18T01:26:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.241+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== watch-notify(notify (1) cookie 94621060314848 notify 150323855378 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f4448026820 con 0x7f44400c3060 2024-09-18T01:26:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.241+0000 7f43317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855378 cookie 94621060314848 notifier 4741 bl.length()=177 2024-09-18T01:26:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.241+0000 7f43317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-18T01:26:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.241+0000 7f43317fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T01:26:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.241+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(98 notify.5 [notify cookie 94621060573552 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4448059020 con 0x7f44400c3060 2024-09-18T01:26:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.241+0000 7f43317fa640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f4310003ea0 con 0x7f44400c3060 2024-09-18T01:26:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.242+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4448059020 con 0x7f44400c3060 2024-09-18T01:26:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.242+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== watch-notify(notify_complete (2) cookie 94621060573552 notify 150323855378 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f44480576c0 con 0x7f44400c3060 2024-09-18T01:26:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.242+0000 7f4452132800 10 removing user index: bar 2024-09-18T01:26:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.242+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb3eb70 con 0x7f44400c3060 2024-09-18T01:26:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.243+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 29 ==== osd_op_reply(100 bar [delete] v35'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f4448059020 con 0x7f44400c3060 2024-09-18T01:26:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.243+0000 7f4452132800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-18T01:26:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.243+0000 7f4452132800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-18T01:26:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.243+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94621060573552 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb470d0 con 0x7f44400c3060 2024-09-18T01:26:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.243+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 30 ==== watch-notify(notify (1) cookie 94621060319680 notify 150323855379 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f44480576c0 con 0x7f44400c3060 2024-09-18T01:26:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.243+0000 7f4330ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855379 cookie 94621060319680 notifier 4741 bl.length()=152 2024-09-18T01:26:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.243+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 31 ==== osd_op_reply(101 notify.7 [notify cookie 94621060573552 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4448059020 con 0x7f44400c3060 2024-09-18T01:26:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.243+0000 7f4330ff9640 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f4278003450 con 0x7f44400c3060 2024-09-18T01:26:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.243+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 32 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4448059020 con 0x7f44400c3060 2024-09-18T01:26:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.243+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 33 ==== watch-notify(notify_complete (2) cookie 94621060573552 notify 150323855379 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4448057890 con 0x7f44400c3060 2024-09-18T01:26:27.255 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-18T01:26:27.068548Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:26:27.068537Z","tags":[],"group_ids":[]} 2024-09-18T01:26:27.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.244+0000 7f42ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:27.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.244+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94621060331088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb3bb00 con 0x560eaeaf36e0 2024-09-18T01:26:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.245+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 40 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94621060331088] v35'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4448059020 con 0x560eaeaf36e0 2024-09-18T01:26:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.245+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94621060304128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb3bb00 con 0x560eaeaf80d0 2024-09-18T01:26:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.246+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 27 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94621060304128] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.246+0000 7f4452132800 20 remove_watcher() i=0 2024-09-18T01:26:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.246+0000 7f4452132800 2 removed watcher, disabling cache 2024-09-18T01:26:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.246+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94621060307888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb3bb00 con 0x560eaeaf36e0 2024-09-18T01:26:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.247+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 41 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94621060307888] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4448059020 con 0x560eaeaf36e0 2024-09-18T01:26:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.247+0000 7f4452132800 20 remove_watcher() i=1 2024-09-18T01:26:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.247+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94621060310016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb3bb00 con 0x560eaeafca80 2024-09-18T01:26:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.249+0000 7f4447fff640 1 -- 172.21.15.100:0/4276627578 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94621060310016] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4438037040 con 0x560eaeafca80 2024-09-18T01:26:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.249+0000 7f4452132800 20 remove_watcher() i=2 2024-09-18T01:26:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.249+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94621060318624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb3bb00 con 0x560eaeaf80d0 2024-09-18T01:26:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.250+0000 7f444de80640 1 -- 172.21.15.100:0/4276627578 <== osd.2 v2:172.21.15.100:6808/3104327688 28 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94621060318624] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44400c0030 con 0x560eaeaf80d0 2024-09-18T01:26:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.250+0000 7f4452132800 20 remove_watcher() i=3 2024-09-18T01:26:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.250+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94621060322176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb3bb00 con 0x560eaeaf36e0 2024-09-18T01:26:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.251+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.1 v2:172.21.15.100:6800/170575980 42 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94621060322176] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4448059020 con 0x560eaeaf36e0 2024-09-18T01:26:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.251+0000 7f4452132800 20 remove_watcher() i=4 2024-09-18T01:26:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.251+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94621060314848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb3bb00 con 0x7f44400c3060 2024-09-18T01:26:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.252+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 34 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94621060314848] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4448059020 con 0x7f44400c3060 2024-09-18T01:26:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.252+0000 7f4452132800 20 remove_watcher() i=5 2024-09-18T01:26:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.252+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94621060327536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb3bb00 con 0x7f44400c3060 2024-09-18T01:26:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 35 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94621060327536] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4448059020 con 0x7f44400c3060 2024-09-18T01:26:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 20 remove_watcher() i=6 2024-09-18T01:26:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94621060319680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560eaeb3bb00 con 0x7f44400c3060 2024-09-18T01:26:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 <== osd.0 v2:172.21.15.92:6800/2777570747 36 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94621060319680] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4448059020 con 0x7f44400c3060 2024-09-18T01:26:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 20 remove_watcher() i=7 2024-09-18T01:26:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f44400c3060 msgr2=0x7f444008f700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f44400c3060 0x7f444008f700 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560eaeaf36e0 msgr2=0x560eaeaf5ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560eaeaf36e0 0x560eaeaf5ba0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560eaeaf80d0 msgr2=0x560eaeafa4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560eaeaf80d0 0x560eaeafa4c0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560eaeafca80 msgr2=0x560eaeafef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560eaeafca80 0x560eaeafef40 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4318036b40 msgr2=0x7f4318039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4318036b40 0x7f4318039000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x560eaeac4990 tx=0x7f4438010000 comp rx=0 tx=0).stop 2024-09-18T01:26:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae9bc1d0 msgr2=0x560eaeae81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f444e681640 1 -- 172.21.15.100:0/4276627578 reap_dead start 2024-09-18T01:26:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae9bc1d0 0x560eaeae81b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4440080900 tx=0x7f4440090d10 comp rx=0 tx=0).stop 2024-09-18T01:26:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 shutdown_connections 2024-09-18T01:26:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 --2- 172.21.15.100:0/4276627578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae9bc1d0 0x560eaeae81b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 >> 172.21.15.100:0/4276627578 conn(0x560eaeadb0b0 msgr2=0x560eaead9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 shutdown_connections 2024-09-18T01:26:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.254+0000 7f4452132800 1 -- 172.21.15.100:0/4276627578 wait complete. 2024-09-18T01:26:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/1092066954 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4328036b40 msgr2=0x7f4328039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 --2- 172.21.15.100:0/1092066954 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4328036b40 0x7f4328039000 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x560eaeabc110 tx=0x7f443800f000 comp rx=0 tx=0).stop 2024-09-18T01:26:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/1092066954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eaead22c0 msgr2=0x560eaead26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 --2- 172.21.15.100:0/1092066954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eaead22c0 0x560eaead26e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f444005cfd0 tx=0x7f4440065e80 comp rx=0 tx=0).stop 2024-09-18T01:26:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/1092066954 shutdown_connections 2024-09-18T01:26:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 --2- 172.21.15.100:0/1092066954 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4328036b40 0x7f4328039000 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 --2- 172.21.15.100:0/1092066954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eaead22c0 0x560eaead26e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/1092066954 >> 172.21.15.100:0/1092066954 conn(0x560eaeac7250 msgr2=0x560eaeac9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/1092066954 shutdown_connections 2024-09-18T01:26:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/1092066954 wait complete. 2024-09-18T01:26:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560eaeac1aa0 msgr2=0x560eaeac3e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560eaeac1aa0 0x560eaeac3e90 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560eae9c0720 msgr2=0x560eaeabb1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560eae9c0720 0x560eaeabb1e0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560eaeabdb60 msgr2=0x560eaeabff50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560eaeabdb60 0x560eaeabff50 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4334036b40 msgr2=0x7f4334039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4334036b40 0x7f4334039000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4438000f60 tx=0x7f4438001370 comp rx=0 tx=0).stop 2024-09-18T01:26:27.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 msgr2=0x560eaeab4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:27.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 --2- 172.21.15.100:0/2326495529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560eae930e30 0x560eaeab4170 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4440025da0 tx=0x7f4440002fb0 comp rx=0 tx=0).stop 2024-09-18T01:26:27.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f444e681640 1 -- 172.21.15.100:0/2326495529 reap_dead start 2024-09-18T01:26:27.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 shutdown_connections 2024-09-18T01:26:27.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 >> 172.21.15.100:0/2326495529 conn(0x560eae9b7dd0 msgr2=0x560eaeaa6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:27.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 shutdown_connections 2024-09-18T01:26:27.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:27.256+0000 7f4452132800 1 -- 172.21.15.100:0/2326495529 wait complete. 2024-09-18T01:26:27.267 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-18T01:26:27.068548Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:26:27.068537Z', 'tags': [], 'group_ids': []} 2024-09-18T01:26:32.277 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:26:32.277 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-18T01:26:32.278 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-18T01:26:32.278 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-18T01:26:32.278 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-18T01:26:32.337 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:26:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:26:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.337+0000 7f7d44f26800 1 Processor -- start 2024-09-18T01:26:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.337+0000 7f7d44f26800 1 -- start start 2024-09-18T01:26:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.337+0000 7f7d44f26800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x559fac4a1a40 0x559fac4a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.337+0000 7f7d44f26800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559fac35cb30 con 0x559fac49d600 2024-09-18T01:26:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.337+0000 7f7d44f26800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x559fac33e360 con 0x559fac4a1a40 2024-09-18T01:26:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.338+0000 7f7d403e2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x559fac4a1a40 0x559fac4a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.338+0000 7f7d403e2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x559fac4a1a40 0x559fac4a3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37382/0 (socket says 172.21.15.100:37382) 2024-09-18T01:26:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.338+0000 7f7d403e2640 1 -- 172.21.15.100:0/2161401484 learned_addr learned my addr 172.21.15.100:0/2161401484 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.338+0000 7f7d40be3640 1 --1- 172.21.15.100:0/2161401484 >> v1:172.21.15.92:6789/0 conn(0x559fac49d600 0x559fac49da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:34534/0 (socket says 172.21.15.100:34534) 2024-09-18T01:26:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.338+0000 7f7d403e2640 1 -- 172.21.15.100:0/2161401484 >> v1:172.21.15.92:6789/0 conn(0x559fac49d600 legacy=0x559fac49da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.338+0000 7f7d403e2640 1 -- 172.21.15.100:0/2161401484 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fac364e00 con 0x559fac4a1a40 2024-09-18T01:26:32.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.340+0000 7f7d403e2640 1 --2- 172.21.15.100:0/2161401484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac4a1a40 0x559fac4a3e30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400a520 tx=0x7f7d34045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c06e57e4174253 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.340+0000 7f7d3fbe1640 1 -- 172.21.15.100:0/2161401484 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d34055070 con 0x559fac4a1a40 2024-09-18T01:26:32.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.340+0000 7f7d3fbe1640 1 -- 172.21.15.100:0/2161401484 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d340515b0 con 0x559fac4a1a40 2024-09-18T01:26:32.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.340+0000 7f7d3fbe1640 1 -- 172.21.15.100:0/2161401484 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d340518d0 con 0x559fac4a1a40 2024-09-18T01:26:32.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.341+0000 7f7d44f26800 1 -- 172.21.15.100:0/2161401484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac4a1a40 msgr2=0x559fac4a3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.341+0000 7f7d44f26800 1 --2- 172.21.15.100:0/2161401484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac4a1a40 0x559fac4a3e30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400a520 tx=0x7f7d34045ba0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.341+0000 7f7d44f26800 1 -- 172.21.15.100:0/2161401484 shutdown_connections 2024-09-18T01:26:32.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.341+0000 7f7d44f26800 1 --2- 172.21.15.100:0/2161401484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac4a1a40 0x559fac4a3e30 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.341+0000 7f7d44f26800 1 -- 172.21.15.100:0/2161401484 >> 172.21.15.100:0/2161401484 conn(0x559fac498f10 msgr2=0x559fac49b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.341+0000 7f7d44f26800 1 -- 172.21.15.100:0/2161401484 shutdown_connections 2024-09-18T01:26:32.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.341+0000 7f7d44f26800 1 -- 172.21.15.100:0/2161401484 wait complete. 2024-09-18T01:26:32.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.356+0000 7f7d44f26800 1 Processor -- start 2024-09-18T01:26:32.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.356+0000 7f7d44f26800 1 -- start start 2024-09-18T01:26:32.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.356+0000 7f7d44f26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac49d600 0x559fac58c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.356+0000 7f7d44f26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559fac3e9370 con 0x559fac49d600 2024-09-18T01:26:32.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.357+0000 7f7d40be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac49d600 0x559fac58c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.357+0000 7f7d40be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac49d600 0x559fac58c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37384/0 (socket says 172.21.15.100:37384) 2024-09-18T01:26:32.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.357+0000 7f7d40be3640 1 -- 172.21.15.100:0/428277634 learned_addr learned my addr 172.21.15.100:0/428277634 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.357+0000 7f7d40be3640 1 -- 172.21.15.100:0/428277634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fac336bc0 con 0x559fac49d600 2024-09-18T01:26:32.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.357+0000 7f7d40be3640 1 --2- 172.21.15.100:0/428277634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac49d600 0x559fac58c930 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7d30001650 tx=0x7f7d30001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d4fe9e45dd19ac server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.357+0000 7f7c2ee0d640 1 -- 172.21.15.100:0/428277634 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d30013420 con 0x559fac49d600 2024-09-18T01:26:32.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.358+0000 7f7c2ee0d640 1 -- 172.21.15.100:0/428277634 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d300135c0 con 0x559fac49d600 2024-09-18T01:26:32.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.358+0000 7f7c2ee0d640 1 -- 172.21.15.100:0/428277634 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d300138c0 con 0x559fac49d600 2024-09-18T01:26:32.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.358+0000 7f7d44f26800 1 -- 172.21.15.100:0/428277634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac49d600 msgr2=0x559fac58c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.358+0000 7f7d44f26800 1 --2- 172.21.15.100:0/428277634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac49d600 0x559fac58c930 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7d30001650 tx=0x7f7d30001b10 comp rx=0 tx=0).stop 2024-09-18T01:26:32.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.358+0000 7f7d44f26800 1 -- 172.21.15.100:0/428277634 shutdown_connections 2024-09-18T01:26:32.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.358+0000 7f7d44f26800 1 --2- 172.21.15.100:0/428277634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac49d600 0x559fac58c930 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.358+0000 7f7d44f26800 1 -- 172.21.15.100:0/428277634 >> 172.21.15.100:0/428277634 conn(0x559fac498f10 msgr2=0x559fac5882f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.358+0000 7f7d44f26800 1 -- 172.21.15.100:0/428277634 shutdown_connections 2024-09-18T01:26:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.358+0000 7f7d44f26800 1 -- 172.21.15.100:0/428277634 wait complete. 2024-09-18T01:26:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.359+0000 7f7d44f26800 1 Processor -- start 2024-09-18T01:26:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.359+0000 7f7d44f26800 1 -- start start 2024-09-18T01:26:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.359+0000 7f7d44f26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac49d600 0x559fac412ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.359+0000 7f7d44f26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559fac4a4670 con 0x559fac49d600 2024-09-18T01:26:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.359+0000 7f7d40be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac49d600 0x559fac412ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.359+0000 7f7d40be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac49d600 0x559fac412ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37398/0 (socket says 172.21.15.100:37398) 2024-09-18T01:26:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.359+0000 7f7d40be3640 1 -- 172.21.15.100:0/1776073396 learned_addr learned my addr 172.21.15.100:0/1776073396 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.359+0000 7f7d40be3640 1 -- 172.21.15.100:0/1776073396 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fac34afe0 con 0x559fac49d600 2024-09-18T01:26:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.360+0000 7f7d40be3640 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac49d600 0x559fac412ec0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7d30000f80 tx=0x7f7d30001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.360+0000 7f7c2d60a640 1 -- 172.21.15.100:0/1776073396 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d30022020 con 0x559fac49d600 2024-09-18T01:26:32.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.360+0000 7f7c2d60a640 1 -- 172.21.15.100:0/1776073396 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d30006830 con 0x559fac49d600 2024-09-18T01:26:32.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.360+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559fac4115b0 con 0x559fac49d600 2024-09-18T01:26:32.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.360+0000 7f7c2d60a640 1 -- 172.21.15.100:0/1776073396 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d30004bb0 con 0x559fac49d600 2024-09-18T01:26:32.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.360+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fac411ad0 con 0x559fac49d600 2024-09-18T01:26:32.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.361+0000 7f7c2d60a640 1 -- 172.21.15.100:0/1776073396 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d30025020 con 0x559fac49d600 2024-09-18T01:26:32.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.361+0000 7f7c2d60a640 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c28036b40 0x7f7c28039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.361+0000 7f7c2d60a640 1 -- 172.21.15.100:0/1776073396 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f7d30018030 con 0x559fac49d600 2024-09-18T01:26:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.361+0000 7f7d403e2640 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c28036b40 0x7f7c28039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.361+0000 7f7d44f26800 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559fac4a1a40 0x559fac59d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.361+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac59dc90 con 0x559fac4a1a40 2024-09-18T01:26:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.361+0000 7f7d413e4640 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559fac4a1a40 0x559fac59d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.362+0000 7f7d403e2640 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c28036b40 0x7f7c28039000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7d34057000 tx=0x7f7d34052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.362+0000 7f7d413e4640 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559fac4a1a40 0x559fac59d750 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.362+0000 7f7d413e4640 1 -- 172.21.15.100:0/1776073396 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d380083e0 con 0x559fac4a1a40 2024-09-18T01:26:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.362+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac59e050 con 0x559fac4a1a40 2024-09-18T01:26:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.362+0000 7f7d413e4640 1 -- 172.21.15.100:0/1776073396 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d380083e0 con 0x559fac4a1a40 2024-09-18T01:26:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.362+0000 7f7d44f26800 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559fac59fe60 0x559fac5a2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.362+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac5a2940 con 0x559fac59fe60 2024-09-18T01:26:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.362+0000 7f7d40be3640 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559fac59fe60 0x559fac5a2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.363+0000 7f7d40be3640 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559fac59fe60 0x559fac5a2250 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.363+0000 7f7d40be3640 1 -- 172.21.15.100:0/1776073396 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7d3001b070 con 0x559fac59fe60 2024-09-18T01:26:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.363+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac59ed00 con 0x559fac4a1a40 2024-09-18T01:26:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.363+0000 7f7d413e4640 1 -- 172.21.15.100:0/1776073396 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d380083e0 con 0x559fac4a1a40 2024-09-18T01:26:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.363+0000 7f7d44f26800 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559fac5a3da0 0x559fac5a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.363+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac5a68d0 con 0x559fac5a3da0 2024-09-18T01:26:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.364+0000 7f7d403e2640 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559fac5a3da0 0x559fac5a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.364+0000 7f7d403e2640 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559fac5a3da0 0x559fac5a6190 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.364+0000 7f7d403e2640 1 -- 172.21.15.100:0/1776073396 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5a3da0 2024-09-18T01:26:32.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.365+0000 7f7d44f26800 1 Processor -- start 2024-09-18T01:26:32.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.365+0000 7f7d44f26800 1 -- start start 2024-09-18T01:26:32.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.365+0000 7f7d44f26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5b4600 0x559fac5b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.365+0000 7f7d44f26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559fac338580 con 0x559fac5b4600 2024-09-18T01:26:32.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.365+0000 7f7d40be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5b4600 0x559fac5b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.365+0000 7f7d40be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5b4600 0x559fac5b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37404/0 (socket says 172.21.15.100:37404) 2024-09-18T01:26:32.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.365+0000 7f7d40be3640 1 -- 172.21.15.100:0/1367219269 learned_addr learned my addr 172.21.15.100:0/1367219269 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.366+0000 7f7d40be3640 1 -- 172.21.15.100:0/1367219269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fac5b4f60 con 0x559fac5b4600 2024-09-18T01:26:32.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.366+0000 7f7d40be3640 1 --2- 172.21.15.100:0/1367219269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5b4600 0x559fac5b4a20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7d3001d510 tx=0x7f7d30004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.366+0000 7f7c267fc640 1 -- 172.21.15.100:0/1367219269 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d300051a0 con 0x559fac5b4600 2024-09-18T01:26:32.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.366+0000 7f7c267fc640 1 -- 172.21.15.100:0/1367219269 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d3001e3f0 con 0x559fac5b4600 2024-09-18T01:26:32.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.366+0000 7f7d44f26800 1 -- 172.21.15.100:0/1367219269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559fac5b51f0 con 0x559fac5b4600 2024-09-18T01:26:32.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.366+0000 7f7c267fc640 1 -- 172.21.15.100:0/1367219269 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d3001e6f0 con 0x559fac5b4600 2024-09-18T01:26:32.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.366+0000 7f7d44f26800 1 -- 172.21.15.100:0/1367219269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fac5b7ed0 con 0x559fac5b4600 2024-09-18T01:26:32.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.367+0000 7f7c267fc640 1 -- 172.21.15.100:0/1367219269 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d30010070 con 0x559fac5b4600 2024-09-18T01:26:32.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.367+0000 7f7c267fc640 1 --2- 172.21.15.100:0/1367219269 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c18036b40 0x7f7c18039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.367+0000 7f7c267fc640 1 -- 172.21.15.100:0/1367219269 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f7d3003dd00 con 0x559fac5b4600 2024-09-18T01:26:32.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.367+0000 7f7d403e2640 1 --2- 172.21.15.100:0/1367219269 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c18036b40 0x7f7c18039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.367+0000 7f7d44f26800 1 Processor -- start 2024-09-18T01:26:32.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.367+0000 7f7d44f26800 1 -- start start 2024-09-18T01:26:32.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.367+0000 7f7d403e2640 1 --2- 172.21.15.100:0/1367219269 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c18036b40 0x7f7c18039000 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7d34005570 tx=0x7f7d34005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.368+0000 7f7d44f26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5c1050 0x559fac5c1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.368+0000 7f7d44f26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559fac58d0e0 con 0x559fac5c1050 2024-09-18T01:26:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.368+0000 7f7d40be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5c1050 0x559fac5c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.368+0000 7f7d40be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5c1050 0x559fac5c1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37406/0 (socket says 172.21.15.100:37406) 2024-09-18T01:26:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.368+0000 7f7d40be3640 1 -- 172.21.15.100:0/1996994385 learned_addr learned my addr 172.21.15.100:0/1996994385 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.368+0000 7f7d40be3640 1 -- 172.21.15.100:0/1996994385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fac5c1970 con 0x559fac5c1050 2024-09-18T01:26:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.368+0000 7f7d40be3640 1 --2- 172.21.15.100:0/1996994385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5c1050 0x559fac5c1430 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7d3003dfd0 tx=0x7f7d3003fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1a3b204bda8da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.368+0000 7f7c17fff640 1 -- 172.21.15.100:0/1996994385 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d300123c0 con 0x559fac5c1050 2024-09-18T01:26:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.368+0000 7f7c17fff640 1 -- 172.21.15.100:0/1996994385 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d3005d070 con 0x559fac5c1050 2024-09-18T01:26:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.368+0000 7f7c17fff640 1 -- 172.21.15.100:0/1996994385 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d30028db0 con 0x559fac5c1050 2024-09-18T01:26:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.369+0000 7f7d44f26800 1 -- 172.21.15.100:0/1996994385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5c1050 msgr2=0x559fac5c1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.369+0000 7f7d44f26800 1 --2- 172.21.15.100:0/1996994385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5c1050 0x559fac5c1430 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7d3003dfd0 tx=0x7f7d3003fe20 comp rx=0 tx=0).stop 2024-09-18T01:26:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.369+0000 7f7d44f26800 1 -- 172.21.15.100:0/1996994385 shutdown_connections 2024-09-18T01:26:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.369+0000 7f7d44f26800 1 --2- 172.21.15.100:0/1996994385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5c1050 0x559fac5c1430 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.369+0000 7f7d44f26800 1 -- 172.21.15.100:0/1996994385 >> 172.21.15.100:0/1996994385 conn(0x559fac5bd400 msgr2=0x559fac5bb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.369+0000 7f7d44f26800 1 -- 172.21.15.100:0/1996994385 shutdown_connections 2024-09-18T01:26:32.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.369+0000 7f7d44f26800 1 -- 172.21.15.100:0/1996994385 wait complete. 2024-09-18T01:26:32.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.369+0000 7f7d44f26800 1 Processor -- start 2024-09-18T01:26:32.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.369+0000 7f7d44f26800 1 -- start start 2024-09-18T01:26:32.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.369+0000 7f7d44f26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5c1050 0x559fac5c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.369+0000 7f7d44f26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559fac5c1eb0 con 0x559fac5c1050 2024-09-18T01:26:32.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.370+0000 7f7d40be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5c1050 0x559fac5c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.370+0000 7f7d40be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5c1050 0x559fac5c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37424/0 (socket says 172.21.15.100:37424) 2024-09-18T01:26:32.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.370+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 learned_addr learned my addr 172.21.15.100:0/2980575644 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.370+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fac5c8870 con 0x559fac5c1050 2024-09-18T01:26:32.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.370+0000 7f7d40be3640 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5c1050 0x559fac5c8330 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f7d3003fe60 tx=0x7f7d30022f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.370+0000 7f7c167fc640 1 -- 172.21.15.100:0/2980575644 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d300123c0 con 0x559fac5c1050 2024-09-18T01:26:32.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.370+0000 7f7c167fc640 1 -- 172.21.15.100:0/2980575644 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d30068070 con 0x559fac5c1050 2024-09-18T01:26:32.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.370+0000 7f7c167fc640 1 -- 172.21.15.100:0/2980575644 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d30026740 con 0x559fac5c1050 2024-09-18T01:26:32.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.370+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559fac5c8870 con 0x559fac5c1050 2024-09-18T01:26:32.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.370+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fac5c8870 con 0x559fac5c1050 2024-09-18T01:26:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.371+0000 7f7c167fc640 1 -- 172.21.15.100:0/2980575644 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d3003f120 con 0x559fac5c1050 2024-09-18T01:26:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.371+0000 7f7c167fc640 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c0c036af0 0x7f7c0c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.371+0000 7f7c167fc640 1 -- 172.21.15.100:0/2980575644 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f7d3005a960 con 0x559fac5c1050 2024-09-18T01:26:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.372+0000 7f7d403e2640 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c0c036af0 0x7f7c0c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.372+0000 7f7d403e2640 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c0c036af0 0x7f7c0c038fb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7d34045be0 tx=0x7f7d3406d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.372+0000 7f7d44f26800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.372+0000 7f7d44f26800 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559fac5d3930 0x559fac5d5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.372+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d6540 con 0x559fac5d3930 2024-09-18T01:26:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.372+0000 7f7d413e4640 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559fac5d3930 0x559fac5d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d413e4640 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559fac5d3930 0x559fac5d5df0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d380083e0 con 0x559fac5d3930 2024-09-18T01:26:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d44f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d44f26800 20 realm 2024-09-18T01:26:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d44f26800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d6950 con 0x559fac5d3930 2024-09-18T01:26:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d380083e0 con 0x559fac5d3930 2024-09-18T01:26:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d44f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d44f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:26:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d44f26800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d3930 2024-09-18T01:26:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d380083e0 con 0x559fac5d3930 2024-09-18T01:26:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d44f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d44f26800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.373+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d75c0 con 0x559fac5d3930 2024-09-18T01:26:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.374+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d380083e0 con 0x559fac5d3930 2024-09-18T01:26:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.374+0000 7f7d44f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.374+0000 7f7d44f26800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.374+0000 7f7d44f26800 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559fac5d7f80 0x559fac5da370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.374+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac5da9c0 con 0x559fac5d7f80 2024-09-18T01:26:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.374+0000 7f7d40be3640 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559fac5d7f80 0x559fac5da370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.374+0000 7f7d40be3640 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559fac5d7f80 0x559fac5da370 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.374+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.374+0000 7f7d44f26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:26:32.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.374+0000 7f7d44f26800 20 searching for the correct realm 2024-09-18T01:26:32.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.374+0000 7f7d44f26800 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559fac5dc970 0x559fac5dee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.374+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5df500 con 0x559fac5dc970 2024-09-18T01:26:32.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.375+0000 7f7d403e2640 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559fac5dc970 0x559fac5dee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.375+0000 7f7d403e2640 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559fac5dc970 0x559fac5dee30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.375+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.375+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5df500 con 0x559fac5d7f80 2024-09-18T01:26:32.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.375+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.375+0000 7f7d40be3640 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7d30064040 0x7f7d300057b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.375+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5df500 con 0x7f7d30064040 2024-09-18T01:26:32.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.376+0000 7f7d413e4640 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7d30064040 0x7f7d300057b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.376+0000 7f7d413e4640 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7d30064040 0x7f7d300057b0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.377+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7d380083e0 con 0x7f7d30064040 2024-09-18T01:26:32.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.377+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d3930 2024-09-18T01:26:32.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.377+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d380083e0 con 0x559fac5d3930 2024-09-18T01:26:32.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.377+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d3930 2024-09-18T01:26:32.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.377+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d38026040 con 0x559fac5d3930 2024-09-18T01:26:32.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.377+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x7f7d30064040 2024-09-18T01:26:32.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.377+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d38026040 con 0x7f7d30064040 2024-09-18T01:26:32.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.377+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x7f7d30064040 2024-09-18T01:26:32.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.378+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d38026040 con 0x7f7d30064040 2024-09-18T01:26:32.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.378+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d7f80 2024-09-18T01:26:32.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.378+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.378+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5dc970 2024-09-18T01:26:32.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.378+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.378+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d3930 2024-09-18T01:26:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.378+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d38026040 con 0x559fac5d3930 2024-09-18T01:26:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.378+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d7f80 2024-09-18T01:26:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.379+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.379+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d3930 2024-09-18T01:26:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.379+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d38026040 con 0x559fac5d3930 2024-09-18T01:26:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.379+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d7f80 2024-09-18T01:26:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.379+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.379+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5dc970 2024-09-18T01:26:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.379+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.379+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5dc970 2024-09-18T01:26:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.379+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.379+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x7f7d30064040 2024-09-18T01:26:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.380+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d38026040 con 0x7f7d30064040 2024-09-18T01:26:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.380+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5dc970 2024-09-18T01:26:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.380+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.380+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5dc970 2024-09-18T01:26:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.380+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.380+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d3930 2024-09-18T01:26:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.381+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d38026040 con 0x559fac5d3930 2024-09-18T01:26:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.381+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d3930 2024-09-18T01:26:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.381+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7d38026040 con 0x559fac5d3930 2024-09-18T01:26:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.381+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x7f7d30064040 2024-09-18T01:26:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.381+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d38026040 con 0x7f7d30064040 2024-09-18T01:26:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.381+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5dc970 2024-09-18T01:26:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.381+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.381+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d7f80 2024-09-18T01:26:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.382+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.382+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d3930 2024-09-18T01:26:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.382+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d38026040 con 0x559fac5d3930 2024-09-18T01:26:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.382+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x7f7d30064040 2024-09-18T01:26:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.382+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.382+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5dc970 2024-09-18T01:26:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.383+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.383+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d7f80 2024-09-18T01:26:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.383+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.383+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d7f80 2024-09-18T01:26:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.383+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.383+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5dc970 2024-09-18T01:26:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.383+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.383+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x7f7d30064040 2024-09-18T01:26:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d3930 2024-09-18T01:26:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7d38037040 con 0x559fac5d3930 2024-09-18T01:26:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559fac5d7220 con 0x559fac5d7f80 2024-09-18T01:26:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d44f26800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:26:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d44f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:26:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d44f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:26:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d44f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:26:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d44f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:26:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d44f26800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:26:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d44f26800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac5dad60 con 0x559fac5d3930 2024-09-18T01:26:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x559fac5d3930 2024-09-18T01:26:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d44f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d44f26800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.384+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac5db150 con 0x559fac5d3930 2024-09-18T01:26:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d38037040 con 0x559fac5d3930 2024-09-18T01:26:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac5db150 con 0x7f7d30064040 2024-09-18T01:26:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:26:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 20 zone default found 2024-09-18T01:26:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 4 Realm: () 2024-09-18T01:26:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:26:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:26:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:26:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 20 zonegroup default 2024-09-18T01:26:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac5df980 con 0x7f7d30064040 2024-09-18T01:26:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.385+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e1360 con 0x559fac5dc970 2024-09-18T01:26:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.386+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.386+0000 7f7d44f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.386+0000 7f7d44f26800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.386+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e1700 con 0x559fac5dc970 2024-09-18T01:26:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.386+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.386+0000 7f7d44f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.386+0000 7f7d44f26800 20 started sync module instance, tier type = 2024-09-18T01:26:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.386+0000 7f7d44f26800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:26:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.386+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e0800 con 0x559fac5d7f80 2024-09-18T01:26:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.387+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.387+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94144280003408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e1aa0 con 0x559fac5d7f80 2024-09-18T01:26:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.387+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e22f0 con 0x559fac5d3930 2024-09-18T01:26:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.388+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94144280003408] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.388+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x559fac5d3930 2024-09-18T01:26:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.388+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94144280009376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e26e0 con 0x559fac5d3930 2024-09-18T01:26:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.388+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e2f30 con 0x559fac5dc970 2024-09-18T01:26:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.390+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94144280009376] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x559fac5d3930 2024-09-18T01:26:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.390+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.390+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94144280012512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e2b00 con 0x559fac5dc970 2024-09-18T01:26:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.390+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e3c30 con 0x559fac5d7f80 2024-09-18T01:26:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.391+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.391+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94144280017280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e44d0 con 0x559fac5d7f80 2024-09-18T01:26:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.391+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e4f80 con 0x559fac5d3930 2024-09-18T01:26:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.391+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94144280012512] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.392+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94144280017280] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.392+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x559fac5d3930 2024-09-18T01:26:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.393+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94144280015568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e4020 con 0x559fac5d3930 2024-09-18T01:26:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.393+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e5820 con 0x7f7d30064040 2024-09-18T01:26:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.394+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94144280015568] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x559fac5d3930 2024-09-18T01:26:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.394+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.394+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94144280021600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e4020 con 0x7f7d30064040 2024-09-18T01:26:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.394+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e5ea0 con 0x7f7d30064040 2024-09-18T01:26:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.395+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94144280021600] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.395+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.395+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94144280025456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e5e60 con 0x7f7d30064040 2024-09-18T01:26:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.395+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e6860 con 0x7f7d30064040 2024-09-18T01:26:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.396+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94144280025456] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.396+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.396+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94144280023584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e6820 con 0x7f7d30064040 2024-09-18T01:26:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.396+0000 7f7d44f26800 20 add_watcher() i=0 2024-09-18T01:26:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.396+0000 7f7d44f26800 20 add_watcher() i=1 2024-09-18T01:26:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.396+0000 7f7d44f26800 20 add_watcher() i=2 2024-09-18T01:26:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.396+0000 7f7d44f26800 20 add_watcher() i=3 2024-09-18T01:26:32.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.396+0000 7f7d44f26800 20 add_watcher() i=4 2024-09-18T01:26:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.396+0000 7f7d44f26800 20 add_watcher() i=5 2024-09-18T01:26:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.396+0000 7f7d44f26800 20 add_watcher() i=6 2024-09-18T01:26:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.397+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94144280023584] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.397+0000 7f7d44f26800 20 add_watcher() i=7 2024-09-18T01:26:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.397+0000 7f7d44f26800 2 all 8 watchers are set, enabling cache 2024-09-18T01:26:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.397+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e9cb0 con 0x559fac5d3930 2024-09-18T01:26:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.398+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7d38037040 con 0x559fac5d3930 2024-09-18T01:26:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.398+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94144280028480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac5e71d0 con 0x559fac5d3930 2024-09-18T01:26:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.399+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94144280028480] v35'220 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x559fac5d3930 2024-09-18T01:26:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.399+0000 7f7bf6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.399+0000 7f7d44f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:26:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.399+0000 7f7d44f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:26:32.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.399+0000 7f7d44f26800 5 note: GC not initialized 2024-09-18T01:26:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.400+0000 7f7bf5fe3640 20 reqs_thread_entry: start 2024-09-18T01:26:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.400+0000 7f7d44f26800 20 init_complete bucket index max shards: 11 2024-09-18T01:26:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.400+0000 7f7d44f26800 20 Filter name: none 2024-09-18T01:26:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.400+0000 7f7b677fe640 20 reqs_thread_entry: start 2024-09-18T01:26:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.400+0000 7f7d44f26800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:26:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.400+0000 7f7d44f26800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.400+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac61d210 con 0x7f7d30064040 2024-09-18T01:26:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.401+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.401+0000 7f7d44f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.401+0000 7f7d44f26800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-18T01:26:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.401+0000 7f7d44f26800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:26:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.401+0000 7f7d44f26800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-18T01:26:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.401+0000 7f7d44f26800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.401+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac61b850 con 0x7f7d30064040 2024-09-18T01:26:32.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.401+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.401+0000 7f7d44f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.401+0000 7f7d44f26800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-18T01:26:32.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.401+0000 7f7d44f26800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:26:32.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.401+0000 7f7d44f26800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T01:26:32.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.401+0000 7f7d44f26800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T01:26:32.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.401+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac61c120 con 0x7f7d30064040 2024-09-18T01:26:32.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.402+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v35'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.402+0000 7f7d44f26800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-18T01:26:32.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.402+0000 7f7d44f26800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:26:32.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.402+0000 7f7d44f26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-18T01:26:32.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.402+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94144280247408 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac620cb0 con 0x7f7d30064040 2024-09-18T01:26:32.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.403+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== watch-notify(notify (1) cookie 94144280021600 notify 150323855380 ret 0) ==== 598+0+0 (crc 0 0 0) 0x559fac61c4c0 con 0x7f7d30064040 2024-09-18T01:26:32.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.403+0000 7f7c17fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855380 cookie 94144280021600 notifier 4748 bl.length()=556 2024-09-18T01:26:32.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.403+0000 7f7c17fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-18T01:26:32.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.403+0000 7f7c17fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:26:32.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.403+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(65 notify.5 [notify cookie 94144280247408 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.403+0000 7f7c17fff640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f7c04003ea0 con 0x7f7d30064040 2024-09-18T01:26:32.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.403+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.403+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== watch-notify(notify_complete (2) cookie 94144280247408 notify 150323855380 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559fac61ba20 con 0x7f7d30064040 2024-09-18T01:26:32.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.403+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac61bc20 con 0x7f7d30064040 2024-09-18T01:26:32.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.404+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v35'11 uv11 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.404+0000 7f7d44f26800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:26:32.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.404+0000 7f7d44f26800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:26:32.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.404+0000 7f7d44f26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:26:32.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.404+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94144280247328 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559fac620c90 con 0x559fac5dc970 2024-09-18T01:26:32.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.405+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== watch-notify(notify (1) cookie 94144280012512 notify 150323855366 ret 0) ==== 219+0+0 (crc 0 0 0) 0x559fac364e00 con 0x559fac5dc970 2024-09-18T01:26:32.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.405+0000 7f7c17fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855366 cookie 94144280012512 notifier 4748 bl.length()=177 2024-09-18T01:26:32.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.405+0000 7f7c17fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:26:32.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.405+0000 7f7c17fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:26:32.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.405+0000 7f7c17fff640 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f7c04003ea0 con 0x559fac5dc970 2024-09-18T01:26:32.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.405+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(68 notify.2 [notify cookie 94144280247328 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.405+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.405+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== watch-notify(notify_complete (2) cookie 94144280247328 notify 150323855366 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7d34080680 con 0x559fac5dc970 2024-09-18T01:26:32.413 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T01:26:32.402400Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:26:32.402386Z","tags":[],"group_ids":[]} 2024-09-18T01:26:32.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.406+0000 7f7bf6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:32.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.406+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94144280028480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac61aef0 con 0x559fac5d3930 2024-09-18T01:26:32.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.407+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94144280028480] v35'221 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x559fac5d3930 2024-09-18T01:26:32.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.407+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94144280003408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac61aef0 con 0x559fac5d7f80 2024-09-18T01:26:32.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.408+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94144280003408] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.408+0000 7f7d44f26800 20 remove_watcher() i=0 2024-09-18T01:26:32.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.408+0000 7f7d44f26800 2 removed watcher, disabling cache 2024-09-18T01:26:32.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.408+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94144280009376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac61aef0 con 0x559fac5d3930 2024-09-18T01:26:32.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.409+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94144280009376] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x559fac5d3930 2024-09-18T01:26:32.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.409+0000 7f7d44f26800 20 remove_watcher() i=1 2024-09-18T01:26:32.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.409+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94144280012512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac61aef0 con 0x559fac5dc970 2024-09-18T01:26:32.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.410+0000 7f7d403e2640 1 -- 172.21.15.100:0/2980575644 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94144280012512] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d34057030 con 0x559fac5dc970 2024-09-18T01:26:32.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.410+0000 7f7d44f26800 20 remove_watcher() i=2 2024-09-18T01:26:32.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.410+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94144280017280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac61aef0 con 0x559fac5d7f80 2024-09-18T01:26:32.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.411+0000 7f7d40be3640 1 -- 172.21.15.100:0/2980575644 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94144280017280] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d30054040 con 0x559fac5d7f80 2024-09-18T01:26:32.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.412+0000 7f7d44f26800 20 remove_watcher() i=3 2024-09-18T01:26:32.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.412+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94144280015568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac61aef0 con 0x559fac5d3930 2024-09-18T01:26:32.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.413+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94144280015568] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x559fac5d3930 2024-09-18T01:26:32.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.413+0000 7f7d44f26800 20 remove_watcher() i=4 2024-09-18T01:26:32.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.413+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94144280021600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac61aef0 con 0x7f7d30064040 2024-09-18T01:26:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.414+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94144280021600] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.414+0000 7f7d44f26800 20 remove_watcher() i=5 2024-09-18T01:26:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.414+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94144280025456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac61aef0 con 0x7f7d30064040 2024-09-18T01:26:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.415+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94144280025456] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.415+0000 7f7d44f26800 20 remove_watcher() i=6 2024-09-18T01:26:32.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.415+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94144280023584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559fac61aef0 con 0x7f7d30064040 2024-09-18T01:26:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.416+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94144280023584] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d38037040 con 0x7f7d30064040 2024-09-18T01:26:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.416+0000 7f7d44f26800 20 remove_watcher() i=7 2024-09-18T01:26:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.416+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7d30064040 msgr2=0x7f7d300057b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.416+0000 7f7d44f26800 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7d30064040 0x7f7d300057b0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.416+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559fac5d3930 msgr2=0x559fac5d5df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.416+0000 7f7d44f26800 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559fac5d3930 0x559fac5d5df0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.416+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559fac5d7f80 msgr2=0x559fac5da370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.416+0000 7f7d44f26800 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559fac5d7f80 0x559fac5da370 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.416+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559fac5dc970 msgr2=0x559fac5dee30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.416+0000 7f7d44f26800 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559fac5dc970 0x559fac5dee30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.416+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c0c036af0 msgr2=0x7f7c0c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c0c036af0 0x7f7c0c038fb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7d34045be0 tx=0x7f7d3406d040 comp rx=0 tx=0).stop 2024-09-18T01:26:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5c1050 msgr2=0x559fac5c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d413e4640 1 -- 172.21.15.100:0/2980575644 reap_dead start 2024-09-18T01:26:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5c1050 0x559fac5c8330 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f7d3003fe60 tx=0x7f7d30022f10 comp rx=0 tx=0).stop 2024-09-18T01:26:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 shutdown_connections 2024-09-18T01:26:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 --2- 172.21.15.100:0/2980575644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5c1050 0x559fac5c8330 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 >> 172.21.15.100:0/2980575644 conn(0x559fac5bd400 msgr2=0x559fac5bb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 shutdown_connections 2024-09-18T01:26:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 -- 172.21.15.100:0/2980575644 wait complete. 2024-09-18T01:26:32.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 -- 172.21.15.100:0/1367219269 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c18036b40 msgr2=0x7f7c18039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 --2- 172.21.15.100:0/1367219269 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c18036b40 0x7f7c18039000 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7d34005570 tx=0x7f7d34005ac0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 -- 172.21.15.100:0/1367219269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5b4600 msgr2=0x559fac5b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 --2- 172.21.15.100:0/1367219269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5b4600 0x559fac5b4a20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7d3001d510 tx=0x7f7d30004e10 comp rx=0 tx=0).stop 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 -- 172.21.15.100:0/1367219269 shutdown_connections 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 --2- 172.21.15.100:0/1367219269 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c18036b40 0x7f7c18039000 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 --2- 172.21.15.100:0/1367219269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac5b4600 0x559fac5b4a20 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 -- 172.21.15.100:0/1367219269 >> 172.21.15.100:0/1367219269 conn(0x559fac5a9590 msgr2=0x559fac5ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 -- 172.21.15.100:0/1367219269 shutdown_connections 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 -- 172.21.15.100:0/1367219269 wait complete. 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559fac5a3da0 msgr2=0x559fac5a6190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559fac5a3da0 0x559fac5a6190 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559fac4a1a40 msgr2=0x559fac59d750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559fac4a1a40 0x559fac59d750 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559fac59fe60 msgr2=0x559fac5a2250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.417+0000 7f7d44f26800 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559fac59fe60 0x559fac5a2250 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.418+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c28036b40 msgr2=0x7f7c28039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.418+0000 7f7d44f26800 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7c28036b40 0x7f7c28039000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7d34057000 tx=0x7f7d34052000 comp rx=0 tx=0).stop 2024-09-18T01:26:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.418+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac49d600 msgr2=0x559fac412ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.418+0000 7f7d44f26800 1 --2- 172.21.15.100:0/1776073396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fac49d600 0x559fac412ec0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7d30000f80 tx=0x7f7d30001250 comp rx=0 tx=0).stop 2024-09-18T01:26:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.418+0000 7f7d413e4640 1 -- 172.21.15.100:0/1776073396 reap_dead start 2024-09-18T01:26:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.418+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 shutdown_connections 2024-09-18T01:26:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.418+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 >> 172.21.15.100:0/1776073396 conn(0x559fac498f10 msgr2=0x559fac586ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.418+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 shutdown_connections 2024-09-18T01:26:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.418+0000 7f7d44f26800 1 -- 172.21.15.100:0/1776073396 wait complete. 2024-09-18T01:26:32.427 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T01:26:32.402400Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:26:32.402386Z', 'tags': [], 'group_ids': []} 2024-09-18T01:26:32.444 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:26:32.450 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-18T01:26:32.450 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-18T01:26:32.450 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-18T01:26:32.451 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-18T01:26:32.497 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:26:32.497 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:26:32.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.496+0000 7f7628c0e800 1 Processor -- start 2024-09-18T01:26:32.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.496+0000 7f7628c0e800 1 -- start start 2024-09-18T01:26:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.496+0000 7f7628c0e800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5618b27ef4e0 0x5618b27ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.496+0000 7f7628c0e800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5618b26afb30 con 0x5618b27efe20 2024-09-18T01:26:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.496+0000 7f7628c0e800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5618b2691360 con 0x5618b27ef4e0 2024-09-18T01:26:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.497+0000 7f76242f7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5618b27ef4e0 0x5618b27ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.497+0000 7f761bfff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5618b27efe20 0x5618b27f49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:34544/0 (socket says 172.21.15.100:34544) 2024-09-18T01:26:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.497+0000 7f76242f7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5618b27ef4e0 0x5618b27ef8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37430/0 (socket says 172.21.15.100:37430) 2024-09-18T01:26:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.497+0000 7f761bfff640 1 -- 172.21.15.100:0/1130199918 learned_addr learned my addr 172.21.15.100:0/1130199918 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:26:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.497+0000 7f76242f7640 1 -- 172.21.15.100:0/1130199918 >> v1:172.21.15.92:6789/0 conn(0x5618b27efe20 legacy=0x5618b27f49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.497+0000 7f76242f7640 1 -- 172.21.15.100:0/1130199918 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618b26b7e00 con 0x5618b27ef4e0 2024-09-18T01:26:32.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.499+0000 7f76242f7640 1 --2- 172.21.15.100:0/1130199918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27ef4e0 0x5618b27ef8e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f761400a470 tx=0x7f7614045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2eb4fec21eea987 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.499+0000 7f7623af6640 1 -- 172.21.15.100:0/1130199918 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7614053570 con 0x5618b27ef4e0 2024-09-18T01:26:32.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.499+0000 7f7623af6640 1 -- 172.21.15.100:0/1130199918 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7614058070 con 0x5618b27ef4e0 2024-09-18T01:26:32.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.499+0000 7f7623af6640 1 -- 172.21.15.100:0/1130199918 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7614053880 con 0x5618b27ef4e0 2024-09-18T01:26:32.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.499+0000 7f7628c0e800 1 -- 172.21.15.100:0/1130199918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27ef4e0 msgr2=0x5618b27ef8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.499+0000 7f7628c0e800 1 --2- 172.21.15.100:0/1130199918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27ef4e0 0x5618b27ef8e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f761400a470 tx=0x7f7614045a20 comp rx=0 tx=0).stop 2024-09-18T01:26:32.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.500+0000 7f7628c0e800 1 -- 172.21.15.100:0/1130199918 shutdown_connections 2024-09-18T01:26:32.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.500+0000 7f7628c0e800 1 --2- 172.21.15.100:0/1130199918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27ef4e0 0x5618b27ef8e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.500+0000 7f7628c0e800 1 -- 172.21.15.100:0/1130199918 >> 172.21.15.100:0/1130199918 conn(0x5618b27eadd0 msgr2=0x5618b27ed1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.500+0000 7f7628c0e800 1 -- 172.21.15.100:0/1130199918 shutdown_connections 2024-09-18T01:26:32.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.500+0000 7f7628c0e800 1 -- 172.21.15.100:0/1130199918 wait complete. 2024-09-18T01:26:32.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.513+0000 7f7628c0e800 1 Processor -- start 2024-09-18T01:26:32.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.513+0000 7f7628c0e800 1 -- start start 2024-09-18T01:26:32.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.513+0000 7f7628c0e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27ef4e0 0x5618b2763da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.513+0000 7f7628c0e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618b273c360 con 0x5618b27ef4e0 2024-09-18T01:26:32.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.514+0000 7f76242f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27ef4e0 0x5618b2763da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.514+0000 7f76242f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27ef4e0 0x5618b2763da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37438/0 (socket says 172.21.15.100:37438) 2024-09-18T01:26:32.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.514+0000 7f76242f7640 1 -- 172.21.15.100:0/1447359945 learned_addr learned my addr 172.21.15.100:0/1447359945 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.514+0000 7f76242f7640 1 -- 172.21.15.100:0/1447359945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618b2689bc0 con 0x5618b27ef4e0 2024-09-18T01:26:32.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.514+0000 7f76242f7640 1 --2- 172.21.15.100:0/1447359945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27ef4e0 0x5618b2763da0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7614025c20 tx=0x7f7614051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c39763df029c05 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.514+0000 7f751260c640 1 -- 172.21.15.100:0/1447359945 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7614053ba0 con 0x5618b27ef4e0 2024-09-18T01:26:32.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.514+0000 7f751260c640 1 -- 172.21.15.100:0/1447359945 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7614063030 con 0x5618b27ef4e0 2024-09-18T01:26:32.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.514+0000 7f751260c640 1 -- 172.21.15.100:0/1447359945 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7614053440 con 0x5618b27ef4e0 2024-09-18T01:26:32.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.515+0000 7f7628c0e800 1 -- 172.21.15.100:0/1447359945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27ef4e0 msgr2=0x5618b2763da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.515+0000 7f7628c0e800 1 --2- 172.21.15.100:0/1447359945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27ef4e0 0x5618b2763da0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7614025c20 tx=0x7f7614051000 comp rx=0 tx=0).stop 2024-09-18T01:26:32.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.515+0000 7f7628c0e800 1 -- 172.21.15.100:0/1447359945 shutdown_connections 2024-09-18T01:26:32.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.515+0000 7f7628c0e800 1 --2- 172.21.15.100:0/1447359945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27ef4e0 0x5618b2763da0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.515+0000 7f7628c0e800 1 -- 172.21.15.100:0/1447359945 >> 172.21.15.100:0/1447359945 conn(0x5618b27eadd0 msgr2=0x5618b28da170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.515+0000 7f7628c0e800 1 -- 172.21.15.100:0/1447359945 shutdown_connections 2024-09-18T01:26:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.515+0000 7f7628c0e800 1 -- 172.21.15.100:0/1447359945 wait complete. 2024-09-18T01:26:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.515+0000 7f7628c0e800 1 Processor -- start 2024-09-18T01:26:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.515+0000 7f7628c0e800 1 -- start start 2024-09-18T01:26:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.515+0000 7f7628c0e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27efe20 0x5618b28dfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.515+0000 7f7628c0e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618b27f6500 con 0x5618b27efe20 2024-09-18T01:26:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.516+0000 7f76242f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27efe20 0x5618b28dfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.516+0000 7f76242f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27efe20 0x5618b28dfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37440/0 (socket says 172.21.15.100:37440) 2024-09-18T01:26:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.516+0000 7f76242f7640 1 -- 172.21.15.100:0/2137682668 learned_addr learned my addr 172.21.15.100:0/2137682668 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.516+0000 7f76242f7640 1 -- 172.21.15.100:0/2137682668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618b269dfe0 con 0x5618b27efe20 2024-09-18T01:26:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.516+0000 7f76242f7640 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27efe20 0x5618b28dfeb0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x5618b27634a0 tx=0x7f7614002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.516+0000 7f7510e09640 1 -- 172.21.15.100:0/2137682668 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7614078070 con 0x5618b27efe20 2024-09-18T01:26:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.516+0000 7f7510e09640 1 -- 172.21.15.100:0/2137682668 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7614053440 con 0x5618b27efe20 2024-09-18T01:26:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.516+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618b28e03f0 con 0x5618b27efe20 2024-09-18T01:26:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.516+0000 7f7510e09640 1 -- 172.21.15.100:0/2137682668 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7614053720 con 0x5618b27efe20 2024-09-18T01:26:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.517+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618b28de950 con 0x5618b27efe20 2024-09-18T01:26:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.517+0000 7f7510e09640 1 -- 172.21.15.100:0/2137682668 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f761407b070 con 0x5618b27efe20 2024-09-18T01:26:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.517+0000 7f7510e09640 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f750c036b40 0x7f750c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.517+0000 7f7510e09640 1 -- 172.21.15.100:0/2137682668 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f7614070070 con 0x5618b27efe20 2024-09-18T01:26:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.518+0000 7f761bfff640 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f750c036b40 0x7f750c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.518+0000 7f7628c0e800 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618b28ee730 0x5618b28f0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.518+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b28f1060 con 0x5618b28ee730 2024-09-18T01:26:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.518+0000 7f7624af8640 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618b28ee730 0x5618b28f0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.518+0000 7f761bfff640 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f750c036b40 0x7f750c039000 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f760c000f60 tx=0x7f760c0012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.518+0000 7f7624af8640 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618b28ee730 0x5618b28f0b20 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.518+0000 7f7624af8640 1 -- 172.21.15.100:0/2137682668 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b28ee730 2024-09-18T01:26:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.518+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b28f14b0 con 0x5618b28ee730 2024-09-18T01:26:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.519+0000 7f7624af8640 1 -- 172.21.15.100:0/2137682668 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b28ee730 2024-09-18T01:26:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.519+0000 7f7628c0e800 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618b28f32c0 0x5618b28f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.519+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b28f5d80 con 0x5618b28f32c0 2024-09-18T01:26:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.519+0000 7f76242f7640 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618b28f32c0 0x5618b28f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.519+0000 7f76242f7640 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618b28f32c0 0x5618b28f56b0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.519+0000 7f76242f7640 1 -- 172.21.15.100:0/2137682668 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f761407a030 con 0x5618b28f32c0 2024-09-18T01:26:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.519+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b28f2160 con 0x5618b28ee730 2024-09-18T01:26:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.520+0000 7f7624af8640 1 -- 172.21.15.100:0/2137682668 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b28ee730 2024-09-18T01:26:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.520+0000 7f7628c0e800 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5618b28f71c0 0x5618b28f95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.520+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b28f9cf0 con 0x5618b28f71c0 2024-09-18T01:26:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.520+0000 7f761bfff640 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5618b28f71c0 0x5618b28f95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.520+0000 7f761bfff640 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5618b28f71c0 0x5618b28f95b0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.521+0000 7f761bfff640 1 -- 172.21.15.100:0/2137682668 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f760c009050 con 0x5618b28f71c0 2024-09-18T01:26:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.521+0000 7f7628c0e800 1 Processor -- start 2024-09-18T01:26:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.521+0000 7f7628c0e800 1 -- start start 2024-09-18T01:26:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.521+0000 7f7628c0e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2907a60 0x5618b2907e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.521+0000 7f7628c0e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618b268b580 con 0x5618b2907a60 2024-09-18T01:26:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.521+0000 7f76242f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2907a60 0x5618b2907e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.521+0000 7f76242f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2907a60 0x5618b2907e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37446/0 (socket says 172.21.15.100:37446) 2024-09-18T01:26:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.521+0000 7f76242f7640 1 -- 172.21.15.100:0/1751575690 learned_addr learned my addr 172.21.15.100:0/1751575690 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.522+0000 7f76242f7640 1 -- 172.21.15.100:0/1751575690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618b29083c0 con 0x5618b2907a60 2024-09-18T01:26:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.522+0000 7f76242f7640 1 --2- 172.21.15.100:0/1751575690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2907a60 0x5618b2907e80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f761406afd0 tx=0x7f7614009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.522+0000 7f7509ffb640 1 -- 172.21.15.100:0/1751575690 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7614094030 con 0x5618b2907a60 2024-09-18T01:26:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.522+0000 7f7509ffb640 1 -- 172.21.15.100:0/1751575690 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761405e630 con 0x5618b2907a60 2024-09-18T01:26:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.522+0000 7f7628c0e800 1 -- 172.21.15.100:0/1751575690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618b2908650 con 0x5618b2907a60 2024-09-18T01:26:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.522+0000 7f7509ffb640 1 -- 172.21.15.100:0/1751575690 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7614009720 con 0x5618b2907a60 2024-09-18T01:26:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.522+0000 7f7628c0e800 1 -- 172.21.15.100:0/1751575690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618b290b330 con 0x5618b2907a60 2024-09-18T01:26:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.523+0000 7f7509ffb640 1 -- 172.21.15.100:0/1751575690 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7614097070 con 0x5618b2907a60 2024-09-18T01:26:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.523+0000 7f7509ffb640 1 --2- 172.21.15.100:0/1751575690 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74fc036af0 0x7f74fc038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.523+0000 7f7509ffb640 1 -- 172.21.15.100:0/1751575690 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f7614095070 con 0x5618b2907a60 2024-09-18T01:26:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.523+0000 7f761bfff640 1 --2- 172.21.15.100:0/1751575690 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74fc036af0 0x7f74fc038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.523+0000 7f7628c0e800 1 Processor -- start 2024-09-18T01:26:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.523+0000 7f761bfff640 1 --2- 172.21.15.100:0/1751575690 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74fc036af0 0x7f74fc038fb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f760c00bf50 tx=0x7f760c00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.524+0000 7f7628c0e800 1 -- start start 2024-09-18T01:26:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.524+0000 7f7628c0e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2914500 0x5618b2914900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.524+0000 7f7628c0e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618b28e2730 con 0x5618b2914500 2024-09-18T01:26:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.524+0000 7f76242f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2914500 0x5618b2914900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.524+0000 7f76242f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2914500 0x5618b2914900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37462/0 (socket says 172.21.15.100:37462) 2024-09-18T01:26:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.524+0000 7f76242f7640 1 -- 172.21.15.100:0/172286173 learned_addr learned my addr 172.21.15.100:0/172286173 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.524+0000 7f76242f7640 1 -- 172.21.15.100:0/172286173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618b2914ed0 con 0x5618b2914500 2024-09-18T01:26:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.524+0000 7f76242f7640 1 --2- 172.21.15.100:0/172286173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2914500 0x5618b2914900 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f761409bfd0 tx=0x7f761405a9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143e6c1c4b5e2c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.525+0000 7f75037fe640 1 -- 172.21.15.100:0/172286173 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76140ac020 con 0x5618b2914500 2024-09-18T01:26:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.525+0000 7f75037fe640 1 -- 172.21.15.100:0/172286173 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76140098c0 con 0x5618b2914500 2024-09-18T01:26:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.525+0000 7f75037fe640 1 -- 172.21.15.100:0/172286173 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f761406ae10 con 0x5618b2914500 2024-09-18T01:26:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.525+0000 7f7628c0e800 1 -- 172.21.15.100:0/172286173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2914500 msgr2=0x5618b2914900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.525+0000 7f7628c0e800 1 --2- 172.21.15.100:0/172286173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2914500 0x5618b2914900 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f761409bfd0 tx=0x7f761405a9d0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.525+0000 7f7628c0e800 1 -- 172.21.15.100:0/172286173 shutdown_connections 2024-09-18T01:26:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.525+0000 7f7628c0e800 1 --2- 172.21.15.100:0/172286173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2914500 0x5618b2914900 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.525+0000 7f7628c0e800 1 -- 172.21.15.100:0/172286173 >> 172.21.15.100:0/172286173 conn(0x5618b29108f0 msgr2=0x5618b290e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.525+0000 7f7628c0e800 1 -- 172.21.15.100:0/172286173 shutdown_connections 2024-09-18T01:26:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.525+0000 7f7628c0e800 1 -- 172.21.15.100:0/172286173 wait complete. 2024-09-18T01:26:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.525+0000 7f7628c0e800 1 Processor -- start 2024-09-18T01:26:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.525+0000 7f7628c0e800 1 -- start start 2024-09-18T01:26:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.526+0000 7f7628c0e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2914500 0x5618b291b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.526+0000 7f7628c0e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618b2915360 con 0x5618b2914500 2024-09-18T01:26:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.526+0000 7f76242f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2914500 0x5618b291b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.526+0000 7f76242f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2914500 0x5618b291b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37470/0 (socket says 172.21.15.100:37470) 2024-09-18T01:26:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.526+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 learned_addr learned my addr 172.21.15.100:0/3084957005 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.526+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618b291bce0 con 0x5618b2914500 2024-09-18T01:26:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.526+0000 7f76242f7640 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2914500 0x5618b291b7a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f761405ee90 tx=0x7f7614071e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.526+0000 7f7501ffb640 1 -- 172.21.15.100:0/3084957005 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76140c1070 con 0x5618b2914500 2024-09-18T01:26:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.526+0000 7f7501ffb640 1 -- 172.21.15.100:0/3084957005 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761407ce20 con 0x5618b2914500 2024-09-18T01:26:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.526+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618b291bce0 con 0x5618b2914500 2024-09-18T01:26:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.527+0000 7f7501ffb640 1 -- 172.21.15.100:0/3084957005 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f761407d880 con 0x5618b2914500 2024-09-18T01:26:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.527+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618b291bce0 con 0x5618b2914500 2024-09-18T01:26:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.527+0000 7f7501ffb640 1 -- 172.21.15.100:0/3084957005 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f76140c4070 con 0x5618b2914500 2024-09-18T01:26:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.528+0000 7f7501ffb640 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74f4036b40 0x7f74f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.528+0000 7f7501ffb640 1 -- 172.21.15.100:0/3084957005 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f76140b8030 con 0x5618b2914500 2024-09-18T01:26:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.528+0000 7f761bfff640 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74f4036b40 0x7f74f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.528+0000 7f7628c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.528+0000 7f761bfff640 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74f4036b40 0x7f74f4039000 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f760c001b60 tx=0x7f760c010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.528+0000 7f7628c0e800 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618b2926f20 0x5618b29293e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.528+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b2929b30 con 0x5618b2926f20 2024-09-18T01:26:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.528+0000 7f7624af8640 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618b2926f20 0x5618b29293e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7624af8640 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618b2926f20 0x5618b29293e0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7628c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7628c0e800 20 realm 2024-09-18T01:26:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7628c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b2929f40 con 0x5618b2926f20 2024-09-18T01:26:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7628c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7628c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:26:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7628c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b292a810 con 0x5618b2926f20 2024-09-18T01:26:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7628c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7628c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2926f20 2024-09-18T01:26:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.529+0000 7f7628c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.530+0000 7f7628c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.530+0000 7f7628c0e800 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618b292b910 0x5618b292dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.530+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b292e2c0 con 0x5618b292b910 2024-09-18T01:26:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.530+0000 7f76242f7640 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618b292b910 0x5618b292dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.530+0000 7f76242f7640 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618b292b910 0x5618b292dd00 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.530+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.530+0000 7f7628c0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:26:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.530+0000 7f7628c0e800 20 searching for the correct realm 2024-09-18T01:26:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.530+0000 7f7628c0e800 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5618b2930250 0x5618b2932710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.530+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b2932de0 con 0x5618b2930250 2024-09-18T01:26:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.530+0000 7f761bfff640 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5618b2930250 0x5618b2932710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.531+0000 7f761bfff640 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5618b2930250 0x5618b2932710 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.531+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f760c009050 con 0x5618b2930250 2024-09-18T01:26:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.531+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b2932de0 con 0x5618b292b910 2024-09-18T01:26:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.531+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.531+0000 7f76242f7640 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f76140b1040 0x7f761407da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.531+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b2932de0 con 0x7f76140b1040 2024-09-18T01:26:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.532+0000 7f7624af8640 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f76140b1040 0x7f761407da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.532+0000 7f7624af8640 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f76140b1040 0x7f761407da20 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.532+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.532+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2926f20 2024-09-18T01:26:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.532+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.532+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2926f20 2024-09-18T01:26:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.533+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.533+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x7f76140b1040 2024-09-18T01:26:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.533+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.533+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x7f76140b1040 2024-09-18T01:26:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.533+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.533+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b292b910 2024-09-18T01:26:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.533+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.533+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2930250 2024-09-18T01:26:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.534+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f760c009050 con 0x5618b2930250 2024-09-18T01:26:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.534+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2926f20 2024-09-18T01:26:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.534+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.534+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b292b910 2024-09-18T01:26:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.534+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.534+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2926f20 2024-09-18T01:26:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.534+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.534+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b292b910 2024-09-18T01:26:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.535+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.535+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2930250 2024-09-18T01:26:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.535+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f760c009050 con 0x5618b2930250 2024-09-18T01:26:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.535+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2930250 2024-09-18T01:26:32.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.535+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f760c009050 con 0x5618b2930250 2024-09-18T01:26:32.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.535+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x7f76140b1040 2024-09-18T01:26:32.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.535+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.535+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2930250 2024-09-18T01:26:32.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.536+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f760c009050 con 0x5618b2930250 2024-09-18T01:26:32.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.536+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2930250 2024-09-18T01:26:32.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.536+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f760c009050 con 0x5618b2930250 2024-09-18T01:26:32.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.536+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2926f20 2024-09-18T01:26:32.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.536+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.536+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2926f20 2024-09-18T01:26:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.536+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.536+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x7f76140b1040 2024-09-18T01:26:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.537+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.537+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2930250 2024-09-18T01:26:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.537+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f760c009050 con 0x5618b2930250 2024-09-18T01:26:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.537+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b292b910 2024-09-18T01:26:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.537+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.537+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2926f20 2024-09-18T01:26:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.537+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.537+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x7f76140b1040 2024-09-18T01:26:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.538+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.538+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2930250 2024-09-18T01:26:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.538+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f760c009050 con 0x5618b2930250 2024-09-18T01:26:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.538+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b292b910 2024-09-18T01:26:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.538+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.538+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b292b910 2024-09-18T01:26:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.538+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.538+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2930250 2024-09-18T01:26:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f760c009050 con 0x5618b2930250 2024-09-18T01:26:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x7f76140b1040 2024-09-18T01:26:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b2926f20 2024-09-18T01:26:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5618b292abb0 con 0x5618b292b910 2024-09-18T01:26:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f7628c0e800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:26:32.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f7628c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:26:32.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f7628c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:26:32.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f7628c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:26:32.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f7628c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:26:32.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f7628c0e800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:26:32.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f7628c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.539+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b292eb80 con 0x5618b2926f20 2024-09-18T01:26:32.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b292ef70 con 0x5618b2926f20 2024-09-18T01:26:32.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:32.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b292ef70 con 0x7f76140b1040 2024-09-18T01:26:32.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:26:32.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 20 zone default found 2024-09-18T01:26:32.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 4 Realm: () 2024-09-18T01:26:32.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:26:32.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:26:32.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:26:32.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 20 zonegroup default 2024-09-18T01:26:32.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.540+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b292e7d0 con 0x7f76140b1040 2024-09-18T01:26:32.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.541+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.541+0000 7f7628c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.541+0000 7f7628c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.541+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b2934ca0 con 0x5618b2930250 2024-09-18T01:26:32.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.541+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f760c009050 con 0x5618b2930250 2024-09-18T01:26:32.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.541+0000 7f7628c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.541+0000 7f7628c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.541+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b2935150 con 0x5618b2930250 2024-09-18T01:26:32.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.541+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f760c009050 con 0x5618b2930250 2024-09-18T01:26:32.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.541+0000 7f7628c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.541+0000 7f7628c0e800 20 started sync module instance, tier type = 2024-09-18T01:26:32.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.541+0000 7f7628c0e800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:26:32.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.541+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b29340e0 con 0x5618b292b910 2024-09-18T01:26:32.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.542+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.542+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94664075199696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b2933d40 con 0x5618b292b910 2024-09-18T01:26:32.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.542+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b2936080 con 0x5618b2926f20 2024-09-18T01:26:32.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.543+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94664075199696] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.544+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.544+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94664075205584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b29364a0 con 0x5618b2926f20 2024-09-18T01:26:32.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.544+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b2936e60 con 0x5618b2930250 2024-09-18T01:26:32.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.545+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94664075205584] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.545+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f760c009050 con 0x5618b2930250 2024-09-18T01:26:32.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.545+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94664075206640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b2936410 con 0x5618b2930250 2024-09-18T01:26:32.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.545+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b2937d20 con 0x5618b292b910 2024-09-18T01:26:32.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.546+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.546+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94664075213424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b29385c0 con 0x5618b292b910 2024-09-18T01:26:32.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.546+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b2939090 con 0x5618b2926f20 2024-09-18T01:26:32.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.546+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94664075206640] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f760c009050 con 0x5618b2930250 2024-09-18T01:26:32.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.547+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.547+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94664075217792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b2939050 con 0x5618b2926f20 2024-09-18T01:26:32.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.547+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b2939ad0 con 0x7f76140b1040 2024-09-18T01:26:32.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.547+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94664075213424] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.548+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.548+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94664075215120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b2939ad0 con 0x7f76140b1040 2024-09-18T01:26:32.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.548+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b293a4e0 con 0x7f76140b1040 2024-09-18T01:26:32.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.549+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94664075217792] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.549+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94664075215120] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.550+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.550+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94664075220512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b2939a40 con 0x7f76140b1040 2024-09-18T01:26:32.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.550+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b293a990 con 0x7f76140b1040 2024-09-18T01:26:32.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.551+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94664075220512] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.551+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.551+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94664075223088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b293a900 con 0x7f76140b1040 2024-09-18T01:26:32.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.551+0000 7f7628c0e800 20 add_watcher() i=0 2024-09-18T01:26:32.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.551+0000 7f7628c0e800 20 add_watcher() i=1 2024-09-18T01:26:32.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.551+0000 7f7628c0e800 20 add_watcher() i=2 2024-09-18T01:26:32.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.551+0000 7f7628c0e800 20 add_watcher() i=3 2024-09-18T01:26:32.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.551+0000 7f7628c0e800 20 add_watcher() i=4 2024-09-18T01:26:32.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.551+0000 7f7628c0e800 20 add_watcher() i=5 2024-09-18T01:26:32.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.551+0000 7f7628c0e800 20 add_watcher() i=6 2024-09-18T01:26:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.552+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94664075223088] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.552+0000 7f7628c0e800 20 add_watcher() i=7 2024-09-18T01:26:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.552+0000 7f7628c0e800 2 all 8 watchers are set, enabling cache 2024-09-18T01:26:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.552+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b293dd30 con 0x5618b2926f20 2024-09-18T01:26:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.552+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.552+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94664075224608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b293b250 con 0x5618b2926f20 2024-09-18T01:26:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.553+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94664075224608] v35'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.553+0000 7f74da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.554+0000 7f7628c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:26:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.554+0000 7f7628c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:26:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.554+0000 7f7628c0e800 5 note: GC not initialized 2024-09-18T01:26:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.554+0000 7f74d97e2640 20 reqs_thread_entry: start 2024-09-18T01:26:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.554+0000 7f7628c0e800 20 init_complete bucket index max shards: 11 2024-09-18T01:26:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.554+0000 7f7628c0e800 20 Filter name: none 2024-09-18T01:26:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.554+0000 7f744affd640 20 reqs_thread_entry: start 2024-09-18T01:26:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.554+0000 7f7628c0e800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-18T01:26:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.554+0000 7f7628c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.554+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5618b2971210 con 0x5618b292b910 2024-09-18T01:26:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.555+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.555+0000 7f7628c0e800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:26:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.555+0000 7f7628c0e800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-18T01:26:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.555+0000 7f7628c0e800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T01:26:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.555+0000 7f7628c0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:26:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.555+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b2975610 con 0x7f76140b1040 2024-09-18T01:26:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.556+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v35'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-18T01:26:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.557+0000 7f74da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.557+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94664075224608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b296ef60 con 0x5618b2926f20 2024-09-18T01:26:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.558+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94664075224608] v35'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.558+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94664075199696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b296ef60 con 0x5618b292b910 2024-09-18T01:26:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.559+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94664075199696] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.559+0000 7f7628c0e800 20 remove_watcher() i=0 2024-09-18T01:26:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.559+0000 7f7628c0e800 2 removed watcher, disabling cache 2024-09-18T01:26:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.559+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94664075205584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b296ef60 con 0x5618b2926f20 2024-09-18T01:26:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.560+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94664075205584] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.560+0000 7f7628c0e800 20 remove_watcher() i=1 2024-09-18T01:26:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.560+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94664075206640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b296ef60 con 0x5618b2930250 2024-09-18T01:26:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.561+0000 7f761bfff640 1 -- 172.21.15.100:0/3084957005 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94664075206640] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f760c009050 con 0x5618b2930250 2024-09-18T01:26:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.561+0000 7f7628c0e800 20 remove_watcher() i=2 2024-09-18T01:26:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.561+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94664075213424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b29344d0 con 0x5618b292b910 2024-09-18T01:26:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.562+0000 7f76242f7640 1 -- 172.21.15.100:0/3084957005 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94664075213424] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76140c3030 con 0x5618b292b910 2024-09-18T01:26:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.562+0000 7f7628c0e800 20 remove_watcher() i=3 2024-09-18T01:26:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.562+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94664075217792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b29344d0 con 0x5618b2926f20 2024-09-18T01:26:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.564+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94664075217792] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x5618b2926f20 2024-09-18T01:26:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.564+0000 7f7628c0e800 20 remove_watcher() i=4 2024-09-18T01:26:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.564+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94664075215120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b29344d0 con 0x7f76140b1040 2024-09-18T01:26:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.565+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94664075215120] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.565+0000 7f7628c0e800 20 remove_watcher() i=5 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.565+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94664075220512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b2938110 con 0x7f76140b1040 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.566+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94664075220512] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.566+0000 7f7628c0e800 20 remove_watcher() i=6 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.566+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94664075223088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5618b2939620 con 0x7f76140b1040 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94664075223088] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f761c00a4a0 con 0x7f76140b1040 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 20 remove_watcher() i=7 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f76140b1040 msgr2=0x7f761407da20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f76140b1040 0x7f761407da20 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618b2926f20 msgr2=0x5618b29293e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618b2926f20 0x5618b29293e0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618b292b910 msgr2=0x5618b292dd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618b292b910 0x5618b292dd00 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5618b2930250 msgr2=0x5618b2932710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5618b2930250 0x5618b2932710 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74f4036b40 msgr2=0x7f74f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74f4036b40 0x7f74f4039000 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f760c001b60 tx=0x7f760c010000 comp rx=0 tx=0).stop 2024-09-18T01:26:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2914500 msgr2=0x5618b291b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 --2- 172.21.15.100:0/3084957005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2914500 0x5618b291b7a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f761405ee90 tx=0x7f7614071e90 comp rx=0 tx=0).stop 2024-09-18T01:26:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 reap_dead start 2024-09-18T01:26:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7624af8640 1 -- 172.21.15.100:0/3084957005 reap_dead start 2024-09-18T01:26:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 shutdown_connections 2024-09-18T01:26:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 >> 172.21.15.100:0/3084957005 conn(0x5618b29108f0 msgr2=0x5618b290e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 shutdown_connections 2024-09-18T01:26:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/3084957005 wait complete. 2024-09-18T01:26:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/1751575690 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74fc036af0 msgr2=0x7f74fc038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 --2- 172.21.15.100:0/1751575690 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74fc036af0 0x7f74fc038fb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f760c00bf50 tx=0x7f760c00f000 comp rx=0 tx=0).stop 2024-09-18T01:26:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/1751575690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2907a60 msgr2=0x5618b2907e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 --2- 172.21.15.100:0/1751575690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2907a60 0x5618b2907e80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f761406afd0 tx=0x7f7614009cd0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/1751575690 shutdown_connections 2024-09-18T01:26:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 --2- 172.21.15.100:0/1751575690 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74fc036af0 0x7f74fc038fb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 --2- 172.21.15.100:0/1751575690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b2907a60 0x5618b2907e80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/1751575690 >> 172.21.15.100:0/1751575690 conn(0x5618b28fc9f0 msgr2=0x5618b28ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/1751575690 shutdown_connections 2024-09-18T01:26:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.568+0000 7f7628c0e800 1 -- 172.21.15.100:0/1751575690 wait complete. 2024-09-18T01:26:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5618b28f71c0 msgr2=0x5618b28f95b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7628c0e800 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5618b28f71c0 0x5618b28f95b0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618b28ee730 msgr2=0x5618b28f0b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7628c0e800 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618b28ee730 0x5618b28f0b20 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618b28f32c0 msgr2=0x5618b28f56b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7628c0e800 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5618b28f32c0 0x5618b28f56b0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f750c036b40 msgr2=0x7f750c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7628c0e800 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f750c036b40 0x7f750c039000 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f760c000f60 tx=0x7f760c0012b0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27efe20 msgr2=0x5618b28dfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7628c0e800 1 --2- 172.21.15.100:0/2137682668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618b27efe20 0x5618b28dfeb0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x5618b27634a0 tx=0x7f7614002fb0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7624af8640 1 -- 172.21.15.100:0/2137682668 reap_dead start 2024-09-18T01:26:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 shutdown_connections 2024-09-18T01:26:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 >> 172.21.15.100:0/2137682668 conn(0x5618b27eadd0 msgr2=0x5618b28d89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 shutdown_connections 2024-09-18T01:26:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.569+0000 7f7628c0e800 1 -- 172.21.15.100:0/2137682668 wait complete. 2024-09-18T01:26:32.578 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-18T01:26:32.584 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:26:32.584 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-18T01:26:32.590 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:26:32.590 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-18T01:26:32.590 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-18T01:26:32.590 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-18T01:26:32.590 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-18T01:26:32.635 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:26:32.636 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:26:32.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.635+0000 7f4416f33800 1 Processor -- start 2024-09-18T01:26:32.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.635+0000 7f4416f33800 1 -- start start 2024-09-18T01:26:32.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.635+0000 7f4416f33800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5591ddb9e920 0x5591ddba0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.635+0000 7f4416f33800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5591dda5ab30 con 0x5591ddb9a4e0 2024-09-18T01:26:32.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.635+0000 7f4416f33800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5591dda3c360 con 0x5591ddb9e920 2024-09-18T01:26:32.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.636+0000 7f440bfff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5591ddb9e920 0x5591ddba0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.636+0000 7f440bfff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5591ddb9e920 0x5591ddba0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37480/0 (socket says 172.21.15.100:37480) 2024-09-18T01:26:32.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.636+0000 7f440bfff640 1 -- 172.21.15.100:0/3593830359 learned_addr learned my addr 172.21.15.100:0/3593830359 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.636+0000 7f440bfff640 1 -- 172.21.15.100:0/3593830359 >> v1:172.21.15.92:6789/0 conn(0x5591ddb9a4e0 legacy=0x5591ddb9a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.636+0000 7f440bfff640 1 -- 172.21.15.100:0/3593830359 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591dda62e00 con 0x5591ddb9e920 2024-09-18T01:26:32.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.638+0000 7f440bfff640 1 --2- 172.21.15.100:0/3593830359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9e920 0x5591ddba0d10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00a520 tx=0x7f43fc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf345e44519a61e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.638+0000 7f4412423640 1 -- 172.21.15.100:0/3593830359 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43fc055070 con 0x5591ddb9e920 2024-09-18T01:26:32.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.638+0000 7f4412423640 1 -- 172.21.15.100:0/3593830359 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43fc0515b0 con 0x5591ddb9e920 2024-09-18T01:26:32.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.638+0000 7f4412423640 1 -- 172.21.15.100:0/3593830359 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43fc0518d0 con 0x5591ddb9e920 2024-09-18T01:26:32.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.638+0000 7f4416f33800 1 -- 172.21.15.100:0/3593830359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9e920 msgr2=0x5591ddba0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.638+0000 7f4416f33800 1 --2- 172.21.15.100:0/3593830359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9e920 0x5591ddba0d10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00a520 tx=0x7f43fc045ba0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.638+0000 7f4416f33800 1 -- 172.21.15.100:0/3593830359 shutdown_connections 2024-09-18T01:26:32.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.638+0000 7f4416f33800 1 --2- 172.21.15.100:0/3593830359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9e920 0x5591ddba0d10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.638+0000 7f4416f33800 1 -- 172.21.15.100:0/3593830359 >> 172.21.15.100:0/3593830359 conn(0x5591ddb95dd0 msgr2=0x5591ddb981f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.638+0000 7f4416f33800 1 -- 172.21.15.100:0/3593830359 shutdown_connections 2024-09-18T01:26:32.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.639+0000 7f4416f33800 1 -- 172.21.15.100:0/3593830359 wait complete. 2024-09-18T01:26:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.652+0000 7f4416f33800 1 Processor -- start 2024-09-18T01:26:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.652+0000 7f4416f33800 1 -- start start 2024-09-18T01:26:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.652+0000 7f4416f33800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9a4e0 0x5591ddc89770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.652+0000 7f4416f33800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5591ddae7360 con 0x5591ddb9a4e0 2024-09-18T01:26:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.653+0000 7f4412c24640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9a4e0 0x5591ddc89770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.653+0000 7f4412c24640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9a4e0 0x5591ddc89770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37494/0 (socket says 172.21.15.100:37494) 2024-09-18T01:26:32.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.653+0000 7f4412c24640 1 -- 172.21.15.100:0/2227476719 learned_addr learned my addr 172.21.15.100:0/2227476719 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.653+0000 7f4412c24640 1 -- 172.21.15.100:0/2227476719 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591dda34bc0 con 0x5591ddb9a4e0 2024-09-18T01:26:32.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.653+0000 7f4412c24640 1 --2- 172.21.15.100:0/2227476719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9a4e0 0x5591ddc89770 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4404001d50 tx=0x7f440400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f964611e74dd608 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.653+0000 7f4300e09640 1 -- 172.21.15.100:0/2227476719 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f440400f400 con 0x5591ddb9a4e0 2024-09-18T01:26:32.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.653+0000 7f4300e09640 1 -- 172.21.15.100:0/2227476719 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440400f5a0 con 0x5591ddb9a4e0 2024-09-18T01:26:32.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.653+0000 7f4300e09640 1 -- 172.21.15.100:0/2227476719 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f440400f7d0 con 0x5591ddb9a4e0 2024-09-18T01:26:32.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.654+0000 7f4416f33800 1 -- 172.21.15.100:0/2227476719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9a4e0 msgr2=0x5591ddc89770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.654+0000 7f4416f33800 1 --2- 172.21.15.100:0/2227476719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9a4e0 0x5591ddc89770 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4404001d50 tx=0x7f440400b5b0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.654+0000 7f4416f33800 1 -- 172.21.15.100:0/2227476719 shutdown_connections 2024-09-18T01:26:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.654+0000 7f4416f33800 1 --2- 172.21.15.100:0/2227476719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9a4e0 0x5591ddc89770 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.654+0000 7f4416f33800 1 -- 172.21.15.100:0/2227476719 >> 172.21.15.100:0/2227476719 conn(0x5591ddb95dd0 msgr2=0x5591ddc85130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.654+0000 7f4416f33800 1 -- 172.21.15.100:0/2227476719 shutdown_connections 2024-09-18T01:26:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.654+0000 7f4416f33800 1 -- 172.21.15.100:0/2227476719 wait complete. 2024-09-18T01:26:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.654+0000 7f4416f33800 1 Processor -- start 2024-09-18T01:26:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.654+0000 7f4416f33800 1 -- start start 2024-09-18T01:26:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.655+0000 7f4416f33800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9a4e0 0x5591ddc94e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.655+0000 7f4416f33800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5591ddba1550 con 0x5591ddb9a4e0 2024-09-18T01:26:32.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.655+0000 7f4412c24640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9a4e0 0x5591ddc94e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.655+0000 7f4412c24640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9a4e0 0x5591ddc94e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37498/0 (socket says 172.21.15.100:37498) 2024-09-18T01:26:32.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.655+0000 7f4412c24640 1 -- 172.21.15.100:0/3597281059 learned_addr learned my addr 172.21.15.100:0/3597281059 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.655+0000 7f4412c24640 1 -- 172.21.15.100:0/3597281059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591dda48fe0 con 0x5591ddb9a4e0 2024-09-18T01:26:32.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.655+0000 7f4412c24640 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9a4e0 0x5591ddc94e50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f440400b5f0 tx=0x7f4404000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.656+0000 7f42ff606640 1 -- 172.21.15.100:0/3597281059 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f440401a7c0 con 0x5591ddb9a4e0 2024-09-18T01:26:32.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.656+0000 7f42ff606640 1 -- 172.21.15.100:0/3597281059 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440401a960 con 0x5591ddb9a4e0 2024-09-18T01:26:32.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.656+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591ddb0ee60 con 0x5591ddb9a4e0 2024-09-18T01:26:32.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.656+0000 7f42ff606640 1 -- 172.21.15.100:0/3597281059 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f440401ac40 con 0x5591ddb9a4e0 2024-09-18T01:26:32.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.656+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591ddc95410 con 0x5591ddb9a4e0 2024-09-18T01:26:32.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.657+0000 7f42ff606640 1 -- 172.21.15.100:0/3597281059 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4404017070 con 0x5591ddb9a4e0 2024-09-18T01:26:32.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.657+0000 7f42ff606640 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42f8036b40 0x7f42f8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.657+0000 7f42ff606640 1 -- 172.21.15.100:0/3597281059 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4404015020 con 0x5591ddb9a4e0 2024-09-18T01:26:32.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.657+0000 7f440bfff640 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42f8036b40 0x7f42f8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.657+0000 7f4416f33800 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591ddb9e920 0x5591ddc99280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.657+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddc99880 con 0x5591ddb9e920 2024-09-18T01:26:32.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.657+0000 7f4413425640 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591ddb9e920 0x5591ddc99280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.657+0000 7f440bfff640 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42f8036b40 0x7f42f8039000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f43fc057000 tx=0x7f43fc052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.657+0000 7f4413425640 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591ddb9e920 0x5591ddc99280 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.658+0000 7f4413425640 1 -- 172.21.15.100:0/3597281059 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddb9e920 2024-09-18T01:26:32.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.658+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddc96850 con 0x5591ddb9e920 2024-09-18T01:26:32.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.658+0000 7f4413425640 1 -- 172.21.15.100:0/3597281059 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddb9e920 2024-09-18T01:26:32.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.658+0000 7f4416f33800 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591ddc9bbb0 0x5591ddc9dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.658+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddc9e690 con 0x5591ddc9bbb0 2024-09-18T01:26:32.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.658+0000 7f4412c24640 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591ddc9bbb0 0x5591ddc9dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.658+0000 7f4412c24640 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591ddc9bbb0 0x5591ddc9dfa0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.659+0000 7f4412c24640 1 -- 172.21.15.100:0/3597281059 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f440402e070 con 0x5591ddc9bbb0 2024-09-18T01:26:32.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.659+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddc9aa50 con 0x5591ddb9e920 2024-09-18T01:26:32.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.659+0000 7f4413425640 1 -- 172.21.15.100:0/3597281059 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddb9e920 2024-09-18T01:26:32.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.659+0000 7f4416f33800 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5591ddc9faf0 0x5591ddca1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.659+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddca25d0 con 0x5591ddc9faf0 2024-09-18T01:26:32.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.659+0000 7f440bfff640 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5591ddc9faf0 0x5591ddca1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.660+0000 7f440bfff640 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5591ddc9faf0 0x5591ddca1ee0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.660+0000 7f440bfff640 1 -- 172.21.15.100:0/3597281059 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddc9faf0 2024-09-18T01:26:32.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.660+0000 7f4416f33800 1 Processor -- start 2024-09-18T01:26:32.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.660+0000 7f4416f33800 1 -- start start 2024-09-18T01:26:32.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.661+0000 7f4416f33800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddcb0320 0x5591ddcb0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.661+0000 7f4416f33800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5591dda36580 con 0x5591ddcb0320 2024-09-18T01:26:32.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.661+0000 7f4412c24640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddcb0320 0x5591ddcb0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.661+0000 7f4412c24640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddcb0320 0x5591ddcb0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37506/0 (socket says 172.21.15.100:37506) 2024-09-18T01:26:32.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.661+0000 7f4412c24640 1 -- 172.21.15.100:0/644517371 learned_addr learned my addr 172.21.15.100:0/644517371 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.661+0000 7f4412c24640 1 -- 172.21.15.100:0/644517371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591ddcb0c80 con 0x5591ddcb0320 2024-09-18T01:26:32.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.661+0000 7f4412c24640 1 --2- 172.21.15.100:0/644517371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddcb0320 0x5591ddcb0740 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f440404b2d0 tx=0x7f440400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.661+0000 7f42fce01640 1 -- 172.21.15.100:0/644517371 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4404017880 con 0x5591ddcb0320 2024-09-18T01:26:32.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.661+0000 7f42fce01640 1 -- 172.21.15.100:0/644517371 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440401c450 con 0x5591ddcb0320 2024-09-18T01:26:32.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.661+0000 7f4416f33800 1 -- 172.21.15.100:0/644517371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591ddcb0f10 con 0x5591ddcb0320 2024-09-18T01:26:32.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.661+0000 7f42fce01640 1 -- 172.21.15.100:0/644517371 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f440401c730 con 0x5591ddcb0320 2024-09-18T01:26:32.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.662+0000 7f4416f33800 1 -- 172.21.15.100:0/644517371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591ddcb0f10 con 0x5591ddcb0320 2024-09-18T01:26:32.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.662+0000 7f42fce01640 1 -- 172.21.15.100:0/644517371 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f440400e070 con 0x5591ddcb0320 2024-09-18T01:26:32.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.662+0000 7f42fce01640 1 --2- 172.21.15.100:0/644517371 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42ec036b40 0x7f42ec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.662+0000 7f42fce01640 1 -- 172.21.15.100:0/644517371 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4404038020 con 0x5591ddcb0320 2024-09-18T01:26:32.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.662+0000 7f440bfff640 1 --2- 172.21.15.100:0/644517371 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42ec036b40 0x7f42ec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.663+0000 7f4416f33800 1 Processor -- start 2024-09-18T01:26:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.663+0000 7f440bfff640 1 --2- 172.21.15.100:0/644517371 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42ec036b40 0x7f42ec039000 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f43fc005570 tx=0x7f43fc005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.663+0000 7f4416f33800 1 -- start start 2024-09-18T01:26:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.663+0000 7f4416f33800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddc90e80 0x5591ddc91280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.663+0000 7f4416f33800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5591ddc89f20 con 0x5591ddc90e80 2024-09-18T01:26:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.663+0000 7f4412c24640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddc90e80 0x5591ddc91280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.663+0000 7f4412c24640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddc90e80 0x5591ddc91280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37508/0 (socket says 172.21.15.100:37508) 2024-09-18T01:26:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.663+0000 7f4412c24640 1 -- 172.21.15.100:0/565948105 learned_addr learned my addr 172.21.15.100:0/565948105 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.664+0000 7f4412c24640 1 -- 172.21.15.100:0/565948105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591ddc917c0 con 0x5591ddc90e80 2024-09-18T01:26:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.664+0000 7f4412c24640 1 --2- 172.21.15.100:0/565948105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddc90e80 0x5591ddc91280 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4404005fd0 tx=0x7f4404031da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0b15bf45580899 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.664+0000 7f42f67fc640 1 -- 172.21.15.100:0/565948105 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4404067070 con 0x5591ddc90e80 2024-09-18T01:26:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.664+0000 7f42f67fc640 1 -- 172.21.15.100:0/565948105 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440405a070 con 0x5591ddc90e80 2024-09-18T01:26:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.664+0000 7f42f67fc640 1 -- 172.21.15.100:0/565948105 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f440405c070 con 0x5591ddc90e80 2024-09-18T01:26:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.664+0000 7f4416f33800 1 -- 172.21.15.100:0/565948105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddc90e80 msgr2=0x5591ddc91280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.664+0000 7f4416f33800 1 --2- 172.21.15.100:0/565948105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddc90e80 0x5591ddc91280 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4404005fd0 tx=0x7f4404031da0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.664+0000 7f4416f33800 1 -- 172.21.15.100:0/565948105 shutdown_connections 2024-09-18T01:26:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.664+0000 7f4416f33800 1 --2- 172.21.15.100:0/565948105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddc90e80 0x5591ddc91280 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.664+0000 7f4416f33800 1 -- 172.21.15.100:0/565948105 >> 172.21.15.100:0/565948105 conn(0x5591ddcb8fd0 msgr2=0x5591ddcb70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.664+0000 7f4416f33800 1 -- 172.21.15.100:0/565948105 shutdown_connections 2024-09-18T01:26:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.664+0000 7f4416f33800 1 -- 172.21.15.100:0/565948105 wait complete. 2024-09-18T01:26:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.665+0000 7f4416f33800 1 Processor -- start 2024-09-18T01:26:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.665+0000 7f4416f33800 1 -- start start 2024-09-18T01:26:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.665+0000 7f4416f33800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddc90e80 0x5591ddcc60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.665+0000 7f4416f33800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5591ddc91d80 con 0x5591ddc90e80 2024-09-18T01:26:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.665+0000 7f4412c24640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddc90e80 0x5591ddcc60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.665+0000 7f4412c24640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddc90e80 0x5591ddcc60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37518/0 (socket says 172.21.15.100:37518) 2024-09-18T01:26:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.665+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 learned_addr learned my addr 172.21.15.100:0/1482969677 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.665+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591ddcc6630 con 0x5591ddc90e80 2024-09-18T01:26:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.665+0000 7f4412c24640 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddc90e80 0x5591ddcc60f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f440401cfa0 tx=0x7f4404037ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.666+0000 7f42f4ff9640 1 -- 172.21.15.100:0/1482969677 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4404067070 con 0x5591ddc90e80 2024-09-18T01:26:32.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.666+0000 7f42f4ff9640 1 -- 172.21.15.100:0/1482969677 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440405d040 con 0x5591ddc90e80 2024-09-18T01:26:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.666+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591ddcc6630 con 0x5591ddc90e80 2024-09-18T01:26:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.666+0000 7f42f4ff9640 1 -- 172.21.15.100:0/1482969677 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44040315b0 con 0x5591ddc90e80 2024-09-18T01:26:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.666+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591ddcc6ad0 con 0x5591ddc90e80 2024-09-18T01:26:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.666+0000 7f42f4ff9640 1 -- 172.21.15.100:0/1482969677 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4404076020 con 0x5591ddc90e80 2024-09-18T01:26:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.667+0000 7f42f4ff9640 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42dc036b40 0x7f42dc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.667+0000 7f42f4ff9640 1 -- 172.21.15.100:0/1482969677 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4404074020 con 0x5591ddc90e80 2024-09-18T01:26:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.667+0000 7f440bfff640 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42dc036b40 0x7f42dc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.667+0000 7f440bfff640 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42dc036b40 0x7f42dc039000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f43fc045be0 tx=0x7f43fc06d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.667+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.667+0000 7f4416f33800 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591ddcd1880 0x5591ddcd3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.667+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd4490 con 0x5591ddcd1880 2024-09-18T01:26:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4413425640 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591ddcd1880 0x5591ddcd3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4413425640 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591ddcd1880 0x5591ddcd3d40 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4416f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4416f33800 20 realm 2024-09-18T01:26:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd48a0 con 0x5591ddcd1880 2024-09-18T01:26:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4416f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4416f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:26:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5170 con 0x5591ddcd1880 2024-09-18T01:26:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4416f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.668+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd1880 2024-09-18T01:26:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.669+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.669+0000 7f4416f33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.669+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.669+0000 7f4416f33800 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591ddcd6270 0x5591ddcd8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.669+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd8c70 con 0x5591ddcd6270 2024-09-18T01:26:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.669+0000 7f4412c24640 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591ddcd6270 0x5591ddcd8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.669+0000 7f4412c24640 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591ddcd6270 0x5591ddcd8660 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.669+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.669+0000 7f4416f33800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:26:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.669+0000 7f4416f33800 20 searching for the correct realm 2024-09-18T01:26:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.669+0000 7f4416f33800 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5591ddcdac20 0x5591ddcdd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.669+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcdd7b0 con 0x5591ddcdac20 2024-09-18T01:26:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.669+0000 7f440bfff640 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5591ddcdac20 0x5591ddcdd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.670+0000 7f440bfff640 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5591ddcdac20 0x5591ddcdd0e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.670+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.670+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcdd7b0 con 0x5591ddcd6270 2024-09-18T01:26:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.670+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.670+0000 7f4412c24640 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f440403e050 0x7f4404032070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.670+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcdd7b0 con 0x7f440403e050 2024-09-18T01:26:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.671+0000 7f4413425640 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f440403e050 0x7f4404032070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.671+0000 7f4413425640 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f440403e050 0x7f4404032070 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.671+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.671+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd1880 2024-09-18T01:26:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.672+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.672+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd1880 2024-09-18T01:26:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.672+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.672+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x7f440403e050 2024-09-18T01:26:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.672+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.672+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x7f440403e050 2024-09-18T01:26:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.672+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.672+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd6270 2024-09-18T01:26:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.673+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.673+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcdac20 2024-09-18T01:26:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.673+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.673+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd1880 2024-09-18T01:26:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.673+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.673+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd6270 2024-09-18T01:26:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.673+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.673+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd1880 2024-09-18T01:26:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.673+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.674+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd6270 2024-09-18T01:26:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.674+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.674+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcdac20 2024-09-18T01:26:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.674+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.674+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcdac20 2024-09-18T01:26:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.674+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.674+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x7f440403e050 2024-09-18T01:26:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.674+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.674+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcdac20 2024-09-18T01:26:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.675+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.675+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcdac20 2024-09-18T01:26:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.675+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.675+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd1880 2024-09-18T01:26:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.675+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.675+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd1880 2024-09-18T01:26:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.675+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.675+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x7f440403e050 2024-09-18T01:26:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.676+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.676+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcdac20 2024-09-18T01:26:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.676+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.676+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd6270 2024-09-18T01:26:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.676+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.676+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd1880 2024-09-18T01:26:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.676+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.676+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x7f440403e050 2024-09-18T01:26:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.677+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.677+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcdac20 2024-09-18T01:26:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.677+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.677+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd6270 2024-09-18T01:26:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.677+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.677+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd6270 2024-09-18T01:26:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.677+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.678+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcdac20 2024-09-18T01:26:32.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.678+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.678+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x7f440403e050 2024-09-18T01:26:32.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.678+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.678+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd1880 2024-09-18T01:26:32.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.678+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.678+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd5510 con 0x5591ddcd6270 2024-09-18T01:26:32.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4416f33800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:26:32.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4416f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:26:32.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4416f33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:26:32.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4416f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:26:32.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4416f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:26:32.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4416f33800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:26:32.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd9530 con 0x5591ddcd1880 2024-09-18T01:26:32.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4416f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd9920 con 0x5591ddcd1880 2024-09-18T01:26:32.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4416f33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:32.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.679+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd9920 con 0x7f440403e050 2024-09-18T01:26:32.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:26:32.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 20 zone default found 2024-09-18T01:26:32.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 4 Realm: () 2024-09-18T01:26:32.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:26:32.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:26:32.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:26:32.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 20 zonegroup default 2024-09-18T01:26:32.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcd90f0 con 0x7f440403e050 2024-09-18T01:26:32.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcdf610 con 0x5591ddcdac20 2024-09-18T01:26:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcdf9b0 con 0x5591ddcdac20 2024-09-18T01:26:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 20 started sync module instance, tier type = 2024-09-18T01:26:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:26:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.680+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcdeab0 con 0x5591ddcd6270 2024-09-18T01:26:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.681+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.681+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94084979877376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcdfd50 con 0x5591ddcd6270 2024-09-18T01:26:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.681+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce05a0 con 0x5591ddcd1880 2024-09-18T01:26:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.682+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94084979877376] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.683+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.683+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94084979884272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce0510 con 0x5591ddcd1880 2024-09-18T01:26:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.683+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce1460 con 0x5591ddcdac20 2024-09-18T01:26:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.684+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94084979884272] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.684+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.684+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94084979888048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce1800 con 0x5591ddcdac20 2024-09-18T01:26:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.684+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce2200 con 0x5591ddcd6270 2024-09-18T01:26:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.685+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94084979888048] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.685+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.685+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94084979886480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce2620 con 0x5591ddcd6270 2024-09-18T01:26:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.686+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce3060 con 0x5591ddcd1880 2024-09-18T01:26:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.686+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94084979886480] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.687+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.687+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94084979895088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce3020 con 0x5591ddcd1880 2024-09-18T01:26:32.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.687+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce3a70 con 0x7f440403e050 2024-09-18T01:26:32.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.688+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94084979895088] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.688+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.688+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94084979891472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce3a70 con 0x7f440403e050 2024-09-18T01:26:32.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.688+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce44b0 con 0x7f440403e050 2024-09-18T01:26:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.689+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94084979891472] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.689+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.689+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94084979898272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce44b0 con 0x7f440403e050 2024-09-18T01:26:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.689+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce4e70 con 0x7f440403e050 2024-09-18T01:26:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.692+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94084979898272] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.692+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.692+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94084979900896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce4e70 con 0x7f440403e050 2024-09-18T01:26:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.692+0000 7f4416f33800 20 add_watcher() i=0 2024-09-18T01:26:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.692+0000 7f4416f33800 20 add_watcher() i=1 2024-09-18T01:26:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.692+0000 7f4416f33800 20 add_watcher() i=2 2024-09-18T01:26:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.692+0000 7f4416f33800 20 add_watcher() i=3 2024-09-18T01:26:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.692+0000 7f4416f33800 20 add_watcher() i=4 2024-09-18T01:26:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.692+0000 7f4416f33800 20 add_watcher() i=5 2024-09-18T01:26:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.692+0000 7f4416f33800 20 add_watcher() i=6 2024-09-18T01:26:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.693+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94084979900896] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.693+0000 7f4416f33800 20 add_watcher() i=7 2024-09-18T01:26:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.693+0000 7f4416f33800 2 all 8 watchers are set, enabling cache 2024-09-18T01:26:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.694+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce8380 con 0x5591ddcd1880 2024-09-18T01:26:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.694+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.694+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94084979904160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce57e0 con 0x5591ddcd1880 2024-09-18T01:26:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.695+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94084979904160] v35'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.695+0000 7f42c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.695+0000 7f4416f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:26:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.695+0000 7f4416f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:26:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.695+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf0ce0 con 0x5591ddcd1880 2024-09-18T01:26:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.697+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.697+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf1330 con 0x7f440403e050 2024-09-18T01:26:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.698+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.698+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf1790 con 0x5591ddcdac20 2024-09-18T01:26:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.699+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.699+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf21b0 con 0x5591ddcd1880 2024-09-18T01:26:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.700+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'225 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.700+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcec9e0 con 0x5591ddcd6270 2024-09-18T01:26:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.701+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'74 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.701+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcec9b0 con 0x5591ddcdac20 2024-09-18T01:26:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.702+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'57 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.702+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf2d10 con 0x5591ddcd1880 2024-09-18T01:26:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.703+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.703+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf32f0 con 0x7f440403e050 2024-09-18T01:26:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.705+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'52 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.705+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf32f0 con 0x5591ddcd6270 2024-09-18T01:26:32.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.706+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.706+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf32f0 con 0x5591ddcdac20 2024-09-18T01:26:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.707+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.707+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf36d0 con 0x5591ddcd6270 2024-09-18T01:26:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.708+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'75 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.708+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf35a0 con 0x7f440403e050 2024-09-18T01:26:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.709+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.709+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3650 con 0x5591ddcd6270 2024-09-18T01:26:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.710+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.710+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3650 con 0x7f440403e050 2024-09-18T01:26:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.711+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'64 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.711+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3650 con 0x5591ddcd1880 2024-09-18T01:26:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.712+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'226 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.712+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3650 con 0x5591ddcdac20 2024-09-18T01:26:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.714+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.714+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3b30 con 0x5591ddcd6270 2024-09-18T01:26:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.715+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'76 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.715+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3b30 con 0x5591ddcdac20 2024-09-18T01:26:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.715+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.716+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3b30 con 0x5591ddcd1880 2024-09-18T01:26:32.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.717+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.717+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3b30 con 0x5591ddcd1880 2024-09-18T01:26:32.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.718+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'227 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.718+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3b30 con 0x5591ddcdac20 2024-09-18T01:26:32.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.719+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.719+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3f10 con 0x5591ddcd6270 2024-09-18T01:26:32.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.720+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.720+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3f10 con 0x5591ddcdac20 2024-09-18T01:26:32.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.721+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.721+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3f10 con 0x5591ddcdac20 2024-09-18T01:26:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.722+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'44 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.722+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3f10 con 0x5591ddcdac20 2024-09-18T01:26:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.723+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.723+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3f10 con 0x5591ddcdac20 2024-09-18T01:26:32.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.724+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'58 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.724+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3f10 con 0x7f440403e050 2024-09-18T01:26:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.725+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.725+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3f10 con 0x5591ddcdac20 2024-09-18T01:26:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.726+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.726+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3f10 con 0x7f440403e050 2024-09-18T01:26:32.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.727+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'53 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.727+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3f10 con 0x5591ddcdac20 2024-09-18T01:26:32.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.729+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.729+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3f10 con 0x7f440403e050 2024-09-18T01:26:32.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.730+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'65 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x7f440403e050 2024-09-18T01:26:32.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.730+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddcf3f10 con 0x5591ddcd6270 2024-09-18T01:26:32.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.731+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.731+0000 7f4243fff640 20 reqs_thread_entry: start 2024-09-18T01:26:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.731+0000 7f4416f33800 20 init_complete bucket index max shards: 11 2024-09-18T01:26:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.731+0000 7f4416f33800 20 Filter name: none 2024-09-18T01:26:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.732+0000 7f4241ffb640 20 reqs_thread_entry: start 2024-09-18T01:26:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.732+0000 7f4416f33800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-18T01:26:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.732+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.732+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd1ebc0 con 0x5591ddcd6270 2024-09-18T01:26:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.732+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.732+0000 7f4416f33800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:26:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.732+0000 7f4416f33800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-18T01:26:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.732+0000 7f4416f33800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T01:26:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.732+0000 7f4416f33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:26:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.732+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd214d0 con 0x5591ddcd1880 2024-09-18T01:26:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.732+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.732+0000 7f4416f33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 : miss 2024-09-18T01:26:32.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.732+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.732+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:96 8.9 8:93267c76:root::.bucket.meta.myfoo6%3a153b7754-209b-4898-8796-577da7c1273d.4237.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd21280 con 0x5591ddcd6270 2024-09-18T01:26:32.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.733+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== osd_op_reply(96 .bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv46 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.733+0000 7f4416f33800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:26:32.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.733+0000 7f4416f33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 info.flags=0x17 2024-09-18T01:26:32.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.733+0000 7f4416f33800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 to cache LRU end 2024-09-18T01:26:32.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.733+0000 7f4416f33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:26:32.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.733+0000 7f4416f33800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T01:26:32.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.733+0000 7f4416f33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 2024-09-18T01:26:32.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.733+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:97 4.3d 4:bd61d7a1:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd9e740 con 0x5591ddcd6270 2024-09-18T01:26:32.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.733+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 23 ==== osd_op_reply(97 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.733+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:98 4.2a 4:56efb9e8:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd9e7c0 con 0x5591ddcd1880 2024-09-18T01:26:32.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.734+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(98 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.734+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:99 4.d 4:b030bc0f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd9e7c0 con 0x5591ddcdac20 2024-09-18T01:26:32.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.734+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(99 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.734+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:100 4.3e 4:7f82a4e5:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd9e7c0 con 0x5591ddcd6270 2024-09-18T01:26:32.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.734+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 24 ==== osd_op_reply(100 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.734+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:101 4.29 4:97d6bde0:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd9ed70 con 0x5591ddcdac20 2024-09-18T01:26:32.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.735+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 27 ==== osd_op_reply(101 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.735+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:102 4.e 4:730bf549:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd9ed70 con 0x5591ddcd6270 2024-09-18T01:26:32.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.735+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 25 ==== osd_op_reply(102 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.735+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:103 4.20 4:07027eab:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd9ed70 con 0x5591ddcd1880 2024-09-18T01:26:32.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.735+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(103 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.735+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:104 4.36 4:6d5d4b00:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd9ed70 con 0x5591ddcd1880 2024-09-18T01:26:32.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.736+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(104 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.736+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:105 4.1b 4:d95c0209:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd9ed70 con 0x5591ddcd6270 2024-09-18T01:26:32.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.736+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 26 ==== osd_op_reply(105 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.736+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:106 4.0 4:03a53d9d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd9ed70 con 0x5591ddcdac20 2024-09-18T01:26:32.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.736+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 28 ==== osd_op_reply(106 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9 [call out=345b] v0'0 uv11 ondisk = 0) ==== 194+0+345 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.736+0000 7f4416f33800 10 cls_bucket_list_unordered: got thirteen 2024-09-18T01:26:32.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.736+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:107 4.2 4:438788aa:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd9ed70 con 0x5591ddcd1880 2024-09-18T01:26:32.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.737+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(107 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.737+0000 7f4416f33800 20 get_obj_state: octx=0x7f440403dc10 obj=myfoo6:thirteen state=0x5591ddd9c7e8 s->prefetch_data=0 2024-09-18T01:26:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.737+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:108 3.35s0 3:af58c9a6:::153b7754-209b-4898-8796-577da7c1273d.4237.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd9d690 con 0x5591ddcd1880 2024-09-18T01:26:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.737+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(108 153b7754-209b-4898-8796-577da7c1273d.4237.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.737+0000 7f4416f33800 10 manifest: total_size = 8 2024-09-18T01:26:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.737+0000 7f4416f33800 20 get_obj_state: setting s->obj_tag to _MpFVHbkFMdN4GoHA7X3fksdDDmkRTUx 2024-09-18T01:26:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.737+0000 7f4416f33800 20 get_obj_state: octx=0x7f440403dc10 obj=myfoo6:thirteen state=0x5591ddd9c7e8 s->prefetch_data=0 2024-09-18T01:26:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.737+0000 7f4416f33800 20 prepare_atomic_modification: state is not atomic. state=0x5591ddd9c7e8 2024-09-18T01:26:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.737+0000 7f4416f33800 20 bucket index object: :.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9 2024-09-18T01:26:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.737+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:109 4.0 4:03a53d9d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd9df50 con 0x5591ddcdac20 2024-09-18T01:26:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.738+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 29 ==== osd_op_reply(109 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9 [stat,call,call] v35'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.738+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:110 3.35s0 3:af58c9a6:::153b7754-209b-4898-8796-577da7c1273d.4237.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd9df50 con 0x5591ddcd1880 2024-09-18T01:26:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.740+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(110 153b7754-209b-4898-8796-577da7c1273d.4237.9_thirteen [call] v35'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f440c00a4a0 con 0x5591ddcd1880 2024-09-18T01:26:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.740+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:111 4.0 4:03a53d9d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd25e30 con 0x5591ddcdac20 2024-09-18T01:26:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.740+0000 7f4416f33800 20 list_objects_ordered: starting attempt 1 2024-09-18T01:26:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.740+0000 7f4416f33800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-18T01:26:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.740+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:112 4.3d 4:bd61d7a1:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd25e30 con 0x5591ddcd6270 2024-09-18T01:26:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.740+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:113 4.2a 4:56efb9e8:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd25e30 con 0x5591ddcd1880 2024-09-18T01:26:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.740+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:114 4.d 4:b030bc0f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd25e30 con 0x5591ddcdac20 2024-09-18T01:26:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.740+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:115 4.3e 4:7f82a4e5:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd2fb10 con 0x5591ddcd6270 2024-09-18T01:26:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.740+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:116 4.29 4:97d6bde0:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd32460 con 0x5591ddcdac20 2024-09-18T01:26:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.740+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:117 4.e 4:730bf549:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd35280 con 0x5591ddcd6270 2024-09-18T01:26:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.740+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:118 4.20 4:07027eab:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd37c50 con 0x5591ddcd1880 2024-09-18T01:26:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.740+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:119 4.36 4:6d5d4b00:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd3a660 con 0x5591ddcd1880 2024-09-18T01:26:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.740+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 34 ==== osd_op_reply(113 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.741+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:120 4.1b 4:d95c0209:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd28ca0 con 0x5591ddcd6270 2024-09-18T01:26:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.741+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:121 4.0 4:03a53d9d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd3d480 con 0x5591ddcdac20 2024-09-18T01:26:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.741+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:122 4.2 4:438788aa:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd40240 con 0x5591ddcd1880 2024-09-18T01:26:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.741+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 27 ==== osd_op_reply(112 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.741+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 28 ==== osd_op_reply(117 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.741+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 30 ==== osd_op_reply(114 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.741+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 35 ==== osd_op_reply(118 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.741+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 36 ==== osd_op_reply(119 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.741+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 37 ==== osd_op_reply(122 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.741+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 29 ==== osd_op_reply(115 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.741+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 30 ==== osd_op_reply(120 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.741+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 31 ==== osd_op_reply(116 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.741+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 32 ==== osd_op_reply(111 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9 [stat,call,call] v35'13 uv13 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.741+0000 7f42f67fc640 20 handle_completion(): completion ok for obj=thirteen 2024-09-18T01:26:32.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 33 ==== osd_op_reply(121 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9 [call out=124b] v0'0 uv13 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-18T01:26:32.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-18T01:26:32.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-18T01:26:32.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-18T01:26:32.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[153b7754-209b-4898-8796-577da7c1273d.4237.9])"; uploads.size()=0; is_truncated=0 2024-09-18T01:26:32.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:123 4.3d 4:bd61d7a1:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20cc0 con 0x5591ddcd6270 2024-09-18T01:26:32.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:124 4.2a 4:56efb9e8:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd402a0 con 0x5591ddcd1880 2024-09-18T01:26:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:125 4.d 4:b030bc0f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd267d0 con 0x5591ddcdac20 2024-09-18T01:26:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:126 4.3e 4:7f82a4e5:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd3de50 con 0x5591ddcd6270 2024-09-18T01:26:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:127 4.29 4:97d6bde0:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd3f760 con 0x5591ddcdac20 2024-09-18T01:26:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:128 4.e 4:730bf549:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd31b90 con 0x5591ddcd6270 2024-09-18T01:26:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:129 4.20 4:07027eab:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd32500 con 0x5591ddcd1880 2024-09-18T01:26:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:130 4.36 4:6d5d4b00:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20cc0 con 0x5591ddcd1880 2024-09-18T01:26:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:131 4.1b 4:d95c0209:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd402a0 con 0x5591ddcd6270 2024-09-18T01:26:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:132 4.0 4:03a53d9d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd32500 con 0x5591ddcdac20 2024-09-18T01:26:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:133 4.2 4:438788aa:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd402a0 con 0x5591ddcd1880 2024-09-18T01:26:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 34 ==== osd_op_reply(125 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 31 ==== osd_op_reply(123 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 38 ==== osd_op_reply(124 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 32 ==== osd_op_reply(131 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 39 ==== osd_op_reply(129 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 33 ==== osd_op_reply(128 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 34 ==== osd_op_reply(126 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 40 ==== osd_op_reply(130 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.742+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 41 ==== osd_op_reply(133 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.743+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 35 ==== osd_op_reply(127 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.743+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 36 ==== osd_op_reply(132 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9 [call out=124b] v0'0 uv13 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.743+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20cc0 con 0x5591ddcd1880 2024-09-18T01:26:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.744+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 42 ==== osd_op_reply(134 bud.buckets [call] v35'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.744+0000 7f4416f33800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-18T01:26:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.744+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.744+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20cc0 con 0x5591ddcd1880 2024-09-18T01:26:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.744+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 43 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.744+0000 7f4416f33800 20 rados_obj.operate() r=0 bl.length=166 2024-09-18T01:26:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.744+0000 7f4416f33800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-18T01:26:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.744+0000 7f4416f33800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-18T01:26:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.744+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20cc0 con 0x5591ddcd1880 2024-09-18T01:26:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.745+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 44 ==== osd_op_reply(136 myfoo6 [call,call,delete] v35'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.745+0000 7f4416f33800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-18T01:26:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.745+0000 7f4416f33800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-18T01:26:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.745+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94084980267424 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20cc0 con 0x5591ddcd6270 2024-09-18T01:26:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.745+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 35 ==== watch-notify(notify (1) cookie 94084979886480 notify 150323855379 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5591ddd207d0 con 0x5591ddcd6270 2024-09-18T01:26:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.745+0000 7f42f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855379 cookie 94084979886480 notifier 4762 bl.length()=150 2024-09-18T01:26:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.745+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 36 ==== osd_op_reply(137 notify.3 [notify cookie 94084980267424 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.745+0000 7f42f5ffb640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f42480032c0 con 0x5591ddcd6270 2024-09-18T01:26:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.746+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 37 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.746+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 38 ==== watch-notify(notify_complete (2) cookie 94084980267424 notify 150323855379 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5591ddc95410 con 0x5591ddcd6270 2024-09-18T01:26:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.746+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:139 8.9 8:93267c76:root::.bucket.meta.myfoo6%3a153b7754-209b-4898-8796-577da7c1273d.4237.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20cc0 con 0x5591ddcd6270 2024-09-18T01:26:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.747+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 39 ==== osd_op_reply(139 .bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 [call,call,delete] v35'48 uv48 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.747+0000 7f4416f33800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9 from cache 2024-09-18T01:26:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.747+0000 7f4416f33800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:153b7754-209b-4898-8796-577da7c1273d.4237.9, ofs0, ns] 2024-09-18T01:26:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.747+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 94084980149264 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd211f0 con 0x5591ddcd1880 2024-09-18T01:26:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.747+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 45 ==== watch-notify(notify (1) cookie 94084979895088 notify 150323855402 ret 0) ==== 249+0+0 (crc 0 0 0) 0x5591ddced030 con 0x5591ddcd1880 2024-09-18T01:26:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.747+0000 7f42f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855402 cookie 94084979895088 notifier 4762 bl.length()=207 2024-09-18T01:26:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.747+0000 7f42f67fc640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f42d8003d60 con 0x5591ddcd1880 2024-09-18T01:26:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.747+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 46 ==== osd_op_reply(140 notify.4 [notify cookie 94084980149264 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.748+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 47 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.748+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 48 ==== watch-notify(notify_complete (2) cookie 94084980149264 notify 150323855402 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5591ddcf0870 con 0x5591ddcd1880 2024-09-18T01:26:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.748+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:142 4.3d 4:bd61d7a1:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20c10 con 0x5591ddcd6270 2024-09-18T01:26:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.748+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:143 4.2a 4:56efb9e8:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd34a80 con 0x5591ddcd1880 2024-09-18T01:26:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.748+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:144 4.d 4:b030bc0f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd34e60 con 0x5591ddcdac20 2024-09-18T01:26:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.748+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:145 4.3e 4:7f82a4e5:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd324e0 con 0x5591ddcd6270 2024-09-18T01:26:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.748+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:146 4.29 4:97d6bde0:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd34a80 con 0x5591ddcdac20 2024-09-18T01:26:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.748+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:147 4.e 4:730bf549:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20c10 con 0x5591ddcd6270 2024-09-18T01:26:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.748+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:148 4.20 4:07027eab:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd34e60 con 0x5591ddcd1880 2024-09-18T01:26:32.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.748+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:149 4.36 4:6d5d4b00:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd34a80 con 0x5591ddcd1880 2024-09-18T01:26:32.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.748+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:150 4.1b 4:d95c0209:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd324e0 con 0x5591ddcd6270 2024-09-18T01:26:32.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.748+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:151 4.0 4:03a53d9d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20c10 con 0x5591ddcdac20 2024-09-18T01:26:32.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.748+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:152 4.2 4:438788aa:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd324e0 con 0x5591ddcd1880 2024-09-18T01:26:32.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.750+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 49 ==== osd_op_reply(143 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.1 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.750+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 40 ==== osd_op_reply(147 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.5 [delete] v35'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.750+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 41 ==== osd_op_reply(150 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.8 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 42 ==== osd_op_reply(142 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.0 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 37 ==== osd_op_reply(146 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.4 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 43 ==== osd_op_reply(145 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.3 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 50 ==== osd_op_reply(148 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.6 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 51 ==== osd_op_reply(152 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.10 [delete] v35'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 52 ==== osd_op_reply(149 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.7 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 38 ==== osd_op_reply(144 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.2 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 39 ==== osd_op_reply(151 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.9.9 [delete] v35'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f4416f33800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/153b7754-209b-4898-8796-577da7c1273d.4237.9 : miss 2024-09-18T01:26:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f4416f33800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:153 6.3 6:c747bb6c:::pubsub..bucket.myfoo6%2f153b7754-209b-4898-8796-577da7c1273d.4237.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20c10 con 0x5591ddcd6270 2024-09-18T01:26:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 44 ==== osd_op_reply(153 pubsub..bucket.myfoo6/153b7754-209b-4898-8796-577da7c1273d.4237.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f4416f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f4416f33800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/153b7754-209b-4898-8796-577da7c1273d.4237.9 info.flags=0x0 2024-09-18T01:26:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f4416f33800 10 adding default.rgw.log++pubsub..bucket.myfoo6/153b7754-209b-4898-8796-577da7c1273d.4237.9 to cache LRU end 2024-09-18T01:26:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.751+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:154 6.3 6:c747bb6c:::pubsub..bucket.myfoo6%2f153b7754-209b-4898-8796-577da7c1273d.4237.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20c10 con 0x5591ddcd6270 2024-09-18T01:26:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.752+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 45 ==== osd_op_reply(154 pubsub..bucket.myfoo6/153b7754-209b-4898-8796-577da7c1273d.4237.9 [delete] v35'77 uv61 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.752+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20c10 con 0x5591ddcd1880 2024-09-18T01:26:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.753+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 53 ==== osd_op_reply(155 bud.buckets [call] v35'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.753+0000 7f4416f33800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-18T01:26:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.753+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20c10 con 0x5591ddcd1880 2024-09-18T01:26:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.754+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 54 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v35'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.754+0000 7f4416f33800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-18T01:26:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.754+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94084980149264 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20010 con 0x7f440403e050 2024-09-18T01:26:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.755+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== watch-notify(notify (1) cookie 94084979891472 notify 150323855382 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7f440c05f040 con 0x7f440403e050 2024-09-18T01:26:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.755+0000 7f42f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855382 cookie 94084979891472 notifier 4762 bl.length()=170 2024-09-18T01:26:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.755+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(157 notify.5 [notify cookie 94084980149264 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f440c04c040 con 0x7f440403e050 2024-09-18T01:26:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.755+0000 7f42f67fc640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f42d8003d60 con 0x7f440403e050 2024-09-18T01:26:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.755+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x7f440403e050 2024-09-18T01:26:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.755+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== watch-notify(notify_complete (2) cookie 94084980149264 notify 150323855382 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5591ddcf0870 con 0x7f440403e050 2024-09-18T01:26:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.755+0000 7f4416f33800 10 removing email index: 2024-09-18T01:26:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.755+0000 7f4416f33800 10 removing user buckets index 2024-09-18T01:26:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.755+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20c10 con 0x5591ddcd1880 2024-09-18T01:26:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.756+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 55 ==== osd_op_reply(159 bud.buckets [delete] v35'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.756+0000 7f4416f33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-18T01:26:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.756+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94084980149264 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20010 con 0x7f440403e050 2024-09-18T01:26:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.756+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== watch-notify(notify (1) cookie 94084979898272 notify 150323855383 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5591ddcf0870 con 0x7f440403e050 2024-09-18T01:26:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.756+0000 7f42f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855383 cookie 94084979898272 notifier 4762 bl.length()=160 2024-09-18T01:26:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.756+0000 7f42f67fc640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f42d8003d60 con 0x7f440403e050 2024-09-18T01:26:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.757+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(160 notify.6 [notify cookie 94084980149264 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f440c04c040 con 0x7f440403e050 2024-09-18T01:26:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.757+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 29 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x7f440403e050 2024-09-18T01:26:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.757+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 30 ==== watch-notify(notify_complete (2) cookie 94084980149264 notify 150323855383 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5591ddcf06a0 con 0x7f440403e050 2024-09-18T01:26:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.757+0000 7f4416f33800 10 removing user index: bud 2024-09-18T01:26:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.757+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20c10 con 0x5591ddcd6270 2024-09-18T01:26:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.758+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 46 ==== osd_op_reply(162 bud [call,call,delete] v35'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.758+0000 7f4416f33800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-18T01:26:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.758+0000 7f4416f33800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-18T01:26:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.758+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94084980149264 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591ddd20010 con 0x7f440403e050 2024-09-18T01:26:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.758+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 31 ==== watch-notify(notify (1) cookie 94084979891472 notify 150323855384 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5591ddcf06a0 con 0x7f440403e050 2024-09-18T01:26:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.758+0000 7f42f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855384 cookie 94084979891472 notifier 4762 bl.length()=152 2024-09-18T01:26:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.758+0000 7f42f5ffb640 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f42480032a0 con 0x7f440403e050 2024-09-18T01:26:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.758+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 32 ==== osd_op_reply(163 notify.5 [notify cookie 94084980149264 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f440c04c040 con 0x7f440403e050 2024-09-18T01:26:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.759+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 33 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x7f440403e050 2024-09-18T01:26:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.759+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 34 ==== watch-notify(notify_complete (2) cookie 94084980149264 notify 150323855384 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5591ddcf0eb0 con 0x7f440403e050 2024-09-18T01:26:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.760+0000 7f42c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.760+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94084979904160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddced950 con 0x5591ddcd1880 2024-09-18T01:26:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.761+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 56 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94084979904160] v35'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.761+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94084979877376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddced950 con 0x5591ddcd6270 2024-09-18T01:26:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.762+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 47 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94084979877376] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.762+0000 7f4416f33800 20 remove_watcher() i=0 2024-09-18T01:26:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.762+0000 7f4416f33800 2 removed watcher, disabling cache 2024-09-18T01:26:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.762+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94084979884272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddced950 con 0x5591ddcd1880 2024-09-18T01:26:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.763+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 57 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94084979884272] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.763+0000 7f4416f33800 20 remove_watcher() i=1 2024-09-18T01:26:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.763+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94084979888048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddced950 con 0x5591ddcdac20 2024-09-18T01:26:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.764+0000 7f440bfff640 1 -- 172.21.15.100:0/1482969677 <== osd.3 v2:172.21.15.100:6816/595195757 40 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94084979888048] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc057030 con 0x5591ddcdac20 2024-09-18T01:26:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.764+0000 7f4416f33800 20 remove_watcher() i=2 2024-09-18T01:26:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.764+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94084979886480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce0fb0 con 0x5591ddcd6270 2024-09-18T01:26:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.765+0000 7f4412c24640 1 -- 172.21.15.100:0/1482969677 <== osd.2 v2:172.21.15.100:6808/3104327688 48 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94084979886480] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440405f070 con 0x5591ddcd6270 2024-09-18T01:26:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.765+0000 7f4416f33800 20 remove_watcher() i=3 2024-09-18T01:26:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.765+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94084979895088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddced950 con 0x5591ddcd1880 2024-09-18T01:26:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.766+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.1 v2:172.21.15.100:6800/170575980 58 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94084979895088] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x5591ddcd1880 2024-09-18T01:26:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.766+0000 7f4416f33800 20 remove_watcher() i=4 2024-09-18T01:26:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.766+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94084979891472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce0fb0 con 0x7f440403e050 2024-09-18T01:26:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.768+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 35 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94084979891472] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x7f440403e050 2024-09-18T01:26:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.768+0000 7f4416f33800 20 remove_watcher() i=5 2024-09-18T01:26:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.768+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94084979898272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddced950 con 0x7f440403e050 2024-09-18T01:26:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.769+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 36 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94084979898272] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x7f440403e050 2024-09-18T01:26:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.769+0000 7f4416f33800 20 remove_watcher() i=6 2024-09-18T01:26:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.769+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94084979900896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591ddce0fb0 con 0x7f440403e050 2024-09-18T01:26:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.770+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 <== osd.0 v2:172.21.15.92:6800/2777570747 37 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94084979900896] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f440c04c040 con 0x7f440403e050 2024-09-18T01:26:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.770+0000 7f4416f33800 20 remove_watcher() i=7 2024-09-18T01:26:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.770+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f440403e050 msgr2=0x7f4404032070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.770+0000 7f4416f33800 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f440403e050 0x7f4404032070 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.770+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591ddcd1880 msgr2=0x5591ddcd3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.770+0000 7f4416f33800 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591ddcd1880 0x5591ddcd3d40 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.770+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591ddcd6270 msgr2=0x5591ddcd8660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.770+0000 7f4416f33800 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591ddcd6270 0x5591ddcd8660 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.770+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5591ddcdac20 msgr2=0x5591ddcdd0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.770+0000 7f4416f33800 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5591ddcdac20 0x5591ddcdd0e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42dc036b40 msgr2=0x7f42dc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42dc036b40 0x7f42dc039000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f43fc045be0 tx=0x7f43fc06d040 comp rx=0 tx=0).stop 2024-09-18T01:26:32.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddc90e80 msgr2=0x5591ddcc60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 --2- 172.21.15.100:0/1482969677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddc90e80 0x5591ddcc60f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f440401cfa0 tx=0x7f4404037ec0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 reap_dead start 2024-09-18T01:26:32.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4413425640 1 -- 172.21.15.100:0/1482969677 reap_dead start 2024-09-18T01:26:32.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 shutdown_connections 2024-09-18T01:26:32.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 >> 172.21.15.100:0/1482969677 conn(0x5591ddcb8fd0 msgr2=0x5591ddcb70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 shutdown_connections 2024-09-18T01:26:32.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/1482969677 wait complete. 2024-09-18T01:26:32.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/644517371 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42ec036b40 msgr2=0x7f42ec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 --2- 172.21.15.100:0/644517371 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42ec036b40 0x7f42ec039000 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f43fc005570 tx=0x7f43fc005ac0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/644517371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddcb0320 msgr2=0x5591ddcb0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 --2- 172.21.15.100:0/644517371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddcb0320 0x5591ddcb0740 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f440404b2d0 tx=0x7f440400ed30 comp rx=0 tx=0).stop 2024-09-18T01:26:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/644517371 shutdown_connections 2024-09-18T01:26:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 --2- 172.21.15.100:0/644517371 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42ec036b40 0x7f42ec039000 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 --2- 172.21.15.100:0/644517371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddcb0320 0x5591ddcb0740 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/644517371 >> 172.21.15.100:0/644517371 conn(0x5591ddca52b0 msgr2=0x5591ddca7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/644517371 shutdown_connections 2024-09-18T01:26:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/644517371 wait complete. 2024-09-18T01:26:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5591ddc9faf0 msgr2=0x5591ddca1ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5591ddc9faf0 0x5591ddca1ee0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591ddb9e920 msgr2=0x5591ddc99280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591ddb9e920 0x5591ddc99280 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591ddc9bbb0 msgr2=0x5591ddc9dfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.771+0000 7f4416f33800 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591ddc9bbb0 0x5591ddc9dfa0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.772+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42f8036b40 msgr2=0x7f42f8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.772+0000 7f4416f33800 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f42f8036b40 0x7f42f8039000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f43fc057000 tx=0x7f43fc052000 comp rx=0 tx=0).stop 2024-09-18T01:26:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.772+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9a4e0 msgr2=0x5591ddc94e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.772+0000 7f4416f33800 1 --2- 172.21.15.100:0/3597281059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591ddb9a4e0 0x5591ddc94e50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f440400b5f0 tx=0x7f4404000ed0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.772+0000 7f4413425640 1 -- 172.21.15.100:0/3597281059 reap_dead start 2024-09-18T01:26:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.772+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 shutdown_connections 2024-09-18T01:26:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.772+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 >> 172.21.15.100:0/3597281059 conn(0x5591ddb95dd0 msgr2=0x5591ddc83a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.772+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 shutdown_connections 2024-09-18T01:26:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.772+0000 7f4416f33800 1 -- 172.21.15.100:0/3597281059 wait complete. 2024-09-18T01:26:32.781 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-18T01:26:32.781 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-18T01:26:32.782 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-18T01:26:32.826 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:26:32.826 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:26:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.826+0000 7f25b0faf800 1 Processor -- start 2024-09-18T01:26:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.826+0000 7f25b0faf800 1 -- start start 2024-09-18T01:26:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.826+0000 7f25b0faf800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e14c637920 0x55e14c639d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.826+0000 7f25b0faf800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e14c4f3b30 con 0x55e14c6334e0 2024-09-18T01:26:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.826+0000 7f25b0faf800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55e14c4d5360 con 0x55e14c637920 2024-09-18T01:26:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.827+0000 7f25ae2a2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e14c637920 0x55e14c639d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.827+0000 7f25ae2a2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e14c637920 0x55e14c639d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37526/0 (socket says 172.21.15.100:37526) 2024-09-18T01:26:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.827+0000 7f25ae2a2640 1 -- 172.21.15.100:0/521203294 learned_addr learned my addr 172.21.15.100:0/521203294 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.827+0000 7f25ae2a2640 1 -- 172.21.15.100:0/521203294 >> v1:172.21.15.92:6789/0 conn(0x55e14c6334e0 legacy=0x55e14c6338e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.827+0000 7f25ae2a2640 1 -- 172.21.15.100:0/521203294 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e14c4fbe00 con 0x55e14c637920 2024-09-18T01:26:32.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.829+0000 7f25ae2a2640 1 --2- 172.21.15.100:0/521203294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c637920 0x55e14c639d10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f25a400a520 tx=0x7f25a4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57ccc9752c771a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.829+0000 7f25adaa1640 1 -- 172.21.15.100:0/521203294 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a4055070 con 0x55e14c637920 2024-09-18T01:26:32.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.829+0000 7f25adaa1640 1 -- 172.21.15.100:0/521203294 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a40515b0 con 0x55e14c637920 2024-09-18T01:26:32.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.829+0000 7f25adaa1640 1 -- 172.21.15.100:0/521203294 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a40518d0 con 0x55e14c637920 2024-09-18T01:26:32.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.829+0000 7f25b0faf800 1 -- 172.21.15.100:0/521203294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c637920 msgr2=0x55e14c639d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.829+0000 7f25b0faf800 1 --2- 172.21.15.100:0/521203294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c637920 0x55e14c639d10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f25a400a520 tx=0x7f25a4045ba0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.829+0000 7f25b0faf800 1 -- 172.21.15.100:0/521203294 shutdown_connections 2024-09-18T01:26:32.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.829+0000 7f25b0faf800 1 --2- 172.21.15.100:0/521203294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c637920 0x55e14c639d10 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.829+0000 7f25b0faf800 1 -- 172.21.15.100:0/521203294 >> 172.21.15.100:0/521203294 conn(0x55e14c62edd0 msgr2=0x55e14c6311f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.830+0000 7f25b0faf800 1 -- 172.21.15.100:0/521203294 shutdown_connections 2024-09-18T01:26:32.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.830+0000 7f25b0faf800 1 -- 172.21.15.100:0/521203294 wait complete. 2024-09-18T01:26:32.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.843+0000 7f25b0faf800 1 Processor -- start 2024-09-18T01:26:32.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.843+0000 7f25b0faf800 1 -- start start 2024-09-18T01:26:32.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.843+0000 7f25b0faf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c6334e0 0x55e14c721670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.843+0000 7f25b0faf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e14c580360 con 0x55e14c6334e0 2024-09-18T01:26:32.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.844+0000 7f25aeaa3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c6334e0 0x55e14c721670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.844+0000 7f25aeaa3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c6334e0 0x55e14c721670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37528/0 (socket says 172.21.15.100:37528) 2024-09-18T01:26:32.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.844+0000 7f25aeaa3640 1 -- 172.21.15.100:0/2868886557 learned_addr learned my addr 172.21.15.100:0/2868886557 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.844+0000 7f25aeaa3640 1 -- 172.21.15.100:0/2868886557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e14c4cdbc0 con 0x55e14c6334e0 2024-09-18T01:26:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.844+0000 7f25aeaa3640 1 --2- 172.21.15.100:0/2868886557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c6334e0 0x55e14c721670 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f25a0001d00 tx=0x7f25a000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f6780eeeb12826 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.844+0000 7f249ce09640 1 -- 172.21.15.100:0/2868886557 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a000f400 con 0x55e14c6334e0 2024-09-18T01:26:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.844+0000 7f249ce09640 1 -- 172.21.15.100:0/2868886557 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a0001e50 con 0x55e14c6334e0 2024-09-18T01:26:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.844+0000 7f249ce09640 1 -- 172.21.15.100:0/2868886557 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a000f600 con 0x55e14c6334e0 2024-09-18T01:26:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.845+0000 7f25b0faf800 1 -- 172.21.15.100:0/2868886557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c6334e0 msgr2=0x55e14c721670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.845+0000 7f25b0faf800 1 --2- 172.21.15.100:0/2868886557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c6334e0 0x55e14c721670 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f25a0001d00 tx=0x7f25a000b5b0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.845+0000 7f25b0faf800 1 -- 172.21.15.100:0/2868886557 shutdown_connections 2024-09-18T01:26:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.845+0000 7f25b0faf800 1 --2- 172.21.15.100:0/2868886557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c6334e0 0x55e14c721670 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.845+0000 7f25b0faf800 1 -- 172.21.15.100:0/2868886557 >> 172.21.15.100:0/2868886557 conn(0x55e14c62edd0 msgr2=0x55e14c71d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.845+0000 7f25b0faf800 1 -- 172.21.15.100:0/2868886557 shutdown_connections 2024-09-18T01:26:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.845+0000 7f25b0faf800 1 -- 172.21.15.100:0/2868886557 wait complete. 2024-09-18T01:26:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.845+0000 7f25b0faf800 1 Processor -- start 2024-09-18T01:26:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.845+0000 7f25b0faf800 1 -- start start 2024-09-18T01:26:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.846+0000 7f25b0faf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c6334e0 0x55e14c729070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.846+0000 7f25b0faf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e14c63a550 con 0x55e14c6334e0 2024-09-18T01:26:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.846+0000 7f25aeaa3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c6334e0 0x55e14c729070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.846+0000 7f25aeaa3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c6334e0 0x55e14c729070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37536/0 (socket says 172.21.15.100:37536) 2024-09-18T01:26:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.846+0000 7f25aeaa3640 1 -- 172.21.15.100:0/4243789745 learned_addr learned my addr 172.21.15.100:0/4243789745 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.846+0000 7f25aeaa3640 1 -- 172.21.15.100:0/4243789745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e14c4e1fe0 con 0x55e14c6334e0 2024-09-18T01:26:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.846+0000 7f25aeaa3640 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c6334e0 0x55e14c729070 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f25a0002000 tx=0x7f25a0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.846+0000 7f249b606640 1 -- 172.21.15.100:0/4243789745 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a001a5b0 con 0x55e14c6334e0 2024-09-18T01:26:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.847+0000 7f249b606640 1 -- 172.21.15.100:0/4243789745 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a001a750 con 0x55e14c6334e0 2024-09-18T01:26:32.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.847+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e14c7295b0 con 0x55e14c6334e0 2024-09-18T01:26:32.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.847+0000 7f249b606640 1 -- 172.21.15.100:0/4243789745 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a001aab0 con 0x55e14c6334e0 2024-09-18T01:26:32.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.847+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e14c729b30 con 0x55e14c6334e0 2024-09-18T01:26:32.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.847+0000 7f249b606640 1 -- 172.21.15.100:0/4243789745 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f25a0017070 con 0x55e14c6334e0 2024-09-18T01:26:32.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.848+0000 7f249b606640 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2494036b40 0x7f2494039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.848+0000 7f249b606640 1 -- 172.21.15.100:0/4243789745 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f25a0015020 con 0x55e14c6334e0 2024-09-18T01:26:32.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.848+0000 7f25ae2a2640 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2494036b40 0x7f2494039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.848+0000 7f25b0faf800 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e14c637920 0x55e14c7300e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.848+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c730660 con 0x55e14c637920 2024-09-18T01:26:32.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.848+0000 7f25af2a4640 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e14c637920 0x55e14c7300e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.848+0000 7f25ae2a2640 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2494036b40 0x7f2494039000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f25a4057000 tx=0x7f25a4052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.848+0000 7f25af2a4640 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e14c637920 0x55e14c7300e0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.848+0000 7f25af2a4640 1 -- 172.21.15.100:0/4243789745 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c637920 2024-09-18T01:26:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.849+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c72d690 con 0x55e14c637920 2024-09-18T01:26:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.849+0000 7f25af2a4640 1 -- 172.21.15.100:0/4243789745 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c637920 2024-09-18T01:26:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.849+0000 7f25b0faf800 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e14c732990 0x55e14c734d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.849+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c735420 con 0x55e14c732990 2024-09-18T01:26:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.849+0000 7f25aeaa3640 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e14c732990 0x55e14c734d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.849+0000 7f25aeaa3640 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e14c732990 0x55e14c734d80 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.849+0000 7f25aeaa3640 1 -- 172.21.15.100:0/4243789745 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c732990 2024-09-18T01:26:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.849+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c731830 con 0x55e14c637920 2024-09-18T01:26:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.850+0000 7f25af2a4640 1 -- 172.21.15.100:0/4243789745 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c637920 2024-09-18T01:26:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.850+0000 7f25b0faf800 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e14c736880 0x55e14c738c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.850+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c739370 con 0x55e14c736880 2024-09-18T01:26:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.850+0000 7f25ae2a2640 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e14c736880 0x55e14c738c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.851+0000 7f25ae2a2640 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e14c736880 0x55e14c738c70 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.851+0000 7f25ae2a2640 1 -- 172.21.15.100:0/4243789745 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c736880 2024-09-18T01:26:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.851+0000 7f25b0faf800 1 Processor -- start 2024-09-18T01:26:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.851+0000 7f25b0faf800 1 -- start start 2024-09-18T01:26:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.851+0000 7f25b0faf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c747120 0x55e14c747540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.851+0000 7f25b0faf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e14c4cf580 con 0x55e14c747120 2024-09-18T01:26:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.852+0000 7f25aeaa3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c747120 0x55e14c747540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.852+0000 7f25aeaa3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c747120 0x55e14c747540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37548/0 (socket says 172.21.15.100:37548) 2024-09-18T01:26:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.852+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1141256639 learned_addr learned my addr 172.21.15.100:0/1141256639 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.852+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1141256639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e14c747a80 con 0x55e14c747120 2024-09-18T01:26:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.852+0000 7f25aeaa3640 1 --2- 172.21.15.100:0/1141256639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c747120 0x55e14c747540 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f25a004b100 tx=0x7f25a0044510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.852+0000 7f2498e01640 1 -- 172.21.15.100:0/1141256639 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a002c040 con 0x55e14c747120 2024-09-18T01:26:32.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.852+0000 7f2498e01640 1 -- 172.21.15.100:0/1141256639 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a0044c90 con 0x55e14c747120 2024-09-18T01:26:32.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.852+0000 7f2498e01640 1 -- 172.21.15.100:0/1141256639 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a00174d0 con 0x55e14c747120 2024-09-18T01:26:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.852+0000 7f25b0faf800 1 -- 172.21.15.100:0/1141256639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e14c747d10 con 0x55e14c747120 2024-09-18T01:26:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.852+0000 7f25b0faf800 1 -- 172.21.15.100:0/1141256639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e14c747d10 con 0x55e14c747120 2024-09-18T01:26:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.853+0000 7f2498e01640 1 -- 172.21.15.100:0/1141256639 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f25a000e070 con 0x55e14c747120 2024-09-18T01:26:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.853+0000 7f2498e01640 1 --2- 172.21.15.100:0/1141256639 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2488036b40 0x7f2488039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.853+0000 7f2498e01640 1 -- 172.21.15.100:0/1141256639 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f25a003bd40 con 0x55e14c747120 2024-09-18T01:26:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.853+0000 7f25ae2a2640 1 --2- 172.21.15.100:0/1141256639 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2488036b40 0x7f2488039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.854+0000 7f25b0faf800 1 Processor -- start 2024-09-18T01:26:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.854+0000 7f25b0faf800 1 -- start start 2024-09-18T01:26:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.854+0000 7f25ae2a2640 1 --2- 172.21.15.100:0/1141256639 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2488036b40 0x7f2488039000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55e14c72d5d0 tx=0x7f25a4005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.854+0000 7f25b0faf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c757ed0 0x55e14c7582d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.854+0000 7f25b0faf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e14c721e20 con 0x55e14c757ed0 2024-09-18T01:26:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.854+0000 7f25aeaa3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c757ed0 0x55e14c7582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.854+0000 7f25aeaa3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c757ed0 0x55e14c7582d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37552/0 (socket says 172.21.15.100:37552) 2024-09-18T01:26:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.854+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1900917716 learned_addr learned my addr 172.21.15.100:0/1900917716 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.854+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1900917716 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e14c7588a0 con 0x55e14c757ed0 2024-09-18T01:26:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.854+0000 7f25aeaa3640 1 --2- 172.21.15.100:0/1900917716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c757ed0 0x55e14c7582d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f25a0029000 tx=0x7f25a0028420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bf61d46c62b0ff server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.855+0000 7f24927fc640 1 -- 172.21.15.100:0/1900917716 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a003f040 con 0x55e14c757ed0 2024-09-18T01:26:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.855+0000 7f24927fc640 1 -- 172.21.15.100:0/1900917716 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a0019430 con 0x55e14c757ed0 2024-09-18T01:26:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.855+0000 7f24927fc640 1 -- 172.21.15.100:0/1900917716 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a003f1e0 con 0x55e14c757ed0 2024-09-18T01:26:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.855+0000 7f25b0faf800 1 -- 172.21.15.100:0/1900917716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c757ed0 msgr2=0x55e14c7582d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.855+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1900917716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c757ed0 0x55e14c7582d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f25a0029000 tx=0x7f25a0028420 comp rx=0 tx=0).stop 2024-09-18T01:26:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.855+0000 7f25b0faf800 1 -- 172.21.15.100:0/1900917716 shutdown_connections 2024-09-18T01:26:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.855+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1900917716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c757ed0 0x55e14c7582d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.855+0000 7f25b0faf800 1 -- 172.21.15.100:0/1900917716 >> 172.21.15.100:0/1900917716 conn(0x55e14c74fd70 msgr2=0x55e14c74de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.855+0000 7f25b0faf800 1 -- 172.21.15.100:0/1900917716 shutdown_connections 2024-09-18T01:26:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.855+0000 7f25b0faf800 1 -- 172.21.15.100:0/1900917716 wait complete. 2024-09-18T01:26:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.855+0000 7f25b0faf800 1 Processor -- start 2024-09-18T01:26:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.856+0000 7f25b0faf800 1 -- start start 2024-09-18T01:26:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.856+0000 7f25b0faf800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c757ed0 0x55e14c75f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.856+0000 7f25b0faf800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e14c758d70 con 0x55e14c757ed0 2024-09-18T01:26:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.856+0000 7f25aeaa3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c757ed0 0x55e14c75f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.856+0000 7f25aeaa3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c757ed0 0x55e14c75f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:37558/0 (socket says 172.21.15.100:37558) 2024-09-18T01:26:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.856+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 learned_addr learned my addr 172.21.15.100:0/1617519098 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:26:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.856+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e14c75f640 con 0x55e14c757ed0 2024-09-18T01:26:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.856+0000 7f25aeaa3640 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c757ed0 0x55e14c75f100 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f25a0017ce0 tx=0x7f25a0026f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.856+0000 7f2490ff9640 1 -- 172.21.15.100:0/1617519098 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a003f040 con 0x55e14c757ed0 2024-09-18T01:26:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.856+0000 7f2490ff9640 1 -- 172.21.15.100:0/1617519098 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a000ec20 con 0x55e14c757ed0 2024-09-18T01:26:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.856+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e14c75f640 con 0x55e14c757ed0 2024-09-18T01:26:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.857+0000 7f2490ff9640 1 -- 172.21.15.100:0/1617519098 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a000e590 con 0x55e14c757ed0 2024-09-18T01:26:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.857+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e14c75f640 con 0x55e14c757ed0 2024-09-18T01:26:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.857+0000 7f2490ff9640 1 -- 172.21.15.100:0/1617519098 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f25a003f5d0 con 0x55e14c757ed0 2024-09-18T01:26:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.857+0000 7f2490ff9640 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2478036b40 0x7f2478039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.858+0000 7f2490ff9640 1 -- 172.21.15.100:0/1617519098 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f25a0057070 con 0x55e14c757ed0 2024-09-18T01:26:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.858+0000 7f25ae2a2640 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2478036b40 0x7f2478039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.858+0000 7f25ae2a2640 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2478036b40 0x7f2478039000 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f25a4051580 tx=0x7f25a406d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.858+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.858+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e14c76a830 0x55e14c76ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.858+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76d440 con 0x55e14c76a830 2024-09-18T01:26:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.858+0000 7f25af2a4640 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e14c76a830 0x55e14c76ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25af2a4640 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e14c76a830 0x55e14c76ccf0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25b0faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25b0faf800 20 realm 2024-09-18T01:26:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76d850 con 0x55e14c76a830 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25b0faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25b0faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e120 con 0x55e14c76a830 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25b0faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76a830 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.859+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.860+0000 7f25b0faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.860+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.860+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e14c76f220 0x55e14c771610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.860+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c771c20 con 0x55e14c76f220 2024-09-18T01:26:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.860+0000 7f25aeaa3640 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e14c76f220 0x55e14c771610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.860+0000 7f25aeaa3640 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e14c76f220 0x55e14c771610 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.860+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.860+0000 7f25b0faf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:26:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.860+0000 7f25b0faf800 20 searching for the correct realm 2024-09-18T01:26:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.860+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e14c773bd0 0x55e14c776090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.860+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c776760 con 0x55e14c773bd0 2024-09-18T01:26:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.860+0000 7f25ae2a2640 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e14c773bd0 0x55e14c776090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.861+0000 7f25ae2a2640 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e14c773bd0 0x55e14c776090 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.861+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.861+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c776760 con 0x55e14c76f220 2024-09-18T01:26:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.861+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.861+0000 7f25aeaa3640 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f25a005a030 0x7f25a005a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:26:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.861+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c776760 con 0x7f25a005a030 2024-09-18T01:26:32.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.861+0000 7f25af2a4640 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f25a005a030 0x7f25a005a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:26:32.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.862+0000 7f25af2a4640 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f25a005a030 0x7f25a005a890 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:26:32.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.862+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.862+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76a830 2024-09-18T01:26:32.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.862+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.862+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76a830 2024-09-18T01:26:32.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.862+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.862+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x7f25a005a030 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.863+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.863+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x7f25a005a030 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.863+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.863+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76f220 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.863+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.863+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c773bd0 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.863+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.863+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76a830 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.864+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.864+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76f220 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.864+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.864+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76a830 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.864+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.864+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76f220 2024-09-18T01:26:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.864+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.864+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c773bd0 2024-09-18T01:26:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.865+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.865+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c773bd0 2024-09-18T01:26:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.865+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.865+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x7f25a005a030 2024-09-18T01:26:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.865+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.865+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c773bd0 2024-09-18T01:26:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.865+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.865+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c773bd0 2024-09-18T01:26:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.866+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.866+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76a830 2024-09-18T01:26:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.866+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.866+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76a830 2024-09-18T01:26:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.866+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.866+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x7f25a005a030 2024-09-18T01:26:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.866+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.866+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c773bd0 2024-09-18T01:26:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.866+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.867+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76f220 2024-09-18T01:26:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.867+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.867+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76a830 2024-09-18T01:26:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.867+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.867+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x7f25a005a030 2024-09-18T01:26:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.867+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.867+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c773bd0 2024-09-18T01:26:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.868+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.868+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76f220 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.868+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.868+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76f220 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.868+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.868+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c773bd0 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.868+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.868+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x7f25a005a030 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76a830 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e14c76e4c0 con 0x55e14c76f220 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25b0faf800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25b0faf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:26:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25b0faf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:26:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25b0faf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:26:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25b0faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:26:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25b0faf800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:26:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7724e0 con 0x55e14c76a830 2024-09-18T01:26:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25b0faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7728d0 con 0x55e14c76a830 2024-09-18T01:26:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.869+0000 7f25b0faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:26:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7728d0 con 0x7f25a005a030 2024-09-18T01:26:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25b0faf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:26:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25b0faf800 20 zone default found 2024-09-18T01:26:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25b0faf800 4 Realm: () 2024-09-18T01:26:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25b0faf800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:26:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25b0faf800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:26:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25b0faf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:26:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25b0faf800 20 zonegroup default 2024-09-18T01:26:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c776be0 con 0x7f25a005a030 2024-09-18T01:26:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25b0faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.870+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7785c0 con 0x55e14c773bd0 2024-09-18T01:26:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.871+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.871+0000 7f25b0faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.871+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.871+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c778960 con 0x55e14c773bd0 2024-09-18T01:26:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.871+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.871+0000 7f25b0faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.871+0000 7f25b0faf800 20 started sync module instance, tier type = 2024-09-18T01:26:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.871+0000 7f25b0faf800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:26:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.871+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c777a60 con 0x55e14c76f220 2024-09-18T01:26:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.872+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.872+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94426138899888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c778d00 con 0x55e14c76f220 2024-09-18T01:26:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.872+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7796c0 con 0x55e14c76a830 2024-09-18T01:26:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.873+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94426138899888] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.873+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.873+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94426138907152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c779ae0 con 0x55e14c76a830 2024-09-18T01:26:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.873+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c77a4a0 con 0x55e14c773bd0 2024-09-18T01:26:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.874+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94426138907152] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.875+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.875+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94426138908208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c779a50 con 0x55e14c773bd0 2024-09-18T01:26:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.875+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c77b310 con 0x55e14c76f220 2024-09-18T01:26:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.876+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.876+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94426138916528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c77bf80 con 0x55e14c76f220 2024-09-18T01:26:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.876+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c77c9a0 con 0x55e14c76a830 2024-09-18T01:26:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.876+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94426138908208] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.877+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94426138916528] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.877+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.877+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94426138920080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c77bad0 con 0x55e14c76a830 2024-09-18T01:26:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.877+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c77d240 con 0x7f25a005a030 2024-09-18T01:26:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.878+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.878+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94426138922304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c77d610 con 0x7f25a005a030 2024-09-18T01:26:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.878+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c77de60 con 0x7f25a005a030 2024-09-18T01:26:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.878+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94426138920080] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.879+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94426138922304] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.879+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.879+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94426138923360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c77da30 con 0x7f25a005a030 2024-09-18T01:26:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.879+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c77e280 con 0x7f25a005a030 2024-09-18T01:26:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.880+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94426138923360] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.880+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.880+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94426138924896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c77e0b0 con 0x7f25a005a030 2024-09-18T01:26:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.880+0000 7f25b0faf800 20 add_watcher() i=0 2024-09-18T01:26:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.880+0000 7f25b0faf800 20 add_watcher() i=1 2024-09-18T01:26:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.880+0000 7f25b0faf800 20 add_watcher() i=2 2024-09-18T01:26:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.880+0000 7f25b0faf800 20 add_watcher() i=3 2024-09-18T01:26:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.880+0000 7f25b0faf800 20 add_watcher() i=4 2024-09-18T01:26:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.880+0000 7f25b0faf800 20 add_watcher() i=5 2024-09-18T01:26:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.880+0000 7f25b0faf800 20 add_watcher() i=6 2024-09-18T01:26:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.881+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94426138924896] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.881+0000 7f25b0faf800 20 add_watcher() i=7 2024-09-18T01:26:32.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.881+0000 7f25b0faf800 2 all 8 watchers are set, enabling cache 2024-09-18T01:26:32.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.881+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c781620 con 0x55e14c76a830 2024-09-18T01:26:32.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.882+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.882+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94426138925952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c77eb40 con 0x55e14c76a830 2024-09-18T01:26:32.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.883+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94426138925952] v35'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.883+0000 7f24657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:32.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.883+0000 7f25b0faf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:26:32.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.883+0000 7f25b0faf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:26:32.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.883+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c781460 con 0x55e14c76a830 2024-09-18T01:26:32.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.884+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'57 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.884+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c78a7d0 con 0x7f25a005a030 2024-09-18T01:26:32.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.886+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.886+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c78abf0 con 0x55e14c773bd0 2024-09-18T01:26:32.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.887+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.887+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c78b500 con 0x55e14c76a830 2024-09-18T01:26:32.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.888+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'230 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.888+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c789ea0 con 0x55e14c76f220 2024-09-18T01:26:32.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.889+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'78 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.889+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c789ea0 con 0x55e14c773bd0 2024-09-18T01:26:32.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.890+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'59 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.890+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c78c4f0 con 0x55e14c76a830 2024-09-18T01:26:32.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.891+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.891+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c78c4f0 con 0x7f25a005a030 2024-09-18T01:26:32.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.892+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'54 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.892+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c78c580 con 0x55e14c76f220 2024-09-18T01:26:32.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.894+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.894+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c78ca30 con 0x55e14c773bd0 2024-09-18T01:26:32.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.895+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.895+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788cd0 con 0x55e14c76f220 2024-09-18T01:26:32.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.896+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'79 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.896+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788cd0 con 0x7f25a005a030 2024-09-18T01:26:32.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.897+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.897+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788cd0 con 0x55e14c76f220 2024-09-18T01:26:32.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.898+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.898+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x7f25a005a030 2024-09-18T01:26:32.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.899+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.899+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c76a830 2024-09-18T01:26:32.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.900+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'231 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.900+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c773bd0 2024-09-18T01:26:32.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.901+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.901+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c76f220 2024-09-18T01:26:32.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.902+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'80 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.902+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c773bd0 2024-09-18T01:26:32.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.903+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.903+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c76a830 2024-09-18T01:26:32.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.904+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.904+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c76a830 2024-09-18T01:26:32.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.906+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'232 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.906+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c773bd0 2024-09-18T01:26:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.907+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.907+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c76f220 2024-09-18T01:26:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.908+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'43 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.908+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c773bd0 2024-09-18T01:26:32.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.909+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.909+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c773bd0 2024-09-18T01:26:32.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.910+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'45 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.910+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c773bd0 2024-09-18T01:26:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.911+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.911+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c773bd0 2024-09-18T01:26:32.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.912+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'60 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.912+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x7f25a005a030 2024-09-18T01:26:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.913+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.913+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c773bd0 2024-09-18T01:26:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.914+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.914+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x7f25a005a030 2024-09-18T01:26:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.916+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'55 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.916+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c773bd0 2024-09-18T01:26:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.917+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.917+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x7f25a005a030 2024-09-18T01:26:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.918+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.918+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c788b00 con 0x55e14c76f220 2024-09-18T01:26:32.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.919+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.919+0000 7f23dffff640 20 reqs_thread_entry: start 2024-09-18T01:26:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.919+0000 7f25b0faf800 20 init_complete bucket index max shards: 11 2024-09-18T01:26:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.919+0000 7f25b0faf800 20 Filter name: none 2024-09-18T01:26:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.919+0000 7f23ddffb640 20 reqs_thread_entry: start 2024-09-18T01:26:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.919+0000 7f25b0faf800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:26:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.919+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.919+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7b7f60 con 0x7f25a005a030 2024-09-18T01:26:32.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.920+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.920+0000 7f25b0faf800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:26:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.920+0000 7f25b0faf800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T01:26:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.920+0000 7f25b0faf800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:26:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.920+0000 7f25b0faf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:26:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.920+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7ba870 con 0x7f25a005a030 2024-09-18T01:26:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.921+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.921+0000 7f25b0faf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:153b7754-209b-4898-8796-577da7c1273d.4237.10 : miss 2024-09-18T01:26:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.921+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.921+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:96 8.2 8:44ab37f4:root::.bucket.meta.myfoo7%3a153b7754-209b-4898-8796-577da7c1273d.4237.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7ba750 con 0x55e14c76f220 2024-09-18T01:26:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.921+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(96 .bucket.meta.myfoo7:153b7754-209b-4898-8796-577da7c1273d.4237.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.921+0000 7f25b0faf800 20 rados_obj.operate() r=0 bl.length=382 2024-09-18T01:26:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.921+0000 7f25b0faf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:153b7754-209b-4898-8796-577da7c1273d.4237.10 info.flags=0x17 2024-09-18T01:26:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.921+0000 7f25b0faf800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:153b7754-209b-4898-8796-577da7c1273d.4237.10 to cache LRU end 2024-09-18T01:26:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.921+0000 7f25b0faf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:26:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.921+0000 7f25b0faf800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:26:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.921+0000 7f25b0faf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:153b7754-209b-4898-8796-577da7c1273d.4237.10 2024-09-18T01:26:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.921+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:97 4.2b 4:d61654fb:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c837cc0 con 0x55e14c76a830 2024-09-18T01:26:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.921+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(97 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.921+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:98 4.34 4:2dcb4100:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c837cc0 con 0x55e14c76f220 2024-09-18T01:26:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.922+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== osd_op_reply(98 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.922+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:99 4.10 4:0b45e194:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c837cc0 con 0x55e14c773bd0 2024-09-18T01:26:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.922+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(99 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.922+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:100 4.2f 4:f7ce4069:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c837d00 con 0x55e14c76a830 2024-09-18T01:26:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.922+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(100 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.922+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:101 4.3a 4:5e9a629f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c837d00 con 0x55e14c773bd0 2024-09-18T01:26:32.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.923+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 27 ==== osd_op_reply(101 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.923+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:102 4.25 4:a4e61a4e:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c837d00 con 0x55e14c773bd0 2024-09-18T01:26:32.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.923+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 28 ==== osd_op_reply(102 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.5 [call out=378b] v0'0 uv5 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.923+0000 7f25b0faf800 10 cls_bucket_list_unordered: got fourteen 2024-09-18T01:26:32.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.923+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:103 4.13 4:ca30b915:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c837d00 con 0x55e14c76f220 2024-09-18T01:26:32.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.923+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 23 ==== osd_op_reply(103 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.923+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:104 4.32 4:4e5b885d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c837d00 con 0x55e14c76a830 2024-09-18T01:26:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.924+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(104 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.924+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:105 4.13 4:c9499899:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c837d00 con 0x55e14c76f220 2024-09-18T01:26:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.924+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 24 ==== osd_op_reply(105 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.8 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.924+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:106 4.21 4:85316f26:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c837d00 con 0x7f25a005a030 2024-09-18T01:26:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.925+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(106 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a800a4a0 con 0x7f25a005a030 2024-09-18T01:26:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.925+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:107 4.28 4:15270fbe:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c837d00 con 0x55e14c76a830 2024-09-18T01:26:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.925+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(107 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.10 [call out=85b] v0'0 uv10 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f25a800a4a0 con 0x55e14c76a830 2024-09-18T01:26:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.925+0000 7f25b0faf800 20 get_obj_state: octx=0x7f25a004b710 obj=myfoo7:fourteen state=0x55e14c835d48 s->prefetch_data=0 2024-09-18T01:26:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.925+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:108 3.2cs0 3:377c275b:::153b7754-209b-4898-8796-577da7c1273d.4237.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c836b70 con 0x55e14c773bd0 2024-09-18T01:26:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.925+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 29 ==== osd_op_reply(108 153b7754-209b-4898-8796-577da7c1273d.4237.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.925+0000 7f25b0faf800 10 manifest: total_size = 8 2024-09-18T01:26:32.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.925+0000 7f25b0faf800 20 get_obj_state: setting s->obj_tag to 153b7754-209b-4898-8796-577da7c1273d.4237.14038842291114192453 2024-09-18T01:26:32.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.925+0000 7f25b0faf800 20 get_obj_state: octx=0x7f25a004b710 obj=myfoo7:fourteen state=0x55e14c835d48 s->prefetch_data=0 2024-09-18T01:26:32.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.925+0000 7f25b0faf800 20 prepare_atomic_modification: state is not atomic. state=0x55e14c835d48 2024-09-18T01:26:32.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.925+0000 7f25b0faf800 20 bucket index object: :.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.5 2024-09-18T01:26:32.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.925+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:109 4.25 4:a4e61a4e:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c837520 con 0x55e14c773bd0 2024-09-18T01:26:32.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.926+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 30 ==== osd_op_reply(109 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.5 [stat,call,call] v35'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.926+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:110 3.2cs0 3:377c275b:::153b7754-209b-4898-8796-577da7c1273d.4237.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c837520 con 0x55e14c773bd0 2024-09-18T01:26:32.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.928+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 31 ==== osd_op_reply(110 153b7754-209b-4898-8796-577da7c1273d.4237.10_fourteen [call] v35'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.928+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:111 4.25 4:a4e61a4e:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7bf300 con 0x55e14c773bd0 2024-09-18T01:26:32.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.928+0000 7f25b0faf800 20 list_objects_ordered: starting attempt 1 2024-09-18T01:26:32.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.928+0000 7f25b0faf800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-18T01:26:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.928+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:112 4.2b 4:d61654fb:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7bf300 con 0x55e14c76a830 2024-09-18T01:26:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.928+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:113 4.34 4:2dcb4100:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7bf300 con 0x55e14c76f220 2024-09-18T01:26:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.928+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:114 4.10 4:0b45e194:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7bf300 con 0x55e14c773bd0 2024-09-18T01:26:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.928+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(112 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.928+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:115 4.2f 4:f7ce4069:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c835610 con 0x55e14c76a830 2024-09-18T01:26:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.928+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 25 ==== osd_op_reply(113 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a002e070 con 0x55e14c76f220 2024-09-18T01:26:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 32 ==== osd_op_reply(114 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(115 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:116 4.3a 4:5e9a629f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c835610 con 0x55e14c773bd0 2024-09-18T01:26:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:117 4.25 4:a4e61a4e:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c3c70 con 0x55e14c773bd0 2024-09-18T01:26:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:118 4.13 4:ca30b915:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6730 con 0x55e14c76f220 2024-09-18T01:26:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:119 4.32 4:4e5b885d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c93d0 con 0x55e14c76a830 2024-09-18T01:26:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:120 4.13 4:c9499899:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7cbe90 con 0x55e14c76f220 2024-09-18T01:26:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:121 4.21 4:85316f26:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7ce880 con 0x7f25a005a030 2024-09-18T01:26:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:122 4.28 4:15270fbe:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c93d0 con 0x55e14c76a830 2024-09-18T01:26:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 26 ==== osd_op_reply(118 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(119 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 33 ==== osd_op_reply(116 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(121 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 34 ==== osd_op_reply(122 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.10 [call out=85b] v0'0 uv10 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.929+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 27 ==== osd_op_reply(120 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.8 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.930+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 34 ==== osd_op_reply(111 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.5 [stat,call,call] v35'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.930+0000 7f24927fc640 20 handle_completion(): completion ok for obj=fourteen 2024-09-18T01:26:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.930+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 35 ==== osd_op_reply(117 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-18T01:26:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-18T01:26:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-18T01:26:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-18T01:26:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[153b7754-209b-4898-8796-577da7c1273d.4237.10])"; uploads.size()=0; is_truncated=0 2024-09-18T01:26:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:123 4.2b 4:d61654fb:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7cbe90 con 0x55e14c76a830 2024-09-18T01:26:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:124 4.34 4:2dcb4100:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7ce880 con 0x55e14c76f220 2024-09-18T01:26:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:125 4.10 4:0b45e194:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6170 con 0x55e14c773bd0 2024-09-18T01:26:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:126 4.2f 4:f7ce4069:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7ce7e0 con 0x55e14c76a830 2024-09-18T01:26:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:127 4.3a 4:5e9a629f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6170 con 0x55e14c773bd0 2024-09-18T01:26:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:128 4.25 4:a4e61a4e:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7cbd40 con 0x55e14c773bd0 2024-09-18T01:26:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:129 4.13 4:ca30b915:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7bd2e0 con 0x55e14c76f220 2024-09-18T01:26:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:130 4.32 4:4e5b885d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7bebe0 con 0x55e14c76a830 2024-09-18T01:26:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:131 4.13 4:c9499899:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7d2180 con 0x55e14c76f220 2024-09-18T01:26:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:132 4.21 4:85316f26:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7d4bc0 con 0x7f25a005a030 2024-09-18T01:26:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:133 4.28 4:15270fbe:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7d78b0 con 0x55e14c76a830 2024-09-18T01:26:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 28 ==== osd_op_reply(124 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 35 ==== osd_op_reply(123 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 36 ==== osd_op_reply(126 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 36 ==== osd_op_reply(125 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 37 ==== osd_op_reply(128 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 37 ==== osd_op_reply(130 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 38 ==== osd_op_reply(127 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 29 ==== osd_op_reply(129 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.931+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 38 ==== osd_op_reply(133 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.10 [call out=85b] v0'0 uv10 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.932+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 30 ==== osd_op_reply(131 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.8 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.932+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(132 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.932+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7d4bc0 con 0x7f25a005a030 2024-09-18T01:26:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.933+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(134 fud.buckets [call] v35'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.933+0000 7f25b0faf800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-18T01:26:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.933+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.933+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7d4bc0 con 0x55e14c76f220 2024-09-18T01:26:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.933+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 31 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv47 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.933+0000 7f25b0faf800 20 rados_obj.operate() r=0 bl.length=168 2024-09-18T01:26:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.933+0000 7f25b0faf800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-18T01:26:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.933+0000 7f25b0faf800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-18T01:26:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.933+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7d4bc0 con 0x55e14c76f220 2024-09-18T01:26:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.935+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 32 ==== osd_op_reply(136 myfoo7 [call,call,delete] v35'49 uv49 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.935+0000 7f25b0faf800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-18T01:26:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.935+0000 7f25b0faf800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-18T01:26:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.935+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94426139293712 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x55e14c76f220 2024-09-18T01:26:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.935+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 33 ==== watch-notify(notify (1) cookie 94426138916528 notify 150323855380 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55e14c7b9c30 con 0x55e14c76f220 2024-09-18T01:26:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.935+0000 7f2491ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855380 cookie 94426138916528 notifier 4769 bl.length()=150 2024-09-18T01:26:32.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.935+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 34 ==== osd_op_reply(137 notify.3 [notify cookie 94426139293712 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.935+0000 7f2491ffb640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f23e4003380 con 0x55e14c76f220 2024-09-18T01:26:32.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.935+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 35 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.935+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 36 ==== watch-notify(notify_complete (2) cookie 94426139293712 notify 150323855380 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e14c729b30 con 0x55e14c76f220 2024-09-18T01:26:32.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.935+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:139 8.2 8:44ab37f4:root::.bucket.meta.myfoo7%3a153b7754-209b-4898-8796-577da7c1273d.4237.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x55e14c76f220 2024-09-18T01:26:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.937+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 37 ==== osd_op_reply(139 .bucket.meta.myfoo7:153b7754-209b-4898-8796-577da7c1273d.4237.10 [call,call,delete] v35'4 uv4 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.937+0000 7f25b0faf800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:153b7754-209b-4898-8796-577da7c1273d.4237.10 from cache 2024-09-18T01:26:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.937+0000 7f25b0faf800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:153b7754-209b-4898-8796-577da7c1273d.4237.10, ofs0, ns] 2024-09-18T01:26:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.937+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 94426139293712 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x7f25a005a030 2024-09-18T01:26:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.937+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 29 ==== watch-notify(notify (1) cookie 94426138922304 notify 150323855385 ret 0) ==== 250+0+0 (crc 0 0 0) 0x55e14c7898c0 con 0x7f25a005a030 2024-09-18T01:26:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.937+0000 7f2491ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855385 cookie 94426138922304 notifier 4769 bl.length()=208 2024-09-18T01:26:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.937+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 30 ==== osd_op_reply(140 notify.5 [notify cookie 94426139293712 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.937+0000 7f2491ffb640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f23e4003320 con 0x7f25a005a030 2024-09-18T01:26:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.937+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 31 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.938+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 32 ==== watch-notify(notify_complete (2) cookie 94426139293712 notify 150323855385 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e14c781100 con 0x7f25a005a030 2024-09-18T01:26:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.938+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:142 4.2b 4:d61654fb:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x55e14c76a830 2024-09-18T01:26:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.938+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:143 4.34 4:2dcb4100:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7d4bc0 con 0x55e14c76f220 2024-09-18T01:26:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.938+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:144 4.10 4:0b45e194:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c835a20 con 0x55e14c773bd0 2024-09-18T01:26:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.938+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:145 4.2f 4:f7ce4069:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7b8a00 con 0x55e14c76a830 2024-09-18T01:26:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.938+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:146 4.3a 4:5e9a629f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x55e14c773bd0 2024-09-18T01:26:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.938+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:147 4.25 4:a4e61a4e:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c835a20 con 0x55e14c773bd0 2024-09-18T01:26:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.938+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:148 4.13 4:ca30b915:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7d4bc0 con 0x55e14c76f220 2024-09-18T01:26:32.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.938+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:149 4.32 4:4e5b885d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x55e14c76a830 2024-09-18T01:26:32.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.938+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:150 4.13 4:c9499899:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c835a20 con 0x55e14c76f220 2024-09-18T01:26:32.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.939+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:151 4.21 4:85316f26:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7d4bc0 con 0x7f25a005a030 2024-09-18T01:26:32.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.939+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:152 4.28 4:15270fbe:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x55e14c76a830 2024-09-18T01:26:32.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.940+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 39 ==== osd_op_reply(145 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.3 [delete] v35'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.940+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 39 ==== osd_op_reply(147 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.5 [delete] v35'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.940+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 38 ==== osd_op_reply(143 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.1 [delete] v35'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.940+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 39 ==== osd_op_reply(148 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.6 [delete] v35'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.940+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 40 ==== osd_op_reply(142 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.0 [delete] v35'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.940+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 40 ==== osd_op_reply(146 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.4 [delete] v35'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.940+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 41 ==== osd_op_reply(144 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.2 [delete] v35'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.940+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 40 ==== osd_op_reply(150 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.8 [delete] v35'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.940+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 41 ==== osd_op_reply(152 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.10 [delete] v35'11 uv11 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.940+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 42 ==== osd_op_reply(149 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.7 [delete] v35'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.940+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 33 ==== osd_op_reply(151 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.10.9 [delete] v35'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.940+0000 7f25b0faf800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/153b7754-209b-4898-8796-577da7c1273d.4237.10 : miss 2024-09-18T01:26:32.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.940+0000 7f25b0faf800 20 rados->read ofs=0 len=0 2024-09-18T01:26:32.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.940+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:153 6.a 6:5264fa4c:::pubsub..bucket.myfoo7%2f153b7754-209b-4898-8796-577da7c1273d.4237.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c835a20 con 0x55e14c76f220 2024-09-18T01:26:32.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.941+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 41 ==== osd_op_reply(153 pubsub..bucket.myfoo7/153b7754-209b-4898-8796-577da7c1273d.4237.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.941+0000 7f25b0faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:26:32.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.941+0000 7f25b0faf800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/153b7754-209b-4898-8796-577da7c1273d.4237.10 info.flags=0x0 2024-09-18T01:26:32.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.941+0000 7f25b0faf800 10 adding default.rgw.log++pubsub..bucket.myfoo7/153b7754-209b-4898-8796-577da7c1273d.4237.10 to cache LRU end 2024-09-18T01:26:32.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.941+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:154 6.a 6:5264fa4c:::pubsub..bucket.myfoo7%2f153b7754-209b-4898-8796-577da7c1273d.4237.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x55e14c76f220 2024-09-18T01:26:32.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.942+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 42 ==== osd_op_reply(154 pubsub..bucket.myfoo7/153b7754-209b-4898-8796-577da7c1273d.4237.10 [delete] v35'44 uv37 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.942+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c835a20 con 0x7f25a005a030 2024-09-18T01:26:32.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.943+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 34 ==== osd_op_reply(155 fud.buckets [call] v35'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.943+0000 7f25b0faf800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-18T01:26:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.943+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x7f25a005a030 2024-09-18T01:26:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.944+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 35 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v35'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.944+0000 7f25b0faf800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:26:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.944+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94426139680256 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c835a20 con 0x55e14c773bd0 2024-09-18T01:26:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.944+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 42 ==== watch-notify(notify (1) cookie 94426138908208 notify 150323855367 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55e14c78c210 con 0x55e14c773bd0 2024-09-18T01:26:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.944+0000 7f2491ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855367 cookie 94426138908208 notifier 4769 bl.length()=170 2024-09-18T01:26:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.944+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 43 ==== osd_op_reply(157 notify.2 [notify cookie 94426139680256 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.944+0000 7f2491ffb640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f23e4003320 con 0x55e14c773bd0 2024-09-18T01:26:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.944+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 44 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.945+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 45 ==== watch-notify(notify_complete (2) cookie 94426139680256 notify 150323855367 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e14c78c040 con 0x55e14c773bd0 2024-09-18T01:26:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.945+0000 7f25b0faf800 10 removing email index: 2024-09-18T01:26:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.945+0000 7f25b0faf800 10 removing user buckets index 2024-09-18T01:26:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.945+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x7f25a005a030 2024-09-18T01:26:32.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.946+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 36 ==== osd_op_reply(159 fud.buckets [delete] v35'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.946+0000 7f25b0faf800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-18T01:26:32.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.946+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94426139174592 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c835a20 con 0x7f25a005a030 2024-09-18T01:26:32.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.946+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 37 ==== watch-notify(notify (1) cookie 94426138923360 notify 150323855386 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55e14c781100 con 0x7f25a005a030 2024-09-18T01:26:32.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.946+0000 7f24927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855386 cookie 94426138923360 notifier 4769 bl.length()=160 2024-09-18T01:26:32.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.946+0000 7f24927fc640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f2474003d60 con 0x7f25a005a030 2024-09-18T01:26:32.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.946+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 38 ==== osd_op_reply(160 notify.6 [notify cookie 94426139174592 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.946+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 39 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.946+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 40 ==== watch-notify(notify_complete (2) cookie 94426139174592 notify 150323855386 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e14c780f30 con 0x7f25a005a030 2024-09-18T01:26:32.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.946+0000 7f25b0faf800 10 removing user index: fud 2024-09-18T01:26:32.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.946+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x7f25a005a030 2024-09-18T01:26:32.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.947+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 41 ==== osd_op_reply(162 fud [call,call,delete] v35'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.947+0000 7f25b0faf800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-18T01:26:32.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.947+0000 7f25b0faf800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-18T01:26:32.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.947+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94426139174592 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e14c835a20 con 0x7f25a005a030 2024-09-18T01:26:32.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.948+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 42 ==== watch-notify(notify (1) cookie 94426138922304 notify 150323855387 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55e14c780f30 con 0x7f25a005a030 2024-09-18T01:26:32.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.948+0000 7f2491ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855387 cookie 94426138922304 notifier 4769 bl.length()=152 2024-09-18T01:26:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.948+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 43 ==== osd_op_reply(163 notify.5 [notify cookie 94426139174592 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.948+0000 7f2491ffb640 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f23e4003320 con 0x7f25a005a030 2024-09-18T01:26:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.948+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 44 ==== watch-notify(notify_complete (2) cookie 94426139174592 notify 150323855387 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e14c7815f0 con 0x7f25a005a030 2024-09-18T01:26:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.948+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 45 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.949+0000 7f24657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:26:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.949+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94426138925952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x55e14c76a830 2024-09-18T01:26:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.950+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 43 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94426138925952] v35'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.950+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94426138899888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c835a20 con 0x55e14c76f220 2024-09-18T01:26:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.951+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 43 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94426138899888] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.951+0000 7f25b0faf800 20 remove_watcher() i=0 2024-09-18T01:26:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.951+0000 7f25b0faf800 2 removed watcher, disabling cache 2024-09-18T01:26:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.951+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94426138907152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x55e14c76a830 2024-09-18T01:26:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.952+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 44 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94426138907152] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.952+0000 7f25b0faf800 20 remove_watcher() i=1 2024-09-18T01:26:32.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.952+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94426138908208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x55e14c773bd0 2024-09-18T01:26:32.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.953+0000 7f25ae2a2640 1 -- 172.21.15.100:0/1617519098 <== osd.3 v2:172.21.15.100:6816/595195757 46 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94426138908208] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a4057030 con 0x55e14c773bd0 2024-09-18T01:26:32.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.953+0000 7f25b0faf800 20 remove_watcher() i=2 2024-09-18T01:26:32.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.953+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94426138916528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x55e14c76f220 2024-09-18T01:26:32.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.954+0000 7f25aeaa3640 1 -- 172.21.15.100:0/1617519098 <== osd.2 v2:172.21.15.100:6808/3104327688 44 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94426138916528] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a009a040 con 0x55e14c76f220 2024-09-18T01:26:32.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.954+0000 7f25b0faf800 20 remove_watcher() i=3 2024-09-18T01:26:32.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.954+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94426138920080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x55e14c76a830 2024-09-18T01:26:32.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.956+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.1 v2:172.21.15.100:6800/170575980 45 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94426138920080] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x55e14c76a830 2024-09-18T01:26:32.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.956+0000 7f25b0faf800 20 remove_watcher() i=4 2024-09-18T01:26:32.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.956+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94426138922304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x7f25a005a030 2024-09-18T01:26:32.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.957+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 46 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94426138922304] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.957+0000 7f25b0faf800 20 remove_watcher() i=5 2024-09-18T01:26:32.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.957+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94426138923360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x7f25a005a030 2024-09-18T01:26:32.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.958+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 47 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94426138923360] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.958+0000 7f25b0faf800 20 remove_watcher() i=6 2024-09-18T01:26:32.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.958+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94426138924896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e14c7c6790 con 0x7f25a005a030 2024-09-18T01:26:32.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 <== osd.0 v2:172.21.15.92:6800/2777570747 48 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94426138924896] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a804c060 con 0x7f25a005a030 2024-09-18T01:26:32.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 20 remove_watcher() i=7 2024-09-18T01:26:32.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f25a005a030 msgr2=0x7f25a005a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f25a005a030 0x7f25a005a890 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e14c76a830 msgr2=0x55e14c76ccf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e14c76a830 0x55e14c76ccf0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e14c76f220 msgr2=0x55e14c771610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e14c76f220 0x55e14c771610 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e14c773bd0 msgr2=0x55e14c776090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55e14c773bd0 0x55e14c776090 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2478036b40 msgr2=0x7f2478039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2478036b40 0x7f2478039000 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f25a4051580 tx=0x7f25a406d040 comp rx=0 tx=0).stop 2024-09-18T01:26:32.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c757ed0 msgr2=0x55e14c75f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25af2a4640 1 -- 172.21.15.100:0/1617519098 reap_dead start 2024-09-18T01:26:32.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c757ed0 0x55e14c75f100 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f25a0017ce0 tx=0x7f25a0026f70 comp rx=0 tx=0).stop 2024-09-18T01:26:32.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 shutdown_connections 2024-09-18T01:26:32.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1617519098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c757ed0 0x55e14c75f100 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 >> 172.21.15.100:0/1617519098 conn(0x55e14c74fd70 msgr2=0x55e14c74de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 shutdown_connections 2024-09-18T01:26:32.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 -- 172.21.15.100:0/1617519098 wait complete. 2024-09-18T01:26:32.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 -- 172.21.15.100:0/1141256639 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2488036b40 msgr2=0x7f2488039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1141256639 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2488036b40 0x7f2488039000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55e14c72d5d0 tx=0x7f25a4005ac0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 -- 172.21.15.100:0/1141256639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c747120 msgr2=0x55e14c747540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1141256639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c747120 0x55e14c747540 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f25a004b100 tx=0x7f25a0044510 comp rx=0 tx=0).stop 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 -- 172.21.15.100:0/1141256639 shutdown_connections 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1141256639 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2488036b40 0x7f2488039000 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 --2- 172.21.15.100:0/1141256639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c747120 0x55e14c747540 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.959+0000 7f25b0faf800 1 -- 172.21.15.100:0/1141256639 >> 172.21.15.100:0/1141256639 conn(0x55e14c73c0b0 msgr2=0x55e14c73ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 -- 172.21.15.100:0/1141256639 shutdown_connections 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 -- 172.21.15.100:0/1141256639 wait complete. 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e14c736880 msgr2=0x55e14c738c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55e14c736880 0x55e14c738c70 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e14c637920 msgr2=0x55e14c7300e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e14c637920 0x55e14c7300e0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e14c732990 msgr2=0x55e14c734d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e14c732990 0x55e14c734d80 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2494036b40 msgr2=0x7f2494039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2494036b40 0x7f2494039000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f25a4057000 tx=0x7f25a4052000 comp rx=0 tx=0).stop 2024-09-18T01:26:32.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c6334e0 msgr2=0x55e14c729070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:26:32.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 --2- 172.21.15.100:0/4243789745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e14c6334e0 0x55e14c729070 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f25a0002000 tx=0x7f25a0000bc0 comp rx=0 tx=0).stop 2024-09-18T01:26:32.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25af2a4640 1 -- 172.21.15.100:0/4243789745 reap_dead start 2024-09-18T01:26:32.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 shutdown_connections 2024-09-18T01:26:32.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 >> 172.21.15.100:0/4243789745 conn(0x55e14c62edd0 msgr2=0x55e14c71b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:26:32.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 shutdown_connections 2024-09-18T01:26:32.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:26:32.960+0000 7f25b0faf800 1 -- 172.21.15.100:0/4243789745 wait complete. 2024-09-18T01:27:12.971 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-18T01:27:12.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-18T01:27:12.972 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-18T01:27:13.024 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:13.024 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:13.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.024+0000 7fe035440800 1 Processor -- start 2024-09-18T01:27:13.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.024+0000 7fe035440800 1 -- start start 2024-09-18T01:27:13.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.024+0000 7fe035440800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55aee2c4a900 0x55aee2c4ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.024+0000 7fe035440800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aee2b06b30 con 0x55aee2c464c0 2024-09-18T01:27:13.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.024+0000 7fe035440800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55aee2ae8360 con 0x55aee2c4a900 2024-09-18T01:27:13.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.024+0000 7fe032733640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55aee2c4a900 0x55aee2c4ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.024+0000 7fe032f34640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55aee2c464c0 0x55aee2c468c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37082/0 (socket says 172.21.15.100:37082) 2024-09-18T01:27:13.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.024+0000 7fe032f34640 1 -- 172.21.15.100:0/103416319 learned_addr learned my addr 172.21.15.100:0/103416319 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:13.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.024+0000 7fe032733640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55aee2c4a900 0x55aee2c4ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44900/0 (socket says 172.21.15.100:44900) 2024-09-18T01:27:13.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.025+0000 7fe032733640 1 -- 172.21.15.100:0/103416319 >> v1:172.21.15.92:6789/0 conn(0x55aee2c464c0 legacy=0x55aee2c468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.025+0000 7fe032733640 1 -- 172.21.15.100:0/103416319 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aee2b0ee00 con 0x55aee2c4a900 2024-09-18T01:27:13.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.025+0000 7fe031f32640 1 -- 172.21.15.100:0/103416319 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923635300 0 0) 0x55aee2b06b30 con 0x55aee2c464c0 2024-09-18T01:27:13.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.027+0000 7fe032733640 1 --2- 172.21.15.100:0/103416319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c4a900 0x55aee2c4ccf0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe02800a600 tx=0x7fe028047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdc78df87980046 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.027+0000 7fe031f32640 1 -- 172.21.15.100:0/103416319 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe028056070 con 0x55aee2c4a900 2024-09-18T01:27:13.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.027+0000 7fe031f32640 1 -- 172.21.15.100:0/103416319 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02800a200 con 0x55aee2c4a900 2024-09-18T01:27:13.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.027+0000 7fe031f32640 1 -- 172.21.15.100:0/103416319 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe028008590 con 0x55aee2c4a900 2024-09-18T01:27:13.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.027+0000 7fe035440800 1 -- 172.21.15.100:0/103416319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c4a900 msgr2=0x55aee2c4ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.027+0000 7fe035440800 1 --2- 172.21.15.100:0/103416319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c4a900 0x55aee2c4ccf0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe02800a600 tx=0x7fe028047cb0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.027+0000 7fe035440800 1 -- 172.21.15.100:0/103416319 shutdown_connections 2024-09-18T01:27:13.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.027+0000 7fe035440800 1 --2- 172.21.15.100:0/103416319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c4a900 0x55aee2c4ccf0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.027+0000 7fe035440800 1 -- 172.21.15.100:0/103416319 >> 172.21.15.100:0/103416319 conn(0x55aee2c41df0 msgr2=0x55aee2c44210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.027+0000 7fe035440800 1 -- 172.21.15.100:0/103416319 shutdown_connections 2024-09-18T01:27:13.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.027+0000 7fe035440800 1 -- 172.21.15.100:0/103416319 wait complete. 2024-09-18T01:27:13.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.043+0000 7fe035440800 1 Processor -- start 2024-09-18T01:27:13.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.043+0000 7fe035440800 1 -- start start 2024-09-18T01:27:13.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.043+0000 7fe035440800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c464c0 0x55aee2d34460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.043+0000 7fe035440800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aee2b93330 con 0x55aee2c464c0 2024-09-18T01:27:13.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.043+0000 7fe032f34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c464c0 0x55aee2d34460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.044+0000 7fe032f34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c464c0 0x55aee2d34460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44906/0 (socket says 172.21.15.100:44906) 2024-09-18T01:27:13.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.044+0000 7fe032f34640 1 -- 172.21.15.100:0/3279226202 learned_addr learned my addr 172.21.15.100:0/3279226202 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.044+0000 7fe032f34640 1 -- 172.21.15.100:0/3279226202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aee2ae0bc0 con 0x55aee2c464c0 2024-09-18T01:27:13.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.044+0000 7fe032f34640 1 --2- 172.21.15.100:0/3279226202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c464c0 0x55aee2d34460 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe024001660 tx=0x7fe024001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3404f00f1045c9fe server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.044+0000 7fdf20e09640 1 -- 172.21.15.100:0/3279226202 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe024003450 con 0x55aee2c464c0 2024-09-18T01:27:13.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.044+0000 7fdf20e09640 1 -- 172.21.15.100:0/3279226202 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe024003610 con 0x55aee2c464c0 2024-09-18T01:27:13.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.044+0000 7fdf20e09640 1 -- 172.21.15.100:0/3279226202 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0240039b0 con 0x55aee2c464c0 2024-09-18T01:27:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.045+0000 7fe035440800 1 -- 172.21.15.100:0/3279226202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c464c0 msgr2=0x55aee2d34460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.045+0000 7fe035440800 1 --2- 172.21.15.100:0/3279226202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c464c0 0x55aee2d34460 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe024001660 tx=0x7fe024001b20 comp rx=0 tx=0).stop 2024-09-18T01:27:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.045+0000 7fe035440800 1 -- 172.21.15.100:0/3279226202 shutdown_connections 2024-09-18T01:27:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.045+0000 7fe035440800 1 --2- 172.21.15.100:0/3279226202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c464c0 0x55aee2d34460 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.045+0000 7fe035440800 1 -- 172.21.15.100:0/3279226202 >> 172.21.15.100:0/3279226202 conn(0x55aee2c41df0 msgr2=0x55aee2d2fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.045+0000 7fe035440800 1 -- 172.21.15.100:0/3279226202 shutdown_connections 2024-09-18T01:27:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.045+0000 7fe035440800 1 -- 172.21.15.100:0/3279226202 wait complete. 2024-09-18T01:27:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.045+0000 7fe035440800 1 Processor -- start 2024-09-18T01:27:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.045+0000 7fe035440800 1 -- start start 2024-09-18T01:27:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.046+0000 7fe035440800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c464c0 0x55aee2d40220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.046+0000 7fe035440800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aee2c4d530 con 0x55aee2c464c0 2024-09-18T01:27:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.046+0000 7fe032f34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c464c0 0x55aee2d40220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.046+0000 7fe032f34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c464c0 0x55aee2d40220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44910/0 (socket says 172.21.15.100:44910) 2024-09-18T01:27:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.046+0000 7fe032f34640 1 -- 172.21.15.100:0/3779075840 learned_addr learned my addr 172.21.15.100:0/3779075840 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.046+0000 7fe032f34640 1 -- 172.21.15.100:0/3779075840 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aee2af4fe0 con 0x55aee2c464c0 2024-09-18T01:27:13.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.046+0000 7fe032f34640 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c464c0 0x55aee2d40220 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x55aee2d352c0 tx=0x7fe024001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.047+0000 7fdf1f606640 1 -- 172.21.15.100:0/3779075840 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe024025070 con 0x55aee2c464c0 2024-09-18T01:27:13.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.047+0000 7fdf1f606640 1 -- 172.21.15.100:0/3779075840 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe024019040 con 0x55aee2c464c0 2024-09-18T01:27:13.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.047+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aee2d40760 con 0x55aee2c464c0 2024-09-18T01:27:13.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.047+0000 7fdf1f606640 1 -- 172.21.15.100:0/3779075840 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe024013950 con 0x55aee2c464c0 2024-09-18T01:27:13.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.047+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aee2d40ce0 con 0x55aee2c464c0 2024-09-18T01:27:13.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.048+0000 7fdf1f606640 1 -- 172.21.15.100:0/3779075840 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe024010070 con 0x55aee2c464c0 2024-09-18T01:27:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.048+0000 7fdf1f606640 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdf18036b90 0x7fdf18039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.048+0000 7fdf1f606640 1 -- 172.21.15.100:0/3779075840 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fe02404c100 con 0x55aee2c464c0 2024-09-18T01:27:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.048+0000 7fe032733640 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdf18036b90 0x7fdf18039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.048+0000 7fe035440800 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aee2c4a900 0x55aee2d47290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.048+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d47820 con 0x55aee2c4a900 2024-09-18T01:27:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.048+0000 7fe033735640 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aee2c4a900 0x55aee2d47290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.048+0000 7fe032733640 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdf18036b90 0x7fdf18039050 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe028058000 tx=0x7fe02800a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.048+0000 7fe033735640 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aee2c4a900 0x55aee2d47290 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.049+0000 7fe033735640 1 -- 172.21.15.100:0/3779075840 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe02c0083e0 con 0x55aee2c4a900 2024-09-18T01:27:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.049+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d44840 con 0x55aee2c4a900 2024-09-18T01:27:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.049+0000 7fe033735640 1 -- 172.21.15.100:0/3779075840 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe02c0083e0 con 0x55aee2c4a900 2024-09-18T01:27:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.049+0000 7fe035440800 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55aee2d49b30 0x55aee2d4bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.049+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d4c610 con 0x55aee2d49b30 2024-09-18T01:27:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.049+0000 7fe032f34640 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55aee2d49b30 0x55aee2d4bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.050+0000 7fe032f34640 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55aee2d49b30 0x55aee2d4bf20 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.050+0000 7fe032f34640 1 -- 172.21.15.100:0/3779075840 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe02400f030 con 0x55aee2d49b30 2024-09-18T01:27:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.050+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d489d0 con 0x55aee2c4a900 2024-09-18T01:27:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.050+0000 7fe033735640 1 -- 172.21.15.100:0/3779075840 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe02c0083e0 con 0x55aee2c4a900 2024-09-18T01:27:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.050+0000 7fe035440800 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55aee2d4da70 0x55aee2d4fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.050+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d50550 con 0x55aee2d4da70 2024-09-18T01:27:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.051+0000 7fe032733640 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55aee2d4da70 0x55aee2d4fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.051+0000 7fe032733640 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55aee2d4da70 0x55aee2d4fe60 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.052+0000 7fe032733640 1 -- 172.21.15.100:0/3779075840 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d4da70 2024-09-18T01:27:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.052+0000 7fe035440800 1 Processor -- start 2024-09-18T01:27:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.052+0000 7fe035440800 1 -- start start 2024-09-18T01:27:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.052+0000 7fe035440800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d5e300 0x55aee2d5e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.052+0000 7fe035440800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aee2ae2580 con 0x55aee2d5e300 2024-09-18T01:27:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.052+0000 7fe032f34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d5e300 0x55aee2d5e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.052+0000 7fe032f34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d5e300 0x55aee2d5e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44924/0 (socket says 172.21.15.100:44924) 2024-09-18T01:27:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.052+0000 7fe032f34640 1 -- 172.21.15.100:0/893030802 learned_addr learned my addr 172.21.15.100:0/893030802 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.053+0000 7fe032f34640 1 -- 172.21.15.100:0/893030802 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aee2d5ec60 con 0x55aee2d5e300 2024-09-18T01:27:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.053+0000 7fe032f34640 1 --2- 172.21.15.100:0/893030802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d5e300 0x55aee2d5e720 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe02400d010 tx=0x7fe02401e520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.053+0000 7fdf1ce01640 1 -- 172.21.15.100:0/893030802 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe02403eb50 con 0x55aee2d5e300 2024-09-18T01:27:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.053+0000 7fdf1ce01640 1 -- 172.21.15.100:0/893030802 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02403ecf0 con 0x55aee2d5e300 2024-09-18T01:27:13.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.053+0000 7fe035440800 1 -- 172.21.15.100:0/893030802 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aee2d5eef0 con 0x55aee2d5e300 2024-09-18T01:27:13.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.053+0000 7fdf1ce01640 1 -- 172.21.15.100:0/893030802 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe024043ad0 con 0x55aee2d5e300 2024-09-18T01:27:13.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.053+0000 7fe035440800 1 -- 172.21.15.100:0/893030802 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aee2d61bd0 con 0x55aee2d5e300 2024-09-18T01:27:13.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.054+0000 7fdf1ce01640 1 -- 172.21.15.100:0/893030802 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe02403a060 con 0x55aee2d5e300 2024-09-18T01:27:13.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.054+0000 7fdf1ce01640 1 --2- 172.21.15.100:0/893030802 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdf0c036b90 0x7fdf0c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.054+0000 7fdf1ce01640 1 -- 172.21.15.100:0/893030802 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fe024034d40 con 0x55aee2d5e300 2024-09-18T01:27:13.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.054+0000 7fe032733640 1 --2- 172.21.15.100:0/893030802 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdf0c036b90 0x7fdf0c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.054+0000 7fe035440800 1 Processor -- start 2024-09-18T01:27:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.054+0000 7fe035440800 1 -- start start 2024-09-18T01:27:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.054+0000 7fe032733640 1 --2- 172.21.15.100:0/893030802 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdf0c036b90 0x7fdf0c039050 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55aee2d480e0 tx=0x7fe028005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.055+0000 7fe035440800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d6af70 0x55aee2d6b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.055+0000 7fe035440800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aee2d34bb0 con 0x55aee2d6af70 2024-09-18T01:27:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.055+0000 7fe032f34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d6af70 0x55aee2d6b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.055+0000 7fe032f34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d6af70 0x55aee2d6b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44936/0 (socket says 172.21.15.100:44936) 2024-09-18T01:27:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.055+0000 7fe032f34640 1 -- 172.21.15.100:0/733724284 learned_addr learned my addr 172.21.15.100:0/733724284 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.055+0000 7fe032f34640 1 -- 172.21.15.100:0/733724284 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aee2d6b940 con 0x55aee2d6af70 2024-09-18T01:27:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.055+0000 7fe032f34640 1 --2- 172.21.15.100:0/733724284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d6af70 0x55aee2d6b370 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe024012c00 tx=0x7fe02401f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ac7e62568aabcb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.055+0000 7fdf167fc640 1 -- 172.21.15.100:0/733724284 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe02405e070 con 0x55aee2d6af70 2024-09-18T01:27:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.056+0000 7fdf167fc640 1 -- 172.21.15.100:0/733724284 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe024051070 con 0x55aee2d6af70 2024-09-18T01:27:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.056+0000 7fdf167fc640 1 -- 172.21.15.100:0/733724284 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe024010590 con 0x55aee2d6af70 2024-09-18T01:27:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.056+0000 7fe035440800 1 -- 172.21.15.100:0/733724284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d6af70 msgr2=0x55aee2d6b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.056+0000 7fe035440800 1 --2- 172.21.15.100:0/733724284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d6af70 0x55aee2d6b370 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe024012c00 tx=0x7fe02401f720 comp rx=0 tx=0).stop 2024-09-18T01:27:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.056+0000 7fe035440800 1 -- 172.21.15.100:0/733724284 shutdown_connections 2024-09-18T01:27:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.056+0000 7fe035440800 1 --2- 172.21.15.100:0/733724284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d6af70 0x55aee2d6b370 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.056+0000 7fe035440800 1 -- 172.21.15.100:0/733724284 >> 172.21.15.100:0/733724284 conn(0x55aee2d672d0 msgr2=0x55aee2d653d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.056+0000 7fe035440800 1 -- 172.21.15.100:0/733724284 shutdown_connections 2024-09-18T01:27:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.056+0000 7fe035440800 1 -- 172.21.15.100:0/733724284 wait complete. 2024-09-18T01:27:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.056+0000 7fe035440800 1 Processor -- start 2024-09-18T01:27:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.056+0000 7fe035440800 1 -- start start 2024-09-18T01:27:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.057+0000 7fe035440800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d6af70 0x55aee2d72220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.057+0000 7fe035440800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aee2d6bec0 con 0x55aee2d6af70 2024-09-18T01:27:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.057+0000 7fe032f34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d6af70 0x55aee2d72220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.057+0000 7fe032f34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d6af70 0x55aee2d72220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44938/0 (socket says 172.21.15.100:44938) 2024-09-18T01:27:13.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.057+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 learned_addr learned my addr 172.21.15.100:0/983734002 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.057+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aee2d72760 con 0x55aee2d6af70 2024-09-18T01:27:13.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.057+0000 7fe032f34640 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d6af70 0x55aee2d72220 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe024002070 tx=0x7fe024007150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.058+0000 7fdf14ff9640 1 -- 172.21.15.100:0/983734002 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe02406b070 con 0x55aee2d6af70 2024-09-18T01:27:13.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.058+0000 7fdf14ff9640 1 -- 172.21.15.100:0/983734002 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe024054040 con 0x55aee2d6af70 2024-09-18T01:27:13.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.058+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aee2d72760 con 0x55aee2d6af70 2024-09-18T01:27:13.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.058+0000 7fdf14ff9640 1 -- 172.21.15.100:0/983734002 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe02405e070 con 0x55aee2d6af70 2024-09-18T01:27:13.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.058+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aee2d72760 con 0x55aee2d6af70 2024-09-18T01:27:13.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.059+0000 7fdf14ff9640 1 -- 172.21.15.100:0/983734002 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe024048040 con 0x55aee2d6af70 2024-09-18T01:27:13.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.059+0000 7fdf14ff9640 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdefc036b90 0x7fdefc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.059+0000 7fdf14ff9640 1 -- 172.21.15.100:0/983734002 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fe024070d00 con 0x55aee2d6af70 2024-09-18T01:27:13.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.059+0000 7fe032733640 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdefc036b90 0x7fdefc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.060+0000 7fe032733640 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdefc036b90 0x7fdefc039050 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe028051fd0 tx=0x7fe028054000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.060+0000 7fe035440800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.060+0000 7fe035440800 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aee2d7d980 0x55aee2d7fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.060+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d80590 con 0x55aee2d7d980 2024-09-18T01:27:13.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.060+0000 7fe033735640 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aee2d7d980 0x55aee2d7fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.060+0000 7fe033735640 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aee2d7d980 0x55aee2d7fe40 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.060+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe02c0083e0 con 0x55aee2d7d980 2024-09-18T01:27:13.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.060+0000 7fe035440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.060+0000 7fe035440800 20 realm 2024-09-18T01:27:13.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.060+0000 7fe035440800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.060+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d809a0 con 0x55aee2d7d980 2024-09-18T01:27:13.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe02c0083e0 con 0x55aee2d7d980 2024-09-18T01:27:13.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe035440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe035440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:13.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe035440800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d7d980 2024-09-18T01:27:13.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe02c0083e0 con 0x55aee2d7d980 2024-09-18T01:27:13.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe035440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe035440800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81610 con 0x55aee2d7d980 2024-09-18T01:27:13.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe02c0083e0 con 0x55aee2d7d980 2024-09-18T01:27:13.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe035440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:13.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe035440800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe035440800 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55aee2d81fd0 0x55aee2d843c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d849d0 con 0x55aee2d81fd0 2024-09-18T01:27:13.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.061+0000 7fe032f34640 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55aee2d81fd0 0x55aee2d843c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.062+0000 7fe032f34640 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55aee2d81fd0 0x55aee2d843c0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.062+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe024056070 con 0x55aee2d81fd0 2024-09-18T01:27:13.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.062+0000 7fe035440800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:13.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.062+0000 7fe035440800 20 searching for the correct realm 2024-09-18T01:27:13.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.062+0000 7fe035440800 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55aee2d86980 0x55aee2d88e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.062+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d89510 con 0x55aee2d86980 2024-09-18T01:27:13.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.062+0000 7fe032733640 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55aee2d86980 0x55aee2d88e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.062+0000 7fe032733640 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55aee2d86980 0x55aee2d88e40 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.063+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d86980 2024-09-18T01:27:13.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.063+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d89510 con 0x55aee2d81fd0 2024-09-18T01:27:13.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.063+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024056070 con 0x55aee2d81fd0 2024-09-18T01:27:13.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.063+0000 7fe032f34640 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe024058c20 0x7fe024033430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.063+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d89510 con 0x7fe024058c20 2024-09-18T01:27:13.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.063+0000 7fe033735640 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe024058c20 0x7fe024033430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.063+0000 7fe033735640 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe024058c20 0x7fe024033430 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.064+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe02c0083e0 con 0x7fe024058c20 2024-09-18T01:27:13.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.064+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d7d980 2024-09-18T01:27:13.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.064+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c0083e0 con 0x55aee2d7d980 2024-09-18T01:27:13.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.064+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d7d980 2024-09-18T01:27:13.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.064+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c026040 con 0x55aee2d7d980 2024-09-18T01:27:13.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.064+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x7fe024058c20 2024-09-18T01:27:13.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.065+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c026040 con 0x7fe024058c20 2024-09-18T01:27:13.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.065+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x7fe024058c20 2024-09-18T01:27:13.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.065+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c026040 con 0x7fe024058c20 2024-09-18T01:27:13.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.065+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d81fd0 2024-09-18T01:27:13.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.065+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02407e040 con 0x55aee2d81fd0 2024-09-18T01:27:13.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.065+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d86980 2024-09-18T01:27:13.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.065+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d86980 2024-09-18T01:27:13.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.065+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d7d980 2024-09-18T01:27:13.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.066+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c026040 con 0x55aee2d7d980 2024-09-18T01:27:13.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.066+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d81fd0 2024-09-18T01:27:13.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.066+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02407e040 con 0x55aee2d81fd0 2024-09-18T01:27:13.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.066+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d7d980 2024-09-18T01:27:13.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.066+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c026040 con 0x55aee2d7d980 2024-09-18T01:27:13.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.066+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d81fd0 2024-09-18T01:27:13.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.067+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe02407e040 con 0x55aee2d81fd0 2024-09-18T01:27:13.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.067+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d86980 2024-09-18T01:27:13.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.067+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d86980 2024-09-18T01:27:13.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.067+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d86980 2024-09-18T01:27:13.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.067+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d86980 2024-09-18T01:27:13.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.067+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x7fe024058c20 2024-09-18T01:27:13.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.067+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c026040 con 0x7fe024058c20 2024-09-18T01:27:13.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.067+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d86980 2024-09-18T01:27:13.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.068+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d86980 2024-09-18T01:27:13.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.068+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d86980 2024-09-18T01:27:13.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.068+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d86980 2024-09-18T01:27:13.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.068+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d7d980 2024-09-18T01:27:13.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.068+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c026040 con 0x55aee2d7d980 2024-09-18T01:27:13.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.068+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d7d980 2024-09-18T01:27:13.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.068+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe02c026040 con 0x55aee2d7d980 2024-09-18T01:27:13.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.068+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x7fe024058c20 2024-09-18T01:27:13.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.069+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c026040 con 0x7fe024058c20 2024-09-18T01:27:13.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.069+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d86980 2024-09-18T01:27:13.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.069+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d86980 2024-09-18T01:27:13.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.069+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d81fd0 2024-09-18T01:27:13.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.069+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02407e040 con 0x55aee2d81fd0 2024-09-18T01:27:13.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.069+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d7d980 2024-09-18T01:27:13.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.070+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c026040 con 0x55aee2d7d980 2024-09-18T01:27:13.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.070+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x7fe024058c20 2024-09-18T01:27:13.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.070+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.070+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d86980 2024-09-18T01:27:13.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.070+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d86980 2024-09-18T01:27:13.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.070+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d81fd0 2024-09-18T01:27:13.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.071+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02407e040 con 0x55aee2d81fd0 2024-09-18T01:27:13.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.071+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d81fd0 2024-09-18T01:27:13.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.071+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02407e040 con 0x55aee2d81fd0 2024-09-18T01:27:13.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.071+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d86980 2024-09-18T01:27:13.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.071+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d86980 2024-09-18T01:27:13.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.071+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x7fe024058c20 2024-09-18T01:27:13.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.071+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.071+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d7d980 2024-09-18T01:27:13.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe02c037040 con 0x55aee2d7d980 2024-09-18T01:27:13.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d81270 con 0x55aee2d81fd0 2024-09-18T01:27:13.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe02407e040 con 0x55aee2d81fd0 2024-09-18T01:27:13.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe035440800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:13.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe035440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:13.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe035440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:13.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe035440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:13.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe035440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:13.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe035440800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:13.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe035440800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d85290 con 0x55aee2d7d980 2024-09-18T01:27:13.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x55aee2d7d980 2024-09-18T01:27:13.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe035440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe035440800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d85680 con 0x55aee2d7d980 2024-09-18T01:27:13.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe02c037040 con 0x55aee2d7d980 2024-09-18T01:27:13.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe035440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:13.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.072+0000 7fe035440800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d85680 con 0x7fe024058c20 2024-09-18T01:27:13.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe035440800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:13.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe035440800 20 zone default found 2024-09-18T01:27:13.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe035440800 4 Realm: () 2024-09-18T01:27:13.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe035440800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:13.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe035440800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:13.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe035440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:13.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe035440800 20 zonegroup default 2024-09-18T01:27:13.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe035440800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d89990 con 0x7fe024058c20 2024-09-18T01:27:13.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe035440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe035440800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.073+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d8b370 con 0x55aee2d86980 2024-09-18T01:27:13.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.074+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d86980 2024-09-18T01:27:13.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.074+0000 7fe035440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.074+0000 7fe035440800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.074+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d8b710 con 0x55aee2d86980 2024-09-18T01:27:13.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.074+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d86980 2024-09-18T01:27:13.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.074+0000 7fe035440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.074+0000 7fe035440800 20 started sync module instance, tier type = 2024-09-18T01:27:13.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.074+0000 7fe035440800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:13.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.074+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d8a810 con 0x55aee2d81fd0 2024-09-18T01:27:13.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.075+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02407e040 con 0x55aee2d81fd0 2024-09-18T01:27:13.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.075+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94209618518880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d8bab0 con 0x55aee2d81fd0 2024-09-18T01:27:13.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.075+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d8c300 con 0x55aee2d7d980 2024-09-18T01:27:13.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.076+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94209618518880] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02407e040 con 0x55aee2d81fd0 2024-09-18T01:27:13.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.077+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x55aee2d7d980 2024-09-18T01:27:13.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.077+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94209618525776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d8c720 con 0x55aee2d7d980 2024-09-18T01:27:13.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.077+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d8d0e0 con 0x55aee2d86980 2024-09-18T01:27:13.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.078+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d86980 2024-09-18T01:27:13.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.078+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94209618529328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d8d980 con 0x55aee2d86980 2024-09-18T01:27:13.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.078+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d8e460 con 0x55aee2d81fd0 2024-09-18T01:27:13.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.078+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94209618525776] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x55aee2d7d980 2024-09-18T01:27:13.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.079+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02407e040 con 0x55aee2d81fd0 2024-09-18T01:27:13.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.079+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94209618534256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d8e850 con 0x55aee2d81fd0 2024-09-18T01:27:13.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.079+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d8f2b0 con 0x55aee2d7d980 2024-09-18T01:27:13.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.079+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94209618529328] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d86980 2024-09-18T01:27:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.080+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x55aee2d7d980 2024-09-18T01:27:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.080+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94209618534256] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02407e040 con 0x55aee2d81fd0 2024-09-18T01:27:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.080+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94209618531536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d8f2b0 con 0x55aee2d7d980 2024-09-18T01:27:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.080+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d8fb50 con 0x7fe024058c20 2024-09-18T01:27:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.082+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94209618531536] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x55aee2d7d980 2024-09-18T01:27:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.082+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.082+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94209618526832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d8f760 con 0x7fe024058c20 2024-09-18T01:27:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.082+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d90120 con 0x7fe024058c20 2024-09-18T01:27:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.083+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94209618526832] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.083+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.083+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94209618539184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d90120 con 0x7fe024058c20 2024-09-18T01:27:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.083+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d90ae0 con 0x7fe024058c20 2024-09-18T01:27:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.084+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94209618539184] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.084+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.084+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94209618541680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d90ae0 con 0x7fe024058c20 2024-09-18T01:27:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.084+0000 7fe035440800 20 add_watcher() i=0 2024-09-18T01:27:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.084+0000 7fe035440800 20 add_watcher() i=1 2024-09-18T01:27:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.084+0000 7fe035440800 20 add_watcher() i=2 2024-09-18T01:27:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.084+0000 7fe035440800 20 add_watcher() i=3 2024-09-18T01:27:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.084+0000 7fe035440800 20 add_watcher() i=4 2024-09-18T01:27:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.084+0000 7fe035440800 20 add_watcher() i=5 2024-09-18T01:27:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.084+0000 7fe035440800 20 add_watcher() i=6 2024-09-18T01:27:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.085+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94209618541680] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.085+0000 7fe035440800 20 add_watcher() i=7 2024-09-18T01:27:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.085+0000 7fe035440800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.085+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d93ee0 con 0x55aee2d7d980 2024-09-18T01:27:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.085+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe02c037040 con 0x55aee2d7d980 2024-09-18T01:27:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.086+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94209618544640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2d91400 con 0x55aee2d7d980 2024-09-18T01:27:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.087+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94209618544640] v35'234 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x55aee2d7d980 2024-09-18T01:27:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.087+0000 7fdee97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.087+0000 7fe035440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.087+0000 7fe035440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.087+0000 7fe035440800 5 note: GC not initialized 2024-09-18T01:27:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.087+0000 7fde63fff640 20 reqs_thread_entry: start 2024-09-18T01:27:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.087+0000 7fe035440800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.087+0000 7fe035440800 20 Filter name: none 2024-09-18T01:27:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.087+0000 7fde61ffb640 20 reqs_thread_entry: start 2024-09-18T01:27:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.087+0000 7fe035440800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:27:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.087+0000 7fe035440800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.088+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aee2dc73c0 con 0x55aee2d7d980 2024-09-18T01:27:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.088+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe02c037040 con 0x55aee2d7d980 2024-09-18T01:27:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.088+0000 7fe035440800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:27:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.088+0000 7fe035440800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:27:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.088+0000 7fe035440800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:27:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.088+0000 7fe035440800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:27:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.088+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2dc6ea0 con 0x7fe024058c20 2024-09-18T01:27:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.089+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 usage.10 [call] v35'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.089+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2dc6ea0 con 0x7fe024058c20 2024-09-18T01:27:13.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.090+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(64 usage.10 [call] v35'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.091+0000 7fdee97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:13.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.091+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94209618544640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2dc6ea0 con 0x55aee2d7d980 2024-09-18T01:27:13.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.092+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94209618544640] v35'235 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x55aee2d7d980 2024-09-18T01:27:13.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.092+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94209618518880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2dc6ea0 con 0x55aee2d81fd0 2024-09-18T01:27:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.093+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94209618518880] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02407e040 con 0x55aee2d81fd0 2024-09-18T01:27:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.093+0000 7fe035440800 20 remove_watcher() i=0 2024-09-18T01:27:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.093+0000 7fe035440800 2 removed watcher, disabling cache 2024-09-18T01:27:13.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.093+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94209618525776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2dc6ea0 con 0x55aee2d7d980 2024-09-18T01:27:13.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.095+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94209618525776] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x55aee2d7d980 2024-09-18T01:27:13.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.095+0000 7fe035440800 20 remove_watcher() i=1 2024-09-18T01:27:13.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.095+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94209618529328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2dc6ea0 con 0x55aee2d86980 2024-09-18T01:27:13.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.096+0000 7fe032733640 1 -- 172.21.15.100:0/983734002 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94209618529328] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe028058030 con 0x55aee2d86980 2024-09-18T01:27:13.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.096+0000 7fe035440800 20 remove_watcher() i=2 2024-09-18T01:27:13.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.096+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94209618534256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2dc6ea0 con 0x55aee2d81fd0 2024-09-18T01:27:13.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.097+0000 7fe032f34640 1 -- 172.21.15.100:0/983734002 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94209618534256] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02407e040 con 0x55aee2d81fd0 2024-09-18T01:27:13.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.097+0000 7fe035440800 20 remove_watcher() i=3 2024-09-18T01:27:13.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.097+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94209618531536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2dc6ea0 con 0x55aee2d7d980 2024-09-18T01:27:13.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.098+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94209618531536] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x55aee2d7d980 2024-09-18T01:27:13.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.098+0000 7fe035440800 20 remove_watcher() i=4 2024-09-18T01:27:13.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.098+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94209618526832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2dc6ea0 con 0x7fe024058c20 2024-09-18T01:27:13.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.099+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94209618526832] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.099+0000 7fe035440800 20 remove_watcher() i=5 2024-09-18T01:27:13.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.099+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94209618539184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2dc6ea0 con 0x7fe024058c20 2024-09-18T01:27:13.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.101+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94209618539184] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.101+0000 7fe035440800 20 remove_watcher() i=6 2024-09-18T01:27:13.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.101+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94209618541680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aee2dc6ea0 con 0x7fe024058c20 2024-09-18T01:27:13.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94209618541680] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c037040 con 0x7fe024058c20 2024-09-18T01:27:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 20 remove_watcher() i=7 2024-09-18T01:27:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe024058c20 msgr2=0x7fe024033430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe024058c20 0x7fe024033430 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aee2d7d980 msgr2=0x55aee2d7fe40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aee2d7d980 0x55aee2d7fe40 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55aee2d81fd0 msgr2=0x55aee2d843c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55aee2d81fd0 0x55aee2d843c0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55aee2d86980 msgr2=0x55aee2d88e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55aee2d86980 0x55aee2d88e40 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdefc036b90 msgr2=0x7fdefc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdefc036b90 0x7fdefc039050 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe028051fd0 tx=0x7fe028054000 comp rx=0 tx=0).stop 2024-09-18T01:27:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d6af70 msgr2=0x55aee2d72220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 1 --2- 172.21.15.100:0/983734002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d6af70 0x55aee2d72220 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe024002070 tx=0x7fe024007150 comp rx=0 tx=0).stop 2024-09-18T01:27:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 reap_dead start 2024-09-18T01:27:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe033735640 1 -- 172.21.15.100:0/983734002 reap_dead start 2024-09-18T01:27:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 shutdown_connections 2024-09-18T01:27:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.102+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 >> 172.21.15.100:0/983734002 conn(0x55aee2d672d0 msgr2=0x55aee2d653a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 shutdown_connections 2024-09-18T01:27:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/983734002 wait complete. 2024-09-18T01:27:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/893030802 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdf0c036b90 msgr2=0x7fdf0c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 --2- 172.21.15.100:0/893030802 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdf0c036b90 0x7fdf0c039050 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55aee2d480e0 tx=0x7fe028005a00 comp rx=0 tx=0).stop 2024-09-18T01:27:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/893030802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d5e300 msgr2=0x55aee2d5e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 --2- 172.21.15.100:0/893030802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d5e300 0x55aee2d5e720 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe02400d010 tx=0x7fe02401e520 comp rx=0 tx=0).stop 2024-09-18T01:27:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/893030802 shutdown_connections 2024-09-18T01:27:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 --2- 172.21.15.100:0/893030802 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdf0c036b90 0x7fdf0c039050 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 --2- 172.21.15.100:0/893030802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2d5e300 0x55aee2d5e720 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/893030802 >> 172.21.15.100:0/893030802 conn(0x55aee2d53290 msgr2=0x55aee2d55e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/893030802 shutdown_connections 2024-09-18T01:27:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/893030802 wait complete. 2024-09-18T01:27:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55aee2d4da70 msgr2=0x55aee2d4fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55aee2d4da70 0x55aee2d4fe60 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aee2c4a900 msgr2=0x55aee2d47290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aee2c4a900 0x55aee2d47290 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55aee2d49b30 msgr2=0x55aee2d4bf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55aee2d49b30 0x55aee2d4bf20 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdf18036b90 msgr2=0x7fdf18039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdf18036b90 0x7fdf18039050 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe028058000 tx=0x7fe02800a000 comp rx=0 tx=0).stop 2024-09-18T01:27:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c464c0 msgr2=0x55aee2d40220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 --2- 172.21.15.100:0/3779075840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aee2c464c0 0x55aee2d40220 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x55aee2d352c0 tx=0x7fe024001250 comp rx=0 tx=0).stop 2024-09-18T01:27:13.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe033735640 1 -- 172.21.15.100:0/3779075840 reap_dead start 2024-09-18T01:27:13.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 shutdown_connections 2024-09-18T01:27:13.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.103+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 >> 172.21.15.100:0/3779075840 conn(0x55aee2c41df0 msgr2=0x55aee2d2e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.104+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 shutdown_connections 2024-09-18T01:27:13.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.104+0000 7fe035440800 1 -- 172.21.15.100:0/3779075840 wait complete. 2024-09-18T01:27:13.113 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-18T01:27:13.113 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-18T01:27:13.113 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-18T01:27:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:13.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.157+0000 7f1a9fb40800 1 Processor -- start 2024-09-18T01:27:13.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.158+0000 7f1a9fb40800 1 -- start start 2024-09-18T01:27:13.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.158+0000 7f1a9fb40800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55de2e395db0 0x55de2e3981a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.158+0000 7f1a9fb40800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55de2e24eb30 con 0x55de2e3035f0 2024-09-18T01:27:13.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.158+0000 7f1a9fb40800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55de2e230360 con 0x55de2e395db0 2024-09-18T01:27:13.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.158+0000 7f1a930c9640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55de2e395db0 0x55de2e3981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.158+0000 7f1a9b8ca640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55de2e3035f0 0x55de2e394690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37090/0 (socket says 172.21.15.100:37090) 2024-09-18T01:27:13.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.158+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/713316632 learned_addr learned my addr 172.21.15.100:0/713316632 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:13.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.158+0000 7f1a930c9640 1 -- 172.21.15.100:0/713316632 >> v1:172.21.15.92:6789/0 conn(0x55de2e3035f0 legacy=0x55de2e394690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.158+0000 7f1a930c9640 1 -- 172.21.15.100:0/713316632 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de2e256e00 con 0x55de2e395db0 2024-09-18T01:27:13.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.160+0000 7f1a930c9640 1 --2- 172.21.15.100:0/713316632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e395db0 0x55de2e3981a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400a470 tx=0x7f1a84045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed3e6e7b86a8cdf server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.161+0000 7f1a9b0c9640 1 -- 172.21.15.100:0/713316632 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a84053570 con 0x55de2e395db0 2024-09-18T01:27:13.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.161+0000 7f1a9b0c9640 1 -- 172.21.15.100:0/713316632 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a84058070 con 0x55de2e395db0 2024-09-18T01:27:13.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.161+0000 7f1a9b0c9640 1 -- 172.21.15.100:0/713316632 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a84053880 con 0x55de2e395db0 2024-09-18T01:27:13.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.161+0000 7f1a9fb40800 1 -- 172.21.15.100:0/713316632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e395db0 msgr2=0x55de2e3981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.161+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/713316632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e395db0 0x55de2e3981a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400a470 tx=0x7f1a84045a20 comp rx=0 tx=0).stop 2024-09-18T01:27:13.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.161+0000 7f1a9fb40800 1 -- 172.21.15.100:0/713316632 shutdown_connections 2024-09-18T01:27:13.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.161+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/713316632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e395db0 0x55de2e3981a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.161+0000 7f1a9fb40800 1 -- 172.21.15.100:0/713316632 >> 172.21.15.100:0/713316632 conn(0x55de2e389de0 msgr2=0x55de2e38c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.161+0000 7f1a9fb40800 1 -- 172.21.15.100:0/713316632 shutdown_connections 2024-09-18T01:27:13.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.161+0000 7f1a9fb40800 1 -- 172.21.15.100:0/713316632 wait complete. 2024-09-18T01:27:13.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.175+0000 7f1a9fb40800 1 Processor -- start 2024-09-18T01:27:13.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.175+0000 7f1a9fb40800 1 -- start start 2024-09-18T01:27:13.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.175+0000 7f1a9fb40800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e3035f0 0x55de2e480a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.175+0000 7f1a9fb40800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55de2e2db330 con 0x55de2e3035f0 2024-09-18T01:27:13.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.175+0000 7f1a9b8ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e3035f0 0x55de2e480a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.175+0000 7f1a9b8ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e3035f0 0x55de2e480a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44948/0 (socket says 172.21.15.100:44948) 2024-09-18T01:27:13.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.175+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/3191548515 learned_addr learned my addr 172.21.15.100:0/3191548515 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.176+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/3191548515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de2e228bc0 con 0x55de2e3035f0 2024-09-18T01:27:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.176+0000 7f1a9b8ca640 1 --2- 172.21.15.100:0/3191548515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e3035f0 0x55de2e480a80 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c001e10 tx=0x7f1a8c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0a061e5c0b2492 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.176+0000 7f1989e0b640 1 -- 172.21.15.100:0/3191548515 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a8c012020 con 0x55de2e3035f0 2024-09-18T01:27:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.176+0000 7f1989e0b640 1 -- 172.21.15.100:0/3191548515 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c00e5a0 con 0x55de2e3035f0 2024-09-18T01:27:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.176+0000 7f1989e0b640 1 -- 172.21.15.100:0/3191548515 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a8c00e8e0 con 0x55de2e3035f0 2024-09-18T01:27:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.177+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3191548515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e3035f0 msgr2=0x55de2e480a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.177+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/3191548515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e3035f0 0x55de2e480a80 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c001e10 tx=0x7f1a8c00b780 comp rx=0 tx=0).stop 2024-09-18T01:27:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.177+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3191548515 shutdown_connections 2024-09-18T01:27:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.177+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/3191548515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e3035f0 0x55de2e480a80 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.177+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3191548515 >> 172.21.15.100:0/3191548515 conn(0x55de2e389de0 msgr2=0x55de2e47c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.177+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3191548515 shutdown_connections 2024-09-18T01:27:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.177+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3191548515 wait complete. 2024-09-18T01:27:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.177+0000 7f1a9fb40800 1 Processor -- start 2024-09-18T01:27:13.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.177+0000 7f1a9fb40800 1 -- start start 2024-09-18T01:27:13.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.177+0000 7f1a9fb40800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e3035f0 0x55de2e488480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.177+0000 7f1a9fb40800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55de2e398980 con 0x55de2e3035f0 2024-09-18T01:27:13.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.178+0000 7f1a9b8ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e3035f0 0x55de2e488480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.178+0000 7f1a9b8ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e3035f0 0x55de2e488480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44950/0 (socket says 172.21.15.100:44950) 2024-09-18T01:27:13.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.178+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/3149164929 learned_addr learned my addr 172.21.15.100:0/3149164929 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.178+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/3149164929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de2e23cfe0 con 0x55de2e3035f0 2024-09-18T01:27:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.178+0000 7f1a9b8ca640 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e3035f0 0x55de2e488480 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c001e10 tx=0x7f1a8c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.178+0000 7f1983fff640 1 -- 172.21.15.100:0/3149164929 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a8c012030 con 0x55de2e3035f0 2024-09-18T01:27:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.178+0000 7f1983fff640 1 -- 172.21.15.100:0/3149164929 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c01a7a0 con 0x55de2e3035f0 2024-09-18T01:27:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.178+0000 7f1983fff640 1 -- 172.21.15.100:0/3149164929 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a8c01aac0 con 0x55de2e3035f0 2024-09-18T01:27:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.178+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de2e4889c0 con 0x55de2e3035f0 2024-09-18T01:27:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.178+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de2e488ee0 con 0x55de2e3035f0 2024-09-18T01:27:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.179+0000 7f1983fff640 1 -- 172.21.15.100:0/3149164929 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1a8c015020 con 0x55de2e3035f0 2024-09-18T01:27:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.179+0000 7f1983fff640 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1984036b40 0x7f1984039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.179+0000 7f1983fff640 1 -- 172.21.15.100:0/3149164929 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f1a8c020030 con 0x55de2e3035f0 2024-09-18T01:27:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.180+0000 7f1a930c9640 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1984036b40 0x7f1984039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.180+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55de2e395db0 0x55de2e48f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.180+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e48fa30 con 0x55de2e395db0 2024-09-18T01:27:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.180+0000 7f1a9c0cb640 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55de2e395db0 0x55de2e48f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.180+0000 7f1a930c9640 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1984036b40 0x7f1984039000 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1a84057000 tx=0x7f1a84052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.180+0000 7f1a9c0cb640 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55de2e395db0 0x55de2e48f4f0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.180+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/3149164929 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e395db0 2024-09-18T01:27:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.180+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e48cac0 con 0x55de2e395db0 2024-09-18T01:27:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.181+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/3149164929 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e395db0 2024-09-18T01:27:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.181+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55de2e491d40 0x55de2e494130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.181+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e494820 con 0x55de2e491d40 2024-09-18T01:27:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.181+0000 7f1a9b8ca640 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55de2e491d40 0x55de2e494130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.181+0000 7f1a9b8ca640 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55de2e491d40 0x55de2e494130 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.181+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/3149164929 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1a8c00dcd0 con 0x55de2e491d40 2024-09-18T01:27:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.181+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e490be0 con 0x55de2e395db0 2024-09-18T01:27:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.182+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/3149164929 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e395db0 2024-09-18T01:27:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.182+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55de2e495c80 0x55de2e498070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.182+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e498770 con 0x55de2e495c80 2024-09-18T01:27:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.182+0000 7f1a930c9640 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55de2e495c80 0x55de2e498070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.182+0000 7f1a930c9640 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55de2e495c80 0x55de2e498070 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.183+0000 7f1a930c9640 1 -- 172.21.15.100:0/3149164929 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e495c80 2024-09-18T01:27:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.183+0000 7f1a9fb40800 1 Processor -- start 2024-09-18T01:27:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.183+0000 7f1a9fb40800 1 -- start start 2024-09-18T01:27:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.183+0000 7f1a9fb40800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4a6520 0x55de2e4a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.183+0000 7f1a9fb40800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55de2e22a580 con 0x55de2e4a6520 2024-09-18T01:27:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.183+0000 7f1a9b8ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4a6520 0x55de2e4a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.183+0000 7f1a9b8ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4a6520 0x55de2e4a6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44954/0 (socket says 172.21.15.100:44954) 2024-09-18T01:27:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.183+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/3292321543 learned_addr learned my addr 172.21.15.100:0/3292321543 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.184+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/3292321543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de2e4a6e80 con 0x55de2e4a6520 2024-09-18T01:27:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.184+0000 7f1a9b8ca640 1 --2- 172.21.15.100:0/3292321543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4a6520 0x55de2e4a6940 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c001750 tx=0x7f1a8c02c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.184+0000 7f19817fa640 1 -- 172.21.15.100:0/3292321543 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a8c0490c0 con 0x55de2e4a6520 2024-09-18T01:27:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.184+0000 7f19817fa640 1 -- 172.21.15.100:0/3292321543 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c049260 con 0x55de2e4a6520 2024-09-18T01:27:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.184+0000 7f19817fa640 1 -- 172.21.15.100:0/3292321543 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a8c017c50 con 0x55de2e4a6520 2024-09-18T01:27:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.184+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3292321543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de2e4a7110 con 0x55de2e4a6520 2024-09-18T01:27:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.184+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3292321543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de2e4a9df0 con 0x55de2e4a6520 2024-09-18T01:27:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.185+0000 7f19817fa640 1 -- 172.21.15.100:0/3292321543 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1a8c03c060 con 0x55de2e4a6520 2024-09-18T01:27:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.185+0000 7f19817fa640 1 --2- 172.21.15.100:0/3292321543 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1974036b40 0x7f1974039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.185+0000 7f19817fa640 1 -- 172.21.15.100:0/3292321543 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f1a8c036d20 con 0x55de2e4a6520 2024-09-18T01:27:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.185+0000 7f1a930c9640 1 --2- 172.21.15.100:0/3292321543 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1974036b40 0x7f1974039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.186+0000 7f1a9fb40800 1 Processor -- start 2024-09-18T01:27:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.186+0000 7f1a9fb40800 1 -- start start 2024-09-18T01:27:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.186+0000 7f1a930c9640 1 --2- 172.21.15.100:0/3292321543 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1974036b40 0x7f1974039000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55de2e4902f0 tx=0x7f1a84005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.186+0000 7f1a9fb40800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4b2f70 0x55de2e4b3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.186+0000 7f1a9fb40800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55de2e481230 con 0x55de2e4b2f70 2024-09-18T01:27:13.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.186+0000 7f1a9b8ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4b2f70 0x55de2e4b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.186+0000 7f1a9b8ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4b2f70 0x55de2e4b3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44958/0 (socket says 172.21.15.100:44958) 2024-09-18T01:27:13.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.186+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/2459237586 learned_addr learned my addr 172.21.15.100:0/2459237586 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.186+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/2459237586 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de2e4b3940 con 0x55de2e4b2f70 2024-09-18T01:27:13.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.187+0000 7f1a9b8ca640 1 --2- 172.21.15.100:0/2459237586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4b2f70 0x55de2e4b3370 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c018740 tx=0x7f1a8c03f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457ab81a61afd361 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.187+0000 7f197affd640 1 -- 172.21.15.100:0/2459237586 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a8c03f480 con 0x55de2e4b2f70 2024-09-18T01:27:13.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.187+0000 7f197affd640 1 -- 172.21.15.100:0/2459237586 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c051070 con 0x55de2e4b2f70 2024-09-18T01:27:13.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.187+0000 7f197affd640 1 -- 172.21.15.100:0/2459237586 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a8c03f750 con 0x55de2e4b2f70 2024-09-18T01:27:13.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.187+0000 7f1a9fb40800 1 -- 172.21.15.100:0/2459237586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4b2f70 msgr2=0x55de2e4b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.187+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/2459237586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4b2f70 0x55de2e4b3370 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c018740 tx=0x7f1a8c03f940 comp rx=0 tx=0).stop 2024-09-18T01:27:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.187+0000 7f1a9fb40800 1 -- 172.21.15.100:0/2459237586 shutdown_connections 2024-09-18T01:27:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.187+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/2459237586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4b2f70 0x55de2e4b3370 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.187+0000 7f1a9fb40800 1 -- 172.21.15.100:0/2459237586 >> 172.21.15.100:0/2459237586 conn(0x55de2e4af370 msgr2=0x55de2e4ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.187+0000 7f1a9fb40800 1 -- 172.21.15.100:0/2459237586 shutdown_connections 2024-09-18T01:27:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.187+0000 7f1a9fb40800 1 -- 172.21.15.100:0/2459237586 wait complete. 2024-09-18T01:27:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.188+0000 7f1a9fb40800 1 Processor -- start 2024-09-18T01:27:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.188+0000 7f1a9fb40800 1 -- start start 2024-09-18T01:27:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.188+0000 7f1a9fb40800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4b2f70 0x55de2e4ba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.188+0000 7f1a9fb40800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55de2e4b3e20 con 0x55de2e4b2f70 2024-09-18T01:27:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.188+0000 7f1a9b8ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4b2f70 0x55de2e4ba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.188+0000 7f1a9b8ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4b2f70 0x55de2e4ba1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44968/0 (socket says 172.21.15.100:44968) 2024-09-18T01:27:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.188+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 learned_addr learned my addr 172.21.15.100:0/804556045 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.188+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de2e4ba730 con 0x55de2e4b2f70 2024-09-18T01:27:13.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.189+0000 7f1a9b8ca640 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4b2f70 0x55de2e4ba1f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c018740 tx=0x7f1a8c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.189+0000 7f19797fa640 1 -- 172.21.15.100:0/804556045 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a8c01b250 con 0x55de2e4b2f70 2024-09-18T01:27:13.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.189+0000 7f19797fa640 1 -- 172.21.15.100:0/804556045 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c069030 con 0x55de2e4b2f70 2024-09-18T01:27:13.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.189+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de2e4ba730 con 0x55de2e4b2f70 2024-09-18T01:27:13.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.189+0000 7f19797fa640 1 -- 172.21.15.100:0/804556045 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a8c0494a0 con 0x55de2e4b2f70 2024-09-18T01:27:13.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.189+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de2e4ba730 con 0x55de2e4b2f70 2024-09-18T01:27:13.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.190+0000 7f19797fa640 1 -- 172.21.15.100:0/804556045 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1a8c060040 con 0x55de2e4b2f70 2024-09-18T01:27:13.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.190+0000 7f1a9fb40800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.190+0000 7f19797fa640 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1964036b90 0x7f1964039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.190+0000 7f19797fa640 1 -- 172.21.15.100:0/804556045 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f1a8c06fd30 con 0x55de2e4b2f70 2024-09-18T01:27:13.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.190+0000 7f1a930c9640 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1964036b90 0x7f1964039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.190+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55de2e4c5950 0x55de2e4c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.190+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c8540 con 0x55de2e4c5950 2024-09-18T01:27:13.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.190+0000 7f1a9c0cb640 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55de2e4c5950 0x55de2e4c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.190+0000 7f1a930c9640 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1964036b90 0x7f1964039050 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1a84053570 tx=0x7f1a84053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9c0cb640 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55de2e4c5950 0x55de2e4c7df0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9fb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9fb40800 20 realm 2024-09-18T01:27:13.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9fb40800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c89a0 con 0x55de2e4c5950 2024-09-18T01:27:13.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9fb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9fb40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:13.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9fb40800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c9240 con 0x55de2e4c5950 2024-09-18T01:27:13.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9fb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9fb40800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.191+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4c5950 2024-09-18T01:27:13.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.192+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.192+0000 7f1a9fb40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:13.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.192+0000 7f1a9fb40800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.192+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55de2e4ca340 0x55de2e4cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.192+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4cccb0 con 0x55de2e4ca340 2024-09-18T01:27:13.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.192+0000 7f1a9b8ca640 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55de2e4ca340 0x55de2e4cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.192+0000 7f1a9b8ca640 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55de2e4ca340 0x55de2e4cc730 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.192+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.192+0000 7f1a9fb40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:13.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.192+0000 7f1a9fb40800 20 searching for the correct realm 2024-09-18T01:27:13.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.192+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55de2e4ced00 0x55de2e4d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.192+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d1890 con 0x55de2e4ced00 2024-09-18T01:27:13.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.192+0000 7f1a930c9640 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55de2e4ced00 0x55de2e4d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.193+0000 7f1a930c9640 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55de2e4ced00 0x55de2e4d11c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.193+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e4ced00 2024-09-18T01:27:13.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.193+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d1890 con 0x55de2e4ca340 2024-09-18T01:27:13.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.193+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.193+0000 7f1a9b8ca640 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f1a8c03e070 0x7f1a8c024420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.193+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d1890 con 0x7f1a8c03e070 2024-09-18T01:27:13.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.194+0000 7f1a9c0cb640 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f1a8c03e070 0x7f1a8c024420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.194+0000 7f1a9c0cb640 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f1a8c03e070 0x7f1a8c024420 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.194+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.194+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4c5950 2024-09-18T01:27:13.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.195+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.195+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4c5950 2024-09-18T01:27:13.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.195+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.195+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x7f1a8c03e070 2024-09-18T01:27:13.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.195+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.195+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x7f1a8c03e070 2024-09-18T01:27:13.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.195+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.195+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ca340 2024-09-18T01:27:13.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.196+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.196+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ced00 2024-09-18T01:27:13.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.196+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e4ced00 2024-09-18T01:27:13.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.196+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4c5950 2024-09-18T01:27:13.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.196+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.196+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ca340 2024-09-18T01:27:13.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.196+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.196+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4c5950 2024-09-18T01:27:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.196+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.196+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ca340 2024-09-18T01:27:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.197+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.197+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ced00 2024-09-18T01:27:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.197+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e4ced00 2024-09-18T01:27:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.197+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ced00 2024-09-18T01:27:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.197+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e4ced00 2024-09-18T01:27:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.197+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x7f1a8c03e070 2024-09-18T01:27:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.198+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.198+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ced00 2024-09-18T01:27:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.198+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e4ced00 2024-09-18T01:27:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.198+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ced00 2024-09-18T01:27:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.198+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e4ced00 2024-09-18T01:27:13.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.198+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4c5950 2024-09-18T01:27:13.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.198+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.198+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4c5950 2024-09-18T01:27:13.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.199+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.199+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x7f1a8c03e070 2024-09-18T01:27:13.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.199+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.199+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ced00 2024-09-18T01:27:13.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.199+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e4ced00 2024-09-18T01:27:13.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.199+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ca340 2024-09-18T01:27:13.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.199+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.200+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4c5950 2024-09-18T01:27:13.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.200+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.200+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x7f1a8c03e070 2024-09-18T01:27:13.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.200+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.200+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ced00 2024-09-18T01:27:13.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.200+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e4ced00 2024-09-18T01:27:13.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.200+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ca340 2024-09-18T01:27:13.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.201+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.201+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ca340 2024-09-18T01:27:13.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.201+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.201+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ced00 2024-09-18T01:27:13.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.201+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e4ced00 2024-09-18T01:27:13.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.201+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x7f1a8c03e070 2024-09-18T01:27:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.201+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.201+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4c5950 2024-09-18T01:27:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4c95e0 con 0x55de2e4ca340 2024-09-18T01:27:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9fb40800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9fb40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9fb40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9fb40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9fb40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9fb40800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9fb40800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4cd600 con 0x55de2e4c5950 2024-09-18T01:27:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9fb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9fb40800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4cd9f0 con 0x55de2e4c5950 2024-09-18T01:27:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9fb40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9fb40800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.202+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4cd9f0 con 0x7f1a8c03e070 2024-09-18T01:27:13.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a9fb40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:13.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a9fb40800 20 zone default found 2024-09-18T01:27:13.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a9fb40800 4 Realm: () 2024-09-18T01:27:13.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a9fb40800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:13.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a9fb40800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:13.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a9fb40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:13.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a9fb40800 20 zonegroup default 2024-09-18T01:27:13.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a9fb40800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4cde10 con 0x7f1a8c03e070 2024-09-18T01:27:13.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a9fb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a9fb40800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4ce230 con 0x55de2e4ced00 2024-09-18T01:27:13.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.203+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e4ced00 2024-09-18T01:27:13.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.204+0000 7f1a9fb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.204+0000 7f1a9fb40800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.204+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d36f0 con 0x55de2e4ced00 2024-09-18T01:27:13.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.204+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e4ced00 2024-09-18T01:27:13.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.204+0000 7f1a9fb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.204+0000 7f1a9fb40800 20 started sync module instance, tier type = 2024-09-18T01:27:13.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.204+0000 7f1a9fb40800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:13.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.204+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d2b90 con 0x55de2e4ca340 2024-09-18T01:27:13.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.205+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.205+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94412747911040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d27f0 con 0x55de2e4ca340 2024-09-18T01:27:13.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.205+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d4560 con 0x55de2e4c5950 2024-09-18T01:27:13.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.206+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94412747911040] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.206+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.206+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94412747915440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d4980 con 0x55de2e4c5950 2024-09-18T01:27:13.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.206+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d5250 con 0x55de2e4ced00 2024-09-18T01:27:13.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.207+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94412747915440] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.208+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e4ced00 2024-09-18T01:27:13.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.208+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94412747917008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d5640 con 0x55de2e4ced00 2024-09-18T01:27:13.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.208+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d60b0 con 0x55de2e4ca340 2024-09-18T01:27:13.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.209+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94412747917008] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e4ced00 2024-09-18T01:27:13.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.209+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.209+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94412747918192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d6950 con 0x55de2e4ca340 2024-09-18T01:27:13.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.209+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d7310 con 0x55de2e4c5950 2024-09-18T01:27:13.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.210+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94412747918192] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.210+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.210+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94412747927136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d7730 con 0x55de2e4c5950 2024-09-18T01:27:13.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.210+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d80f0 con 0x7f1a8c03e070 2024-09-18T01:27:13.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.211+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.211+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94412747930688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d8510 con 0x7f1a8c03e070 2024-09-18T01:27:13.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.211+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d8f90 con 0x7f1a8c03e070 2024-09-18T01:27:13.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.211+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94412747927136] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.212+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94412747930688] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.212+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.212+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94412747934336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d8060 con 0x7f1a8c03e070 2024-09-18T01:27:13.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.212+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d9830 con 0x7f1a8c03e070 2024-09-18T01:27:13.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.213+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(58 notify.7 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.213+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94412747934336] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.213+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94412747936640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d8060 con 0x7f1a8c03e070 2024-09-18T01:27:13.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.213+0000 7f1a9fb40800 20 add_watcher() i=0 2024-09-18T01:27:13.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.213+0000 7f1a9fb40800 20 add_watcher() i=1 2024-09-18T01:27:13.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.213+0000 7f1a9fb40800 20 add_watcher() i=2 2024-09-18T01:27:13.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.213+0000 7f1a9fb40800 20 add_watcher() i=3 2024-09-18T01:27:13.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.213+0000 7f1a9fb40800 20 add_watcher() i=4 2024-09-18T01:27:13.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.213+0000 7f1a9fb40800 20 add_watcher() i=5 2024-09-18T01:27:13.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.214+0000 7f1a9fb40800 20 add_watcher() i=6 2024-09-18T01:27:13.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.215+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94412747936640] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.215+0000 7f1a9fb40800 20 add_watcher() i=7 2024-09-18T01:27:13.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.215+0000 7f1a9fb40800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:13.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.215+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d7370 con 0x55de2e4c5950 2024-09-18T01:27:13.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.215+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.215+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94412747937696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d7370 con 0x55de2e4c5950 2024-09-18T01:27:13.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.216+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94412747937696] v35'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.216+0000 7f1951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:13.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.216+0000 7f1a9fb40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:13.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.216+0000 7f1a9fb40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:13.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.216+0000 7f1a9fb40800 5 note: GC not initialized 2024-09-18T01:27:13.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.216+0000 7f1950fe1640 20 reqs_thread_entry: start 2024-09-18T01:27:13.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.216+0000 7f1a9fb40800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:13.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.216+0000 7f1a9fb40800 20 Filter name: none 2024-09-18T01:27:13.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.217+0000 7f18ca7fc640 20 reqs_thread_entry: start 2024-09-18T01:27:13.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.217+0000 7f1a9fb40800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.217+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e50f850 con 0x55de2e4c5950 2024-09-18T01:27:13.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.217+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.217+0000 7f1a9fb40800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:27:13.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.217+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de2e510da0 con 0x7f1a8c03e070 2024-09-18T01:27:13.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.217+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.218+0000 7f1951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.218+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94412747937696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4e5b00 con 0x55de2e4c5950 2024-09-18T01:27:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.219+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94412747937696] v35'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.219+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94412747911040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d97a0 con 0x55de2e4ca340 2024-09-18T01:27:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.220+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94412747911040] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.220+0000 7f1a9fb40800 20 remove_watcher() i=0 2024-09-18T01:27:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.220+0000 7f1a9fb40800 2 removed watcher, disabling cache 2024-09-18T01:27:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.220+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94412747915440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d97a0 con 0x55de2e4c5950 2024-09-18T01:27:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.221+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94412747915440] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.221+0000 7f1a9fb40800 20 remove_watcher() i=1 2024-09-18T01:27:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.221+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94412747917008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d40b0 con 0x55de2e4ced00 2024-09-18T01:27:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.222+0000 7f1a930c9640 1 -- 172.21.15.100:0/804556045 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94412747917008] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a84051070 con 0x55de2e4ced00 2024-09-18T01:27:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.223+0000 7f1a9fb40800 20 remove_watcher() i=2 2024-09-18T01:27:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.223+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94412747918192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d97a0 con 0x55de2e4ca340 2024-09-18T01:27:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.223+0000 7f1a9b8ca640 1 -- 172.21.15.100:0/804556045 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94412747918192] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a8c075070 con 0x55de2e4ca340 2024-09-18T01:27:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.223+0000 7f1a9fb40800 20 remove_watcher() i=3 2024-09-18T01:27:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.224+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94412747927136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d46d0 con 0x55de2e4c5950 2024-09-18T01:27:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.225+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94412747927136] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x55de2e4c5950 2024-09-18T01:27:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.225+0000 7f1a9fb40800 20 remove_watcher() i=4 2024-09-18T01:27:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.225+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94412747930688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d97a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.226+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94412747930688] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.226+0000 7f1a9fb40800 20 remove_watcher() i=5 2024-09-18T01:27:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.226+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94412747934336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d46d0 con 0x7f1a8c03e070 2024-09-18T01:27:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.227+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94412747934336] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.227+0000 7f1a9fb40800 20 remove_watcher() i=6 2024-09-18T01:27:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.227+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94412747936640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de2e4d7c40 con 0x7f1a8c03e070 2024-09-18T01:27:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94412747936640] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a9400a4a0 con 0x7f1a8c03e070 2024-09-18T01:27:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 20 remove_watcher() i=7 2024-09-18T01:27:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f1a8c03e070 msgr2=0x7f1a8c024420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f1a8c03e070 0x7f1a8c024420 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55de2e4c5950 msgr2=0x55de2e4c7df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55de2e4c5950 0x55de2e4c7df0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55de2e4ca340 msgr2=0x55de2e4cc730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55de2e4ca340 0x55de2e4cc730 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55de2e4ced00 msgr2=0x55de2e4d11c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55de2e4ced00 0x55de2e4d11c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1964036b90 msgr2=0x7f1964039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1964036b90 0x7f1964039050 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1a84053570 tx=0x7f1a84053000 comp rx=0 tx=0).stop 2024-09-18T01:27:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4b2f70 msgr2=0x55de2e4ba1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/804556045 reap_dead start 2024-09-18T01:27:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4b2f70 0x55de2e4ba1f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c018740 tx=0x7f1a8c02bf50 comp rx=0 tx=0).stop 2024-09-18T01:27:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 shutdown_connections 2024-09-18T01:27:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/804556045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4b2f70 0x55de2e4ba1f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 >> 172.21.15.100:0/804556045 conn(0x55de2e4af370 msgr2=0x55de2e4ad440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 shutdown_connections 2024-09-18T01:27:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.228+0000 7f1a9fb40800 1 -- 172.21.15.100:0/804556045 wait complete. 2024-09-18T01:27:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3292321543 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1974036b40 msgr2=0x7f1974039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/3292321543 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1974036b40 0x7f1974039000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55de2e4902f0 tx=0x7f1a84005a00 comp rx=0 tx=0).stop 2024-09-18T01:27:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3292321543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4a6520 msgr2=0x55de2e4a6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/3292321543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4a6520 0x55de2e4a6940 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c001750 tx=0x7f1a8c02c4e0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3292321543 shutdown_connections 2024-09-18T01:27:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/3292321543 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1974036b40 0x7f1974039000 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/3292321543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e4a6520 0x55de2e4a6940 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3292321543 >> 172.21.15.100:0/3292321543 conn(0x55de2e49b4b0 msgr2=0x55de2e49e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3292321543 shutdown_connections 2024-09-18T01:27:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3292321543 wait complete. 2024-09-18T01:27:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55de2e495c80 msgr2=0x55de2e498070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55de2e495c80 0x55de2e498070 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55de2e395db0 msgr2=0x55de2e48f4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55de2e395db0 0x55de2e48f4f0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55de2e491d40 msgr2=0x55de2e494130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55de2e491d40 0x55de2e494130 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1984036b40 msgr2=0x7f1984039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1984036b40 0x7f1984039000 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1a84057000 tx=0x7f1a84052000 comp rx=0 tx=0).stop 2024-09-18T01:27:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e3035f0 msgr2=0x55de2e488480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 --2- 172.21.15.100:0/3149164929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de2e3035f0 0x55de2e488480 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c001e10 tx=0x7f1a8c000ed0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9c0cb640 1 -- 172.21.15.100:0/3149164929 reap_dead start 2024-09-18T01:27:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 shutdown_connections 2024-09-18T01:27:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 >> 172.21.15.100:0/3149164929 conn(0x55de2e389de0 msgr2=0x55de2e47acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 shutdown_connections 2024-09-18T01:27:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.229+0000 7f1a9fb40800 1 -- 172.21.15.100:0/3149164929 wait complete. 2024-09-18T01:27:13.239 INFO:teuthology.orchestra.run.smithi100.stdout:{"entries":[],"summary":[]} 2024-09-18T01:27:13.239 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-18T01:27:13.239 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-18T01:27:13.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-18T01:27:13.239 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-18T01:27:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.284+0000 7fd3e0340800 1 Processor -- start 2024-09-18T01:27:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.284+0000 7fd3e0340800 1 -- start start 2024-09-18T01:27:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.284+0000 7fd3e0340800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55771752e4e0 0x55771752e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.284+0000 7fd3e0340800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5577173eeb30 con 0x55771752ee20 2024-09-18T01:27:13.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.284+0000 7fd3e0340800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5577173d0360 con 0x55771752e4e0 2024-09-18T01:27:13.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.284+0000 7fd3dc0d1640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55771752e4e0 0x55771752e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.284+0000 7fd3dc0d1640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55771752e4e0 0x55771752e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44978/0 (socket says 172.21.15.100:44978) 2024-09-18T01:27:13.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.284+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/3527624315 learned_addr learned my addr 172.21.15.100:0/3527624315 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.284+0000 7fd3d38d0640 1 --1- 172.21.15.100:0/3527624315 >> v1:172.21.15.92:6789/0 conn(0x55771752ee20 0x5577175339a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37106/0 (socket says 172.21.15.100:37106) 2024-09-18T01:27:13.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.284+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/3527624315 >> v1:172.21.15.92:6789/0 conn(0x55771752ee20 legacy=0x5577175339a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.284+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/3527624315 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577173f6e00 con 0x55771752e4e0 2024-09-18T01:27:13.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.286+0000 7fd3dc0d1640 1 --2- 172.21.15.100:0/3527624315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 0x55771752e8e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00a520 tx=0x7fd3cc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91dfa1979a5a2e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.286+0000 7fd3db8d0640 1 -- 172.21.15.100:0/3527624315 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3cc055070 con 0x55771752e4e0 2024-09-18T01:27:13.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.286+0000 7fd3db8d0640 1 -- 172.21.15.100:0/3527624315 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3cc0515b0 con 0x55771752e4e0 2024-09-18T01:27:13.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.286+0000 7fd3db8d0640 1 -- 172.21.15.100:0/3527624315 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3cc0518d0 con 0x55771752e4e0 2024-09-18T01:27:13.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.287+0000 7fd3e0340800 1 -- 172.21.15.100:0/3527624315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 msgr2=0x55771752e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.287+0000 7fd3e0340800 1 --2- 172.21.15.100:0/3527624315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 0x55771752e8e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00a520 tx=0x7fd3cc045ba0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.287+0000 7fd3e0340800 1 -- 172.21.15.100:0/3527624315 shutdown_connections 2024-09-18T01:27:13.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.287+0000 7fd3e0340800 1 --2- 172.21.15.100:0/3527624315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 0x55771752e8e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.287+0000 7fd3e0340800 1 -- 172.21.15.100:0/3527624315 >> 172.21.15.100:0/3527624315 conn(0x557717529db0 msgr2=0x55771752c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.287+0000 7fd3e0340800 1 -- 172.21.15.100:0/3527624315 shutdown_connections 2024-09-18T01:27:13.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.287+0000 7fd3e0340800 1 -- 172.21.15.100:0/3527624315 wait complete. 2024-09-18T01:27:13.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.300+0000 7fd3e0340800 1 Processor -- start 2024-09-18T01:27:13.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.301+0000 7fd3e0340800 1 -- start start 2024-09-18T01:27:13.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.301+0000 7fd3e0340800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 0x557717620a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.301+0000 7fd3e0340800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55771747b360 con 0x55771752e4e0 2024-09-18T01:27:13.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.301+0000 7fd3dc0d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 0x557717620a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.301+0000 7fd3dc0d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 0x557717620a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44982/0 (socket says 172.21.15.100:44982) 2024-09-18T01:27:13.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.301+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1684762241 learned_addr learned my addr 172.21.15.100:0/1684762241 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.301+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1684762241 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577173c8bc0 con 0x55771752e4e0 2024-09-18T01:27:13.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.302+0000 7fd3dc0d1640 1 --2- 172.21.15.100:0/1684762241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 0x557717620a80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc025da0 tx=0x7fd3cc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0093fdade82e03 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.302+0000 7fd2ca60c640 1 -- 172.21.15.100:0/1684762241 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3cc051950 con 0x55771752e4e0 2024-09-18T01:27:13.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.302+0000 7fd2ca60c640 1 -- 172.21.15.100:0/1684762241 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3cc051af0 con 0x55771752e4e0 2024-09-18T01:27:13.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.302+0000 7fd2ca60c640 1 -- 172.21.15.100:0/1684762241 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3cc051dd0 con 0x55771752e4e0 2024-09-18T01:27:13.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.302+0000 7fd3e0340800 1 -- 172.21.15.100:0/1684762241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 msgr2=0x557717620a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.302+0000 7fd3e0340800 1 --2- 172.21.15.100:0/1684762241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 0x557717620a80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc025da0 tx=0x7fd3cc051000 comp rx=0 tx=0).stop 2024-09-18T01:27:13.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.303+0000 7fd3e0340800 1 -- 172.21.15.100:0/1684762241 shutdown_connections 2024-09-18T01:27:13.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.303+0000 7fd3e0340800 1 --2- 172.21.15.100:0/1684762241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 0x557717620a80 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.303+0000 7fd3e0340800 1 -- 172.21.15.100:0/1684762241 >> 172.21.15.100:0/1684762241 conn(0x557717529db0 msgr2=0x55771761c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.303+0000 7fd3e0340800 1 -- 172.21.15.100:0/1684762241 shutdown_connections 2024-09-18T01:27:13.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.303+0000 7fd3e0340800 1 -- 172.21.15.100:0/1684762241 wait complete. 2024-09-18T01:27:13.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.303+0000 7fd3e0340800 1 Processor -- start 2024-09-18T01:27:13.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.303+0000 7fd3e0340800 1 -- start start 2024-09-18T01:27:13.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.303+0000 7fd3e0340800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 0x5577176282b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.303+0000 7fd3e0340800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557717535500 con 0x55771752e4e0 2024-09-18T01:27:13.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.303+0000 7fd3dc0d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 0x5577176282b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.303+0000 7fd3dc0d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 0x5577176282b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44994/0 (socket says 172.21.15.100:44994) 2024-09-18T01:27:13.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.303+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/857273952 learned_addr learned my addr 172.21.15.100:0/857273952 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.304+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/857273952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577173dcfe0 con 0x55771752e4e0 2024-09-18T01:27:13.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.304+0000 7fd3dc0d1640 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 0x5577176282b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc067040 tx=0x7fd3cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.304+0000 7fd2c8e09640 1 -- 172.21.15.100:0/857273952 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3cc073070 con 0x55771752e4e0 2024-09-18T01:27:13.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.304+0000 7fd2c8e09640 1 -- 172.21.15.100:0/857273952 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3cc05a450 con 0x55771752e4e0 2024-09-18T01:27:13.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.304+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577176287f0 con 0x55771752e4e0 2024-09-18T01:27:13.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.304+0000 7fd2c8e09640 1 -- 172.21.15.100:0/857273952 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3cc05a730 con 0x55771752e4e0 2024-09-18T01:27:13.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.304+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557717628d70 con 0x55771752e4e0 2024-09-18T01:27:13.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.305+0000 7fd2c8e09640 1 -- 172.21.15.100:0/857273952 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd3cc076070 con 0x55771752e4e0 2024-09-18T01:27:13.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.305+0000 7fd2c8e09640 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2c4036b40 0x7fd2c4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.305+0000 7fd2c8e09640 1 -- 172.21.15.100:0/857273952 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd3cc062070 con 0x55771752e4e0 2024-09-18T01:27:13.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.305+0000 7fd3d38d0640 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2c4036b40 0x7fd2c4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.305+0000 7fd3e0340800 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55771752ee20 0x55771762f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.305+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55771762f8a0 con 0x55771752ee20 2024-09-18T01:27:13.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.305+0000 7fd3dc8d2640 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55771752ee20 0x55771762f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.306+0000 7fd3d38d0640 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2c4036b40 0x7fd2c4039000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4000f60 tx=0x7fd3c4001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.306+0000 7fd3dc8d2640 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55771752ee20 0x55771762f320 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.306+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/857273952 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x55771752ee20 2024-09-18T01:27:13.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.306+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55771762c8f0 con 0x55771752ee20 2024-09-18T01:27:13.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.306+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/857273952 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd3d400a4a0 con 0x55771752ee20 2024-09-18T01:27:13.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.306+0000 7fd3e0340800 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557717631bd0 0x557717633fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.306+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717634660 con 0x557717631bd0 2024-09-18T01:27:13.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.306+0000 7fd3dc0d1640 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557717631bd0 0x557717633fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.307+0000 7fd3dc0d1640 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557717631bd0 0x557717633fc0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.307+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/857273952 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd3cc07f070 con 0x557717631bd0 2024-09-18T01:27:13.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.307+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717630a70 con 0x55771752ee20 2024-09-18T01:27:13.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.307+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/857273952 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd3d400a4a0 con 0x55771752ee20 2024-09-18T01:27:13.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.307+0000 7fd3e0340800 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x557717635ac0 0x557717637eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.307+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176385b0 con 0x557717635ac0 2024-09-18T01:27:13.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.307+0000 7fd3d38d0640 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x557717635ac0 0x557717637eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.308+0000 7fd3d38d0640 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x557717635ac0 0x557717637eb0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.308+0000 7fd3d38d0640 1 -- 172.21.15.100:0/857273952 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd3c400f690 con 0x557717635ac0 2024-09-18T01:27:13.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.309+0000 7fd3e0340800 1 Processor -- start 2024-09-18T01:27:13.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.309+0000 7fd3e0340800 1 -- start start 2024-09-18T01:27:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.309+0000 7fd3e0340800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717646360 0x557717646780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.309+0000 7fd3e0340800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5577173ca580 con 0x557717646360 2024-09-18T01:27:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.309+0000 7fd3dc0d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717646360 0x557717646780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.309+0000 7fd3dc0d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717646360 0x557717646780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:44998/0 (socket says 172.21.15.100:44998) 2024-09-18T01:27:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.309+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/283242234 learned_addr learned my addr 172.21.15.100:0/283242234 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.309+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/283242234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557717646cc0 con 0x557717646360 2024-09-18T01:27:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.309+0000 7fd3dc0d1640 1 --2- 172.21.15.100:0/283242234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717646360 0x557717646780 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc08f2c0 tx=0x7fd3cc05af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.310+0000 7fd2c1ffb640 1 -- 172.21.15.100:0/283242234 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3cc07d050 con 0x557717646360 2024-09-18T01:27:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.310+0000 7fd2c1ffb640 1 -- 172.21.15.100:0/283242234 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3cc065c20 con 0x557717646360 2024-09-18T01:27:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.310+0000 7fd3e0340800 1 -- 172.21.15.100:0/283242234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557717646f50 con 0x557717646360 2024-09-18T01:27:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.310+0000 7fd2c1ffb640 1 -- 172.21.15.100:0/283242234 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3cc009b60 con 0x557717646360 2024-09-18T01:27:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.310+0000 7fd3e0340800 1 -- 172.21.15.100:0/283242234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557717649c30 con 0x557717646360 2024-09-18T01:27:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.310+0000 7fd2c1ffb640 1 -- 172.21.15.100:0/283242234 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd3cc08c070 con 0x557717646360 2024-09-18T01:27:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.311+0000 7fd2c1ffb640 1 --2- 172.21.15.100:0/283242234 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2b4036b90 0x7fd2b4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.311+0000 7fd2c1ffb640 1 -- 172.21.15.100:0/283242234 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd3cc093020 con 0x557717646360 2024-09-18T01:27:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.311+0000 7fd3d38d0640 1 --2- 172.21.15.100:0/283242234 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2b4036b90 0x7fd2b4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.311+0000 7fd3e0340800 1 Processor -- start 2024-09-18T01:27:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.311+0000 7fd3e0340800 1 -- start start 2024-09-18T01:27:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.311+0000 7fd3d38d0640 1 --2- 172.21.15.100:0/283242234 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2b4036b90 0x7fd2b4039050 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55771762c810 tx=0x7fd3c400f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.311+0000 7fd3e0340800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717652ee0 0x5577176532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.311+0000 7fd3e0340800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557717621170 con 0x557717652ee0 2024-09-18T01:27:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.311+0000 7fd3dc0d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717652ee0 0x5577176532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.311+0000 7fd3dc0d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717652ee0 0x5577176532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45008/0 (socket says 172.21.15.100:45008) 2024-09-18T01:27:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.311+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/4133385854 learned_addr learned my addr 172.21.15.100:0/4133385854 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.312+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/4133385854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577176538b0 con 0x557717652ee0 2024-09-18T01:27:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.312+0000 7fd3dc0d1640 1 --2- 172.21.15.100:0/4133385854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717652ee0 0x5577176532e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc095040 tx=0x7fd3cc079820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69282d5d74d5a9a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.312+0000 7fd2bb7fe640 1 -- 172.21.15.100:0/4133385854 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3cc06e740 con 0x557717652ee0 2024-09-18T01:27:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.312+0000 7fd2bb7fe640 1 -- 172.21.15.100:0/4133385854 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3cc063310 con 0x557717652ee0 2024-09-18T01:27:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.312+0000 7fd2bb7fe640 1 -- 172.21.15.100:0/4133385854 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3cc06e8e0 con 0x557717652ee0 2024-09-18T01:27:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.312+0000 7fd3e0340800 1 -- 172.21.15.100:0/4133385854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717652ee0 msgr2=0x5577176532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.312+0000 7fd3e0340800 1 --2- 172.21.15.100:0/4133385854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717652ee0 0x5577176532e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc095040 tx=0x7fd3cc079820 comp rx=0 tx=0).stop 2024-09-18T01:27:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.312+0000 7fd3e0340800 1 -- 172.21.15.100:0/4133385854 shutdown_connections 2024-09-18T01:27:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.312+0000 7fd3e0340800 1 --2- 172.21.15.100:0/4133385854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717652ee0 0x5577176532e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.312+0000 7fd3e0340800 1 -- 172.21.15.100:0/4133385854 >> 172.21.15.100:0/4133385854 conn(0x55771764f290 msgr2=0x55771764d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.312+0000 7fd3e0340800 1 -- 172.21.15.100:0/4133385854 shutdown_connections 2024-09-18T01:27:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.312+0000 7fd3e0340800 1 -- 172.21.15.100:0/4133385854 wait complete. 2024-09-18T01:27:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.313+0000 7fd3e0340800 1 Processor -- start 2024-09-18T01:27:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.313+0000 7fd3e0340800 1 -- start start 2024-09-18T01:27:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.313+0000 7fd3e0340800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717652ee0 0x55771765a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.313+0000 7fd3e0340800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557717653d00 con 0x557717652ee0 2024-09-18T01:27:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.313+0000 7fd3dc0d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717652ee0 0x55771765a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.313+0000 7fd3dc0d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717652ee0 0x55771765a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45024/0 (socket says 172.21.15.100:45024) 2024-09-18T01:27:13.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.313+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 learned_addr learned my addr 172.21.15.100:0/1934450496 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.313+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55771765a720 con 0x557717652ee0 2024-09-18T01:27:13.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.314+0000 7fd3dc0d1640 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717652ee0 0x55771765a1e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc063b40 tx=0x7fd3cc09af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.314+0000 7fd2b9ffb640 1 -- 172.21.15.100:0/1934450496 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3cc0bc070 con 0x557717652ee0 2024-09-18T01:27:13.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.314+0000 7fd2b9ffb640 1 -- 172.21.15.100:0/1934450496 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3cc0611d0 con 0x557717652ee0 2024-09-18T01:27:13.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.314+0000 7fd2b9ffb640 1 -- 172.21.15.100:0/1934450496 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3cc079460 con 0x557717652ee0 2024-09-18T01:27:13.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.314+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55771765a720 con 0x557717652ee0 2024-09-18T01:27:13.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.314+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55771765a720 con 0x557717652ee0 2024-09-18T01:27:13.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.315+0000 7fd2b9ffb640 1 -- 172.21.15.100:0/1934450496 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd3cc0bf070 con 0x557717652ee0 2024-09-18T01:27:13.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.315+0000 7fd2b9ffb640 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2ac036b90 0x7fd2ac039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.315+0000 7fd2b9ffb640 1 -- 172.21.15.100:0/1934450496 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd3cc0a8070 con 0x557717652ee0 2024-09-18T01:27:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.315+0000 7fd3d38d0640 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2ac036b90 0x7fd2ac039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.315+0000 7fd3d38d0640 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2ac036b90 0x7fd2ac039050 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5577176389b0 tx=0x7fd3c4010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.315+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.315+0000 7fd3e0340800 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557717665940 0x557717667e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.315+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717668550 con 0x557717665940 2024-09-18T01:27:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.316+0000 7fd3dc8d2640 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557717665940 0x557717667e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.316+0000 7fd3dc8d2640 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557717665940 0x557717667e00 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.316+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.316+0000 7fd3e0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.316+0000 7fd3e0340800 20 realm 2024-09-18T01:27:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.316+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.316+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717668960 con 0x557717665940 2024-09-18T01:27:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.316+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.316+0000 7fd3e0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.316+0000 7fd3e0340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.316+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.316+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717669230 con 0x557717665940 2024-09-18T01:27:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3e0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x557717665940 2024-09-18T01:27:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3e0340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3e0340800 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55771766a330 0x55771766c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55771766cd30 con 0x55771766a330 2024-09-18T01:27:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3dc0d1640 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55771766a330 0x55771766c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3dc0d1640 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55771766a330 0x55771766c720 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3e0340800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:13.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3e0340800 20 searching for the correct realm 2024-09-18T01:27:13.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.317+0000 7fd3e0340800 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55771766ece0 0x5577176711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.318+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557717671870 con 0x55771766ece0 2024-09-18T01:27:13.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.318+0000 7fd3d38d0640 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55771766ece0 0x5577176711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.318+0000 7fd3d38d0640 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55771766ece0 0x5577176711a0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.318+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.318+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557717671870 con 0x55771766a330 2024-09-18T01:27:13.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.318+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.318+0000 7fd3dc0d1640 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd3cc0c1060 0x7fd3cc0818c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.318+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557717671870 con 0x7fd3cc0c1060 2024-09-18T01:27:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.319+0000 7fd3dc8d2640 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd3cc0c1060 0x7fd3cc0818c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.319+0000 7fd3dc8d2640 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd3cc0c1060 0x7fd3cc0818c0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.319+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.319+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x557717665940 2024-09-18T01:27:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.320+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.320+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x557717665940 2024-09-18T01:27:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.320+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.320+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.320+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.320+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.320+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.320+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766a330 2024-09-18T01:27:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.320+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.321+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766ece0 2024-09-18T01:27:13.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.321+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.321+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x557717665940 2024-09-18T01:27:13.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.321+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.321+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766a330 2024-09-18T01:27:13.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.321+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.321+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x557717665940 2024-09-18T01:27:13.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.321+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.321+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766a330 2024-09-18T01:27:13.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.322+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.322+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766ece0 2024-09-18T01:27:13.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.322+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.322+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766ece0 2024-09-18T01:27:13.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.322+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.322+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.323+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.323+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766ece0 2024-09-18T01:27:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.323+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.323+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766ece0 2024-09-18T01:27:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.323+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.323+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x557717665940 2024-09-18T01:27:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.323+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.323+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x557717665940 2024-09-18T01:27:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.324+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.324+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.324+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.324+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766ece0 2024-09-18T01:27:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.325+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.325+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766a330 2024-09-18T01:27:13.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.325+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.325+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x557717665940 2024-09-18T01:27:13.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.325+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.325+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.325+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.325+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766ece0 2024-09-18T01:27:13.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.326+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.326+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766a330 2024-09-18T01:27:13.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.326+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.326+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766a330 2024-09-18T01:27:13.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.326+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.326+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766ece0 2024-09-18T01:27:13.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.326+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.326+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x557717665940 2024-09-18T01:27:13.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5577176695d0 con 0x55771766a330 2024-09-18T01:27:13.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3e0340800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:13.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3e0340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:13.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3e0340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:13.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3e0340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:13.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3e0340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:13.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3e0340800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:13.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55771766d5f0 con 0x557717665940 2024-09-18T01:27:13.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3e0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55771766d9e0 con 0x557717665940 2024-09-18T01:27:13.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.327+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:13.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55771766d9e0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:13.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 20 zone default found 2024-09-18T01:27:13.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 4 Realm: () 2024-09-18T01:27:13.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 20 zonegroup default 2024-09-18T01:27:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55771766d210 con 0x7fd3cc0c1060 2024-09-18T01:27:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176736d0 con 0x55771766ece0 2024-09-18T01:27:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.328+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.329+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717673a70 con 0x55771766ece0 2024-09-18T01:27:13.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.329+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.329+0000 7fd3e0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.329+0000 7fd3e0340800 20 started sync module instance, tier type = 2024-09-18T01:27:13.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.329+0000 7fd3e0340800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:13.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.329+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717672b70 con 0x55771766a330 2024-09-18T01:27:13.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.330+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.330+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93969982107488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176727d0 con 0x55771766a330 2024-09-18T01:27:13.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.330+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176747d0 con 0x557717665940 2024-09-18T01:27:13.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.331+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93969982107488] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.331+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.331+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93969982111248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717674bc0 con 0x557717665940 2024-09-18T01:27:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.331+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176755c0 con 0x55771766ece0 2024-09-18T01:27:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.332+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.332+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93969982116048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717675e90 con 0x55771766ece0 2024-09-18T01:27:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.332+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717676960 con 0x55771766a330 2024-09-18T01:27:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.332+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93969982111248] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.333+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.333+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93969982112304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717676d50 con 0x55771766a330 2024-09-18T01:27:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.333+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717677770 con 0x557717665940 2024-09-18T01:27:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.333+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93969982116048] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.335+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93969982112304] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.335+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.335+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93969982124640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717676d50 con 0x557717665940 2024-09-18T01:27:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.335+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717678010 con 0x7fd3cc0c1060 2024-09-18T01:27:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.336+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93969982124640] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.336+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.336+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93969982118368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717676d50 con 0x7fd3cc0c1060 2024-09-18T01:27:13.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.336+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176785e0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.337+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93969982118368] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.337+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.337+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93969982128336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176785a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.337+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717678fc0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.338+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(58 notify.7 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.338+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93969982130864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717678f80 con 0x7fd3cc0c1060 2024-09-18T01:27:13.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.338+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93969982128336] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.338+0000 7fd3e0340800 20 add_watcher() i=0 2024-09-18T01:27:13.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.338+0000 7fd3e0340800 20 add_watcher() i=1 2024-09-18T01:27:13.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.338+0000 7fd3e0340800 20 add_watcher() i=2 2024-09-18T01:27:13.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.338+0000 7fd3e0340800 20 add_watcher() i=3 2024-09-18T01:27:13.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.338+0000 7fd3e0340800 20 add_watcher() i=4 2024-09-18T01:27:13.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.338+0000 7fd3e0340800 20 add_watcher() i=5 2024-09-18T01:27:13.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.338+0000 7fd3e0340800 20 add_watcher() i=6 2024-09-18T01:27:13.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.339+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93969982130864] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.339+0000 7fd3e0340800 20 add_watcher() i=7 2024-09-18T01:27:13.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.339+0000 7fd3e0340800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:13.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.339+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717677ba0 con 0x557717665940 2024-09-18T01:27:13.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.339+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.339+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93969982133088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717677ba0 con 0x557717665940 2024-09-18T01:27:13.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.340+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93969982133088] v35'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.340+0000 7fd292fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:13.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.340+0000 7fd3e0340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:13.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.340+0000 7fd3e0340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:13.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.341+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717684f60 con 0x557717665940 2024-09-18T01:27:13.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.342+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'58 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.342+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717685630 con 0x7fd3cc0c1060 2024-09-18T01:27:13.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.343+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.343+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717685a50 con 0x55771766ece0 2024-09-18T01:27:13.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.344+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.344+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717686470 con 0x557717665940 2024-09-18T01:27:13.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.345+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'239 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.345+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717680c20 con 0x55771766a330 2024-09-18T01:27:13.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.346+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'81 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.346+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717680c20 con 0x55771766ece0 2024-09-18T01:27:13.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.347+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'61 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.347+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687060 con 0x557717665940 2024-09-18T01:27:13.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.348+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.348+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687620 con 0x7fd3cc0c1060 2024-09-18T01:27:13.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.349+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'56 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.349+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687620 con 0x55771766a330 2024-09-18T01:27:13.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.350+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.350+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ad0 con 0x55771766ece0 2024-09-18T01:27:13.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.351+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.351+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ad0 con 0x55771766a330 2024-09-18T01:27:13.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.352+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'82 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.352+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687230 con 0x7fd3cc0c1060 2024-09-18T01:27:13.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.353+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.353+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176876e0 con 0x55771766a330 2024-09-18T01:27:13.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.354+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.354+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176876e0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.355+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'68 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.356+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176876e0 con 0x557717665940 2024-09-18T01:27:13.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.356+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'240 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.357+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176876e0 con 0x55771766ece0 2024-09-18T01:27:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.358+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.358+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176877f0 con 0x55771766a330 2024-09-18T01:27:13.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.359+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'83 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.359+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176877f0 con 0x55771766ece0 2024-09-18T01:27:13.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.359+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'40 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.359+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ca0 con 0x557717665940 2024-09-18T01:27:13.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.361+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.361+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ca0 con 0x557717665940 2024-09-18T01:27:13.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.362+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'241 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.362+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ca0 con 0x55771766ece0 2024-09-18T01:27:13.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.363+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.363+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ca0 con 0x55771766a330 2024-09-18T01:27:13.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.364+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.364+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ca0 con 0x55771766ece0 2024-09-18T01:27:13.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.365+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.365+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ca0 con 0x55771766ece0 2024-09-18T01:27:13.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.366+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'46 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.366+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ca0 con 0x55771766ece0 2024-09-18T01:27:13.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.366+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.367+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ca0 con 0x55771766ece0 2024-09-18T01:27:13.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.367+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'62 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.367+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ca0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.369+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.369+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ca0 con 0x55771766ece0 2024-09-18T01:27:13.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.370+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.370+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ca0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.371+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'57 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.371+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ca0 con 0x55771766ece0 2024-09-18T01:27:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.372+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.372+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ca0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.373+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'69 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.373+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717687ca0 con 0x55771766a330 2024-09-18T01:27:13.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.374+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.374+0000 7fd291fe3640 20 reqs_thread_entry: start 2024-09-18T01:27:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.374+0000 7fd3e0340800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd3e0340800 20 Filter name: none 2024-09-18T01:27:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd28affd640 20 reqs_thread_entry: start 2024-09-18T01:27:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd3e0340800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:27:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176b2850 con 0x557717665940 2024-09-18T01:27:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd3e0340800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:27:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd3e0340800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:27:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd3e0340800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:27:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd3e0340800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:27:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176b22f0 con 0x55771766a330 2024-09-18T01:27:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd3e0340800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.7 : miss 2024-09-18T01:27:13.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.375+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:96 8.6 8:61f80f78:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176b5330 con 0x7fd3cc0c1060 2024-09-18T01:27:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.376+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(96 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.376+0000 7fd3e0340800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:27:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.376+0000 7fd3e0340800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.7 info.flags=0x17 2024-09-18T01:27:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.376+0000 7fd3e0340800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.7 to cache LRU end 2024-09-18T01:27:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.376+0000 7fd3e0340800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:27:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.376+0000 7fd3e0340800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:27:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.376+0000 7fd3e0340800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.7 2024-09-18T01:27:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.376+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:97 4.14 4:28c58a20:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577177326b0 con 0x55771766ece0 2024-09-18T01:27:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.377+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(97 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.377+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:98 4.e 4:718a44b5:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577177326f0 con 0x55771766a330 2024-09-18T01:27:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.377+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== osd_op_reply(98 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.377+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:99 4.6 4:62043cc8:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577177326f0 con 0x55771766ece0 2024-09-18T01:27:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.377+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 27 ==== osd_op_reply(99 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.377+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:100 4.28 4:14122442:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577177326f0 con 0x557717665940 2024-09-18T01:27:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.378+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(100 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.3 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.378+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:101 4.22 4:44173ae7:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717732710 con 0x557717665940 2024-09-18T01:27:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.378+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(101 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.4 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.378+0000 7fd3e0340800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-18T01:27:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.378+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:102 4.14 4:2b76a5ac:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717732710 con 0x55771766ece0 2024-09-18T01:27:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.378+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 28 ==== osd_op_reply(102 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.5 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.378+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:103 4.3c 4:3d8ca500:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717732710 con 0x557717665940 2024-09-18T01:27:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.379+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(103 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d400a4a0 con 0x557717665940 2024-09-18T01:27:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.379+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:104 4.37 4:ec0fe179:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717732710 con 0x7fd3cc0c1060 2024-09-18T01:27:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.379+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(104 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.379+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:105 4.1c 4:3a93e57f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717732710 con 0x7fd3cc0c1060 2024-09-18T01:27:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.380+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(105 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d400a4a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.380+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:106 4.33 4:cfda9686:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717732710 con 0x7fd3cc0c1060 2024-09-18T01:27:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.380+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(106 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.9 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.380+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:107 4.23 4:c790496d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717732710 con 0x7fd3cc0c1060 2024-09-18T01:27:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.380+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(107 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.380+0000 7fd3e0340800 20 get_obj_state: octx=0x7fd3cc054f10 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x557717730758 s->prefetch_data=0 2024-09-18T01:27:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.380+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:108 3.9s0 3:9303812c:::153b7754-209b-4898-8796-577da7c1273d.4237.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717731130 con 0x55771766ece0 2024-09-18T01:27:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.381+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 29 ==== osd_op_reply(108 153b7754-209b-4898-8796-577da7c1273d.4237.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.381+0000 7fd3e0340800 10 manifest: total_size = 6 2024-09-18T01:27:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.381+0000 7fd3e0340800 20 get_obj_state: setting s->obj_tag to 153b7754-209b-4898-8796-577da7c1273d.4237.4518088439547961591 2024-09-18T01:27:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.381+0000 7fd3e0340800 20 get_obj_state: octx=0x7fd3cc054f10 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x557717730758 s->prefetch_data=0 2024-09-18T01:27:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.381+0000 7fd3e0340800 20 prepare_atomic_modification: state is not atomic. state=0x557717730758 2024-09-18T01:27:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.381+0000 7fd3e0340800 20 bucket index object: :.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.4 2024-09-18T01:27:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.381+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:109 4.22 4:44173ae7:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176b98a0 con 0x557717665940 2024-09-18T01:27:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.382+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(109 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.4 [stat,call,call] v35'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.382+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:110 3.9s0 3:9303812c:::153b7754-209b-4898-8796-577da7c1273d.4237.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176b7880 con 0x55771766ece0 2024-09-18T01:27:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.383+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 30 ==== osd_op_reply(110 153b7754-209b-4898-8796-577da7c1273d.4237.7_15f6f8dc036519d7fe15b39338f6e5db [call] v35'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.383+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:111 4.22 4:44173ae7:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176b9e80 con 0x557717665940 2024-09-18T01:27:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.383+0000 7fd3e0340800 20 list_objects_ordered: starting attempt 1 2024-09-18T01:27:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.383+0000 7fd3e0340800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-18T01:27:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.383+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:112 4.14 4:28c58a20:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176bb800 con 0x55771766ece0 2024-09-18T01:27:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.383+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:113 4.e 4:718a44b5:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176bb800 con 0x55771766a330 2024-09-18T01:27:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.383+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:114 4.6 4:62043cc8:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c05d0 con 0x55771766ece0 2024-09-18T01:27:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.384+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:115 4.28 4:14122442:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176bb800 con 0x557717665940 2024-09-18T01:27:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.384+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 31 ==== osd_op_reply(112 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.384+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(115 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.3 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.384+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 23 ==== osd_op_reply(113 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.384+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 32 ==== osd_op_reply(114 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.384+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:116 4.22 4:44173ae7:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176bbc30 con 0x557717665940 2024-09-18T01:27:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.384+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:117 4.14 4:2b76a5ac:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176be100 con 0x55771766ece0 2024-09-18T01:27:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.384+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:118 4.3c 4:3d8ca500:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c0ec0 con 0x557717665940 2024-09-18T01:27:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.384+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:119 4.37 4:ec0fe179:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c3990 con 0x7fd3cc0c1060 2024-09-18T01:27:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.384+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:120 4.1c 4:3a93e57f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c6460 con 0x7fd3cc0c1060 2024-09-18T01:27:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.384+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:121 4.33 4:cfda9686:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c8d50 con 0x7fd3cc0c1060 2024-09-18T01:27:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.384+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:122 4.23 4:c790496d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176cb660 con 0x7fd3cc0c1060 2024-09-18T01:27:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 33 ==== osd_op_reply(117 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.5 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(118 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(119 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 29 ==== osd_op_reply(120 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 30 ==== osd_op_reply(121 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.9 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 31 ==== osd_op_reply(122 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 34 ==== osd_op_reply(111 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.4 [stat,call,call] v35'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd2baffd640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-18T01:27:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 35 ==== osd_op_reply(116 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.4 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-18T01:27:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-18T01:27:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-18T01:27:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-18T01:27:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[153b7754-209b-4898-8796-577da7c1273d.4237.7])"; uploads.size()=0; is_truncated=0 2024-09-18T01:27:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:123 4.14 4:28c58a20:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c3a70 con 0x55771766ece0 2024-09-18T01:27:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:124 4.e 4:718a44b5:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557717731720 con 0x55771766a330 2024-09-18T01:27:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:125 4.6 4:62043cc8:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c23c0 con 0x55771766ece0 2024-09-18T01:27:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:126 4.28 4:14122442:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c5340 con 0x557717665940 2024-09-18T01:27:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:127 4.22 4:44173ae7:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176cb640 con 0x557717665940 2024-09-18T01:27:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:128 4.14 4:2b76a5ac:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c23c0 con 0x55771766ece0 2024-09-18T01:27:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:129 4.3c 4:3d8ca500:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c5340 con 0x557717665940 2024-09-18T01:27:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:130 4.37 4:ec0fe179:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c5c80 con 0x7fd3cc0c1060 2024-09-18T01:27:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:131 4.1c 4:3a93e57f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c61a0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:132 4.33 4:cfda9686:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176d0470 con 0x7fd3cc0c1060 2024-09-18T01:27:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.385+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:133 4.23 4:c790496d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176d2d60 con 0x7fd3cc0c1060 2024-09-18T01:27:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.386+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 34 ==== osd_op_reply(123 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.386+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 24 ==== osd_op_reply(124 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.386+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 36 ==== osd_op_reply(126 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.3 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.386+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 32 ==== osd_op_reply(132 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.9 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.386+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 33 ==== osd_op_reply(131 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.386+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 35 ==== osd_op_reply(125 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.386+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 36 ==== osd_op_reply(128 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.5 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.386+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 34 ==== osd_op_reply(130 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.386+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 35 ==== osd_op_reply(133 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.386+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 37 ==== osd_op_reply(127 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.4 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.386+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 38 ==== osd_op_reply(129 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.386+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x55771766a330 2024-09-18T01:27:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.387+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 25 ==== osd_op_reply(134 foo.buckets [call] v35'50 uv50 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.387+0000 7fd3e0340800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:27:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.387+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.387+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x55771766a330 2024-09-18T01:27:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.387+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 26 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.387+0000 7fd3e0340800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:27:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.387+0000 7fd3e0340800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:27:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.387+0000 7fd3e0340800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:27:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.387+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x55771766a330 2024-09-18T01:27:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.388+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 27 ==== osd_op_reply(136 myfoo [call,call,delete] v35'51 uv51 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.388+0000 7fd3e0340800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-18T01:27:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.388+0000 7fd3e0340800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:27:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.388+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93969982398080 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.389+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 36 ==== watch-notify(notify (1) cookie 93969982128336 notify 150323855388 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5577176b45e0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.389+0000 7fd2baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855388 cookie 93969982128336 notifier 4790 bl.length()=149 2024-09-18T01:27:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.389+0000 7fd2baffd640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd2040032c0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.389+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 37 ==== osd_op_reply(137 notify.6 [notify cookie 93969982398080 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.389+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 38 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.389+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 39 ==== watch-notify(notify_complete (2) cookie 93969982398080 notify 150323855388 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557717684b30 con 0x7fd3cc0c1060 2024-09-18T01:27:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.389+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:139 8.6 8:61f80f78:root::.bucket.meta.myfoo%3a153b7754-209b-4898-8796-577da7c1273d.4237.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.390+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 40 ==== osd_op_reply(139 .bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.7 [call,call,delete] v35'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.390+0000 7fd3e0340800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.7 from cache 2024-09-18T01:27:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.390+0000 7fd3e0340800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:153b7754-209b-4898-8796-577da7c1273d.4237.7, ofs0, ns] 2024-09-18T01:27:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.390+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 93969982398080 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x557717665940 2024-09-18T01:27:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.390+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 39 ==== watch-notify(notify (1) cookie 93969982111248 notify 150323855403 ret 0) ==== 248+0+0 (crc 0 0 0) 0x557717684b30 con 0x557717665940 2024-09-18T01:27:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.390+0000 7fd2bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855403 cookie 93969982111248 notifier 4790 bl.length()=206 2024-09-18T01:27:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.390+0000 7fd2bb7fe640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd2a0003d60 con 0x557717665940 2024-09-18T01:27:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.390+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 40 ==== osd_op_reply(140 notify.1 [notify cookie 93969982398080 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.391+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 41 ==== watch-notify(notify_complete (2) cookie 93969982398080 notify 150323855403 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557717684960 con 0x557717665940 2024-09-18T01:27:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.391+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 42 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.391+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:142 4.14 4:28c58a20:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x55771766ece0 2024-09-18T01:27:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.391+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:143 4.e 4:718a44b5:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176b3920 con 0x55771766a330 2024-09-18T01:27:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.391+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:144 4.6 4:62043cc8:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c27f0 con 0x55771766ece0 2024-09-18T01:27:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.391+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:145 4.28 4:14122442:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x557717665940 2024-09-18T01:27:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.391+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:146 4.22 4:44173ae7:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c27f0 con 0x557717665940 2024-09-18T01:27:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.391+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:147 4.14 4:2b76a5ac:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176baca0 con 0x55771766ece0 2024-09-18T01:27:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.391+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:148 4.3c 4:3d8ca500:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176b3920 con 0x557717665940 2024-09-18T01:27:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.391+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:149 4.37 4:ec0fe179:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.391+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:150 4.1c 4:3a93e57f:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c27f0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.391+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:151 4.33 4:cfda9686:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c1d10 con 0x7fd3cc0c1060 2024-09-18T01:27:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.391+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:152 4.23 4:c790496d:::.dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176be5f0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.392+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 43 ==== osd_op_reply(145 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.3 [delete] v35'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.392+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 37 ==== osd_op_reply(142 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.0 [delete] v35'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 41 ==== osd_op_reply(150 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.8 [delete] v35'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 42 ==== osd_op_reply(149 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.7 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 44 ==== osd_op_reply(148 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.6 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 38 ==== osd_op_reply(144 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.2 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 39 ==== osd_op_reply(147 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.5 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 43 ==== osd_op_reply(152 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.10 [delete] v35'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 45 ==== osd_op_reply(146 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.4 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 44 ==== osd_op_reply(151 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.9 [delete] v35'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 28 ==== osd_op_reply(143 .dir.153b7754-209b-4898-8796-577da7c1273d.4237.7.1 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3e0340800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/153b7754-209b-4898-8796-577da7c1273d.4237.7 : miss 2024-09-18T01:27:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3e0340800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:153 6.1a 6:5ab3e8f1:::pubsub..bucket.myfoo%2f153b7754-209b-4898-8796-577da7c1273d.4237.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x55771766ece0 2024-09-18T01:27:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 40 ==== osd_op_reply(153 pubsub..bucket.myfoo/153b7754-209b-4898-8796-577da7c1273d.4237.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3e0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3e0340800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/153b7754-209b-4898-8796-577da7c1273d.4237.7 info.flags=0x0 2024-09-18T01:27:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3e0340800 10 adding default.rgw.log++pubsub..bucket.myfoo/153b7754-209b-4898-8796-577da7c1273d.4237.7 to cache LRU end 2024-09-18T01:27:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.393+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:154 6.1a 6:5ab3e8f1:::pubsub..bucket.myfoo%2f153b7754-209b-4898-8796-577da7c1273d.4237.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x55771766ece0 2024-09-18T01:27:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.394+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 41 ==== osd_op_reply(154 pubsub..bucket.myfoo/153b7754-209b-4898-8796-577da7c1273d.4237.7 [delete] v35'42 uv40 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.394+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x55771766a330 2024-09-18T01:27:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.396+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 29 ==== osd_op_reply(155 foo.buckets [call] v35'52 uv52 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.396+0000 7fd3e0340800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-18T01:27:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.396+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.397+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 45 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v35'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.397+0000 7fd3e0340800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-18T01:27:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.397+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 93969982433152 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x55771766a330 2024-09-18T01:27:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.397+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 30 ==== watch-notify(notify (1) cookie 93969982112304 notify 150323855381 ret 0) ==== 212+0+0 (crc 0 0 0) 0x557717680fc0 con 0x55771766a330 2024-09-18T01:27:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.397+0000 7fd2bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855381 cookie 93969982112304 notifier 4790 bl.length()=170 2024-09-18T01:27:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.397+0000 7fd2bb7fe640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd2a0003d60 con 0x55771766a330 2024-09-18T01:27:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.397+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 31 ==== osd_op_reply(157 notify.3 [notify cookie 93969982433152 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.397+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 32 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.397+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 33 ==== watch-notify(notify_complete (2) cookie 93969982433152 notify 150323855381 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557717646cc0 con 0x55771766a330 2024-09-18T01:27:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.397+0000 7fd3e0340800 10 removing email index: foo@foo.com 2024-09-18T01:27:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.397+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x557717665940 2024-09-18T01:27:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.398+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 46 ==== osd_op_reply(159 foo@foo.com [delete] v35'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.398+0000 7fd3e0340800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-18T01:27:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.398+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 93969982415904 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x55771766a330 2024-09-18T01:27:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.399+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 34 ==== watch-notify(notify (1) cookie 93969982112304 notify 150323855382 ret 0) ==== 204+0+0 (crc 0 0 0) 0x557717646cc0 con 0x55771766a330 2024-09-18T01:27:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.399+0000 7fd2baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855382 cookie 93969982112304 notifier 4790 bl.length()=162 2024-09-18T01:27:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.399+0000 7fd2baffd640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd2040032c0 con 0x55771766a330 2024-09-18T01:27:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.399+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 35 ==== osd_op_reply(160 notify.3 [notify cookie 93969982415904 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.399+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 36 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.399+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 37 ==== watch-notify(notify_complete (2) cookie 93969982415904 notify 150323855382 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557717628d70 con 0x55771766a330 2024-09-18T01:27:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.399+0000 7fd3e0340800 10 removing user buckets index 2024-09-18T01:27:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.399+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x55771766a330 2024-09-18T01:27:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.400+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 38 ==== osd_op_reply(162 foo.buckets [delete] v35'53 uv53 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.400+0000 7fd3e0340800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-18T01:27:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.400+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93969982415904 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.400+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 46 ==== watch-notify(notify (1) cookie 93969982118368 notify 150323855389 ret 0) ==== 202+0+0 (crc 0 0 0) 0x557717684960 con 0x7fd3cc0c1060 2024-09-18T01:27:13.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.400+0000 7fd2bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855389 cookie 93969982118368 notifier 4790 bl.length()=160 2024-09-18T01:27:13.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.400+0000 7fd2bb7fe640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd2a0003d60 con 0x7fd3cc0c1060 2024-09-18T01:27:13.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.400+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 47 ==== osd_op_reply(163 notify.5 [notify cookie 93969982415904 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.401+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 48 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.401+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 49 ==== watch-notify(notify_complete (2) cookie 93969982415904 notify 150323855389 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5577176850f0 con 0x7fd3cc0c1060 2024-09-18T01:27:13.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.401+0000 7fd3e0340800 10 removing user index: foo 2024-09-18T01:27:13.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.401+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x557717665940 2024-09-18T01:27:13.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.402+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 47 ==== osd_op_reply(165 foo [call,call,delete] v35'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.402+0000 7fd3e0340800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-18T01:27:13.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.402+0000 7fd3e0340800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:27:13.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.402+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 93969982415904 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x557717665940 2024-09-18T01:27:13.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.402+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 48 ==== watch-notify(notify (1) cookie 93969982124640 notify 150323855404 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5577176850f0 con 0x557717665940 2024-09-18T01:27:13.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.402+0000 7fd2baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855404 cookie 93969982124640 notifier 4790 bl.length()=152 2024-09-18T01:27:13.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.402+0000 7fd2baffd640 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd2040032c0 con 0x557717665940 2024-09-18T01:27:13.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.402+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 49 ==== osd_op_reply(166 notify.4 [notify cookie 93969982415904 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.402+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 50 ==== watch-notify(notify_complete (2) cookie 93969982415904 notify 150323855404 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557717684f20 con 0x557717665940 2024-09-18T01:27:13.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.402+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 51 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.403+0000 7fd292fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:13.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.403+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93969982133088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x557717665940 2024-09-18T01:27:13.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.404+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 52 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 93969982133088] v35'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.404+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93969982107488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x55771766a330 2024-09-18T01:27:13.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.405+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 39 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 93969982107488] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.405+0000 7fd3e0340800 20 remove_watcher() i=0 2024-09-18T01:27:13.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.405+0000 7fd3e0340800 2 removed watcher, disabling cache 2024-09-18T01:27:13.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.405+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93969982111248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x557717665940 2024-09-18T01:27:13.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.407+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 53 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 93969982111248] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.407+0000 7fd3e0340800 20 remove_watcher() i=1 2024-09-18T01:27:13.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.407+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93969982116048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x55771766ece0 2024-09-18T01:27:13.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.408+0000 7fd3d38d0640 1 -- 172.21.15.100:0/1934450496 <== osd.3 v2:172.21.15.100:6816/595195757 42 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 93969982116048] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c4037040 con 0x55771766ece0 2024-09-18T01:27:13.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.408+0000 7fd3e0340800 20 remove_watcher() i=2 2024-09-18T01:27:13.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.408+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93969982112304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c09f0 con 0x55771766a330 2024-09-18T01:27:13.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.409+0000 7fd3dc0d1640 1 -- 172.21.15.100:0/1934450496 <== osd.2 v2:172.21.15.100:6808/3104327688 40 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 93969982112304] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc0be030 con 0x55771766a330 2024-09-18T01:27:13.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.409+0000 7fd3e0340800 20 remove_watcher() i=3 2024-09-18T01:27:13.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.409+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93969982124640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c0f20 con 0x557717665940 2024-09-18T01:27:13.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.410+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.1 v2:172.21.15.100:6800/170575980 54 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 93969982124640] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x557717665940 2024-09-18T01:27:13.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.410+0000 7fd3e0340800 20 remove_watcher() i=4 2024-09-18T01:27:13.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.410+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93969982118368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717683080 con 0x7fd3cc0c1060 2024-09-18T01:27:13.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.411+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 50 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 93969982118368] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.411+0000 7fd3e0340800 20 remove_watcher() i=5 2024-09-18T01:27:13.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.411+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93969982128336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5577176c0f20 con 0x7fd3cc0c1060 2024-09-18T01:27:13.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.412+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 51 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 93969982128336] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.412+0000 7fd3e0340800 20 remove_watcher() i=6 2024-09-18T01:27:13.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.412+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93969982130864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557717683080 con 0x7fd3cc0c1060 2024-09-18T01:27:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 <== osd.0 v2:172.21.15.92:6800/2777570747 52 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 93969982130864] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d404c060 con 0x7fd3cc0c1060 2024-09-18T01:27:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 20 remove_watcher() i=7 2024-09-18T01:27:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd3cc0c1060 msgr2=0x7fd3cc0818c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd3cc0c1060 0x7fd3cc0818c0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557717665940 msgr2=0x557717667e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x557717665940 0x557717667e00 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55771766a330 msgr2=0x55771766c720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55771766a330 0x55771766c720 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55771766ece0 msgr2=0x5577176711a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55771766ece0 0x5577176711a0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2ac036b90 msgr2=0x7fd2ac039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2ac036b90 0x7fd2ac039050 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5577176389b0 tx=0x7fd3c4010000 comp rx=0 tx=0).stop 2024-09-18T01:27:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717652ee0 msgr2=0x55771765a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 --2- 172.21.15.100:0/1934450496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717652ee0 0x55771765a1e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc063b40 tx=0x7fd3cc09af00 comp rx=0 tx=0).stop 2024-09-18T01:27:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 reap_dead start 2024-09-18T01:27:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/1934450496 reap_dead start 2024-09-18T01:27:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 shutdown_connections 2024-09-18T01:27:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 >> 172.21.15.100:0/1934450496 conn(0x55771764f290 msgr2=0x55771764d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 shutdown_connections 2024-09-18T01:27:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.413+0000 7fd3e0340800 1 -- 172.21.15.100:0/1934450496 wait complete. 2024-09-18T01:27:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 -- 172.21.15.100:0/283242234 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2b4036b90 msgr2=0x7fd2b4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 --2- 172.21.15.100:0/283242234 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2b4036b90 0x7fd2b4039050 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55771762c810 tx=0x7fd3c400f000 comp rx=0 tx=0).stop 2024-09-18T01:27:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 -- 172.21.15.100:0/283242234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717646360 msgr2=0x557717646780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 --2- 172.21.15.100:0/283242234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717646360 0x557717646780 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc08f2c0 tx=0x7fd3cc05af40 comp rx=0 tx=0).stop 2024-09-18T01:27:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 -- 172.21.15.100:0/283242234 shutdown_connections 2024-09-18T01:27:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 --2- 172.21.15.100:0/283242234 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2b4036b90 0x7fd2b4039050 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 --2- 172.21.15.100:0/283242234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557717646360 0x557717646780 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 -- 172.21.15.100:0/283242234 >> 172.21.15.100:0/283242234 conn(0x55771763b2f0 msgr2=0x55771763de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 -- 172.21.15.100:0/283242234 shutdown_connections 2024-09-18T01:27:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 -- 172.21.15.100:0/283242234 wait complete. 2024-09-18T01:27:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x557717635ac0 msgr2=0x557717637eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x557717635ac0 0x557717637eb0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55771752ee20 msgr2=0x55771762f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55771752ee20 0x55771762f320 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557717631bd0 msgr2=0x557717633fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x557717631bd0 0x557717633fc0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2c4036b40 msgr2=0x7fd2c4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd2c4036b40 0x7fd2c4039000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4000f60 tx=0x7fd3c4001370 comp rx=0 tx=0).stop 2024-09-18T01:27:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 msgr2=0x5577176282b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 --2- 172.21.15.100:0/857273952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55771752e4e0 0x5577176282b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc067040 tx=0x7fd3cc002fb0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3dc8d2640 1 -- 172.21.15.100:0/857273952 reap_dead start 2024-09-18T01:27:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 shutdown_connections 2024-09-18T01:27:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 >> 172.21.15.100:0/857273952 conn(0x557717529db0 msgr2=0x5577176168a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.414+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 shutdown_connections 2024-09-18T01:27:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.415+0000 7fd3e0340800 1 -- 172.21.15.100:0/857273952 wait complete. 2024-09-18T01:27:13.424 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:27:13.424 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:27:13.424 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:27:13.468 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:13.468 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:13.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.467+0000 7fe105c13800 1 Processor -- start 2024-09-18T01:27:13.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.468+0000 7fe105c13800 1 -- start start 2024-09-18T01:27:13.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.468+0000 7fe105c13800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55b25f4d6970 0x55b25f4d8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.468+0000 7fe105c13800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b25f391b30 con 0x55b25f446630 2024-09-18T01:27:13.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.468+0000 7fe105c13800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55b25f373360 con 0x55b25f4d6970 2024-09-18T01:27:13.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.468+0000 7fe0f8b2b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55b25f4d6970 0x55b25f4d8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.468+0000 7fe10132c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55b25f446630 0x55b25f4d5250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37112/0 (socket says 172.21.15.100:37112) 2024-09-18T01:27:13.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.468+0000 7fe10132c640 1 -- 172.21.15.100:0/2281453352 learned_addr learned my addr 172.21.15.100:0/2281453352 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:13.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.468+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/2281453352 >> v1:172.21.15.92:6789/0 conn(0x55b25f446630 legacy=0x55b25f4d5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.468+0000 7fe100b2b640 1 -- 172.21.15.100:0/2281453352 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1063898170 0 0) 0x55b25f391b30 con 0x55b25f446630 2024-09-18T01:27:13.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.468+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/2281453352 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25f399e00 con 0x55b25f4d6970 2024-09-18T01:27:13.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.470+0000 7fe0f8b2b640 1 --2- 172.21.15.100:0/2281453352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f4d6970 0x55b25f4d8d60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00a470 tx=0x7fe0ec045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f03fa4ac03c8536 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.470+0000 7fe100b2b640 1 -- 172.21.15.100:0/2281453352 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0ec053570 con 0x55b25f4d6970 2024-09-18T01:27:13.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.470+0000 7fe100b2b640 1 -- 172.21.15.100:0/2281453352 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ec058070 con 0x55b25f4d6970 2024-09-18T01:27:13.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.470+0000 7fe100b2b640 1 -- 172.21.15.100:0/2281453352 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0ec053880 con 0x55b25f4d6970 2024-09-18T01:27:13.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.471+0000 7fe105c13800 1 -- 172.21.15.100:0/2281453352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f4d6970 msgr2=0x55b25f4d8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.471+0000 7fe105c13800 1 --2- 172.21.15.100:0/2281453352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f4d6970 0x55b25f4d8d60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00a470 tx=0x7fe0ec045a20 comp rx=0 tx=0).stop 2024-09-18T01:27:13.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.471+0000 7fe105c13800 1 -- 172.21.15.100:0/2281453352 shutdown_connections 2024-09-18T01:27:13.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.471+0000 7fe105c13800 1 --2- 172.21.15.100:0/2281453352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f4d6970 0x55b25f4d8d60 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.471+0000 7fe105c13800 1 -- 172.21.15.100:0/2281453352 >> 172.21.15.100:0/2281453352 conn(0x55b25f4ccde0 msgr2=0x55b25f4cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.471+0000 7fe105c13800 1 -- 172.21.15.100:0/2281453352 shutdown_connections 2024-09-18T01:27:13.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.471+0000 7fe105c13800 1 -- 172.21.15.100:0/2281453352 wait complete. 2024-09-18T01:27:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.485+0000 7fe105c13800 1 Processor -- start 2024-09-18T01:27:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.485+0000 7fe105c13800 1 -- start start 2024-09-18T01:27:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.485+0000 7fe105c13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f446630 0x55b25f5c1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.485+0000 7fe105c13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b25f41e330 con 0x55b25f446630 2024-09-18T01:27:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.485+0000 7fe10132c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f446630 0x55b25f5c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.485+0000 7fe10132c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f446630 0x55b25f5c1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45048/0 (socket says 172.21.15.100:45048) 2024-09-18T01:27:13.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.485+0000 7fe10132c640 1 -- 172.21.15.100:0/2710132295 learned_addr learned my addr 172.21.15.100:0/2710132295 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.485+0000 7fe10132c640 1 -- 172.21.15.100:0/2710132295 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25f36bbc0 con 0x55b25f446630 2024-09-18T01:27:13.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.486+0000 7fe10132c640 1 --2- 172.21.15.100:0/2710132295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f446630 0x55b25f5c1630 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400b240 tx=0x7fe0f400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f31c215facb55b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.486+0000 7fdfef606640 1 -- 172.21.15.100:0/2710132295 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f4008070 con 0x55b25f446630 2024-09-18T01:27:13.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.486+0000 7fdfef606640 1 -- 172.21.15.100:0/2710132295 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f400d500 con 0x55b25f446630 2024-09-18T01:27:13.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.486+0000 7fdfef606640 1 -- 172.21.15.100:0/2710132295 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f400d860 con 0x55b25f446630 2024-09-18T01:27:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.486+0000 7fe105c13800 1 -- 172.21.15.100:0/2710132295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f446630 msgr2=0x55b25f5c1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.486+0000 7fe105c13800 1 --2- 172.21.15.100:0/2710132295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f446630 0x55b25f5c1630 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400b240 tx=0x7fe0f400b700 comp rx=0 tx=0).stop 2024-09-18T01:27:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.486+0000 7fe105c13800 1 -- 172.21.15.100:0/2710132295 shutdown_connections 2024-09-18T01:27:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.486+0000 7fe105c13800 1 --2- 172.21.15.100:0/2710132295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f446630 0x55b25f5c1630 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.486+0000 7fe105c13800 1 -- 172.21.15.100:0/2710132295 >> 172.21.15.100:0/2710132295 conn(0x55b25f4ccde0 msgr2=0x55b25f5bcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.486+0000 7fe105c13800 1 -- 172.21.15.100:0/2710132295 shutdown_connections 2024-09-18T01:27:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.487+0000 7fe105c13800 1 -- 172.21.15.100:0/2710132295 wait complete. 2024-09-18T01:27:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.487+0000 7fe105c13800 1 Processor -- start 2024-09-18T01:27:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.487+0000 7fe105c13800 1 -- start start 2024-09-18T01:27:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.487+0000 7fe105c13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f446630 0x55b25f4d2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.487+0000 7fe105c13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b25f4d9690 con 0x55b25f446630 2024-09-18T01:27:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.487+0000 7fe10132c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f446630 0x55b25f4d2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.487+0000 7fe10132c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f446630 0x55b25f4d2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45050/0 (socket says 172.21.15.100:45050) 2024-09-18T01:27:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.487+0000 7fe10132c640 1 -- 172.21.15.100:0/3576424818 learned_addr learned my addr 172.21.15.100:0/3576424818 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.488+0000 7fe10132c640 1 -- 172.21.15.100:0/3576424818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25f37ffe0 con 0x55b25f446630 2024-09-18T01:27:13.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.488+0000 7fe10132c640 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f446630 0x55b25f4d2b80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4000f60 tx=0x7fe0f4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.488+0000 7fdfede03640 1 -- 172.21.15.100:0/3576424818 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f4019870 con 0x55b25f446630 2024-09-18T01:27:13.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.488+0000 7fdfede03640 1 -- 172.21.15.100:0/3576424818 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f4019a10 con 0x55b25f446630 2024-09-18T01:27:13.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.488+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b25f4d1270 con 0x55b25f446630 2024-09-18T01:27:13.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.488+0000 7fdfede03640 1 -- 172.21.15.100:0/3576424818 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f4019d10 con 0x55b25f446630 2024-09-18T01:27:13.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.488+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b25f4d1790 con 0x55b25f446630 2024-09-18T01:27:13.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.489+0000 7fdfede03640 1 -- 172.21.15.100:0/3576424818 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe0f4017040 con 0x55b25f446630 2024-09-18T01:27:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.489+0000 7fdfede03640 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfe8036b90 0x7fdfe8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.489+0000 7fdfede03640 1 -- 172.21.15.100:0/3576424818 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fe0f4015020 con 0x55b25f446630 2024-09-18T01:27:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.489+0000 7fe0f8b2b640 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfe8036b90 0x7fdfe8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.489+0000 7fe105c13800 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b25f4d6970 0x55b25f5d24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.489+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f5d29e0 con 0x55b25f4d6970 2024-09-18T01:27:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.489+0000 7fe101b2d640 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b25f4d6970 0x55b25f5d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.490+0000 7fe0f8b2b640 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfe8036b90 0x7fdfe8039050 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec057000 tx=0x7fe0ec052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.490+0000 7fe101b2d640 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b25f4d6970 0x55b25f5d24a0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.490+0000 7fe101b2d640 1 -- 172.21.15.100:0/3576424818 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f4d6970 2024-09-18T01:27:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.490+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f5d3230 con 0x55b25f4d6970 2024-09-18T01:27:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.490+0000 7fe101b2d640 1 -- 172.21.15.100:0/3576424818 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f4d6970 2024-09-18T01:27:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.490+0000 7fe105c13800 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b25f5d4b40 0x55b25f5d6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.490+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f5d7760 con 0x55b25f5d4b40 2024-09-18T01:27:13.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.490+0000 7fe10132c640 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b25f5d4b40 0x55b25f5d6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.491+0000 7fe10132c640 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b25f5d4b40 0x55b25f5d6fd0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.491+0000 7fe10132c640 1 -- 172.21.15.100:0/3576424818 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe0f402d070 con 0x55b25f5d4b40 2024-09-18T01:27:13.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.491+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f5d3a80 con 0x55b25f4d6970 2024-09-18T01:27:13.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.491+0000 7fe101b2d640 1 -- 172.21.15.100:0/3576424818 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f4d6970 2024-09-18T01:27:13.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.491+0000 7fe105c13800 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b25f5d8bc0 0x55b25f5dafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.491+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f5db6b0 con 0x55b25f5d8bc0 2024-09-18T01:27:13.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.491+0000 7fe0f8b2b640 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b25f5d8bc0 0x55b25f5dafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.492+0000 7fe0f8b2b640 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b25f5d8bc0 0x55b25f5dafb0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.492+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/3576424818 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f5d8bc0 2024-09-18T01:27:13.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.492+0000 7fe105c13800 1 Processor -- start 2024-09-18T01:27:13.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.493+0000 7fe105c13800 1 -- start start 2024-09-18T01:27:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.493+0000 7fe105c13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5e9460 0x55b25f5e9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.493+0000 7fe105c13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b25f4d30c0 con 0x55b25f5e9460 2024-09-18T01:27:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.493+0000 7fe10132c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5e9460 0x55b25f5e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.493+0000 7fe10132c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5e9460 0x55b25f5e9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45054/0 (socket says 172.21.15.100:45054) 2024-09-18T01:27:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.493+0000 7fe10132c640 1 -- 172.21.15.100:0/3483145075 learned_addr learned my addr 172.21.15.100:0/3483145075 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.493+0000 7fe10132c640 1 -- 172.21.15.100:0/3483145075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25f5e9dc0 con 0x55b25f5e9460 2024-09-18T01:27:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.493+0000 7fe10132c640 1 --2- 172.21.15.100:0/3483145075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5e9460 0x55b25f5e9880 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe0f404b740 tx=0x7fe0f400fe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.493+0000 7fdfe6ffd640 1 -- 172.21.15.100:0/3483145075 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f400edc0 con 0x55b25f5e9460 2024-09-18T01:27:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.493+0000 7fdfe6ffd640 1 -- 172.21.15.100:0/3483145075 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f4034070 con 0x55b25f5e9460 2024-09-18T01:27:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.493+0000 7fdfe6ffd640 1 -- 172.21.15.100:0/3483145075 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f404bc20 con 0x55b25f5e9460 2024-09-18T01:27:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.494+0000 7fe105c13800 1 -- 172.21.15.100:0/3483145075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b25f5ea050 con 0x55b25f5e9460 2024-09-18T01:27:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.494+0000 7fe105c13800 1 -- 172.21.15.100:0/3483145075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b25f5ecd30 con 0x55b25f5e9460 2024-09-18T01:27:13.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.494+0000 7fdfe6ffd640 1 -- 172.21.15.100:0/3483145075 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe0f4036020 con 0x55b25f5e9460 2024-09-18T01:27:13.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.494+0000 7fdfe6ffd640 1 --2- 172.21.15.100:0/3483145075 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfd8036b90 0x7fdfd8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.494+0000 7fdfe6ffd640 1 -- 172.21.15.100:0/3483145075 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fe0f400a200 con 0x55b25f5e9460 2024-09-18T01:27:13.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.494+0000 7fe0f8b2b640 1 --2- 172.21.15.100:0/3483145075 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfd8036b90 0x7fdfd8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.495+0000 7fe105c13800 1 Processor -- start 2024-09-18T01:27:13.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.495+0000 7fe105c13800 1 -- start start 2024-09-18T01:27:13.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.495+0000 7fe0f8b2b640 1 --2- 172.21.15.100:0/3483145075 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfd8036b90 0x7fdfd8039050 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55b25f4d1b80 tx=0x7fe0ec005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.495+0000 7fe105c13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5f6070 0x55b25f5f6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.495+0000 7fe105c13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b25f36d580 con 0x55b25f5f6070 2024-09-18T01:27:13.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.495+0000 7fe10132c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5f6070 0x55b25f5f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.495+0000 7fe10132c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5f6070 0x55b25f5f6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45058/0 (socket says 172.21.15.100:45058) 2024-09-18T01:27:13.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.495+0000 7fe10132c640 1 -- 172.21.15.100:0/3393355548 learned_addr learned my addr 172.21.15.100:0/3393355548 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.495+0000 7fe10132c640 1 -- 172.21.15.100:0/3393355548 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25f5f69b0 con 0x55b25f5f6070 2024-09-18T01:27:13.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.496+0000 7fe10132c640 1 --2- 172.21.15.100:0/3393355548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5f6070 0x55b25f5f6470 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4016040 tx=0x7fe0f4045fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3182f68855b3ed server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.496+0000 7fdfe4ff9640 1 -- 172.21.15.100:0/3393355548 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f405e070 con 0x55b25f5f6070 2024-09-18T01:27:13.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.496+0000 7fdfe4ff9640 1 -- 172.21.15.100:0/3393355548 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f4008d10 con 0x55b25f5f6070 2024-09-18T01:27:13.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.496+0000 7fdfe4ff9640 1 -- 172.21.15.100:0/3393355548 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f4053040 con 0x55b25f5f6070 2024-09-18T01:27:13.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.496+0000 7fe105c13800 1 -- 172.21.15.100:0/3393355548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5f6070 msgr2=0x55b25f5f6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.496+0000 7fe105c13800 1 --2- 172.21.15.100:0/3393355548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5f6070 0x55b25f5f6470 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4016040 tx=0x7fe0f4045fd0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.496+0000 7fe105c13800 1 -- 172.21.15.100:0/3393355548 shutdown_connections 2024-09-18T01:27:13.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.496+0000 7fe105c13800 1 --2- 172.21.15.100:0/3393355548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5f6070 0x55b25f5f6470 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.496+0000 7fe105c13800 1 -- 172.21.15.100:0/3393355548 >> 172.21.15.100:0/3393355548 conn(0x55b25f5f2420 msgr2=0x55b25f5f0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.496+0000 7fe105c13800 1 -- 172.21.15.100:0/3393355548 shutdown_connections 2024-09-18T01:27:13.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.496+0000 7fe105c13800 1 -- 172.21.15.100:0/3393355548 wait complete. 2024-09-18T01:27:13.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.497+0000 7fe105c13800 1 Processor -- start 2024-09-18T01:27:13.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.497+0000 7fe105c13800 1 -- start start 2024-09-18T01:27:13.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.497+0000 7fe105c13800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5f6070 0x55b25f5fd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.497+0000 7fe105c13800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b25f5f69b0 con 0x55b25f5f6070 2024-09-18T01:27:13.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.497+0000 7fe10132c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5f6070 0x55b25f5fd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.497+0000 7fe10132c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5f6070 0x55b25f5fd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45070/0 (socket says 172.21.15.100:45070) 2024-09-18T01:27:13.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.497+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 learned_addr learned my addr 172.21.15.100:0/1840790771 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.497+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25f5fd7b0 con 0x55b25f5f6070 2024-09-18T01:27:13.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.497+0000 7fe10132c640 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5f6070 0x55b25f5fd270 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4000fb0 tx=0x7fe0f4016f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.498+0000 7fdfd6ffd640 1 -- 172.21.15.100:0/1840790771 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f4069020 con 0x55b25f5f6070 2024-09-18T01:27:13.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.498+0000 7fdfd6ffd640 1 -- 172.21.15.100:0/1840790771 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f401aa40 con 0x55b25f5f6070 2024-09-18T01:27:13.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.498+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b25f5fd7b0 con 0x55b25f5f6070 2024-09-18T01:27:13.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.498+0000 7fdfd6ffd640 1 -- 172.21.15.100:0/1840790771 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f405e030 con 0x55b25f5f6070 2024-09-18T01:27:13.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.498+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b25f5fd7b0 con 0x55b25f5f6070 2024-09-18T01:27:13.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.498+0000 7fdfd6ffd640 1 -- 172.21.15.100:0/1840790771 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe0f406c020 con 0x55b25f5f6070 2024-09-18T01:27:13.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.499+0000 7fdfd6ffd640 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfcc036b90 0x7fdfcc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.499+0000 7fdfd6ffd640 1 -- 172.21.15.100:0/1840790771 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fe0f405f070 con 0x55b25f5f6070 2024-09-18T01:27:13.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.499+0000 7fe0f8b2b640 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfcc036b90 0x7fdfcc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.499+0000 7fe105c13800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.499+0000 7fe105c13800 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b25f608940 0x55b25f60ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.499+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60b550 con 0x55b25f608940 2024-09-18T01:27:13.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.499+0000 7fe101b2d640 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b25f608940 0x55b25f60ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.499+0000 7fe0f8b2b640 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfcc036b90 0x7fdfcc039050 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55b25f5dbab0 tx=0x7fe0ec06b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.499+0000 7fe101b2d640 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b25f608940 0x55b25f60ae00 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 20 realm 2024-09-18T01:27:13.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60b960 con 0x55b25f608940 2024-09-18T01:27:13.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:13.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c230 con 0x55b25f608940 2024-09-18T01:27:13.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f608940 2024-09-18T01:27:13.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:13.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b25f60d100 0x55b25f60f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60fc30 con 0x55b25f60d100 2024-09-18T01:27:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.500+0000 7fe10132c640 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b25f60d100 0x55b25f60f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.501+0000 7fe10132c640 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b25f60d100 0x55b25f60f4f0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.501+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.501+0000 7fe105c13800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.501+0000 7fe105c13800 20 searching for the correct realm 2024-09-18T01:27:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.501+0000 7fe105c13800 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b25f611c90 0x55b25f614130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.501+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f614800 con 0x55b25f611c90 2024-09-18T01:27:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.501+0000 7fe0f8b2b640 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b25f611c90 0x55b25f614130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.501+0000 7fe0f8b2b640 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b25f611c90 0x55b25f614130 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.502+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f611c90 2024-09-18T01:27:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.502+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f614800 con 0x55b25f60d100 2024-09-18T01:27:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.502+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.502+0000 7fe10132c640 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe0f406e020 0x7fe0f404d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.502+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f614800 con 0x7fe0f406e020 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.502+0000 7fe101b2d640 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe0f406e020 0x7fe0f404d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.502+0000 7fe101b2d640 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe0f406e020 0x7fe0f404d500 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.503+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.503+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f608940 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.503+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.503+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f608940 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.503+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.503+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x7fe0f406e020 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.503+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.503+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x7fe0f406e020 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.504+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.504+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f60d100 2024-09-18T01:27:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.504+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.504+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f611c90 2024-09-18T01:27:13.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.504+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f611c90 2024-09-18T01:27:13.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.504+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f608940 2024-09-18T01:27:13.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.504+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.504+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f60d100 2024-09-18T01:27:13.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.504+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.504+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f608940 2024-09-18T01:27:13.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.505+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.505+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f60d100 2024-09-18T01:27:13.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.505+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.505+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f611c90 2024-09-18T01:27:13.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.505+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f611c90 2024-09-18T01:27:13.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.505+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f611c90 2024-09-18T01:27:13.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.505+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f611c90 2024-09-18T01:27:13.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.505+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x7fe0f406e020 2024-09-18T01:27:13.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.506+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.506+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f611c90 2024-09-18T01:27:13.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.506+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f611c90 2024-09-18T01:27:13.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.506+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f611c90 2024-09-18T01:27:13.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.506+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f611c90 2024-09-18T01:27:13.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.506+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f608940 2024-09-18T01:27:13.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.506+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.506+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f608940 2024-09-18T01:27:13.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.506+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.506+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x7fe0f406e020 2024-09-18T01:27:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.507+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.507+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f611c90 2024-09-18T01:27:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.507+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f611c90 2024-09-18T01:27:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.507+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f60d100 2024-09-18T01:27:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.507+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.507+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f608940 2024-09-18T01:27:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.507+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.507+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x7fe0f406e020 2024-09-18T01:27:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.508+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.508+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f611c90 2024-09-18T01:27:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.508+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f611c90 2024-09-18T01:27:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.508+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f60d100 2024-09-18T01:27:13.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.508+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.508+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f60d100 2024-09-18T01:27:13.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.508+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.508+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f611c90 2024-09-18T01:27:13.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f611c90 2024-09-18T01:27:13.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x7fe0f406e020 2024-09-18T01:27:13.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f608940 2024-09-18T01:27:13.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b25f60c5d0 con 0x55b25f60d100 2024-09-18T01:27:13.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe105c13800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe105c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe105c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe105c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe105c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe105c13800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe105c13800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f6105b0 con 0x55b25f608940 2024-09-18T01:27:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.509+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f6109a0 con 0x55b25f608940 2024-09-18T01:27:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:13.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f6109a0 con 0x7fe0f406e020 2024-09-18T01:27:13.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:13.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 20 zone default found 2024-09-18T01:27:13.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 4 Realm: () 2024-09-18T01:27:13.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:13.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:13.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:13.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 20 zonegroup default 2024-09-18T01:27:13.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f610dc0 con 0x7fe0f406e020 2024-09-18T01:27:13.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.510+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f6111b0 con 0x55b25f611c90 2024-09-18T01:27:13.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.511+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f611c90 2024-09-18T01:27:13.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.511+0000 7fe105c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.511+0000 7fe105c13800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.511+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f616660 con 0x55b25f611c90 2024-09-18T01:27:13.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.511+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f611c90 2024-09-18T01:27:13.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.511+0000 7fe105c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.511+0000 7fe105c13800 20 started sync module instance, tier type = 2024-09-18T01:27:13.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.511+0000 7fe105c13800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:13.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.511+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f615b00 con 0x55b25f60d100 2024-09-18T01:27:13.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.512+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.512+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94224592756464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f615760 con 0x55b25f60d100 2024-09-18T01:27:13.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.512+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f6174d0 con 0x55b25f608940 2024-09-18T01:27:13.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.513+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94224592756464] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.513+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.513+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94224592760864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f6178f0 con 0x55b25f608940 2024-09-18T01:27:13.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.513+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f6182b0 con 0x55b25f611c90 2024-09-18T01:27:13.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.514+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f611c90 2024-09-18T01:27:13.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.514+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94224592764416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f618b00 con 0x55b25f611c90 2024-09-18T01:27:13.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.514+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f6195e0 con 0x55b25f60d100 2024-09-18T01:27:13.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.514+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94224592760864] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.515+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94224592764416] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f611c90 2024-09-18T01:27:13.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.515+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.515+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94224592766544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f6190f0 con 0x55b25f60d100 2024-09-18T01:27:13.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.515+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f61a020 con 0x55b25f608940 2024-09-18T01:27:13.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.516+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.516+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94224592771952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f61a440 con 0x55b25f608940 2024-09-18T01:27:13.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.517+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f61ae40 con 0x7fe0f406e020 2024-09-18T01:27:13.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.517+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94224592766544] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.518+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94224592771952] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.518+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.518+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94224592761920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f619f90 con 0x7fe0f406e020 2024-09-18T01:27:13.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.518+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f61b6e0 con 0x7fe0f406e020 2024-09-18T01:27:13.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.519+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(56 notify.6 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.519+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94224592761920] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.519+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94224592777600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f619f90 con 0x7fe0f406e020 2024-09-18T01:27:13.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.519+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f61bca0 con 0x7fe0f406e020 2024-09-18T01:27:13.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.520+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94224592777600] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.520+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.520+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94224592775504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f61bca0 con 0x7fe0f406e020 2024-09-18T01:27:13.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.520+0000 7fe105c13800 20 add_watcher() i=0 2024-09-18T01:27:13.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.520+0000 7fe105c13800 20 add_watcher() i=1 2024-09-18T01:27:13.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.520+0000 7fe105c13800 20 add_watcher() i=2 2024-09-18T01:27:13.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.520+0000 7fe105c13800 20 add_watcher() i=3 2024-09-18T01:27:13.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.520+0000 7fe105c13800 20 add_watcher() i=4 2024-09-18T01:27:13.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.520+0000 7fe105c13800 20 add_watcher() i=5 2024-09-18T01:27:13.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.520+0000 7fe105c13800 20 add_watcher() i=6 2024-09-18T01:27:13.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.521+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94224592775504] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.521+0000 7fe105c13800 20 add_watcher() i=7 2024-09-18T01:27:13.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.521+0000 7fe105c13800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:13.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.521+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f61f0c0 con 0x55b25f608940 2024-09-18T01:27:13.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.521+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.521+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94224592778656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f61c5c0 con 0x55b25f608940 2024-09-18T01:27:13.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.522+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94224592778656] v35'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.522+0000 7fdfb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:13.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.522+0000 7fe105c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:13.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.522+0000 7fe105c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:13.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.522+0000 7fe105c13800 5 note: GC not initialized 2024-09-18T01:27:13.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.523+0000 7fdfb67e4640 20 reqs_thread_entry: start 2024-09-18T01:27:13.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.523+0000 7fe105c13800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:13.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.523+0000 7fe105c13800 20 Filter name: none 2024-09-18T01:27:13.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.523+0000 7fdf27fff640 20 reqs_thread_entry: start 2024-09-18T01:27:13.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.523+0000 7fe105c13800 20 rados->read ofs=0 len=0 2024-09-18T01:27:13.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.523+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b25f652000 con 0x55b25f608940 2024-09-18T01:27:13.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.523+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.523+0000 7fe105c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:13.535 INFO:teuthology.orchestra.run.smithi100.stderr:could not fetch user info: no user info saved 2024-09-18T01:27:13.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.524+0000 7fdfb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:13.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.524+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94224592778656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f651fc0 con 0x55b25f608940 2024-09-18T01:27:13.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.525+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94224592778656] v35'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.525+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94224592756464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f64fdb0 con 0x55b25f60d100 2024-09-18T01:27:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.526+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94224592756464] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.526+0000 7fe105c13800 20 remove_watcher() i=0 2024-09-18T01:27:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.526+0000 7fe105c13800 2 removed watcher, disabling cache 2024-09-18T01:27:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.526+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94224592760864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f64fdb0 con 0x55b25f608940 2024-09-18T01:27:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.527+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94224592760864] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.527+0000 7fe105c13800 20 remove_watcher() i=1 2024-09-18T01:27:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.527+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94224592764416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f64fdb0 con 0x55b25f611c90 2024-09-18T01:27:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.528+0000 7fe0f8b2b640 1 -- 172.21.15.100:0/1840790771 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94224592764416] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0ec051070 con 0x55b25f611c90 2024-09-18T01:27:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.528+0000 7fe105c13800 20 remove_watcher() i=2 2024-09-18T01:27:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.528+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94224592766544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f651fc0 con 0x55b25f60d100 2024-09-18T01:27:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.529+0000 7fe10132c640 1 -- 172.21.15.100:0/1840790771 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94224592766544] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f4056040 con 0x55b25f60d100 2024-09-18T01:27:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.529+0000 7fe105c13800 20 remove_watcher() i=3 2024-09-18T01:27:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.529+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94224592771952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f651fc0 con 0x55b25f608940 2024-09-18T01:27:13.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.530+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94224592771952] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x55b25f608940 2024-09-18T01:27:13.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.530+0000 7fe105c13800 20 remove_watcher() i=4 2024-09-18T01:27:13.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.530+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94224592761920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f651fc0 con 0x7fe0f406e020 2024-09-18T01:27:13.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.531+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94224592761920] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.531+0000 7fe105c13800 20 remove_watcher() i=5 2024-09-18T01:27:13.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.531+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94224592777600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f651fc0 con 0x7fe0f406e020 2024-09-18T01:27:13.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.532+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94224592777600] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.532+0000 7fe105c13800 20 remove_watcher() i=6 2024-09-18T01:27:13.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.532+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94224592775504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b25f651fc0 con 0x7fe0f406e020 2024-09-18T01:27:13.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.533+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94224592775504] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0fc00a4a0 con 0x7fe0f406e020 2024-09-18T01:27:13.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.533+0000 7fe105c13800 20 remove_watcher() i=7 2024-09-18T01:27:13.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe0f406e020 msgr2=0x7fe0f404d500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fe0f406e020 0x7fe0f404d500 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b25f608940 msgr2=0x55b25f60ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b25f608940 0x55b25f60ae00 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b25f60d100 msgr2=0x55b25f60f4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b25f60d100 0x55b25f60f4f0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b25f611c90 msgr2=0x55b25f614130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55b25f611c90 0x55b25f614130 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfcc036b90 msgr2=0x7fdfcc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfcc036b90 0x7fdfcc039050 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55b25f5dbab0 tx=0x7fe0ec06b040 comp rx=0 tx=0).stop 2024-09-18T01:27:13.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5f6070 msgr2=0x55b25f5fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe101b2d640 1 -- 172.21.15.100:0/1840790771 reap_dead start 2024-09-18T01:27:13.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5f6070 0x55b25f5fd270 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4000fb0 tx=0x7fe0f4016f30 comp rx=0 tx=0).stop 2024-09-18T01:27:13.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 shutdown_connections 2024-09-18T01:27:13.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 --2- 172.21.15.100:0/1840790771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5f6070 0x55b25f5fd270 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 >> 172.21.15.100:0/1840790771 conn(0x55b25f5f2420 msgr2=0x55b25f5f04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 shutdown_connections 2024-09-18T01:27:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/1840790771 wait complete. 2024-09-18T01:27:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/3483145075 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfd8036b90 msgr2=0x7fdfd8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 --2- 172.21.15.100:0/3483145075 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfd8036b90 0x7fdfd8039050 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55b25f4d1b80 tx=0x7fe0ec005a00 comp rx=0 tx=0).stop 2024-09-18T01:27:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/3483145075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5e9460 msgr2=0x55b25f5e9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 --2- 172.21.15.100:0/3483145075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5e9460 0x55b25f5e9880 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe0f404b740 tx=0x7fe0f400fe50 comp rx=0 tx=0).stop 2024-09-18T01:27:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/3483145075 shutdown_connections 2024-09-18T01:27:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 --2- 172.21.15.100:0/3483145075 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfd8036b90 0x7fdfd8039050 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 --2- 172.21.15.100:0/3483145075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f5e9460 0x55b25f5e9880 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/3483145075 >> 172.21.15.100:0/3483145075 conn(0x55b25f5de3f0 msgr2=0x55b25f5e0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/3483145075 shutdown_connections 2024-09-18T01:27:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.534+0000 7fe105c13800 1 -- 172.21.15.100:0/3483145075 wait complete. 2024-09-18T01:27:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b25f5d8bc0 msgr2=0x55b25f5dafb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe105c13800 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55b25f5d8bc0 0x55b25f5dafb0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b25f4d6970 msgr2=0x55b25f5d24a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe105c13800 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55b25f4d6970 0x55b25f5d24a0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b25f5d4b40 msgr2=0x55b25f5d6fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe105c13800 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55b25f5d4b40 0x55b25f5d6fd0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfe8036b90 msgr2=0x7fdfe8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe105c13800 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fdfe8036b90 0x7fdfe8039050 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec057000 tx=0x7fe0ec052000 comp rx=0 tx=0).stop 2024-09-18T01:27:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f446630 msgr2=0x55b25f4d2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe105c13800 1 --2- 172.21.15.100:0/3576424818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b25f446630 0x55b25f4d2b80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4000f60 tx=0x7fe0f4000ed0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe101b2d640 1 -- 172.21.15.100:0/3576424818 reap_dead start 2024-09-18T01:27:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 shutdown_connections 2024-09-18T01:27:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 >> 172.21.15.100:0/3576424818 conn(0x55b25f4ccde0 msgr2=0x55b25f5bb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 shutdown_connections 2024-09-18T01:27:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.535+0000 7fe105c13800 1 -- 172.21.15.100:0/3576424818 wait complete. 2024-09-18T01:27:13.548 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T01:27:13.549 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-18T01:27:13.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-18T01:27:13.549 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-18T01:27:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.592+0000 7f5d5192e800 1 Processor -- start 2024-09-18T01:27:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.592+0000 7f5d5192e800 1 -- start start 2024-09-18T01:27:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.592+0000 7f5d5192e800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5618144676e0 0x5618144f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.592+0000 7f5d5192e800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5618143b2b30 con 0x5618144f8bf0 2024-09-18T01:27:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.592+0000 7f5d5192e800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x561814394360 con 0x5618144676e0 2024-09-18T01:27:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.593+0000 7f5d4d680640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5618144676e0 0x5618144f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.593+0000 7f5d47fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5618144f8bf0 0x5618144fafe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37116/0 (socket says 172.21.15.100:37116) 2024-09-18T01:27:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.593+0000 7f5d47fff640 1 -- 172.21.15.100:0/3631288072 learned_addr learned my addr 172.21.15.100:0/3631288072 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.593+0000 7f5d4d680640 1 -- 172.21.15.100:0/3631288072 >> v1:172.21.15.92:6789/0 conn(0x5618144f8bf0 legacy=0x5618144fafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.593+0000 7f5d4d680640 1 -- 172.21.15.100:0/3631288072 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618143bae00 con 0x5618144676e0 2024-09-18T01:27:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.593+0000 7f5d4ce7f640 1 -- 172.21.15.100:0/3631288072 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2977774737 0 0) 0x5618143b2b30 con 0x5618144f8bf0 2024-09-18T01:27:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.595+0000 7f5d4d680640 1 --2- 172.21.15.100:0/3631288072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618144f86b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000a470 tx=0x7f5d40045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba30065e652ad7c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.595+0000 7f5d4ce7f640 1 -- 172.21.15.100:0/3631288072 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d40053570 con 0x5618144676e0 2024-09-18T01:27:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.595+0000 7f5d4ce7f640 1 -- 172.21.15.100:0/3631288072 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d40058070 con 0x5618144676e0 2024-09-18T01:27:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.595+0000 7f5d4ce7f640 1 -- 172.21.15.100:0/3631288072 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d40053880 con 0x5618144676e0 2024-09-18T01:27:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.595+0000 7f5d5192e800 1 -- 172.21.15.100:0/3631288072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 msgr2=0x5618144f86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.595+0000 7f5d5192e800 1 --2- 172.21.15.100:0/3631288072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618144f86b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000a470 tx=0x7f5d40045a20 comp rx=0 tx=0).stop 2024-09-18T01:27:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.595+0000 7f5d5192e800 1 -- 172.21.15.100:0/3631288072 shutdown_connections 2024-09-18T01:27:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.595+0000 7f5d5192e800 1 --2- 172.21.15.100:0/3631288072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618144f86b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.595+0000 7f5d5192e800 1 -- 172.21.15.100:0/3631288072 >> 172.21.15.100:0/3631288072 conn(0x5618144ede20 msgr2=0x5618144f0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.595+0000 7f5d5192e800 1 -- 172.21.15.100:0/3631288072 shutdown_connections 2024-09-18T01:27:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.595+0000 7f5d5192e800 1 -- 172.21.15.100:0/3631288072 wait complete. 2024-09-18T01:27:13.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.609+0000 7f5d5192e800 1 Processor -- start 2024-09-18T01:27:13.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.609+0000 7f5d5192e800 1 -- start start 2024-09-18T01:27:13.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.609+0000 7f5d5192e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618145e4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.609+0000 7f5d5192e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56181443f330 con 0x5618144676e0 2024-09-18T01:27:13.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.609+0000 7f5d4d680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618145e4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.609+0000 7f5d4d680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618145e4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45082/0 (socket says 172.21.15.100:45082) 2024-09-18T01:27:13.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.609+0000 7f5d4d680640 1 -- 172.21.15.100:0/3348522182 learned_addr learned my addr 172.21.15.100:0/3348522182 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.610+0000 7f5d4d680640 1 -- 172.21.15.100:0/3348522182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56181438cbc0 con 0x5618144676e0 2024-09-18T01:27:13.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.610+0000 7f5d4d680640 1 --2- 172.21.15.100:0/3348522182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618145e4970 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5d40005870 tx=0x7f5d40051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d07acf951bc0c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.610+0000 7f5c3b606640 1 -- 172.21.15.100:0/3348522182 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d4005c580 con 0x5618144676e0 2024-09-18T01:27:13.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.610+0000 7f5c3b606640 1 -- 172.21.15.100:0/3348522182 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d40063030 con 0x5618144676e0 2024-09-18T01:27:13.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.610+0000 7f5c3b606640 1 -- 172.21.15.100:0/3348522182 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d4005c850 con 0x5618144676e0 2024-09-18T01:27:13.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.611+0000 7f5d5192e800 1 -- 172.21.15.100:0/3348522182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 msgr2=0x5618145e4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.611+0000 7f5d5192e800 1 --2- 172.21.15.100:0/3348522182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618145e4970 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5d40005870 tx=0x7f5d40051000 comp rx=0 tx=0).stop 2024-09-18T01:27:13.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.611+0000 7f5d5192e800 1 -- 172.21.15.100:0/3348522182 shutdown_connections 2024-09-18T01:27:13.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.611+0000 7f5d5192e800 1 --2- 172.21.15.100:0/3348522182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618145e4970 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.611+0000 7f5d5192e800 1 -- 172.21.15.100:0/3348522182 >> 172.21.15.100:0/3348522182 conn(0x5618144ede20 msgr2=0x5618145e0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.611+0000 7f5d5192e800 1 -- 172.21.15.100:0/3348522182 shutdown_connections 2024-09-18T01:27:13.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.611+0000 7f5d5192e800 1 -- 172.21.15.100:0/3348522182 wait complete. 2024-09-18T01:27:13.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.611+0000 7f5d5192e800 1 Processor -- start 2024-09-18T01:27:13.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.611+0000 7f5d5192e800 1 -- start start 2024-09-18T01:27:13.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.611+0000 7f5d5192e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618145ec270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.611+0000 7f5d5192e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618144fc9a0 con 0x5618144676e0 2024-09-18T01:27:13.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.611+0000 7f5d4d680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618145ec270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.611+0000 7f5d4d680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618145ec270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45096/0 (socket says 172.21.15.100:45096) 2024-09-18T01:27:13.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.611+0000 7f5d4d680640 1 -- 172.21.15.100:0/4167212913 learned_addr learned my addr 172.21.15.100:0/4167212913 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.612+0000 7f5d4d680640 1 -- 172.21.15.100:0/4167212913 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618143a0fe0 con 0x5618144676e0 2024-09-18T01:27:13.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.612+0000 7f5d4d680640 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618145ec270 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5d40045f50 tx=0x7f5d40002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.612+0000 7f5c39e03640 1 -- 172.21.15.100:0/4167212913 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d40078070 con 0x5618144676e0 2024-09-18T01:27:13.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.612+0000 7f5c39e03640 1 -- 172.21.15.100:0/4167212913 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d40054a70 con 0x5618144676e0 2024-09-18T01:27:13.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.612+0000 7f5c39e03640 1 -- 172.21.15.100:0/4167212913 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d40054d50 con 0x5618144676e0 2024-09-18T01:27:13.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.612+0000 7f5d5192e800 1 -- 172.21.15.100:0/4167212913 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618145ec7b0 con 0x5618144676e0 2024-09-18T01:27:13.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.612+0000 7f5d5192e800 1 -- 172.21.15.100:0/4167212913 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618145ecd30 con 0x5618144676e0 2024-09-18T01:27:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.613+0000 7f5d5192e800 1 Processor -- start 2024-09-18T01:27:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.613+0000 7f5d5192e800 1 -- start start 2024-09-18T01:27:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.613+0000 7f5c39e03640 1 -- 172.21.15.100:0/4167212913 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5d4007b070 con 0x5618144676e0 2024-09-18T01:27:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.613+0000 7f5d5192e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618145f90e0 0x5618145f94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.613+0000 7f5d5192e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56181438e580 con 0x5618145f90e0 2024-09-18T01:27:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.613+0000 7f5c39e03640 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5c34036b40 0x7f5c34039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.613+0000 7f5c39e03640 1 -- 172.21.15.100:0/4167212913 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f5d40070070 con 0x5618144676e0 2024-09-18T01:27:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.613+0000 7f5d4de81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618145f90e0 0x5618145f94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.613+0000 7f5d4d680640 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5c34036b40 0x7f5c34039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.613+0000 7f5d4de81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618145f90e0 0x5618145f94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45106/0 (socket says 172.21.15.100:45106) 2024-09-18T01:27:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.613+0000 7f5d4de81640 1 -- 172.21.15.100:0/3683802265 learned_addr learned my addr 172.21.15.100:0/3683802265 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.613+0000 7f5d4de81640 1 -- 172.21.15.100:0/3683802265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618145f9a20 con 0x5618145f90e0 2024-09-18T01:27:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.614+0000 7f5d4d680640 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5c34036b40 0x7f5c34039000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5d40054850 tx=0x7f5d40054f70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.614+0000 7f5d4de81640 1 --2- 172.21.15.100:0/3683802265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618145f90e0 0x5618145f94e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800a430 tx=0x7f5d4800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be125215d14fcc84 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.614+0000 7f5c337fe640 1 -- 172.21.15.100:0/3683802265 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d48015070 con 0x5618145f90e0 2024-09-18T01:27:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.614+0000 7f5c337fe640 1 -- 172.21.15.100:0/3683802265 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d48001670 con 0x5618145f90e0 2024-09-18T01:27:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.614+0000 7f5c337fe640 1 -- 172.21.15.100:0/3683802265 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d48001990 con 0x5618145f90e0 2024-09-18T01:27:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.614+0000 7f5d5192e800 1 -- 172.21.15.100:0/3683802265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618145f90e0 msgr2=0x5618145f94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.614+0000 7f5d5192e800 1 --2- 172.21.15.100:0/3683802265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618145f90e0 0x5618145f94e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800a430 tx=0x7f5d4800a8f0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.614+0000 7f5d5192e800 1 -- 172.21.15.100:0/3683802265 shutdown_connections 2024-09-18T01:27:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.614+0000 7f5d5192e800 1 --2- 172.21.15.100:0/3683802265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618145f90e0 0x5618145f94e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.614+0000 7f5d5192e800 1 -- 172.21.15.100:0/3683802265 >> 172.21.15.100:0/3683802265 conn(0x5618144f8bf0 msgr2=0x5618145f4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.614+0000 7f5d5192e800 1 -- 172.21.15.100:0/3683802265 shutdown_connections 2024-09-18T01:27:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.614+0000 7f5d5192e800 1 -- 172.21.15.100:0/3683802265 wait complete. 2024-09-18T01:27:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.615+0000 7f5d5192e800 1 Processor -- start 2024-09-18T01:27:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.615+0000 7f5d5192e800 1 -- start start 2024-09-18T01:27:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.615+0000 7f5d5192e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618145f90e0 0x561814600700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.615+0000 7f5d5192e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618145fa3d0 con 0x5618145f90e0 2024-09-18T01:27:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.615+0000 7f5d4de81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618145f90e0 0x561814600700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.615+0000 7f5d4de81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618145f90e0 0x561814600700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45110/0 (socket says 172.21.15.100:45110) 2024-09-18T01:27:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.615+0000 7f5d4de81640 1 -- 172.21.15.100:0/126445811 learned_addr learned my addr 172.21.15.100:0/126445811 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.615+0000 7f5d4de81640 1 -- 172.21.15.100:0/126445811 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561814600c40 con 0x5618145f90e0 2024-09-18T01:27:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.615+0000 7f5d4de81640 1 --2- 172.21.15.100:0/126445811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618145f90e0 0x561814600700 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800a930 tx=0x7f5d48003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.615+0000 7f5c31ffb640 1 -- 172.21.15.100:0/126445811 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d48020020 con 0x5618145f90e0 2024-09-18T01:27:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.615+0000 7f5c31ffb640 1 -- 172.21.15.100:0/126445811 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d480108b0 con 0x5618145f90e0 2024-09-18T01:27:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.615+0000 7f5d5192e800 1 -- 172.21.15.100:0/126445811 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561814600ed0 con 0x5618145f90e0 2024-09-18T01:27:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.616+0000 7f5c31ffb640 1 -- 172.21.15.100:0/126445811 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d48015040 con 0x5618145f90e0 2024-09-18T01:27:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.616+0000 7f5d5192e800 1 -- 172.21.15.100:0/126445811 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561814603b80 con 0x5618145f90e0 2024-09-18T01:27:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.616+0000 7f5c31ffb640 1 -- 172.21.15.100:0/126445811 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5d48023020 con 0x5618145f90e0 2024-09-18T01:27:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.617+0000 7f5c31ffb640 1 --2- 172.21.15.100:0/126445811 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5c28036b90 0x7f5c28039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.617+0000 7f5c31ffb640 1 -- 172.21.15.100:0/126445811 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f5d4804c2e0 con 0x5618145f90e0 2024-09-18T01:27:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.617+0000 7f5d47fff640 1 --2- 172.21.15.100:0/126445811 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5c28036b90 0x7f5c28039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.617+0000 7f5d5192e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.617+0000 7f5d5192e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.617+0000 7f5d47fff640 1 --2- 172.21.15.100:0/126445811 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5c28036b90 0x7f5c28039050 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5d38000c00 tx=0x7f5d38001330 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.617+0000 7f5d5192e800 1 Processor -- start 2024-09-18T01:27:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.617+0000 7f5d5192e800 1 -- start start 2024-09-18T01:27:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.617+0000 7f5d5192e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56181461a6d0 0x56181461aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.617+0000 7f5d5192e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618145e50c0 con 0x56181461a6d0 2024-09-18T01:27:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.618+0000 7f5d4d680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56181461a6d0 0x56181461aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.618+0000 7f5d4d680640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56181461a6d0 0x56181461aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45114/0 (socket says 172.21.15.100:45114) 2024-09-18T01:27:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.618+0000 7f5d4d680640 1 -- 172.21.15.100:0/11299970 learned_addr learned my addr 172.21.15.100:0/11299970 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.618+0000 7f5d4d680640 1 -- 172.21.15.100:0/11299970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56181461b0c0 con 0x56181461a6d0 2024-09-18T01:27:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.618+0000 7f5d4d680640 1 --2- 172.21.15.100:0/11299970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56181461a6d0 0x56181461aaf0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5d40054800 tx=0x7f5d4005eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.618+0000 7f5c127e4640 1 -- 172.21.15.100:0/11299970 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d40009b60 con 0x56181461a6d0 2024-09-18T01:27:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.618+0000 7f5c127e4640 1 -- 172.21.15.100:0/11299970 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d40094070 con 0x56181461a6d0 2024-09-18T01:27:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.618+0000 7f5c127e4640 1 -- 172.21.15.100:0/11299970 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d40068cc0 con 0x56181461a6d0 2024-09-18T01:27:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.618+0000 7f5d5192e800 1 -- 172.21.15.100:0/11299970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56181461dd10 con 0x56181461a6d0 2024-09-18T01:27:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.618+0000 7f5d5192e800 1 -- 172.21.15.100:0/11299970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56181461e0f0 con 0x56181461a6d0 2024-09-18T01:27:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.619+0000 7f5c127e4640 1 -- 172.21.15.100:0/11299970 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5d4007a4a0 con 0x56181461a6d0 2024-09-18T01:27:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.619+0000 7f5c127e4640 1 --2- 172.21.15.100:0/11299970 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5b84036b90 0x7f5b84039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.619+0000 7f5c127e4640 1 -- 172.21.15.100:0/11299970 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f5d400830d0 con 0x56181461a6d0 2024-09-18T01:27:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.619+0000 7f5d47fff640 1 --2- 172.21.15.100:0/11299970 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5b84036b90 0x7f5b84039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.620+0000 7f5c0bfff640 20 reqs_thread_entry: start 2024-09-18T01:27:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.620+0000 7f5d47fff640 1 --2- 172.21.15.100:0/11299970 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5b84036b90 0x7f5b84039050 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5d38000f60 tx=0x7f5d38006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.620+0000 7f5d5192e800 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618146280d0 0x56181462a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.620+0000 7f5d5192e800 1 -- 172.21.15.100:0/4167212913 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56181462ac10 con 0x5618146280d0 2024-09-18T01:27:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.620+0000 7f5d4de81640 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618146280d0 0x56181462a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.620+0000 7f5d4de81640 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618146280d0 0x56181462a540 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.620+0000 7f5d4de81640 1 -- 172.21.15.100:0/4167212913 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d48010d70 con 0x5618146280d0 2024-09-18T01:27:13.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.620+0000 7f5d5192e800 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56181462ca30 0x56181462ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.620+0000 7f5d5192e800 1 -- 172.21.15.100:0/4167212913 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:2 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56181462f430 con 0x56181462ca30 2024-09-18T01:27:13.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.621+0000 7f5d4d680640 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56181462ca30 0x56181462ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.621+0000 7f5d4d680640 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56181462ca30 0x56181462ee20 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.621+0000 7f5d4d680640 1 -- 172.21.15.100:0/4167212913 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(2 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d4007a030 con 0x56181462ca30 2024-09-18T01:27:13.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 -- 172.21.15.100:0/126445811 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5c28036b90 msgr2=0x7f5c28039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 --2- 172.21.15.100:0/126445811 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5c28036b90 0x7f5c28039050 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5d38000c00 tx=0x7f5d38001330 comp rx=0 tx=0).stop 2024-09-18T01:27:13.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 -- 172.21.15.100:0/126445811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618145f90e0 msgr2=0x561814600700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 --2- 172.21.15.100:0/126445811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618145f90e0 0x561814600700 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800a930 tx=0x7f5d48003370 comp rx=0 tx=0).stop 2024-09-18T01:27:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 -- 172.21.15.100:0/126445811 shutdown_connections 2024-09-18T01:27:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 --2- 172.21.15.100:0/126445811 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5c28036b90 0x7f5c28039050 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 --2- 172.21.15.100:0/126445811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618145f90e0 0x561814600700 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 -- 172.21.15.100:0/126445811 >> 172.21.15.100:0/126445811 conn(0x5618144f8bf0 msgr2=0x5618145f4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 -- 172.21.15.100:0/126445811 shutdown_connections 2024-09-18T01:27:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 -- 172.21.15.100:0/126445811 wait complete. 2024-09-18T01:27:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 -- 172.21.15.100:0/11299970 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5b84036b90 msgr2=0x7f5b84039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 --2- 172.21.15.100:0/11299970 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5b84036b90 0x7f5b84039050 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5d38000f60 tx=0x7f5d38006000 comp rx=0 tx=0).stop 2024-09-18T01:27:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 -- 172.21.15.100:0/11299970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56181461a6d0 msgr2=0x56181461aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 --2- 172.21.15.100:0/11299970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56181461a6d0 0x56181461aaf0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5d40054800 tx=0x7f5d4005eea0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 -- 172.21.15.100:0/11299970 shutdown_connections 2024-09-18T01:27:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 --2- 172.21.15.100:0/11299970 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5b84036b90 0x7f5b84039050 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 --2- 172.21.15.100:0/11299970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56181461a6d0 0x56181461aaf0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 -- 172.21.15.100:0/11299970 >> 172.21.15.100:0/11299970 conn(0x56181460f5e0 msgr2=0x561814611f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 -- 172.21.15.100:0/11299970 shutdown_connections 2024-09-18T01:27:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.622+0000 7f5d5192e800 1 -- 172.21.15.100:0/11299970 wait complete. 2024-09-18T01:27:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 -- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618146280d0 msgr2=0x56181462a540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618146280d0 0x56181462a540 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 -- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56181462ca30 msgr2=0x56181462ee20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56181462ca30 0x56181462ee20 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 -- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5c34036b40 msgr2=0x7f5c34039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5c34036b40 0x7f5c34039000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5d40054850 tx=0x7f5d40054f70 comp rx=0 tx=0).stop 2024-09-18T01:27:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 -- 172.21.15.100:0/4167212913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 msgr2=0x5618145ec270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618145ec270 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5d40045f50 tx=0x7f5d40002fb0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 -- 172.21.15.100:0/4167212913 shutdown_connections 2024-09-18T01:27:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56181462ca30 0x56181462ee20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5618146280d0 0x56181462a540 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5c34036b40 0x7f5c34039000 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 --2- 172.21.15.100:0/4167212913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618144676e0 0x5618145ec270 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 -- 172.21.15.100:0/4167212913 >> 172.21.15.100:0/4167212913 conn(0x5618144ede20 msgr2=0x5618145debc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 -- 172.21.15.100:0/4167212913 shutdown_connections 2024-09-18T01:27:13.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.623+0000 7f5d5192e800 1 -- 172.21.15.100:0/4167212913 wait complete. 2024-09-18T01:27:13.633 INFO:teuthology.orchestra.run.smithi100.stdout:{"id":"153b7754-209b-4898-8796-577da7c1273d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-18T01:27:13.633 DEBUG:tasks.util.rgw: json result: {'id': '153b7754-209b-4898-8796-577da7c1273d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-18T01:27:13.634 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-18T01:27:13.634 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-18T01:27:13.634 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-18T01:27:13.716 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:13.716 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:13.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.716+0000 7f350cd39800 1 Processor -- start 2024-09-18T01:27:13.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.716+0000 7f350cd39800 1 -- start start 2024-09-18T01:27:13.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.716+0000 7f350cd39800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560fe7a8b980 0x560fe7a8dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.716+0000 7f350cd39800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560fe7947b30 con 0x560fe7a87540 2024-09-18T01:27:13.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.716+0000 7f350cd39800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x560fe7929360 con 0x560fe7a8b980 2024-09-18T01:27:13.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.717+0000 7f35081d0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560fe7a8b980 0x560fe7a8dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.717+0000 7f35089d1640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x560fe7a87540 0x560fe7a87940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37120/0 (socket says 172.21.15.100:37120) 2024-09-18T01:27:13.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.717+0000 7f35089d1640 1 -- 172.21.15.100:0/2556961889 learned_addr learned my addr 172.21.15.100:0/2556961889 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:13.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.717+0000 7f35081d0640 1 -- 172.21.15.100:0/2556961889 >> v1:172.21.15.92:6789/0 conn(0x560fe7a87540 legacy=0x560fe7a87940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.717+0000 7f35081d0640 1 -- 172.21.15.100:0/2556961889 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fe794fe00 con 0x560fe7a8b980 2024-09-18T01:27:13.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.719+0000 7f35081d0640 1 --2- 172.21.15.100:0/2556961889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a8b980 0x560fe7a8dd70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00a470 tx=0x7f34fc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a379c0ad0eccede2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.719+0000 7f35079cf640 1 -- 172.21.15.100:0/2556961889 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34fc053570 con 0x560fe7a8b980 2024-09-18T01:27:13.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.719+0000 7f35079cf640 1 -- 172.21.15.100:0/2556961889 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34fc058070 con 0x560fe7a8b980 2024-09-18T01:27:13.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.719+0000 7f35079cf640 1 -- 172.21.15.100:0/2556961889 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34fc053880 con 0x560fe7a8b980 2024-09-18T01:27:13.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.719+0000 7f350cd39800 1 -- 172.21.15.100:0/2556961889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a8b980 msgr2=0x560fe7a8dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.719+0000 7f350cd39800 1 --2- 172.21.15.100:0/2556961889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a8b980 0x560fe7a8dd70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00a470 tx=0x7f34fc045a20 comp rx=0 tx=0).stop 2024-09-18T01:27:13.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.719+0000 7f350cd39800 1 -- 172.21.15.100:0/2556961889 shutdown_connections 2024-09-18T01:27:13.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.719+0000 7f350cd39800 1 --2- 172.21.15.100:0/2556961889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a8b980 0x560fe7a8dd70 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.719+0000 7f350cd39800 1 -- 172.21.15.100:0/2556961889 >> 172.21.15.100:0/2556961889 conn(0x560fe7a82dd0 msgr2=0x560fe7a851f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.719+0000 7f350cd39800 1 -- 172.21.15.100:0/2556961889 shutdown_connections 2024-09-18T01:27:13.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.719+0000 7f350cd39800 1 -- 172.21.15.100:0/2556961889 wait complete. 2024-09-18T01:27:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.733+0000 7f350cd39800 1 Processor -- start 2024-09-18T01:27:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.733+0000 7f350cd39800 1 -- start start 2024-09-18T01:27:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.733+0000 7f350cd39800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a87540 0x560fe7b76770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.733+0000 7f350cd39800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560fe79d4320 con 0x560fe7a87540 2024-09-18T01:27:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.733+0000 7f35089d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a87540 0x560fe7b76770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.733+0000 7f35089d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a87540 0x560fe7b76770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45124/0 (socket says 172.21.15.100:45124) 2024-09-18T01:27:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.733+0000 7f35089d1640 1 -- 172.21.15.100:0/181350380 learned_addr learned my addr 172.21.15.100:0/181350380 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.733+0000 7f35089d1640 1 -- 172.21.15.100:0/181350380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fe7921bc0 con 0x560fe7a87540 2024-09-18T01:27:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.734+0000 7f35089d1640 1 --2- 172.21.15.100:0/181350380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a87540 0x560fe7b76770 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f34f800d540 tx=0x7f34f800da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7ea71f6a21cf90 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.734+0000 7f33f6e0d640 1 -- 172.21.15.100:0/181350380 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f8014070 con 0x560fe7a87540 2024-09-18T01:27:13.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.734+0000 7f33f6e0d640 1 -- 172.21.15.100:0/181350380 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f80063b0 con 0x560fe7a87540 2024-09-18T01:27:13.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.734+0000 7f33f6e0d640 1 -- 172.21.15.100:0/181350380 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f8004650 con 0x560fe7a87540 2024-09-18T01:27:13.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.734+0000 7f350cd39800 1 -- 172.21.15.100:0/181350380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a87540 msgr2=0x560fe7b76770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.734+0000 7f350cd39800 1 --2- 172.21.15.100:0/181350380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a87540 0x560fe7b76770 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f34f800d540 tx=0x7f34f800da00 comp rx=0 tx=0).stop 2024-09-18T01:27:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.734+0000 7f350cd39800 1 -- 172.21.15.100:0/181350380 shutdown_connections 2024-09-18T01:27:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.734+0000 7f350cd39800 1 --2- 172.21.15.100:0/181350380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a87540 0x560fe7b76770 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.734+0000 7f350cd39800 1 -- 172.21.15.100:0/181350380 >> 172.21.15.100:0/181350380 conn(0x560fe7a82dd0 msgr2=0x560fe7b72130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.734+0000 7f350cd39800 1 -- 172.21.15.100:0/181350380 shutdown_connections 2024-09-18T01:27:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.735+0000 7f350cd39800 1 -- 172.21.15.100:0/181350380 wait complete. 2024-09-18T01:27:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.735+0000 7f350cd39800 1 Processor -- start 2024-09-18T01:27:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.735+0000 7f350cd39800 1 -- start start 2024-09-18T01:27:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.735+0000 7f350cd39800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a87540 0x560fe7b7d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.735+0000 7f350cd39800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560fe7a8e5b0 con 0x560fe7a87540 2024-09-18T01:27:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.735+0000 7f35089d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a87540 0x560fe7b7d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.735+0000 7f35089d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a87540 0x560fe7b7d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45128/0 (socket says 172.21.15.100:45128) 2024-09-18T01:27:13.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.735+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 learned_addr learned my addr 172.21.15.100:0/3766768980 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.735+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fe7935fe0 con 0x560fe7a87540 2024-09-18T01:27:13.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.736+0000 7f35089d1640 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a87540 0x560fe7b7d040 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f34f8001350 tx=0x7f34f8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.736+0000 7f33f560a640 1 -- 172.21.15.100:0/3766768980 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f802a070 con 0x560fe7a87540 2024-09-18T01:27:13.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.736+0000 7f33f560a640 1 -- 172.21.15.100:0/3766768980 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f800b830 con 0x560fe7a87540 2024-09-18T01:27:13.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.736+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560fe7b7d580 con 0x560fe7a87540 2024-09-18T01:27:13.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.736+0000 7f33f560a640 1 -- 172.21.15.100:0/3766768980 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f800bb50 con 0x560fe7a87540 2024-09-18T01:27:13.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.736+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fe7b7daa0 con 0x560fe7a87540 2024-09-18T01:27:13.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.736+0000 7f350cd39800 1 Processor -- start 2024-09-18T01:27:13.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f350cd39800 1 -- start start 2024-09-18T01:27:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f33f560a640 1 -- 172.21.15.100:0/3766768980 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f34f802d070 con 0x560fe7a87540 2024-09-18T01:27:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f350cd39800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7b8e1c0 0x560fe7b8e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f350cd39800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560fe7923580 con 0x560fe7b8e1c0 2024-09-18T01:27:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f33f560a640 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f33f0036b40 0x7f33f0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f33f560a640 1 -- 172.21.15.100:0/3766768980 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f34f80089b0 con 0x560fe7a87540 2024-09-18T01:27:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f35089d1640 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f33f0036b40 0x7f33f0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f35091d2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7b8e1c0 0x560fe7b8e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f35091d2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7b8e1c0 0x560fe7b8e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45134/0 (socket says 172.21.15.100:45134) 2024-09-18T01:27:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f35091d2640 1 -- 172.21.15.100:0/978174787 learned_addr learned my addr 172.21.15.100:0/978174787 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f35091d2640 1 -- 172.21.15.100:0/978174787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fe7b8eb00 con 0x560fe7b8e1c0 2024-09-18T01:27:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f35089d1640 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f33f0036b40 0x7f33f0039000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f34f800ff90 tx=0x7f34f800bdf0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f35091d2640 1 --2- 172.21.15.100:0/978174787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7b8e1c0 0x560fe7b8e5c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f350000a400 tx=0x7f350000a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f57c50bd936780c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f33eeffd640 1 -- 172.21.15.100:0/978174787 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35000087e0 con 0x560fe7b8e1c0 2024-09-18T01:27:13.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.737+0000 7f33eeffd640 1 -- 172.21.15.100:0/978174787 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35000089a0 con 0x560fe7b8e1c0 2024-09-18T01:27:13.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.738+0000 7f33eeffd640 1 -- 172.21.15.100:0/978174787 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3500008d00 con 0x560fe7b8e1c0 2024-09-18T01:27:13.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.738+0000 7f350cd39800 1 -- 172.21.15.100:0/978174787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7b8e1c0 msgr2=0x560fe7b8e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.738+0000 7f350cd39800 1 --2- 172.21.15.100:0/978174787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7b8e1c0 0x560fe7b8e5c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f350000a400 tx=0x7f350000a8c0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.738+0000 7f350cd39800 1 -- 172.21.15.100:0/978174787 shutdown_connections 2024-09-18T01:27:13.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.738+0000 7f350cd39800 1 --2- 172.21.15.100:0/978174787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7b8e1c0 0x560fe7b8e5c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.738+0000 7f350cd39800 1 -- 172.21.15.100:0/978174787 >> 172.21.15.100:0/978174787 conn(0x560fe7a8b980 msgr2=0x560fe7b85530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.738+0000 7f350cd39800 1 -- 172.21.15.100:0/978174787 shutdown_connections 2024-09-18T01:27:13.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.738+0000 7f350cd39800 1 -- 172.21.15.100:0/978174787 wait complete. 2024-09-18T01:27:13.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.738+0000 7f350cd39800 1 Processor -- start 2024-09-18T01:27:13.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.738+0000 7f350cd39800 1 -- start start 2024-09-18T01:27:13.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.738+0000 7f350cd39800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7b8e1c0 0x560fe7b958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.738+0000 7f350cd39800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560fe7b8f4b0 con 0x560fe7b8e1c0 2024-09-18T01:27:13.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.739+0000 7f35091d2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7b8e1c0 0x560fe7b958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.739+0000 7f35091d2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7b8e1c0 0x560fe7b958b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45136/0 (socket says 172.21.15.100:45136) 2024-09-18T01:27:13.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.739+0000 7f35091d2640 1 -- 172.21.15.100:0/3303130025 learned_addr learned my addr 172.21.15.100:0/3303130025 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.739+0000 7f35091d2640 1 -- 172.21.15.100:0/3303130025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fe7b95df0 con 0x560fe7b8e1c0 2024-09-18T01:27:13.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.739+0000 7f35091d2640 1 --2- 172.21.15.100:0/3303130025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7b8e1c0 0x560fe7b958b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x560fe7b8ef40 tx=0x7f3500002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.739+0000 7f33ed7fa640 1 -- 172.21.15.100:0/3303130025 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3500022020 con 0x560fe7b8e1c0 2024-09-18T01:27:13.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.739+0000 7f33ed7fa640 1 -- 172.21.15.100:0/3303130025 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3500019040 con 0x560fe7b8e1c0 2024-09-18T01:27:13.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.739+0000 7f350cd39800 1 -- 172.21.15.100:0/3303130025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560fe7b96080 con 0x560fe7b8e1c0 2024-09-18T01:27:13.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.739+0000 7f33ed7fa640 1 -- 172.21.15.100:0/3303130025 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3500013950 con 0x560fe7b8e1c0 2024-09-18T01:27:13.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.739+0000 7f350cd39800 1 -- 172.21.15.100:0/3303130025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fe7b98d30 con 0x560fe7b8e1c0 2024-09-18T01:27:13.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.740+0000 7f33ed7fa640 1 -- 172.21.15.100:0/3303130025 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3500025020 con 0x560fe7b8e1c0 2024-09-18T01:27:13.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.740+0000 7f33ed7fa640 1 --2- 172.21.15.100:0/3303130025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f33e0036b90 0x7f33e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.740+0000 7f33ed7fa640 1 -- 172.21.15.100:0/3303130025 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f350004c6c0 con 0x560fe7b8e1c0 2024-09-18T01:27:13.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.740+0000 7f35081d0640 1 --2- 172.21.15.100:0/3303130025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f33e0036b90 0x7f33e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.741+0000 7f350cd39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:13.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.741+0000 7f350cd39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:13.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.741+0000 7f35081d0640 1 --2- 172.21.15.100:0/3303130025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f33e0036b90 0x7f33e0039050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f34fc057000 tx=0x7f34fc052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.741+0000 7f350cd39800 1 Processor -- start 2024-09-18T01:27:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.741+0000 7f350cd39800 1 -- start start 2024-09-18T01:27:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.741+0000 7f350cd39800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7baf7a0 0x560fe7bafbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.741+0000 7f350cd39800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560fe7b76f20 con 0x560fe7baf7a0 2024-09-18T01:27:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.742+0000 7f35089d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7baf7a0 0x560fe7bafbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.742+0000 7f35089d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7baf7a0 0x560fe7bafbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45144/0 (socket says 172.21.15.100:45144) 2024-09-18T01:27:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.742+0000 7f35089d1640 1 -- 172.21.15.100:0/555298966 learned_addr learned my addr 172.21.15.100:0/555298966 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.742+0000 7f35089d1640 1 -- 172.21.15.100:0/555298966 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fe7bb0190 con 0x560fe7baf7a0 2024-09-18T01:27:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.742+0000 7f35089d1640 1 --2- 172.21.15.100:0/555298966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7baf7a0 0x560fe7bafbc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f34f804cbe0 tx=0x7f34f802d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.742+0000 7f33cd7e2640 1 -- 172.21.15.100:0/555298966 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f804c070 con 0x560fe7baf7a0 2024-09-18T01:27:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.742+0000 7f33cd7e2640 1 -- 172.21.15.100:0/555298966 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f802e840 con 0x560fe7baf7a0 2024-09-18T01:27:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.742+0000 7f350cd39800 1 -- 172.21.15.100:0/555298966 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560fe7bb2de0 con 0x560fe7baf7a0 2024-09-18T01:27:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.742+0000 7f33cd7e2640 1 -- 172.21.15.100:0/555298966 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f804c210 con 0x560fe7baf7a0 2024-09-18T01:27:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.742+0000 7f350cd39800 1 -- 172.21.15.100:0/555298966 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fe7bb31c0 con 0x560fe7baf7a0 2024-09-18T01:27:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.743+0000 7f33cd7e2640 1 -- 172.21.15.100:0/555298966 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f34f8017070 con 0x560fe7baf7a0 2024-09-18T01:27:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.743+0000 7f33cd7e2640 1 --2- 172.21.15.100:0/555298966 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f3344036b90 0x7f3344039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.743+0000 7f33cd7e2640 1 -- 172.21.15.100:0/555298966 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f34f8009580 con 0x560fe7baf7a0 2024-09-18T01:27:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.743+0000 7f35081d0640 1 --2- 172.21.15.100:0/555298966 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f3344036b90 0x7f3344039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.743+0000 7f334effd640 20 reqs_thread_entry: start 2024-09-18T01:27:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.744+0000 7f350cd39800 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560fe7bbd200 0x560fe7bbf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.744+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bbfc00 con 0x560fe7bbd200 2024-09-18T01:27:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.744+0000 7f35081d0640 1 --2- 172.21.15.100:0/555298966 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f3344036b90 0x7f3344039050 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x560fe7a88340 tx=0x7f34fc005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.744+0000 7f35091d2640 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560fe7bbd200 0x560fe7bbf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.744+0000 7f35091d2640 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560fe7bbd200 0x560fe7bbf5f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.744+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f350001e940 con 0x560fe7bbd200 2024-09-18T01:27:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.744+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bc04e0 con 0x560fe7bbd200 2024-09-18T01:27:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.744+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f350001e940 con 0x560fe7bbd200 2024-09-18T01:27:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.744+0000 7f350cd39800 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560fe7bc1df0 0x560fe7bc4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.745+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bc4950 con 0x560fe7bc1df0 2024-09-18T01:27:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.745+0000 7f35089d1640 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560fe7bc1df0 0x560fe7bc4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.745+0000 7f35089d1640 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560fe7bc1df0 0x560fe7bc4260 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.745+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f34f8045070 con 0x560fe7bc1df0 2024-09-18T01:27:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.745+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bd1a90 con 0x560fe7bbd200 2024-09-18T01:27:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.746+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f350001e940 con 0x560fe7bbd200 2024-09-18T01:27:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:NOTICE: set zone's realm_id= 2024-09-18T01:27:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.746+0000 7f350cd39800 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560fe7bc8e50 0x560fe7bcbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.746+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc8e50 2024-09-18T01:27:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.746+0000 7f35081d0640 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560fe7bc8e50 0x560fe7bcbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.746+0000 7f35081d0640 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560fe7bc8e50 0x560fe7bcbd80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.746+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(5 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc051070 con 0x560fe7bc8e50 2024-09-18T01:27:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.746+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc1df0 2024-09-18T01:27:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.747+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34f8045070 con 0x560fe7bc1df0 2024-09-18T01:27:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.747+0000 7f35089d1640 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f34f802f060 0x7f34f803b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.747+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x7f34f802f060 2024-09-18T01:27:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.747+0000 7f35091d2640 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f34f802f060 0x7f34f803b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.747+0000 7f35091d2640 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f34f802f060 0x7f34f803b3f0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.748+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f350001e940 con 0x7f34f802f060 2024-09-18T01:27:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.748+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bbd200 2024-09-18T01:27:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.748+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350001e940 con 0x560fe7bbd200 2024-09-18T01:27:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.748+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bbd200 2024-09-18T01:27:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.748+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350001e940 con 0x560fe7bbd200 2024-09-18T01:27:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.748+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x7f34f802f060 2024-09-18T01:27:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.748+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350001e940 con 0x7f34f802f060 2024-09-18T01:27:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.748+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x7f34f802f060 2024-09-18T01:27:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.748+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350001e940 con 0x7f34f802f060 2024-09-18T01:27:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.748+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc1df0 2024-09-18T01:27:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.749+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34f8045070 con 0x560fe7bc1df0 2024-09-18T01:27:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.749+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc8e50 2024-09-18T01:27:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.749+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc051070 con 0x560fe7bc8e50 2024-09-18T01:27:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.749+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bbd200 2024-09-18T01:27:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.749+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350001e940 con 0x560fe7bbd200 2024-09-18T01:27:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.749+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc1df0 2024-09-18T01:27:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.749+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34f8045070 con 0x560fe7bc1df0 2024-09-18T01:27:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.749+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bbd200 2024-09-18T01:27:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.750+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350001e940 con 0x560fe7bbd200 2024-09-18T01:27:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.750+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc1df0 2024-09-18T01:27:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.750+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(17 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f34f8045070 con 0x560fe7bc1df0 2024-09-18T01:27:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.750+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc8e50 2024-09-18T01:27:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.750+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc051070 con 0x560fe7bc8e50 2024-09-18T01:27:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.750+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc8e50 2024-09-18T01:27:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.750+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc051070 con 0x560fe7bc8e50 2024-09-18T01:27:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.750+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x7f34f802f060 2024-09-18T01:27:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.751+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350001e940 con 0x7f34f802f060 2024-09-18T01:27:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.751+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc8e50 2024-09-18T01:27:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.751+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc051070 con 0x560fe7bc8e50 2024-09-18T01:27:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.751+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc8e50 2024-09-18T01:27:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.751+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc051070 con 0x560fe7bc8e50 2024-09-18T01:27:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.751+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bbd200 2024-09-18T01:27:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.751+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350001e940 con 0x560fe7bbd200 2024-09-18T01:27:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.751+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bbd200 2024-09-18T01:27:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.751+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f350001e940 con 0x560fe7bbd200 2024-09-18T01:27:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.752+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x7f34f802f060 2024-09-18T01:27:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.752+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350001e940 con 0x7f34f802f060 2024-09-18T01:27:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.752+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc8e50 2024-09-18T01:27:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.752+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc051070 con 0x560fe7bc8e50 2024-09-18T01:27:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.752+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc1df0 2024-09-18T01:27:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.752+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34f8045070 con 0x560fe7bc1df0 2024-09-18T01:27:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.752+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bbd200 2024-09-18T01:27:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.753+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350001e940 con 0x560fe7bbd200 2024-09-18T01:27:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.753+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x7f34f802f060 2024-09-18T01:27:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.753+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350001e940 con 0x7f34f802f060 2024-09-18T01:27:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.753+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc8e50 2024-09-18T01:27:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.753+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc051070 con 0x560fe7bc8e50 2024-09-18T01:27:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.753+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc1df0 2024-09-18T01:27:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.753+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34f8045070 con 0x560fe7bc1df0 2024-09-18T01:27:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.753+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc1df0 2024-09-18T01:27:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.754+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34f8045070 con 0x560fe7bc1df0 2024-09-18T01:27:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.754+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc8e50 2024-09-18T01:27:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.754+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc051070 con 0x560fe7bc8e50 2024-09-18T01:27:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.754+0000 7f35081d0640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x7f34f802f060 2024-09-18T01:27:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.754+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350001e940 con 0x7f34f802f060 2024-09-18T01:27:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.754+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bbd200 2024-09-18T01:27:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.754+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(35 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f350001e940 con 0x560fe7bbd200 2024-09-18T01:27:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.754+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb900 con 0x560fe7bc1df0 2024-09-18T01:27:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.755+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f34f8045070 con 0x560fe7bc1df0 2024-09-18T01:27:13.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.755+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcf960 con 0x560fe7bbd200 2024-09-18T01:27:13.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.755+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f350001e940 con 0x560fe7bbd200 2024-09-18T01:27:13.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.755+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:38 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bc1100 con 0x560fe7bc1df0 2024-09-18T01:27:13.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.755+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(38 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f34f8045070 con 0x560fe7bc1df0 2024-09-18T01:27:13.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.755+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:39 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bcb190 con 0x560fe7bc1df0 2024-09-18T01:27:13.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.757+0000 7f35089d1640 1 -- 172.21.15.100:0/3766768980 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(39 zone_info.153b7754-209b-4898-8796-577da7c1273d [create,call,writefull 0~1155] v35'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f34f8045070 con 0x560fe7bc1df0 2024-09-18T01:27:13.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.757+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bccf30 con 0x560fe7bbd200 2024-09-18T01:27:13.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.758+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v35'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f350001e940 con 0x560fe7bbd200 2024-09-18T01:27:13.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.758+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fe7bca450 con 0x560fe7bbd200 2024-09-18T01:27:13.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.759+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v35'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f350001e940 con 0x560fe7bbd200 2024-09-18T01:27:13.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 -- 172.21.15.100:0/3303130025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f33e0036b90 msgr2=0x7f33e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 --2- 172.21.15.100:0/3303130025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f33e0036b90 0x7f33e0039050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f34fc057000 tx=0x7f34fc052000 comp rx=0 tx=0).stop 2024-09-18T01:27:13.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 -- 172.21.15.100:0/3303130025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7b8e1c0 msgr2=0x560fe7b958b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 --2- 172.21.15.100:0/3303130025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7b8e1c0 0x560fe7b958b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x560fe7b8ef40 tx=0x7f3500002ff0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 -- 172.21.15.100:0/3303130025 shutdown_connections 2024-09-18T01:27:13.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 --2- 172.21.15.100:0/3303130025 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f33e0036b90 0x7f33e0039050 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 --2- 172.21.15.100:0/3303130025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7b8e1c0 0x560fe7b958b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 -- 172.21.15.100:0/3303130025 >> 172.21.15.100:0/3303130025 conn(0x560fe7a8b980 msgr2=0x560fe7b85100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 -- 172.21.15.100:0/3303130025 shutdown_connections 2024-09-18T01:27:13.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 -- 172.21.15.100:0/3303130025 wait complete. 2024-09-18T01:27:13.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 -- 172.21.15.100:0/555298966 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f3344036b90 msgr2=0x7f3344039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 --2- 172.21.15.100:0/555298966 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f3344036b90 0x7f3344039050 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x560fe7a88340 tx=0x7f34fc005a00 comp rx=0 tx=0).stop 2024-09-18T01:27:13.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 -- 172.21.15.100:0/555298966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7baf7a0 msgr2=0x560fe7bafbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 --2- 172.21.15.100:0/555298966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7baf7a0 0x560fe7bafbc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f34f804cbe0 tx=0x7f34f802d910 comp rx=0 tx=0).stop 2024-09-18T01:27:13.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 -- 172.21.15.100:0/555298966 shutdown_connections 2024-09-18T01:27:13.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 --2- 172.21.15.100:0/555298966 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f3344036b90 0x7f3344039050 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 --2- 172.21.15.100:0/555298966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7baf7a0 0x560fe7bafbc0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 -- 172.21.15.100:0/555298966 >> 172.21.15.100:0/555298966 conn(0x560fe7ba46b0 msgr2=0x560fe7ba6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 -- 172.21.15.100:0/555298966 shutdown_connections 2024-09-18T01:27:13.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.760+0000 7f350cd39800 1 -- 172.21.15.100:0/555298966 wait complete. 2024-09-18T01:27:13.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f34f802f060 msgr2=0x7f34f803b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f34f802f060 0x7f34f803b3f0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560fe7bbd200 msgr2=0x560fe7bbf5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560fe7bbd200 0x560fe7bbf5f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560fe7bc1df0 msgr2=0x560fe7bc4260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560fe7bc1df0 0x560fe7bc4260 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560fe7bc8e50 msgr2=0x560fe7bcbd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560fe7bc8e50 0x560fe7bcbd80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f33f0036b40 msgr2=0x7f33f0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f33f0036b40 0x7f33f0039000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f34f800ff90 tx=0x7f34f800bdf0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f35091d2640 1 -- 172.21.15.100:0/3766768980 reap_dead start 2024-09-18T01:27:13.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a87540 msgr2=0x560fe7b7d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a87540 0x560fe7b7d040 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f34f8001350 tx=0x7f34f8001250 comp rx=0 tx=0).stop 2024-09-18T01:27:13.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 shutdown_connections 2024-09-18T01:27:13.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 --2- 172.21.15.100:0/3766768980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560fe7a87540 0x560fe7b7d040 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 >> 172.21.15.100:0/3766768980 conn(0x560fe7a82dd0 msgr2=0x560fe7b709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 shutdown_connections 2024-09-18T01:27:13.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.761+0000 7f350cd39800 1 -- 172.21.15.100:0/3766768980 wait complete. 2024-09-18T01:27:13.772 INFO:teuthology.orchestra.run.smithi100.stdout:{"id":"153b7754-209b-4898-8796-577da7c1273d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-18T01:27:13.773 DEBUG:tasks.util.rgw: json result: {'id': '153b7754-209b-4898-8796-577da7c1273d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-18T01:27:13.773 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-18T01:27:13.773 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-18T01:27:13.773 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-18T01:27:13.855 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:13.856 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:13.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.855+0000 7f7a99eb9800 1 Processor -- start 2024-09-18T01:27:13.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.855+0000 7f7a99eb9800 1 -- start start 2024-09-18T01:27:13.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.856+0000 7f7a99eb9800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558c802a15e0 0x558c80332680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.856+0000 7f7a99eb9800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558c801ecb30 con 0x558c80332bc0 2024-09-18T01:27:13.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.856+0000 7f7a99eb9800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x558c801ce360 con 0x558c802a15e0 2024-09-18T01:27:13.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.856+0000 7f7a979ad640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558c802a15e0 0x558c80332680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.856+0000 7f7a979ad640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x558c802a15e0 0x558c80332680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45154/0 (socket says 172.21.15.100:45154) 2024-09-18T01:27:13.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.856+0000 7f7a979ad640 1 -- 172.21.15.100:0/3432338488 learned_addr learned my addr 172.21.15.100:0/3432338488 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.856+0000 7f7a971ac640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x558c80332bc0 0x558c80334fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37128/0 (socket says 172.21.15.100:37128) 2024-09-18T01:27:13.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.856+0000 7f7a979ad640 1 -- 172.21.15.100:0/3432338488 >> v1:172.21.15.92:6789/0 conn(0x558c80332bc0 legacy=0x558c80334fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.856+0000 7f7a979ad640 1 -- 172.21.15.100:0/3432338488 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c801f4e00 con 0x558c802a15e0 2024-09-18T01:27:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.858+0000 7f7a979ad640 1 --2- 172.21.15.100:0/3432338488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c80332680 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800a520 tx=0x7f7a88045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c1fc81a44c9c3f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.858+0000 7f7a969ab640 1 -- 172.21.15.100:0/3432338488 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a88055070 con 0x558c802a15e0 2024-09-18T01:27:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.858+0000 7f7a969ab640 1 -- 172.21.15.100:0/3432338488 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a880515b0 con 0x558c802a15e0 2024-09-18T01:27:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.858+0000 7f7a969ab640 1 -- 172.21.15.100:0/3432338488 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a880518d0 con 0x558c802a15e0 2024-09-18T01:27:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.858+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3432338488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 msgr2=0x558c80332680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.858+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3432338488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c80332680 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800a520 tx=0x7f7a88045ba0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.858+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3432338488 shutdown_connections 2024-09-18T01:27:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.858+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3432338488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c80332680 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.858+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3432338488 >> 172.21.15.100:0/3432338488 conn(0x558c80327dd0 msgr2=0x558c8032a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.859+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3432338488 shutdown_connections 2024-09-18T01:27:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.859+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3432338488 wait complete. 2024-09-18T01:27:13.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.872+0000 7f7a99eb9800 1 Processor -- start 2024-09-18T01:27:13.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.872+0000 7f7a99eb9800 1 -- start start 2024-09-18T01:27:13.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.872+0000 7f7a99eb9800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c8041ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.872+0000 7f7a99eb9800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558c80279320 con 0x558c802a15e0 2024-09-18T01:27:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.873+0000 7f7a979ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c8041ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.873+0000 7f7a979ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c8041ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45170/0 (socket says 172.21.15.100:45170) 2024-09-18T01:27:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.873+0000 7f7a979ad640 1 -- 172.21.15.100:0/1232701267 learned_addr learned my addr 172.21.15.100:0/1232701267 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.873+0000 7f7a979ad640 1 -- 172.21.15.100:0/1232701267 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c801c6bc0 con 0x558c802a15e0 2024-09-18T01:27:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.873+0000 7f7a979ad640 1 --2- 172.21.15.100:0/1232701267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c8041ea60 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7a88025da0 tx=0x7f7a88051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d3cab425f4741c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.873+0000 7f7985e0b640 1 -- 172.21.15.100:0/1232701267 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a88051950 con 0x558c802a15e0 2024-09-18T01:27:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.873+0000 7f7985e0b640 1 -- 172.21.15.100:0/1232701267 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a88051af0 con 0x558c802a15e0 2024-09-18T01:27:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.873+0000 7f7985e0b640 1 -- 172.21.15.100:0/1232701267 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a88051dd0 con 0x558c802a15e0 2024-09-18T01:27:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.874+0000 7f7a99eb9800 1 -- 172.21.15.100:0/1232701267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 msgr2=0x558c8041ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.874+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/1232701267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c8041ea60 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7a88025da0 tx=0x7f7a88051000 comp rx=0 tx=0).stop 2024-09-18T01:27:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.874+0000 7f7a99eb9800 1 -- 172.21.15.100:0/1232701267 shutdown_connections 2024-09-18T01:27:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.874+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/1232701267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c8041ea60 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.874+0000 7f7a99eb9800 1 -- 172.21.15.100:0/1232701267 >> 172.21.15.100:0/1232701267 conn(0x558c80327dd0 msgr2=0x558c8041a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.874+0000 7f7a99eb9800 1 -- 172.21.15.100:0/1232701267 shutdown_connections 2024-09-18T01:27:13.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.874+0000 7f7a99eb9800 1 -- 172.21.15.100:0/1232701267 wait complete. 2024-09-18T01:27:13.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.874+0000 7f7a99eb9800 1 Processor -- start 2024-09-18T01:27:13.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.874+0000 7f7a99eb9800 1 -- start start 2024-09-18T01:27:13.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.874+0000 7f7a99eb9800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c80426330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.874+0000 7f7a99eb9800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558c80336970 con 0x558c802a15e0 2024-09-18T01:27:13.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.875+0000 7f7a979ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c80426330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.875+0000 7f7a979ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c80426330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45184/0 (socket says 172.21.15.100:45184) 2024-09-18T01:27:13.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.875+0000 7f7a979ad640 1 -- 172.21.15.100:0/3820729173 learned_addr learned my addr 172.21.15.100:0/3820729173 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.875+0000 7f7a979ad640 1 -- 172.21.15.100:0/3820729173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c801dafe0 con 0x558c802a15e0 2024-09-18T01:27:13.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.875+0000 7f7a979ad640 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c80426330 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f7a88067040 tx=0x7f7a88002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.875+0000 7f797ffff640 1 -- 172.21.15.100:0/3820729173 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a88073070 con 0x558c802a15e0 2024-09-18T01:27:13.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.875+0000 7f797ffff640 1 -- 172.21.15.100:0/3820729173 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a8805a450 con 0x558c802a15e0 2024-09-18T01:27:13.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.875+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3820729173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c80426870 con 0x558c802a15e0 2024-09-18T01:27:13.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.875+0000 7f797ffff640 1 -- 172.21.15.100:0/3820729173 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a8805a730 con 0x558c802a15e0 2024-09-18T01:27:13.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.875+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3820729173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c80426df0 con 0x558c802a15e0 2024-09-18T01:27:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.876+0000 7f7a99eb9800 1 Processor -- start 2024-09-18T01:27:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.876+0000 7f7a99eb9800 1 -- start start 2024-09-18T01:27:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.876+0000 7f797ffff640 1 -- 172.21.15.100:0/3820729173 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7a88076070 con 0x558c802a15e0 2024-09-18T01:27:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.876+0000 7f7a99eb9800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80433140 0x558c80433540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.876+0000 7f7a99eb9800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558c801c8580 con 0x558c80433140 2024-09-18T01:27:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.876+0000 7f797ffff640 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7980036b40 0x7f7980039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.876+0000 7f797ffff640 1 -- 172.21.15.100:0/3820729173 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f7a88062070 con 0x558c802a15e0 2024-09-18T01:27:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.876+0000 7f7a981ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80433140 0x558c80433540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.876+0000 7f7a981ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80433140 0x558c80433540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45192/0 (socket says 172.21.15.100:45192) 2024-09-18T01:27:13.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.876+0000 7f7a981ae640 1 -- 172.21.15.100:0/3211326847 learned_addr learned my addr 172.21.15.100:0/3211326847 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.876+0000 7f7a979ad640 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7980036b40 0x7f7980039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.876+0000 7f7a981ae640 1 -- 172.21.15.100:0/3211326847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c80433a80 con 0x558c80433140 2024-09-18T01:27:13.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.877+0000 7f7a979ad640 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7980036b40 0x7f7980039000 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7a88064ff0 tx=0x7f7a88086040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.877+0000 7f7a981ae640 1 --2- 172.21.15.100:0/3211326847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80433140 0x558c80433540 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000a430 tx=0x7f7a9000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0bfa02fc668ec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.877+0000 7f797dffb640 1 -- 172.21.15.100:0/3211326847 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a90015070 con 0x558c80433140 2024-09-18T01:27:13.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.877+0000 7f797dffb640 1 -- 172.21.15.100:0/3211326847 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a90001670 con 0x558c80433140 2024-09-18T01:27:13.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.877+0000 7f797dffb640 1 -- 172.21.15.100:0/3211326847 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a90001990 con 0x558c80433140 2024-09-18T01:27:13.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.877+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3211326847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80433140 msgr2=0x558c80433540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.877+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3211326847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80433140 0x558c80433540 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000a430 tx=0x7f7a9000a8f0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.877+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3211326847 shutdown_connections 2024-09-18T01:27:13.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.877+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3211326847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80433140 0x558c80433540 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.877+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3211326847 >> 172.21.15.100:0/3211326847 conn(0x558c80332bc0 msgr2=0x558c8042e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.877+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3211326847 shutdown_connections 2024-09-18T01:27:13.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.877+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3211326847 wait complete. 2024-09-18T01:27:13.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.878+0000 7f7a99eb9800 1 Processor -- start 2024-09-18T01:27:13.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.878+0000 7f7a99eb9800 1 -- start start 2024-09-18T01:27:13.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.878+0000 7f7a99eb9800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80433140 0x558c8043a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.878+0000 7f7a99eb9800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558c80434430 con 0x558c80433140 2024-09-18T01:27:13.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.878+0000 7f7a981ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80433140 0x558c8043a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.878+0000 7f7a981ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80433140 0x558c8043a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45200/0 (socket says 172.21.15.100:45200) 2024-09-18T01:27:13.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.878+0000 7f7a981ae640 1 -- 172.21.15.100:0/3236512117 learned_addr learned my addr 172.21.15.100:0/3236512117 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.878+0000 7f7a981ae640 1 -- 172.21.15.100:0/3236512117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c8043ac50 con 0x558c80433140 2024-09-18T01:27:13.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.878+0000 7f7a981ae640 1 --2- 172.21.15.100:0/3236512117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80433140 0x558c8043a710 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000a930 tx=0x7f7a90003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.878+0000 7f7977fff640 1 -- 172.21.15.100:0/3236512117 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a90020020 con 0x558c80433140 2024-09-18T01:27:13.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.878+0000 7f7977fff640 1 -- 172.21.15.100:0/3236512117 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a900108b0 con 0x558c80433140 2024-09-18T01:27:13.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.878+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3236512117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c8043aee0 con 0x558c80433140 2024-09-18T01:27:13.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.878+0000 7f7977fff640 1 -- 172.21.15.100:0/3236512117 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a90015040 con 0x558c80433140 2024-09-18T01:27:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.879+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3236512117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c8043db90 con 0x558c80433140 2024-09-18T01:27:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.879+0000 7f7977fff640 1 -- 172.21.15.100:0/3236512117 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7a90023020 con 0x558c80433140 2024-09-18T01:27:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.879+0000 7f7977fff640 1 --2- 172.21.15.100:0/3236512117 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7970036b90 0x7f7970039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.879+0000 7f7977fff640 1 -- 172.21.15.100:0/3236512117 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f7a9004c360 con 0x558c80433140 2024-09-18T01:27:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.879+0000 7f7a971ac640 1 --2- 172.21.15.100:0/3236512117 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7970036b90 0x7f7970039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.880+0000 7f7a99eb9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.880+0000 7f7a99eb9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.880+0000 7f7a971ac640 1 --2- 172.21.15.100:0/3236512117 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7970036b90 0x7f7970039050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c000f60 tx=0x7f7a8c0012f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.880+0000 7f7a99eb9800 1 Processor -- start 2024-09-18T01:27:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.880+0000 7f7a99eb9800 1 -- start start 2024-09-18T01:27:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.880+0000 7f7a99eb9800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80454720 0x558c80454b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.880+0000 7f7a99eb9800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558c8041f150 con 0x558c80454720 2024-09-18T01:27:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.881+0000 7f7a979ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80454720 0x558c80454b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.881+0000 7f7a979ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80454720 0x558c80454b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45212/0 (socket says 172.21.15.100:45212) 2024-09-18T01:27:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.881+0000 7f7a979ad640 1 -- 172.21.15.100:0/1775538830 learned_addr learned my addr 172.21.15.100:0/1775538830 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.881+0000 7f7a979ad640 1 -- 172.21.15.100:0/1775538830 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c80455110 con 0x558c80454720 2024-09-18T01:27:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.881+0000 7f7a979ad640 1 --2- 172.21.15.100:0/1775538830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80454720 0x558c80454b40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7a8801bb60 tx=0x7f7a88064f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.881+0000 7f790ffff640 1 -- 172.21.15.100:0/1775538830 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a8806e4f0 con 0x558c80454720 2024-09-18T01:27:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.881+0000 7f790ffff640 1 -- 172.21.15.100:0/1775538830 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a8806e690 con 0x558c80454720 2024-09-18T01:27:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.881+0000 7f7a99eb9800 1 -- 172.21.15.100:0/1775538830 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c80457d60 con 0x558c80454720 2024-09-18T01:27:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.881+0000 7f790ffff640 1 -- 172.21.15.100:0/1775538830 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a880813a0 con 0x558c80454720 2024-09-18T01:27:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.881+0000 7f7a99eb9800 1 -- 172.21.15.100:0/1775538830 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c80458140 con 0x558c80454720 2024-09-18T01:27:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.882+0000 7f790ffff640 1 -- 172.21.15.100:0/1775538830 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7a8808b070 con 0x558c80454720 2024-09-18T01:27:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.882+0000 7f790ffff640 1 --2- 172.21.15.100:0/1775538830 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78d8036b30 0x7f78d8038ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.882+0000 7f790ffff640 1 -- 172.21.15.100:0/1775538830 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f7a8809dd10 con 0x558c80454720 2024-09-18T01:27:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.882+0000 7f7a971ac640 1 --2- 172.21.15.100:0/1775538830 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78d8036b30 0x7f78d8038ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.883+0000 7f7a971ac640 1 --2- 172.21.15.100:0/1775538830 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78d8036b30 0x7f78d8038ff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c001ed0 tx=0x7f7a8c00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.883+0000 7f790dffb640 20 reqs_thread_entry: start 2024-09-18T01:27:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.883+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558c80462180 0x558c80464570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.883+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3820729173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558c80464bf0 con 0x558c80462180 2024-09-18T01:27:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.883+0000 7f7a981ae640 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558c80462180 0x558c80464570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.883+0000 7f7a981ae640 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558c80462180 0x558c80464570 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.883+0000 7f7a981ae640 1 -- 172.21.15.100:0/3820729173 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a90010d70 con 0x558c80462180 2024-09-18T01:27:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.883+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3820729173 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558c804654d0 con 0x558c80462180 2024-09-18T01:27:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.884+0000 7f7a981ae640 1 -- 172.21.15.100:0/3820729173 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a90010d70 con 0x558c80462180 2024-09-18T01:27:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.884+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558c80466de0 0x558c80469270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.884+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3820729173 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558c80469960 con 0x558c80466de0 2024-09-18T01:27:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.884+0000 7f7a979ad640 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558c80466de0 0x558c80469270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.884+0000 7f7a979ad640 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558c80466de0 0x558c80469270 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.884+0000 7f7a979ad640 1 -- 172.21.15.100:0/3820729173 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f7a88075030 con 0x558c80466de0 2024-09-18T01:27:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.885+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3236512117 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7970036b90 msgr2=0x7f7970039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.885+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3236512117 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7970036b90 0x7f7970039050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c000f60 tx=0x7f7a8c0012f0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.885+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3236512117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80433140 msgr2=0x558c8043a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.885+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3236512117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80433140 0x558c8043a710 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000a930 tx=0x7f7a90003370 comp rx=0 tx=0).stop 2024-09-18T01:27:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.885+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3236512117 shutdown_connections 2024-09-18T01:27:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.885+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3236512117 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7970036b90 0x7f7970039050 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.885+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3236512117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80433140 0x558c8043a710 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.885+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3236512117 >> 172.21.15.100:0/3236512117 conn(0x558c80332bc0 msgr2=0x558c8042e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.885+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3236512117 shutdown_connections 2024-09-18T01:27:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.885+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3236512117 wait complete. 2024-09-18T01:27:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 -- 172.21.15.100:0/1775538830 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78d8036b30 msgr2=0x7f78d8038ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/1775538830 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78d8036b30 0x7f78d8038ff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c001ed0 tx=0x7f7a8c00f000 comp rx=0 tx=0).stop 2024-09-18T01:27:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 -- 172.21.15.100:0/1775538830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80454720 msgr2=0x558c80454b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/1775538830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80454720 0x558c80454b40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7a8801bb60 tx=0x7f7a88064f60 comp rx=0 tx=0).stop 2024-09-18T01:27:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 -- 172.21.15.100:0/1775538830 shutdown_connections 2024-09-18T01:27:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/1775538830 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f78d8036b30 0x7f78d8038ff0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/1775538830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c80454720 0x558c80454b40 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 -- 172.21.15.100:0/1775538830 >> 172.21.15.100:0/1775538830 conn(0x558c80449660 msgr2=0x558c8044bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 -- 172.21.15.100:0/1775538830 shutdown_connections 2024-09-18T01:27:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 -- 172.21.15.100:0/1775538830 wait complete. 2024-09-18T01:27:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558c80462180 msgr2=0x558c80464570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558c80462180 0x558c80464570 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558c80466de0 msgr2=0x558c80469270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558c80466de0 0x558c80469270 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7980036b40 msgr2=0x7f7980039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7980036b40 0x7f7980039000 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7a88064ff0 tx=0x7f7a88086040 comp rx=0 tx=0).stop 2024-09-18T01:27:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3820729173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 msgr2=0x558c80426330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c80426330 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f7a88067040 tx=0x7f7a88002fb0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3820729173 shutdown_connections 2024-09-18T01:27:13.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x558c80466de0 0x558c80469270 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x558c80462180 0x558c80464570 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7980036b40 0x7f7980039000 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 --2- 172.21.15.100:0/3820729173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c802a15e0 0x558c80426330 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3820729173 >> 172.21.15.100:0/3820729173 conn(0x558c80327dd0 msgr2=0x558c80418c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3820729173 shutdown_connections 2024-09-18T01:27:13.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.886+0000 7f7a99eb9800 1 -- 172.21.15.100:0/3820729173 wait complete. 2024-09-18T01:27:13.897 INFO:teuthology.orchestra.run.smithi100.stdout:{"id":"153b7754-209b-4898-8796-577da7c1273d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-18T01:27:13.897 DEBUG:tasks.util.rgw: json result: {'id': '153b7754-209b-4898-8796-577da7c1273d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-18T01:27:13.897 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-18T01:27:13.898 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-18T01:27:13.898 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-18T01:27:13.983 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:13.983 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:13.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.983+0000 7fea9b010800 1 Processor -- start 2024-09-18T01:27:13.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.983+0000 7fea9b010800 1 -- start start 2024-09-18T01:27:13.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.983+0000 7fea9b010800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e2c16d8550 0x55e2c16d8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:13.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.983+0000 7fea9b010800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e2c1598b30 con 0x55e2c16d8e90 2024-09-18T01:27:13.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.983+0000 7fea9b010800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55e2c157a360 con 0x55e2c16d8550 2024-09-18T01:27:13.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.983+0000 7fea967cd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e2c16d8550 0x55e2c16d8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:13.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.983+0000 7fea95fcc640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55e2c16d8e90 0x55e2c16dda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37142/0 (socket says 172.21.15.100:37142) 2024-09-18T01:27:13.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.983+0000 7fea967cd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55e2c16d8550 0x55e2c16d8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45218/0 (socket says 172.21.15.100:45218) 2024-09-18T01:27:13.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.983+0000 7fea95fcc640 1 -- 172.21.15.100:0/202095554 learned_addr learned my addr 172.21.15.100:0/202095554 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:13.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.983+0000 7fea967cd640 1 -- 172.21.15.100:0/202095554 >> v1:172.21.15.92:6789/0 conn(0x55e2c16d8e90 legacy=0x55e2c16dda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.983+0000 7fea967cd640 1 -- 172.21.15.100:0/202095554 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c15a0e00 con 0x55e2c16d8550 2024-09-18T01:27:13.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.985+0000 7fea967cd640 1 --2- 172.21.15.100:0/202095554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c16d8950 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fea8800a470 tx=0x7fea88045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c60da052390e963 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:13.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.985+0000 7fea957cb640 1 -- 172.21.15.100:0/202095554 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea88053570 con 0x55e2c16d8550 2024-09-18T01:27:13.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.985+0000 7fea957cb640 1 -- 172.21.15.100:0/202095554 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea88058070 con 0x55e2c16d8550 2024-09-18T01:27:13.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.985+0000 7fea957cb640 1 -- 172.21.15.100:0/202095554 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea88053880 con 0x55e2c16d8550 2024-09-18T01:27:13.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.986+0000 7fea9b010800 1 -- 172.21.15.100:0/202095554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 msgr2=0x55e2c16d8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:13.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.986+0000 7fea9b010800 1 --2- 172.21.15.100:0/202095554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c16d8950 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fea8800a470 tx=0x7fea88045a20 comp rx=0 tx=0).stop 2024-09-18T01:27:13.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.986+0000 7fea9b010800 1 -- 172.21.15.100:0/202095554 shutdown_connections 2024-09-18T01:27:13.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.986+0000 7fea9b010800 1 --2- 172.21.15.100:0/202095554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c16d8950 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:13.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.986+0000 7fea9b010800 1 -- 172.21.15.100:0/202095554 >> 172.21.15.100:0/202095554 conn(0x55e2c16d3e40 msgr2=0x55e2c16d6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:13.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.986+0000 7fea9b010800 1 -- 172.21.15.100:0/202095554 shutdown_connections 2024-09-18T01:27:13.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:13.986+0000 7fea9b010800 1 -- 172.21.15.100:0/202095554 wait complete. 2024-09-18T01:27:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.000+0000 7fea9b010800 1 Processor -- start 2024-09-18T01:27:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.000+0000 7fea9b010800 1 -- start start 2024-09-18T01:27:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.000+0000 7fea9b010800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c17c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.000+0000 7fea9b010800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e2c1625350 con 0x55e2c16d8550 2024-09-18T01:27:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.000+0000 7fea967cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c17c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.000+0000 7fea967cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c17c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45228/0 (socket says 172.21.15.100:45228) 2024-09-18T01:27:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.000+0000 7fea967cd640 1 -- 172.21.15.100:0/3209019744 learned_addr learned my addr 172.21.15.100:0/3209019744 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.001+0000 7fea967cd640 1 -- 172.21.15.100:0/3209019744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c1572bc0 con 0x55e2c16d8550 2024-09-18T01:27:14.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.001+0000 7fea967cd640 1 --2- 172.21.15.100:0/3209019744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c17c4740 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fea88025c20 tx=0x7fea88051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1637923f5be71d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.001+0000 7fe984608640 1 -- 172.21.15.100:0/3209019744 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8805c580 con 0x55e2c16d8550 2024-09-18T01:27:14.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.001+0000 7fe984608640 1 -- 172.21.15.100:0/3209019744 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea88063030 con 0x55e2c16d8550 2024-09-18T01:27:14.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.001+0000 7fe984608640 1 -- 172.21.15.100:0/3209019744 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8805c850 con 0x55e2c16d8550 2024-09-18T01:27:14.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.002+0000 7fea9b010800 1 -- 172.21.15.100:0/3209019744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 msgr2=0x55e2c17c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.002+0000 7fea9b010800 1 --2- 172.21.15.100:0/3209019744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c17c4740 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fea88025c20 tx=0x7fea88051000 comp rx=0 tx=0).stop 2024-09-18T01:27:14.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.002+0000 7fea9b010800 1 -- 172.21.15.100:0/3209019744 shutdown_connections 2024-09-18T01:27:14.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.002+0000 7fea9b010800 1 --2- 172.21.15.100:0/3209019744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c17c4740 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.002+0000 7fea9b010800 1 -- 172.21.15.100:0/3209019744 >> 172.21.15.100:0/3209019744 conn(0x55e2c16d3e40 msgr2=0x55e2c17c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.002+0000 7fea9b010800 1 -- 172.21.15.100:0/3209019744 shutdown_connections 2024-09-18T01:27:14.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.002+0000 7fea9b010800 1 -- 172.21.15.100:0/3209019744 wait complete. 2024-09-18T01:27:14.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.002+0000 7fea9b010800 1 Processor -- start 2024-09-18T01:27:14.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.002+0000 7fea9b010800 1 -- start start 2024-09-18T01:27:14.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.002+0000 7fea9b010800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c17d24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.002+0000 7fea9b010800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e2c16df570 con 0x55e2c16d8550 2024-09-18T01:27:14.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.002+0000 7fea967cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c17d24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.002+0000 7fea967cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c17d24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45240/0 (socket says 172.21.15.100:45240) 2024-09-18T01:27:14.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.002+0000 7fea967cd640 1 -- 172.21.15.100:0/758588243 learned_addr learned my addr 172.21.15.100:0/758588243 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.003+0000 7fea967cd640 1 -- 172.21.15.100:0/758588243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c1586fe0 con 0x55e2c16d8550 2024-09-18T01:27:14.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.003+0000 7fea967cd640 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c17d24e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x55e2c17c3e40 tx=0x7fea88002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.003+0000 7fe982e05640 1 -- 172.21.15.100:0/758588243 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea88054ad0 con 0x55e2c16d8550 2024-09-18T01:27:14.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.003+0000 7fe982e05640 1 -- 172.21.15.100:0/758588243 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea88054c70 con 0x55e2c16d8550 2024-09-18T01:27:14.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.003+0000 7fe982e05640 1 -- 172.21.15.100:0/758588243 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea88068420 con 0x55e2c16d8550 2024-09-18T01:27:14.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.003+0000 7fea9b010800 1 -- 172.21.15.100:0/758588243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2c17d2a20 con 0x55e2c16d8550 2024-09-18T01:27:14.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.003+0000 7fea9b010800 1 -- 172.21.15.100:0/758588243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c17d2f40 con 0x55e2c16d8550 2024-09-18T01:27:14.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.004+0000 7fea9b010800 1 Processor -- start 2024-09-18T01:27:14.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.004+0000 7fea9b010800 1 -- start start 2024-09-18T01:27:14.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.004+0000 7fea9b010800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c17df2c0 0x55e2c17df6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.004+0000 7fea9b010800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e2c1574580 con 0x55e2c17df2c0 2024-09-18T01:27:14.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.004+0000 7fe982e05640 1 -- 172.21.15.100:0/758588243 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fea880685c0 con 0x55e2c16d8550 2024-09-18T01:27:14.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.004+0000 7fea96fce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c17df2c0 0x55e2c17df6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.004+0000 7fea96fce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c17df2c0 0x55e2c17df6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45246/0 (socket says 172.21.15.100:45246) 2024-09-18T01:27:14.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.004+0000 7fea96fce640 1 -- 172.21.15.100:0/3073691900 learned_addr learned my addr 172.21.15.100:0/3073691900 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.004+0000 7fe982e05640 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe97c036b40 0x7fe97c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.004+0000 7fe982e05640 1 -- 172.21.15.100:0/758588243 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fea88070030 con 0x55e2c16d8550 2024-09-18T01:27:14.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.004+0000 7fea967cd640 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe97c036b40 0x7fe97c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.004+0000 7fea96fce640 1 -- 172.21.15.100:0/3073691900 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c17dfc00 con 0x55e2c17df2c0 2024-09-18T01:27:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.004+0000 7fea96fce640 1 --2- 172.21.15.100:0/3073691900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c17df2c0 0x55e2c17df6c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fea9000a430 tx=0x7fea9000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4bfded04e7fdd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.004+0000 7fea967cd640 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe97c036b40 0x7fe97c039000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fea8808f110 tx=0x7fea8805ef20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.005+0000 7fe980e01640 1 -- 172.21.15.100:0/3073691900 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea90015070 con 0x55e2c17df2c0 2024-09-18T01:27:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.005+0000 7fe980e01640 1 -- 172.21.15.100:0/3073691900 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea90001670 con 0x55e2c17df2c0 2024-09-18T01:27:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.005+0000 7fe980e01640 1 -- 172.21.15.100:0/3073691900 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea90001990 con 0x55e2c17df2c0 2024-09-18T01:27:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.005+0000 7fea9b010800 1 -- 172.21.15.100:0/3073691900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c17df2c0 msgr2=0x55e2c17df6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.005+0000 7fea9b010800 1 --2- 172.21.15.100:0/3073691900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c17df2c0 0x55e2c17df6c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fea9000a430 tx=0x7fea9000a8f0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.005+0000 7fea9b010800 1 -- 172.21.15.100:0/3073691900 shutdown_connections 2024-09-18T01:27:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.005+0000 7fea9b010800 1 --2- 172.21.15.100:0/3073691900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c17df2c0 0x55e2c17df6c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.005+0000 7fea9b010800 1 -- 172.21.15.100:0/3073691900 >> 172.21.15.100:0/3073691900 conn(0x55e2c16d8e90 msgr2=0x55e2c17daa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.005+0000 7fea9b010800 1 -- 172.21.15.100:0/3073691900 shutdown_connections 2024-09-18T01:27:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.005+0000 7fea9b010800 1 -- 172.21.15.100:0/3073691900 wait complete. 2024-09-18T01:27:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.005+0000 7fea9b010800 1 Processor -- start 2024-09-18T01:27:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.005+0000 7fea9b010800 1 -- start start 2024-09-18T01:27:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.005+0000 7fea9b010800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c17df2c0 0x55e2c17e6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.006+0000 7fea9b010800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e2c17e05b0 con 0x55e2c17df2c0 2024-09-18T01:27:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.006+0000 7fea96fce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c17df2c0 0x55e2c17e6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.006+0000 7fea96fce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c17df2c0 0x55e2c17e6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45260/0 (socket says 172.21.15.100:45260) 2024-09-18T01:27:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.006+0000 7fea96fce640 1 -- 172.21.15.100:0/345632954 learned_addr learned my addr 172.21.15.100:0/345632954 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.006+0000 7fea96fce640 1 -- 172.21.15.100:0/345632954 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c17e6d60 con 0x55e2c17df2c0 2024-09-18T01:27:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.006+0000 7fea96fce640 1 --2- 172.21.15.100:0/345632954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c17df2c0 0x55e2c17e6820 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fea90013040 tx=0x7fea90003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.006+0000 7fe97affd640 1 -- 172.21.15.100:0/345632954 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea90020020 con 0x55e2c17df2c0 2024-09-18T01:27:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.006+0000 7fe97affd640 1 -- 172.21.15.100:0/345632954 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea900108e0 con 0x55e2c17df2c0 2024-09-18T01:27:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.006+0000 7fea9b010800 1 -- 172.21.15.100:0/345632954 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2c17e6ff0 con 0x55e2c17df2c0 2024-09-18T01:27:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.006+0000 7fe97affd640 1 -- 172.21.15.100:0/345632954 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea90015040 con 0x55e2c17df2c0 2024-09-18T01:27:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.006+0000 7fea9b010800 1 -- 172.21.15.100:0/345632954 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c17e9ca0 con 0x55e2c17df2c0 2024-09-18T01:27:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.007+0000 7fe97affd640 1 -- 172.21.15.100:0/345632954 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fea90023020 con 0x55e2c17df2c0 2024-09-18T01:27:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.007+0000 7fe97affd640 1 --2- 172.21.15.100:0/345632954 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe970036b40 0x7fe970039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.007+0000 7fe97affd640 1 -- 172.21.15.100:0/345632954 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fea9004c460 con 0x55e2c17df2c0 2024-09-18T01:27:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.007+0000 7fea95fcc640 1 --2- 172.21.15.100:0/345632954 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe970036b40 0x7fe970039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.008+0000 7fea9b010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.008+0000 7fea9b010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.008+0000 7fea95fcc640 1 --2- 172.21.15.100:0/345632954 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe970036b40 0x7fe970039000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fea8c000f60 tx=0x7fea8c001230 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.008+0000 7fea9b010800 1 Processor -- start 2024-09-18T01:27:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.008+0000 7fea9b010800 1 -- start start 2024-09-18T01:27:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.008+0000 7fea9b010800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c1800830 0x55e2c1800c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.008+0000 7fea9b010800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e2c17c2e40 con 0x55e2c1800830 2024-09-18T01:27:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.008+0000 7fea967cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c1800830 0x55e2c1800c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.008+0000 7fea967cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c1800830 0x55e2c1800c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45268/0 (socket says 172.21.15.100:45268) 2024-09-18T01:27:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.008+0000 7fea967cd640 1 -- 172.21.15.100:0/3844778463 learned_addr learned my addr 172.21.15.100:0/3844778463 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.009+0000 7fea967cd640 1 -- 172.21.15.100:0/3844778463 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c1801220 con 0x55e2c1800830 2024-09-18T01:27:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.009+0000 7fea967cd640 1 --2- 172.21.15.100:0/3844778463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c1800830 0x55e2c1800c50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fea8808f050 tx=0x7fea8808efe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.009+0000 7fe95afe5640 1 -- 172.21.15.100:0/3844778463 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8807c7f0 con 0x55e2c1800830 2024-09-18T01:27:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.009+0000 7fe95afe5640 1 -- 172.21.15.100:0/3844778463 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea88094070 con 0x55e2c1800830 2024-09-18T01:27:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.009+0000 7fea9b010800 1 -- 172.21.15.100:0/3844778463 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2c1803e70 con 0x55e2c1800830 2024-09-18T01:27:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.009+0000 7fe95afe5640 1 -- 172.21.15.100:0/3844778463 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8805fad0 con 0x55e2c1800830 2024-09-18T01:27:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.009+0000 7fea9b010800 1 -- 172.21.15.100:0/3844778463 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c1804250 con 0x55e2c1800830 2024-09-18T01:27:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.010+0000 7fe95afe5640 1 -- 172.21.15.100:0/3844778463 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fea88086070 con 0x55e2c1800830 2024-09-18T01:27:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.010+0000 7fe95afe5640 1 --2- 172.21.15.100:0/3844778463 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe8d8036b40 0x7fe8d8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.010+0000 7fe95afe5640 1 -- 172.21.15.100:0/3844778463 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fea880760c0 con 0x55e2c1800830 2024-09-18T01:27:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.010+0000 7fea95fcc640 1 --2- 172.21.15.100:0/3844778463 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe8d8036b40 0x7fe8d8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.010+0000 7fe958fe1640 20 reqs_thread_entry: start 2024-09-18T01:27:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.010+0000 7fea95fcc640 1 --2- 172.21.15.100:0/3844778463 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe8d8036b40 0x7fe8d8039000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fea8c001ed0 tx=0x7fea8c00f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.010+0000 7fea9b010800 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e2c180e230 0x55e2c18106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.010+0000 7fea9b010800 1 -- 172.21.15.100:0/758588243 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2c1810d90 con 0x55e2c180e230 2024-09-18T01:27:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.010+0000 7fea96fce640 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e2c180e230 0x55e2c18106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.011+0000 7fea96fce640 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e2c180e230 0x55e2c18106c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.011+0000 7fea96fce640 1 -- 172.21.15.100:0/758588243 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea9000e070 con 0x55e2c180e230 2024-09-18T01:27:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.011+0000 7fea9b010800 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e2c1812b60 0x55e2c1814f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.011+0000 7fea9b010800 1 -- 172.21.15.100:0/758588243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:2 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2c18155b0 con 0x55e2c1812b60 2024-09-18T01:27:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.011+0000 7fea967cd640 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e2c1812b60 0x55e2c1814f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.011+0000 7fea967cd640 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e2c1812b60 0x55e2c1814f50 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.012+0000 7fea967cd640 1 -- 172.21.15.100:0/758588243 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(2 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fea88085030 con 0x55e2c1812b60 2024-09-18T01:27:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.012+0000 7fea9b010800 1 -- 172.21.15.100:0/758588243 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2c1812230 con 0x55e2c1812b60 2024-09-18T01:27:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.013+0000 7fea967cd640 1 -- 172.21.15.100:0/758588243 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [stat,call,call,writefull 0~993] v35'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fea88085030 con 0x55e2c1812b60 2024-09-18T01:27:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 -- 172.21.15.100:0/345632954 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe970036b40 msgr2=0x7fe970039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 --2- 172.21.15.100:0/345632954 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe970036b40 0x7fe970039000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fea8c000f60 tx=0x7fea8c001230 comp rx=0 tx=0).stop 2024-09-18T01:27:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 -- 172.21.15.100:0/345632954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c17df2c0 msgr2=0x55e2c17e6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 --2- 172.21.15.100:0/345632954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c17df2c0 0x55e2c17e6820 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fea90013040 tx=0x7fea90003370 comp rx=0 tx=0).stop 2024-09-18T01:27:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 -- 172.21.15.100:0/345632954 shutdown_connections 2024-09-18T01:27:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 --2- 172.21.15.100:0/345632954 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe970036b40 0x7fe970039000 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 --2- 172.21.15.100:0/345632954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c17df2c0 0x55e2c17e6820 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 -- 172.21.15.100:0/345632954 >> 172.21.15.100:0/345632954 conn(0x55e2c16d8e90 msgr2=0x55e2c17da610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 -- 172.21.15.100:0/345632954 shutdown_connections 2024-09-18T01:27:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 -- 172.21.15.100:0/345632954 wait complete. 2024-09-18T01:27:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 -- 172.21.15.100:0/3844778463 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe8d8036b40 msgr2=0x7fe8d8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 --2- 172.21.15.100:0/3844778463 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe8d8036b40 0x7fe8d8039000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fea8c001ed0 tx=0x7fea8c00f000 comp rx=0 tx=0).stop 2024-09-18T01:27:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 -- 172.21.15.100:0/3844778463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c1800830 msgr2=0x55e2c1800c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 --2- 172.21.15.100:0/3844778463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c1800830 0x55e2c1800c50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fea8808f050 tx=0x7fea8808efe0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 -- 172.21.15.100:0/3844778463 shutdown_connections 2024-09-18T01:27:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 --2- 172.21.15.100:0/3844778463 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe8d8036b40 0x7fe8d8039000 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 --2- 172.21.15.100:0/3844778463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c1800830 0x55e2c1800c50 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 -- 172.21.15.100:0/3844778463 >> 172.21.15.100:0/3844778463 conn(0x55e2c17f5770 msgr2=0x55e2c17f8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 -- 172.21.15.100:0/3844778463 shutdown_connections 2024-09-18T01:27:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.014+0000 7fea9b010800 1 -- 172.21.15.100:0/3844778463 wait complete. 2024-09-18T01:27:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 -- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e2c180e230 msgr2=0x55e2c18106c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e2c180e230 0x55e2c18106c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 -- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e2c1812b60 msgr2=0x55e2c1814f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e2c1812b60 0x55e2c1814f50 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 -- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe97c036b40 msgr2=0x7fe97c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe97c036b40 0x7fe97c039000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fea8808f110 tx=0x7fea8805ef20 comp rx=0 tx=0).stop 2024-09-18T01:27:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 -- 172.21.15.100:0/758588243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 msgr2=0x55e2c17d24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c17d24e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x55e2c17c3e40 tx=0x7fea88002fb0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 -- 172.21.15.100:0/758588243 shutdown_connections 2024-09-18T01:27:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55e2c1812b60 0x55e2c1814f50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55e2c180e230 0x55e2c18106c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe97c036b40 0x7fe97c039000 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 --2- 172.21.15.100:0/758588243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2c16d8550 0x55e2c17d24e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 -- 172.21.15.100:0/758588243 >> 172.21.15.100:0/758588243 conn(0x55e2c16d3e40 msgr2=0x55e2c17c1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 -- 172.21.15.100:0/758588243 shutdown_connections 2024-09-18T01:27:14.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.015+0000 7fea9b010800 1 -- 172.21.15.100:0/758588243 wait complete. 2024-09-18T01:27:14.025 INFO:teuthology.orchestra.run.smithi100.stdout:{"id":"153b7754-209b-4898-8796-577da7c1273d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-18T01:27:14.025 DEBUG:tasks.util.rgw: json result: {'id': '153b7754-209b-4898-8796-577da7c1273d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-18T01:27:14.025 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-18T01:27:14.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-18T01:27:14.025 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-18T01:27:14.067 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:14.067 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:14.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.067+0000 7fd60110c800 1 Processor -- start 2024-09-18T01:27:14.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.067+0000 7fd60110c800 1 -- start start 2024-09-18T01:27:14.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.067+0000 7fd60110c800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55aa55334710 0x55aa55336bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.067+0000 7fd60110c800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aa551f0b30 con 0x55aa55330b40 2024-09-18T01:27:14.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.067+0000 7fd60110c800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55aa551d2360 con 0x55aa55334710 2024-09-18T01:27:14.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.067+0000 7fd5fe3ff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55aa55334710 0x55aa55336bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.067+0000 7fd5fe3ff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55aa55334710 0x55aa55336bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45278/0 (socket says 172.21.15.100:45278) 2024-09-18T01:27:14.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.067+0000 7fd5fec00640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55aa55330b40 0x55aa55332f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37150/0 (socket says 172.21.15.100:37150) 2024-09-18T01:27:14.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.067+0000 7fd5fe3ff640 1 -- 172.21.15.100:0/1735384791 learned_addr learned my addr 172.21.15.100:0/1735384791 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.067+0000 7fd5fe3ff640 1 -- 172.21.15.100:0/1735384791 >> v1:172.21.15.92:6789/0 conn(0x55aa55330b40 legacy=0x55aa55332f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.067+0000 7fd5fdbfe640 1 -- 172.21.15.100:0/1735384791 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3585048795 0 0) 0x55aa551f0b30 con 0x55aa55330b40 2024-09-18T01:27:14.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.067+0000 7fd5fe3ff640 1 -- 172.21.15.100:0/1735384791 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa551f8e00 con 0x55aa55334710 2024-09-18T01:27:14.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.069+0000 7fd5fe3ff640 1 --2- 172.21.15.100:0/1735384791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55334710 0x55aa55336bd0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800a520 tx=0x7fd5e8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b258af46f18758 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.069+0000 7fd5fdbfe640 1 -- 172.21.15.100:0/1735384791 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e8055070 con 0x55aa55334710 2024-09-18T01:27:14.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.069+0000 7fd5fdbfe640 1 -- 172.21.15.100:0/1735384791 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e80515b0 con 0x55aa55334710 2024-09-18T01:27:14.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.069+0000 7fd5fdbfe640 1 -- 172.21.15.100:0/1735384791 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e80518d0 con 0x55aa55334710 2024-09-18T01:27:14.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.070+0000 7fd60110c800 1 -- 172.21.15.100:0/1735384791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55334710 msgr2=0x55aa55336bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.070+0000 7fd60110c800 1 --2- 172.21.15.100:0/1735384791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55334710 0x55aa55336bd0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800a520 tx=0x7fd5e8045ba0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.070+0000 7fd60110c800 1 -- 172.21.15.100:0/1735384791 shutdown_connections 2024-09-18T01:27:14.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.070+0000 7fd60110c800 1 --2- 172.21.15.100:0/1735384791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55334710 0x55aa55336bd0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.070+0000 7fd60110c800 1 -- 172.21.15.100:0/1735384791 >> 172.21.15.100:0/1735384791 conn(0x55aa5532b5b0 msgr2=0x55aa5532d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.070+0000 7fd60110c800 1 -- 172.21.15.100:0/1735384791 shutdown_connections 2024-09-18T01:27:14.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.070+0000 7fd60110c800 1 -- 172.21.15.100:0/1735384791 wait complete. 2024-09-18T01:27:14.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.084+0000 7fd60110c800 1 Processor -- start 2024-09-18T01:27:14.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.084+0000 7fd60110c800 1 -- start start 2024-09-18T01:27:14.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.084+0000 7fd60110c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55330b40 0x55aa55330360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.084+0000 7fd60110c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aa5527d320 con 0x55aa55330b40 2024-09-18T01:27:14.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.084+0000 7fd5fec00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55330b40 0x55aa55330360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.084+0000 7fd5fec00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55330b40 0x55aa55330360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45292/0 (socket says 172.21.15.100:45292) 2024-09-18T01:27:14.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.084+0000 7fd5fec00640 1 -- 172.21.15.100:0/1770078118 learned_addr learned my addr 172.21.15.100:0/1770078118 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.084+0000 7fd5fec00640 1 -- 172.21.15.100:0/1770078118 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa551cabc0 con 0x55aa55330b40 2024-09-18T01:27:14.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.085+0000 7fd5fec00640 1 --2- 172.21.15.100:0/1770078118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55330b40 0x55aa55330360 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8001630 tx=0x7fd5f8001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2c3c2165915778 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.085+0000 7fd4ece09640 1 -- 172.21.15.100:0/1770078118 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f8003450 con 0x55aa55330b40 2024-09-18T01:27:14.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.085+0000 7fd4ece09640 1 -- 172.21.15.100:0/1770078118 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f80035f0 con 0x55aa55330b40 2024-09-18T01:27:14.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.085+0000 7fd4ece09640 1 -- 172.21.15.100:0/1770078118 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f8003990 con 0x55aa55330b40 2024-09-18T01:27:14.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.085+0000 7fd60110c800 1 -- 172.21.15.100:0/1770078118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55330b40 msgr2=0x55aa55330360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.085+0000 7fd60110c800 1 --2- 172.21.15.100:0/1770078118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55330b40 0x55aa55330360 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8001630 tx=0x7fd5f8001af0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.085+0000 7fd60110c800 1 -- 172.21.15.100:0/1770078118 shutdown_connections 2024-09-18T01:27:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.085+0000 7fd60110c800 1 --2- 172.21.15.100:0/1770078118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55330b40 0x55aa55330360 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.085+0000 7fd60110c800 1 -- 172.21.15.100:0/1770078118 >> 172.21.15.100:0/1770078118 conn(0x55aa5532b5b0 msgr2=0x55aa5541aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.086+0000 7fd60110c800 1 -- 172.21.15.100:0/1770078118 shutdown_connections 2024-09-18T01:27:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.086+0000 7fd60110c800 1 -- 172.21.15.100:0/1770078118 wait complete. 2024-09-18T01:27:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.086+0000 7fd60110c800 1 Processor -- start 2024-09-18T01:27:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.086+0000 7fd60110c800 1 -- start start 2024-09-18T01:27:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.086+0000 7fd60110c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55330b40 0x55aa55428080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.086+0000 7fd60110c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aa55337550 con 0x55aa55330b40 2024-09-18T01:27:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.086+0000 7fd5fec00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55330b40 0x55aa55428080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.086+0000 7fd5fec00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55330b40 0x55aa55428080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45304/0 (socket says 172.21.15.100:45304) 2024-09-18T01:27:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.086+0000 7fd5fec00640 1 -- 172.21.15.100:0/2995636781 learned_addr learned my addr 172.21.15.100:0/2995636781 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.086+0000 7fd5fec00640 1 -- 172.21.15.100:0/2995636781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa551defe0 con 0x55aa55330b40 2024-09-18T01:27:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.087+0000 7fd5fec00640 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55330b40 0x55aa55428080 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8006fa0 tx=0x7fd5f8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.087+0000 7fd4eb606640 1 -- 172.21.15.100:0/2995636781 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f8013820 con 0x55aa55330b40 2024-09-18T01:27:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.087+0000 7fd4eb606640 1 -- 172.21.15.100:0/2995636781 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f8023070 con 0x55aa55330b40 2024-09-18T01:27:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.087+0000 7fd4eb606640 1 -- 172.21.15.100:0/2995636781 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f8013af0 con 0x55aa55330b40 2024-09-18T01:27:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.087+0000 7fd60110c800 1 -- 172.21.15.100:0/2995636781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa554285c0 con 0x55aa55330b40 2024-09-18T01:27:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.087+0000 7fd60110c800 1 -- 172.21.15.100:0/2995636781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa55428a80 con 0x55aa55330b40 2024-09-18T01:27:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.087+0000 7fd60110c800 1 Processor -- start 2024-09-18T01:27:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.087+0000 7fd60110c800 1 -- start start 2024-09-18T01:27:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd4eb606640 1 -- 172.21.15.100:0/2995636781 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd5f8010070 con 0x55aa55330b40 2024-09-18T01:27:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd60110c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55434dd0 0x55aa554351d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd60110c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aa551cc580 con 0x55aa55434dd0 2024-09-18T01:27:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd4eb606640 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4e4036b90 0x7fd4e4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd5ff401640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55434dd0 0x55aa554351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd5ff401640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55434dd0 0x55aa554351d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45310/0 (socket says 172.21.15.100:45310) 2024-09-18T01:27:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd5ff401640 1 -- 172.21.15.100:0/3860230582 learned_addr learned my addr 172.21.15.100:0/3860230582 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd4eb606640 1 -- 172.21.15.100:0/2995636781 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd5f8018070 con 0x55aa55330b40 2024-09-18T01:27:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd5fec00640 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4e4036b90 0x7fd4e4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd5ff401640 1 -- 172.21.15.100:0/3860230582 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa55435710 con 0x55aa55434dd0 2024-09-18T01:27:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd5ff401640 1 --2- 172.21.15.100:0/3860230582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55434dd0 0x55aa554351d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000a400 tx=0x7fd5f000a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927913594be8c629 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd5fec00640 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4e4036b90 0x7fd4e4039050 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8000f80 tx=0x7fd5f8013e70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd4e9602640 1 -- 172.21.15.100:0/3860230582 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f00087e0 con 0x55aa55434dd0 2024-09-18T01:27:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd4e9602640 1 -- 172.21.15.100:0/3860230582 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f00089a0 con 0x55aa55434dd0 2024-09-18T01:27:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.088+0000 7fd4e9602640 1 -- 172.21.15.100:0/3860230582 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f0008d00 con 0x55aa55434dd0 2024-09-18T01:27:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.089+0000 7fd60110c800 1 -- 172.21.15.100:0/3860230582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55434dd0 msgr2=0x55aa554351d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.089+0000 7fd60110c800 1 --2- 172.21.15.100:0/3860230582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55434dd0 0x55aa554351d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000a400 tx=0x7fd5f000a8c0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.089+0000 7fd60110c800 1 -- 172.21.15.100:0/3860230582 shutdown_connections 2024-09-18T01:27:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.089+0000 7fd60110c800 1 --2- 172.21.15.100:0/3860230582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55434dd0 0x55aa554351d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.089+0000 7fd60110c800 1 -- 172.21.15.100:0/3860230582 >> 172.21.15.100:0/3860230582 conn(0x55aa55334710 msgr2=0x55aa55430550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.089+0000 7fd60110c800 1 -- 172.21.15.100:0/3860230582 shutdown_connections 2024-09-18T01:27:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.089+0000 7fd60110c800 1 -- 172.21.15.100:0/3860230582 wait complete. 2024-09-18T01:27:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.089+0000 7fd60110c800 1 Processor -- start 2024-09-18T01:27:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.089+0000 7fd60110c800 1 -- start start 2024-09-18T01:27:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.089+0000 7fd60110c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55434dd0 0x55aa55420c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.089+0000 7fd60110c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aa554360c0 con 0x55aa55434dd0 2024-09-18T01:27:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.090+0000 7fd5ff401640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55434dd0 0x55aa55420c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.090+0000 7fd5ff401640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55434dd0 0x55aa55420c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45320/0 (socket says 172.21.15.100:45320) 2024-09-18T01:27:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.090+0000 7fd5ff401640 1 -- 172.21.15.100:0/1223089613 learned_addr learned my addr 172.21.15.100:0/1223089613 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.090+0000 7fd5ff401640 1 -- 172.21.15.100:0/1223089613 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa5541f380 con 0x55aa55434dd0 2024-09-18T01:27:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.090+0000 7fd5ff401640 1 --2- 172.21.15.100:0/1223089613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55434dd0 0x55aa55420c90 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000c010 tx=0x7fd5f0002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.090+0000 7fd4e37fe640 1 -- 172.21.15.100:0/1223089613 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f0022020 con 0x55aa55434dd0 2024-09-18T01:27:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.090+0000 7fd4e37fe640 1 -- 172.21.15.100:0/1223089613 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f0019040 con 0x55aa55434dd0 2024-09-18T01:27:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.090+0000 7fd60110c800 1 -- 172.21.15.100:0/1223089613 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa5541f610 con 0x55aa55434dd0 2024-09-18T01:27:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.090+0000 7fd4e37fe640 1 -- 172.21.15.100:0/1223089613 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f0013a70 con 0x55aa55434dd0 2024-09-18T01:27:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.090+0000 7fd60110c800 1 -- 172.21.15.100:0/1223089613 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa5541fb10 con 0x55aa55434dd0 2024-09-18T01:27:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.091+0000 7fd4e37fe640 1 -- 172.21.15.100:0/1223089613 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd5f0025020 con 0x55aa55434dd0 2024-09-18T01:27:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.091+0000 7fd4e37fe640 1 --2- 172.21.15.100:0/1223089613 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4d8036b40 0x7fd4d8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.091+0000 7fd4e37fe640 1 -- 172.21.15.100:0/1223089613 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd5f004c7b0 con 0x55aa55434dd0 2024-09-18T01:27:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.091+0000 7fd5fe3ff640 1 --2- 172.21.15.100:0/1223089613 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4d8036b40 0x7fd4d8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.092+0000 7fd60110c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.092+0000 7fd60110c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.092+0000 7fd5fe3ff640 1 --2- 172.21.15.100:0/1223089613 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4d8036b40 0x7fd4d8039000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8057000 tx=0x7fd5e8052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.092+0000 7fd60110c800 1 Processor -- start 2024-09-18T01:27:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.092+0000 7fd60110c800 1 -- start start 2024-09-18T01:27:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.092+0000 7fd60110c800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa554584f0 0x55aa55458910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.092+0000 7fd60110c800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aa55423510 con 0x55aa554584f0 2024-09-18T01:27:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.092+0000 7fd5fec00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa554584f0 0x55aa55458910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.092+0000 7fd5fec00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa554584f0 0x55aa55458910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45324/0 (socket says 172.21.15.100:45324) 2024-09-18T01:27:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.092+0000 7fd5fec00640 1 -- 172.21.15.100:0/1653956846 learned_addr learned my addr 172.21.15.100:0/1653956846 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.093+0000 7fd5fec00640 1 -- 172.21.15.100:0/1653956846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa55458ee0 con 0x55aa554584f0 2024-09-18T01:27:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.093+0000 7fd5fec00640 1 --2- 172.21.15.100:0/1653956846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa554584f0 0x55aa55458910 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8001b30 tx=0x7fd5f802d5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.093+0000 7fd4c37e6640 1 -- 172.21.15.100:0/1653956846 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f80123c0 con 0x55aa554584f0 2024-09-18T01:27:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.093+0000 7fd4c37e6640 1 -- 172.21.15.100:0/1653956846 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f8044020 con 0x55aa554584f0 2024-09-18T01:27:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.093+0000 7fd4c37e6640 1 -- 172.21.15.100:0/1653956846 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f8027c10 con 0x55aa554584f0 2024-09-18T01:27:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.093+0000 7fd60110c800 1 -- 172.21.15.100:0/1653956846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa5545bb30 con 0x55aa554584f0 2024-09-18T01:27:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.093+0000 7fd60110c800 1 -- 172.21.15.100:0/1653956846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa5545bf10 con 0x55aa554584f0 2024-09-18T01:27:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.094+0000 7fd4c37e6640 1 -- 172.21.15.100:0/1653956846 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd5f803c040 con 0x55aa554584f0 2024-09-18T01:27:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.094+0000 7fd4c37e6640 1 --2- 172.21.15.100:0/1653956846 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd440036b40 0x7fd440039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.094+0000 7fd4c37e6640 1 -- 172.21.15.100:0/1653956846 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd5f8045030 con 0x55aa554584f0 2024-09-18T01:27:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.094+0000 7fd5fe3ff640 1 --2- 172.21.15.100:0/1653956846 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd440036b40 0x7fd440039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.094+0000 7fd4c17e2640 20 reqs_thread_entry: start 2024-09-18T01:27:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.094+0000 7fd60110c800 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aa55465fe0 0x55aa55468470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.094+0000 7fd60110c800 1 -- 172.21.15.100:0/2995636781 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aa55468af0 con 0x55aa55465fe0 2024-09-18T01:27:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.094+0000 7fd5fe3ff640 1 --2- 172.21.15.100:0/1653956846 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd440036b40 0x7fd440039000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8000c00 tx=0x7fd5e8005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.094+0000 7fd5ff401640 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aa55465fe0 0x55aa55468470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.095+0000 7fd5ff401640 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aa55465fe0 0x55aa55468470 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.095+0000 7fd5ff401640 1 -- 172.21.15.100:0/2995636781 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5f0013c10 con 0x55aa55465fe0 2024-09-18T01:27:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.095+0000 7fd60110c800 1 -- 172.21.15.100:0/2995636781 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aa554693d0 con 0x55aa55465fe0 2024-09-18T01:27:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.095+0000 7fd5ff401640 1 -- 172.21.15.100:0/2995636781 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5f0013c10 con 0x55aa55465fe0 2024-09-18T01:27:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.095+0000 7fd60110c800 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55aa5546ace0 0x55aa5546d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.095+0000 7fd60110c800 1 -- 172.21.15.100:0/2995636781 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:3 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aa5546d830 con 0x55aa5546ace0 2024-09-18T01:27:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.095+0000 7fd5fec00640 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55aa5546ace0 0x55aa5546d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.096+0000 7fd5fec00640 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55aa5546ace0 0x55aa5546d170 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.096+0000 7fd5fec00640 1 -- 172.21.15.100:0/2995636781 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(3 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd5f801b030 con 0x55aa5546ace0 2024-09-18T01:27:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 -- 172.21.15.100:0/1223089613 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4d8036b40 msgr2=0x7fd4d8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 --2- 172.21.15.100:0/1223089613 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4d8036b40 0x7fd4d8039000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8057000 tx=0x7fd5e8052000 comp rx=0 tx=0).stop 2024-09-18T01:27:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 -- 172.21.15.100:0/1223089613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55434dd0 msgr2=0x55aa55420c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 --2- 172.21.15.100:0/1223089613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55434dd0 0x55aa55420c90 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000c010 tx=0x7fd5f0002ff0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 -- 172.21.15.100:0/1223089613 shutdown_connections 2024-09-18T01:27:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 --2- 172.21.15.100:0/1223089613 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4d8036b40 0x7fd4d8039000 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 --2- 172.21.15.100:0/1223089613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55434dd0 0x55aa55420c90 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 -- 172.21.15.100:0/1223089613 >> 172.21.15.100:0/1223089613 conn(0x55aa55334710 msgr2=0x55aa55430120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 -- 172.21.15.100:0/1223089613 shutdown_connections 2024-09-18T01:27:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 -- 172.21.15.100:0/1223089613 wait complete. 2024-09-18T01:27:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 -- 172.21.15.100:0/1653956846 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd440036b40 msgr2=0x7fd440039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 --2- 172.21.15.100:0/1653956846 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd440036b40 0x7fd440039000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8000c00 tx=0x7fd5e8005ac0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 -- 172.21.15.100:0/1653956846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa554584f0 msgr2=0x55aa55458910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 --2- 172.21.15.100:0/1653956846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa554584f0 0x55aa55458910 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8001b30 tx=0x7fd5f802d5d0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 -- 172.21.15.100:0/1653956846 shutdown_connections 2024-09-18T01:27:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 --2- 172.21.15.100:0/1653956846 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd440036b40 0x7fd440039000 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 --2- 172.21.15.100:0/1653956846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa554584f0 0x55aa55458910 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 -- 172.21.15.100:0/1653956846 >> 172.21.15.100:0/1653956846 conn(0x55aa5544d400 msgr2=0x55aa5544fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 -- 172.21.15.100:0/1653956846 shutdown_connections 2024-09-18T01:27:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.097+0000 7fd60110c800 1 -- 172.21.15.100:0/1653956846 wait complete. 2024-09-18T01:27:14.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 -- 172.21.15.100:0/2995636781 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55aa5546ace0 msgr2=0x55aa5546d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55aa5546ace0 0x55aa5546d170 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 -- 172.21.15.100:0/2995636781 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aa55465fe0 msgr2=0x55aa55468470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aa55465fe0 0x55aa55468470 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 -- 172.21.15.100:0/2995636781 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4e4036b90 msgr2=0x7fd4e4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4e4036b90 0x7fd4e4039050 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8000f80 tx=0x7fd5f8013e70 comp rx=0 tx=0).stop 2024-09-18T01:27:14.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 -- 172.21.15.100:0/2995636781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55330b40 msgr2=0x55aa55428080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55330b40 0x55aa55428080 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8006fa0 tx=0x7fd5f8001250 comp rx=0 tx=0).stop 2024-09-18T01:27:14.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 -- 172.21.15.100:0/2995636781 shutdown_connections 2024-09-18T01:27:14.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55aa5546ace0 0x55aa5546d170 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55aa55465fe0 0x55aa55468470 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd4e4036b90 0x7fd4e4039050 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 --2- 172.21.15.100:0/2995636781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa55330b40 0x55aa55428080 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 -- 172.21.15.100:0/2995636781 >> 172.21.15.100:0/2995636781 conn(0x55aa5532b5b0 msgr2=0x55aa55419760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 -- 172.21.15.100:0/2995636781 shutdown_connections 2024-09-18T01:27:14.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.098+0000 7fd60110c800 1 -- 172.21.15.100:0/2995636781 wait complete. 2024-09-18T01:27:14.112 INFO:teuthology.orchestra.run.smithi100.stdout:{"id":"2d75eca1-60da-4ca3-af9b-0b09072c949e","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"153b7754-209b-4898-8796-577da7c1273d","zones":[{"id":"153b7754-209b-4898-8796-577da7c1273d","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-18T01:27:14.112 DEBUG:tasks.util.rgw: json result: {'id': '2d75eca1-60da-4ca3-af9b-0b09072c949e', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '153b7754-209b-4898-8796-577da7c1273d', 'zones': [{'id': '153b7754-209b-4898-8796-577da7c1273d', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-18T01:27:14.115 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-18T01:27:14.141 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-18T01:27:14.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-18T01:27:14.141 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-18T01:27:14.208 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:14.208 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:14.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.207+0000 7f1602928800 1 Processor -- start 2024-09-18T01:27:14.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.207+0000 7f1602928800 1 -- start start 2024-09-18T01:27:14.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.208+0000 7f1602928800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x562c91507680 0x562c91596210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.208+0000 7f1602928800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562c91452b30 con 0x562c91596750 2024-09-18T01:27:14.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.208+0000 7f1602928800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x562c91434360 con 0x562c91507680 2024-09-18T01:27:14.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.208+0000 7f15fe61d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x562c91507680 0x562c91596210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.208+0000 7f15fde1c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x562c91596750 0x562c91598b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37166/0 (socket says 172.21.15.100:37166) 2024-09-18T01:27:14.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.208+0000 7f15fde1c640 1 -- 172.21.15.100:0/2159391829 learned_addr learned my addr 172.21.15.100:0/2159391829 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:14.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.208+0000 7f15fd61b640 1 -- 172.21.15.100:0/2159391829 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 931670776 0 0) 0x562c91452b30 con 0x562c91596750 2024-09-18T01:27:14.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.208+0000 7f15fd61b640 1 -- 172.21.15.100:0/2159391829 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15e8001e10 con 0x562c91596750 2024-09-18T01:27:14.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.208+0000 7f15fe61d640 1 -- 172.21.15.100:0/2159391829 >> v1:172.21.15.92:6789/0 conn(0x562c91596750 legacy=0x562c91598b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.208+0000 7f15fe61d640 1 -- 172.21.15.100:0/2159391829 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c9145ae00 con 0x562c91507680 2024-09-18T01:27:14.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.210+0000 7f15fe61d640 1 --2- 172.21.15.100:0/2159391829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 0x562c91596210 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f15f0005fd0 tx=0x7f15f0045b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539d4932a7ed5c76 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.210+0000 7f15fd61b640 1 -- 172.21.15.100:0/2159391829 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f0055070 con 0x562c91507680 2024-09-18T01:27:14.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.210+0000 7f15fd61b640 1 -- 172.21.15.100:0/2159391829 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f0051540 con 0x562c91507680 2024-09-18T01:27:14.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.210+0000 7f15fd61b640 1 -- 172.21.15.100:0/2159391829 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f0051820 con 0x562c91507680 2024-09-18T01:27:14.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.211+0000 7f1602928800 1 -- 172.21.15.100:0/2159391829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 msgr2=0x562c91596210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.211+0000 7f1602928800 1 --2- 172.21.15.100:0/2159391829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 0x562c91596210 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f15f0005fd0 tx=0x7f15f0045b30 comp rx=0 tx=0).stop 2024-09-18T01:27:14.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.211+0000 7f1602928800 1 -- 172.21.15.100:0/2159391829 shutdown_connections 2024-09-18T01:27:14.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.211+0000 7f1602928800 1 --2- 172.21.15.100:0/2159391829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 0x562c91596210 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.211+0000 7f1602928800 1 -- 172.21.15.100:0/2159391829 >> 172.21.15.100:0/2159391829 conn(0x562c9158dde0 msgr2=0x562c91590200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.211+0000 7f1602928800 1 -- 172.21.15.100:0/2159391829 shutdown_connections 2024-09-18T01:27:14.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.211+0000 7f1602928800 1 -- 172.21.15.100:0/2159391829 wait complete. 2024-09-18T01:27:14.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.224+0000 7f1602928800 1 Processor -- start 2024-09-18T01:27:14.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.225+0000 7f1602928800 1 -- start start 2024-09-18T01:27:14.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.225+0000 7f1602928800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 0x562c91682820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.225+0000 7f1602928800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562c914df450 con 0x562c91507680 2024-09-18T01:27:14.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.225+0000 7f15fe61d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 0x562c91682820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.225+0000 7f15fe61d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 0x562c91682820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45352/0 (socket says 172.21.15.100:45352) 2024-09-18T01:27:14.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.225+0000 7f15fe61d640 1 -- 172.21.15.100:0/2498028495 learned_addr learned my addr 172.21.15.100:0/2498028495 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.225+0000 7f15fe61d640 1 -- 172.21.15.100:0/2498028495 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c9142cbc0 con 0x562c91507680 2024-09-18T01:27:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.226+0000 7f15fe61d640 1 --2- 172.21.15.100:0/2498028495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 0x562c91682820 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f15f0005fd0 tx=0x7f15f0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1c8514585a719 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.226+0000 7f14ec608640 1 -- 172.21.15.100:0/2498028495 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f0055040 con 0x562c91507680 2024-09-18T01:27:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.226+0000 7f14ec608640 1 -- 172.21.15.100:0/2498028495 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f0051a10 con 0x562c91507680 2024-09-18T01:27:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.226+0000 7f14ec608640 1 -- 172.21.15.100:0/2498028495 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f0051cf0 con 0x562c91507680 2024-09-18T01:27:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.227+0000 7f1602928800 1 -- 172.21.15.100:0/2498028495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 msgr2=0x562c91682820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.227+0000 7f1602928800 1 --2- 172.21.15.100:0/2498028495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 0x562c91682820 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f15f0005fd0 tx=0x7f15f0051000 comp rx=0 tx=0).stop 2024-09-18T01:27:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.227+0000 7f1602928800 1 -- 172.21.15.100:0/2498028495 shutdown_connections 2024-09-18T01:27:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.227+0000 7f1602928800 1 --2- 172.21.15.100:0/2498028495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 0x562c91682820 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.227+0000 7f1602928800 1 -- 172.21.15.100:0/2498028495 >> 172.21.15.100:0/2498028495 conn(0x562c9158dde0 msgr2=0x562c9167e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.227+0000 7f1602928800 1 -- 172.21.15.100:0/2498028495 shutdown_connections 2024-09-18T01:27:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.227+0000 7f1602928800 1 -- 172.21.15.100:0/2498028495 wait complete. 2024-09-18T01:27:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.227+0000 7f1602928800 1 Processor -- start 2024-09-18T01:27:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.227+0000 7f1602928800 1 -- start start 2024-09-18T01:27:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.227+0000 7f1602928800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 0x562c9168a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.227+0000 7f1602928800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562c9159a650 con 0x562c91507680 2024-09-18T01:27:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.227+0000 7f15fe61d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 0x562c9168a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.227+0000 7f15fe61d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 0x562c9168a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45362/0 (socket says 172.21.15.100:45362) 2024-09-18T01:27:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.227+0000 7f15fe61d640 1 -- 172.21.15.100:0/1135284651 learned_addr learned my addr 172.21.15.100:0/1135284651 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.228+0000 7f15fe61d640 1 -- 172.21.15.100:0/1135284651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c91440fe0 con 0x562c91507680 2024-09-18T01:27:14.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.228+0000 7f15fe61d640 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 0x562c9168a010 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f15f0005fd0 tx=0x7f15f0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.228+0000 7f14eae05640 1 -- 172.21.15.100:0/1135284651 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f0071020 con 0x562c91507680 2024-09-18T01:27:14.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.228+0000 7f14eae05640 1 -- 172.21.15.100:0/1135284651 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f005a970 con 0x562c91507680 2024-09-18T01:27:14.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.228+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c9168a550 con 0x562c91507680 2024-09-18T01:27:14.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.228+0000 7f14eae05640 1 -- 172.21.15.100:0/1135284651 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f0055030 con 0x562c91507680 2024-09-18T01:27:14.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.228+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c9168aad0 con 0x562c91507680 2024-09-18T01:27:14.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.229+0000 7f14eae05640 1 -- 172.21.15.100:0/1135284651 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f15f0074020 con 0x562c91507680 2024-09-18T01:27:14.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.229+0000 7f14eae05640 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14e4036b90 0x7f14e4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.229+0000 7f14eae05640 1 -- 172.21.15.100:0/1135284651 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f15f006a040 con 0x562c91507680 2024-09-18T01:27:14.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.229+0000 7f15fde1c640 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14e4036b90 0x7f14e4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.229+0000 7f1602928800 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562c91596750 0x562c91691080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.229+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c916916a0 con 0x562c91596750 2024-09-18T01:27:14.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.229+0000 7f15fee1e640 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562c91596750 0x562c91691080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.229+0000 7f15fde1c640 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14e4036b90 0x7f14e4039050 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f15f4000f60 tx=0x7f15f40010a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.230+0000 7f15fee1e640 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562c91596750 0x562c91691080 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.230+0000 7f15fee1e640 1 -- 172.21.15.100:0/1135284651 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15f80083e0 con 0x562c91596750 2024-09-18T01:27:14.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.230+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c9168e610 con 0x562c91596750 2024-09-18T01:27:14.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.230+0000 7f15fee1e640 1 -- 172.21.15.100:0/1135284651 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f15f80083e0 con 0x562c91596750 2024-09-18T01:27:14.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.230+0000 7f1602928800 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562c916939d0 0x562c91695dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.230+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c91696490 con 0x562c916939d0 2024-09-18T01:27:14.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.230+0000 7f15fe61d640 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562c916939d0 0x562c91695dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.231+0000 7f15fe61d640 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562c916939d0 0x562c91695dc0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.231+0000 7f15fe61d640 1 -- 172.21.15.100:0/1135284651 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916939d0 2024-09-18T01:27:14.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.231+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c91692870 con 0x562c91596750 2024-09-18T01:27:14.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.231+0000 7f15fee1e640 1 -- 172.21.15.100:0/1135284651 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f15f80083e0 con 0x562c91596750 2024-09-18T01:27:14.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.231+0000 7f1602928800 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562c916978f0 0x562c91699ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.231+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c9169a3a0 con 0x562c916978f0 2024-09-18T01:27:14.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.231+0000 7f15fde1c640 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562c916978f0 0x562c91699ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.232+0000 7f15fde1c640 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562c916978f0 0x562c91699ce0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.232+0000 7f15fde1c640 1 -- 172.21.15.100:0/1135284651 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f15f4009050 con 0x562c916978f0 2024-09-18T01:27:14.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.232+0000 7f1602928800 1 Processor -- start 2024-09-18T01:27:14.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.233+0000 7f1602928800 1 -- start start 2024-09-18T01:27:14.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.233+0000 7f1602928800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91593be0 0x562c91592230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.233+0000 7f1602928800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562c9142e580 con 0x562c91593be0 2024-09-18T01:27:14.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.233+0000 7f15fe61d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91593be0 0x562c91592230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.233+0000 7f15fe61d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91593be0 0x562c91592230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45376/0 (socket says 172.21.15.100:45376) 2024-09-18T01:27:14.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.233+0000 7f15fe61d640 1 -- 172.21.15.100:0/3348695763 learned_addr learned my addr 172.21.15.100:0/3348695763 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.233+0000 7f15fe61d640 1 -- 172.21.15.100:0/3348695763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c91594000 con 0x562c91593be0 2024-09-18T01:27:14.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.233+0000 7f15fe61d640 1 --2- 172.21.15.100:0/3348695763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91593be0 0x562c91592230 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f15f008ec30 tx=0x7f15f006caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.233+0000 7f14e3fff640 1 -- 172.21.15.100:0/3348695763 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f0077c20 con 0x562c91593be0 2024-09-18T01:27:14.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.233+0000 7f14e3fff640 1 -- 172.21.15.100:0/3348695763 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f0077dc0 con 0x562c91593be0 2024-09-18T01:27:14.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.233+0000 7f14e3fff640 1 -- 172.21.15.100:0/3348695763 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f0090b40 con 0x562c91593be0 2024-09-18T01:27:14.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.233+0000 7f1602928800 1 -- 172.21.15.100:0/3348695763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c91592830 con 0x562c91593be0 2024-09-18T01:27:14.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.234+0000 7f1602928800 1 -- 172.21.15.100:0/3348695763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c91592830 con 0x562c91593be0 2024-09-18T01:27:14.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.234+0000 7f14e3fff640 1 -- 172.21.15.100:0/3348695763 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f15f0058070 con 0x562c91593be0 2024-09-18T01:27:14.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.234+0000 7f14e3fff640 1 --2- 172.21.15.100:0/3348695763 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14d8036b90 0x7f14d8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.234+0000 7f14e3fff640 1 -- 172.21.15.100:0/3348695763 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f15f0061070 con 0x562c91593be0 2024-09-18T01:27:14.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.234+0000 7f15fde1c640 1 --2- 172.21.15.100:0/3348695763 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14d8036b90 0x7f14d8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.235+0000 7f1602928800 1 Processor -- start 2024-09-18T01:27:14.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.235+0000 7f1602928800 1 -- start start 2024-09-18T01:27:14.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.235+0000 7f15fde1c640 1 --2- 172.21.15.100:0/3348695763 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14d8036b90 0x7f14d8039050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f15f400bf90 tx=0x7f15f400f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.235+0000 7f1602928800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c916b6c30 0x562c916b7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.235+0000 7f1602928800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562c91682f10 con 0x562c916b6c30 2024-09-18T01:27:14.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.235+0000 7f15fe61d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c916b6c30 0x562c916b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.235+0000 7f15fe61d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c916b6c30 0x562c916b7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45384/0 (socket says 172.21.15.100:45384) 2024-09-18T01:27:14.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.235+0000 7f15fe61d640 1 -- 172.21.15.100:0/2857841532 learned_addr learned my addr 172.21.15.100:0/2857841532 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.235+0000 7f15fe61d640 1 -- 172.21.15.100:0/2857841532 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c916b7600 con 0x562c916b6c30 2024-09-18T01:27:14.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.235+0000 7f15fe61d640 1 --2- 172.21.15.100:0/2857841532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c916b6c30 0x562c916b7030 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f15f005a650 tx=0x7f15f0063e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e31c4ae92097cbf server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.236+0000 7f14e1ffb640 1 -- 172.21.15.100:0/2857841532 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f00aa070 con 0x562c916b6c30 2024-09-18T01:27:14.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.236+0000 7f14e1ffb640 1 -- 172.21.15.100:0/2857841532 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f00754e0 con 0x562c916b6c30 2024-09-18T01:27:14.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.236+0000 7f14e1ffb640 1 -- 172.21.15.100:0/2857841532 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f0095040 con 0x562c916b6c30 2024-09-18T01:27:14.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.236+0000 7f1602928800 1 -- 172.21.15.100:0/2857841532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c916b6c30 msgr2=0x562c916b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.236+0000 7f1602928800 1 --2- 172.21.15.100:0/2857841532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c916b6c30 0x562c916b7030 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f15f005a650 tx=0x7f15f0063e40 comp rx=0 tx=0).stop 2024-09-18T01:27:14.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.236+0000 7f1602928800 1 -- 172.21.15.100:0/2857841532 shutdown_connections 2024-09-18T01:27:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.236+0000 7f1602928800 1 --2- 172.21.15.100:0/2857841532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c916b6c30 0x562c916b7030 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.236+0000 7f1602928800 1 -- 172.21.15.100:0/2857841532 >> 172.21.15.100:0/2857841532 conn(0x562c916b2f90 msgr2=0x562c916b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.236+0000 7f1602928800 1 -- 172.21.15.100:0/2857841532 shutdown_connections 2024-09-18T01:27:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.236+0000 7f1602928800 1 -- 172.21.15.100:0/2857841532 wait complete. 2024-09-18T01:27:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.236+0000 7f1602928800 1 Processor -- start 2024-09-18T01:27:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.236+0000 7f1602928800 1 -- start start 2024-09-18T01:27:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.237+0000 7f1602928800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c916b6c30 0x562c916bdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.237+0000 7f1602928800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562c916b7b80 con 0x562c916b6c30 2024-09-18T01:27:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.237+0000 7f15fe61d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c916b6c30 0x562c916bdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.237+0000 7f15fe61d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c916b6c30 0x562c916bdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45392/0 (socket says 172.21.15.100:45392) 2024-09-18T01:27:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.237+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 learned_addr learned my addr 172.21.15.100:0/553081882 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.237+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c916be420 con 0x562c916b6c30 2024-09-18T01:27:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.237+0000 7f15fe61d640 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c916b6c30 0x562c916bdee0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f15f005a650 tx=0x7f15f006df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.237+0000 7f14cffff640 1 -- 172.21.15.100:0/553081882 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f00b2020 con 0x562c916b6c30 2024-09-18T01:27:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.237+0000 7f14cffff640 1 -- 172.21.15.100:0/553081882 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f0075740 con 0x562c916b6c30 2024-09-18T01:27:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.237+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c916be420 con 0x562c916b6c30 2024-09-18T01:27:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.237+0000 7f14cffff640 1 -- 172.21.15.100:0/553081882 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f00aa040 con 0x562c916b6c30 2024-09-18T01:27:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.237+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c916be420 con 0x562c916b6c30 2024-09-18T01:27:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.238+0000 7f14cffff640 1 -- 172.21.15.100:0/553081882 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f15f00b5020 con 0x562c916b6c30 2024-09-18T01:27:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.238+0000 7f14cffff640 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14c8036b90 0x7f14c8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.238+0000 7f14cffff640 1 -- 172.21.15.100:0/553081882 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f15f00a2070 con 0x562c916b6c30 2024-09-18T01:27:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.238+0000 7f15fde1c640 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14c8036b90 0x7f14c8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.239+0000 7f15fde1c640 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14c8036b90 0x7f14c8039050 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x562c91691f80 tx=0x7f15f4010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.239+0000 7f1602928800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.239+0000 7f1602928800 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562c916c96c0 0x562c916cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.239+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c916cc2d0 con 0x562c916c96c0 2024-09-18T01:27:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.239+0000 7f15fee1e640 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562c916c96c0 0x562c916cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.239+0000 7f15fee1e640 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562c916c96c0 0x562c916cbb80 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15f80083e0 con 0x562c916c96c0 2024-09-18T01:27:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 20 realm 2024-09-18T01:27:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c916cc700 con 0x562c916c96c0 2024-09-18T01:27:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15f80083e0 con 0x562c916c96c0 2024-09-18T01:27:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916c96c0 2024-09-18T01:27:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15f80083e0 con 0x562c916c96c0 2024-09-18T01:27:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c916cd370 con 0x562c916c96c0 2024-09-18T01:27:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f15f80083e0 con 0x562c916c96c0 2024-09-18T01:27:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562c916cdd30 0x562c916d0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c916d0730 con 0x562c916cdd30 2024-09-18T01:27:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.240+0000 7f15fe61d640 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562c916cdd30 0x562c916d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.241+0000 7f15fe61d640 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562c916cdd30 0x562c916d0120 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.241+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.241+0000 7f1602928800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.241+0000 7f1602928800 20 searching for the correct realm 2024-09-18T01:27:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.241+0000 7f1602928800 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562c916d26c0 0x562c916d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.241+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916d5250 con 0x562c916d26c0 2024-09-18T01:27:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.241+0000 7f15fde1c640 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562c916d26c0 0x562c916d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.241+0000 7f15fde1c640 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562c916d26c0 0x562c916d4b80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.242+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.242+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916d5250 con 0x562c916cdd30 2024-09-18T01:27:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.242+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.242+0000 7f15fe61d640 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f15f00b7020 0x7f15f00ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.242+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916d5250 con 0x7f15f00b7020 2024-09-18T01:27:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.242+0000 7f15fee1e640 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f15f00b7020 0x7f15f00ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.242+0000 7f15fee1e640 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f15f00b7020 0x7f15f00ae430 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.243+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f15f80083e0 con 0x7f15f00b7020 2024-09-18T01:27:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.243+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916c96c0 2024-09-18T01:27:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.243+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f80083e0 con 0x562c916c96c0 2024-09-18T01:27:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.243+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916c96c0 2024-09-18T01:27:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.243+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8026040 con 0x562c916c96c0 2024-09-18T01:27:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.243+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x7f15f00b7020 2024-09-18T01:27:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.243+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8026040 con 0x7f15f00b7020 2024-09-18T01:27:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.243+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x7f15f00b7020 2024-09-18T01:27:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.244+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8026040 con 0x7f15f00b7020 2024-09-18T01:27:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.244+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916cdd30 2024-09-18T01:27:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.244+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.244+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916d26c0 2024-09-18T01:27:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.244+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.244+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916c96c0 2024-09-18T01:27:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.244+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8026040 con 0x562c916c96c0 2024-09-18T01:27:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.244+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916cdd30 2024-09-18T01:27:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.244+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.244+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916c96c0 2024-09-18T01:27:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.245+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8026040 con 0x562c916c96c0 2024-09-18T01:27:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.245+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916cdd30 2024-09-18T01:27:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.245+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.245+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916d26c0 2024-09-18T01:27:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.245+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.245+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916d26c0 2024-09-18T01:27:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.245+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.245+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x7f15f00b7020 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.246+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8026040 con 0x7f15f00b7020 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.246+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916d26c0 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.246+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.246+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916d26c0 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.246+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.246+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916c96c0 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.246+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8026040 con 0x562c916c96c0 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.246+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916c96c0 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.246+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f15f8026040 con 0x562c916c96c0 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.247+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x7f15f00b7020 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.247+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8026040 con 0x7f15f00b7020 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.247+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916d26c0 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.247+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.247+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916cdd30 2024-09-18T01:27:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.247+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.247+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916c96c0 2024-09-18T01:27:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.248+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8026040 con 0x562c916c96c0 2024-09-18T01:27:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.248+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x7f15f00b7020 2024-09-18T01:27:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.248+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.248+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916d26c0 2024-09-18T01:27:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.248+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.248+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916cdd30 2024-09-18T01:27:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.248+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.248+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916cdd30 2024-09-18T01:27:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.249+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.249+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916d26c0 2024-09-18T01:27:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.249+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.249+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x7f15f00b7020 2024-09-18T01:27:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.249+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.249+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916c96c0 2024-09-18T01:27:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.249+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.249+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c916ccfd0 con 0x562c916cdd30 2024-09-18T01:27:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f1602928800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f1602928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f1602928800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f1602928800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f1602928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f1602928800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f1602928800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c916d0ad0 con 0x562c916c96c0 2024-09-18T01:27:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f1602928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f1602928800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c916d0ec0 con 0x562c916c96c0 2024-09-18T01:27:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f1602928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f1602928800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.250+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c916d0ec0 con 0x7f15f00b7020 2024-09-18T01:27:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 20 zone default found 2024-09-18T01:27:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 4 Realm: () 2024-09-18T01:27:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 20 zonegroup default 2024-09-18T01:27:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c916d1b90 con 0x7f15f00b7020 2024-09-18T01:27:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c916d70b0 con 0x562c916d26c0 2024-09-18T01:27:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c916d7450 con 0x562c916d26c0 2024-09-18T01:27:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 20 started sync module instance, tier type = 2024-09-18T01:27:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.251+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916d6550 con 0x562c916cdd30 2024-09-18T01:27:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.253+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.253+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94749418416448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916d7ca0 con 0x562c916cdd30 2024-09-18T01:27:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.253+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916d84f0 con 0x562c916c96c0 2024-09-18T01:27:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.254+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94749418416448] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.254+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.254+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94749418420208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916d84f0 con 0x562c916c96c0 2024-09-18T01:27:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.254+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916d8fc0 con 0x562c916d26c0 2024-09-18T01:27:14.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.255+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94749418420208] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.255+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.255+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94749418422336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916d8460 con 0x562c916d26c0 2024-09-18T01:27:14.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.255+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916d9e80 con 0x562c916cdd30 2024-09-18T01:27:14.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.256+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94749418422336] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.256+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.256+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94749418428880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916d9df0 con 0x562c916cdd30 2024-09-18T01:27:14.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.256+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916dad40 con 0x562c916c96c0 2024-09-18T01:27:14.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.257+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.257+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94749418432656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916db160 con 0x562c916c96c0 2024-09-18T01:27:14.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.257+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916dbbc0 con 0x7f15f00b7020 2024-09-18T01:27:14.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.257+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94749418428880] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.258+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.258+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94749418431088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916dbb80 con 0x7f15f00b7020 2024-09-18T01:27:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.258+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916dc600 con 0x7f15f00b7020 2024-09-18T01:27:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.258+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94749418432656] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.259+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(56 notify.6 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.259+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94749418433712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916dc600 con 0x7f15f00b7020 2024-09-18T01:27:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.259+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916dcfc0 con 0x7f15f00b7020 2024-09-18T01:27:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.259+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94749418431088] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.260+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94749418433712] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.260+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.260+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94749418438992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916dc570 con 0x7f15f00b7020 2024-09-18T01:27:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.260+0000 7f1602928800 20 add_watcher() i=0 2024-09-18T01:27:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.260+0000 7f1602928800 20 add_watcher() i=1 2024-09-18T01:27:14.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.260+0000 7f1602928800 20 add_watcher() i=2 2024-09-18T01:27:14.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.260+0000 7f1602928800 20 add_watcher() i=3 2024-09-18T01:27:14.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.260+0000 7f1602928800 20 add_watcher() i=4 2024-09-18T01:27:14.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.260+0000 7f1602928800 20 add_watcher() i=5 2024-09-18T01:27:14.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.260+0000 7f1602928800 20 add_watcher() i=6 2024-09-18T01:27:14.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.261+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94749418438992] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.261+0000 7f1602928800 20 add_watcher() i=7 2024-09-18T01:27:14.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.261+0000 7f1602928800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:14.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.261+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c916dfff0 con 0x562c916c96c0 2024-09-18T01:27:14.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.262+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.262+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94749418441488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c916dd3e0 con 0x562c916c96c0 2024-09-18T01:27:14.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.263+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94749418441488] v35'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.263+0000 7f14b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:14.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.263+0000 7f1602928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:14.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.263+0000 7f1602928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:14.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.263+0000 7f1602928800 5 note: GC not initialized 2024-09-18T01:27:14.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.263+0000 7f142f7fe640 20 reqs_thread_entry: start 2024-09-18T01:27:14.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.263+0000 7f1602928800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:14.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.263+0000 7f1602928800 20 Filter name: none 2024-09-18T01:27:14.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.263+0000 7f142d7fa640 20 reqs_thread_entry: start 2024-09-18T01:27:14.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.263+0000 7f1602928800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:27:14.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.263+0000 7f1602928800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.263+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c91713300 con 0x7f15f00b7020 2024-09-18T01:27:14.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.264+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.264+0000 7f1602928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.264+0000 7f1602928800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-18T01:27:14.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.264+0000 7f1602928800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:14.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.264+0000 7f1602928800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-18T01:27:14.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.264+0000 7f1602928800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.264+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c91711940 con 0x562c916c96c0 2024-09-18T01:27:14.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.264+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.264+0000 7f1602928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.264+0000 7f1602928800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-18T01:27:14.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.264+0000 7f1602928800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-18T01:27:14.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.264+0000 7f1602928800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-18T01:27:14.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.264+0000 7f1602928800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-18T01:27:14.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.264+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c91712230 con 0x7f15f00b7020 2024-09-18T01:27:14.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.266+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v35'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.266+0000 7f1602928800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:14.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.266+0000 7f1602928800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:14.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.266+0000 7f1602928800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:27:14.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.266+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94749418659200 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c91716da0 con 0x562c916c96c0 2024-09-18T01:27:14.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.266+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== watch-notify(notify (1) cookie 94749418432656 notify 150323855405 ret 0) ==== 691+0+0 (crc 0 0 0) 0x562c917125d0 con 0x562c916c96c0 2024-09-18T01:27:14.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.266+0000 7f14e1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855405 cookie 94749418432656 notifier 4839 bl.length()=649 2024-09-18T01:27:14.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.266+0000 7f14e1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:14.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.266+0000 7f14e1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:14.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.266+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.4 [notify cookie 94749418659200 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.266+0000 7f14e1ffb640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f14c4003ea0 con 0x562c916c96c0 2024-09-18T01:27:14.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.266+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.266+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== watch-notify(notify_complete (2) cookie 94749418659200 notify 150323855405 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562c91712d90 con 0x562c916c96c0 2024-09-18T01:27:14.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.266+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c917148d0 con 0x562c916c96c0 2024-09-18T01:27:14.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.267+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v35'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.267+0000 7f1602928800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-18T01:27:14.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.267+0000 7f1602928800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-18T01:27:14.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.267+0000 7f1602928800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-18T01:27:14.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.267+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94749418659120 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c917171b0 con 0x562c916d26c0 2024-09-18T01:27:14.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.268+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== watch-notify(notify (1) cookie 94749418422336 notify 150323855368 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f15e8001e10 con 0x562c916d26c0 2024-09-18T01:27:14.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.268+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(68 notify.2 [notify cookie 94749418659120 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.268+0000 7f14e1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855368 cookie 94749418422336 notifier 4839 bl.length()=177 2024-09-18T01:27:14.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.268+0000 7f14e1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-18T01:27:14.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.268+0000 7f14e1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-18T01:27:14.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.268+0000 7f14e1ffb640 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f14c4003ea0 con 0x562c916d26c0 2024-09-18T01:27:14.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.268+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== watch-notify(notify_complete (2) cookie 94749418659120 notify 150323855368 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f15f4038430 con 0x562c916d26c0 2024-09-18T01:27:14.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.268+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.285 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:27:14.265685Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:27:14.265676Z","tags":[],"group_ids":[]} 2024-09-18T01:27:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.269+0000 7f14b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.269+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94749418441488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c91710fe0 con 0x562c916c96c0 2024-09-18T01:27:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.270+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94749418441488] v35'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.270+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94749418416448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c91710fe0 con 0x562c916cdd30 2024-09-18T01:27:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.271+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94749418416448] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.271+0000 7f1602928800 20 remove_watcher() i=0 2024-09-18T01:27:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.271+0000 7f1602928800 2 removed watcher, disabling cache 2024-09-18T01:27:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.271+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94749418420208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c91710fe0 con 0x562c916c96c0 2024-09-18T01:27:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.272+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94749418420208] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.272+0000 7f1602928800 20 remove_watcher() i=1 2024-09-18T01:27:14.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.272+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94749418422336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c91710fe0 con 0x562c916d26c0 2024-09-18T01:27:14.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.273+0000 7f15fde1c640 1 -- 172.21.15.100:0/553081882 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94749418422336] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f4009050 con 0x562c916d26c0 2024-09-18T01:27:14.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.273+0000 7f1602928800 20 remove_watcher() i=2 2024-09-18T01:27:14.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.273+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94749418428880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c91710fe0 con 0x562c916cdd30 2024-09-18T01:27:14.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.274+0000 7f15fe61d640 1 -- 172.21.15.100:0/553081882 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94749418428880] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f008ed70 con 0x562c916cdd30 2024-09-18T01:27:14.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.274+0000 7f1602928800 20 remove_watcher() i=3 2024-09-18T01:27:14.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.275+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94749418432656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c91710fe0 con 0x562c916c96c0 2024-09-18T01:27:14.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.275+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94749418432656] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x562c916c96c0 2024-09-18T01:27:14.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.276+0000 7f1602928800 20 remove_watcher() i=4 2024-09-18T01:27:14.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.276+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94749418431088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c91710fe0 con 0x7f15f00b7020 2024-09-18T01:27:14.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.277+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94749418431088] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.277+0000 7f1602928800 20 remove_watcher() i=5 2024-09-18T01:27:14.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.277+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94749418433712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c91710fe0 con 0x7f15f00b7020 2024-09-18T01:27:14.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.278+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94749418433712] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.278+0000 7f1602928800 20 remove_watcher() i=6 2024-09-18T01:27:14.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.278+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94749418438992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c91710fe0 con 0x7f15f00b7020 2024-09-18T01:27:14.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94749418438992] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8037040 con 0x7f15f00b7020 2024-09-18T01:27:14.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 20 remove_watcher() i=7 2024-09-18T01:27:14.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f15f00b7020 msgr2=0x7f15f00ae430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f15f00b7020 0x7f15f00ae430 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562c916c96c0 msgr2=0x562c916cbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562c916c96c0 0x562c916cbb80 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562c916cdd30 msgr2=0x562c916d0120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562c916cdd30 0x562c916d0120 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562c916d26c0 msgr2=0x562c916d4b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562c916d26c0 0x562c916d4b80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14c8036b90 msgr2=0x7f14c8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14c8036b90 0x7f14c8039050 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x562c91691f80 tx=0x7f15f4010000 comp rx=0 tx=0).stop 2024-09-18T01:27:14.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c916b6c30 msgr2=0x562c916bdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f15fee1e640 1 -- 172.21.15.100:0/553081882 reap_dead start 2024-09-18T01:27:14.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c916b6c30 0x562c916bdee0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f15f005a650 tx=0x7f15f006df30 comp rx=0 tx=0).stop 2024-09-18T01:27:14.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 shutdown_connections 2024-09-18T01:27:14.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 --2- 172.21.15.100:0/553081882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c916b6c30 0x562c916bdee0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 >> 172.21.15.100:0/553081882 conn(0x562c916b2f90 msgr2=0x562c916b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 shutdown_connections 2024-09-18T01:27:14.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.279+0000 7f1602928800 1 -- 172.21.15.100:0/553081882 wait complete. 2024-09-18T01:27:14.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/3348695763 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14d8036b90 msgr2=0x7f14d8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 --2- 172.21.15.100:0/3348695763 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14d8036b90 0x7f14d8039050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f15f400bf90 tx=0x7f15f400f000 comp rx=0 tx=0).stop 2024-09-18T01:27:14.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/3348695763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91593be0 msgr2=0x562c91592230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 --2- 172.21.15.100:0/3348695763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91593be0 0x562c91592230 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f15f008ec30 tx=0x7f15f006caa0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/3348695763 shutdown_connections 2024-09-18T01:27:14.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 --2- 172.21.15.100:0/3348695763 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14d8036b90 0x7f14d8039050 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 --2- 172.21.15.100:0/3348695763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91593be0 0x562c91592230 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/3348695763 >> 172.21.15.100:0/3348695763 conn(0x562c9169d0e0 msgr2=0x562c9169fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/3348695763 shutdown_connections 2024-09-18T01:27:14.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/3348695763 wait complete. 2024-09-18T01:27:14.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562c916978f0 msgr2=0x562c91699ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562c916978f0 0x562c91699ce0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562c91596750 msgr2=0x562c91691080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562c91596750 0x562c91691080 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562c916939d0 msgr2=0x562c91695dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562c916939d0 0x562c91695dc0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14e4036b90 msgr2=0x7f14e4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f14e4036b90 0x7f14e4039050 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f15f4000f60 tx=0x7f15f40010a0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 msgr2=0x562c9168a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 --2- 172.21.15.100:0/1135284651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c91507680 0x562c9168a010 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f15f0005fd0 tx=0x7f15f0003330 comp rx=0 tx=0).stop 2024-09-18T01:27:14.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f15fee1e640 1 -- 172.21.15.100:0/1135284651 reap_dead start 2024-09-18T01:27:14.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 shutdown_connections 2024-09-18T01:27:14.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 >> 172.21.15.100:0/1135284651 conn(0x562c9158dde0 msgr2=0x562c9167ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 shutdown_connections 2024-09-18T01:27:14.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.280+0000 7f1602928800 1 -- 172.21.15.100:0/1135284651 wait complete. 2024-09-18T01:27:14.296 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:14.297 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:14.297 ERROR:root:0 2024-09-18T01:27:14.298 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:14.304 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000bf648ae6c6272d48-0066ea2c72-4237-default', 'HostId': '4237-default-default'} 2024-09-18T01:27:14.304 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-18T01:27:14.314 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:14.315 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-18T01:27:14.326 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-18T01:27:14.327 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-18T01:27:14.341 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-18T01:27:14.341 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-18T01:27:14.348 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-18T01:27:14.349 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:14.352 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:14.352 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-18T01:27:14.356 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:14.356 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:27:14.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:27:14.357 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-18T01:27:14.403 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:14.403 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:14.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.403+0000 7fa564951800 1 Processor -- start 2024-09-18T01:27:14.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.403+0000 7fa564951800 1 -- start start 2024-09-18T01:27:14.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.403+0000 7fa564951800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ae0ed2d920 0x55ae0ed2fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.403+0000 7fa564951800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ae0ebe9b30 con 0x55ae0ed294e0 2024-09-18T01:27:14.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.403+0000 7fa564951800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55ae0ebcb360 con 0x55ae0ed2d920 2024-09-18T01:27:14.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.403+0000 7fa559c44640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ae0ed2d920 0x55ae0ed2fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.403+0000 7fa562445640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55ae0ed294e0 0x55ae0ed298e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37182/0 (socket says 172.21.15.100:37182) 2024-09-18T01:27:14.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.403+0000 7fa562445640 1 -- 172.21.15.100:0/4287114514 learned_addr learned my addr 172.21.15.100:0/4287114514 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:14.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.404+0000 7fa559c44640 1 -- 172.21.15.100:0/4287114514 >> v1:172.21.15.92:6789/0 conn(0x55ae0ed294e0 legacy=0x55ae0ed298e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.404+0000 7fa561c44640 1 -- 172.21.15.100:0/4287114514 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1397988029 0 0) 0x55ae0ebe9b30 con 0x55ae0ed294e0 2024-09-18T01:27:14.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.404+0000 7fa559c44640 1 -- 172.21.15.100:0/4287114514 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae0ebf1e00 con 0x55ae0ed2d920 2024-09-18T01:27:14.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.405+0000 7fa559c44640 1 --2- 172.21.15.100:0/4287114514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed2d920 0x55ae0ed2fd10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00a470 tx=0x7fa54c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b592b0d28f5c32 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.406+0000 7fa561c44640 1 -- 172.21.15.100:0/4287114514 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa54c053570 con 0x55ae0ed2d920 2024-09-18T01:27:14.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.406+0000 7fa561c44640 1 -- 172.21.15.100:0/4287114514 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54c058070 con 0x55ae0ed2d920 2024-09-18T01:27:14.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.406+0000 7fa561c44640 1 -- 172.21.15.100:0/4287114514 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa54c053880 con 0x55ae0ed2d920 2024-09-18T01:27:14.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.406+0000 7fa564951800 1 -- 172.21.15.100:0/4287114514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed2d920 msgr2=0x55ae0ed2fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.406+0000 7fa564951800 1 --2- 172.21.15.100:0/4287114514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed2d920 0x55ae0ed2fd10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00a470 tx=0x7fa54c045a20 comp rx=0 tx=0).stop 2024-09-18T01:27:14.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.406+0000 7fa564951800 1 -- 172.21.15.100:0/4287114514 shutdown_connections 2024-09-18T01:27:14.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.406+0000 7fa564951800 1 --2- 172.21.15.100:0/4287114514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed2d920 0x55ae0ed2fd10 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.406+0000 7fa564951800 1 -- 172.21.15.100:0/4287114514 >> 172.21.15.100:0/4287114514 conn(0x55ae0ed24dd0 msgr2=0x55ae0ed271f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.406+0000 7fa564951800 1 -- 172.21.15.100:0/4287114514 shutdown_connections 2024-09-18T01:27:14.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.406+0000 7fa564951800 1 -- 172.21.15.100:0/4287114514 wait complete. 2024-09-18T01:27:14.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.420+0000 7fa564951800 1 Processor -- start 2024-09-18T01:27:14.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.420+0000 7fa564951800 1 -- start start 2024-09-18T01:27:14.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.420+0000 7fa564951800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed294e0 0x55ae0ec9dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.420+0000 7fa564951800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ec76360 con 0x55ae0ed294e0 2024-09-18T01:27:14.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.420+0000 7fa562445640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed294e0 0x55ae0ec9dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.420+0000 7fa562445640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed294e0 0x55ae0ec9dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45412/0 (socket says 172.21.15.100:45412) 2024-09-18T01:27:14.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.420+0000 7fa562445640 1 -- 172.21.15.100:0/1273738502 learned_addr learned my addr 172.21.15.100:0/1273738502 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.421+0000 7fa562445640 1 -- 172.21.15.100:0/1273738502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae0ebc3bc0 con 0x55ae0ed294e0 2024-09-18T01:27:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.421+0000 7fa562445640 1 --2- 172.21.15.100:0/1273738502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed294e0 0x55ae0ec9dd80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa55400b240 tx=0x7fa55400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03b9cd0f27d0960 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.421+0000 7fa450608640 1 -- 172.21.15.100:0/1273738502 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa554008070 con 0x55ae0ed294e0 2024-09-18T01:27:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.421+0000 7fa450608640 1 -- 172.21.15.100:0/1273738502 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55400d500 con 0x55ae0ed294e0 2024-09-18T01:27:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.421+0000 7fa450608640 1 -- 172.21.15.100:0/1273738502 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa55400d860 con 0x55ae0ed294e0 2024-09-18T01:27:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.422+0000 7fa564951800 1 -- 172.21.15.100:0/1273738502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed294e0 msgr2=0x55ae0ec9dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.422+0000 7fa564951800 1 --2- 172.21.15.100:0/1273738502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed294e0 0x55ae0ec9dd80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa55400b240 tx=0x7fa55400b700 comp rx=0 tx=0).stop 2024-09-18T01:27:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.422+0000 7fa564951800 1 -- 172.21.15.100:0/1273738502 shutdown_connections 2024-09-18T01:27:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.422+0000 7fa564951800 1 --2- 172.21.15.100:0/1273738502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed294e0 0x55ae0ec9dd80 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.422+0000 7fa564951800 1 -- 172.21.15.100:0/1273738502 >> 172.21.15.100:0/1273738502 conn(0x55ae0ed24dd0 msgr2=0x55ae0ee13f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.422+0000 7fa564951800 1 -- 172.21.15.100:0/1273738502 shutdown_connections 2024-09-18T01:27:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.422+0000 7fa564951800 1 -- 172.21.15.100:0/1273738502 wait complete. 2024-09-18T01:27:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.422+0000 7fa564951800 1 Processor -- start 2024-09-18T01:27:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.422+0000 7fa564951800 1 -- start start 2024-09-18T01:27:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.422+0000 7fa564951800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed2d920 0x55ae0ee19d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.422+0000 7fa564951800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ed30550 con 0x55ae0ed2d920 2024-09-18T01:27:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.423+0000 7fa562445640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed2d920 0x55ae0ee19d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.423+0000 7fa562445640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed2d920 0x55ae0ee19d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45418/0 (socket says 172.21.15.100:45418) 2024-09-18T01:27:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.423+0000 7fa562445640 1 -- 172.21.15.100:0/1995254997 learned_addr learned my addr 172.21.15.100:0/1995254997 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.423+0000 7fa562445640 1 -- 172.21.15.100:0/1995254997 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae0ebd7fe0 con 0x55ae0ed2d920 2024-09-18T01:27:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.423+0000 7fa562445640 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed2d920 0x55ae0ee19d10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x55ae0ec9d480 tx=0x7fa554000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.423+0000 7fa44ee05640 1 -- 172.21.15.100:0/1995254997 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5540197b0 con 0x55ae0ed2d920 2024-09-18T01:27:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.423+0000 7fa44ee05640 1 -- 172.21.15.100:0/1995254997 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa554019950 con 0x55ae0ed2d920 2024-09-18T01:27:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.423+0000 7fa44ee05640 1 -- 172.21.15.100:0/1995254997 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa554019c30 con 0x55ae0ed2d920 2024-09-18T01:27:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.423+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae0ee18400 con 0x55ae0ed2d920 2024-09-18T01:27:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.423+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae0ee18920 con 0x55ae0ed2d920 2024-09-18T01:27:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.424+0000 7fa44ee05640 1 -- 172.21.15.100:0/1995254997 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa554017040 con 0x55ae0ed2d920 2024-09-18T01:27:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.424+0000 7fa44ee05640 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa448036b90 0x7fa448039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.424+0000 7fa44ee05640 1 -- 172.21.15.100:0/1995254997 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fa554015020 con 0x55ae0ed2d920 2024-09-18T01:27:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.424+0000 7fa559c44640 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa448036b90 0x7fa448039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.424+0000 7fa564951800 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae0ee286e0 0x55ae0ee2aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.424+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee2b010 con 0x55ae0ee286e0 2024-09-18T01:27:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.425+0000 7fa562c46640 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae0ee286e0 0x55ae0ee2aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.425+0000 7fa559c44640 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa448036b90 0x7fa448039050 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa54c057000 tx=0x7fa54c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.425+0000 7fa562c46640 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae0ee286e0 0x55ae0ee2aad0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.425+0000 7fa562c46640 1 -- 172.21.15.100:0/1995254997 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee286e0 2024-09-18T01:27:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.425+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee2b860 con 0x55ae0ee286e0 2024-09-18T01:27:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.425+0000 7fa562c46640 1 -- 172.21.15.100:0/1995254997 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee286e0 2024-09-18T01:27:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.425+0000 7fa564951800 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae0ee2d1b0 0x55ae0ee2f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.425+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee2fde0 con 0x55ae0ee2d1b0 2024-09-18T01:27:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.425+0000 7fa562445640 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae0ee2d1b0 0x55ae0ee2f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.426+0000 7fa562445640 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae0ee2d1b0 0x55ae0ee2f650 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.426+0000 7fa562445640 1 -- 172.21.15.100:0/1995254997 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee2d1b0 2024-09-18T01:27:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.426+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee2c0b0 con 0x55ae0ee286e0 2024-09-18T01:27:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.426+0000 7fa562c46640 1 -- 172.21.15.100:0/1995254997 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee286e0 2024-09-18T01:27:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.426+0000 7fa564951800 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ae0ee31240 0x55ae0ee33630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.426+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee33d20 con 0x55ae0ee31240 2024-09-18T01:27:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.427+0000 7fa559c44640 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ae0ee31240 0x55ae0ee33630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.427+0000 7fa559c44640 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ae0ee31240 0x55ae0ee33630 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.427+0000 7fa559c44640 1 -- 172.21.15.100:0/1995254997 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee31240 2024-09-18T01:27:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.427+0000 7fa564951800 1 Processor -- start 2024-09-18T01:27:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.427+0000 7fa564951800 1 -- start start 2024-09-18T01:27:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.428+0000 7fa564951800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee41ad0 0x55ae0ee41ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.428+0000 7fa564951800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ee1a250 con 0x55ae0ee41ad0 2024-09-18T01:27:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.428+0000 7fa562445640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee41ad0 0x55ae0ee41ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.428+0000 7fa562445640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee41ad0 0x55ae0ee41ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45420/0 (socket says 172.21.15.100:45420) 2024-09-18T01:27:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.428+0000 7fa562445640 1 -- 172.21.15.100:0/2868615363 learned_addr learned my addr 172.21.15.100:0/2868615363 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.428+0000 7fa562445640 1 -- 172.21.15.100:0/2868615363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae0ee42430 con 0x55ae0ee41ad0 2024-09-18T01:27:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.428+0000 7fa562445640 1 --2- 172.21.15.100:0/2868615363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee41ad0 0x55ae0ee41ef0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa55401af90 tx=0x7fa55404bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.428+0000 7fa447fff640 1 -- 172.21.15.100:0/2868615363 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa55401bae0 con 0x55ae0ee41ad0 2024-09-18T01:27:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.428+0000 7fa447fff640 1 -- 172.21.15.100:0/2868615363 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55401b440 con 0x55ae0ee41ad0 2024-09-18T01:27:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.428+0000 7fa447fff640 1 -- 172.21.15.100:0/2868615363 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa55400f3f0 con 0x55ae0ee41ad0 2024-09-18T01:27:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.428+0000 7fa564951800 1 -- 172.21.15.100:0/2868615363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae0ee426c0 con 0x55ae0ee41ad0 2024-09-18T01:27:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.429+0000 7fa564951800 1 -- 172.21.15.100:0/2868615363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae0ee453a0 con 0x55ae0ee41ad0 2024-09-18T01:27:14.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.429+0000 7fa447fff640 1 -- 172.21.15.100:0/2868615363 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa55400f590 con 0x55ae0ee41ad0 2024-09-18T01:27:14.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.429+0000 7fa447fff640 1 --2- 172.21.15.100:0/2868615363 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa43c036b90 0x7fa43c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.429+0000 7fa447fff640 1 -- 172.21.15.100:0/2868615363 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fa55403ad90 con 0x55ae0ee41ad0 2024-09-18T01:27:14.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.429+0000 7fa559c44640 1 --2- 172.21.15.100:0/2868615363 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa43c036b90 0x7fa43c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.430+0000 7fa564951800 1 Processor -- start 2024-09-18T01:27:14.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.430+0000 7fa559c44640 1 --2- 172.21.15.100:0/2868615363 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa43c036b90 0x7fa43c039050 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55ae0ee19390 tx=0x7fa54c005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.430+0000 7fa564951800 1 -- start start 2024-09-18T01:27:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.430+0000 7fa564951800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee4e710 0x55ae0ee4eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.430+0000 7fa564951800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ebc5580 con 0x55ae0ee4e710 2024-09-18T01:27:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.430+0000 7fa562445640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee4e710 0x55ae0ee4eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.430+0000 7fa562445640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee4e710 0x55ae0ee4eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45426/0 (socket says 172.21.15.100:45426) 2024-09-18T01:27:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.430+0000 7fa562445640 1 -- 172.21.15.100:0/2891417579 learned_addr learned my addr 172.21.15.100:0/2891417579 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.430+0000 7fa562445640 1 -- 172.21.15.100:0/2891417579 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae0ee4f0e0 con 0x55ae0ee4e710 2024-09-18T01:27:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.431+0000 7fa562445640 1 --2- 172.21.15.100:0/2891417579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee4e710 0x55ae0ee4eb10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa554026040 tx=0x7fa554030ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3942c866b9db60cf server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.431+0000 7fa445ffb640 1 -- 172.21.15.100:0/2891417579 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa55405f070 con 0x55ae0ee4e710 2024-09-18T01:27:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.431+0000 7fa445ffb640 1 -- 172.21.15.100:0/2891417579 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa554013e30 con 0x55ae0ee4e710 2024-09-18T01:27:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.431+0000 7fa445ffb640 1 -- 172.21.15.100:0/2891417579 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa55401fe10 con 0x55ae0ee4e710 2024-09-18T01:27:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.431+0000 7fa564951800 1 -- 172.21.15.100:0/2891417579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee4e710 msgr2=0x55ae0ee4eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.431+0000 7fa564951800 1 --2- 172.21.15.100:0/2891417579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee4e710 0x55ae0ee4eb10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa554026040 tx=0x7fa554030ba0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.431+0000 7fa564951800 1 -- 172.21.15.100:0/2891417579 shutdown_connections 2024-09-18T01:27:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.431+0000 7fa564951800 1 --2- 172.21.15.100:0/2891417579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee4e710 0x55ae0ee4eb10 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.431+0000 7fa564951800 1 -- 172.21.15.100:0/2891417579 >> 172.21.15.100:0/2891417579 conn(0x55ae0ee4ab00 msgr2=0x55ae0ee48c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.431+0000 7fa564951800 1 -- 172.21.15.100:0/2891417579 shutdown_connections 2024-09-18T01:27:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.431+0000 7fa564951800 1 -- 172.21.15.100:0/2891417579 wait complete. 2024-09-18T01:27:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.432+0000 7fa564951800 1 Processor -- start 2024-09-18T01:27:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.432+0000 7fa564951800 1 -- start start 2024-09-18T01:27:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.432+0000 7fa564951800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee4e710 0x55ae0ee558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.432+0000 7fa564951800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ee4f570 con 0x55ae0ee4e710 2024-09-18T01:27:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.432+0000 7fa562445640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee4e710 0x55ae0ee558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.432+0000 7fa562445640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee4e710 0x55ae0ee558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45428/0 (socket says 172.21.15.100:45428) 2024-09-18T01:27:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.432+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 learned_addr learned my addr 172.21.15.100:0/2392000387 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.432+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae0ee55e30 con 0x55ae0ee4e710 2024-09-18T01:27:14.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.432+0000 7fa562445640 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee4e710 0x55ae0ee558f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa55400fe00 tx=0x7fa554036fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.432+0000 7fa433fff640 1 -- 172.21.15.100:0/2392000387 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa55406a020 con 0x55ae0ee4e710 2024-09-18T01:27:14.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.432+0000 7fa433fff640 1 -- 172.21.15.100:0/2392000387 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa554050e30 con 0x55ae0ee4e710 2024-09-18T01:27:14.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.432+0000 7fa433fff640 1 -- 172.21.15.100:0/2392000387 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa55405f030 con 0x55ae0ee4e710 2024-09-18T01:27:14.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.432+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae0ee55e30 con 0x55ae0ee4e710 2024-09-18T01:27:14.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.433+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae0ee55e30 con 0x55ae0ee4e710 2024-09-18T01:27:14.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.433+0000 7fa433fff640 1 -- 172.21.15.100:0/2392000387 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa55406d020 con 0x55ae0ee4e710 2024-09-18T01:27:14.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.434+0000 7fa433fff640 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa42c036b40 0x7fa42c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.434+0000 7fa433fff640 1 -- 172.21.15.100:0/2392000387 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fa554060070 con 0x55ae0ee4e710 2024-09-18T01:27:14.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.434+0000 7fa559c44640 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa42c036b40 0x7fa42c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.434+0000 7fa559c44640 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa42c036b40 0x7fa42c039000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55ae0ee34120 tx=0x7fa54c06b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.434+0000 7fa564951800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.434+0000 7fa564951800 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae0ee60f20 0x55ae0ee633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.434+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee63b30 con 0x55ae0ee60f20 2024-09-18T01:27:14.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.434+0000 7fa562c46640 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae0ee60f20 0x55ae0ee633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa562c46640 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae0ee60f20 0x55ae0ee633e0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa564951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa564951800 20 realm 2024-09-18T01:27:14.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa564951800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee63f40 con 0x55ae0ee60f20 2024-09-18T01:27:14.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa564951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa564951800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:14.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa564951800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64810 con 0x55ae0ee60f20 2024-09-18T01:27:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa564951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa564951800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee60f20 2024-09-18T01:27:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.435+0000 7fa564951800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.436+0000 7fa564951800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.436+0000 7fa564951800 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae0ee65910 0x55ae0ee67d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.436+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee68310 con 0x55ae0ee65910 2024-09-18T01:27:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.436+0000 7fa562445640 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae0ee65910 0x55ae0ee67d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.436+0000 7fa562445640 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae0ee65910 0x55ae0ee67d00 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.436+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.436+0000 7fa564951800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.436+0000 7fa564951800 20 searching for the correct realm 2024-09-18T01:27:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.436+0000 7fa564951800 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ae0ee6a2a0 0x55ae0ee6c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.436+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee6ce30 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.436+0000 7fa559c44640 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ae0ee6a2a0 0x55ae0ee6c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.437+0000 7fa559c44640 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ae0ee6a2a0 0x55ae0ee6c760 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.437+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.437+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee6ce30 con 0x55ae0ee65910 2024-09-18T01:27:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.437+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.437+0000 7fa562445640 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa55406f020 0x7fa5540504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.437+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee6ce30 con 0x7fa55406f020 2024-09-18T01:27:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.437+0000 7fa562c46640 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa55406f020 0x7fa5540504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.438+0000 7fa562c46640 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa55406f020 0x7fa5540504b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.438+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.438+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee60f20 2024-09-18T01:27:14.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.438+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.438+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee60f20 2024-09-18T01:27:14.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.438+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.438+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x7fa55406f020 2024-09-18T01:27:14.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.438+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.438+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x7fa55406f020 2024-09-18T01:27:14.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.439+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.439+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee65910 2024-09-18T01:27:14.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.439+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.439+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.439+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.439+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee60f20 2024-09-18T01:27:14.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.439+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.439+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee65910 2024-09-18T01:27:14.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.440+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.440+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee60f20 2024-09-18T01:27:14.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.440+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.440+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee65910 2024-09-18T01:27:14.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.440+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.440+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.440+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.440+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.441+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.441+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x7fa55406f020 2024-09-18T01:27:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.441+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.441+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.441+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.441+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.441+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.441+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee60f20 2024-09-18T01:27:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.442+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.442+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee60f20 2024-09-18T01:27:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.442+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.442+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x7fa55406f020 2024-09-18T01:27:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.442+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.442+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.442+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.442+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee65910 2024-09-18T01:27:14.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.443+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.443+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee60f20 2024-09-18T01:27:14.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.443+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.443+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x7fa55406f020 2024-09-18T01:27:14.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.443+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.443+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.443+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.443+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee65910 2024-09-18T01:27:14.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.444+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.444+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee65910 2024-09-18T01:27:14.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.444+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.444+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.444+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.444+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x7fa55406f020 2024-09-18T01:27:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.444+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.444+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee60f20 2024-09-18T01:27:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee64bb0 con 0x55ae0ee65910 2024-09-18T01:27:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa564951800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa564951800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa564951800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa564951800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa564951800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa564951800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa564951800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee68bd0 con 0x55ae0ee60f20 2024-09-18T01:27:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa564951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa564951800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee68fc0 con 0x55ae0ee60f20 2024-09-18T01:27:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa564951800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa564951800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.445+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee68fc0 con 0x7fa55406f020 2024-09-18T01:27:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 20 zone default found 2024-09-18T01:27:14.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 4 Realm: () 2024-09-18T01:27:14.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:14.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:14.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:14.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 20 zonegroup default 2024-09-18T01:27:14.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee68830 con 0x7fa55406f020 2024-09-18T01:27:14.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee68830 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.446+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee6ed60 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.447+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.447+0000 7fa564951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.447+0000 7fa564951800 20 started sync module instance, tier type = 2024-09-18T01:27:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.447+0000 7fa564951800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.447+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee6e130 con 0x55ae0ee65910 2024-09-18T01:27:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.448+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.448+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206062683424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee6f670 con 0x55ae0ee65910 2024-09-18T01:27:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.448+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee6fec0 con 0x55ae0ee60f20 2024-09-18T01:27:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.449+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94206062683424] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.449+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.449+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94206062686656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee6fb50 con 0x55ae0ee60f20 2024-09-18T01:27:14.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.449+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee70650 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.451+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.451+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94206062686656] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.451+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94206062687712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee70a70 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.451+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee714b0 con 0x55ae0ee65910 2024-09-18T01:27:14.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.452+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.452+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206062694272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee71d50 con 0x55ae0ee65910 2024-09-18T01:27:14.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.452+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee72850 con 0x55ae0ee60f20 2024-09-18T01:27:14.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.452+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94206062687712] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.453+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94206062694272] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.453+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.453+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206062699328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee718a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.453+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee730f0 con 0x7fa55406f020 2024-09-18T01:27:14.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.454+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.454+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206062701376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee73410 con 0x7fa55406f020 2024-09-18T01:27:14.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.454+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee73ca0 con 0x7fa55406f020 2024-09-18T01:27:14.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.454+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94206062699328] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.455+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94206062701376] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.455+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.455+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94206062690624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee73410 con 0x7fa55406f020 2024-09-18T01:27:14.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.455+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee74540 con 0x7fa55406f020 2024-09-18T01:27:14.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.456+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94206062690624] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.456+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.456+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206062702432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee73380 con 0x7fa55406f020 2024-09-18T01:27:14.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.456+0000 7fa564951800 20 add_watcher() i=0 2024-09-18T01:27:14.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.456+0000 7fa564951800 20 add_watcher() i=1 2024-09-18T01:27:14.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.456+0000 7fa564951800 20 add_watcher() i=2 2024-09-18T01:27:14.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.456+0000 7fa564951800 20 add_watcher() i=3 2024-09-18T01:27:14.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.456+0000 7fa564951800 20 add_watcher() i=4 2024-09-18T01:27:14.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.456+0000 7fa564951800 20 add_watcher() i=5 2024-09-18T01:27:14.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.456+0000 7fa564951800 20 add_watcher() i=6 2024-09-18T01:27:14.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.457+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94206062702432] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.457+0000 7fa564951800 20 add_watcher() i=7 2024-09-18T01:27:14.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.457+0000 7fa564951800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:14.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.457+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee77550 con 0x55ae0ee60f20 2024-09-18T01:27:14.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.457+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.458+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94206062706752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee74a70 con 0x55ae0ee60f20 2024-09-18T01:27:14.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.459+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94206062706752] v35'247 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.459+0000 7fa418fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:14.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.459+0000 7fa564951800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:14.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.459+0000 7fa564951800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:14.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.459+0000 7fa564951800 5 note: GC not initialized 2024-09-18T01:27:14.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.459+0000 7fa3937fe640 20 reqs_thread_entry: start 2024-09-18T01:27:14.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.459+0000 7fa564951800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:14.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.459+0000 7fa564951800 20 Filter name: none 2024-09-18T01:27:14.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.459+0000 7fa3917fa640 20 reqs_thread_entry: start 2024-09-18T01:27:14.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.459+0000 7fa564951800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:27:14.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.459+0000 7fa564951800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.459+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0eeaa990 con 0x7fa55406f020 2024-09-18T01:27:14.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.460+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.460+0000 7fa564951800 20 rados_obj.operate() r=0 bl.length=473 2024-09-18T01:27:14.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.460+0000 7fa564951800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:27:14.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.460+0000 7fa564951800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:14.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.460+0000 7fa564951800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:27:14.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.460+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0eeb1340 con 0x7fa55406f020 2024-09-18T01:27:14.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.462+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v35'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.462+0000 7fa564951800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:14.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.462+0000 7fa564951800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:14.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.462+0000 7fa564951800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:27:14.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.462+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94206062955776 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ae0eeac9a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.462+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== watch-notify(notify (1) cookie 94206062699328 notify 150323855407 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fa55c026410 con 0x55ae0ee60f20 2024-09-18T01:27:14.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.462+0000 7fa445ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855407 cookie 94206062699328 notifier 4846 bl.length()=636 2024-09-18T01:27:14.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.462+0000 7fa445ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:14.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.462+0000 7fa445ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:14.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.462+0000 7fa445ffb640 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa428003ea0 con 0x55ae0ee60f20 2024-09-18T01:27:14.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.462+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 notify.4 [notify cookie 94206062955776 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.462+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.462+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== watch-notify(notify_complete (2) cookie 94206062955776 notify 150323855407 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa55c0265e0 con 0x55ae0ee60f20 2024-09-18T01:27:14.475 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:27:14.265685Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:27:14.265676Z","tags":[],"group_ids":[]} 2024-09-18T01:27:14.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.463+0000 7fa418fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:14.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.463+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94206062706752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0eea86f0 con 0x55ae0ee60f20 2024-09-18T01:27:14.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.464+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94206062706752] v35'248 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.464+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94206062683424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0eea86f0 con 0x55ae0ee65910 2024-09-18T01:27:14.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.465+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94206062683424] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.465+0000 7fa564951800 20 remove_watcher() i=0 2024-09-18T01:27:14.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.465+0000 7fa564951800 2 removed watcher, disabling cache 2024-09-18T01:27:14.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.465+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94206062686656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0eea86f0 con 0x55ae0ee60f20 2024-09-18T01:27:14.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.466+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94206062686656] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.467+0000 7fa564951800 20 remove_watcher() i=1 2024-09-18T01:27:14.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.467+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94206062687712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0eea86f0 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.467+0000 7fa559c44640 1 -- 172.21.15.100:0/2392000387 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94206062687712] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa54c051070 con 0x55ae0ee6a2a0 2024-09-18T01:27:14.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.468+0000 7fa564951800 20 remove_watcher() i=2 2024-09-18T01:27:14.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.468+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94206062694272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee6e520 con 0x55ae0ee65910 2024-09-18T01:27:14.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.468+0000 7fa562445640 1 -- 172.21.15.100:0/2392000387 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94206062694272] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55402d070 con 0x55ae0ee65910 2024-09-18T01:27:14.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.468+0000 7fa564951800 20 remove_watcher() i=3 2024-09-18T01:27:14.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.468+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94206062699328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee6e520 con 0x55ae0ee60f20 2024-09-18T01:27:14.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.469+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94206062699328] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x55ae0ee60f20 2024-09-18T01:27:14.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.469+0000 7fa564951800 20 remove_watcher() i=4 2024-09-18T01:27:14.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.469+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94206062701376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee6e520 con 0x7fa55406f020 2024-09-18T01:27:14.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.470+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94206062701376] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.470+0000 7fa564951800 20 remove_watcher() i=5 2024-09-18T01:27:14.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.470+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94206062690624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee6e520 con 0x7fa55406f020 2024-09-18T01:27:14.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.471+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94206062690624] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.471+0000 7fa564951800 20 remove_watcher() i=6 2024-09-18T01:27:14.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.471+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94206062702432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ae0ee70140 con 0x7fa55406f020 2024-09-18T01:27:14.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94206062702432] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa55c00a4a0 con 0x7fa55406f020 2024-09-18T01:27:14.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 20 remove_watcher() i=7 2024-09-18T01:27:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa55406f020 msgr2=0x7fa5540504b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fa55406f020 0x7fa5540504b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae0ee60f20 msgr2=0x55ae0ee633e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae0ee60f20 0x55ae0ee633e0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae0ee65910 msgr2=0x55ae0ee67d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae0ee65910 0x55ae0ee67d00 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ae0ee6a2a0 msgr2=0x55ae0ee6c760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ae0ee6a2a0 0x55ae0ee6c760 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa42c036b40 msgr2=0x7fa42c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa42c036b40 0x7fa42c039000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55ae0ee34120 tx=0x7fa54c06b040 comp rx=0 tx=0).stop 2024-09-18T01:27:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee4e710 msgr2=0x55ae0ee558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 --2- 172.21.15.100:0/2392000387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee4e710 0x55ae0ee558f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa55400fe00 tx=0x7fa554036fa0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 reap_dead start 2024-09-18T01:27:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa562c46640 1 -- 172.21.15.100:0/2392000387 reap_dead start 2024-09-18T01:27:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 shutdown_connections 2024-09-18T01:27:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 >> 172.21.15.100:0/2392000387 conn(0x55ae0ee4ab00 msgr2=0x55ae0ee48bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 shutdown_connections 2024-09-18T01:27:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2392000387 wait complete. 2024-09-18T01:27:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2868615363 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa43c036b90 msgr2=0x7fa43c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 --2- 172.21.15.100:0/2868615363 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa43c036b90 0x7fa43c039050 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55ae0ee19390 tx=0x7fa54c005a00 comp rx=0 tx=0).stop 2024-09-18T01:27:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2868615363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee41ad0 msgr2=0x55ae0ee41ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 --2- 172.21.15.100:0/2868615363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee41ad0 0x55ae0ee41ef0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa55401af90 tx=0x7fa55404bcd0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2868615363 shutdown_connections 2024-09-18T01:27:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 --2- 172.21.15.100:0/2868615363 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa43c036b90 0x7fa43c039050 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 --2- 172.21.15.100:0/2868615363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ee41ad0 0x55ae0ee41ef0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2868615363 >> 172.21.15.100:0/2868615363 conn(0x55ae0ee36a60 msgr2=0x55ae0ee395e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2868615363 shutdown_connections 2024-09-18T01:27:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.473+0000 7fa564951800 1 -- 172.21.15.100:0/2868615363 wait complete. 2024-09-18T01:27:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ae0ee31240 msgr2=0x55ae0ee33630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa564951800 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ae0ee31240 0x55ae0ee33630 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae0ee286e0 msgr2=0x55ae0ee2aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa564951800 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ae0ee286e0 0x55ae0ee2aad0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae0ee2d1b0 msgr2=0x55ae0ee2f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa564951800 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ae0ee2d1b0 0x55ae0ee2f650 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa448036b90 msgr2=0x7fa448039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa564951800 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fa448036b90 0x7fa448039050 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa54c057000 tx=0x7fa54c052000 comp rx=0 tx=0).stop 2024-09-18T01:27:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed2d920 msgr2=0x55ae0ee19d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa564951800 1 --2- 172.21.15.100:0/1995254997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae0ed2d920 0x55ae0ee19d10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x55ae0ec9d480 tx=0x7fa554000ed0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa562c46640 1 -- 172.21.15.100:0/1995254997 reap_dead start 2024-09-18T01:27:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 shutdown_connections 2024-09-18T01:27:14.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 >> 172.21.15.100:0/1995254997 conn(0x55ae0ed24dd0 msgr2=0x55ae0ee128a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 shutdown_connections 2024-09-18T01:27:14.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.474+0000 7fa564951800 1 -- 172.21.15.100:0/1995254997 wait complete. 2024-09-18T01:27:14.487 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:14.487 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:14.487 ERROR:root:0 2024-09-18T01:27:14.487 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-18T01:27:14.487 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-18T01:27:14.487 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-18T01:27:14.541 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:14.541 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:14.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.540+0000 7fcb4ce98800 1 Processor -- start 2024-09-18T01:27:14.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.540+0000 7fcb4ce98800 1 -- start start 2024-09-18T01:27:14.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.540+0000 7fcb4ce98800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5606a08bdba0 0x5606a08bdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.540+0000 7fcb4ce98800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5606a077db30 con 0x5606a08be4e0 2024-09-18T01:27:14.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.540+0000 7fcb4ce98800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5606a075f360 con 0x5606a08bdba0 2024-09-18T01:27:14.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.541+0000 7fcb4a98c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5606a08bdba0 0x5606a08bdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.541+0000 7fcb4218b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5606a08be4e0 0x5606a08c29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37194/0 (socket says 172.21.15.100:37194) 2024-09-18T01:27:14.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.541+0000 7fcb4218b640 1 -- 172.21.15.100:0/4294339983 learned_addr learned my addr 172.21.15.100:0/4294339983 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:14.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.541+0000 7fcb4a98c640 1 -- 172.21.15.100:0/4294339983 >> v1:172.21.15.92:6789/0 conn(0x5606a08be4e0 legacy=0x5606a08c29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.541+0000 7fcb4a98c640 1 -- 172.21.15.100:0/4294339983 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a0785e00 con 0x5606a08bdba0 2024-09-18T01:27:14.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.543+0000 7fcb4a98c640 1 --2- 172.21.15.100:0/4294339983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 0x5606a08bdfa0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00a470 tx=0x7fcb3c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5870c373481585 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.543+0000 7fcb4a18b640 1 -- 172.21.15.100:0/4294339983 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c053570 con 0x5606a08bdba0 2024-09-18T01:27:14.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.543+0000 7fcb4a18b640 1 -- 172.21.15.100:0/4294339983 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c058070 con 0x5606a08bdba0 2024-09-18T01:27:14.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.543+0000 7fcb4a18b640 1 -- 172.21.15.100:0/4294339983 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c053880 con 0x5606a08bdba0 2024-09-18T01:27:14.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.544+0000 7fcb4ce98800 1 -- 172.21.15.100:0/4294339983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 msgr2=0x5606a08bdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.544+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/4294339983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 0x5606a08bdfa0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00a470 tx=0x7fcb3c045a20 comp rx=0 tx=0).stop 2024-09-18T01:27:14.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.544+0000 7fcb4ce98800 1 -- 172.21.15.100:0/4294339983 shutdown_connections 2024-09-18T01:27:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.544+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/4294339983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 0x5606a08bdfa0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.544+0000 7fcb4ce98800 1 -- 172.21.15.100:0/4294339983 >> 172.21.15.100:0/4294339983 conn(0x5606a08b8580 msgr2=0x5606a08ba9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.544+0000 7fcb4ce98800 1 -- 172.21.15.100:0/4294339983 shutdown_connections 2024-09-18T01:27:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.544+0000 7fcb4ce98800 1 -- 172.21.15.100:0/4294339983 wait complete. 2024-09-18T01:27:14.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.557+0000 7fcb4ce98800 1 Processor -- start 2024-09-18T01:27:14.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.557+0000 7fcb4ce98800 1 -- start start 2024-09-18T01:27:14.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.558+0000 7fcb4ce98800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 0x5606a09ac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.558+0000 7fcb4ce98800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5606a080a450 con 0x5606a08bdba0 2024-09-18T01:27:14.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.558+0000 7fcb4a98c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 0x5606a09ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.558+0000 7fcb4a98c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 0x5606a09ac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45444/0 (socket says 172.21.15.100:45444) 2024-09-18T01:27:14.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.558+0000 7fcb4a98c640 1 -- 172.21.15.100:0/3059919252 learned_addr learned my addr 172.21.15.100:0/3059919252 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.558+0000 7fcb4a98c640 1 -- 172.21.15.100:0/3059919252 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a0757bc0 con 0x5606a08bdba0 2024-09-18T01:27:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.558+0000 7fcb4a98c640 1 --2- 172.21.15.100:0/3059919252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 0x5606a09ac830 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c025c20 tx=0x7fcb3c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f814ff0cf499315d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.559+0000 7fca38e09640 1 -- 172.21.15.100:0/3059919252 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c05c580 con 0x5606a08bdba0 2024-09-18T01:27:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.559+0000 7fca38e09640 1 -- 172.21.15.100:0/3059919252 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c063030 con 0x5606a08bdba0 2024-09-18T01:27:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.559+0000 7fca38e09640 1 -- 172.21.15.100:0/3059919252 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c05c850 con 0x5606a08bdba0 2024-09-18T01:27:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.559+0000 7fcb4ce98800 1 -- 172.21.15.100:0/3059919252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 msgr2=0x5606a09ac830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.559+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/3059919252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 0x5606a09ac830 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c025c20 tx=0x7fcb3c051000 comp rx=0 tx=0).stop 2024-09-18T01:27:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.559+0000 7fcb4ce98800 1 -- 172.21.15.100:0/3059919252 shutdown_connections 2024-09-18T01:27:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.559+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/3059919252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 0x5606a09ac830 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.559+0000 7fcb4ce98800 1 -- 172.21.15.100:0/3059919252 >> 172.21.15.100:0/3059919252 conn(0x5606a08b8580 msgr2=0x5606a09a81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.559+0000 7fcb4ce98800 1 -- 172.21.15.100:0/3059919252 shutdown_connections 2024-09-18T01:27:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.559+0000 7fcb4ce98800 1 -- 172.21.15.100:0/3059919252 wait complete. 2024-09-18T01:27:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.560+0000 7fcb4ce98800 1 Processor -- start 2024-09-18T01:27:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.560+0000 7fcb4ce98800 1 -- start start 2024-09-18T01:27:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.560+0000 7fcb4ce98800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 0x5606a09b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.560+0000 7fcb4ce98800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5606a08c4530 con 0x5606a08bdba0 2024-09-18T01:27:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.560+0000 7fcb4a98c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 0x5606a09b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.560+0000 7fcb4a98c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 0x5606a09b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45448/0 (socket says 172.21.15.100:45448) 2024-09-18T01:27:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.560+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1593844859 learned_addr learned my addr 172.21.15.100:0/1593844859 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.560+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1593844859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a076bfe0 con 0x5606a08bdba0 2024-09-18T01:27:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.561+0000 7fcb4a98c640 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 0x5606a09b4190 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x5606a09ad690 tx=0x7fcb3c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.561+0000 7fca37606640 1 -- 172.21.15.100:0/1593844859 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c054ad0 con 0x5606a08bdba0 2024-09-18T01:27:14.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.561+0000 7fca37606640 1 -- 172.21.15.100:0/1593844859 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c054c70 con 0x5606a08bdba0 2024-09-18T01:27:14.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.561+0000 7fca37606640 1 -- 172.21.15.100:0/1593844859 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c068420 con 0x5606a08bdba0 2024-09-18T01:27:14.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.561+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606a09b46d0 con 0x5606a08bdba0 2024-09-18T01:27:14.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.561+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606a09b4bf0 con 0x5606a08bdba0 2024-09-18T01:27:14.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.561+0000 7fca37606640 1 -- 172.21.15.100:0/1593844859 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcb3c0685c0 con 0x5606a08bdba0 2024-09-18T01:27:14.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.562+0000 7fca37606640 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca30036b40 0x7fca30039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.562+0000 7fca37606640 1 -- 172.21.15.100:0/1593844859 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fcb3c070030 con 0x5606a08bdba0 2024-09-18T01:27:14.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.562+0000 7fcb4218b640 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca30036b40 0x7fca30039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.562+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5606a08be4e0 0x5606a09bb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.562+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09bb7d0 con 0x5606a08be4e0 2024-09-18T01:27:14.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.562+0000 7fcb4b18d640 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5606a08be4e0 0x5606a09bb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.562+0000 7fcb4218b640 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca30036b40 0x7fca30039000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb34000f60 tx=0x7fcb340012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.562+0000 7fcb4b18d640 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5606a08be4e0 0x5606a09bb200 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.562+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1593844859 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a08be4e0 2024-09-18T01:27:14.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.562+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09b87b0 con 0x5606a08be4e0 2024-09-18T01:27:14.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.563+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1593844859 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a08be4e0 2024-09-18T01:27:14.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.563+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5606a09bdb30 0x5606a09bff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.563+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09c0610 con 0x5606a09bdb30 2024-09-18T01:27:14.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.563+0000 7fcb4a98c640 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5606a09bdb30 0x5606a09bff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.563+0000 7fcb4a98c640 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5606a09bdb30 0x5606a09bff20 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.563+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1593844859 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcb3c051070 con 0x5606a09bdb30 2024-09-18T01:27:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.563+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09bc9d0 con 0x5606a08be4e0 2024-09-18T01:27:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.564+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1593844859 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a08be4e0 2024-09-18T01:27:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.564+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5606a09c1a70 0x5606a09c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.564+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09c4520 con 0x5606a09c1a70 2024-09-18T01:27:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.564+0000 7fcb4218b640 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5606a09c1a70 0x5606a09c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.564+0000 7fcb4218b640 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5606a09c1a70 0x5606a09c3e60 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.565+0000 7fcb4218b640 1 -- 172.21.15.100:0/1593844859 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09c1a70 2024-09-18T01:27:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.565+0000 7fcb4ce98800 1 Processor -- start 2024-09-18T01:27:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.565+0000 7fcb4ce98800 1 -- start start 2024-09-18T01:27:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.565+0000 7fcb4ce98800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09d22d0 0x5606a09d26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.565+0000 7fcb4ce98800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5606a0759580 con 0x5606a09d22d0 2024-09-18T01:27:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.565+0000 7fcb4a98c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09d22d0 0x5606a09d26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.565+0000 7fcb4a98c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09d22d0 0x5606a09d26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45450/0 (socket says 172.21.15.100:45450) 2024-09-18T01:27:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.565+0000 7fcb4a98c640 1 -- 172.21.15.100:0/983519569 learned_addr learned my addr 172.21.15.100:0/983519569 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.566+0000 7fcb4a98c640 1 -- 172.21.15.100:0/983519569 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a09d2c30 con 0x5606a09d22d0 2024-09-18T01:27:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.566+0000 7fcb4a98c640 1 --2- 172.21.15.100:0/983519569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09d22d0 0x5606a09d26f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c025c20 tx=0x7fcb3c05cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.566+0000 7fca34e01640 1 -- 172.21.15.100:0/983519569 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c095070 con 0x5606a09d22d0 2024-09-18T01:27:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.566+0000 7fca34e01640 1 -- 172.21.15.100:0/983519569 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c05e600 con 0x5606a09d22d0 2024-09-18T01:27:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.566+0000 7fcb4ce98800 1 -- 172.21.15.100:0/983519569 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606a09d2ec0 con 0x5606a09d22d0 2024-09-18T01:27:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.566+0000 7fca34e01640 1 -- 172.21.15.100:0/983519569 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c05e8e0 con 0x5606a09d22d0 2024-09-18T01:27:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.566+0000 7fcb4ce98800 1 -- 172.21.15.100:0/983519569 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606a09d2ec0 con 0x5606a09d22d0 2024-09-18T01:27:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.567+0000 7fca34e01640 1 -- 172.21.15.100:0/983519569 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcb3c098070 con 0x5606a09d22d0 2024-09-18T01:27:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.567+0000 7fca34e01640 1 --2- 172.21.15.100:0/983519569 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca24036b40 0x7fca24039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.567+0000 7fca34e01640 1 -- 172.21.15.100:0/983519569 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fcb3c08c030 con 0x5606a09d22d0 2024-09-18T01:27:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.567+0000 7fcb4218b640 1 --2- 172.21.15.100:0/983519569 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca24036b40 0x7fca24039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.567+0000 7fcb4ce98800 1 Processor -- start 2024-09-18T01:27:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.567+0000 7fcb4ce98800 1 -- start start 2024-09-18T01:27:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.567+0000 7fcb4218b640 1 --2- 172.21.15.100:0/983519569 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca24036b40 0x7fca24039000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400bf50 tx=0x7fcb3400f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.567+0000 7fcb4ce98800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09dec90 0x5606a09df090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.567+0000 7fcb4ce98800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5606a09acf80 con 0x5606a09dec90 2024-09-18T01:27:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.567+0000 7fcb4a98c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09dec90 0x5606a09df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.567+0000 7fcb4a98c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09dec90 0x5606a09df090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45452/0 (socket says 172.21.15.100:45452) 2024-09-18T01:27:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.567+0000 7fcb4a98c640 1 -- 172.21.15.100:0/2664792498 learned_addr learned my addr 172.21.15.100:0/2664792498 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.568+0000 7fcb4a98c640 1 -- 172.21.15.100:0/2664792498 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a09df660 con 0x5606a09dec90 2024-09-18T01:27:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.568+0000 7fcb4a98c640 1 --2- 172.21.15.100:0/2664792498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09dec90 0x5606a09df090 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c07d560 tx=0x7fcb3c05cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271fa5ad80ee5815 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.568+0000 7fca2e7fc640 1 -- 172.21.15.100:0/2664792498 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c0aa070 con 0x5606a09dec90 2024-09-18T01:27:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.568+0000 7fca2e7fc640 1 -- 172.21.15.100:0/2664792498 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c06c0d0 con 0x5606a09dec90 2024-09-18T01:27:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.568+0000 7fca2e7fc640 1 -- 172.21.15.100:0/2664792498 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c05c450 con 0x5606a09dec90 2024-09-18T01:27:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.568+0000 7fcb4ce98800 1 -- 172.21.15.100:0/2664792498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09dec90 msgr2=0x5606a09df090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.568+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/2664792498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09dec90 0x5606a09df090 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c07d560 tx=0x7fcb3c05cc20 comp rx=0 tx=0).stop 2024-09-18T01:27:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.568+0000 7fcb4ce98800 1 -- 172.21.15.100:0/2664792498 shutdown_connections 2024-09-18T01:27:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.568+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/2664792498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09dec90 0x5606a09df090 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.568+0000 7fcb4ce98800 1 -- 172.21.15.100:0/2664792498 >> 172.21.15.100:0/2664792498 conn(0x5606a09daff0 msgr2=0x5606a09d90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.568+0000 7fcb4ce98800 1 -- 172.21.15.100:0/2664792498 shutdown_connections 2024-09-18T01:27:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.568+0000 7fcb4ce98800 1 -- 172.21.15.100:0/2664792498 wait complete. 2024-09-18T01:27:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.569+0000 7fcb4ce98800 1 Processor -- start 2024-09-18T01:27:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.569+0000 7fcb4ce98800 1 -- start start 2024-09-18T01:27:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.569+0000 7fcb4ce98800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09dec90 0x5606a09e4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.569+0000 7fcb4ce98800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5606a09dfbe0 con 0x5606a09dec90 2024-09-18T01:27:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.569+0000 7fcb4a98c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09dec90 0x5606a09e4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.569+0000 7fcb4a98c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09dec90 0x5606a09e4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45458/0 (socket says 172.21.15.100:45458) 2024-09-18T01:27:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.569+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 learned_addr learned my addr 172.21.15.100:0/1074956238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.569+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a09e5300 con 0x5606a09dec90 2024-09-18T01:27:14.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.569+0000 7fcb4a98c640 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09dec90 0x5606a09e4dc0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c074440 tx=0x7fcb3c05cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.570+0000 7fca2cff9640 1 -- 172.21.15.100:0/1074956238 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c07de00 con 0x5606a09dec90 2024-09-18T01:27:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.570+0000 7fca2cff9640 1 -- 172.21.15.100:0/1074956238 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c084ba0 con 0x5606a09dec90 2024-09-18T01:27:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.570+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606a09e5300 con 0x5606a09dec90 2024-09-18T01:27:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.570+0000 7fca2cff9640 1 -- 172.21.15.100:0/1074956238 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c090450 con 0x5606a09dec90 2024-09-18T01:27:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.570+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606a09e5300 con 0x5606a09dec90 2024-09-18T01:27:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.570+0000 7fca2cff9640 1 -- 172.21.15.100:0/1074956238 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcb3c0bc020 con 0x5606a09dec90 2024-09-18T01:27:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.571+0000 7fca2cff9640 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca14036b90 0x7fca14039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.571+0000 7fca2cff9640 1 -- 172.21.15.100:0/1074956238 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fcb3c0bfd20 con 0x5606a09dec90 2024-09-18T01:27:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.571+0000 7fcb4218b640 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca14036b90 0x7fca14039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.571+0000 7fcb4218b640 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca14036b90 0x7fca14039050 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcb34001b60 tx=0x7fcb34010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.571+0000 7fcb4ce98800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.571+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5606a09f04f0 0x5606a09f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.571+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f3100 con 0x5606a09f04f0 2024-09-18T01:27:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.571+0000 7fcb4b18d640 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5606a09f04f0 0x5606a09f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4b18d640 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5606a09f04f0 0x5606a09f29b0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4ce98800 20 realm 2024-09-18T01:27:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4ce98800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f3510 con 0x5606a09f04f0 2024-09-18T01:27:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4ce98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4ce98800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f3de0 con 0x5606a09f04f0 2024-09-18T01:27:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4ce98800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.572+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f04f0 2024-09-18T01:27:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.573+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.573+0000 7fcb4ce98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.573+0000 7fcb4ce98800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.573+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5606a09f4ee0 0x5606a09f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.573+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f7890 con 0x5606a09f4ee0 2024-09-18T01:27:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.573+0000 7fcb4a98c640 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5606a09f4ee0 0x5606a09f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.573+0000 7fcb4a98c640 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5606a09f4ee0 0x5606a09f72d0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.573+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.573+0000 7fcb4ce98800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.573+0000 7fcb4ce98800 20 searching for the correct realm 2024-09-18T01:27:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.573+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5606a09f9840 0x5606a09fbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.573+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09fc3d0 con 0x5606a09f9840 2024-09-18T01:27:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.573+0000 7fcb4218b640 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5606a09f9840 0x5606a09fbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.574+0000 7fcb4218b640 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5606a09f9840 0x5606a09fbd00 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.574+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.574+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09fc3d0 con 0x5606a09f4ee0 2024-09-18T01:27:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.574+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.574+0000 7fcb4a98c640 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcb3c0af070 0x7fcb3c09a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.574+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09fc3d0 con 0x7fcb3c0af070 2024-09-18T01:27:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.574+0000 7fcb4b18d640 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcb3c0af070 0x7fcb3c09a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.575+0000 7fcb4b18d640 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcb3c0af070 0x7fcb3c09a8a0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.575+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.575+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f04f0 2024-09-18T01:27:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.575+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.575+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f04f0 2024-09-18T01:27:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.575+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.575+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x7fcb3c0af070 2024-09-18T01:27:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.576+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.576+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x7fcb3c0af070 2024-09-18T01:27:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.576+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.576+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f4ee0 2024-09-18T01:27:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.576+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.576+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f9840 2024-09-18T01:27:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.576+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.576+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f04f0 2024-09-18T01:27:14.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.577+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.577+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f4ee0 2024-09-18T01:27:14.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.577+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.577+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f04f0 2024-09-18T01:27:14.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.577+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.577+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f4ee0 2024-09-18T01:27:14.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.577+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.577+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f9840 2024-09-18T01:27:14.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.577+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.578+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f9840 2024-09-18T01:27:14.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.578+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.578+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x7fcb3c0af070 2024-09-18T01:27:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.578+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.578+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f9840 2024-09-18T01:27:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.578+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.578+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f9840 2024-09-18T01:27:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.579+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.579+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f04f0 2024-09-18T01:27:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.579+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.579+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f04f0 2024-09-18T01:27:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.579+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.579+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x7fcb3c0af070 2024-09-18T01:27:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.579+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.579+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f9840 2024-09-18T01:27:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.580+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.580+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f4ee0 2024-09-18T01:27:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.580+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.580+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f04f0 2024-09-18T01:27:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.580+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.580+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x7fcb3c0af070 2024-09-18T01:27:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.580+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.580+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f9840 2024-09-18T01:27:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.581+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.581+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f4ee0 2024-09-18T01:27:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.581+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.581+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f4ee0 2024-09-18T01:27:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.581+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.581+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f9840 2024-09-18T01:27:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.581+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.581+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x7fcb3c0af070 2024-09-18T01:27:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.581+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.581+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f04f0 2024-09-18T01:27:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f4180 con 0x5606a09f4ee0 2024-09-18T01:27:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4ce98800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4ce98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4ce98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4ce98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4ce98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4ce98800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4ce98800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f8150 con 0x5606a09f04f0 2024-09-18T01:27:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4ce98800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f8540 con 0x5606a09f04f0 2024-09-18T01:27:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4ce98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4ce98800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.582+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09f8540 con 0x7fcb3c0af070 2024-09-18T01:27:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 20 zone default found 2024-09-18T01:27:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 4 Realm: () 2024-09-18T01:27:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 20 zonegroup default 2024-09-18T01:27:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09fc850 con 0x7fcb3c0af070 2024-09-18T01:27:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09fe230 con 0x5606a09f9840 2024-09-18T01:27:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.583+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a09fe5d0 con 0x5606a09f9840 2024-09-18T01:27:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.584+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.584+0000 7fcb4ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.584+0000 7fcb4ce98800 20 started sync module instance, tier type = 2024-09-18T01:27:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.584+0000 7fcb4ce98800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.584+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a09fd6d0 con 0x5606a09f4ee0 2024-09-18T01:27:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.585+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.585+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94586464623344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a09fee20 con 0x5606a09f4ee0 2024-09-18T01:27:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.585+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a09ff670 con 0x5606a09f04f0 2024-09-18T01:27:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.586+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94586464623344] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.586+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.586+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94586464627056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a09ff670 con 0x5606a09f04f0 2024-09-18T01:27:14.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.586+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a000b0 con 0x5606a09f9840 2024-09-18T01:27:14.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.588+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94586464627056] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.588+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.588+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94586464629184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a09ff5e0 con 0x5606a09f9840 2024-09-18T01:27:14.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.588+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a00f70 con 0x5606a09f4ee0 2024-09-18T01:27:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.589+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94586464629184] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.589+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.589+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94586464635584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a00ee0 con 0x5606a09f4ee0 2024-09-18T01:27:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.589+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a01e30 con 0x5606a09f04f0 2024-09-18T01:27:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.590+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.590+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94586464639360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a02250 con 0x5606a09f04f0 2024-09-18T01:27:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.590+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a02d20 con 0x7fcb3c0af070 2024-09-18T01:27:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.591+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94586464635584] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.591+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.591+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94586464643088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a02ce0 con 0x7fcb3c0af070 2024-09-18T01:27:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.591+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a03730 con 0x7fcb3c0af070 2024-09-18T01:27:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.591+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94586464639360] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.592+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94586464643088] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.593+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.593+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94586464637792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a03280 con 0x7fcb3c0af070 2024-09-18T01:27:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.593+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a03c40 con 0x7fcb3c0af070 2024-09-18T01:27:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.594+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94586464637792] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.594+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.594+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94586464640416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a03c40 con 0x7fcb3c0af070 2024-09-18T01:27:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.594+0000 7fcb4ce98800 20 add_watcher() i=0 2024-09-18T01:27:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.594+0000 7fcb4ce98800 20 add_watcher() i=1 2024-09-18T01:27:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.594+0000 7fcb4ce98800 20 add_watcher() i=2 2024-09-18T01:27:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.594+0000 7fcb4ce98800 20 add_watcher() i=3 2024-09-18T01:27:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.594+0000 7fcb4ce98800 20 add_watcher() i=4 2024-09-18T01:27:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.594+0000 7fcb4ce98800 20 add_watcher() i=5 2024-09-18T01:27:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.594+0000 7fcb4ce98800 20 add_watcher() i=6 2024-09-18T01:27:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.594+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94586464640416] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.594+0000 7fcb4ce98800 20 add_watcher() i=7 2024-09-18T01:27:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.594+0000 7fcb4ce98800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.595+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a07060 con 0x5606a09f04f0 2024-09-18T01:27:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.595+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.595+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94586464647568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a04530 con 0x5606a09f04f0 2024-09-18T01:27:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.596+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94586464647568] v35'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.596+0000 7fca017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.596+0000 7fcb4ce98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.596+0000 7fcb4ce98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.596+0000 7fcb4ce98800 5 note: GC not initialized 2024-09-18T01:27:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.596+0000 7fc97bfff640 20 reqs_thread_entry: start 2024-09-18T01:27:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.596+0000 7fcb4ce98800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.596+0000 7fcb4ce98800 20 Filter name: none 2024-09-18T01:27:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fc979ffb640 20 reqs_thread_entry: start 2024-09-18T01:27:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-18T01:27:14.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a3a430 con 0x7fcb3c0af070 2024-09-18T01:27:14.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-18T01:27:14.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-18T01:27:14.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-18T01:27:14.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a38a70 con 0x5606a09f9840 2024-09-18T01:27:14.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-18T01:27:14.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-18T01:27:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-18T01:27:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-18T01:27:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.597+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a39560 con 0x7fcb3c0af070 2024-09-18T01:27:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.599+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v35'9 uv9 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.599+0000 7fcb4ce98800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-18T01:27:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.599+0000 7fcb4ce98800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-18T01:27:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.599+0000 7fcb4ce98800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-18T01:27:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.599+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94586464866128 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a3e0e0 con 0x5606a09f4ee0 2024-09-18T01:27:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.599+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== watch-notify(notify (1) cookie 94586464623344 notify 150323855385 ret 0) ==== 575+0+0 (crc 0 0 0) 0x5606a09d2c30 con 0x5606a09f4ee0 2024-09-18T01:27:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.599+0000 7fca2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855385 cookie 94586464623344 notifier 4853 bl.length()=533 2024-09-18T01:27:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.599+0000 7fca2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-18T01:27:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.599+0000 7fca2e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-18T01:27:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.599+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(65 notify.0 [notify cookie 94586464866128 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.599+0000 7fca2e7fc640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fca10003ea0 con 0x5606a09f4ee0 2024-09-18T01:27:14.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.599+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.600+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== watch-notify(notify_complete (2) cookie 94586464866128 notify 150323855385 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcb3c083040 con 0x5606a09f4ee0 2024-09-18T01:27:14.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.600+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a3e0a0 con 0x5606a09f9840 2024-09-18T01:27:14.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.601+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v35'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.601+0000 7fcb4ce98800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-18T01:27:14.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.601+0000 7fcb4ce98800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-18T01:27:14.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.601+0000 7fcb4ce98800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-18T01:27:14.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.601+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94586464885744 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a3e9a0 con 0x5606a09f04f0 2024-09-18T01:27:14.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.601+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== watch-notify(notify (1) cookie 94586464627056 notify 150323855408 ret 0) ==== 218+0+0 (crc 0 0 0) 0x5606a0a3da20 con 0x5606a09f04f0 2024-09-18T01:27:14.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.601+0000 7fca2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855408 cookie 94586464627056 notifier 4853 bl.length()=176 2024-09-18T01:27:14.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.601+0000 7fca2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-18T01:27:14.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.601+0000 7fca2e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-18T01:27:14.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.601+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(68 notify.1 [notify cookie 94586464885744 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.601+0000 7fca2e7fc640 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fca10003ea0 con 0x5606a09f04f0 2024-09-18T01:27:14.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.601+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.601+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== watch-notify(notify_complete (2) cookie 94586464885744 notify 150323855408 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5606a0a3a130 con 0x5606a09f04f0 2024-09-18T01:27:14.615 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-18T01:27:14.598769Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:27:14.598753Z","tags":[],"group_ids":[]} 2024-09-18T01:27:14.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.602+0000 7fca017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:14.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.602+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94586464647568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a38170 con 0x5606a09f04f0 2024-09-18T01:27:14.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.603+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94586464647568] v35'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.603+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94586464623344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a38170 con 0x5606a09f4ee0 2024-09-18T01:27:14.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.604+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94586464623344] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.604+0000 7fcb4ce98800 20 remove_watcher() i=0 2024-09-18T01:27:14.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.604+0000 7fcb4ce98800 2 removed watcher, disabling cache 2024-09-18T01:27:14.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.604+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94586464627056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a38170 con 0x5606a09f04f0 2024-09-18T01:27:14.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.605+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94586464627056] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.605+0000 7fcb4ce98800 20 remove_watcher() i=1 2024-09-18T01:27:14.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.605+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94586464629184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a38170 con 0x5606a09f9840 2024-09-18T01:27:14.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.606+0000 7fcb4218b640 1 -- 172.21.15.100:0/1074956238 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94586464629184] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb34009050 con 0x5606a09f9840 2024-09-18T01:27:14.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.606+0000 7fcb4ce98800 20 remove_watcher() i=2 2024-09-18T01:27:14.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.606+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94586464635584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a38170 con 0x5606a09f4ee0 2024-09-18T01:27:14.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.607+0000 7fcb4a98c640 1 -- 172.21.15.100:0/1074956238 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94586464635584] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c0ac030 con 0x5606a09f4ee0 2024-09-18T01:27:14.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.607+0000 7fcb4ce98800 20 remove_watcher() i=3 2024-09-18T01:27:14.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.607+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94586464639360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a38170 con 0x5606a09f04f0 2024-09-18T01:27:14.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.608+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94586464639360] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x5606a09f04f0 2024-09-18T01:27:14.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.608+0000 7fcb4ce98800 20 remove_watcher() i=4 2024-09-18T01:27:14.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.608+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94586464643088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a38170 con 0x7fcb3c0af070 2024-09-18T01:27:14.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.609+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94586464643088] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.609+0000 7fcb4ce98800 20 remove_watcher() i=5 2024-09-18T01:27:14.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.609+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94586464637792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a38170 con 0x7fcb3c0af070 2024-09-18T01:27:14.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.610+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94586464637792] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.610+0000 7fcb4ce98800 20 remove_watcher() i=6 2024-09-18T01:27:14.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.610+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94586464640416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606a0a38170 con 0x7fcb3c0af070 2024-09-18T01:27:14.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94586464640416] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4400a4a0 con 0x7fcb3c0af070 2024-09-18T01:27:14.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 20 remove_watcher() i=7 2024-09-18T01:27:14.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcb3c0af070 msgr2=0x7fcb3c09a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fcb3c0af070 0x7fcb3c09a8a0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5606a09f04f0 msgr2=0x5606a09f29b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5606a09f04f0 0x5606a09f29b0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5606a09f4ee0 msgr2=0x5606a09f72d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5606a09f4ee0 0x5606a09f72d0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5606a09f9840 msgr2=0x5606a09fbd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5606a09f9840 0x5606a09fbd00 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca14036b90 msgr2=0x7fca14039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca14036b90 0x7fca14039050 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcb34001b60 tx=0x7fcb34010000 comp rx=0 tx=0).stop 2024-09-18T01:27:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09dec90 msgr2=0x5606a09e4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1074956238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09dec90 0x5606a09e4dc0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c074440 tx=0x7fcb3c05cfd0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 reap_dead start 2024-09-18T01:27:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1074956238 reap_dead start 2024-09-18T01:27:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 shutdown_connections 2024-09-18T01:27:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 >> 172.21.15.100:0/1074956238 conn(0x5606a09daff0 msgr2=0x5606a09d90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.611+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 shutdown_connections 2024-09-18T01:27:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1074956238 wait complete. 2024-09-18T01:27:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/983519569 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca24036b40 msgr2=0x7fca24039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/983519569 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca24036b40 0x7fca24039000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400bf50 tx=0x7fcb3400f000 comp rx=0 tx=0).stop 2024-09-18T01:27:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/983519569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09d22d0 msgr2=0x5606a09d26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/983519569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09d22d0 0x5606a09d26f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c025c20 tx=0x7fcb3c05cf60 comp rx=0 tx=0).stop 2024-09-18T01:27:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/983519569 shutdown_connections 2024-09-18T01:27:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/983519569 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca24036b40 0x7fca24039000 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/983519569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a09d22d0 0x5606a09d26f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/983519569 >> 172.21.15.100:0/983519569 conn(0x5606a09c7260 msgr2=0x5606a09c9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/983519569 shutdown_connections 2024-09-18T01:27:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/983519569 wait complete. 2024-09-18T01:27:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5606a09c1a70 msgr2=0x5606a09c3e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5606a09c1a70 0x5606a09c3e60 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5606a08be4e0 msgr2=0x5606a09bb200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5606a08be4e0 0x5606a09bb200 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5606a09bdb30 msgr2=0x5606a09bff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5606a09bdb30 0x5606a09bff20 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca30036b40 msgr2=0x7fca30039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fca30036b40 0x7fca30039000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb34000f60 tx=0x7fcb340012b0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 msgr2=0x5606a09b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 --2- 172.21.15.100:0/1593844859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5606a08bdba0 0x5606a09b4190 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x5606a09ad690 tx=0x7fcb3c002fb0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4b18d640 1 -- 172.21.15.100:0/1593844859 reap_dead start 2024-09-18T01:27:14.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 shutdown_connections 2024-09-18T01:27:14.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 >> 172.21.15.100:0/1593844859 conn(0x5606a08b8580 msgr2=0x5606a09a6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 shutdown_connections 2024-09-18T01:27:14.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.612+0000 7fcb4ce98800 1 -- 172.21.15.100:0/1593844859 wait complete. 2024-09-18T01:27:14.627 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-18T01:27:14.598769Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.598753Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:14.627 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-18T01:27:14.598769Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.598753Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:14.627 ERROR:root:0 2024-09-18T01:27:14.627 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:14.631 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:14.632 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-18T01:27:14.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-18T01:27:14.632 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-18T01:27:14.678 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:14.678 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:14.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.677+0000 7f7566b24800 1 Processor -- start 2024-09-18T01:27:14.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.678+0000 7f7566b24800 1 -- start start 2024-09-18T01:27:14.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.678+0000 7f7566b24800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x559898768d90 0x55989876b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.678+0000 7f7566b24800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559898621b30 con 0x5598986d6610 2024-09-18T01:27:14.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.678+0000 7f7566b24800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x559898603360 con 0x559898768d90 2024-09-18T01:27:14.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.678+0000 7f755a0df640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x559898768d90 0x55989876b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.678+0000 7f75628e0640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5598986d6610 0x559898767670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37202/0 (socket says 172.21.15.100:37202) 2024-09-18T01:27:14.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.678+0000 7f75628e0640 1 -- 172.21.15.100:0/428824068 learned_addr learned my addr 172.21.15.100:0/428824068 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:14.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.678+0000 7f755a0df640 1 -- 172.21.15.100:0/428824068 >> v1:172.21.15.92:6789/0 conn(0x5598986d6610 legacy=0x559898767670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.678+0000 7f75620df640 1 -- 172.21.15.100:0/428824068 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214411760 0 0) 0x559898621b30 con 0x5598986d6610 2024-09-18T01:27:14.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.678+0000 7f755a0df640 1 -- 172.21.15.100:0/428824068 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559898629e00 con 0x559898768d90 2024-09-18T01:27:14.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.680+0000 7f755a0df640 1 --2- 172.21.15.100:0/428824068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898768d90 0x55989876b180 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f754c00a470 tx=0x7f754c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a1c95d6ccfc4c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.680+0000 7f75620df640 1 -- 172.21.15.100:0/428824068 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f754c053570 con 0x559898768d90 2024-09-18T01:27:14.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.680+0000 7f75620df640 1 -- 172.21.15.100:0/428824068 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f754c058070 con 0x559898768d90 2024-09-18T01:27:14.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.680+0000 7f75620df640 1 -- 172.21.15.100:0/428824068 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f754c053880 con 0x559898768d90 2024-09-18T01:27:14.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.681+0000 7f7566b24800 1 -- 172.21.15.100:0/428824068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898768d90 msgr2=0x55989876b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.681+0000 7f7566b24800 1 --2- 172.21.15.100:0/428824068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898768d90 0x55989876b180 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f754c00a470 tx=0x7f754c045a20 comp rx=0 tx=0).stop 2024-09-18T01:27:14.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.681+0000 7f7566b24800 1 -- 172.21.15.100:0/428824068 shutdown_connections 2024-09-18T01:27:14.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.681+0000 7f7566b24800 1 --2- 172.21.15.100:0/428824068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898768d90 0x55989876b180 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.681+0000 7f7566b24800 1 -- 172.21.15.100:0/428824068 >> 172.21.15.100:0/428824068 conn(0x55989875cde0 msgr2=0x55989875f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.681+0000 7f7566b24800 1 -- 172.21.15.100:0/428824068 shutdown_connections 2024-09-18T01:27:14.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.681+0000 7f7566b24800 1 -- 172.21.15.100:0/428824068 wait complete. 2024-09-18T01:27:14.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.698+0000 7f7566b24800 1 Processor -- start 2024-09-18T01:27:14.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.698+0000 7f7566b24800 1 -- start start 2024-09-18T01:27:14.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.699+0000 7f7566b24800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598986d6610 0x559898853840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.699+0000 7f7566b24800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5598986ae330 con 0x5598986d6610 2024-09-18T01:27:14.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.699+0000 7f75628e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598986d6610 0x559898853840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.699+0000 7f75628e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598986d6610 0x559898853840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45480/0 (socket says 172.21.15.100:45480) 2024-09-18T01:27:14.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.699+0000 7f75628e0640 1 -- 172.21.15.100:0/2101685827 learned_addr learned my addr 172.21.15.100:0/2101685827 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.699+0000 7f75628e0640 1 -- 172.21.15.100:0/2101685827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598985fbbc0 con 0x5598986d6610 2024-09-18T01:27:14.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.699+0000 7f75628e0640 1 --2- 172.21.15.100:0/2101685827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598986d6610 0x559898853840 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f755400b240 tx=0x7f755400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d38d5f107fd918 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.699+0000 7f7450e09640 1 -- 172.21.15.100:0/2101685827 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7554008070 con 0x5598986d6610 2024-09-18T01:27:14.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.699+0000 7f7450e09640 1 -- 172.21.15.100:0/2101685827 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755400d500 con 0x5598986d6610 2024-09-18T01:27:14.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.699+0000 7f7450e09640 1 -- 172.21.15.100:0/2101685827 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755400d860 con 0x5598986d6610 2024-09-18T01:27:14.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.700+0000 7f7566b24800 1 -- 172.21.15.100:0/2101685827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598986d6610 msgr2=0x559898853840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.700+0000 7f7566b24800 1 --2- 172.21.15.100:0/2101685827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598986d6610 0x559898853840 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f755400b240 tx=0x7f755400b700 comp rx=0 tx=0).stop 2024-09-18T01:27:14.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.700+0000 7f7566b24800 1 -- 172.21.15.100:0/2101685827 shutdown_connections 2024-09-18T01:27:14.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.700+0000 7f7566b24800 1 --2- 172.21.15.100:0/2101685827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598986d6610 0x559898853840 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.700+0000 7f7566b24800 1 -- 172.21.15.100:0/2101685827 >> 172.21.15.100:0/2101685827 conn(0x55989875cde0 msgr2=0x55989884f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.700+0000 7f7566b24800 1 -- 172.21.15.100:0/2101685827 shutdown_connections 2024-09-18T01:27:14.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.700+0000 7f7566b24800 1 -- 172.21.15.100:0/2101685827 wait complete. 2024-09-18T01:27:14.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.700+0000 7f7566b24800 1 Processor -- start 2024-09-18T01:27:14.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.701+0000 7f7566b24800 1 -- start start 2024-09-18T01:27:14.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.701+0000 7f7566b24800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598986d6610 0x55989885b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.701+0000 7f7566b24800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55989876b990 con 0x5598986d6610 2024-09-18T01:27:14.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.701+0000 7f75628e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598986d6610 0x55989885b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.701+0000 7f75628e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598986d6610 0x55989885b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45490/0 (socket says 172.21.15.100:45490) 2024-09-18T01:27:14.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.701+0000 7f75628e0640 1 -- 172.21.15.100:0/1325317612 learned_addr learned my addr 172.21.15.100:0/1325317612 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.701+0000 7f75628e0640 1 -- 172.21.15.100:0/1325317612 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989860ffe0 con 0x5598986d6610 2024-09-18T01:27:14.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.701+0000 7f75628e0640 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598986d6610 0x55989885b2c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x5598988546a0 tx=0x7f7554000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.702+0000 7f744f606640 1 -- 172.21.15.100:0/1325317612 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7554019870 con 0x5598986d6610 2024-09-18T01:27:14.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.702+0000 7f744f606640 1 -- 172.21.15.100:0/1325317612 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7554019a10 con 0x5598986d6610 2024-09-18T01:27:14.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.702+0000 7f744f606640 1 -- 172.21.15.100:0/1325317612 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7554019d30 con 0x5598986d6610 2024-09-18T01:27:14.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.702+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55989885b800 con 0x5598986d6610 2024-09-18T01:27:14.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.702+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989885bd20 con 0x5598986d6610 2024-09-18T01:27:14.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.703+0000 7f744f606640 1 -- 172.21.15.100:0/1325317612 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7554017040 con 0x5598986d6610 2024-09-18T01:27:14.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.703+0000 7f744f606640 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7448036b90 0x7f7448039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.703+0000 7f744f606640 1 -- 172.21.15.100:0/1325317612 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f7554015020 con 0x5598986d6610 2024-09-18T01:27:14.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.703+0000 7f755a0df640 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7448036b90 0x7f7448039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.703+0000 7f7566b24800 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559898768d90 0x559898862330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.703+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598988628b0 con 0x559898768d90 2024-09-18T01:27:14.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.703+0000 7f75630e1640 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559898768d90 0x559898862330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.704+0000 7f75630e1640 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559898768d90 0x559898862330 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.704+0000 7f755a0df640 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7448036b90 0x7f7448039050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f754c057000 tx=0x7f754c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.704+0000 7f75630e1640 1 -- 172.21.15.100:0/1325317612 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898768d90 2024-09-18T01:27:14.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.704+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55989885f8e0 con 0x559898768d90 2024-09-18T01:27:14.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.704+0000 7f75630e1640 1 -- 172.21.15.100:0/1325317612 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898768d90 2024-09-18T01:27:14.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.704+0000 7f7566b24800 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559898864be0 0x559898866fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.704+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559898867670 con 0x559898864be0 2024-09-18T01:27:14.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.705+0000 7f75628e0640 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559898864be0 0x559898866fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.705+0000 7f75628e0640 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559898864be0 0x559898866fd0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.706+0000 7f75628e0640 1 -- 172.21.15.100:0/1325317612 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f755402d070 con 0x559898864be0 2024-09-18T01:27:14.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.706+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559898863a80 con 0x559898768d90 2024-09-18T01:27:14.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.706+0000 7f75630e1640 1 -- 172.21.15.100:0/1325317612 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898768d90 2024-09-18T01:27:14.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.706+0000 7f7566b24800 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559898868ad0 0x55989886aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.706+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55989886b5c0 con 0x559898868ad0 2024-09-18T01:27:14.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.706+0000 7f755a0df640 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559898868ad0 0x55989886aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.707+0000 7f755a0df640 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559898868ad0 0x55989886aec0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.707+0000 7f755a0df640 1 -- 172.21.15.100:0/1325317612 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f754c051070 con 0x559898868ad0 2024-09-18T01:27:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.707+0000 7f7566b24800 1 Processor -- start 2024-09-18T01:27:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.708+0000 7f7566b24800 1 -- start start 2024-09-18T01:27:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.708+0000 7f7566b24800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898879370 0x559898879790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.708+0000 7f7566b24800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5598985fd580 con 0x559898879370 2024-09-18T01:27:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.708+0000 7f75628e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898879370 0x559898879790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.708+0000 7f75628e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898879370 0x559898879790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45506/0 (socket says 172.21.15.100:45506) 2024-09-18T01:27:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.708+0000 7f75628e0640 1 -- 172.21.15.100:0/1535024308 learned_addr learned my addr 172.21.15.100:0/1535024308 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.708+0000 7f75628e0640 1 -- 172.21.15.100:0/1535024308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559898879cd0 con 0x559898879370 2024-09-18T01:27:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.708+0000 7f75628e0640 1 --2- 172.21.15.100:0/1535024308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898879370 0x559898879790 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f755404b770 tx=0x7f755401a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.709+0000 7f744ce01640 1 -- 172.21.15.100:0/1535024308 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755401ae00 con 0x559898879370 2024-09-18T01:27:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.709+0000 7f744ce01640 1 -- 172.21.15.100:0/1535024308 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755400ee20 con 0x559898879370 2024-09-18T01:27:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.709+0000 7f7566b24800 1 -- 172.21.15.100:0/1535024308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559898879f60 con 0x559898879370 2024-09-18T01:27:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.709+0000 7f744ce01640 1 -- 172.21.15.100:0/1535024308 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755404bbf0 con 0x559898879370 2024-09-18T01:27:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.709+0000 7f7566b24800 1 -- 172.21.15.100:0/1535024308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989887cc40 con 0x559898879370 2024-09-18T01:27:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.709+0000 7f744ce01640 1 -- 172.21.15.100:0/1535024308 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f755400f470 con 0x559898879370 2024-09-18T01:27:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.710+0000 7f744ce01640 1 --2- 172.21.15.100:0/1535024308 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f743c036b40 0x7f743c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.710+0000 7f744ce01640 1 -- 172.21.15.100:0/1535024308 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f755400a200 con 0x559898879370 2024-09-18T01:27:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.710+0000 7f755a0df640 1 --2- 172.21.15.100:0/1535024308 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f743c036b40 0x7f743c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.710+0000 7f7566b24800 1 Processor -- start 2024-09-18T01:27:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.710+0000 7f7566b24800 1 -- start start 2024-09-18T01:27:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.710+0000 7f755a0df640 1 --2- 172.21.15.100:0/1535024308 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f743c036b40 0x7f743c039000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55989885f820 tx=0x7f754c005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.710+0000 7f7566b24800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898885de0 0x5598988861e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.710+0000 7f7566b24800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559898853ff0 con 0x559898885de0 2024-09-18T01:27:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.710+0000 7f75628e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898885de0 0x5598988861e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.710+0000 7f75628e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898885de0 0x5598988861e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45508/0 (socket says 172.21.15.100:45508) 2024-09-18T01:27:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.710+0000 7f75628e0640 1 -- 172.21.15.100:0/3246757727 learned_addr learned my addr 172.21.15.100:0/3246757727 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.711+0000 7f75628e0640 1 -- 172.21.15.100:0/3246757727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559898886720 con 0x559898885de0 2024-09-18T01:27:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.711+0000 7f75628e0640 1 --2- 172.21.15.100:0/3246757727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898885de0 0x5598988861e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7554044cd0 tx=0x7f7554018940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf10f78c29d3a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.711+0000 7f74467fc640 1 -- 172.21.15.100:0/3246757727 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755405f070 con 0x559898885de0 2024-09-18T01:27:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.711+0000 7f74467fc640 1 -- 172.21.15.100:0/3246757727 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75540454a0 con 0x559898885de0 2024-09-18T01:27:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.711+0000 7f74467fc640 1 -- 172.21.15.100:0/3246757727 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7554044d40 con 0x559898885de0 2024-09-18T01:27:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.711+0000 7f7566b24800 1 -- 172.21.15.100:0/3246757727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898885de0 msgr2=0x5598988861e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.711+0000 7f7566b24800 1 --2- 172.21.15.100:0/3246757727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898885de0 0x5598988861e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7554044cd0 tx=0x7f7554018940 comp rx=0 tx=0).stop 2024-09-18T01:27:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.711+0000 7f7566b24800 1 -- 172.21.15.100:0/3246757727 shutdown_connections 2024-09-18T01:27:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.711+0000 7f7566b24800 1 --2- 172.21.15.100:0/3246757727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898885de0 0x5598988861e0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.711+0000 7f7566b24800 1 -- 172.21.15.100:0/3246757727 >> 172.21.15.100:0/3246757727 conn(0x559898882190 msgr2=0x559898880290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.712+0000 7f7566b24800 1 -- 172.21.15.100:0/3246757727 shutdown_connections 2024-09-18T01:27:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.712+0000 7f7566b24800 1 -- 172.21.15.100:0/3246757727 wait complete. 2024-09-18T01:27:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.712+0000 7f7566b24800 1 Processor -- start 2024-09-18T01:27:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.712+0000 7f7566b24800 1 -- start start 2024-09-18T01:27:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.712+0000 7f7566b24800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898885de0 0x55989888cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.712+0000 7f7566b24800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559898886720 con 0x559898885de0 2024-09-18T01:27:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.712+0000 7f75628e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898885de0 0x55989888cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.712+0000 7f75628e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898885de0 0x55989888cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45524/0 (socket says 172.21.15.100:45524) 2024-09-18T01:27:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.712+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 learned_addr learned my addr 172.21.15.100:0/139519656 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.713+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989888d4e0 con 0x559898885de0 2024-09-18T01:27:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.713+0000 7f75628e0640 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898885de0 0x55989888cfa0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f75540274e0 tx=0x7f7554038f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.713+0000 7f7444ff9640 1 -- 172.21.15.100:0/139519656 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755405f040 con 0x559898885de0 2024-09-18T01:27:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.713+0000 7f7444ff9640 1 -- 172.21.15.100:0/139519656 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755400f760 con 0x559898885de0 2024-09-18T01:27:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.713+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55989888d4e0 con 0x559898885de0 2024-09-18T01:27:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.713+0000 7f7444ff9640 1 -- 172.21.15.100:0/139519656 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7554044140 con 0x559898885de0 2024-09-18T01:27:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.713+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989888d4e0 con 0x559898885de0 2024-09-18T01:27:14.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.714+0000 7f7444ff9640 1 -- 172.21.15.100:0/139519656 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f755406d020 con 0x559898885de0 2024-09-18T01:27:14.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.714+0000 7f7444ff9640 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f742c036b40 0x7f742c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.714+0000 7f7444ff9640 1 -- 172.21.15.100:0/139519656 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f755406b020 con 0x559898885de0 2024-09-18T01:27:14.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.714+0000 7f755a0df640 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f742c036b40 0x7f742c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.715+0000 7f755a0df640 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f742c036b40 0x7f742c039000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55989886b9c0 tx=0x7f754c06b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.715+0000 7f7566b24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.715+0000 7f7566b24800 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559898898550 0x55989889aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.715+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55989889b160 con 0x559898898550 2024-09-18T01:27:14.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.715+0000 7f75630e1640 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559898898550 0x55989889aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.715+0000 7f75630e1640 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559898898550 0x55989889aa10 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.715+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.715+0000 7f7566b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.715+0000 7f7566b24800 20 realm 2024-09-18T01:27:14.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.715+0000 7f7566b24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.715+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55989889b570 con 0x559898898550 2024-09-18T01:27:14.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f7566b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f7566b24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:14.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f7566b24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55989889be40 con 0x559898898550 2024-09-18T01:27:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f7566b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f7566b24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x559898898550 2024-09-18T01:27:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f7566b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f7566b24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f7566b24800 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55989889cf40 0x55989889f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55989889f940 con 0x55989889cf40 2024-09-18T01:27:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f75628e0640 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55989889cf40 0x55989889f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.716+0000 7f75628e0640 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55989889cf40 0x55989889f330 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.717+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.717+0000 7f7566b24800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:14.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.717+0000 7f7566b24800 20 searching for the correct realm 2024-09-18T01:27:14.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.717+0000 7f7566b24800 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5598988a18f0 0x5598988a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.717+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598988a4480 con 0x5598988a18f0 2024-09-18T01:27:14.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.717+0000 7f755a0df640 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5598988a18f0 0x5598988a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.717+0000 7f755a0df640 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5598988a18f0 0x5598988a3db0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.717+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.717+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598988a4480 con 0x55989889cf40 2024-09-18T01:27:14.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.718+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.718+0000 7f75628e0640 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7554003550 0x7f755403f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.718+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598988a4480 con 0x7f7554003550 2024-09-18T01:27:14.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.718+0000 7f75630e1640 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7554003550 0x7f755403f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.718+0000 7f75630e1640 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7554003550 0x7f755403f050 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.718+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.718+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x559898898550 2024-09-18T01:27:14.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.719+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.719+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x559898898550 2024-09-18T01:27:14.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.719+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.719+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x7f7554003550 2024-09-18T01:27:14.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.719+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.719+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x7f7554003550 2024-09-18T01:27:14.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.719+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.719+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x55989889cf40 2024-09-18T01:27:14.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.720+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.720+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x5598988a18f0 2024-09-18T01:27:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.720+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.720+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x559898898550 2024-09-18T01:27:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.720+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.720+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x55989889cf40 2024-09-18T01:27:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.720+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.720+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x559898898550 2024-09-18T01:27:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.721+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.721+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x55989889cf40 2024-09-18T01:27:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.721+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.721+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x5598988a18f0 2024-09-18T01:27:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.721+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.721+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x5598988a18f0 2024-09-18T01:27:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.721+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.721+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x7f7554003550 2024-09-18T01:27:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.721+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.721+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x5598988a18f0 2024-09-18T01:27:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.722+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.722+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x5598988a18f0 2024-09-18T01:27:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.722+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.722+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x559898898550 2024-09-18T01:27:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.722+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.722+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x559898898550 2024-09-18T01:27:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.722+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.722+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x7f7554003550 2024-09-18T01:27:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.723+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.723+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x5598988a18f0 2024-09-18T01:27:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.723+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.723+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x55989889cf40 2024-09-18T01:27:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.723+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.723+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x559898898550 2024-09-18T01:27:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.723+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.723+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x7f7554003550 2024-09-18T01:27:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.724+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.724+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x5598988a18f0 2024-09-18T01:27:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.724+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.724+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x55989889cf40 2024-09-18T01:27:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.724+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.724+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x55989889cf40 2024-09-18T01:27:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.724+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.724+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x5598988a18f0 2024-09-18T01:27:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.724+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.725+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x7f7554003550 2024-09-18T01:27:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.725+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.725+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x559898898550 2024-09-18T01:27:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.725+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.725+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55989889c1e0 con 0x55989889cf40 2024-09-18T01:27:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.725+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.725+0000 7f7566b24800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.725+0000 7f7566b24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.725+0000 7f7566b24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.725+0000 7f7566b24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.725+0000 7f7566b24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.725+0000 7f7566b24800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.725+0000 7f7566b24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.725+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598988a0200 con 0x559898898550 2024-09-18T01:27:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598988a05f0 con 0x559898898550 2024-09-18T01:27:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598988a05f0 con 0x7f7554003550 2024-09-18T01:27:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 20 zone default found 2024-09-18T01:27:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 4 Realm: () 2024-09-18T01:27:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 20 zonegroup default 2024-09-18T01:27:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55989889fe60 con 0x7f7554003550 2024-09-18T01:27:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.726+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55989889fe60 con 0x5598988a18f0 2024-09-18T01:27:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.727+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.727+0000 7f7566b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.727+0000 7f7566b24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.727+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598988a63c0 con 0x5598988a18f0 2024-09-18T01:27:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.727+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.727+0000 7f7566b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.727+0000 7f7566b24800 20 started sync module instance, tier type = 2024-09-18T01:27:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.727+0000 7f7566b24800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.727+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988a5780 con 0x55989889cf40 2024-09-18T01:27:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.728+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.728+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94113882594160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988a6cd0 con 0x55989889cf40 2024-09-18T01:27:14.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.728+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988a7520 con 0x559898898550 2024-09-18T01:27:14.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.729+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.729+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94113882599536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988a7ac0 con 0x559898898550 2024-09-18T01:27:14.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.729+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988a8390 con 0x5598988a18f0 2024-09-18T01:27:14.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.730+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94113882594160] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.730+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94113882599536] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.731+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.731+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94113882603232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988a8730 con 0x5598988a18f0 2024-09-18T01:27:14.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.731+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988a8f80 con 0x55989889cf40 2024-09-18T01:27:14.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.732+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94113882603232] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.732+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.732+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94113882606288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988a93a0 con 0x55989889cf40 2024-09-18T01:27:14.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.732+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988a9da0 con 0x559898898550 2024-09-18T01:27:14.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.733+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94113882606288] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.733+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.733+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94113882609840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988a93a0 con 0x559898898550 2024-09-18T01:27:14.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.733+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988aa7b0 con 0x7f7554003550 2024-09-18T01:27:14.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.734+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94113882609840] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.734+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.734+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94113882612960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988a93a0 con 0x7f7554003550 2024-09-18T01:27:14.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.734+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ab1c0 con 0x7f7554003550 2024-09-18T01:27:14.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.735+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(56 notify.6 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.735+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94113882615056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ab620 con 0x7f7554003550 2024-09-18T01:27:14.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.735+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ac120 con 0x7f7554003550 2024-09-18T01:27:14.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.735+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94113882612960] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.736+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94113882615056] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.736+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.736+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94113882618896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ac0e0 con 0x7f7554003550 2024-09-18T01:27:14.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.736+0000 7f7566b24800 20 add_watcher() i=0 2024-09-18T01:27:14.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.736+0000 7f7566b24800 20 add_watcher() i=1 2024-09-18T01:27:14.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.736+0000 7f7566b24800 20 add_watcher() i=2 2024-09-18T01:27:14.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.736+0000 7f7566b24800 20 add_watcher() i=3 2024-09-18T01:27:14.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.736+0000 7f7566b24800 20 add_watcher() i=4 2024-09-18T01:27:14.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.736+0000 7f7566b24800 20 add_watcher() i=5 2024-09-18T01:27:14.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.736+0000 7f7566b24800 20 add_watcher() i=6 2024-09-18T01:27:14.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.737+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94113882618896] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.737+0000 7f7566b24800 20 add_watcher() i=7 2024-09-18T01:27:14.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.737+0000 7f7566b24800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:14.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.737+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598988ab130 con 0x559898898550 2024-09-18T01:27:14.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.738+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.738+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94113882607344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ab130 con 0x559898898550 2024-09-18T01:27:14.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.739+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94113882607344] v35'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.739+0000 7f74197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:14.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.739+0000 7f7566b24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:14.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.739+0000 7f7566b24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:14.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.739+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988b7b50 con 0x559898898550 2024-09-18T01:27:14.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.740+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.740+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988b8220 con 0x7f7554003550 2024-09-18T01:27:14.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.741+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.741+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988b8640 con 0x5598988a18f0 2024-09-18T01:27:14.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.742+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.742+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988b9060 con 0x559898898550 2024-09-18T01:27:14.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.743+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'252 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.743+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988b37b0 con 0x55989889cf40 2024-09-18T01:27:14.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.744+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'84 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.744+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988b3750 con 0x5598988a18f0 2024-09-18T01:27:14.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.745+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'63 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.745+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988b9bc0 con 0x559898898550 2024-09-18T01:27:14.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.746+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.746+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988b9bc0 con 0x7f7554003550 2024-09-18T01:27:14.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.748+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'58 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.748+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988b9bc0 con 0x55989889cf40 2024-09-18T01:27:14.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.749+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.749+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988b9d90 con 0x5598988a18f0 2024-09-18T01:27:14.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.749+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.750+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ba340 con 0x55989889cf40 2024-09-18T01:27:14.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.750+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'85 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.750+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ba340 con 0x7f7554003550 2024-09-18T01:27:14.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.752+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.752+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ba340 con 0x55989889cf40 2024-09-18T01:27:14.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.753+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.753+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ba400 con 0x7f7554003550 2024-09-18T01:27:14.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.754+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'70 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.754+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ba400 con 0x559898898550 2024-09-18T01:27:14.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.755+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'253 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.755+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ba3d0 con 0x5598988a18f0 2024-09-18T01:27:14.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.756+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.756+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ba3d0 con 0x55989889cf40 2024-09-18T01:27:14.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.757+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'86 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.757+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ba3d0 con 0x5598988a18f0 2024-09-18T01:27:14.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.758+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.758+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ba3d0 con 0x559898898550 2024-09-18T01:27:14.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.759+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.759+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ba340 con 0x559898898550 2024-09-18T01:27:14.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.760+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'254 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.760+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ba340 con 0x5598988a18f0 2024-09-18T01:27:14.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.762+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.762+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988ba340 con 0x55989889cf40 2024-09-18T01:27:14.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.762+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.763+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988bad20 con 0x5598988a18f0 2024-09-18T01:27:14.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.763+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.763+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988bad20 con 0x5598988a18f0 2024-09-18T01:27:14.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.764+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'47 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.764+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988bad20 con 0x5598988a18f0 2024-09-18T01:27:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.765+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.765+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988bad20 con 0x5598988a18f0 2024-09-18T01:27:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.766+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'64 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.766+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988bad20 con 0x7f7554003550 2024-09-18T01:27:14.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.768+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.768+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988bad20 con 0x5598988a18f0 2024-09-18T01:27:14.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.769+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.769+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988bad20 con 0x7f7554003550 2024-09-18T01:27:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.770+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'59 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.770+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988bad20 con 0x5598988a18f0 2024-09-18T01:27:14.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.772+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.772+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988bad20 con 0x7f7554003550 2024-09-18T01:27:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.773+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'71 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.773+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988bad20 con 0x55989889cf40 2024-09-18T01:27:14.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.774+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.774+0000 7f7393fff640 20 reqs_thread_entry: start 2024-09-18T01:27:14.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.774+0000 7f7566b24800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:14.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.774+0000 7f7566b24800 20 Filter name: none 2024-09-18T01:27:14.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.774+0000 7f7391ffb640 20 reqs_thread_entry: start 2024-09-18T01:27:14.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.775+0000 7f7566b24800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-18T01:27:14.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.775+0000 7f7566b24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.775+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598988e5860 con 0x7f7554003550 2024-09-18T01:27:14.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.775+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.775+0000 7f7566b24800 20 rados_obj.operate() r=0 bl.length=349 2024-09-18T01:27:14.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.775+0000 7f7566b24800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-18T01:27:14.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.775+0000 7f7566b24800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-18T01:27:14.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.775+0000 7f7566b24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:27:14.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.775+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598988e5370 con 0x7f7554003550 2024-09-18T01:27:14.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.775+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.775+0000 7f7566b24800 10 removing key index: system_akey 2024-09-18T01:27:14.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.775+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988e5370 con 0x5598988a18f0 2024-09-18T01:27:14.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.776+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(96 system_akey [delete] v35'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.776+0000 7f7566b24800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-18T01:27:14.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.776+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94113882861104 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598988e87f0 con 0x559898898550 2024-09-18T01:27:14.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.777+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== watch-notify(notify (1) cookie 94113882599536 notify 150323855409 ret 0) ==== 203+0+0 (crc 0 0 0) 0x5598988b3bd0 con 0x559898898550 2024-09-18T01:27:14.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.777+0000 7f74467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855409 cookie 94113882599536 notifier 4860 bl.length()=161 2024-09-18T01:27:14.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.777+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(97 notify.1 [notify cookie 94113882861104 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.777+0000 7f74467fc640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f7428003d60 con 0x559898898550 2024-09-18T01:27:14.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.777+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.777+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== watch-notify(notify_complete (2) cookie 94113882861104 notify 150323855409 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598988b76a0 con 0x559898898550 2024-09-18T01:27:14.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.777+0000 7f7566b24800 10 removing email index: 2024-09-18T01:27:14.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.777+0000 7f7566b24800 10 removing user buckets index 2024-09-18T01:27:14.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.777+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988e6280 con 0x7f7554003550 2024-09-18T01:27:14.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.778+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(99 system_user.buckets [delete] v35'10 uv9 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.778+0000 7f7566b24800 10 removing user index: system_user 2024-09-18T01:27:14.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.778+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988e6280 con 0x7f7554003550 2024-09-18T01:27:14.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.779+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(100 system_user [call,call,delete] v35'11 uv11 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.779+0000 7f7566b24800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-18T01:27:14.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.779+0000 7f7566b24800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-18T01:27:14.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.779+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94113882856912 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598988e61f0 con 0x55989889cf40 2024-09-18T01:27:14.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.779+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== watch-notify(notify (1) cookie 94113882594160 notify 150323855386 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5598988b9d90 con 0x55989889cf40 2024-09-18T01:27:14.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.779+0000 7f74467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855386 cookie 94113882594160 notifier 4860 bl.length()=160 2024-09-18T01:27:14.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.779+0000 7f74467fc640 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f7428003d60 con 0x55989889cf40 2024-09-18T01:27:14.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.779+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== osd_op_reply(101 notify.0 [notify cookie 94113882856912 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.780+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 23 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.780+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 24 ==== watch-notify(notify_complete (2) cookie 94113882856912 notify 150323855386 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559898879cd0 con 0x55989889cf40 2024-09-18T01:27:14.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.780+0000 7f74197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:14.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.781+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94113882607344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988e6210 con 0x559898898550 2024-09-18T01:27:14.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.782+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94113882607344] v35'255 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.782+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94113882594160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988e6210 con 0x55989889cf40 2024-09-18T01:27:14.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.783+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 25 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94113882594160] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.783+0000 7f7566b24800 20 remove_watcher() i=0 2024-09-18T01:27:14.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.783+0000 7f7566b24800 2 removed watcher, disabling cache 2024-09-18T01:27:14.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.783+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94113882599536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988a5b20 con 0x559898898550 2024-09-18T01:27:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.784+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94113882599536] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.784+0000 7f7566b24800 20 remove_watcher() i=1 2024-09-18T01:27:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.784+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94113882603232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988a7070 con 0x5598988a18f0 2024-09-18T01:27:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.785+0000 7f755a0df640 1 -- 172.21.15.100:0/139519656 <== osd.3 v2:172.21.15.100:6816/595195757 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94113882603232] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f754c051070 con 0x5598988a18f0 2024-09-18T01:27:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.785+0000 7f7566b24800 20 remove_watcher() i=2 2024-09-18T01:27:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.785+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94113882606288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988a7070 con 0x55989889cf40 2024-09-18T01:27:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.786+0000 7f75628e0640 1 -- 172.21.15.100:0/139519656 <== osd.2 v2:172.21.15.100:6808/3104327688 26 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94113882606288] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7554053070 con 0x55989889cf40 2024-09-18T01:27:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.786+0000 7f7566b24800 20 remove_watcher() i=3 2024-09-18T01:27:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.786+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94113882609840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988e6210 con 0x559898898550 2024-09-18T01:27:14.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.787+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94113882609840] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x559898898550 2024-09-18T01:27:14.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.787+0000 7f7566b24800 20 remove_watcher() i=4 2024-09-18T01:27:14.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.787+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94113882612960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988e6210 con 0x7f7554003550 2024-09-18T01:27:14.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.788+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94113882612960] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.788+0000 7f7566b24800 20 remove_watcher() i=5 2024-09-18T01:27:14.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.788+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94113882615056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988e6210 con 0x7f7554003550 2024-09-18T01:27:14.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.789+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94113882615056] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.789+0000 7f7566b24800 20 remove_watcher() i=6 2024-09-18T01:27:14.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.789+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94113882618896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598988e6210 con 0x7f7554003550 2024-09-18T01:27:14.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.790+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 <== osd.0 v2:172.21.15.92:6800/2777570747 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94113882618896] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c00a4a0 con 0x7f7554003550 2024-09-18T01:27:14.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.790+0000 7f7566b24800 20 remove_watcher() i=7 2024-09-18T01:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.790+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7554003550 msgr2=0x7f755403f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.790+0000 7f7566b24800 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f7554003550 0x7f755403f050 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.790+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559898898550 msgr2=0x55989889aa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.790+0000 7f7566b24800 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559898898550 0x55989889aa10 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.790+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55989889cf40 msgr2=0x55989889f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.790+0000 7f7566b24800 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55989889cf40 0x55989889f330 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.790+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5598988a18f0 msgr2=0x5598988a3db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.790+0000 7f7566b24800 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x5598988a18f0 0x5598988a3db0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f742c036b40 msgr2=0x7f742c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f742c036b40 0x7f742c039000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55989886b9c0 tx=0x7f754c06b040 comp rx=0 tx=0).stop 2024-09-18T01:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898885de0 msgr2=0x55989888cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898885de0 0x55989888cfa0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f75540274e0 tx=0x7f7554038f60 comp rx=0 tx=0).stop 2024-09-18T01:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f75630e1640 1 -- 172.21.15.100:0/139519656 reap_dead start 2024-09-18T01:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 shutdown_connections 2024-09-18T01:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 --2- 172.21.15.100:0/139519656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898885de0 0x55989888cfa0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 >> 172.21.15.100:0/139519656 conn(0x559898882190 msgr2=0x559898880260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 shutdown_connections 2024-09-18T01:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 -- 172.21.15.100:0/139519656 wait complete. 2024-09-18T01:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 -- 172.21.15.100:0/1535024308 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f743c036b40 msgr2=0x7f743c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 --2- 172.21.15.100:0/1535024308 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f743c036b40 0x7f743c039000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55989885f820 tx=0x7f754c005a00 comp rx=0 tx=0).stop 2024-09-18T01:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 -- 172.21.15.100:0/1535024308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898879370 msgr2=0x559898879790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 --2- 172.21.15.100:0/1535024308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898879370 0x559898879790 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f755404b770 tx=0x7f755401a950 comp rx=0 tx=0).stop 2024-09-18T01:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 -- 172.21.15.100:0/1535024308 shutdown_connections 2024-09-18T01:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 --2- 172.21.15.100:0/1535024308 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f743c036b40 0x7f743c039000 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 --2- 172.21.15.100:0/1535024308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559898879370 0x559898879790 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 -- 172.21.15.100:0/1535024308 >> 172.21.15.100:0/1535024308 conn(0x55989886e300 msgr2=0x559898870e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 -- 172.21.15.100:0/1535024308 shutdown_connections 2024-09-18T01:27:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 -- 172.21.15.100:0/1535024308 wait complete. 2024-09-18T01:27:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.791+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559898868ad0 msgr2=0x55989886aec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.792+0000 7f7566b24800 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559898868ad0 0x55989886aec0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.792+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559898768d90 msgr2=0x559898862330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.792+0000 7f7566b24800 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559898768d90 0x559898862330 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.792+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559898864be0 msgr2=0x559898866fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.792+0000 7f7566b24800 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559898864be0 0x559898866fd0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.792+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7448036b90 msgr2=0x7f7448039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.792+0000 7f7566b24800 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f7448036b90 0x7f7448039050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f754c057000 tx=0x7f754c052000 comp rx=0 tx=0).stop 2024-09-18T01:27:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.792+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598986d6610 msgr2=0x55989885b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.792+0000 7f7566b24800 1 --2- 172.21.15.100:0/1325317612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598986d6610 0x55989885b2c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x5598988546a0 tx=0x7f7554000ed0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.792+0000 7f75630e1640 1 -- 172.21.15.100:0/1325317612 reap_dead start 2024-09-18T01:27:14.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.792+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 shutdown_connections 2024-09-18T01:27:14.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.792+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 >> 172.21.15.100:0/1325317612 conn(0x55989875cde0 msgr2=0x55989884dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.792+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 shutdown_connections 2024-09-18T01:27:14.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.792+0000 7f7566b24800 1 -- 172.21.15.100:0/1325317612 wait complete. 2024-09-18T01:27:14.802 ERROR:root:None 2024-09-18T01:27:14.802 ERROR:root:0 2024-09-18T01:27:14.802 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-18T01:27:14.802 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-18T01:27:14.802 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-18T01:27:14.855 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:14.855 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:14.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.855+0000 7f0def698800 1 Processor -- start 2024-09-18T01:27:14.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.855+0000 7f0def698800 1 -- start start 2024-09-18T01:27:14.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.855+0000 7f0def698800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ab4f63c640 0x55ab4f6cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.855+0000 7f0def698800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ab4f587b30 con 0x55ab4f6cdb90 2024-09-18T01:27:14.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.855+0000 7f0def698800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55ab4f569360 con 0x55ab4f63c640 2024-09-18T01:27:14.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.855+0000 7f0ded18c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ab4f63c640 0x55ab4f6cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.855+0000 7f0dec98b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55ab4f6cdb90 0x55ab4f6cff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37216/0 (socket says 172.21.15.100:37216) 2024-09-18T01:27:14.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.855+0000 7f0dec98b640 1 -- 172.21.15.100:0/1224725821 learned_addr learned my addr 172.21.15.100:0/1224725821 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:14.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.856+0000 7f0de7fff640 1 -- 172.21.15.100:0/1224725821 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 448670484 0 0) 0x55ab4f587b30 con 0x55ab4f6cdb90 2024-09-18T01:27:14.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.856+0000 7f0de7fff640 1 -- 172.21.15.100:0/1224725821 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ddc001e10 con 0x55ab4f6cdb90 2024-09-18T01:27:14.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.856+0000 7f0ded18c640 1 -- 172.21.15.100:0/1224725821 >> v1:172.21.15.92:6789/0 conn(0x55ab4f6cdb90 legacy=0x55ab4f6cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.856+0000 7f0ded18c640 1 -- 172.21.15.100:0/1224725821 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab4f58fe00 con 0x55ab4f63c640 2024-09-18T01:27:14.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.858+0000 7f0ded18c640 1 --2- 172.21.15.100:0/1224725821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 0x55ab4f6cd650 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0de800a470 tx=0x7f0de8045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f3de48d9410707 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.858+0000 7f0de7fff640 1 -- 172.21.15.100:0/1224725821 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de8059070 con 0x55ab4f63c640 2024-09-18T01:27:14.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.858+0000 7f0de7fff640 1 -- 172.21.15.100:0/1224725821 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de8054570 con 0x55ab4f63c640 2024-09-18T01:27:14.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.858+0000 7f0de7fff640 1 -- 172.21.15.100:0/1224725821 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de8054870 con 0x55ab4f63c640 2024-09-18T01:27:14.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.858+0000 7f0def698800 1 -- 172.21.15.100:0/1224725821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 msgr2=0x55ab4f6cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.858+0000 7f0def698800 1 --2- 172.21.15.100:0/1224725821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 0x55ab4f6cd650 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0de800a470 tx=0x7f0de8045920 comp rx=0 tx=0).stop 2024-09-18T01:27:14.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.858+0000 7f0def698800 1 -- 172.21.15.100:0/1224725821 shutdown_connections 2024-09-18T01:27:14.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.858+0000 7f0def698800 1 --2- 172.21.15.100:0/1224725821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 0x55ab4f6cd650 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.858+0000 7f0def698800 1 -- 172.21.15.100:0/1224725821 >> 172.21.15.100:0/1224725821 conn(0x55ab4f6c2de0 msgr2=0x55ab4f6c5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.858+0000 7f0def698800 1 -- 172.21.15.100:0/1224725821 shutdown_connections 2024-09-18T01:27:14.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.858+0000 7f0def698800 1 -- 172.21.15.100:0/1224725821 wait complete. 2024-09-18T01:27:14.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.872+0000 7f0def698800 1 Processor -- start 2024-09-18T01:27:14.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.872+0000 7f0def698800 1 -- start start 2024-09-18T01:27:14.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.872+0000 7f0def698800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 0x55ab4f7b9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.872+0000 7f0def698800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab4f614450 con 0x55ab4f63c640 2024-09-18T01:27:14.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.872+0000 7f0ded18c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 0x55ab4f7b9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.872+0000 7f0ded18c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 0x55ab4f7b9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45534/0 (socket says 172.21.15.100:45534) 2024-09-18T01:27:14.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.872+0000 7f0ded18c640 1 -- 172.21.15.100:0/1716387001 learned_addr learned my addr 172.21.15.100:0/1716387001 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.873+0000 7f0ded18c640 1 -- 172.21.15.100:0/1716387001 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab4f561bc0 con 0x55ab4f63c640 2024-09-18T01:27:14.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.873+0000 7f0ded18c640 1 --2- 172.21.15.100:0/1716387001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 0x55ab4f7b9930 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f0de8025b20 tx=0x7f0de804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f648d8f47817a2f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.873+0000 7f0cdb606640 1 -- 172.21.15.100:0/1716387001 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de8062070 con 0x55ab4f63c640 2024-09-18T01:27:14.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.873+0000 7f0cdb606640 1 -- 172.21.15.100:0/1716387001 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de800a170 con 0x55ab4f63c640 2024-09-18T01:27:14.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.873+0000 7f0cdb606640 1 -- 172.21.15.100:0/1716387001 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de8059040 con 0x55ab4f63c640 2024-09-18T01:27:14.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.874+0000 7f0def698800 1 -- 172.21.15.100:0/1716387001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 msgr2=0x55ab4f7b9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.874+0000 7f0def698800 1 --2- 172.21.15.100:0/1716387001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 0x55ab4f7b9930 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f0de8025b20 tx=0x7f0de804e000 comp rx=0 tx=0).stop 2024-09-18T01:27:14.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.874+0000 7f0def698800 1 -- 172.21.15.100:0/1716387001 shutdown_connections 2024-09-18T01:27:14.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.874+0000 7f0def698800 1 --2- 172.21.15.100:0/1716387001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 0x55ab4f7b9930 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.874+0000 7f0def698800 1 -- 172.21.15.100:0/1716387001 >> 172.21.15.100:0/1716387001 conn(0x55ab4f6c2de0 msgr2=0x55ab4f7b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.874+0000 7f0def698800 1 -- 172.21.15.100:0/1716387001 shutdown_connections 2024-09-18T01:27:14.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.874+0000 7f0def698800 1 -- 172.21.15.100:0/1716387001 wait complete. 2024-09-18T01:27:14.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.874+0000 7f0def698800 1 Processor -- start 2024-09-18T01:27:14.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.874+0000 7f0def698800 1 -- start start 2024-09-18T01:27:14.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.874+0000 7f0def698800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 0x55ab4f7c1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.874+0000 7f0def698800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab4f6d1940 con 0x55ab4f63c640 2024-09-18T01:27:14.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.874+0000 7f0ded18c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 0x55ab4f7c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.874+0000 7f0ded18c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 0x55ab4f7c1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45538/0 (socket says 172.21.15.100:45538) 2024-09-18T01:27:14.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.874+0000 7f0ded18c640 1 -- 172.21.15.100:0/314319669 learned_addr learned my addr 172.21.15.100:0/314319669 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.875+0000 7f0ded18c640 1 -- 172.21.15.100:0/314319669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab4f575fe0 con 0x55ab4f63c640 2024-09-18T01:27:14.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.875+0000 7f0ded18c640 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 0x55ab4f7c1370 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0de8045960 tx=0x7f0de8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.875+0000 7f0cd9e03640 1 -- 172.21.15.100:0/314319669 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de806c070 con 0x55ab4f63c640 2024-09-18T01:27:14.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.875+0000 7f0cd9e03640 1 -- 172.21.15.100:0/314319669 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de8054bf0 con 0x55ab4f63c640 2024-09-18T01:27:14.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.875+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab4f7c18b0 con 0x55ab4f63c640 2024-09-18T01:27:14.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.875+0000 7f0cd9e03640 1 -- 172.21.15.100:0/314319669 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de8062070 con 0x55ab4f63c640 2024-09-18T01:27:14.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.875+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab4f7c1dd0 con 0x55ab4f63c640 2024-09-18T01:27:14.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.876+0000 7f0cd9e03640 1 -- 172.21.15.100:0/314319669 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0de8065040 con 0x55ab4f63c640 2024-09-18T01:27:14.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.876+0000 7f0cd9e03640 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cd4036b90 0x7f0cd4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.876+0000 7f0cd9e03640 1 -- 172.21.15.100:0/314319669 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f0de808f400 con 0x55ab4f63c640 2024-09-18T01:27:14.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.876+0000 7f0dec98b640 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cd4036b90 0x7f0cd4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.876+0000 7f0def698800 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab4f6cdb90 0x55ab4f7c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.876+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f7c8920 con 0x55ab4f6cdb90 2024-09-18T01:27:14.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.876+0000 7f0ded98d640 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab4f6cdb90 0x55ab4f7c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.876+0000 7f0dec98b640 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cd4036b90 0x7f0cd4039050 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8000f60 tx=0x7f0dd80010a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.877+0000 7f0ded98d640 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab4f6cdb90 0x55ab4f7c83e0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.877+0000 7f0ded98d640 1 -- 172.21.15.100:0/314319669 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f6cdb90 2024-09-18T01:27:14.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.877+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f7c5990 con 0x55ab4f6cdb90 2024-09-18T01:27:14.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.877+0000 7f0ded98d640 1 -- 172.21.15.100:0/314319669 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f6cdb90 2024-09-18T01:27:14.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.877+0000 7f0def698800 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab4f7cac10 0x55ab4f7cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.877+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f7cd6a0 con 0x55ab4f7cac10 2024-09-18T01:27:14.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.877+0000 7f0ded18c640 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab4f7cac10 0x55ab4f7cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.878+0000 7f0ded18c640 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab4f7cac10 0x55ab4f7cd000 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.878+0000 7f0ded18c640 1 -- 172.21.15.100:0/314319669 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0de805c040 con 0x55ab4f7cac10 2024-09-18T01:27:14.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.878+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f7c9ab0 con 0x55ab4f6cdb90 2024-09-18T01:27:14.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.878+0000 7f0ded98d640 1 -- 172.21.15.100:0/314319669 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f6cdb90 2024-09-18T01:27:14.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.878+0000 7f0def698800 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ab4f7ceb00 0x55ab4f7d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.878+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f7d15f0 con 0x55ab4f7ceb00 2024-09-18T01:27:14.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.879+0000 7f0dec98b640 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ab4f7ceb00 0x55ab4f7d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.879+0000 7f0dec98b640 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ab4f7ceb00 0x55ab4f7d0ef0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.879+0000 7f0dec98b640 1 -- 172.21.15.100:0/314319669 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f7ceb00 2024-09-18T01:27:14.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.880+0000 7f0def698800 1 Processor -- start 2024-09-18T01:27:14.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.880+0000 7f0def698800 1 -- start start 2024-09-18T01:27:14.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.880+0000 7f0def698800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7df320 0x55ab4f7df740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.880+0000 7f0def698800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab4f563580 con 0x55ab4f7df320 2024-09-18T01:27:14.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.880+0000 7f0ded18c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7df320 0x55ab4f7df740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.880+0000 7f0ded18c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7df320 0x55ab4f7df740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45548/0 (socket says 172.21.15.100:45548) 2024-09-18T01:27:14.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.880+0000 7f0ded18c640 1 -- 172.21.15.100:0/1256684464 learned_addr learned my addr 172.21.15.100:0/1256684464 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.880+0000 7f0ded18c640 1 -- 172.21.15.100:0/1256684464 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab4f7dfc80 con 0x55ab4f7df320 2024-09-18T01:27:14.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.881+0000 7f0ded18c640 1 --2- 172.21.15.100:0/1256684464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7df320 0x55ab4f7df740 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f0de808d740 tx=0x7f0de8068f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.881+0000 7f0cd2ffd640 1 -- 172.21.15.100:0/1256684464 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de8059040 con 0x55ab4f7df320 2024-09-18T01:27:14.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.881+0000 7f0cd2ffd640 1 -- 172.21.15.100:0/1256684464 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de8068550 con 0x55ab4f7df320 2024-09-18T01:27:14.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.881+0000 7f0def698800 1 -- 172.21.15.100:0/1256684464 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab4f7dff10 con 0x55ab4f7df320 2024-09-18T01:27:14.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.881+0000 7f0cd2ffd640 1 -- 172.21.15.100:0/1256684464 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de8068830 con 0x55ab4f7df320 2024-09-18T01:27:14.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.881+0000 7f0def698800 1 -- 172.21.15.100:0/1256684464 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab4f7e2bf0 con 0x55ab4f7df320 2024-09-18T01:27:14.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.881+0000 7f0cd2ffd640 1 -- 172.21.15.100:0/1256684464 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0de8073110 con 0x55ab4f7df320 2024-09-18T01:27:14.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.882+0000 7f0cd2ffd640 1 --2- 172.21.15.100:0/1256684464 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cc4036b90 0x7f0cc4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.882+0000 7f0cd2ffd640 1 -- 172.21.15.100:0/1256684464 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f0de804d050 con 0x55ab4f7df320 2024-09-18T01:27:14.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.882+0000 7f0dec98b640 1 --2- 172.21.15.100:0/1256684464 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cc4036b90 0x7f0cc4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.882+0000 7f0def698800 1 Processor -- start 2024-09-18T01:27:14.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.882+0000 7f0def698800 1 -- start start 2024-09-18T01:27:14.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.882+0000 7f0dec98b640 1 --2- 172.21.15.100:0/1256684464 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cc4036b90 0x7f0cc4039050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800bf90 tx=0x7f0dd800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.882+0000 7f0def698800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7ebd90 0x55ab4f7ec190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.882+0000 7f0def698800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab4f7ba020 con 0x55ab4f7ebd90 2024-09-18T01:27:14.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.882+0000 7f0ded18c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7ebd90 0x55ab4f7ec190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.882+0000 7f0ded18c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7ebd90 0x55ab4f7ec190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45560/0 (socket says 172.21.15.100:45560) 2024-09-18T01:27:14.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.882+0000 7f0ded18c640 1 -- 172.21.15.100:0/835730826 learned_addr learned my addr 172.21.15.100:0/835730826 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.883+0000 7f0ded18c640 1 -- 172.21.15.100:0/835730826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab4f7ec760 con 0x55ab4f7ebd90 2024-09-18T01:27:14.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.883+0000 7f0ded18c640 1 --2- 172.21.15.100:0/835730826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7ebd90 0x55ab4f7ec190 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f0de808f010 tx=0x7f0de8064350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e925fef7da4924 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.883+0000 7f0cd0ff9640 1 -- 172.21.15.100:0/835730826 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de8086e40 con 0x55ab4f7ebd90 2024-09-18T01:27:14.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.883+0000 7f0cd0ff9640 1 -- 172.21.15.100:0/835730826 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de809d030 con 0x55ab4f7ebd90 2024-09-18T01:27:14.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.883+0000 7f0cd0ff9640 1 -- 172.21.15.100:0/835730826 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de80885b0 con 0x55ab4f7ebd90 2024-09-18T01:27:14.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.883+0000 7f0def698800 1 -- 172.21.15.100:0/835730826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7ebd90 msgr2=0x55ab4f7ec190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.883+0000 7f0def698800 1 --2- 172.21.15.100:0/835730826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7ebd90 0x55ab4f7ec190 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f0de808f010 tx=0x7f0de8064350 comp rx=0 tx=0).stop 2024-09-18T01:27:14.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.883+0000 7f0def698800 1 -- 172.21.15.100:0/835730826 shutdown_connections 2024-09-18T01:27:14.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.883+0000 7f0def698800 1 --2- 172.21.15.100:0/835730826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7ebd90 0x55ab4f7ec190 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.883+0000 7f0def698800 1 -- 172.21.15.100:0/835730826 >> 172.21.15.100:0/835730826 conn(0x55ab4f7e8140 msgr2=0x55ab4f7e6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.883+0000 7f0def698800 1 -- 172.21.15.100:0/835730826 shutdown_connections 2024-09-18T01:27:14.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.883+0000 7f0def698800 1 -- 172.21.15.100:0/835730826 wait complete. 2024-09-18T01:27:14.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.884+0000 7f0def698800 1 Processor -- start 2024-09-18T01:27:14.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.884+0000 7f0def698800 1 -- start start 2024-09-18T01:27:14.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.884+0000 7f0def698800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7ebd90 0x55ab4f7f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.884+0000 7f0def698800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab4f7ecbf0 con 0x55ab4f7ebd90 2024-09-18T01:27:14.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.884+0000 7f0ded18c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7ebd90 0x55ab4f7f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.884+0000 7f0ded18c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7ebd90 0x55ab4f7f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45564/0 (socket says 172.21.15.100:45564) 2024-09-18T01:27:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.884+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 learned_addr learned my addr 172.21.15.100:0/1581391300 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.884+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab4f7f3540 con 0x55ab4f7ebd90 2024-09-18T01:27:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.885+0000 7f0ded18c640 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7ebd90 0x55ab4f7f3000 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0de8064390 tx=0x7f0de805bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.885+0000 7f0cc2ffd640 1 -- 172.21.15.100:0/1581391300 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de80b2070 con 0x55ab4f7ebd90 2024-09-18T01:27:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.885+0000 7f0cc2ffd640 1 -- 172.21.15.100:0/1581391300 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de808dca0 con 0x55ab4f7ebd90 2024-09-18T01:27:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.885+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab4f7f3540 con 0x55ab4f7ebd90 2024-09-18T01:27:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.885+0000 7f0cc2ffd640 1 -- 172.21.15.100:0/1581391300 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de80888e0 con 0x55ab4f7ebd90 2024-09-18T01:27:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.885+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab4f7f3540 con 0x55ab4f7ebd90 2024-09-18T01:27:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.885+0000 7f0cc2ffd640 1 -- 172.21.15.100:0/1581391300 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0de80b5070 con 0x55ab4f7ebd90 2024-09-18T01:27:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.886+0000 7f0cc2ffd640 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cb8036b40 0x7f0cb8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.886+0000 7f0cc2ffd640 1 -- 172.21.15.100:0/1581391300 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f0de80aa070 con 0x55ab4f7ebd90 2024-09-18T01:27:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.886+0000 7f0dec98b640 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cb8036b40 0x7f0cb8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.886+0000 7f0dec98b640 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cb8036b40 0x7f0cb8039000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55ab4f7c58d0 tx=0x7f0dd8010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.886+0000 7f0def698800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.886+0000 7f0def698800 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab4f7fe790 0x55ab4f800c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.886+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f8013a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.886+0000 7f0ded98d640 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab4f7fe790 0x55ab4f800c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0ded98d640 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab4f7fe790 0x55ab4f800c50 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0def698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0def698800 20 realm 2024-09-18T01:27:14.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0def698800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f8017b0 con 0x55ab4f7fe790 2024-09-18T01:27:14.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0def698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0def698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:14.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0def698800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802080 con 0x55ab4f7fe790 2024-09-18T01:27:14.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0def698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0def698800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.887+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f7fe790 2024-09-18T01:27:14.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.888+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.888+0000 7f0def698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:14.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.888+0000 7f0def698800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.888+0000 7f0def698800 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab4f803180 0x55ab4f805570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.888+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f805b80 con 0x55ab4f803180 2024-09-18T01:27:14.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.888+0000 7f0ded18c640 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab4f803180 0x55ab4f805570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.888+0000 7f0ded18c640 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab4f803180 0x55ab4f805570 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.888+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.888+0000 7f0def698800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.888+0000 7f0def698800 20 searching for the correct realm 2024-09-18T01:27:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.888+0000 7f0def698800 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ab4f807b30 0x55ab4f809ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.888+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80a6c0 con 0x55ab4f807b30 2024-09-18T01:27:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.888+0000 7f0dec98b640 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ab4f807b30 0x55ab4f809ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.889+0000 7f0dec98b640 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ab4f807b30 0x55ab4f809ff0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.889+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.889+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80a6c0 con 0x55ab4f803180 2024-09-18T01:27:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.889+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.889+0000 7f0ded18c640 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0de80b7060 0x7f0de804e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.889+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80a6c0 con 0x7f0de80b7060 2024-09-18T01:27:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.890+0000 7f0ded98d640 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0de80b7060 0x7f0de804e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.890+0000 7f0ded98d640 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0de80b7060 0x7f0de804e0e0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.890+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.890+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f7fe790 2024-09-18T01:27:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.890+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.890+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f7fe790 2024-09-18T01:27:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.891+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.891+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x7f0de80b7060 2024-09-18T01:27:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.891+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.891+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x7f0de80b7060 2024-09-18T01:27:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.891+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.891+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f803180 2024-09-18T01:27:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.891+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.891+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f807b30 2024-09-18T01:27:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.892+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.892+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f7fe790 2024-09-18T01:27:14.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.892+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.892+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f803180 2024-09-18T01:27:14.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.892+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.892+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f7fe790 2024-09-18T01:27:14.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.892+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.892+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f803180 2024-09-18T01:27:14.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.893+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.893+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f807b30 2024-09-18T01:27:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.893+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.893+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f807b30 2024-09-18T01:27:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.893+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.893+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x7f0de80b7060 2024-09-18T01:27:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.893+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.893+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f807b30 2024-09-18T01:27:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.893+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.893+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f807b30 2024-09-18T01:27:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.894+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.894+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f7fe790 2024-09-18T01:27:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.894+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.894+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f7fe790 2024-09-18T01:27:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.894+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.894+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x7f0de80b7060 2024-09-18T01:27:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.894+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.894+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f807b30 2024-09-18T01:27:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.895+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.895+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f803180 2024-09-18T01:27:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.895+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.895+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f7fe790 2024-09-18T01:27:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.895+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.895+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x7f0de80b7060 2024-09-18T01:27:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.895+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.895+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f807b30 2024-09-18T01:27:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.896+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.896+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f803180 2024-09-18T01:27:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.896+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.896+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f803180 2024-09-18T01:27:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.896+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.896+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f807b30 2024-09-18T01:27:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.896+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.896+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x7f0de80b7060 2024-09-18T01:27:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f7fe790 2024-09-18T01:27:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f802420 con 0x55ab4f803180 2024-09-18T01:27:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0def698800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0def698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0def698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0def698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0def698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0def698800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0def698800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f806440 con 0x55ab4f7fe790 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0def698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0def698800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f806830 con 0x55ab4f7fe790 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.897+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f806830 con 0x7f0de80b7060 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 20 zone default found 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 4 Realm: () 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 20 zonegroup default 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f806040 con 0x7f0de80b7060 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80c520 con 0x55ab4f807b30 2024-09-18T01:27:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.898+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80c8c0 con 0x55ab4f807b30 2024-09-18T01:27:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.899+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.899+0000 7f0def698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.899+0000 7f0def698800 20 started sync module instance, tier type = 2024-09-18T01:27:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.899+0000 7f0def698800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.899+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80b9c0 con 0x55ab4f803180 2024-09-18T01:27:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.900+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.900+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94194261605808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80d110 con 0x55ab4f803180 2024-09-18T01:27:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.900+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80d960 con 0x55ab4f7fe790 2024-09-18T01:27:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.901+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94194261605808] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.901+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.901+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94194261609568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80d570 con 0x55ab4f7fe790 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.901+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80e050 con 0x55ab4f807b30 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.902+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94194261609568] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.902+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.903+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94194261613312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80e440 con 0x55ab4f807b30 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.903+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80ee60 con 0x55ab4f803180 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.903+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94194261613312] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.904+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.904+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94194261616976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80f280 con 0x55ab4f803180 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.904+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80fc80 con 0x55ab4f7fe790 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.905+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.905+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94194261620624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f80fbf0 con 0x55ab4f7fe790 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.905+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f810c50 con 0x7f0de80b7060 2024-09-18T01:27:14.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.905+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94194261616976] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.905+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94194261620624] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.906+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.906+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94194261624640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f810c10 con 0x7f0de80b7060 2024-09-18T01:27:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.906+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f8114f0 con 0x7f0de80b7060 2024-09-18T01:27:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.907+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94194261624640] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.907+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.907+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94194261610624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f810c10 con 0x7f0de80b7060 2024-09-18T01:27:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.907+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f811b10 con 0x7f0de80b7060 2024-09-18T01:27:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.908+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94194261610624] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.908+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.908+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94194261626944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f811b10 con 0x7f0de80b7060 2024-09-18T01:27:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.908+0000 7f0def698800 20 add_watcher() i=0 2024-09-18T01:27:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.908+0000 7f0def698800 20 add_watcher() i=1 2024-09-18T01:27:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.908+0000 7f0def698800 20 add_watcher() i=2 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.908+0000 7f0def698800 20 add_watcher() i=3 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.908+0000 7f0def698800 20 add_watcher() i=4 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.908+0000 7f0def698800 20 add_watcher() i=5 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.908+0000 7f0def698800 20 add_watcher() i=6 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.909+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94194261626944] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.909+0000 7f0def698800 20 add_watcher() i=7 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.909+0000 7f0def698800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.909+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f814e50 con 0x55ab4f7fe790 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.910+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.910+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94194261641328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f811c80 con 0x55ab4f7fe790 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.911+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94194261641328] v35'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.911+0000 7f0ca3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.911+0000 7f0def698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.911+0000 7f0def698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:14.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.911+0000 7f0def698800 5 note: GC not initialized 2024-09-18T01:27:14.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.911+0000 7f0ca2fe5640 20 reqs_thread_entry: start 2024-09-18T01:27:14.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.911+0000 7f0def698800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:14.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.911+0000 7f0def698800 20 Filter name: none 2024-09-18T01:27:14.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.911+0000 7f0ca0fe1640 20 reqs_thread_entry: start 2024-09-18T01:27:14.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-18T01:27:14.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f848310 con 0x55ab4f807b30 2024-09-18T01:27:14.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-18T01:27:14.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-18T01:27:14.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-18T01:27:14.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 20 rados->read ofs=0 len=0 2024-09-18T01:27:14.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f846e00 con 0x55ab4f807b30 2024-09-18T01:27:14.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:14.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-18T01:27:14.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-18T01:27:14.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-18T01:27:14.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-18T01:27:14.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.912+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f84b900 con 0x55ab4f807b30 2024-09-18T01:27:14.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.913+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v35'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.913+0000 7f0def698800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-18T01:27:14.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.913+0000 7f0def698800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-18T01:27:14.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.913+0000 7f0def698800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-18T01:27:14.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.913+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94194261862640 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f84b240 con 0x55ab4f807b30 2024-09-18T01:27:14.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.914+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== watch-notify(notify (1) cookie 94194261613312 notify 150323855369 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55ab4f84bca0 con 0x55ab4f807b30 2024-09-18T01:27:14.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.914+0000 7f0cd0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855369 cookie 94194261613312 notifier 4867 bl.length()=542 2024-09-18T01:27:14.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.914+0000 7f0cd0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-18T01:27:14.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.914+0000 7f0cd0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-18T01:27:14.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.914+0000 7f0cd0ff9640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f0cb0003ea0 con 0x55ab4f807b30 2024-09-18T01:27:14.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.914+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(65 notify.2 [notify cookie 94194261862640 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.914+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.914+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== watch-notify(notify_complete (2) cookie 94194261862640 notify 150323855369 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ab4f846bc0 con 0x55ab4f807b30 2024-09-18T01:27:14.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.914+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f8498e0 con 0x55ab4f807b30 2024-09-18T01:27:14.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.915+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v35'5 uv5 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.915+0000 7f0def698800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-18T01:27:14.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.915+0000 7f0def698800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-18T01:27:14.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.915+0000 7f0def698800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-18T01:27:14.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.915+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94194261866096 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f84ada0 con 0x7f0de80b7060 2024-09-18T01:27:14.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.916+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== watch-notify(notify (1) cookie 94194261624640 notify 150323855390 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7f0de0018bb0 con 0x7f0de80b7060 2024-09-18T01:27:14.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.916+0000 7f0cc3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855390 cookie 94194261624640 notifier 4867 bl.length()=175 2024-09-18T01:27:14.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.916+0000 7f0cc3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-18T01:27:14.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.916+0000 7f0cc3fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-18T01:27:14.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.916+0000 7f0cc3fff640 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f0c14003400 con 0x7f0de80b7060 2024-09-18T01:27:14.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.916+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(68 notify.5 [notify cookie 94194261866096 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.916+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.916+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== watch-notify(notify_complete (2) cookie 94194261866096 notify 150323855390 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0de0026410 con 0x7f0de80b7060 2024-09-18T01:27:14.929 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-18T01:27:14.913465Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:27:14.913451Z","tags":[],"group_ids":[]} 2024-09-18T01:27:14.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.917+0000 7f0ca3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:14.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.917+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94194261641328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f846050 con 0x55ab4f7fe790 2024-09-18T01:27:14.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.918+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94194261641328] v35'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.918+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94194261605808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f846050 con 0x55ab4f803180 2024-09-18T01:27:14.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.919+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94194261605808] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.919+0000 7f0def698800 20 remove_watcher() i=0 2024-09-18T01:27:14.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.919+0000 7f0def698800 2 removed watcher, disabling cache 2024-09-18T01:27:14.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.919+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94194261609568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f846050 con 0x55ab4f7fe790 2024-09-18T01:27:14.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.920+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94194261609568] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.920+0000 7f0def698800 20 remove_watcher() i=1 2024-09-18T01:27:14.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.920+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94194261613312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f846050 con 0x55ab4f807b30 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.921+0000 7f0dec98b640 1 -- 172.21.15.100:0/1581391300 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94194261613312] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd8009050 con 0x55ab4f807b30 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.921+0000 7f0def698800 20 remove_watcher() i=2 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.921+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94194261616976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f846050 con 0x55ab4f803180 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.922+0000 7f0ded18c640 1 -- 172.21.15.100:0/1581391300 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94194261616976] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de80b4030 con 0x55ab4f803180 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.922+0000 7f0def698800 20 remove_watcher() i=3 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.922+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94194261620624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f846050 con 0x55ab4f7fe790 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.923+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94194261620624] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x55ab4f7fe790 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.923+0000 7f0def698800 20 remove_watcher() i=4 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.923+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94194261624640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f846050 con 0x7f0de80b7060 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.925+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94194261624640] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.925+0000 7f0def698800 20 remove_watcher() i=5 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.925+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94194261610624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f846050 con 0x7f0de80b7060 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.925+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94194261610624] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.925+0000 7f0def698800 20 remove_watcher() i=6 2024-09-18T01:27:14.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.926+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94194261626944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ab4f846050 con 0x7f0de80b7060 2024-09-18T01:27:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.926+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94194261626944] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0de000a4a0 con 0x7f0de80b7060 2024-09-18T01:27:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.926+0000 7f0def698800 20 remove_watcher() i=7 2024-09-18T01:27:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0de80b7060 msgr2=0x7f0de804e0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f0de80b7060 0x7f0de804e0e0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab4f7fe790 msgr2=0x55ab4f800c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab4f7fe790 0x55ab4f800c50 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab4f803180 msgr2=0x55ab4f805570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab4f803180 0x55ab4f805570 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ab4f807b30 msgr2=0x55ab4f809ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ab4f807b30 0x55ab4f809ff0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cb8036b40 msgr2=0x7f0cb8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cb8036b40 0x7f0cb8039000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55ab4f7c58d0 tx=0x7f0dd8010000 comp rx=0 tx=0).stop 2024-09-18T01:27:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7ebd90 msgr2=0x55ab4f7f3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 --2- 172.21.15.100:0/1581391300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7ebd90 0x55ab4f7f3000 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0de8064390 tx=0x7f0de805bf40 comp rx=0 tx=0).stop 2024-09-18T01:27:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 reap_dead start 2024-09-18T01:27:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0ded98d640 1 -- 172.21.15.100:0/1581391300 reap_dead start 2024-09-18T01:27:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 shutdown_connections 2024-09-18T01:27:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 >> 172.21.15.100:0/1581391300 conn(0x55ab4f7e8140 msgr2=0x55ab4f7e6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 shutdown_connections 2024-09-18T01:27:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1581391300 wait complete. 2024-09-18T01:27:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1256684464 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cc4036b90 msgr2=0x7f0cc4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 --2- 172.21.15.100:0/1256684464 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cc4036b90 0x7f0cc4039050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800bf90 tx=0x7f0dd800f000 comp rx=0 tx=0).stop 2024-09-18T01:27:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1256684464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7df320 msgr2=0x55ab4f7df740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 --2- 172.21.15.100:0/1256684464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7df320 0x55ab4f7df740 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f0de808d740 tx=0x7f0de8068f10 comp rx=0 tx=0).stop 2024-09-18T01:27:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1256684464 shutdown_connections 2024-09-18T01:27:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 --2- 172.21.15.100:0/1256684464 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cc4036b90 0x7f0cc4039050 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 --2- 172.21.15.100:0/1256684464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f7df320 0x55ab4f7df740 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1256684464 >> 172.21.15.100:0/1256684464 conn(0x55ab4f7d42b0 msgr2=0x55ab4f7d6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1256684464 shutdown_connections 2024-09-18T01:27:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.927+0000 7f0def698800 1 -- 172.21.15.100:0/1256684464 wait complete. 2024-09-18T01:27:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ab4f7ceb00 msgr2=0x55ab4f7d0ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0def698800 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ab4f7ceb00 0x55ab4f7d0ef0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab4f6cdb90 msgr2=0x55ab4f7c83e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0def698800 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ab4f6cdb90 0x55ab4f7c83e0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab4f7cac10 msgr2=0x55ab4f7cd000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0def698800 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ab4f7cac10 0x55ab4f7cd000 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cd4036b90 msgr2=0x7f0cd4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0def698800 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f0cd4036b90 0x7f0cd4039050 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8000f60 tx=0x7f0dd80010a0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 msgr2=0x55ab4f7c1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0def698800 1 --2- 172.21.15.100:0/314319669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab4f63c640 0x55ab4f7c1370 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0de8045960 tx=0x7f0de8002fb0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0ded98d640 1 -- 172.21.15.100:0/314319669 reap_dead start 2024-09-18T01:27:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 shutdown_connections 2024-09-18T01:27:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 >> 172.21.15.100:0/314319669 conn(0x55ab4f6c2de0 msgr2=0x55ab4f7b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 shutdown_connections 2024-09-18T01:27:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.928+0000 7f0def698800 1 -- 172.21.15.100:0/314319669 wait complete. 2024-09-18T01:27:14.940 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-18T01:27:14.913465Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.913451Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:14.940 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-18T01:27:14.913465Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.913451Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:14.940 ERROR:root:0 2024-09-18T01:27:14.940 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:14.945 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:14.945 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-18T01:27:14.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-18T01:27:14.945 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-18T01:27:14.989 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:14.989 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:14.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.989+0000 7f2a00724800 1 Processor -- start 2024-09-18T01:27:14.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.989+0000 7f2a00724800 1 -- start start 2024-09-18T01:27:14.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.989+0000 7f2a00724800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560376b69970 0x560376b6bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:14.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.989+0000 7f2a00724800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560376a25b30 con 0x560376b65ba0 2024-09-18T01:27:14.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.989+0000 7f2a00724800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x560376a07360 con 0x560376b69970 2024-09-18T01:27:14.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.989+0000 7f29f3fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x560376b69970 0x560376b6bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:14.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.989+0000 7f29fc4d9640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x560376b65ba0 0x560376b65fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37218/0 (socket says 172.21.15.100:37218) 2024-09-18T01:27:14.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.989+0000 7f29fc4d9640 1 -- 172.21.15.100:0/3991312879 learned_addr learned my addr 172.21.15.100:0/3991312879 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:14.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.989+0000 7f29f3fff640 1 -- 172.21.15.100:0/3991312879 >> v1:172.21.15.92:6789/0 conn(0x560376b65ba0 legacy=0x560376b65fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.990+0000 7f29f3fff640 1 -- 172.21.15.100:0/3991312879 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560376a2de00 con 0x560376b69970 2024-09-18T01:27:14.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.989+0000 7f29fbcd8640 1 -- 172.21.15.100:0/3991312879 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3500805600 0 0) 0x560376a25b30 con 0x560376b65ba0 2024-09-18T01:27:14.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.991+0000 7f29f3fff640 1 --2- 172.21.15.100:0/3991312879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b69970 0x560376b6bd60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f29e400a470 tx=0x7f29e4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c203882963b5ae59 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:14.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.991+0000 7f29fbcd8640 1 -- 172.21.15.100:0/3991312879 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e4053570 con 0x560376b69970 2024-09-18T01:27:14.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.991+0000 7f29fbcd8640 1 -- 172.21.15.100:0/3991312879 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e4058070 con 0x560376b69970 2024-09-18T01:27:14.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.991+0000 7f29fbcd8640 1 -- 172.21.15.100:0/3991312879 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e4053880 con 0x560376b69970 2024-09-18T01:27:14.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.992+0000 7f2a00724800 1 -- 172.21.15.100:0/3991312879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b69970 msgr2=0x560376b6bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:14.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.992+0000 7f2a00724800 1 --2- 172.21.15.100:0/3991312879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b69970 0x560376b6bd60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f29e400a470 tx=0x7f29e4045a20 comp rx=0 tx=0).stop 2024-09-18T01:27:14.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.992+0000 7f2a00724800 1 -- 172.21.15.100:0/3991312879 shutdown_connections 2024-09-18T01:27:14.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.992+0000 7f2a00724800 1 --2- 172.21.15.100:0/3991312879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b69970 0x560376b6bd60 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:14.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.992+0000 7f2a00724800 1 -- 172.21.15.100:0/3991312879 >> 172.21.15.100:0/3991312879 conn(0x560376b605c0 msgr2=0x560376b629e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:14.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.992+0000 7f2a00724800 1 -- 172.21.15.100:0/3991312879 shutdown_connections 2024-09-18T01:27:14.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:14.992+0000 7f2a00724800 1 -- 172.21.15.100:0/3991312879 wait complete. 2024-09-18T01:27:15.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.005+0000 7f2a00724800 1 Processor -- start 2024-09-18T01:27:15.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.005+0000 7f2a00724800 1 -- start start 2024-09-18T01:27:15.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.005+0000 7f2a00724800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b65ba0 0x560376c53480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.005+0000 7f2a00724800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560376ab2330 con 0x560376b65ba0 2024-09-18T01:27:15.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.006+0000 7f29fc4d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b65ba0 0x560376c53480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.006+0000 7f29fc4d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b65ba0 0x560376c53480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45580/0 (socket says 172.21.15.100:45580) 2024-09-18T01:27:15.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.006+0000 7f29fc4d9640 1 -- 172.21.15.100:0/994437363 learned_addr learned my addr 172.21.15.100:0/994437363 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.006+0000 7f29fc4d9640 1 -- 172.21.15.100:0/994437363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603769ffbc0 con 0x560376b65ba0 2024-09-18T01:27:15.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.006+0000 7f29fc4d9640 1 --2- 172.21.15.100:0/994437363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b65ba0 0x560376c53480 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f29ec00b240 tx=0x7f29ec00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c4a672a2081f55 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.006+0000 7f28ea60c640 1 -- 172.21.15.100:0/994437363 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ec008070 con 0x560376b65ba0 2024-09-18T01:27:15.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.006+0000 7f28ea60c640 1 -- 172.21.15.100:0/994437363 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ec00d500 con 0x560376b65ba0 2024-09-18T01:27:15.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.006+0000 7f28ea60c640 1 -- 172.21.15.100:0/994437363 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ec00d860 con 0x560376b65ba0 2024-09-18T01:27:15.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.007+0000 7f2a00724800 1 -- 172.21.15.100:0/994437363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b65ba0 msgr2=0x560376c53480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.007+0000 7f2a00724800 1 --2- 172.21.15.100:0/994437363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b65ba0 0x560376c53480 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f29ec00b240 tx=0x7f29ec00b700 comp rx=0 tx=0).stop 2024-09-18T01:27:15.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.007+0000 7f2a00724800 1 -- 172.21.15.100:0/994437363 shutdown_connections 2024-09-18T01:27:15.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.007+0000 7f2a00724800 1 --2- 172.21.15.100:0/994437363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b65ba0 0x560376c53480 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.007+0000 7f2a00724800 1 -- 172.21.15.100:0/994437363 >> 172.21.15.100:0/994437363 conn(0x560376b605c0 msgr2=0x560376c4ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.007+0000 7f2a00724800 1 -- 172.21.15.100:0/994437363 shutdown_connections 2024-09-18T01:27:15.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.007+0000 7f2a00724800 1 -- 172.21.15.100:0/994437363 wait complete. 2024-09-18T01:27:15.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.007+0000 7f2a00724800 1 Processor -- start 2024-09-18T01:27:15.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.007+0000 7f2a00724800 1 -- start start 2024-09-18T01:27:15.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.008+0000 7f2a00724800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b65ba0 0x560376c5aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.008+0000 7f2a00724800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560376b6c5a0 con 0x560376b65ba0 2024-09-18T01:27:15.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.008+0000 7f29fc4d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b65ba0 0x560376c5aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.008+0000 7f29fc4d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b65ba0 0x560376c5aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45592/0 (socket says 172.21.15.100:45592) 2024-09-18T01:27:15.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.008+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1637173498 learned_addr learned my addr 172.21.15.100:0/1637173498 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.008+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1637173498 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560376a13fe0 con 0x560376b65ba0 2024-09-18T01:27:15.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.008+0000 7f29fc4d9640 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b65ba0 0x560376c5aec0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x560376c542e0 tx=0x7f29ec000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.008+0000 7f28e8e09640 1 -- 172.21.15.100:0/1637173498 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ec019870 con 0x560376b65ba0 2024-09-18T01:27:15.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.008+0000 7f28e8e09640 1 -- 172.21.15.100:0/1637173498 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ec019a10 con 0x560376b65ba0 2024-09-18T01:27:15.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.008+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560376c5b400 con 0x560376b65ba0 2024-09-18T01:27:15.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.008+0000 7f28e8e09640 1 -- 172.21.15.100:0/1637173498 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ec019d30 con 0x560376b65ba0 2024-09-18T01:27:15.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.009+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560376c5b920 con 0x560376b65ba0 2024-09-18T01:27:15.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.009+0000 7f28e8e09640 1 -- 172.21.15.100:0/1637173498 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f29ec017040 con 0x560376b65ba0 2024-09-18T01:27:15.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.009+0000 7f28e8e09640 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28e4036b90 0x7f28e4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.009+0000 7f28e8e09640 1 -- 172.21.15.100:0/1637173498 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f29ec015020 con 0x560376b65ba0 2024-09-18T01:27:15.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.010+0000 7f29f3fff640 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28e4036b90 0x7f28e4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.010+0000 7f2a00724800 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560376b69970 0x560376c61f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.010+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376c624b0 con 0x560376b69970 2024-09-18T01:27:15.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.010+0000 7f29fccda640 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560376b69970 0x560376c61f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.010+0000 7f29f3fff640 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28e4036b90 0x7f28e4039050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f29e4057000 tx=0x7f29e4052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.010+0000 7f29fccda640 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560376b69970 0x560376c61f30 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.010+0000 7f29fccda640 1 -- 172.21.15.100:0/1637173498 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376b69970 2024-09-18T01:27:15.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.010+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376c5f500 con 0x560376b69970 2024-09-18T01:27:15.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.011+0000 7f29fccda640 1 -- 172.21.15.100:0/1637173498 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376b69970 2024-09-18T01:27:15.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.011+0000 7f2a00724800 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560376c647e0 0x560376c66bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.011+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376c67270 con 0x560376c647e0 2024-09-18T01:27:15.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.011+0000 7f29fc4d9640 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560376c647e0 0x560376c66bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.011+0000 7f29fc4d9640 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560376c647e0 0x560376c66bd0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.011+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1637173498 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c647e0 2024-09-18T01:27:15.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.011+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376c63680 con 0x560376b69970 2024-09-18T01:27:15.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.012+0000 7f29fccda640 1 -- 172.21.15.100:0/1637173498 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376b69970 2024-09-18T01:27:15.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.012+0000 7f2a00724800 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560376c686d0 0x560376c6aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.012+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376c6b1c0 con 0x560376c686d0 2024-09-18T01:27:15.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.012+0000 7f29f3fff640 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560376c686d0 0x560376c6aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.012+0000 7f29f3fff640 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560376c686d0 0x560376c6aac0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.012+0000 7f29f3fff640 1 -- 172.21.15.100:0/1637173498 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f29e4051070 con 0x560376c686d0 2024-09-18T01:27:15.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.013+0000 7f2a00724800 1 Processor -- start 2024-09-18T01:27:15.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.013+0000 7f2a00724800 1 -- start start 2024-09-18T01:27:15.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.013+0000 7f2a00724800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c78f70 0x560376c79390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.013+0000 7f2a00724800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560376a01580 con 0x560376c78f70 2024-09-18T01:27:15.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.013+0000 7f29fc4d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c78f70 0x560376c79390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.013+0000 7f29fc4d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c78f70 0x560376c79390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45594/0 (socket says 172.21.15.100:45594) 2024-09-18T01:27:15.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.013+0000 7f29fc4d9640 1 -- 172.21.15.100:0/239186213 learned_addr learned my addr 172.21.15.100:0/239186213 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.013+0000 7f29fc4d9640 1 -- 172.21.15.100:0/239186213 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560376c798d0 con 0x560376c78f70 2024-09-18T01:27:15.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.013+0000 7f29fc4d9640 1 --2- 172.21.15.100:0/239186213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c78f70 0x560376c79390 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f29ec04b770 tx=0x7f29ec01aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.014+0000 7f28e1ffb640 1 -- 172.21.15.100:0/239186213 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ec01a8c0 con 0x560376c78f70 2024-09-18T01:27:15.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.014+0000 7f28e1ffb640 1 -- 172.21.15.100:0/239186213 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ec034070 con 0x560376c78f70 2024-09-18T01:27:15.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.014+0000 7f28e1ffb640 1 -- 172.21.15.100:0/239186213 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ec00eaa0 con 0x560376c78f70 2024-09-18T01:27:15.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.014+0000 7f2a00724800 1 -- 172.21.15.100:0/239186213 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560376c79b60 con 0x560376c78f70 2024-09-18T01:27:15.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.014+0000 7f2a00724800 1 -- 172.21.15.100:0/239186213 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560376c7c840 con 0x560376c78f70 2024-09-18T01:27:15.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.014+0000 7f28e1ffb640 1 -- 172.21.15.100:0/239186213 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f29ec00ec40 con 0x560376c78f70 2024-09-18T01:27:15.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.014+0000 7f28e1ffb640 1 --2- 172.21.15.100:0/239186213 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28d4036b90 0x7f28d4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.015+0000 7f28e1ffb640 1 -- 172.21.15.100:0/239186213 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f29ec04ede0 con 0x560376c78f70 2024-09-18T01:27:15.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.015+0000 7f29f3fff640 1 --2- 172.21.15.100:0/239186213 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28d4036b90 0x7f28d4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.015+0000 7f2a00724800 1 Processor -- start 2024-09-18T01:27:15.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.015+0000 7f2a00724800 1 -- start start 2024-09-18T01:27:15.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.015+0000 7f29f3fff640 1 --2- 172.21.15.100:0/239186213 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28d4036b90 0x7f28d4039050 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x560376c5f420 tx=0x7f29e4005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.015+0000 7f2a00724800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c85b00 0x560376c85f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.015+0000 7f2a00724800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560376c53c30 con 0x560376c85b00 2024-09-18T01:27:15.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.015+0000 7f29fc4d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c85b00 0x560376c85f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.015+0000 7f29fc4d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c85b00 0x560376c85f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45604/0 (socket says 172.21.15.100:45604) 2024-09-18T01:27:15.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.015+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1536751448 learned_addr learned my addr 172.21.15.100:0/1536751448 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.015+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1536751448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560376c864d0 con 0x560376c85b00 2024-09-18T01:27:15.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.016+0000 7f29fc4d9640 1 --2- 172.21.15.100:0/1536751448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c85b00 0x560376c85f00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f29ec001540 tx=0x7f29ec00fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb5304bba183ea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.016+0000 7f28db7fe640 1 -- 172.21.15.100:0/1536751448 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ec05c020 con 0x560376c85b00 2024-09-18T01:27:15.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.016+0000 7f28db7fe640 1 -- 172.21.15.100:0/1536751448 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ec0441b0 con 0x560376c85b00 2024-09-18T01:27:15.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.016+0000 7f28db7fe640 1 -- 172.21.15.100:0/1536751448 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ec04a6a0 con 0x560376c85b00 2024-09-18T01:27:15.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.016+0000 7f2a00724800 1 -- 172.21.15.100:0/1536751448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c85b00 msgr2=0x560376c85f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.016+0000 7f2a00724800 1 --2- 172.21.15.100:0/1536751448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c85b00 0x560376c85f00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f29ec001540 tx=0x7f29ec00fa20 comp rx=0 tx=0).stop 2024-09-18T01:27:15.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.016+0000 7f2a00724800 1 -- 172.21.15.100:0/1536751448 shutdown_connections 2024-09-18T01:27:15.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.016+0000 7f2a00724800 1 --2- 172.21.15.100:0/1536751448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c85b00 0x560376c85f00 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.016+0000 7f2a00724800 1 -- 172.21.15.100:0/1536751448 >> 172.21.15.100:0/1536751448 conn(0x560376c81eb0 msgr2=0x560376c7ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.016+0000 7f2a00724800 1 -- 172.21.15.100:0/1536751448 shutdown_connections 2024-09-18T01:27:15.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.016+0000 7f2a00724800 1 -- 172.21.15.100:0/1536751448 wait complete. 2024-09-18T01:27:15.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.016+0000 7f2a00724800 1 Processor -- start 2024-09-18T01:27:15.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.017+0000 7f2a00724800 1 -- start start 2024-09-18T01:27:15.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.017+0000 7f2a00724800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c85b00 0x560376c8cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.017+0000 7f2a00724800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560376c86960 con 0x560376c85b00 2024-09-18T01:27:15.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.017+0000 7f29fc4d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c85b00 0x560376c8cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.017+0000 7f29fc4d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c85b00 0x560376c8cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45614/0 (socket says 172.21.15.100:45614) 2024-09-18T01:27:15.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.017+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 learned_addr learned my addr 172.21.15.100:0/1573907709 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.017+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560376c8d310 con 0x560376c85b00 2024-09-18T01:27:15.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.017+0000 7f29fc4d9640 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c85b00 0x560376c8cdd0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f29ec001540 tx=0x7f29ec031ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.017+0000 7f28d9ffb640 1 -- 172.21.15.100:0/1573907709 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ec030810 con 0x560376c85b00 2024-09-18T01:27:15.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.017+0000 7f28d9ffb640 1 -- 172.21.15.100:0/1573907709 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ec0309b0 con 0x560376c85b00 2024-09-18T01:27:15.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.017+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560376c8d310 con 0x560376c85b00 2024-09-18T01:27:15.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.017+0000 7f28d9ffb640 1 -- 172.21.15.100:0/1573907709 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ec030c90 con 0x560376c85b00 2024-09-18T01:27:15.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.018+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560376c8d310 con 0x560376c85b00 2024-09-18T01:27:15.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.018+0000 7f28d9ffb640 1 -- 172.21.15.100:0/1573907709 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f29ec073060 con 0x560376c85b00 2024-09-18T01:27:15.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.018+0000 7f28d9ffb640 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28cc036b90 0x7f28cc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.018+0000 7f28d9ffb640 1 -- 172.21.15.100:0/1573907709 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f29ec076d10 con 0x560376c85b00 2024-09-18T01:27:15.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.018+0000 7f29f3fff640 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28cc036b90 0x7f28cc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.019+0000 7f29f3fff640 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28cc036b90 0x7f28cc039050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x560376c6b5c0 tx=0x7f29e4053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.019+0000 7f2a00724800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.019+0000 7f2a00724800 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560376c98550 0x560376c9aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.019+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376c9b160 con 0x560376c98550 2024-09-18T01:27:15.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.019+0000 7f29fccda640 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560376c98550 0x560376c9aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f29fccda640 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560376c98550 0x560376c9aa10 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f2a00724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f2a00724800 20 realm 2024-09-18T01:27:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f2a00724800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376c9b570 con 0x560376c98550 2024-09-18T01:27:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f2a00724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f2a00724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f2a00724800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376c9be40 con 0x560376c98550 2024-09-18T01:27:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f2a00724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f2a00724800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c98550 2024-09-18T01:27:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f2a00724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.020+0000 7f2a00724800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.021+0000 7f2a00724800 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560376c9cf40 0x560376c9f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.021+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376c9f940 con 0x560376c9cf40 2024-09-18T01:27:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.021+0000 7f29fc4d9640 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560376c9cf40 0x560376c9f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.021+0000 7f29fc4d9640 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560376c9cf40 0x560376c9f330 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.021+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.021+0000 7f2a00724800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.021+0000 7f2a00724800 20 searching for the correct realm 2024-09-18T01:27:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.021+0000 7f2a00724800 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560376ca18f0 0x560376ca3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.021+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376ca4480 con 0x560376ca18f0 2024-09-18T01:27:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.021+0000 7f29f3fff640 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560376ca18f0 0x560376ca3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.021+0000 7f29f3fff640 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560376ca18f0 0x560376ca3db0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.022+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.022+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376ca4480 con 0x560376c9cf40 2024-09-18T01:27:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.022+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.022+0000 7f29fc4d9640 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f29ec061040 0x7f29ec0454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.022+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376ca4480 con 0x7f29ec061040 2024-09-18T01:27:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.022+0000 7f29fccda640 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f29ec061040 0x7f29ec0454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.023+0000 7f29fccda640 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f29ec061040 0x7f29ec0454a0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.023+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.023+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c98550 2024-09-18T01:27:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.023+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.023+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c98550 2024-09-18T01:27:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.023+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.023+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x7f29ec061040 2024-09-18T01:27:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.024+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.024+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x7f29ec061040 2024-09-18T01:27:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.024+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.024+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c9cf40 2024-09-18T01:27:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.024+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.024+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376ca18f0 2024-09-18T01:27:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.024+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.024+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c98550 2024-09-18T01:27:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.024+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.024+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c9cf40 2024-09-18T01:27:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.025+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.025+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c98550 2024-09-18T01:27:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.025+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.025+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c9cf40 2024-09-18T01:27:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.025+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.025+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376ca18f0 2024-09-18T01:27:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.025+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.025+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376ca18f0 2024-09-18T01:27:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.026+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.026+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x7f29ec061040 2024-09-18T01:27:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.026+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.026+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376ca18f0 2024-09-18T01:27:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.026+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.026+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376ca18f0 2024-09-18T01:27:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.026+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.026+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c98550 2024-09-18T01:27:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.027+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.027+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c98550 2024-09-18T01:27:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.027+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.027+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x7f29ec061040 2024-09-18T01:27:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.027+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.027+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376ca18f0 2024-09-18T01:27:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.027+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.027+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c9cf40 2024-09-18T01:27:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.028+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.028+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c98550 2024-09-18T01:27:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.028+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.028+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x7f29ec061040 2024-09-18T01:27:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.028+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.028+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376ca18f0 2024-09-18T01:27:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.028+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.028+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c9cf40 2024-09-18T01:27:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.028+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.028+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c9cf40 2024-09-18T01:27:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.029+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.029+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376ca18f0 2024-09-18T01:27:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.029+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.029+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x7f29ec061040 2024-09-18T01:27:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.029+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.029+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c98550 2024-09-18T01:27:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.029+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.029+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560376c9c1e0 con 0x560376c9cf40 2024-09-18T01:27:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376ca0200 con 0x560376c98550 2024-09-18T01:27:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376ca05f0 con 0x560376c98550 2024-09-18T01:27:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376ca05f0 con 0x7f29ec061040 2024-09-18T01:27:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 zone default found 2024-09-18T01:27:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 4 Realm: () 2024-09-18T01:27:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 zonegroup default 2024-09-18T01:27:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.030+0000 7f2a00724800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.031+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376ca4900 con 0x7f29ec061040 2024-09-18T01:27:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.031+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.031+0000 7f2a00724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.031+0000 7f2a00724800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.031+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376ca62e0 con 0x560376ca18f0 2024-09-18T01:27:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.031+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.031+0000 7f2a00724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.031+0000 7f2a00724800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.031+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376ca6680 con 0x560376ca18f0 2024-09-18T01:27:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.031+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.031+0000 7f2a00724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.031+0000 7f2a00724800 20 started sync module instance, tier type = 2024-09-18T01:27:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.031+0000 7f2a00724800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.031+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ca5780 con 0x560376c9cf40 2024-09-18T01:27:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.032+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.032+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94572877863792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ca53e0 con 0x560376c9cf40 2024-09-18T01:27:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.032+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ca7380 con 0x560376c98550 2024-09-18T01:27:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.033+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94572877863792] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.034+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.034+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94572877868032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ca75d0 con 0x560376c98550 2024-09-18T01:27:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.034+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ca80f0 con 0x560376ca18f0 2024-09-18T01:27:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.035+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94572877868032] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.035+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.035+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94572877872064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ca84e0 con 0x560376ca18f0 2024-09-18T01:27:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.035+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ca8f30 con 0x560376c9cf40 2024-09-18T01:27:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.036+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94572877872064] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.036+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.036+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94572877869088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ca97d0 con 0x560376c9cf40 2024-09-18T01:27:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.036+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376caa190 con 0x560376c98550 2024-09-18T01:27:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.037+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.037+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94572877869088] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.037+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94572877880544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376caa5b0 con 0x560376c98550 2024-09-18T01:27:15.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.037+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376caaf70 con 0x7f29ec061040 2024-09-18T01:27:15.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.038+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94572877880544] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.038+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.038+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94572877882080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376caaf70 con 0x7f29ec061040 2024-09-18T01:27:15.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.038+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cab930 con 0x7f29ec061040 2024-09-18T01:27:15.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.039+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94572877882080] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.039+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.039+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94572877884576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cab930 con 0x7f29ec061040 2024-09-18T01:27:15.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.039+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cac2f0 con 0x7f29ec061040 2024-09-18T01:27:15.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.040+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94572877884576] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.040+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.040+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94572877887072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cac2f0 con 0x7f29ec061040 2024-09-18T01:27:15.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.040+0000 7f2a00724800 20 add_watcher() i=0 2024-09-18T01:27:15.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.040+0000 7f2a00724800 20 add_watcher() i=1 2024-09-18T01:27:15.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.040+0000 7f2a00724800 20 add_watcher() i=2 2024-09-18T01:27:15.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.040+0000 7f2a00724800 20 add_watcher() i=3 2024-09-18T01:27:15.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.040+0000 7f2a00724800 20 add_watcher() i=4 2024-09-18T01:27:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.040+0000 7f2a00724800 20 add_watcher() i=5 2024-09-18T01:27:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.040+0000 7f2a00724800 20 add_watcher() i=6 2024-09-18T01:27:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.041+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94572877887072] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.042+0000 7f2a00724800 20 add_watcher() i=7 2024-09-18T01:27:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.042+0000 7f2a00724800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.042+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376caf600 con 0x560376c98550 2024-09-18T01:27:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.042+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.042+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94572877889456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cac880 con 0x560376c98550 2024-09-18T01:27:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.043+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94572877889456] v35'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.043+0000 7f28b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.043+0000 7f2a00724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.043+0000 7f2a00724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.043+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376caeec0 con 0x560376c98550 2024-09-18T01:27:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.044+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'60 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.044+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cb8740 con 0x7f29ec061040 2024-09-18T01:27:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.045+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.045+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cb8cb0 con 0x560376ca18f0 2024-09-18T01:27:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.046+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.046+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cb9160 con 0x560376c98550 2024-09-18T01:27:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.047+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'259 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.047+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cb9550 con 0x560376c9cf40 2024-09-18T01:27:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.048+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'87 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.048+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cb9550 con 0x560376ca18f0 2024-09-18T01:27:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.049+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'65 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.050+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cb9b60 con 0x560376c98550 2024-09-18T01:27:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.051+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.051+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba010 con 0x7f29ec061040 2024-09-18T01:27:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.051+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'60 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.052+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba010 con 0x560376c9cf40 2024-09-18T01:27:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.052+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.052+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba010 con 0x560376ca18f0 2024-09-18T01:27:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.054+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.054+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba580 con 0x560376c9cf40 2024-09-18T01:27:15.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.055+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'88 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.055+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba580 con 0x7f29ec061040 2024-09-18T01:27:15.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.056+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.056+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba580 con 0x560376c9cf40 2024-09-18T01:27:15.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.057+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.057+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba580 con 0x7f29ec061040 2024-09-18T01:27:15.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.058+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.058+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba580 con 0x560376c98550 2024-09-18T01:27:15.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.059+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'260 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.059+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba580 con 0x560376ca18f0 2024-09-18T01:27:15.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.060+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.060+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba810 con 0x560376c9cf40 2024-09-18T01:27:15.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.061+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'89 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.061+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba7b0 con 0x560376ca18f0 2024-09-18T01:27:15.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.062+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.062+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba7b0 con 0x560376c98550 2024-09-18T01:27:15.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.063+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.063+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba7b0 con 0x560376c98550 2024-09-18T01:27:15.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.064+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'261 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.064+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba7b0 con 0x560376ca18f0 2024-09-18T01:27:15.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.065+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.065+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba7b0 con 0x560376c9cf40 2024-09-18T01:27:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.066+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.066+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba720 con 0x560376ca18f0 2024-09-18T01:27:15.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.067+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.067+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba720 con 0x560376ca18f0 2024-09-18T01:27:15.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.068+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'48 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.068+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba720 con 0x560376ca18f0 2024-09-18T01:27:15.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.069+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.069+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba720 con 0x560376ca18f0 2024-09-18T01:27:15.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.070+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'66 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.070+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba720 con 0x7f29ec061040 2024-09-18T01:27:15.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.071+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.071+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba720 con 0x560376ca18f0 2024-09-18T01:27:15.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.072+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'44 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.072+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba720 con 0x7f29ec061040 2024-09-18T01:27:15.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.073+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'61 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.073+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba720 con 0x560376ca18f0 2024-09-18T01:27:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.074+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.074+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba720 con 0x7f29ec061040 2024-09-18T01:27:15.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.075+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.075+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cba720 con 0x560376c9cf40 2024-09-18T01:27:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.076+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.077+0000 7f28b17e2640 20 reqs_thread_entry: start 2024-09-18T01:27:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.077+0000 7f2a00724800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.077+0000 7f2a00724800 20 Filter name: none 2024-09-18T01:27:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.077+0000 7f2822ffd640 20 reqs_thread_entry: start 2024-09-18T01:27:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.077+0000 7f2a00724800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-18T01:27:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.077+0000 7f2a00724800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.077+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376ce5650 con 0x560376ca18f0 2024-09-18T01:27:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.077+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.078+0000 7f2a00724800 20 rados_obj.operate() r=0 bl.length=363 2024-09-18T01:27:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.078+0000 7f2a00724800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-18T01:27:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.078+0000 7f2a00724800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-18T01:27:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.078+0000 7f2a00724800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:27:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.078+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376ce7f30 con 0x560376ca18f0 2024-09-18T01:27:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.078+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f29e407c040 con 0x560376ca18f0 2024-09-18T01:27:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.078+0000 7f2a00724800 10 removing key index: true_admin_akey 2024-09-18T01:27:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.078+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ce5f10 con 0x560376ca18f0 2024-09-18T01:27:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.079+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 28 ==== osd_op_reply(96 true_admin_akey [delete] v35'6 uv6 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f29e4090040 con 0x560376ca18f0 2024-09-18T01:27:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.079+0000 7f2a00724800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-18T01:27:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.079+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94572878129696 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376ce84a0 con 0x7f29ec061040 2024-09-18T01:27:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.079+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== watch-notify(notify (1) cookie 94572877882080 notify 150323855391 ret 0) ==== 207+0+0 (crc 0 0 0) 0x560376cb9d30 con 0x7f29ec061040 2024-09-18T01:27:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.079+0000 7f28db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855391 cookie 94572877882080 notifier 4874 bl.length()=165 2024-09-18T01:27:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.079+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(97 notify.5 [notify cookie 94572878129696 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.079+0000 7f28db7fe640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f28c0003d60 con 0x7f29ec061040 2024-09-18T01:27:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.079+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.080+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== watch-notify(notify_complete (2) cookie 94572878129696 notify 150323855391 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560376caeb80 con 0x7f29ec061040 2024-09-18T01:27:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.080+0000 7f2a00724800 10 removing email index: 2024-09-18T01:27:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.080+0000 7f2a00724800 10 removing user buckets index 2024-09-18T01:27:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.080+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ce8400 con 0x560376ca18f0 2024-09-18T01:27:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.080+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 29 ==== osd_op_reply(99 a_user.buckets [delete] v35'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f29e4090040 con 0x560376ca18f0 2024-09-18T01:27:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.080+0000 7f2a00724800 10 removing user index: a_user 2024-09-18T01:27:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.080+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ce7a30 con 0x560376ca18f0 2024-09-18T01:27:15.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.081+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 30 ==== osd_op_reply(100 a_user [call,call,delete] v35'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f29e4090040 con 0x560376ca18f0 2024-09-18T01:27:15.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.081+0000 7f2a00724800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-18T01:27:15.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.081+0000 7f2a00724800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-18T01:27:15.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.081+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94572878135024 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560376ce6ed0 con 0x560376ca18f0 2024-09-18T01:27:15.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.082+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 31 ==== watch-notify(notify (1) cookie 94572877872064 notify 150323855370 ret 0) ==== 197+0+0 (crc 0 0 0) 0x560376cbab90 con 0x560376ca18f0 2024-09-18T01:27:15.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.082+0000 7f28db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855370 cookie 94572877872064 notifier 4874 bl.length()=155 2024-09-18T01:27:15.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.082+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 32 ==== osd_op_reply(101 notify.2 [notify cookie 94572878135024 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f29e4090040 con 0x560376ca18f0 2024-09-18T01:27:15.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.082+0000 7f28db7fe640 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f28c0003d60 con 0x560376ca18f0 2024-09-18T01:27:15.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.082+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 33 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29e4090040 con 0x560376ca18f0 2024-09-18T01:27:15.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.082+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 34 ==== watch-notify(notify_complete (2) cookie 94572878135024 notify 150323855370 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560376cb8cb0 con 0x560376ca18f0 2024-09-18T01:27:15.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.083+0000 7f28b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:15.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.083+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94572877889456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cb7960 con 0x560376c98550 2024-09-18T01:27:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.084+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94572877889456] v35'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.084+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94572877863792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cabfb0 con 0x560376c9cf40 2024-09-18T01:27:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.085+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94572877863792] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.085+0000 7f2a00724800 20 remove_watcher() i=0 2024-09-18T01:27:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.085+0000 7f2a00724800 2 removed watcher, disabling cache 2024-09-18T01:27:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.085+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94572877868032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cabfb0 con 0x560376c98550 2024-09-18T01:27:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.086+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94572877868032] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.086+0000 7f2a00724800 20 remove_watcher() i=1 2024-09-18T01:27:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.086+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94572877872064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ca6c00 con 0x560376ca18f0 2024-09-18T01:27:15.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.087+0000 7f29f3fff640 1 -- 172.21.15.100:0/1573907709 <== osd.3 v2:172.21.15.100:6816/595195757 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94572877872064] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29e4090040 con 0x560376ca18f0 2024-09-18T01:27:15.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.087+0000 7f2a00724800 20 remove_watcher() i=2 2024-09-18T01:27:15.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.087+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94572877869088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cabfb0 con 0x560376c9cf40 2024-09-18T01:27:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.088+0000 7f29fc4d9640 1 -- 172.21.15.100:0/1573907709 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94572877869088] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ec02d070 con 0x560376c9cf40 2024-09-18T01:27:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.088+0000 7f2a00724800 20 remove_watcher() i=3 2024-09-18T01:27:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.088+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94572877880544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ca7bc0 con 0x560376c98550 2024-09-18T01:27:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.089+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94572877880544] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x560376c98550 2024-09-18T01:27:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.089+0000 7f2a00724800 20 remove_watcher() i=4 2024-09-18T01:27:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.089+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94572877882080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376cabfb0 con 0x7f29ec061040 2024-09-18T01:27:15.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.090+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94572877882080] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.090+0000 7f2a00724800 20 remove_watcher() i=5 2024-09-18T01:27:15.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.090+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94572877884576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ca9ce0 con 0x7f29ec061040 2024-09-18T01:27:15.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.091+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94572877884576] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.091+0000 7f2a00724800 20 remove_watcher() i=6 2024-09-18T01:27:15.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.091+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94572877887072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560376ca7bc0 con 0x7f29ec061040 2024-09-18T01:27:15.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 <== osd.0 v2:172.21.15.92:6800/2777570747 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94572877887072] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f400a4a0 con 0x7f29ec061040 2024-09-18T01:27:15.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 20 remove_watcher() i=7 2024-09-18T01:27:15.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f29ec061040 msgr2=0x7f29ec0454a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f29ec061040 0x7f29ec0454a0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560376c98550 msgr2=0x560376c9aa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560376c98550 0x560376c9aa10 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560376c9cf40 msgr2=0x560376c9f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560376c9cf40 0x560376c9f330 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560376ca18f0 msgr2=0x560376ca3db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560376ca18f0 0x560376ca3db0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28cc036b90 msgr2=0x7f28cc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28cc036b90 0x7f28cc039050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x560376c6b5c0 tx=0x7f29e4053000 comp rx=0 tx=0).stop 2024-09-18T01:27:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c85b00 msgr2=0x560376c8cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 --2- 172.21.15.100:0/1573907709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c85b00 0x560376c8cdd0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f29ec001540 tx=0x7f29ec031ed0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 reap_dead start 2024-09-18T01:27:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f29fccda640 1 -- 172.21.15.100:0/1573907709 reap_dead start 2024-09-18T01:27:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 shutdown_connections 2024-09-18T01:27:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 >> 172.21.15.100:0/1573907709 conn(0x560376c81eb0 msgr2=0x560376c7ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.092+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 shutdown_connections 2024-09-18T01:27:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/1573907709 wait complete. 2024-09-18T01:27:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/239186213 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28d4036b90 msgr2=0x7f28d4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 --2- 172.21.15.100:0/239186213 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28d4036b90 0x7f28d4039050 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x560376c5f420 tx=0x7f29e4005a00 comp rx=0 tx=0).stop 2024-09-18T01:27:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/239186213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c78f70 msgr2=0x560376c79390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 --2- 172.21.15.100:0/239186213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c78f70 0x560376c79390 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f29ec04b770 tx=0x7f29ec01aee0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/239186213 shutdown_connections 2024-09-18T01:27:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 --2- 172.21.15.100:0/239186213 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28d4036b90 0x7f28d4039050 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 --2- 172.21.15.100:0/239186213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376c78f70 0x560376c79390 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/239186213 >> 172.21.15.100:0/239186213 conn(0x560376c6df00 msgr2=0x560376c70a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/239186213 shutdown_connections 2024-09-18T01:27:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/239186213 wait complete. 2024-09-18T01:27:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560376c686d0 msgr2=0x560376c6aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560376c686d0 0x560376c6aac0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560376b69970 msgr2=0x560376c61f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560376b69970 0x560376c61f30 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560376c647e0 msgr2=0x560376c66bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560376c647e0 0x560376c66bd0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28e4036b90 msgr2=0x7f28e4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28e4036b90 0x7f28e4039050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f29e4057000 tx=0x7f29e4052000 comp rx=0 tx=0).stop 2024-09-18T01:27:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b65ba0 msgr2=0x560376c5aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 --2- 172.21.15.100:0/1637173498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560376b65ba0 0x560376c5aec0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x560376c542e0 tx=0x7f29ec000ed0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f29fccda640 1 -- 172.21.15.100:0/1637173498 reap_dead start 2024-09-18T01:27:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 shutdown_connections 2024-09-18T01:27:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 >> 172.21.15.100:0/1637173498 conn(0x560376b605c0 msgr2=0x560376c4d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 shutdown_connections 2024-09-18T01:27:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.093+0000 7f2a00724800 1 -- 172.21.15.100:0/1637173498 wait complete. 2024-09-18T01:27:15.102 ERROR:root:None 2024-09-18T01:27:15.103 ERROR:root:0 2024-09-18T01:27:15.103 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-18T01:27:15.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-18T01:27:15.103 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-18T01:27:15.149 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:15.149 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:15.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.149+0000 7ff6be124800 1 Processor -- start 2024-09-18T01:27:15.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.149+0000 7ff6be124800 1 -- start start 2024-09-18T01:27:15.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.149+0000 7ff6be124800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x559046abc920 0x559046abed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.149+0000 7ff6be124800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559046978b30 con 0x559046ab84e0 2024-09-18T01:27:15.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.149+0000 7ff6be124800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55904695a360 con 0x559046abc920 2024-09-18T01:27:15.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.149+0000 7ff6b3fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x559046abc920 0x559046abed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.149+0000 7ff6b9eac640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x559046ab84e0 0x559046ab88e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37224/0 (socket says 172.21.15.100:37224) 2024-09-18T01:27:15.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.149+0000 7ff6b9eac640 1 -- 172.21.15.100:0/1910852333 learned_addr learned my addr 172.21.15.100:0/1910852333 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:15.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.149+0000 7ff6b96ab640 1 -- 172.21.15.100:0/1910852333 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034069226 0 0) 0x559046978b30 con 0x559046ab84e0 2024-09-18T01:27:15.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.150+0000 7ff6b96ab640 1 -- 172.21.15.100:0/1910852333 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6a8001e10 con 0x559046ab84e0 2024-09-18T01:27:15.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.150+0000 7ff6b3fff640 1 -- 172.21.15.100:0/1910852333 >> v1:172.21.15.92:6789/0 conn(0x559046ab84e0 legacy=0x559046ab88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.150+0000 7ff6b3fff640 1 -- 172.21.15.100:0/1910852333 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559046980e00 con 0x559046abc920 2024-09-18T01:27:15.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.151+0000 7ff6b3fff640 1 --2- 172.21.15.100:0/1910852333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046abc920 0x559046abed10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400a470 tx=0x7ff6a4045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a964588d505f3ff server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.152+0000 7ff6b96ab640 1 -- 172.21.15.100:0/1910852333 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a4059070 con 0x559046abc920 2024-09-18T01:27:15.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.152+0000 7ff6b96ab640 1 -- 172.21.15.100:0/1910852333 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a4054570 con 0x559046abc920 2024-09-18T01:27:15.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.152+0000 7ff6b96ab640 1 -- 172.21.15.100:0/1910852333 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a4054870 con 0x559046abc920 2024-09-18T01:27:15.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.152+0000 7ff6be124800 1 -- 172.21.15.100:0/1910852333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046abc920 msgr2=0x559046abed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.152+0000 7ff6be124800 1 --2- 172.21.15.100:0/1910852333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046abc920 0x559046abed10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400a470 tx=0x7ff6a4045920 comp rx=0 tx=0).stop 2024-09-18T01:27:15.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.152+0000 7ff6be124800 1 -- 172.21.15.100:0/1910852333 shutdown_connections 2024-09-18T01:27:15.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.152+0000 7ff6be124800 1 --2- 172.21.15.100:0/1910852333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046abc920 0x559046abed10 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.152+0000 7ff6be124800 1 -- 172.21.15.100:0/1910852333 >> 172.21.15.100:0/1910852333 conn(0x559046ab3dd0 msgr2=0x559046ab61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.152+0000 7ff6be124800 1 -- 172.21.15.100:0/1910852333 shutdown_connections 2024-09-18T01:27:15.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.152+0000 7ff6be124800 1 -- 172.21.15.100:0/1910852333 wait complete. 2024-09-18T01:27:15.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.166+0000 7ff6be124800 1 Processor -- start 2024-09-18T01:27:15.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.166+0000 7ff6be124800 1 -- start start 2024-09-18T01:27:15.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.166+0000 7ff6be124800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046ab84e0 0x559046baa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.166+0000 7ff6be124800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559046a05360 con 0x559046ab84e0 2024-09-18T01:27:15.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.166+0000 7ff6b9eac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046ab84e0 0x559046baa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.166+0000 7ff6b9eac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046ab84e0 0x559046baa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45620/0 (socket says 172.21.15.100:45620) 2024-09-18T01:27:15.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.166+0000 7ff6b9eac640 1 -- 172.21.15.100:0/450894248 learned_addr learned my addr 172.21.15.100:0/450894248 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.166+0000 7ff6b9eac640 1 -- 172.21.15.100:0/450894248 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559046952bc0 con 0x559046ab84e0 2024-09-18T01:27:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.167+0000 7ff6b9eac640 1 --2- 172.21.15.100:0/450894248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046ab84e0 0x559046baa900 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac001db0 tx=0x7ff6ac00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6954e7d7652fff15 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.167+0000 7ff5a7e07640 1 -- 172.21.15.100:0/450894248 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6ac012020 con 0x559046ab84e0 2024-09-18T01:27:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.167+0000 7ff5a7e07640 1 -- 172.21.15.100:0/450894248 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ac00e5a0 con 0x559046ab84e0 2024-09-18T01:27:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.167+0000 7ff5a7e07640 1 -- 172.21.15.100:0/450894248 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6ac00e940 con 0x559046ab84e0 2024-09-18T01:27:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.167+0000 7ff6be124800 1 -- 172.21.15.100:0/450894248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046ab84e0 msgr2=0x559046baa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.167+0000 7ff6be124800 1 --2- 172.21.15.100:0/450894248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046ab84e0 0x559046baa900 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac001db0 tx=0x7ff6ac00b6c0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.168+0000 7ff6be124800 1 -- 172.21.15.100:0/450894248 shutdown_connections 2024-09-18T01:27:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.168+0000 7ff6be124800 1 --2- 172.21.15.100:0/450894248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046ab84e0 0x559046baa900 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.168+0000 7ff6be124800 1 -- 172.21.15.100:0/450894248 >> 172.21.15.100:0/450894248 conn(0x559046ab3dd0 msgr2=0x559046ba1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.168+0000 7ff6be124800 1 -- 172.21.15.100:0/450894248 shutdown_connections 2024-09-18T01:27:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.168+0000 7ff6be124800 1 -- 172.21.15.100:0/450894248 wait complete. 2024-09-18T01:27:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.168+0000 7ff6be124800 1 Processor -- start 2024-09-18T01:27:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.168+0000 7ff6be124800 1 -- start start 2024-09-18T01:27:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.168+0000 7ff6be124800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046ab84e0 0x559046bb2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.168+0000 7ff6be124800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559046abf550 con 0x559046ab84e0 2024-09-18T01:27:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.168+0000 7ff6b9eac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046ab84e0 0x559046bb2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.168+0000 7ff6b9eac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046ab84e0 0x559046bb2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45630/0 (socket says 172.21.15.100:45630) 2024-09-18T01:27:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.168+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3678764117 learned_addr learned my addr 172.21.15.100:0/3678764117 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.168+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3678764117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559046966fe0 con 0x559046ab84e0 2024-09-18T01:27:15.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.169+0000 7ff6b9eac640 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046ab84e0 0x559046bb2340 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00c010 tx=0x7ff6ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.169+0000 7ff5a6604640 1 -- 172.21.15.100:0/3678764117 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6ac012030 con 0x559046ab84e0 2024-09-18T01:27:15.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.169+0000 7ff5a6604640 1 -- 172.21.15.100:0/3678764117 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ac01a750 con 0x559046ab84e0 2024-09-18T01:27:15.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.169+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559046bb2880 con 0x559046ab84e0 2024-09-18T01:27:15.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.169+0000 7ff5a6604640 1 -- 172.21.15.100:0/3678764117 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6ac01aa30 con 0x559046ab84e0 2024-09-18T01:27:15.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.169+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559046bb2da0 con 0x559046ab84e0 2024-09-18T01:27:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.170+0000 7ff5a6604640 1 -- 172.21.15.100:0/3678764117 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff6ac015020 con 0x559046ab84e0 2024-09-18T01:27:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.170+0000 7ff5a6604640 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff5a0036b40 0x7ff5a0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.170+0000 7ff5a6604640 1 -- 172.21.15.100:0/3678764117 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff6ac020030 con 0x559046ab84e0 2024-09-18T01:27:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.170+0000 7ff6b3fff640 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff5a0036b40 0x7ff5a0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.170+0000 7ff6be124800 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559046abc920 0x559046bb93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.170+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bb98f0 con 0x559046abc920 2024-09-18T01:27:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.170+0000 7ff6ba6ad640 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559046abc920 0x559046bb93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.170+0000 7ff6b3fff640 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff5a0036b40 0x7ff5a0039000 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x559046ab92e0 tx=0x7ff6a4050000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.170+0000 7ff6ba6ad640 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559046abc920 0x559046bb93b0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.171+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3678764117 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046abc920 2024-09-18T01:27:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.171+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bb6980 con 0x559046abc920 2024-09-18T01:27:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.171+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3678764117 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046abc920 2024-09-18T01:27:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.171+0000 7ff6be124800 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559046bbbc00 0x559046bbdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.171+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bbe6e0 con 0x559046bbbc00 2024-09-18T01:27:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.171+0000 7ff6b9eac640 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559046bbbc00 0x559046bbdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.172+0000 7ff6b9eac640 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559046bbbc00 0x559046bbdff0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.172+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3678764117 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff6ac018950 con 0x559046bbbc00 2024-09-18T01:27:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.172+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bbaaa0 con 0x559046abc920 2024-09-18T01:27:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.172+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3678764117 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046abc920 2024-09-18T01:27:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.172+0000 7ff6be124800 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559046bbfb40 0x559046bc1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.172+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bc2630 con 0x559046bbfb40 2024-09-18T01:27:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.172+0000 7ff6b3fff640 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559046bbfb40 0x559046bc1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.173+0000 7ff6b3fff640 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559046bbfb40 0x559046bc1f30 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.173+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3678764117 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff6a405c040 con 0x559046bbfb40 2024-09-18T01:27:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.173+0000 7ff6be124800 1 Processor -- start 2024-09-18T01:27:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.174+0000 7ff6be124800 1 -- start start 2024-09-18T01:27:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.174+0000 7ff6be124800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bd03e0 0x559046bd0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.174+0000 7ff6be124800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559046954580 con 0x559046bd03e0 2024-09-18T01:27:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.174+0000 7ff6b9eac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bd03e0 0x559046bd0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.174+0000 7ff6b9eac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bd03e0 0x559046bd0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45636/0 (socket says 172.21.15.100:45636) 2024-09-18T01:27:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.174+0000 7ff6b9eac640 1 -- 172.21.15.100:0/388334347 learned_addr learned my addr 172.21.15.100:0/388334347 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.174+0000 7ff6b9eac640 1 -- 172.21.15.100:0/388334347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559046bd0d40 con 0x559046bd03e0 2024-09-18T01:27:15.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.174+0000 7ff6b9eac640 1 --2- 172.21.15.100:0/388334347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bd03e0 0x559046bd0800 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac04ae30 tx=0x7ff6ac0444a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.174+0000 7ff59f7fe640 1 -- 172.21.15.100:0/388334347 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6ac03b070 con 0x559046bd03e0 2024-09-18T01:27:15.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.174+0000 7ff59f7fe640 1 -- 172.21.15.100:0/388334347 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ac024420 con 0x559046bd03e0 2024-09-18T01:27:15.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.174+0000 7ff6be124800 1 -- 172.21.15.100:0/388334347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559046bd0fd0 con 0x559046bd03e0 2024-09-18T01:27:15.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.174+0000 7ff59f7fe640 1 -- 172.21.15.100:0/388334347 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6ac024700 con 0x559046bd03e0 2024-09-18T01:27:15.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.175+0000 7ff6be124800 1 -- 172.21.15.100:0/388334347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559046bd3cb0 con 0x559046bd03e0 2024-09-18T01:27:15.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.175+0000 7ff59f7fe640 1 -- 172.21.15.100:0/388334347 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff6ac03e070 con 0x559046bd03e0 2024-09-18T01:27:15.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.175+0000 7ff59f7fe640 1 --2- 172.21.15.100:0/388334347 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff594036b40 0x7ff594039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.175+0000 7ff59f7fe640 1 -- 172.21.15.100:0/388334347 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff6ac038080 con 0x559046bd03e0 2024-09-18T01:27:15.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.175+0000 7ff6b3fff640 1 --2- 172.21.15.100:0/388334347 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff594036b40 0x7ff594039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.176+0000 7ff6be124800 1 Processor -- start 2024-09-18T01:27:15.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.176+0000 7ff6be124800 1 -- start start 2024-09-18T01:27:15.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.176+0000 7ff6b3fff640 1 --2- 172.21.15.100:0/388334347 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff594036b40 0x7ff594039000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x559046bba1b0 tx=0x7ff6a4005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.176+0000 7ff6be124800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bdcee0 0x559046bdd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.176+0000 7ff6be124800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559046bab0b0 con 0x559046bdcee0 2024-09-18T01:27:15.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.176+0000 7ff6b9eac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bdcee0 0x559046bdd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.176+0000 7ff6b9eac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bdcee0 0x559046bdd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45650/0 (socket says 172.21.15.100:45650) 2024-09-18T01:27:15.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.176+0000 7ff6b9eac640 1 -- 172.21.15.100:0/2248083133 learned_addr learned my addr 172.21.15.100:0/2248083133 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.176+0000 7ff6b9eac640 1 -- 172.21.15.100:0/2248083133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559046bdd8b0 con 0x559046bdcee0 2024-09-18T01:27:15.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.176+0000 7ff6b9eac640 1 --2- 172.21.15.100:0/2248083133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bdcee0 0x559046bdd2e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac01a6a0 tx=0x7ff6ac0474a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d616d47191b107 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.177+0000 7ff59d7fa640 1 -- 172.21.15.100:0/2248083133 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6ac047a70 con 0x559046bdcee0 2024-09-18T01:27:15.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.177+0000 7ff59d7fa640 1 -- 172.21.15.100:0/2248083133 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ac00fd10 con 0x559046bdcee0 2024-09-18T01:27:15.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.177+0000 7ff59d7fa640 1 -- 172.21.15.100:0/2248083133 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6ac0168f0 con 0x559046bdcee0 2024-09-18T01:27:15.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.177+0000 7ff6be124800 1 -- 172.21.15.100:0/2248083133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bdcee0 msgr2=0x559046bdd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.177+0000 7ff6be124800 1 --2- 172.21.15.100:0/2248083133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bdcee0 0x559046bdd2e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac01a6a0 tx=0x7ff6ac0474a0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.177+0000 7ff6be124800 1 -- 172.21.15.100:0/2248083133 shutdown_connections 2024-09-18T01:27:15.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.177+0000 7ff6be124800 1 --2- 172.21.15.100:0/2248083133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bdcee0 0x559046bdd2e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.177+0000 7ff6be124800 1 -- 172.21.15.100:0/2248083133 >> 172.21.15.100:0/2248083133 conn(0x559046bd9240 msgr2=0x559046bd7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.177+0000 7ff6be124800 1 -- 172.21.15.100:0/2248083133 shutdown_connections 2024-09-18T01:27:15.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.177+0000 7ff6be124800 1 -- 172.21.15.100:0/2248083133 wait complete. 2024-09-18T01:27:15.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.177+0000 7ff6be124800 1 Processor -- start 2024-09-18T01:27:15.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.177+0000 7ff6be124800 1 -- start start 2024-09-18T01:27:15.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.178+0000 7ff6be124800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bdcee0 0x559046be4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.178+0000 7ff6be124800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559046bdde30 con 0x559046bdcee0 2024-09-18T01:27:15.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.178+0000 7ff6b9eac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bdcee0 0x559046be4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.178+0000 7ff6b9eac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bdcee0 0x559046be4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45660/0 (socket says 172.21.15.100:45660) 2024-09-18T01:27:15.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.178+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 learned_addr learned my addr 172.21.15.100:0/3120745206 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.178+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559046be46b0 con 0x559046bdcee0 2024-09-18T01:27:15.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.178+0000 7ff6b9eac640 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bdcee0 0x559046be4170 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac01a6a0 tx=0x7ff6ac032f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.178+0000 7ff58b7fe640 1 -- 172.21.15.100:0/3120745206 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6ac066070 con 0x559046bdcee0 2024-09-18T01:27:15.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.178+0000 7ff58b7fe640 1 -- 172.21.15.100:0/3120745206 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ac047e90 con 0x559046bdcee0 2024-09-18T01:27:15.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.178+0000 7ff58b7fe640 1 -- 172.21.15.100:0/3120745206 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6ac04fa50 con 0x559046bdcee0 2024-09-18T01:27:15.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.178+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559046be46b0 con 0x559046bdcee0 2024-09-18T01:27:15.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.178+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559046be46b0 con 0x559046bdcee0 2024-09-18T01:27:15.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.179+0000 7ff58b7fe640 1 -- 172.21.15.100:0/3120745206 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff6ac073060 con 0x559046bdcee0 2024-09-18T01:27:15.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.179+0000 7ff58b7fe640 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff584036b40 0x7ff584039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.179+0000 7ff58b7fe640 1 -- 172.21.15.100:0/3120745206 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff6ac06dd50 con 0x559046bdcee0 2024-09-18T01:27:15.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.179+0000 7ff6b3fff640 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff584036b40 0x7ff584039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.180+0000 7ff6b3fff640 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff584036b40 0x7ff584039000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400a470 tx=0x7ff6a4062040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.180+0000 7ff6be124800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.180+0000 7ff6be124800 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559046bef8d0 0x559046bf1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.180+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bf24e0 con 0x559046bef8d0 2024-09-18T01:27:15.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.180+0000 7ff6ba6ad640 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559046bef8d0 0x559046bf1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.180+0000 7ff6ba6ad640 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559046bef8d0 0x559046bf1d90 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.180+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.180+0000 7ff6be124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.180+0000 7ff6be124800 20 realm 2024-09-18T01:27:15.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.180+0000 7ff6be124800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.180+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bf28f0 con 0x559046bef8d0 2024-09-18T01:27:15.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6be124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6be124800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:15.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6be124800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bf31c0 con 0x559046bef8d0 2024-09-18T01:27:15.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6be124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6be124800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bef8d0 2024-09-18T01:27:15.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6be124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:15.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6be124800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6be124800 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559046bf42c0 0x559046bf66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bf6cc0 con 0x559046bf42c0 2024-09-18T01:27:15.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6b9eac640 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559046bf42c0 0x559046bf66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.181+0000 7ff6b9eac640 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559046bf42c0 0x559046bf66b0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.182+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.182+0000 7ff6be124800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:15.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.182+0000 7ff6be124800 20 searching for the correct realm 2024-09-18T01:27:15.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.182+0000 7ff6be124800 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559046bf8c70 0x559046bfb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.182+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bfb800 con 0x559046bf8c70 2024-09-18T01:27:15.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.182+0000 7ff6b3fff640 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559046bf8c70 0x559046bfb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.182+0000 7ff6b3fff640 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559046bf8c70 0x559046bfb130 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.182+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a4072030 con 0x559046bf8c70 2024-09-18T01:27:15.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.182+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bfb800 con 0x559046bf42c0 2024-09-18T01:27:15.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.183+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.183+0000 7ff6b9eac640 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff6ac017050 0x7ff6ac015770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.183+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bfb800 con 0x7ff6ac017050 2024-09-18T01:27:15.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.183+0000 7ff6ba6ad640 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff6ac017050 0x7ff6ac015770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.183+0000 7ff6ba6ad640 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff6ac017050 0x7ff6ac015770 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.183+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.183+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bef8d0 2024-09-18T01:27:15.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.184+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.184+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bef8d0 2024-09-18T01:27:15.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.184+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.184+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x7ff6ac017050 2024-09-18T01:27:15.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.184+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.184+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x7ff6ac017050 2024-09-18T01:27:15.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.184+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.184+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf42c0 2024-09-18T01:27:15.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.185+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.185+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf8c70 2024-09-18T01:27:15.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.185+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a4072030 con 0x559046bf8c70 2024-09-18T01:27:15.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.185+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bef8d0 2024-09-18T01:27:15.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.185+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.185+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf42c0 2024-09-18T01:27:15.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.185+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.185+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bef8d0 2024-09-18T01:27:15.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.186+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.186+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf42c0 2024-09-18T01:27:15.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.186+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.186+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf8c70 2024-09-18T01:27:15.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.186+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a4072030 con 0x559046bf8c70 2024-09-18T01:27:15.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.186+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf8c70 2024-09-18T01:27:15.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.186+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a4072030 con 0x559046bf8c70 2024-09-18T01:27:15.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.186+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x7ff6ac017050 2024-09-18T01:27:15.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.187+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.187+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf8c70 2024-09-18T01:27:15.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.187+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a4072030 con 0x559046bf8c70 2024-09-18T01:27:15.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.187+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf8c70 2024-09-18T01:27:15.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.187+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a4072030 con 0x559046bf8c70 2024-09-18T01:27:15.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.187+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bef8d0 2024-09-18T01:27:15.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.187+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.187+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bef8d0 2024-09-18T01:27:15.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.188+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.188+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x7ff6ac017050 2024-09-18T01:27:15.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.188+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.188+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf8c70 2024-09-18T01:27:15.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.188+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a4072030 con 0x559046bf8c70 2024-09-18T01:27:15.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.188+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf42c0 2024-09-18T01:27:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.188+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.188+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bef8d0 2024-09-18T01:27:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.189+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.189+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x7ff6ac017050 2024-09-18T01:27:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.189+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.189+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf8c70 2024-09-18T01:27:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.189+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a4072030 con 0x559046bf8c70 2024-09-18T01:27:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.189+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf42c0 2024-09-18T01:27:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.189+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.189+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf42c0 2024-09-18T01:27:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.190+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.190+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf8c70 2024-09-18T01:27:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.190+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a4072030 con 0x559046bf8c70 2024-09-18T01:27:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.190+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x7ff6ac017050 2024-09-18T01:27:15.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.190+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.190+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bef8d0 2024-09-18T01:27:15.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.190+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.190+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559046bf3560 con 0x559046bf42c0 2024-09-18T01:27:15.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:15.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:15.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:15.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:15.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:15.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:15.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bf7580 con 0x559046bef8d0 2024-09-18T01:27:15.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bf7970 con 0x559046bef8d0 2024-09-18T01:27:15.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:15.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bf7970 con 0x7ff6ac017050 2024-09-18T01:27:15.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:15.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 zone default found 2024-09-18T01:27:15.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 4 Realm: () 2024-09-18T01:27:15.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:15.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:15.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:15.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 zonegroup default 2024-09-18T01:27:15.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.191+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bf71b0 con 0x7ff6ac017050 2024-09-18T01:27:15.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.192+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.192+0000 7ff6be124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.192+0000 7ff6be124800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.192+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bf71b0 con 0x559046bf8c70 2024-09-18T01:27:15.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.192+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff6a4072030 con 0x559046bf8c70 2024-09-18T01:27:15.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.192+0000 7ff6be124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.192+0000 7ff6be124800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.192+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046bfd6e0 con 0x559046bf8c70 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.192+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff6a4072030 con 0x559046bf8c70 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.192+0000 7ff6be124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.192+0000 7ff6be124800 20 started sync module instance, tier type = 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.192+0000 7ff6be124800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.192+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046bfcb00 con 0x559046bf42c0 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.193+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.193+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94078150627056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046bfdff0 con 0x559046bf42c0 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.193+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046bfe840 con 0x559046bef8d0 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.194+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94078150627056] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.195+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.195+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94078150630208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046bfe8a0 con 0x559046bef8d0 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.195+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046bff3b0 con 0x559046bf8c70 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.196+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94078150630208] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.196+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a4072030 con 0x559046bf8c70 2024-09-18T01:27:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.196+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94078150635104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046bff7a0 con 0x559046bf8c70 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.196+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c001c0 con 0x559046bf42c0 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.197+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94078150635104] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a4072030 con 0x559046bf8c70 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.197+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.197+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94078150632336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c00a90 con 0x559046bf42c0 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.197+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c01450 con 0x559046bef8d0 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.198+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94078150632336] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.198+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.198+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94078150641600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c01450 con 0x559046bef8d0 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.198+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c01e10 con 0x7ff6ac017050 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.199+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94078150641600] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.199+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.199+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94078150644096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c01e10 con 0x7ff6ac017050 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.199+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c027d0 con 0x7ff6ac017050 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.200+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94078150644096] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.200+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.200+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94078150646112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c029b0 con 0x7ff6ac017050 2024-09-18T01:27:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.200+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c03200 con 0x7ff6ac017050 2024-09-18T01:27:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.201+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94078150646112] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.201+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.201+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94078150649568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c030b0 con 0x7ff6ac017050 2024-09-18T01:27:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.201+0000 7ff6be124800 20 add_watcher() i=0 2024-09-18T01:27:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.201+0000 7ff6be124800 20 add_watcher() i=1 2024-09-18T01:27:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.201+0000 7ff6be124800 20 add_watcher() i=2 2024-09-18T01:27:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.201+0000 7ff6be124800 20 add_watcher() i=3 2024-09-18T01:27:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.201+0000 7ff6be124800 20 add_watcher() i=4 2024-09-18T01:27:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.201+0000 7ff6be124800 20 add_watcher() i=5 2024-09-18T01:27:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.201+0000 7ff6be124800 20 add_watcher() i=6 2024-09-18T01:27:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.202+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94078150649568] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.202+0000 7ff6be124800 20 add_watcher() i=7 2024-09-18T01:27:15.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.202+0000 7ff6be124800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:15.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.202+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046c06620 con 0x559046bef8d0 2024-09-18T01:27:15.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.203+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.203+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94078150650688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c03b10 con 0x559046bef8d0 2024-09-18T01:27:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.204+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94078150650688] v35'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.204+0000 7ff56b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.204+0000 7ff6be124800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.204+0000 7ff6be124800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.204+0000 7ff6be124800 5 note: GC not initialized 2024-09-18T01:27:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.204+0000 7ff56a7fc640 20 reqs_thread_entry: start 2024-09-18T01:27:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.204+0000 7ff6be124800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.204+0000 7ff6be124800 20 Filter name: none 2024-09-18T01:27:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.205+0000 7ff4dbfff640 20 reqs_thread_entry: start 2024-09-18T01:27:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.205+0000 7ff6be124800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:27:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.205+0000 7ff6be124800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.205+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046c39ab0 con 0x7ff6ac017050 2024-09-18T01:27:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.205+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.205+0000 7ff6be124800 20 rados_obj.operate() r=0 bl.length=460 2024-09-18T01:27:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.205+0000 7ff6be124800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:27:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.205+0000 7ff6be124800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.205+0000 7ff6be124800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:27:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.206+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c40190 con 0x7ff6ac017050 2024-09-18T01:27:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.207+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v35'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.207+0000 7ff6be124800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.207+0000 7ff6be124800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.207+0000 7ff6be124800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:27:15.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.207+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94078150900560 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559046c3b7d0 con 0x559046bef8d0 2024-09-18T01:27:15.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.207+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== watch-notify(notify (1) cookie 94078150641600 notify 150323855410 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7ff6b4026410 con 0x559046bef8d0 2024-09-18T01:27:15.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.207+0000 7ff59d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855410 cookie 94078150641600 notifier 4881 bl.length()=666 2024-09-18T01:27:15.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.207+0000 7ff59d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:15.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.207+0000 7ff59d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.207+0000 7ff59d7fa640 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff57c003ea0 con 0x559046bef8d0 2024-09-18T01:27:15.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.207+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 notify.4 [notify cookie 94078150900560 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.207+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.208+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== watch-notify(notify_complete (2) cookie 94078150900560 notify 150323855410 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff6b40265e0 con 0x559046bef8d0 2024-09-18T01:27:15.217 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:27:14.265685Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:27:14.265676Z","tags":[],"group_ids":[]} 2024-09-18T01:27:15.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.208+0000 7ff56b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:15.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.208+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94078150650688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c377d0 con 0x559046bef8d0 2024-09-18T01:27:15.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.209+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94078150650688] v35'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.209+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94078150627056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c377d0 con 0x559046bf42c0 2024-09-18T01:27:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.210+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94078150627056] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.210+0000 7ff6be124800 20 remove_watcher() i=0 2024-09-18T01:27:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.210+0000 7ff6be124800 2 removed watcher, disabling cache 2024-09-18T01:27:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.210+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94078150630208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c377d0 con 0x559046bef8d0 2024-09-18T01:27:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.212+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94078150630208] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.212+0000 7ff6be124800 20 remove_watcher() i=1 2024-09-18T01:27:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.212+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94078150635104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c377d0 con 0x559046bf8c70 2024-09-18T01:27:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.213+0000 7ff6b3fff640 1 -- 172.21.15.100:0/3120745206 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94078150635104] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a4072030 con 0x559046bf8c70 2024-09-18T01:27:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.213+0000 7ff6be124800 20 remove_watcher() i=2 2024-09-18T01:27:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.213+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94078150632336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c38d30 con 0x559046bf42c0 2024-09-18T01:27:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.214+0000 7ff6b9eac640 1 -- 172.21.15.100:0/3120745206 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94078150632336] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ac04cd70 con 0x559046bf42c0 2024-09-18T01:27:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.214+0000 7ff6be124800 20 remove_watcher() i=3 2024-09-18T01:27:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.214+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94078150641600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c38d30 con 0x559046bef8d0 2024-09-18T01:27:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.215+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94078150641600] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x559046bef8d0 2024-09-18T01:27:15.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.215+0000 7ff6be124800 20 remove_watcher() i=4 2024-09-18T01:27:15.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.215+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94078150644096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c38d30 con 0x7ff6ac017050 2024-09-18T01:27:15.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.216+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94078150644096] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.216+0000 7ff6be124800 20 remove_watcher() i=5 2024-09-18T01:27:15.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.216+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94078150646112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c38d30 con 0x7ff6ac017050 2024-09-18T01:27:15.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.217+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94078150646112] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.217+0000 7ff6be124800 20 remove_watcher() i=6 2024-09-18T01:27:15.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.217+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94078150649568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559046c38d30 con 0x7ff6ac017050 2024-09-18T01:27:15.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94078150649568] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6b400a4a0 con 0x7ff6ac017050 2024-09-18T01:27:15.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 20 remove_watcher() i=7 2024-09-18T01:27:15.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff6ac017050 msgr2=0x7ff6ac015770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff6ac017050 0x7ff6ac015770 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559046bef8d0 msgr2=0x559046bf1d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559046bef8d0 0x559046bf1d90 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559046bf42c0 msgr2=0x559046bf66b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559046bf42c0 0x559046bf66b0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559046bf8c70 msgr2=0x559046bfb130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x559046bf8c70 0x559046bfb130 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff584036b40 msgr2=0x7ff584039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff584036b40 0x7ff584039000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400a470 tx=0x7ff6a4062040 comp rx=0 tx=0).stop 2024-09-18T01:27:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bdcee0 msgr2=0x559046be4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 --2- 172.21.15.100:0/3120745206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bdcee0 0x559046be4170 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac01a6a0 tx=0x7ff6ac032f10 comp rx=0 tx=0).stop 2024-09-18T01:27:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 reap_dead start 2024-09-18T01:27:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3120745206 reap_dead start 2024-09-18T01:27:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 shutdown_connections 2024-09-18T01:27:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 >> 172.21.15.100:0/3120745206 conn(0x559046bd9240 msgr2=0x559046bd7310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 shutdown_connections 2024-09-18T01:27:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 -- 172.21.15.100:0/3120745206 wait complete. 2024-09-18T01:27:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 -- 172.21.15.100:0/388334347 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff594036b40 msgr2=0x7ff594039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 --2- 172.21.15.100:0/388334347 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff594036b40 0x7ff594039000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x559046bba1b0 tx=0x7ff6a4005a00 comp rx=0 tx=0).stop 2024-09-18T01:27:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 -- 172.21.15.100:0/388334347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bd03e0 msgr2=0x559046bd0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.218+0000 7ff6be124800 1 --2- 172.21.15.100:0/388334347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bd03e0 0x559046bd0800 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac04ae30 tx=0x7ff6ac0444a0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 -- 172.21.15.100:0/388334347 shutdown_connections 2024-09-18T01:27:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 --2- 172.21.15.100:0/388334347 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff594036b40 0x7ff594039000 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 --2- 172.21.15.100:0/388334347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046bd03e0 0x559046bd0800 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 -- 172.21.15.100:0/388334347 >> 172.21.15.100:0/388334347 conn(0x559046bc5370 msgr2=0x559046bc7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 -- 172.21.15.100:0/388334347 shutdown_connections 2024-09-18T01:27:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 -- 172.21.15.100:0/388334347 wait complete. 2024-09-18T01:27:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559046bbfb40 msgr2=0x559046bc1f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x559046bbfb40 0x559046bc1f30 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559046abc920 msgr2=0x559046bb93b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559046abc920 0x559046bb93b0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559046bbbc00 msgr2=0x559046bbdff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559046bbbc00 0x559046bbdff0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff5a0036b40 msgr2=0x7ff5a0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff5a0036b40 0x7ff5a0039000 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x559046ab92e0 tx=0x7ff6a4050000 comp rx=0 tx=0).stop 2024-09-18T01:27:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046ab84e0 msgr2=0x559046bb2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 --2- 172.21.15.100:0/3678764117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559046ab84e0 0x559046bb2340 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00c010 tx=0x7ff6ac000bc0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6ba6ad640 1 -- 172.21.15.100:0/3678764117 reap_dead start 2024-09-18T01:27:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 shutdown_connections 2024-09-18T01:27:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 >> 172.21.15.100:0/3678764117 conn(0x559046ab3dd0 msgr2=0x559046ba0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 shutdown_connections 2024-09-18T01:27:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.219+0000 7ff6be124800 1 -- 172.21.15.100:0/3678764117 wait complete. 2024-09-18T01:27:15.229 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:15.229 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:15.229 ERROR:root:0 2024-09-18T01:27:15.229 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:15.233 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:15.233 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-18T01:27:15.234 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-18T01:27:15.234 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-18T01:27:15.279 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:15.279 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:15.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.279+0000 7ff814810800 1 Processor -- start 2024-09-18T01:27:15.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.279+0000 7ff814810800 1 -- start start 2024-09-18T01:27:15.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.279+0000 7ff814810800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5650856169a0 0x565085618d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.279+0000 7ff814810800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5650854d1b30 con 0x565085585d90 2024-09-18T01:27:15.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.279+0000 7ff814810800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5650854b3360 con 0x5650856169a0 2024-09-18T01:27:15.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.280+0000 7ff807fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5650856169a0 0x565085618d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.280+0000 7ff80ffc6640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x565085585d90 0x565085615280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37238/0 (socket says 172.21.15.100:37238) 2024-09-18T01:27:15.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.280+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2111243559 learned_addr learned my addr 172.21.15.100:0/2111243559 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:15.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.280+0000 7ff807fff640 1 -- 172.21.15.100:0/2111243559 >> v1:172.21.15.92:6789/0 conn(0x565085585d90 legacy=0x565085615280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.280+0000 7ff807fff640 1 -- 172.21.15.100:0/2111243559 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650854d9e00 con 0x5650856169a0 2024-09-18T01:27:15.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.282+0000 7ff807fff640 1 --2- 172.21.15.100:0/2111243559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650856169a0 0x565085618d90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800a470 tx=0x7ff7f8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a1c0be44644205 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.282+0000 7ff80f7c5640 1 -- 172.21.15.100:0/2111243559 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f8053570 con 0x5650856169a0 2024-09-18T01:27:15.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.282+0000 7ff80f7c5640 1 -- 172.21.15.100:0/2111243559 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f8058070 con 0x5650856169a0 2024-09-18T01:27:15.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.282+0000 7ff80f7c5640 1 -- 172.21.15.100:0/2111243559 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f8053880 con 0x5650856169a0 2024-09-18T01:27:15.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.282+0000 7ff814810800 1 -- 172.21.15.100:0/2111243559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650856169a0 msgr2=0x565085618d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.282+0000 7ff814810800 1 --2- 172.21.15.100:0/2111243559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650856169a0 0x565085618d90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800a470 tx=0x7ff7f8045a20 comp rx=0 tx=0).stop 2024-09-18T01:27:15.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.282+0000 7ff814810800 1 -- 172.21.15.100:0/2111243559 shutdown_connections 2024-09-18T01:27:15.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.282+0000 7ff814810800 1 --2- 172.21.15.100:0/2111243559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650856169a0 0x565085618d90 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.282+0000 7ff814810800 1 -- 172.21.15.100:0/2111243559 >> 172.21.15.100:0/2111243559 conn(0x56508560cdd0 msgr2=0x56508560f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.282+0000 7ff814810800 1 -- 172.21.15.100:0/2111243559 shutdown_connections 2024-09-18T01:27:15.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.282+0000 7ff814810800 1 -- 172.21.15.100:0/2111243559 wait complete. 2024-09-18T01:27:15.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.296+0000 7ff814810800 1 Processor -- start 2024-09-18T01:27:15.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.296+0000 7ff814810800 1 -- start start 2024-09-18T01:27:15.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.296+0000 7ff814810800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085585d90 0x5650857018a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.296+0000 7ff814810800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56508555e360 con 0x565085585d90 2024-09-18T01:27:15.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.296+0000 7ff80ffc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085585d90 0x5650857018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.296+0000 7ff80ffc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085585d90 0x5650857018a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45686/0 (socket says 172.21.15.100:45686) 2024-09-18T01:27:15.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.297+0000 7ff80ffc6640 1 -- 172.21.15.100:0/1791783871 learned_addr learned my addr 172.21.15.100:0/1791783871 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.297+0000 7ff80ffc6640 1 -- 172.21.15.100:0/1791783871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650854abbc0 con 0x565085585d90 2024-09-18T01:27:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.297+0000 7ff80ffc6640 1 --2- 172.21.15.100:0/1791783871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085585d90 0x5650857018a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff800001d80 tx=0x7ff800001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252d2a3f5bad1ca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.297+0000 7ff6fde0b640 1 -- 172.21.15.100:0/1791783871 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff800013030 con 0x565085585d90 2024-09-18T01:27:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.297+0000 7ff6fde0b640 1 -- 172.21.15.100:0/1791783871 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80000e470 con 0x565085585d90 2024-09-18T01:27:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.297+0000 7ff6fde0b640 1 -- 172.21.15.100:0/1791783871 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff80000e810 con 0x565085585d90 2024-09-18T01:27:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.298+0000 7ff814810800 1 -- 172.21.15.100:0/1791783871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085585d90 msgr2=0x5650857018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.298+0000 7ff814810800 1 --2- 172.21.15.100:0/1791783871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085585d90 0x5650857018a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff800001d80 tx=0x7ff800001e70 comp rx=0 tx=0).stop 2024-09-18T01:27:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.298+0000 7ff814810800 1 -- 172.21.15.100:0/1791783871 shutdown_connections 2024-09-18T01:27:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.298+0000 7ff814810800 1 --2- 172.21.15.100:0/1791783871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085585d90 0x5650857018a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.298+0000 7ff814810800 1 -- 172.21.15.100:0/1791783871 >> 172.21.15.100:0/1791783871 conn(0x56508560cdd0 msgr2=0x5650856fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.298+0000 7ff814810800 1 -- 172.21.15.100:0/1791783871 shutdown_connections 2024-09-18T01:27:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.298+0000 7ff814810800 1 -- 172.21.15.100:0/1791783871 wait complete. 2024-09-18T01:27:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.298+0000 7ff814810800 1 Processor -- start 2024-09-18T01:27:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.298+0000 7ff814810800 1 -- start start 2024-09-18T01:27:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.298+0000 7ff814810800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085585d90 0x565085612bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.298+0000 7ff814810800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x565085619660 con 0x565085585d90 2024-09-18T01:27:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.298+0000 7ff80ffc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085585d90 0x565085612bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.299+0000 7ff80ffc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085585d90 0x565085612bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45702/0 (socket says 172.21.15.100:45702) 2024-09-18T01:27:15.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.299+0000 7ff80ffc6640 1 -- 172.21.15.100:0/4045865396 learned_addr learned my addr 172.21.15.100:0/4045865396 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.299+0000 7ff80ffc6640 1 -- 172.21.15.100:0/4045865396 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650854bffe0 con 0x565085585d90 2024-09-18T01:27:15.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.299+0000 7ff80ffc6640 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085585d90 0x565085612bb0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff800004000 tx=0x7ff800000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.299+0000 7ff6f7fff640 1 -- 172.21.15.100:0/4045865396 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff800027070 con 0x565085585d90 2024-09-18T01:27:15.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.299+0000 7ff6f7fff640 1 -- 172.21.15.100:0/4045865396 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff800019900 con 0x565085585d90 2024-09-18T01:27:15.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.299+0000 7ff6f7fff640 1 -- 172.21.15.100:0/4045865396 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff800019c60 con 0x565085585d90 2024-09-18T01:27:15.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.299+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650856112a0 con 0x565085585d90 2024-09-18T01:27:15.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.299+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650856117c0 con 0x565085585d90 2024-09-18T01:27:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.300+0000 7ff6f7fff640 1 -- 172.21.15.100:0/4045865396 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff80002a070 con 0x565085585d90 2024-09-18T01:27:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.300+0000 7ff6f7fff640 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6f8036b40 0x7ff6f8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.300+0000 7ff6f7fff640 1 -- 172.21.15.100:0/4045865396 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff80001f070 con 0x565085585d90 2024-09-18T01:27:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.300+0000 7ff807fff640 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6f8036b40 0x7ff6f8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.300+0000 7ff814810800 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5650856169a0 0x5650857126a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.300+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565085712be0 con 0x5650856169a0 2024-09-18T01:27:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.300+0000 7ff8107c7640 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5650856169a0 0x5650857126a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.301+0000 7ff807fff640 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6f8036b40 0x7ff6f8039000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800a470 tx=0x7ff7f8052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.301+0000 7ff8107c7640 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5650856169a0 0x5650857126a0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.301+0000 7ff8107c7640 1 -- 172.21.15.100:0/4045865396 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650856169a0 2024-09-18T01:27:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.301+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565085713430 con 0x5650856169a0 2024-09-18T01:27:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.301+0000 7ff8107c7640 1 -- 172.21.15.100:0/4045865396 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650856169a0 2024-09-18T01:27:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.301+0000 7ff814810800 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565085714e60 0x565085717290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.301+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565085717a20 con 0x565085714e60 2024-09-18T01:27:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.301+0000 7ff80ffc6640 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565085714e60 0x565085717290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.302+0000 7ff80ffc6640 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565085714e60 0x565085717290 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.302+0000 7ff80ffc6640 1 -- 172.21.15.100:0/4045865396 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff800029030 con 0x565085714e60 2024-09-18T01:27:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.302+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565085713c80 con 0x5650856169a0 2024-09-18T01:27:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.302+0000 7ff8107c7640 1 -- 172.21.15.100:0/4045865396 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650856169a0 2024-09-18T01:27:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.302+0000 7ff814810800 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x565085718e80 0x56508571b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.302+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56508571b960 con 0x565085718e80 2024-09-18T01:27:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.302+0000 7ff807fff640 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x565085718e80 0x56508571b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.303+0000 7ff807fff640 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x565085718e80 0x56508571b270 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.303+0000 7ff807fff640 1 -- 172.21.15.100:0/4045865396 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff7f8051070 con 0x565085718e80 2024-09-18T01:27:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.303+0000 7ff814810800 1 Processor -- start 2024-09-18T01:27:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.303+0000 7ff814810800 1 -- start start 2024-09-18T01:27:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.303+0000 7ff814810800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085729710 0x565085729b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.303+0000 7ff814810800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5650856130f0 con 0x565085729710 2024-09-18T01:27:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.304+0000 7ff80ffc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085729710 0x565085729b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.304+0000 7ff80ffc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085729710 0x565085729b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45710/0 (socket says 172.21.15.100:45710) 2024-09-18T01:27:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.304+0000 7ff80ffc6640 1 -- 172.21.15.100:0/1746072664 learned_addr learned my addr 172.21.15.100:0/1746072664 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.304+0000 7ff80ffc6640 1 -- 172.21.15.100:0/1746072664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56508572a070 con 0x565085729710 2024-09-18T01:27:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.304+0000 7ff80ffc6640 1 --2- 172.21.15.100:0/1746072664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085729710 0x565085729b30 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff80000c520 tx=0x7ff8000177a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.304+0000 7ff6f57fa640 1 -- 172.21.15.100:0/1746072664 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff800040740 con 0x565085729710 2024-09-18T01:27:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.304+0000 7ff6f57fa640 1 -- 172.21.15.100:0/1746072664 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8000408e0 con 0x565085729710 2024-09-18T01:27:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.304+0000 7ff814810800 1 -- 172.21.15.100:0/1746072664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56508572a2a0 con 0x565085729710 2024-09-18T01:27:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.304+0000 7ff6f57fa640 1 -- 172.21.15.100:0/1746072664 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff800040bc0 con 0x565085729710 2024-09-18T01:27:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.304+0000 7ff814810800 1 -- 172.21.15.100:0/1746072664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56508572cf80 con 0x565085729710 2024-09-18T01:27:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.305+0000 7ff6f57fa640 1 -- 172.21.15.100:0/1746072664 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff80003b060 con 0x565085729710 2024-09-18T01:27:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.305+0000 7ff6f57fa640 1 --2- 172.21.15.100:0/1746072664 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6e8036b90 0x7ff6e8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.305+0000 7ff6f57fa640 1 -- 172.21.15.100:0/1746072664 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff800014070 con 0x565085729710 2024-09-18T01:27:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.305+0000 7ff807fff640 1 --2- 172.21.15.100:0/1746072664 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6e8036b90 0x7ff6e8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.305+0000 7ff814810800 1 Processor -- start 2024-09-18T01:27:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.306+0000 7ff814810800 1 -- start start 2024-09-18T01:27:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.306+0000 7ff807fff640 1 --2- 172.21.15.100:0/1746072664 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6e8036b90 0x7ff6e8039050 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x565085611c60 tx=0x7ff7f8005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.306+0000 7ff814810800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085736180 0x565085736560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.306+0000 7ff814810800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5650854ad580 con 0x565085736180 2024-09-18T01:27:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.306+0000 7ff80ffc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085736180 0x565085736560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.306+0000 7ff80ffc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085736180 0x565085736560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45724/0 (socket says 172.21.15.100:45724) 2024-09-18T01:27:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.306+0000 7ff80ffc6640 1 -- 172.21.15.100:0/3368162195 learned_addr learned my addr 172.21.15.100:0/3368162195 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.306+0000 7ff80ffc6640 1 -- 172.21.15.100:0/3368162195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565085736b30 con 0x565085736180 2024-09-18T01:27:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.306+0000 7ff80ffc6640 1 --2- 172.21.15.100:0/3368162195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085736180 0x565085736560 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff800042f40 tx=0x7ff800021640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7835664c92ca7b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.306+0000 7ff6eeffd640 1 -- 172.21.15.100:0/3368162195 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff800041cc0 con 0x565085736180 2024-09-18T01:27:15.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.306+0000 7ff6eeffd640 1 -- 172.21.15.100:0/3368162195 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80002a580 con 0x565085736180 2024-09-18T01:27:15.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.306+0000 7ff6eeffd640 1 -- 172.21.15.100:0/3368162195 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff80003d450 con 0x565085736180 2024-09-18T01:27:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.307+0000 7ff814810800 1 -- 172.21.15.100:0/3368162195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085736180 msgr2=0x565085736560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.307+0000 7ff814810800 1 --2- 172.21.15.100:0/3368162195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085736180 0x565085736560 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff800042f40 tx=0x7ff800021640 comp rx=0 tx=0).stop 2024-09-18T01:27:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.307+0000 7ff814810800 1 -- 172.21.15.100:0/3368162195 shutdown_connections 2024-09-18T01:27:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.307+0000 7ff814810800 1 --2- 172.21.15.100:0/3368162195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085736180 0x565085736560 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.307+0000 7ff814810800 1 -- 172.21.15.100:0/3368162195 >> 172.21.15.100:0/3368162195 conn(0x565085732530 msgr2=0x565085730630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.307+0000 7ff814810800 1 -- 172.21.15.100:0/3368162195 shutdown_connections 2024-09-18T01:27:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.307+0000 7ff814810800 1 -- 172.21.15.100:0/3368162195 wait complete. 2024-09-18T01:27:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.307+0000 7ff814810800 1 Processor -- start 2024-09-18T01:27:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.307+0000 7ff814810800 1 -- start start 2024-09-18T01:27:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.307+0000 7ff814810800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085736180 0x56508573d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.307+0000 7ff814810800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x565085736b30 con 0x565085736180 2024-09-18T01:27:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.308+0000 7ff80ffc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085736180 0x56508573d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.308+0000 7ff80ffc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085736180 0x56508573d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45728/0 (socket says 172.21.15.100:45728) 2024-09-18T01:27:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.308+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 learned_addr learned my addr 172.21.15.100:0/2676724097 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.308+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56508573d7e0 con 0x565085736180 2024-09-18T01:27:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.308+0000 7ff80ffc6640 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085736180 0x56508573d2a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff80000dfd0 tx=0x7ff800042ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.308+0000 7ff6ed7fa640 1 -- 172.21.15.100:0/2676724097 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff800069070 con 0x565085736180 2024-09-18T01:27:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.308+0000 7ff6ed7fa640 1 -- 172.21.15.100:0/2676724097 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80002acb0 con 0x565085736180 2024-09-18T01:27:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.308+0000 7ff6ed7fa640 1 -- 172.21.15.100:0/2676724097 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff80003d7b0 con 0x565085736180 2024-09-18T01:27:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.308+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56508573d7e0 con 0x565085736180 2024-09-18T01:27:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.308+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56508573d7e0 con 0x565085736180 2024-09-18T01:27:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.309+0000 7ff6ed7fa640 1 -- 172.21.15.100:0/2676724097 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff80006c070 con 0x565085736180 2024-09-18T01:27:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.309+0000 7ff6ed7fa640 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6d8036b90 0x7ff6d8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.309+0000 7ff6ed7fa640 1 -- 172.21.15.100:0/2676724097 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff80006fd50 con 0x565085736180 2024-09-18T01:27:15.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.309+0000 7ff807fff640 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6d8036b90 0x7ff6d8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.310+0000 7ff807fff640 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6d8036b90 0x7ff6d8039050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8045f20 tx=0x7ff7f8053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.310+0000 7ff814810800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.310+0000 7ff814810800 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5650857489a0 0x56508574ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.310+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56508574b5b0 con 0x5650857489a0 2024-09-18T01:27:15.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.310+0000 7ff8107c7640 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5650857489a0 0x56508574ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.310+0000 7ff8107c7640 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5650857489a0 0x56508574ae60 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.310+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 20 realm 2024-09-18T01:27:15.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56508574b9c0 con 0x5650857489a0 2024-09-18T01:27:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56508574c290 con 0x5650857489a0 2024-09-18T01:27:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x5650857489a0 2024-09-18T01:27:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56508574d390 0x56508574f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56508574fd90 con 0x56508574d390 2024-09-18T01:27:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.311+0000 7ff80ffc6640 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56508574d390 0x56508574f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.312+0000 7ff80ffc6640 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56508574d390 0x56508574f780 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.312+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.312+0000 7ff814810800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.312+0000 7ff814810800 20 searching for the correct realm 2024-09-18T01:27:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.312+0000 7ff814810800 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x565085751d40 0x565085754200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.312+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5650857548d0 con 0x565085751d40 2024-09-18T01:27:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.312+0000 7ff807fff640 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x565085751d40 0x565085754200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.312+0000 7ff807fff640 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x565085751d40 0x565085754200 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.313+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f8051070 con 0x565085751d40 2024-09-18T01:27:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.313+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5650857548d0 con 0x56508574d390 2024-09-18T01:27:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.313+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.313+0000 7ff80ffc6640 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff80006e060 0x7ff8000322c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.313+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5650857548d0 con 0x7ff80006e060 2024-09-18T01:27:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.313+0000 7ff8107c7640 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff80006e060 0x7ff8000322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.313+0000 7ff8107c7640 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff80006e060 0x7ff8000322c0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.313+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.314+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x5650857489a0 2024-09-18T01:27:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.314+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.314+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x5650857489a0 2024-09-18T01:27:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.314+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.314+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x7ff80006e060 2024-09-18T01:27:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.314+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.314+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x7ff80006e060 2024-09-18T01:27:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.314+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.314+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x56508574d390 2024-09-18T01:27:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.315+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.315+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x565085751d40 2024-09-18T01:27:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.315+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f8051070 con 0x565085751d40 2024-09-18T01:27:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.315+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x5650857489a0 2024-09-18T01:27:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.315+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.315+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x56508574d390 2024-09-18T01:27:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.315+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.315+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x5650857489a0 2024-09-18T01:27:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.315+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.316+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x56508574d390 2024-09-18T01:27:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.316+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.316+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x565085751d40 2024-09-18T01:27:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.316+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f8051070 con 0x565085751d40 2024-09-18T01:27:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.316+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x565085751d40 2024-09-18T01:27:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.316+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f8051070 con 0x565085751d40 2024-09-18T01:27:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.316+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x7ff80006e060 2024-09-18T01:27:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.316+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.316+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x565085751d40 2024-09-18T01:27:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.317+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f8051070 con 0x565085751d40 2024-09-18T01:27:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.317+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x565085751d40 2024-09-18T01:27:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.317+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f8051070 con 0x565085751d40 2024-09-18T01:27:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.317+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x5650857489a0 2024-09-18T01:27:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.317+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.317+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x5650857489a0 2024-09-18T01:27:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.317+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.317+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x7ff80006e060 2024-09-18T01:27:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.318+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.318+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x565085751d40 2024-09-18T01:27:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.318+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f8051070 con 0x565085751d40 2024-09-18T01:27:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.318+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x56508574d390 2024-09-18T01:27:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.318+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.318+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x5650857489a0 2024-09-18T01:27:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.318+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.318+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x7ff80006e060 2024-09-18T01:27:15.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.319+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.319+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x565085751d40 2024-09-18T01:27:15.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.319+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f8051070 con 0x565085751d40 2024-09-18T01:27:15.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.319+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x56508574d390 2024-09-18T01:27:15.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.319+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.319+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x56508574d390 2024-09-18T01:27:15.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.319+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.319+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x565085751d40 2024-09-18T01:27:15.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.319+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f8051070 con 0x565085751d40 2024-09-18T01:27:15.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.319+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x7ff80006e060 2024-09-18T01:27:15.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x5650857489a0 2024-09-18T01:27:15.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56508574c630 con 0x56508574d390 2024-09-18T01:27:15.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff814810800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:15.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff814810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:15.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff814810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:15.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff814810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:15.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff814810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:15.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff814810800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:15.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff814810800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565085750650 con 0x5650857489a0 2024-09-18T01:27:15.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff814810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff814810800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.320+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565085750a40 con 0x5650857489a0 2024-09-18T01:27:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565085750a40 con 0x7ff80006e060 2024-09-18T01:27:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 20 zone default found 2024-09-18T01:27:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 4 Realm: () 2024-09-18T01:27:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 20 zonegroup default 2024-09-18T01:27:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565085754d50 con 0x7ff80006e060 2024-09-18T01:27:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.321+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565085756730 con 0x565085751d40 2024-09-18T01:27:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.322+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7f8051070 con 0x565085751d40 2024-09-18T01:27:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.322+0000 7ff814810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.322+0000 7ff814810800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.322+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565085756ad0 con 0x565085751d40 2024-09-18T01:27:15.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.322+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7f8051070 con 0x565085751d40 2024-09-18T01:27:15.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.322+0000 7ff814810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.322+0000 7ff814810800 20 started sync module instance, tier type = 2024-09-18T01:27:15.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.322+0000 7ff814810800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:15.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.322+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565085755bd0 con 0x56508574d390 2024-09-18T01:27:15.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.323+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.323+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94903836432160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565085756e70 con 0x56508574d390 2024-09-18T01:27:15.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.323+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5650857576c0 con 0x5650857489a0 2024-09-18T01:27:15.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.324+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.324+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903836439536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565085757f60 con 0x5650857489a0 2024-09-18T01:27:15.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.324+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5650857589e0 con 0x565085751d40 2024-09-18T01:27:15.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.324+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94903836432160] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.325+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f8051070 con 0x565085751d40 2024-09-18T01:27:15.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.325+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94903836443888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565085758e00 con 0x565085751d40 2024-09-18T01:27:15.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.325+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565085759830 con 0x56508574d390 2024-09-18T01:27:15.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.325+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94903836439536] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.326+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94903836443888] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f8051070 con 0x565085751d40 2024-09-18T01:27:15.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.326+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.326+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94903836447552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565085759c50 con 0x56508574d390 2024-09-18T01:27:15.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.326+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56508575a4e0 con 0x5650857489a0 2024-09-18T01:27:15.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.327+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94903836447552] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.327+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.327+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94903836441264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56508575a100 con 0x5650857489a0 2024-09-18T01:27:15.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.327+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56508575aef0 con 0x7ff80006e060 2024-09-18T01:27:15.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.328+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.328+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94903836441264] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.328+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903836453440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56508575ae60 con 0x7ff80006e060 2024-09-18T01:27:15.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.328+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56508575b9a0 con 0x7ff80006e060 2024-09-18T01:27:15.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.329+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(56 notify.6 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.329+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94903836449872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56508575be10 con 0x7ff80006e060 2024-09-18T01:27:15.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.329+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56508575c8c0 con 0x7ff80006e060 2024-09-18T01:27:15.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.330+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94903836453440] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.330+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94903836449872] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.330+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.330+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94903836459936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56508575b960 con 0x7ff80006e060 2024-09-18T01:27:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.330+0000 7ff814810800 20 add_watcher() i=0 2024-09-18T01:27:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.330+0000 7ff814810800 20 add_watcher() i=1 2024-09-18T01:27:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.330+0000 7ff814810800 20 add_watcher() i=2 2024-09-18T01:27:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.330+0000 7ff814810800 20 add_watcher() i=3 2024-09-18T01:27:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.330+0000 7ff814810800 20 add_watcher() i=4 2024-09-18T01:27:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.330+0000 7ff814810800 20 add_watcher() i=5 2024-09-18T01:27:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.330+0000 7ff814810800 20 add_watcher() i=6 2024-09-18T01:27:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.331+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94903836459936] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.331+0000 7ff814810800 20 add_watcher() i=7 2024-09-18T01:27:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.331+0000 7ff814810800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.331+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56508575f9c0 con 0x5650857489a0 2024-09-18T01:27:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.332+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.332+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94903836455568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56508575ce40 con 0x5650857489a0 2024-09-18T01:27:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.333+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94903836455568] v35'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.333+0000 7ff6c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.333+0000 7ff814810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.333+0000 7ff814810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.333+0000 7ff814810800 5 note: GC not initialized 2024-09-18T01:27:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.333+0000 7ff6c4fe1640 20 reqs_thread_entry: start 2024-09-18T01:27:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.333+0000 7ff814810800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.333+0000 7ff814810800 20 Filter name: none 2024-09-18T01:27:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.334+0000 7ff63e7fc640 20 reqs_thread_entry: start 2024-09-18T01:27:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.334+0000 7ff814810800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:27:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.334+0000 7ff814810800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.334+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565085792b90 con 0x7ff80006e060 2024-09-18T01:27:15.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.334+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.334+0000 7ff814810800 20 rados_obj.operate() r=0 bl.length=490 2024-09-18T01:27:15.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.334+0000 7ff814810800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:27:15.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.334+0000 7ff814810800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.334+0000 7ff814810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:27:15.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.334+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565085799380 con 0x7ff80006e060 2024-09-18T01:27:15.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.336+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v35'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.336+0000 7ff814810800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.336+0000 7ff814810800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.336+0000 7ff814810800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:27:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.336+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94903836708160 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5650857949a0 con 0x5650857489a0 2024-09-18T01:27:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.336+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== watch-notify(notify (1) cookie 94903836441264 notify 150323855411 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7ff808026410 con 0x5650857489a0 2024-09-18T01:27:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.336+0000 7ff6eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855411 cookie 94903836441264 notifier 4888 bl.length()=666 2024-09-18T01:27:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.336+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 notify.4 [notify cookie 94903836708160 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.336+0000 7ff6eeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.336+0000 7ff6eeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.336+0000 7ff6eeffd640 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff6d4003ea0 con 0x5650857489a0 2024-09-18T01:27:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.336+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.336+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== watch-notify(notify_complete (2) cookie 94903836708160 notify 150323855411 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff8080265e0 con 0x5650857489a0 2024-09-18T01:27:15.356 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:27:14.265685Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:27:14.265676Z","tags":[],"group_ids":[]} 2024-09-18T01:27:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.337+0000 7ff6c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.337+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94903836455568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5650857908b0 con 0x5650857489a0 2024-09-18T01:27:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.338+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94903836455568] v35'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.338+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94903836432160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5650857908b0 con 0x56508574d390 2024-09-18T01:27:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.339+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94903836432160] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.339+0000 7ff814810800 20 remove_watcher() i=0 2024-09-18T01:27:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.339+0000 7ff814810800 2 removed watcher, disabling cache 2024-09-18T01:27:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.339+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94903836439536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5650857908b0 con 0x5650857489a0 2024-09-18T01:27:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.340+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94903836439536] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.340+0000 7ff814810800 20 remove_watcher() i=1 2024-09-18T01:27:15.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.340+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94903836443888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5650857908b0 con 0x565085751d40 2024-09-18T01:27:15.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.341+0000 7ff807fff640 1 -- 172.21.15.100:0/2676724097 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94903836443888] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f8051070 con 0x565085751d40 2024-09-18T01:27:15.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.341+0000 7ff814810800 20 remove_watcher() i=2 2024-09-18T01:27:15.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.342+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94903836447552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56508575b290 con 0x56508574d390 2024-09-18T01:27:15.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.343+0000 7ff80ffc6640 1 -- 172.21.15.100:0/2676724097 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94903836447552] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80006b030 con 0x56508574d390 2024-09-18T01:27:15.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.343+0000 7ff814810800 20 remove_watcher() i=3 2024-09-18T01:27:15.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.343+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94903836441264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56508575b290 con 0x5650857489a0 2024-09-18T01:27:15.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.343+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94903836441264] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x5650857489a0 2024-09-18T01:27:15.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.343+0000 7ff814810800 20 remove_watcher() i=4 2024-09-18T01:27:15.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.343+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94903836453440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565085757ab0 con 0x7ff80006e060 2024-09-18T01:27:15.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.345+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94903836453440] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.345+0000 7ff814810800 20 remove_watcher() i=5 2024-09-18T01:27:15.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.345+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94903836449872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56508575aa40 con 0x7ff80006e060 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.346+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94903836449872] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.346+0000 7ff814810800 20 remove_watcher() i=6 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.346+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94903836459936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56508575aa40 con 0x7ff80006e060 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.346+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94903836459936] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80800a4a0 con 0x7ff80006e060 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 20 remove_watcher() i=7 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff80006e060 msgr2=0x7ff8000322c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff80006e060 0x7ff8000322c0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5650857489a0 msgr2=0x56508574ae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5650857489a0 0x56508574ae60 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56508574d390 msgr2=0x56508574f780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56508574d390 0x56508574f780 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x565085751d40 msgr2=0x565085754200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x565085751d40 0x565085754200 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6d8036b90 msgr2=0x7ff6d8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6d8036b90 0x7ff6d8039050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8045f20 tx=0x7ff7f8053000 comp rx=0 tx=0).stop 2024-09-18T01:27:15.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085736180 msgr2=0x56508573d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 --2- 172.21.15.100:0/2676724097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085736180 0x56508573d2a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff80000dfd0 tx=0x7ff800042ea0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 reap_dead start 2024-09-18T01:27:15.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff8107c7640 1 -- 172.21.15.100:0/2676724097 reap_dead start 2024-09-18T01:27:15.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 shutdown_connections 2024-09-18T01:27:15.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 >> 172.21.15.100:0/2676724097 conn(0x565085732530 msgr2=0x565085730600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 shutdown_connections 2024-09-18T01:27:15.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/2676724097 wait complete. 2024-09-18T01:27:15.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/1746072664 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6e8036b90 msgr2=0x7ff6e8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 --2- 172.21.15.100:0/1746072664 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6e8036b90 0x7ff6e8039050 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x565085611c60 tx=0x7ff7f8005a00 comp rx=0 tx=0).stop 2024-09-18T01:27:15.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/1746072664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085729710 msgr2=0x565085729b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 --2- 172.21.15.100:0/1746072664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085729710 0x565085729b30 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff80000c520 tx=0x7ff8000177a0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/1746072664 shutdown_connections 2024-09-18T01:27:15.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 --2- 172.21.15.100:0/1746072664 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6e8036b90 0x7ff6e8039050 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 --2- 172.21.15.100:0/1746072664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085729710 0x565085729b30 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/1746072664 >> 172.21.15.100:0/1746072664 conn(0x56508571e6a0 msgr2=0x565085721220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/1746072664 shutdown_connections 2024-09-18T01:27:15.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.347+0000 7ff814810800 1 -- 172.21.15.100:0/1746072664 wait complete. 2024-09-18T01:27:15.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x565085718e80 msgr2=0x56508571b270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff814810800 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x565085718e80 0x56508571b270 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5650856169a0 msgr2=0x5650857126a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff814810800 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5650856169a0 0x5650857126a0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565085714e60 msgr2=0x565085717290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff814810800 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x565085714e60 0x565085717290 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6f8036b40 msgr2=0x7ff6f8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff814810800 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff6f8036b40 0x7ff6f8039000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800a470 tx=0x7ff7f8052000 comp rx=0 tx=0).stop 2024-09-18T01:27:15.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085585d90 msgr2=0x565085612bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff814810800 1 --2- 172.21.15.100:0/4045865396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565085585d90 0x565085612bb0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff800004000 tx=0x7ff800000bc0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff8107c7640 1 -- 172.21.15.100:0/4045865396 reap_dead start 2024-09-18T01:27:15.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 shutdown_connections 2024-09-18T01:27:15.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 >> 172.21.15.100:0/4045865396 conn(0x56508560cdd0 msgr2=0x5650856fbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 shutdown_connections 2024-09-18T01:27:15.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.348+0000 7ff814810800 1 -- 172.21.15.100:0/4045865396 wait complete. 2024-09-18T01:27:15.367 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:15.367 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:15.367 ERROR:root:0 2024-09-18T01:27:15.367 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:15.372 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:15.372 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:27:15.372 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:27:15.372 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-18T01:27:15.418 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:15.418 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:15.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.418+0000 7ff04bf24800 1 Processor -- start 2024-09-18T01:27:15.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.418+0000 7ff04bf24800 1 -- start start 2024-09-18T01:27:15.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.418+0000 7ff04bf24800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5603259ae710 0x5603259aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.418+0000 7ff04bf24800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56032586db30 con 0x5603259af050 2024-09-18T01:27:15.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.418+0000 7ff04bf24800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x56032584f360 con 0x5603259ae710 2024-09-18T01:27:15.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.418+0000 7ff047ce0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5603259ae710 0x5603259aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.418+0000 7ff03f4df640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5603259af050 0x5603259b3a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37250/0 (socket says 172.21.15.100:37250) 2024-09-18T01:27:15.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.418+0000 7ff047ce0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x5603259ae710 0x5603259aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45736/0 (socket says 172.21.15.100:45736) 2024-09-18T01:27:15.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.418+0000 7ff047ce0640 1 -- 172.21.15.100:0/3590214281 learned_addr learned my addr 172.21.15.100:0/3590214281 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.418+0000 7ff047ce0640 1 -- 172.21.15.100:0/3590214281 >> v1:172.21.15.92:6789/0 conn(0x5603259af050 legacy=0x5603259b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.418+0000 7ff047ce0640 1 -- 172.21.15.100:0/3590214281 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560325875e00 con 0x5603259ae710 2024-09-18T01:27:15.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.420+0000 7ff047ce0640 1 --2- 172.21.15.100:0/3590214281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 0x5603259aeb10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff03800a520 tx=0x7ff038045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e76f545ade61923 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.420+0000 7ff0474df640 1 -- 172.21.15.100:0/3590214281 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff038055070 con 0x5603259ae710 2024-09-18T01:27:15.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.420+0000 7ff0474df640 1 -- 172.21.15.100:0/3590214281 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0380515b0 con 0x5603259ae710 2024-09-18T01:27:15.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.420+0000 7ff0474df640 1 -- 172.21.15.100:0/3590214281 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0380518d0 con 0x5603259ae710 2024-09-18T01:27:15.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.421+0000 7ff04bf24800 1 -- 172.21.15.100:0/3590214281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 msgr2=0x5603259aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.421+0000 7ff04bf24800 1 --2- 172.21.15.100:0/3590214281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 0x5603259aeb10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff03800a520 tx=0x7ff038045ba0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.421+0000 7ff04bf24800 1 -- 172.21.15.100:0/3590214281 shutdown_connections 2024-09-18T01:27:15.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.421+0000 7ff04bf24800 1 --2- 172.21.15.100:0/3590214281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 0x5603259aeb10 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.421+0000 7ff04bf24800 1 -- 172.21.15.100:0/3590214281 >> 172.21.15.100:0/3590214281 conn(0x5603259a9fe0 msgr2=0x5603259ac400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.421+0000 7ff04bf24800 1 -- 172.21.15.100:0/3590214281 shutdown_connections 2024-09-18T01:27:15.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.421+0000 7ff04bf24800 1 -- 172.21.15.100:0/3590214281 wait complete. 2024-09-18T01:27:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.435+0000 7ff04bf24800 1 Processor -- start 2024-09-18T01:27:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.435+0000 7ff04bf24800 1 -- start start 2024-09-18T01:27:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.435+0000 7ff04bf24800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 0x560325a9d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.435+0000 7ff04bf24800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5603258fa360 con 0x5603259ae710 2024-09-18T01:27:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.435+0000 7ff047ce0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 0x560325a9d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.435+0000 7ff047ce0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 0x560325a9d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45740/0 (socket says 172.21.15.100:45740) 2024-09-18T01:27:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.435+0000 7ff047ce0640 1 -- 172.21.15.100:0/4033865607 learned_addr learned my addr 172.21.15.100:0/4033865607 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.435+0000 7ff047ce0640 1 -- 172.21.15.100:0/4033865607 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560325847bc0 con 0x5603259ae710 2024-09-18T01:27:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.435+0000 7ff047ce0640 1 --2- 172.21.15.100:0/4033865607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 0x560325a9d900 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff038025da0 tx=0x7ff038051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9465c66d79f7c7ea server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.436+0000 7fef35e0b640 1 -- 172.21.15.100:0/4033865607 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff038051950 con 0x5603259ae710 2024-09-18T01:27:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.436+0000 7fef35e0b640 1 -- 172.21.15.100:0/4033865607 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff038051af0 con 0x5603259ae710 2024-09-18T01:27:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.436+0000 7fef35e0b640 1 -- 172.21.15.100:0/4033865607 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff038051dd0 con 0x5603259ae710 2024-09-18T01:27:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.436+0000 7ff04bf24800 1 -- 172.21.15.100:0/4033865607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 msgr2=0x560325a9d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.436+0000 7ff04bf24800 1 --2- 172.21.15.100:0/4033865607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 0x560325a9d900 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff038025da0 tx=0x7ff038051000 comp rx=0 tx=0).stop 2024-09-18T01:27:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.436+0000 7ff04bf24800 1 -- 172.21.15.100:0/4033865607 shutdown_connections 2024-09-18T01:27:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.436+0000 7ff04bf24800 1 --2- 172.21.15.100:0/4033865607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 0x560325a9d900 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.436+0000 7ff04bf24800 1 -- 172.21.15.100:0/4033865607 >> 172.21.15.100:0/4033865607 conn(0x5603259a9fe0 msgr2=0x560325a992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.436+0000 7ff04bf24800 1 -- 172.21.15.100:0/4033865607 shutdown_connections 2024-09-18T01:27:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.436+0000 7ff04bf24800 1 -- 172.21.15.100:0/4033865607 wait complete. 2024-09-18T01:27:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.437+0000 7ff04bf24800 1 Processor -- start 2024-09-18T01:27:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.437+0000 7ff04bf24800 1 -- start start 2024-09-18T01:27:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.437+0000 7ff04bf24800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 0x5603259246e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.437+0000 7ff04bf24800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5603259b55f0 con 0x5603259ae710 2024-09-18T01:27:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.437+0000 7ff047ce0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 0x5603259246e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.437+0000 7ff047ce0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 0x5603259246e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45754/0 (socket says 172.21.15.100:45754) 2024-09-18T01:27:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.437+0000 7ff047ce0640 1 -- 172.21.15.100:0/1243421235 learned_addr learned my addr 172.21.15.100:0/1243421235 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.437+0000 7ff047ce0640 1 -- 172.21.15.100:0/1243421235 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56032585bfe0 con 0x5603259ae710 2024-09-18T01:27:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.437+0000 7ff047ce0640 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 0x5603259246e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ff038067040 tx=0x7ff038002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.438+0000 7fef2ffff640 1 -- 172.21.15.100:0/1243421235 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff038073070 con 0x5603259ae710 2024-09-18T01:27:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.438+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560325922dd0 con 0x5603259ae710 2024-09-18T01:27:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.438+0000 7fef2ffff640 1 -- 172.21.15.100:0/1243421235 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03805a450 con 0x5603259ae710 2024-09-18T01:27:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.438+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560325923350 con 0x5603259ae710 2024-09-18T01:27:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.438+0000 7fef2ffff640 1 -- 172.21.15.100:0/1243421235 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff03807d060 con 0x5603259ae710 2024-09-18T01:27:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.439+0000 7fef2ffff640 1 -- 172.21.15.100:0/1243421235 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff038076070 con 0x5603259ae710 2024-09-18T01:27:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.439+0000 7fef2ffff640 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef30036b40 0x7fef30039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.439+0000 7fef2ffff640 1 -- 172.21.15.100:0/1243421235 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff038062070 con 0x5603259ae710 2024-09-18T01:27:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.439+0000 7ff03f4df640 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef30036b40 0x7fef30039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.439+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5603259af050 0x560325aae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.439+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325aaea90 con 0x5603259af050 2024-09-18T01:27:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.439+0000 7ff0484e1640 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5603259af050 0x560325aae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.439+0000 7ff03f4df640 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef30036b40 0x7fef30039000 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff030000f60 tx=0x7ff030001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.439+0000 7ff0484e1640 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5603259af050 0x560325aae550 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.440+0000 7ff0484e1640 1 -- 172.21.15.100:0/1243421235 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x5603259af050 2024-09-18T01:27:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.440+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325aaf2e0 con 0x5603259af050 2024-09-18T01:27:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.440+0000 7ff0484e1640 1 -- 172.21.15.100:0/1243421235 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff04000a4a0 con 0x5603259af050 2024-09-18T01:27:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.440+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560325ab0d10 0x560325ab3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.440+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325ab38d0 con 0x560325ab0d10 2024-09-18T01:27:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.440+0000 7ff047ce0640 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560325ab0d10 0x560325ab3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.440+0000 7ff047ce0640 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560325ab0d10 0x560325ab3140 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.441+0000 7ff047ce0640 1 -- 172.21.15.100:0/1243421235 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff03807f070 con 0x560325ab0d10 2024-09-18T01:27:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.441+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325aafb30 con 0x5603259af050 2024-09-18T01:27:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.441+0000 7ff0484e1640 1 -- 172.21.15.100:0/1243421235 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff04000a4a0 con 0x5603259af050 2024-09-18T01:27:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.441+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560325ab4d30 0x560325ab7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.441+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325ab7810 con 0x560325ab4d30 2024-09-18T01:27:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.441+0000 7ff03f4df640 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560325ab4d30 0x560325ab7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.441+0000 7ff03f4df640 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560325ab4d30 0x560325ab7120 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.442+0000 7ff03f4df640 1 -- 172.21.15.100:0/1243421235 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff03000f690 con 0x560325ab4d30 2024-09-18T01:27:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.442+0000 7ff04bf24800 1 Processor -- start 2024-09-18T01:27:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.442+0000 7ff04bf24800 1 -- start start 2024-09-18T01:27:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.442+0000 7ff04bf24800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ac55c0 0x560325ac59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.442+0000 7ff04bf24800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560325924c20 con 0x560325ac55c0 2024-09-18T01:27:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.442+0000 7ff047ce0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ac55c0 0x560325ac59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.442+0000 7ff047ce0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ac55c0 0x560325ac59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45756/0 (socket says 172.21.15.100:45756) 2024-09-18T01:27:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.442+0000 7ff047ce0640 1 -- 172.21.15.100:0/1207403997 learned_addr learned my addr 172.21.15.100:0/1207403997 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.443+0000 7ff047ce0640 1 -- 172.21.15.100:0/1207403997 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560325ac5f20 con 0x560325ac55c0 2024-09-18T01:27:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.443+0000 7ff047ce0640 1 --2- 172.21.15.100:0/1207403997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ac55c0 0x560325ac59e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ff038070fd0 tx=0x7ff038064960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.443+0000 7fef2d7fa640 1 -- 172.21.15.100:0/1207403997 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff038065740 con 0x560325ac55c0 2024-09-18T01:27:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.443+0000 7fef2d7fa640 1 -- 172.21.15.100:0/1207403997 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0380017d0 con 0x560325ac55c0 2024-09-18T01:27:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.443+0000 7fef2d7fa640 1 -- 172.21.15.100:0/1207403997 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff038001ab0 con 0x560325ac55c0 2024-09-18T01:27:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.443+0000 7ff04bf24800 1 -- 172.21.15.100:0/1207403997 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560325ac6150 con 0x560325ac55c0 2024-09-18T01:27:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.443+0000 7ff04bf24800 1 -- 172.21.15.100:0/1207403997 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560325ac6150 con 0x560325ac55c0 2024-09-18T01:27:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.444+0000 7fef2d7fa640 1 -- 172.21.15.100:0/1207403997 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff038058070 con 0x560325ac55c0 2024-09-18T01:27:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.444+0000 7fef2d7fa640 1 --2- 172.21.15.100:0/1207403997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef20036b90 0x7fef20039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.444+0000 7fef2d7fa640 1 -- 172.21.15.100:0/1207403997 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff03808f050 con 0x560325ac55c0 2024-09-18T01:27:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.444+0000 7ff03f4df640 1 --2- 172.21.15.100:0/1207403997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef20036b90 0x7fef20039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.444+0000 7ff04bf24800 1 Processor -- start 2024-09-18T01:27:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.444+0000 7ff04bf24800 1 -- start start 2024-09-18T01:27:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.444+0000 7ff03f4df640 1 --2- 172.21.15.100:0/1207403997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef20036b90 0x7fef20039050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x560325923dc0 tx=0x7ff03000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.444+0000 7ff04bf24800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ad1cf0 0x560325ad20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.444+0000 7ff04bf24800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560325849580 con 0x560325ad1cf0 2024-09-18T01:27:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.445+0000 7ff047ce0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ad1cf0 0x560325ad20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.445+0000 7ff047ce0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ad1cf0 0x560325ad20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45762/0 (socket says 172.21.15.100:45762) 2024-09-18T01:27:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.445+0000 7ff047ce0640 1 -- 172.21.15.100:0/3423693296 learned_addr learned my addr 172.21.15.100:0/3423693296 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.445+0000 7ff047ce0640 1 -- 172.21.15.100:0/3423693296 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560325ad26c0 con 0x560325ad1cf0 2024-09-18T01:27:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.445+0000 7ff047ce0640 1 --2- 172.21.15.100:0/3423693296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ad1cf0 0x560325ad20f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7ff03808f2b0 tx=0x7ff03806c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1de25b1f7bc5b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.445+0000 7fef26ffd640 1 -- 172.21.15.100:0/3423693296 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff038088e60 con 0x560325ad1cf0 2024-09-18T01:27:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.445+0000 7fef26ffd640 1 -- 172.21.15.100:0/3423693296 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff038090d00 con 0x560325ad1cf0 2024-09-18T01:27:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.445+0000 7fef26ffd640 1 -- 172.21.15.100:0/3423693296 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0380507d0 con 0x560325ad1cf0 2024-09-18T01:27:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff04bf24800 1 -- 172.21.15.100:0/3423693296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ad1cf0 msgr2=0x560325ad20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff04bf24800 1 --2- 172.21.15.100:0/3423693296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ad1cf0 0x560325ad20f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7ff03808f2b0 tx=0x7ff03806c670 comp rx=0 tx=0).stop 2024-09-18T01:27:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff04bf24800 1 -- 172.21.15.100:0/3423693296 shutdown_connections 2024-09-18T01:27:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff04bf24800 1 --2- 172.21.15.100:0/3423693296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ad1cf0 0x560325ad20f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff04bf24800 1 -- 172.21.15.100:0/3423693296 >> 172.21.15.100:0/3423693296 conn(0x560325ace0a0 msgr2=0x560325acc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff04bf24800 1 -- 172.21.15.100:0/3423693296 shutdown_connections 2024-09-18T01:27:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff04bf24800 1 -- 172.21.15.100:0/3423693296 wait complete. 2024-09-18T01:27:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff04bf24800 1 Processor -- start 2024-09-18T01:27:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff04bf24800 1 -- start start 2024-09-18T01:27:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff04bf24800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ad1cf0 0x560325ad8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff04bf24800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560325ad26c0 con 0x560325ad1cf0 2024-09-18T01:27:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff047ce0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ad1cf0 0x560325ad8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff047ce0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ad1cf0 0x560325ad8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45766/0 (socket says 172.21.15.100:45766) 2024-09-18T01:27:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 learned_addr learned my addr 172.21.15.100:0/1475268520 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.446+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560325ad9350 con 0x560325ad1cf0 2024-09-18T01:27:15.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.447+0000 7ff047ce0640 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ad1cf0 0x560325ad8e10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff038051840 tx=0x7ff038092f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.447+0000 7fef257fa640 1 -- 172.21.15.100:0/1475268520 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0380be070 con 0x560325ad1cf0 2024-09-18T01:27:15.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.447+0000 7fef257fa640 1 -- 172.21.15.100:0/1475268520 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff038090770 con 0x560325ad1cf0 2024-09-18T01:27:15.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.447+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560325ad9350 con 0x560325ad1cf0 2024-09-18T01:27:15.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.447+0000 7fef257fa640 1 -- 172.21.15.100:0/1475268520 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff038090ab0 con 0x560325ad1cf0 2024-09-18T01:27:15.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.447+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560325ad9350 con 0x560325ad1cf0 2024-09-18T01:27:15.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.448+0000 7fef257fa640 1 -- 172.21.15.100:0/1475268520 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff0380c1070 con 0x560325ad1cf0 2024-09-18T01:27:15.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.448+0000 7fef257fa640 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef10036af0 0x7fef10038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.448+0000 7fef257fa640 1 -- 172.21.15.100:0/1475268520 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff0380b6070 con 0x560325ad1cf0 2024-09-18T01:27:15.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.448+0000 7ff03f4df640 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef10036af0 0x7fef10038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.448+0000 7ff03f4df640 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef10036af0 0x7fef10038fb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x560325ab7c10 tx=0x7ff030010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.448+0000 7ff04bf24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.448+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560325ae4530 0x560325ae69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.448+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325ae7140 con 0x560325ae4530 2024-09-18T01:27:15.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff0484e1640 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560325ae4530 0x560325ae69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff0484e1640 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560325ae4530 0x560325ae69f0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff04bf24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff04bf24800 20 realm 2024-09-18T01:27:15.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff04bf24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325ae7550 con 0x560325ae4530 2024-09-18T01:27:15.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff04bf24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff04bf24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:15.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff04bf24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325ae7e20 con 0x560325ae4530 2024-09-18T01:27:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff04bf24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff04bf24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.449+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae4530 2024-09-18T01:27:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.450+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.450+0000 7ff04bf24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.450+0000 7ff04bf24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.450+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560325ae8f20 0x560325aeb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.450+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325aeb920 con 0x560325ae8f20 2024-09-18T01:27:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.450+0000 7ff047ce0640 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560325ae8f20 0x560325aeb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.450+0000 7ff047ce0640 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560325ae8f20 0x560325aeb310 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.450+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.450+0000 7ff04bf24800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:15.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.450+0000 7ff04bf24800 20 searching for the correct realm 2024-09-18T01:27:15.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.450+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560325aed8d0 0x560325aefd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.450+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325af0460 con 0x560325aed8d0 2024-09-18T01:27:15.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.450+0000 7ff03f4df640 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560325aed8d0 0x560325aefd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.451+0000 7ff03f4df640 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560325aed8d0 0x560325aefd90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.451+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff030037040 con 0x560325aed8d0 2024-09-18T01:27:15.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.451+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325af0460 con 0x560325ae8f20 2024-09-18T01:27:15.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.451+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.451+0000 7ff047ce0640 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff0380c3060 0x7ff03807e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.451+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325af0460 con 0x7ff0380c3060 2024-09-18T01:27:15.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.452+0000 7ff0484e1640 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff0380c3060 0x7ff03807e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.452+0000 7ff0484e1640 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff0380c3060 0x7ff03807e9b0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.452+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.452+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae4530 2024-09-18T01:27:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.452+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.452+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae4530 2024-09-18T01:27:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.453+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.453+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x7ff0380c3060 2024-09-18T01:27:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.453+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.453+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x7ff0380c3060 2024-09-18T01:27:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.453+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.453+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae8f20 2024-09-18T01:27:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.453+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.453+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325aed8d0 2024-09-18T01:27:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.454+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff030037040 con 0x560325aed8d0 2024-09-18T01:27:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.454+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae4530 2024-09-18T01:27:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.454+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.454+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae8f20 2024-09-18T01:27:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.454+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.454+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae4530 2024-09-18T01:27:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.454+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.454+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae8f20 2024-09-18T01:27:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.455+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.455+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325aed8d0 2024-09-18T01:27:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.455+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff030037040 con 0x560325aed8d0 2024-09-18T01:27:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.455+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325aed8d0 2024-09-18T01:27:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.455+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff030037040 con 0x560325aed8d0 2024-09-18T01:27:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.455+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x7ff0380c3060 2024-09-18T01:27:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.455+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.455+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325aed8d0 2024-09-18T01:27:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.455+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff030037040 con 0x560325aed8d0 2024-09-18T01:27:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.455+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325aed8d0 2024-09-18T01:27:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.456+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff030037040 con 0x560325aed8d0 2024-09-18T01:27:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.456+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae4530 2024-09-18T01:27:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.456+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.456+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae4530 2024-09-18T01:27:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.456+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.456+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x7ff0380c3060 2024-09-18T01:27:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.456+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.456+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325aed8d0 2024-09-18T01:27:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.457+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff030037040 con 0x560325aed8d0 2024-09-18T01:27:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.457+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae8f20 2024-09-18T01:27:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.457+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.457+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae4530 2024-09-18T01:27:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.457+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.457+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x7ff0380c3060 2024-09-18T01:27:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.457+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.457+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325aed8d0 2024-09-18T01:27:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.458+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff030037040 con 0x560325aed8d0 2024-09-18T01:27:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.458+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae8f20 2024-09-18T01:27:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.458+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.458+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae8f20 2024-09-18T01:27:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.458+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.458+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325aed8d0 2024-09-18T01:27:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.458+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff030037040 con 0x560325aed8d0 2024-09-18T01:27:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.458+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x7ff0380c3060 2024-09-18T01:27:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae4530 2024-09-18T01:27:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560325ae81c0 con 0x560325ae8f20 2024-09-18T01:27:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff04bf24800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff04bf24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff04bf24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff04bf24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff04bf24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff04bf24800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:15.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff04bf24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325aec1e0 con 0x560325ae4530 2024-09-18T01:27:15.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff04bf24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff04bf24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325aec5d0 con 0x560325ae4530 2024-09-18T01:27:15.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff04bf24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:15.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff04bf24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.459+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325aec5d0 con 0x7ff0380c3060 2024-09-18T01:27:15.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:15.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 20 zone default found 2024-09-18T01:27:15.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 4 Realm: () 2024-09-18T01:27:15.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:15.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:15.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:15.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 20 zonegroup default 2024-09-18T01:27:15.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325aebe20 con 0x7ff0380c3060 2024-09-18T01:27:15.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325af22c0 con 0x560325aed8d0 2024-09-18T01:27:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff030037040 con 0x560325aed8d0 2024-09-18T01:27:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.460+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325af2660 con 0x560325aed8d0 2024-09-18T01:27:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.461+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff030037040 con 0x560325aed8d0 2024-09-18T01:27:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.461+0000 7ff04bf24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.461+0000 7ff04bf24800 20 started sync module instance, tier type = 2024-09-18T01:27:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.461+0000 7ff04bf24800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.461+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af1760 con 0x560325ae8f20 2024-09-18T01:27:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.462+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.462+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94571517123456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af13c0 con 0x560325ae8f20 2024-09-18T01:27:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.462+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af3360 con 0x560325ae4530 2024-09-18T01:27:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.463+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94571517123456] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.463+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.463+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94571517127648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af3780 con 0x560325ae4530 2024-09-18T01:27:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.463+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af4180 con 0x560325aed8d0 2024-09-18T01:27:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.464+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94571517127648] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.464+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff030037040 con 0x560325aed8d0 2024-09-18T01:27:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.464+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94571517128832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af4570 con 0x560325aed8d0 2024-09-18T01:27:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.464+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af4fb0 con 0x560325ae8f20 2024-09-18T01:27:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.465+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94571517128832] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff030037040 con 0x560325aed8d0 2024-09-18T01:27:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.465+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.466+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94571517135488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af53a0 con 0x560325ae8f20 2024-09-18T01:27:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.466+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af5de0 con 0x560325ae4530 2024-09-18T01:27:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.467+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.467+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94571517139120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af5da0 con 0x560325ae4530 2024-09-18T01:27:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.467+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af6d40 con 0x7ff0380c3060 2024-09-18T01:27:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.467+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94571517135488] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.468+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.468+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94571517139120] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.468+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94571517143120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af6d40 con 0x7ff0380c3060 2024-09-18T01:27:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.468+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af72a0 con 0x7ff0380c3060 2024-09-18T01:27:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.469+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(56 notify.6 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.469+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94571517141312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af7750 con 0x7ff0380c3060 2024-09-18T01:27:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.469+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af8150 con 0x7ff0380c3060 2024-09-18T01:27:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.469+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94571517143120] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.470+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94571517141312] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.470+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.470+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94571517131920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af7c60 con 0x7ff0380c3060 2024-09-18T01:27:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.470+0000 7ff04bf24800 20 add_watcher() i=0 2024-09-18T01:27:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.470+0000 7ff04bf24800 20 add_watcher() i=1 2024-09-18T01:27:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.470+0000 7ff04bf24800 20 add_watcher() i=2 2024-09-18T01:27:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.470+0000 7ff04bf24800 20 add_watcher() i=3 2024-09-18T01:27:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.470+0000 7ff04bf24800 20 add_watcher() i=4 2024-09-18T01:27:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.470+0000 7ff04bf24800 20 add_watcher() i=5 2024-09-18T01:27:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.470+0000 7ff04bf24800 20 add_watcher() i=6 2024-09-18T01:27:15.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.471+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94571517131920] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.471+0000 7ff04bf24800 20 add_watcher() i=7 2024-09-18T01:27:15.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.471+0000 7ff04bf24800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:15.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.471+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325afb140 con 0x560325ae4530 2024-09-18T01:27:15.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.471+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.471+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94571517148256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325af8570 con 0x560325ae4530 2024-09-18T01:27:15.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.472+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94571517148256] v35'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.472+0000 7feefdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:15.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.472+0000 7ff04bf24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:15.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.472+0000 7ff04bf24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:15.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.472+0000 7ff04bf24800 5 note: GC not initialized 2024-09-18T01:27:15.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.473+0000 7feefcfe1640 20 reqs_thread_entry: start 2024-09-18T01:27:15.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.473+0000 7ff04bf24800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.473+0000 7ff04bf24800 20 Filter name: none 2024-09-18T01:27:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.473+0000 7fee767fc640 20 reqs_thread_entry: start 2024-09-18T01:27:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.473+0000 7ff04bf24800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:27:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.473+0000 7ff04bf24800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.473+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325b2e430 con 0x7ff0380c3060 2024-09-18T01:27:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.474+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.474+0000 7ff04bf24800 20 rados_obj.operate() r=0 bl.length=490 2024-09-18T01:27:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.474+0000 7ff04bf24800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:27:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.474+0000 7ff04bf24800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.474+0000 7ff04bf24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:27:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.474+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325b34c10 con 0x7ff0380c3060 2024-09-18T01:27:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.475+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v35'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.475+0000 7ff04bf24800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.475+0000 7ff04bf24800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.475+0000 7ff04bf24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:27:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.475+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94571517396432 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560325b30230 con 0x560325ae4530 2024-09-18T01:27:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.475+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== watch-notify(notify (1) cookie 94571517139120 notify 150323855412 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7ff040018c10 con 0x560325ae4530 2024-09-18T01:27:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.475+0000 7fef26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855412 cookie 94571517139120 notifier 4895 bl.length()=679 2024-09-18T01:27:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.475+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 notify.4 [notify cookie 94571517396432 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.475+0000 7fef26ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.475+0000 7fef26ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.475+0000 7fef26ffd640 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fef0c003ea0 con 0x560325ae4530 2024-09-18T01:27:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.476+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.476+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== watch-notify(notify_complete (2) cookie 94571517396432 notify 150323855412 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff040018de0 con 0x560325ae4530 2024-09-18T01:27:15.491 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:27:14.265685Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:27:14.265676Z","tags":[],"group_ids":[]} 2024-09-18T01:27:15.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.476+0000 7feefdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.476+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94571517148256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325b2c150 con 0x560325ae4530 2024-09-18T01:27:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.477+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94571517148256] v35'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.477+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94571517123456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325b2c150 con 0x560325ae8f20 2024-09-18T01:27:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.479+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94571517123456] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.479+0000 7ff04bf24800 20 remove_watcher() i=0 2024-09-18T01:27:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.479+0000 7ff04bf24800 2 removed watcher, disabling cache 2024-09-18T01:27:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.479+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94571517127648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325b2c150 con 0x560325ae4530 2024-09-18T01:27:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.480+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94571517127648] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.480+0000 7ff04bf24800 20 remove_watcher() i=1 2024-09-18T01:27:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.480+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94571517128832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325b2c150 con 0x560325aed8d0 2024-09-18T01:27:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.481+0000 7ff03f4df640 1 -- 172.21.15.100:0/1475268520 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94571517128832] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff030037040 con 0x560325aed8d0 2024-09-18T01:27:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.481+0000 7ff04bf24800 20 remove_watcher() i=2 2024-09-18T01:27:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.481+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94571517135488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325b2d6c0 con 0x560325ae8f20 2024-09-18T01:27:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.482+0000 7ff047ce0640 1 -- 172.21.15.100:0/1475268520 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94571517135488] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0380c0030 con 0x560325ae8f20 2024-09-18T01:27:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.482+0000 7ff04bf24800 20 remove_watcher() i=3 2024-09-18T01:27:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.482+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94571517139120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325b2d6c0 con 0x560325ae4530 2024-09-18T01:27:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.483+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94571517139120] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x560325ae4530 2024-09-18T01:27:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.483+0000 7ff04bf24800 20 remove_watcher() i=4 2024-09-18T01:27:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.483+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94571517143120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325b2d6c0 con 0x7ff0380c3060 2024-09-18T01:27:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.484+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94571517143120] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.484+0000 7ff04bf24800 20 remove_watcher() i=5 2024-09-18T01:27:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.484+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94571517141312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325b2d6c0 con 0x7ff0380c3060 2024-09-18T01:27:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.485+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94571517141312] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.485+0000 7ff04bf24800 20 remove_watcher() i=6 2024-09-18T01:27:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.485+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94571517131920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560325b2d6c0 con 0x7ff0380c3060 2024-09-18T01:27:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94571517131920] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff04000a4a0 con 0x7ff0380c3060 2024-09-18T01:27:15.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 20 remove_watcher() i=7 2024-09-18T01:27:15.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff0380c3060 msgr2=0x7ff03807e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7ff0380c3060 0x7ff03807e9b0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560325ae4530 msgr2=0x560325ae69f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x560325ae4530 0x560325ae69f0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560325ae8f20 msgr2=0x560325aeb310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560325ae8f20 0x560325aeb310 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560325aed8d0 msgr2=0x560325aefd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x560325aed8d0 0x560325aefd90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef10036af0 msgr2=0x7fef10038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef10036af0 0x7fef10038fb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x560325ab7c10 tx=0x7ff030010000 comp rx=0 tx=0).stop 2024-09-18T01:27:15.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ad1cf0 msgr2=0x560325ad8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1475268520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ad1cf0 0x560325ad8e10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff038051840 tx=0x7ff038092f20 comp rx=0 tx=0).stop 2024-09-18T01:27:15.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 reap_dead start 2024-09-18T01:27:15.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff0484e1640 1 -- 172.21.15.100:0/1475268520 reap_dead start 2024-09-18T01:27:15.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 shutdown_connections 2024-09-18T01:27:15.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 >> 172.21.15.100:0/1475268520 conn(0x560325ace0a0 msgr2=0x560325acc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 shutdown_connections 2024-09-18T01:27:15.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 -- 172.21.15.100:0/1475268520 wait complete. 2024-09-18T01:27:15.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 -- 172.21.15.100:0/1207403997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef20036b90 msgr2=0x7fef20039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.486+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1207403997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef20036b90 0x7fef20039050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x560325923dc0 tx=0x7ff03000f000 comp rx=0 tx=0).stop 2024-09-18T01:27:15.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 -- 172.21.15.100:0/1207403997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ac55c0 msgr2=0x560325ac59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1207403997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ac55c0 0x560325ac59e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ff038070fd0 tx=0x7ff038064960 comp rx=0 tx=0).stop 2024-09-18T01:27:15.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 -- 172.21.15.100:0/1207403997 shutdown_connections 2024-09-18T01:27:15.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1207403997 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef20036b90 0x7fef20039050 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1207403997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560325ac55c0 0x560325ac59e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 -- 172.21.15.100:0/1207403997 >> 172.21.15.100:0/1207403997 conn(0x560325aba550 msgr2=0x560325abd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 -- 172.21.15.100:0/1207403997 shutdown_connections 2024-09-18T01:27:15.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 -- 172.21.15.100:0/1207403997 wait complete. 2024-09-18T01:27:15.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560325ab4d30 msgr2=0x560325ab7120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x560325ab4d30 0x560325ab7120 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5603259af050 msgr2=0x560325aae550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5603259af050 0x560325aae550 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560325ab0d10 msgr2=0x560325ab3140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x560325ab0d10 0x560325ab3140 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef30036b40 msgr2=0x7fef30039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fef30036b40 0x7fef30039000 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff030000f60 tx=0x7ff030001370 comp rx=0 tx=0).stop 2024-09-18T01:27:15.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 msgr2=0x5603259246e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 --2- 172.21.15.100:0/1243421235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603259ae710 0x5603259246e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ff038067040 tx=0x7ff038002fb0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff0484e1640 1 -- 172.21.15.100:0/1243421235 reap_dead start 2024-09-18T01:27:15.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 shutdown_connections 2024-09-18T01:27:15.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 >> 172.21.15.100:0/1243421235 conn(0x5603259a9fe0 msgr2=0x560325a97b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 shutdown_connections 2024-09-18T01:27:15.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.487+0000 7ff04bf24800 1 -- 172.21.15.100:0/1243421235 wait complete. 2024-09-18T01:27:15.503 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:15.504 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:15.504 ERROR:root:0 2024-09-18T01:27:15.504 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:15.508 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:15.509 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-18T01:27:15.509 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-18T01:27:15.509 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-18T01:27:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.555+0000 7f5240836800 1 Processor -- start 2024-09-18T01:27:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.555+0000 7f5240836800 1 -- start start 2024-09-18T01:27:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.555+0000 7f5240836800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x556c5e1bed40 0x556c5e1c1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.555+0000 7f5240836800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556c5e077b30 con 0x556c5e12bdf0 2024-09-18T01:27:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.555+0000 7f5240836800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x556c5e059360 con 0x556c5e1bed40 2024-09-18T01:27:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.555+0000 7f5233fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x556c5e1bed40 0x556c5e1c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.555+0000 7f523bb52640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x556c5e12bdf0 0x556c5e1bd620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37262/0 (socket says 172.21.15.100:37262) 2024-09-18T01:27:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.555+0000 7f523bb52640 1 -- 172.21.15.100:0/2394487886 learned_addr learned my addr 172.21.15.100:0/2394487886 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.556+0000 7f5233fff640 1 -- 172.21.15.100:0/2394487886 >> v1:172.21.15.92:6789/0 conn(0x556c5e12bdf0 legacy=0x556c5e1bd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.556+0000 7f5233fff640 1 -- 172.21.15.100:0/2394487886 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c5e07fe00 con 0x556c5e1bed40 2024-09-18T01:27:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.557+0000 7f5233fff640 1 --2- 172.21.15.100:0/2394487886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e1bed40 0x556c5e1c1130 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f522400a470 tx=0x7f5224045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42f50fccc21a626 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.558+0000 7f523b351640 1 -- 172.21.15.100:0/2394487886 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5224053570 con 0x556c5e1bed40 2024-09-18T01:27:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.558+0000 7f523b351640 1 -- 172.21.15.100:0/2394487886 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5224058070 con 0x556c5e1bed40 2024-09-18T01:27:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.558+0000 7f523b351640 1 -- 172.21.15.100:0/2394487886 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5224053880 con 0x556c5e1bed40 2024-09-18T01:27:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.558+0000 7f5240836800 1 -- 172.21.15.100:0/2394487886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e1bed40 msgr2=0x556c5e1c1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.558+0000 7f5240836800 1 --2- 172.21.15.100:0/2394487886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e1bed40 0x556c5e1c1130 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f522400a470 tx=0x7f5224045a20 comp rx=0 tx=0).stop 2024-09-18T01:27:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.558+0000 7f5240836800 1 -- 172.21.15.100:0/2394487886 shutdown_connections 2024-09-18T01:27:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.558+0000 7f5240836800 1 --2- 172.21.15.100:0/2394487886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e1bed40 0x556c5e1c1130 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.558+0000 7f5240836800 1 -- 172.21.15.100:0/2394487886 >> 172.21.15.100:0/2394487886 conn(0x556c5e1b2dd0 msgr2=0x556c5e1b51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.558+0000 7f5240836800 1 -- 172.21.15.100:0/2394487886 shutdown_connections 2024-09-18T01:27:15.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.558+0000 7f5240836800 1 -- 172.21.15.100:0/2394487886 wait complete. 2024-09-18T01:27:15.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.572+0000 7f5240836800 1 Processor -- start 2024-09-18T01:27:15.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.572+0000 7f5240836800 1 -- start start 2024-09-18T01:27:15.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.572+0000 7f5240836800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e12bdf0 0x556c5e2a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.572+0000 7f5240836800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556c5e104360 con 0x556c5e12bdf0 2024-09-18T01:27:15.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.572+0000 7f523bb52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e12bdf0 0x556c5e2a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.572+0000 7f523bb52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e12bdf0 0x556c5e2a9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45780/0 (socket says 172.21.15.100:45780) 2024-09-18T01:27:15.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.572+0000 7f523bb52640 1 -- 172.21.15.100:0/2275263355 learned_addr learned my addr 172.21.15.100:0/2275263355 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.573+0000 7f523bb52640 1 -- 172.21.15.100:0/2275263355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c5e051bc0 con 0x556c5e12bdf0 2024-09-18T01:27:15.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.573+0000 7f523bb52640 1 --2- 172.21.15.100:0/2275263355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e12bdf0 0x556c5e2a9b00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f522c001d80 tx=0x7f522c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6a32c1aeaf752 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.573+0000 7f5129e0b640 1 -- 172.21.15.100:0/2275263355 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c013030 con 0x556c5e12bdf0 2024-09-18T01:27:15.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.573+0000 7f5129e0b640 1 -- 172.21.15.100:0/2275263355 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f522c00e470 con 0x556c5e12bdf0 2024-09-18T01:27:15.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.573+0000 7f5129e0b640 1 -- 172.21.15.100:0/2275263355 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c00e810 con 0x556c5e12bdf0 2024-09-18T01:27:15.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.574+0000 7f5240836800 1 -- 172.21.15.100:0/2275263355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e12bdf0 msgr2=0x556c5e2a9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.574+0000 7f5240836800 1 --2- 172.21.15.100:0/2275263355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e12bdf0 0x556c5e2a9b00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f522c001d80 tx=0x7f522c001e70 comp rx=0 tx=0).stop 2024-09-18T01:27:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.574+0000 7f5240836800 1 -- 172.21.15.100:0/2275263355 shutdown_connections 2024-09-18T01:27:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.574+0000 7f5240836800 1 --2- 172.21.15.100:0/2275263355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e12bdf0 0x556c5e2a9b00 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.574+0000 7f5240836800 1 -- 172.21.15.100:0/2275263355 >> 172.21.15.100:0/2275263355 conn(0x556c5e1b2dd0 msgr2=0x556c5e2a54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.574+0000 7f5240836800 1 -- 172.21.15.100:0/2275263355 shutdown_connections 2024-09-18T01:27:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.574+0000 7f5240836800 1 -- 172.21.15.100:0/2275263355 wait complete. 2024-09-18T01:27:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.574+0000 7f5240836800 1 Processor -- start 2024-09-18T01:27:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.574+0000 7f5240836800 1 -- start start 2024-09-18T01:27:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.574+0000 7f5240836800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e12bdf0 0x556c5e2b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.574+0000 7f5240836800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556c5e1c1910 con 0x556c5e12bdf0 2024-09-18T01:27:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.574+0000 7f523bb52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e12bdf0 0x556c5e2b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.574+0000 7f523bb52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e12bdf0 0x556c5e2b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45788/0 (socket says 172.21.15.100:45788) 2024-09-18T01:27:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.574+0000 7f523bb52640 1 -- 172.21.15.100:0/4031415318 learned_addr learned my addr 172.21.15.100:0/4031415318 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.575+0000 7f523bb52640 1 -- 172.21.15.100:0/4031415318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c5e065fe0 con 0x556c5e12bdf0 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.575+0000 7f523bb52640 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e12bdf0 0x556c5e2b1510 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f522c004000 tx=0x7f522c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.575+0000 7f5123fff640 1 -- 172.21.15.100:0/4031415318 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c027070 con 0x556c5e12bdf0 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.575+0000 7f5123fff640 1 -- 172.21.15.100:0/4031415318 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f522c001400 con 0x556c5e12bdf0 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.575+0000 7f5123fff640 1 -- 172.21.15.100:0/4031415318 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c019a70 con 0x556c5e12bdf0 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.575+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c5e2b1a50 con 0x556c5e12bdf0 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.575+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c5e2b1f70 con 0x556c5e12bdf0 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.576+0000 7f5123fff640 1 -- 172.21.15.100:0/4031415318 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f522c02a070 con 0x556c5e12bdf0 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.576+0000 7f5123fff640 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5124036b40 0x7f5124039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.576+0000 7f5123fff640 1 -- 172.21.15.100:0/4031415318 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f522c01f070 con 0x556c5e12bdf0 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.576+0000 7f5233fff640 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5124036b40 0x7f5124039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.576+0000 7f5240836800 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556c5e1bed40 0x556c5e2b8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.576+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2b8b00 con 0x556c5e1bed40 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.576+0000 7f523c353640 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556c5e1bed40 0x556c5e2b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.576+0000 7f5233fff640 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5124036b40 0x7f5124039000 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5224057000 tx=0x7f5224052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.576+0000 7f523c353640 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556c5e1bed40 0x556c5e2b8580 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.577+0000 7f523c353640 1 -- 172.21.15.100:0/4031415318 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e1bed40 2024-09-18T01:27:15.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.577+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2b5b50 con 0x556c5e1bed40 2024-09-18T01:27:15.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.577+0000 7f523c353640 1 -- 172.21.15.100:0/4031415318 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e1bed40 2024-09-18T01:27:15.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.577+0000 7f5240836800 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556c5e2bae50 0x556c5e2bd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.577+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2bd930 con 0x556c5e2bae50 2024-09-18T01:27:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.577+0000 7f523bb52640 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556c5e2bae50 0x556c5e2bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.578+0000 7f523bb52640 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556c5e2bae50 0x556c5e2bd240 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.578+0000 7f523bb52640 1 -- 172.21.15.100:0/4031415318 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f522c029030 con 0x556c5e2bae50 2024-09-18T01:27:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.578+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2b9cf0 con 0x556c5e1bed40 2024-09-18T01:27:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.578+0000 7f523c353640 1 -- 172.21.15.100:0/4031415318 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e1bed40 2024-09-18T01:27:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.578+0000 7f5240836800 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556c5e2bed90 0x556c5e2c1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.578+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2c1880 con 0x556c5e2bed90 2024-09-18T01:27:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.578+0000 7f5233fff640 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556c5e2bed90 0x556c5e2c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.579+0000 7f5233fff640 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556c5e2bed90 0x556c5e2c1180 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.579+0000 7f5233fff640 1 -- 172.21.15.100:0/4031415318 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2bed90 2024-09-18T01:27:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.579+0000 7f5240836800 1 Processor -- start 2024-09-18T01:27:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.579+0000 7f5240836800 1 -- start start 2024-09-18T01:27:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.580+0000 7f5240836800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2cf5f0 0x556c5e2cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.580+0000 7f5240836800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556c5e053580 con 0x556c5e2cf5f0 2024-09-18T01:27:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.580+0000 7f523bb52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2cf5f0 0x556c5e2cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.580+0000 7f523bb52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2cf5f0 0x556c5e2cfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45804/0 (socket says 172.21.15.100:45804) 2024-09-18T01:27:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.580+0000 7f523bb52640 1 -- 172.21.15.100:0/3657871424 learned_addr learned my addr 172.21.15.100:0/3657871424 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.580+0000 7f523bb52640 1 -- 172.21.15.100:0/3657871424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c5e2cff50 con 0x556c5e2cf5f0 2024-09-18T01:27:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.580+0000 7f523bb52640 1 --2- 172.21.15.100:0/3657871424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2cf5f0 0x556c5e2cfa10 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f522c04b070 tx=0x7f522c044f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.580+0000 7f51217fa640 1 -- 172.21.15.100:0/3657871424 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c039070 con 0x556c5e2cf5f0 2024-09-18T01:27:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.580+0000 7f51217fa640 1 -- 172.21.15.100:0/3657871424 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f522c0166a0 con 0x556c5e2cf5f0 2024-09-18T01:27:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.580+0000 7f5240836800 1 -- 172.21.15.100:0/3657871424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c5e2d01e0 con 0x556c5e2cf5f0 2024-09-18T01:27:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.580+0000 7f51217fa640 1 -- 172.21.15.100:0/3657871424 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c016980 con 0x556c5e2cf5f0 2024-09-18T01:27:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.580+0000 7f5240836800 1 -- 172.21.15.100:0/3657871424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c5e2d2ec0 con 0x556c5e2cf5f0 2024-09-18T01:27:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.581+0000 7f51217fa640 1 -- 172.21.15.100:0/3657871424 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f522c03c070 con 0x556c5e2cf5f0 2024-09-18T01:27:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.581+0000 7f51217fa640 1 --2- 172.21.15.100:0/3657871424 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5114036b40 0x7f5114039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.581+0000 7f51217fa640 1 -- 172.21.15.100:0/3657871424 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f522c014070 con 0x556c5e2cf5f0 2024-09-18T01:27:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.581+0000 7f5233fff640 1 --2- 172.21.15.100:0/3657871424 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5114036b40 0x7f5114039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.582+0000 7f5240836800 1 Processor -- start 2024-09-18T01:27:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.582+0000 7f5233fff640 1 --2- 172.21.15.100:0/3657871424 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5114036b40 0x7f5114039000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x556c5e2b9400 tx=0x7f5224005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.582+0000 7f5240836800 1 -- start start 2024-09-18T01:27:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.582+0000 7f5240836800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2dc0f0 0x556c5e2dc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.582+0000 7f5240836800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556c5e2aa2b0 con 0x556c5e2dc0f0 2024-09-18T01:27:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.582+0000 7f523bb52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2dc0f0 0x556c5e2dc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.582+0000 7f523bb52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2dc0f0 0x556c5e2dc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45812/0 (socket says 172.21.15.100:45812) 2024-09-18T01:27:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.582+0000 7f523bb52640 1 -- 172.21.15.100:0/3415116922 learned_addr learned my addr 172.21.15.100:0/3415116922 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.582+0000 7f523bb52640 1 -- 172.21.15.100:0/3415116922 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c5e2dcac0 con 0x556c5e2dc0f0 2024-09-18T01:27:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.583+0000 7f523bb52640 1 --2- 172.21.15.100:0/3415116922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2dc0f0 0x556c5e2dc4f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f522c019640 tx=0x7f522c021370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14459b887ab62567 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.583+0000 7f511affd640 1 -- 172.21.15.100:0/3415116922 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c057040 con 0x556c5e2dc0f0 2024-09-18T01:27:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.583+0000 7f511affd640 1 -- 172.21.15.100:0/3415116922 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f522c021730 con 0x556c5e2dc0f0 2024-09-18T01:27:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.583+0000 7f511affd640 1 -- 172.21.15.100:0/3415116922 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c00c6e0 con 0x556c5e2dc0f0 2024-09-18T01:27:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.583+0000 7f5240836800 1 -- 172.21.15.100:0/3415116922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2dc0f0 msgr2=0x556c5e2dc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.583+0000 7f5240836800 1 --2- 172.21.15.100:0/3415116922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2dc0f0 0x556c5e2dc4f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f522c019640 tx=0x7f522c021370 comp rx=0 tx=0).stop 2024-09-18T01:27:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.583+0000 7f5240836800 1 -- 172.21.15.100:0/3415116922 shutdown_connections 2024-09-18T01:27:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.583+0000 7f5240836800 1 --2- 172.21.15.100:0/3415116922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2dc0f0 0x556c5e2dc4f0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.583+0000 7f5240836800 1 -- 172.21.15.100:0/3415116922 >> 172.21.15.100:0/3415116922 conn(0x556c5e2d8450 msgr2=0x556c5e2d6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.583+0000 7f5240836800 1 -- 172.21.15.100:0/3415116922 shutdown_connections 2024-09-18T01:27:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.583+0000 7f5240836800 1 -- 172.21.15.100:0/3415116922 wait complete. 2024-09-18T01:27:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.583+0000 7f5240836800 1 Processor -- start 2024-09-18T01:27:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.583+0000 7f5240836800 1 -- start start 2024-09-18T01:27:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.584+0000 7f5240836800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2dc0f0 0x556c5e2e3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.584+0000 7f5240836800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556c5e2dd080 con 0x556c5e2dc0f0 2024-09-18T01:27:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.584+0000 7f523bb52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2dc0f0 0x556c5e2e3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.584+0000 7f523bb52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2dc0f0 0x556c5e2e3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45824/0 (socket says 172.21.15.100:45824) 2024-09-18T01:27:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.584+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 learned_addr learned my addr 172.21.15.100:0/2489145871 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.584+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c5e2e3890 con 0x556c5e2dc0f0 2024-09-18T01:27:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.584+0000 7f523bb52640 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2dc0f0 0x556c5e2e3350 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f522c0213b0 tx=0x7f522c032e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.584+0000 7f51197fa640 1 -- 172.21.15.100:0/2489145871 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c02dd70 con 0x556c5e2dc0f0 2024-09-18T01:27:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.584+0000 7f51197fa640 1 -- 172.21.15.100:0/2489145871 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f522c02b3b0 con 0x556c5e2dc0f0 2024-09-18T01:27:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.584+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c5e2e3890 con 0x556c5e2dc0f0 2024-09-18T01:27:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.584+0000 7f51197fa640 1 -- 172.21.15.100:0/2489145871 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c04c340 con 0x556c5e2dc0f0 2024-09-18T01:27:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.584+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c5e2e3890 con 0x556c5e2dc0f0 2024-09-18T01:27:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.585+0000 7f51197fa640 1 -- 172.21.15.100:0/2489145871 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f522c062030 con 0x556c5e2dc0f0 2024-09-18T01:27:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.585+0000 7f51197fa640 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5104036b40 0x7f5104039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.585+0000 7f51197fa640 1 -- 172.21.15.100:0/2489145871 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f522c060020 con 0x556c5e2dc0f0 2024-09-18T01:27:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.585+0000 7f5233fff640 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5104036b40 0x7f5104039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.586+0000 7f5233fff640 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5104036b40 0x7f5104039000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5224045a60 tx=0x7f5224053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.586+0000 7f5240836800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.586+0000 7f5240836800 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556c5e2eea70 0x556c5e2f0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.586+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f1680 con 0x556c5e2eea70 2024-09-18T01:27:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.586+0000 7f523c353640 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556c5e2eea70 0x556c5e2f0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.586+0000 7f523c353640 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556c5e2eea70 0x556c5e2f0f30 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 20 realm 2024-09-18T01:27:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f1a90 con 0x556c5e2eea70 2024-09-18T01:27:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2360 con 0x556c5e2eea70 2024-09-18T01:27:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2eea70 2024-09-18T01:27:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556c5e2f3460 0x556c5e2f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.587+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f5e60 con 0x556c5e2f3460 2024-09-18T01:27:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.588+0000 7f523bb52640 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556c5e2f3460 0x556c5e2f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.588+0000 7f523bb52640 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556c5e2f3460 0x556c5e2f5850 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.588+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.588+0000 7f5240836800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.588+0000 7f5240836800 20 searching for the correct realm 2024-09-18T01:27:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.588+0000 7f5240836800 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556c5e2f7df0 0x556c5e2fa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.588+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fa980 con 0x556c5e2f7df0 2024-09-18T01:27:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.588+0000 7f5233fff640 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556c5e2f7df0 0x556c5e2fa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.588+0000 7f5233fff640 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556c5e2f7df0 0x556c5e2fa2b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.589+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2f7df0 2024-09-18T01:27:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.589+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fa980 con 0x556c5e2f3460 2024-09-18T01:27:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.589+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.589+0000 7f523bb52640 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f522c021b70 0x7f522c06f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.589+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fa980 con 0x7f522c021b70 2024-09-18T01:27:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.589+0000 7f523c353640 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f522c021b70 0x7f522c06f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.589+0000 7f523c353640 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f522c021b70 0x7f522c06f820 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.590+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.590+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2eea70 2024-09-18T01:27:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.590+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.590+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2eea70 2024-09-18T01:27:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.590+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.590+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x7f522c021b70 2024-09-18T01:27:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.590+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.590+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x7f522c021b70 2024-09-18T01:27:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.591+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.591+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f3460 2024-09-18T01:27:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.591+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.591+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f7df0 2024-09-18T01:27:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.591+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2f7df0 2024-09-18T01:27:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.591+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2eea70 2024-09-18T01:27:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.591+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.591+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f3460 2024-09-18T01:27:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.592+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.592+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2eea70 2024-09-18T01:27:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.592+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.592+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f3460 2024-09-18T01:27:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.592+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.592+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f7df0 2024-09-18T01:27:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.592+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2f7df0 2024-09-18T01:27:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.592+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f7df0 2024-09-18T01:27:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.592+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2f7df0 2024-09-18T01:27:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.592+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x7f522c021b70 2024-09-18T01:27:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.593+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.593+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f7df0 2024-09-18T01:27:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.593+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2f7df0 2024-09-18T01:27:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.593+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f7df0 2024-09-18T01:27:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.593+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2f7df0 2024-09-18T01:27:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.593+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2eea70 2024-09-18T01:27:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.593+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.593+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2eea70 2024-09-18T01:27:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.594+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.594+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x7f522c021b70 2024-09-18T01:27:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.594+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.594+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f7df0 2024-09-18T01:27:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.595+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2f7df0 2024-09-18T01:27:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.595+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f3460 2024-09-18T01:27:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.595+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.595+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2eea70 2024-09-18T01:27:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.595+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.595+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x7f522c021b70 2024-09-18T01:27:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.595+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.595+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f7df0 2024-09-18T01:27:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.596+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2f7df0 2024-09-18T01:27:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.596+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f3460 2024-09-18T01:27:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.596+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.596+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f3460 2024-09-18T01:27:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.596+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.596+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f7df0 2024-09-18T01:27:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.596+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2f7df0 2024-09-18T01:27:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.596+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x7f522c021b70 2024-09-18T01:27:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2eea70 2024-09-18T01:27:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f2700 con 0x556c5e2f3460 2024-09-18T01:27:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f5240836800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f5240836800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f5240836800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f5240836800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f5240836800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f5240836800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f5240836800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f6720 con 0x556c5e2eea70 2024-09-18T01:27:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f5240836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f5240836800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.597+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f6b10 con 0x556c5e2eea70 2024-09-18T01:27:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2f6b10 con 0x7f522c021b70 2024-09-18T01:27:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 20 zone default found 2024-09-18T01:27:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 4 Realm: () 2024-09-18T01:27:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 20 zonegroup default 2024-09-18T01:27:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fae00 con 0x7f522c021b70 2024-09-18T01:27:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fc7e0 con 0x556c5e2f7df0 2024-09-18T01:27:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2f7df0 2024-09-18T01:27:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.598+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fcb80 con 0x556c5e2f7df0 2024-09-18T01:27:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.599+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2f7df0 2024-09-18T01:27:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.599+0000 7f5240836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.599+0000 7f5240836800 20 started sync module instance, tier type = 2024-09-18T01:27:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.599+0000 7f5240836800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.599+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fbc80 con 0x556c5e2f3460 2024-09-18T01:27:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.600+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.600+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93923925016736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fd3d0 con 0x556c5e2f3460 2024-09-18T01:27:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.600+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fdc20 con 0x556c5e2eea70 2024-09-18T01:27:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.601+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.601+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93923925022576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fe040 con 0x556c5e2eea70 2024-09-18T01:27:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.601+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2feb60 con 0x556c5e2f7df0 2024-09-18T01:27:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.601+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93923925016736] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.602+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2f7df0 2024-09-18T01:27:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.602+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93923925026352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fef50 con 0x556c5e2f7df0 2024-09-18T01:27:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.602+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2ff970 con 0x556c5e2f3460 2024-09-18T01:27:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.602+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93923925022576] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.603+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.603+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93923925029984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2ffd90 con 0x556c5e2f3460 2024-09-18T01:27:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.603+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e3007b0 con 0x556c5e2eea70 2024-09-18T01:27:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.603+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93923925026352] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2f7df0 2024-09-18T01:27:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.604+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.604+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93923925033632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e300770 con 0x556c5e2eea70 2024-09-18T01:27:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.604+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e3011c0 con 0x7f522c021b70 2024-09-18T01:27:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.604+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93923925029984] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.605+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93923925033632] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.605+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.605+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93923925020448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e300d10 con 0x7f522c021b70 2024-09-18T01:27:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.605+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e3016d0 con 0x7f522c021b70 2024-09-18T01:27:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.606+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93923925020448] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.606+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.606+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93923925023632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e3016d0 con 0x7f522c021b70 2024-09-18T01:27:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.606+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e302090 con 0x7f522c021b70 2024-09-18T01:27:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.607+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(58 notify.7 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.607+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93923925023632] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.607+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93923925040096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e3024b0 con 0x7f522c021b70 2024-09-18T01:27:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.607+0000 7f5240836800 20 add_watcher() i=0 2024-09-18T01:27:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.607+0000 7f5240836800 20 add_watcher() i=1 2024-09-18T01:27:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.607+0000 7f5240836800 20 add_watcher() i=2 2024-09-18T01:27:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.607+0000 7f5240836800 20 add_watcher() i=3 2024-09-18T01:27:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.607+0000 7f5240836800 20 add_watcher() i=4 2024-09-18T01:27:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.607+0000 7f5240836800 20 add_watcher() i=5 2024-09-18T01:27:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.607+0000 7f5240836800 20 add_watcher() i=6 2024-09-18T01:27:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.608+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93923925040096] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.608+0000 7f5240836800 20 add_watcher() i=7 2024-09-18T01:27:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.608+0000 7f5240836800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.608+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e3054e0 con 0x556c5e2eea70 2024-09-18T01:27:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.609+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.609+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93923925041152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e302970 con 0x556c5e2eea70 2024-09-18T01:27:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.610+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93923925041152] v35'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.610+0000 7f50f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.610+0000 7f5240836800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.610+0000 7f5240836800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.610+0000 7f5240836800 5 note: GC not initialized 2024-09-18T01:27:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.610+0000 7f50f0fe1640 20 reqs_thread_entry: start 2024-09-18T01:27:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.610+0000 7f5240836800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.610+0000 7f5240836800 20 Filter name: none 2024-09-18T01:27:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.610+0000 7f506a7fc640 20 reqs_thread_entry: start 2024-09-18T01:27:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.610+0000 7f5240836800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:27:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.610+0000 7f5240836800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.610+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e338770 con 0x7f522c021b70 2024-09-18T01:27:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.611+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.611+0000 7f5240836800 20 rados_obj.operate() r=0 bl.length=503 2024-09-18T01:27:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.611+0000 7f5240836800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:27:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.611+0000 7f5240836800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.611+0000 7f5240836800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:27:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.611+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e33f220 con 0x7f522c021b70 2024-09-18T01:27:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.612+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v35'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.612+0000 7f5240836800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.612+0000 7f5240836800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.612+0000 7f5240836800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:27:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.612+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93923925289952 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556c5e33a820 con 0x556c5e2eea70 2024-09-18T01:27:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.613+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== watch-notify(notify (1) cookie 93923925033632 notify 150323855413 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f5234026410 con 0x556c5e2eea70 2024-09-18T01:27:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.613+0000 7f511affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855413 cookie 93923925033632 notifier 4902 bl.length()=636 2024-09-18T01:27:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.613+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 notify.4 [notify cookie 93923925289952 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.613+0000 7f511affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:15.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.613+0000 7f511affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.613+0000 7f511affd640 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f5100003ea0 con 0x556c5e2eea70 2024-09-18T01:27:15.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.613+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.613+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== watch-notify(notify_complete (2) cookie 93923925289952 notify 150323855413 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f52340265e0 con 0x556c5e2eea70 2024-09-18T01:27:15.627 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:27:14.265685Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:27:14.265676Z","tags":[],"group_ids":[]} 2024-09-18T01:27:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.614+0000 7f50f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.614+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93923925041152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e3364c0 con 0x556c5e2eea70 2024-09-18T01:27:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.615+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93923925041152] v35'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.615+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93923925016736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e3364c0 con 0x556c5e2f3460 2024-09-18T01:27:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.616+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93923925016736] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.616+0000 7f5240836800 20 remove_watcher() i=0 2024-09-18T01:27:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.616+0000 7f5240836800 2 removed watcher, disabling cache 2024-09-18T01:27:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.616+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93923925022576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e3364c0 con 0x556c5e2eea70 2024-09-18T01:27:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.617+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93923925022576] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.617+0000 7f5240836800 20 remove_watcher() i=1 2024-09-18T01:27:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.617+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93923925026352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e3364c0 con 0x556c5e2f7df0 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.618+0000 7f5233fff640 1 -- 172.21.15.100:0/2489145871 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93923925026352] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5224051070 con 0x556c5e2f7df0 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.618+0000 7f5240836800 20 remove_watcher() i=2 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.618+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93923925029984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fc0a0 con 0x556c5e2f3460 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.619+0000 7f523bb52640 1 -- 172.21.15.100:0/2489145871 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93923925029984] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c03b030 con 0x556c5e2f3460 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.619+0000 7f5240836800 20 remove_watcher() i=3 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.619+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93923925033632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fd770 con 0x556c5e2eea70 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.620+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93923925033632] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x556c5e2eea70 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.620+0000 7f5240836800 20 remove_watcher() i=4 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.620+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93923925020448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2ff460 con 0x7f522c021b70 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.621+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93923925020448] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.621+0000 7f5240836800 20 remove_watcher() i=5 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.621+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93923925023632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fc0a0 con 0x7f522c021b70 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.622+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93923925023632] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.622+0000 7f5240836800 20 remove_watcher() i=6 2024-09-18T01:27:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.622+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93923925040096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556c5e2fcf20 con 0x7f522c021b70 2024-09-18T01:27:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93923925040096] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x7f522c021b70 2024-09-18T01:27:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 20 remove_watcher() i=7 2024-09-18T01:27:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f522c021b70 msgr2=0x7f522c06f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f522c021b70 0x7f522c06f820 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556c5e2eea70 msgr2=0x556c5e2f0f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556c5e2eea70 0x556c5e2f0f30 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556c5e2f3460 msgr2=0x556c5e2f5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556c5e2f3460 0x556c5e2f5850 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556c5e2f7df0 msgr2=0x556c5e2fa2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x556c5e2f7df0 0x556c5e2fa2b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5104036b40 msgr2=0x7f5104039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5104036b40 0x7f5104039000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5224045a60 tx=0x7f5224053000 comp rx=0 tx=0).stop 2024-09-18T01:27:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2dc0f0 msgr2=0x556c5e2e3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f523c353640 1 -- 172.21.15.100:0/2489145871 reap_dead start 2024-09-18T01:27:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2dc0f0 0x556c5e2e3350 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f522c0213b0 tx=0x7f522c032e80 comp rx=0 tx=0).stop 2024-09-18T01:27:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 shutdown_connections 2024-09-18T01:27:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 --2- 172.21.15.100:0/2489145871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2dc0f0 0x556c5e2e3350 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 >> 172.21.15.100:0/2489145871 conn(0x556c5e2d8450 msgr2=0x556c5e2d6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 shutdown_connections 2024-09-18T01:27:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.623+0000 7f5240836800 1 -- 172.21.15.100:0/2489145871 wait complete. 2024-09-18T01:27:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/3657871424 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5114036b40 msgr2=0x7f5114039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 --2- 172.21.15.100:0/3657871424 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5114036b40 0x7f5114039000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x556c5e2b9400 tx=0x7f5224005a00 comp rx=0 tx=0).stop 2024-09-18T01:27:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/3657871424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2cf5f0 msgr2=0x556c5e2cfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 --2- 172.21.15.100:0/3657871424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2cf5f0 0x556c5e2cfa10 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f522c04b070 tx=0x7f522c044f10 comp rx=0 tx=0).stop 2024-09-18T01:27:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/3657871424 shutdown_connections 2024-09-18T01:27:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 --2- 172.21.15.100:0/3657871424 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5114036b40 0x7f5114039000 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 --2- 172.21.15.100:0/3657871424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e2cf5f0 0x556c5e2cfa10 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/3657871424 >> 172.21.15.100:0/3657871424 conn(0x556c5e2c4580 msgr2=0x556c5e2c7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/3657871424 shutdown_connections 2024-09-18T01:27:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/3657871424 wait complete. 2024-09-18T01:27:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556c5e2bed90 msgr2=0x556c5e2c1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x556c5e2bed90 0x556c5e2c1180 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556c5e1bed40 msgr2=0x556c5e2b8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x556c5e1bed40 0x556c5e2b8580 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556c5e2bae50 msgr2=0x556c5e2bd240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x556c5e2bae50 0x556c5e2bd240 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5124036b40 msgr2=0x7f5124039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f5124036b40 0x7f5124039000 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5224057000 tx=0x7f5224052000 comp rx=0 tx=0).stop 2024-09-18T01:27:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e12bdf0 msgr2=0x556c5e2b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 --2- 172.21.15.100:0/4031415318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c5e12bdf0 0x556c5e2b1510 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f522c004000 tx=0x7f522c000bc0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f523c353640 1 -- 172.21.15.100:0/4031415318 reap_dead start 2024-09-18T01:27:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 shutdown_connections 2024-09-18T01:27:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 >> 172.21.15.100:0/4031415318 conn(0x556c5e1b2dd0 msgr2=0x556c5e2a3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 shutdown_connections 2024-09-18T01:27:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.624+0000 7f5240836800 1 -- 172.21.15.100:0/4031415318 wait complete. 2024-09-18T01:27:15.639 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:15.639 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:15.639 ERROR:root:0 2024-09-18T01:27:15.639 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-18T01:27:15.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-18T01:27:15.640 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-18T01:27:15.686 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:15.686 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:15.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.686+0000 7f9ca0135800 1 Processor -- start 2024-09-18T01:27:15.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.686+0000 7f9ca0135800 1 -- start start 2024-09-18T01:27:15.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.686+0000 7f9ca0135800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x56122361f920 0x561223621d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.686+0000 7f9ca0135800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5612234dbb30 con 0x56122361b4e0 2024-09-18T01:27:15.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.686+0000 7f9ca0135800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x5612234bd360 con 0x56122361f920 2024-09-18T01:27:15.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.686+0000 7f9c9beee640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x56122361b4e0 0x56122361b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37276/0 (socket says 172.21.15.100:37276) 2024-09-18T01:27:15.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.686+0000 7f9c9beee640 1 -- 172.21.15.100:0/3407448830 learned_addr learned my addr 172.21.15.100:0/3407448830 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:15.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.686+0000 7f9c9b6ed640 1 --2- 172.21.15.100:0/3407448830 >> v2:172.21.15.92:3300/0 conn(0x56122361f920 0x561223621d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.686+0000 7f9c9aeec640 1 -- 172.21.15.100:0/3407448830 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081203090 0 0) 0x5612234dbb30 con 0x56122361b4e0 2024-09-18T01:27:15.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.686+0000 7f9c9aeec640 1 -- 172.21.15.100:0/3407448830 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c84001e10 con 0x56122361b4e0 2024-09-18T01:27:15.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.686+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3407448830 >> v1:172.21.15.92:6789/0 conn(0x56122361b4e0 legacy=0x56122361b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.686+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3407448830 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612234e3e00 con 0x56122361f920 2024-09-18T01:27:15.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.688+0000 7f9c9b6ed640 1 --2- 172.21.15.100:0/3407448830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361f920 0x561223621d10 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000a470 tx=0x7f9c90045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2200840617b5e1e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.689+0000 7f9c9aeec640 1 -- 172.21.15.100:0/3407448830 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c90059070 con 0x56122361f920 2024-09-18T01:27:15.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.689+0000 7f9c9aeec640 1 -- 172.21.15.100:0/3407448830 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c90054570 con 0x56122361f920 2024-09-18T01:27:15.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.689+0000 7f9c9aeec640 1 -- 172.21.15.100:0/3407448830 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c90054870 con 0x56122361f920 2024-09-18T01:27:15.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.689+0000 7f9ca0135800 1 -- 172.21.15.100:0/3407448830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361f920 msgr2=0x561223621d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.689+0000 7f9ca0135800 1 --2- 172.21.15.100:0/3407448830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361f920 0x561223621d10 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000a470 tx=0x7f9c90045920 comp rx=0 tx=0).stop 2024-09-18T01:27:15.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.689+0000 7f9ca0135800 1 -- 172.21.15.100:0/3407448830 shutdown_connections 2024-09-18T01:27:15.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.689+0000 7f9ca0135800 1 --2- 172.21.15.100:0/3407448830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361f920 0x561223621d10 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.689+0000 7f9ca0135800 1 -- 172.21.15.100:0/3407448830 >> 172.21.15.100:0/3407448830 conn(0x561223616db0 msgr2=0x5612236191d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.689+0000 7f9ca0135800 1 -- 172.21.15.100:0/3407448830 shutdown_connections 2024-09-18T01:27:15.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.689+0000 7f9ca0135800 1 -- 172.21.15.100:0/3407448830 wait complete. 2024-09-18T01:27:15.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.703+0000 7f9ca0135800 1 Processor -- start 2024-09-18T01:27:15.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.703+0000 7f9ca0135800 1 -- start start 2024-09-18T01:27:15.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.703+0000 7f9ca0135800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361b4e0 0x5612235905c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.703+0000 7f9ca0135800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561223568360 con 0x56122361b4e0 2024-09-18T01:27:15.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.703+0000 7f9c9beee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361b4e0 0x5612235905c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.703+0000 7f9c9beee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361b4e0 0x5612235905c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45838/0 (socket says 172.21.15.100:45838) 2024-09-18T01:27:15.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.703+0000 7f9c9beee640 1 -- 172.21.15.100:0/3267626303 learned_addr learned my addr 172.21.15.100:0/3267626303 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.704+0000 7f9c9beee640 1 -- 172.21.15.100:0/3267626303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612234b5bc0 con 0x56122361b4e0 2024-09-18T01:27:15.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.704+0000 7f9c9beee640 1 --2- 172.21.15.100:0/3267626303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361b4e0 0x5612235905c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c001e30 tx=0x7f9c8c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c83c7ea4d6ef74 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.704+0000 7f9b89e0b640 1 -- 172.21.15.100:0/3267626303 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8c012020 con 0x56122361b4e0 2024-09-18T01:27:15.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.704+0000 7f9b89e0b640 1 -- 172.21.15.100:0/3267626303 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8c00e5a0 con 0x56122361b4e0 2024-09-18T01:27:15.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.704+0000 7f9b89e0b640 1 -- 172.21.15.100:0/3267626303 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8c00e8e0 con 0x56122361b4e0 2024-09-18T01:27:15.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.705+0000 7f9ca0135800 1 -- 172.21.15.100:0/3267626303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361b4e0 msgr2=0x5612235905c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.705+0000 7f9ca0135800 1 --2- 172.21.15.100:0/3267626303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361b4e0 0x5612235905c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c001e30 tx=0x7f9c8c00b780 comp rx=0 tx=0).stop 2024-09-18T01:27:15.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.705+0000 7f9ca0135800 1 -- 172.21.15.100:0/3267626303 shutdown_connections 2024-09-18T01:27:15.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.705+0000 7f9ca0135800 1 --2- 172.21.15.100:0/3267626303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361b4e0 0x5612235905c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.705+0000 7f9ca0135800 1 -- 172.21.15.100:0/3267626303 >> 172.21.15.100:0/3267626303 conn(0x561223616db0 msgr2=0x561223705fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.705+0000 7f9ca0135800 1 -- 172.21.15.100:0/3267626303 shutdown_connections 2024-09-18T01:27:15.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.705+0000 7f9ca0135800 1 -- 172.21.15.100:0/3267626303 wait complete. 2024-09-18T01:27:15.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.705+0000 7f9ca0135800 1 Processor -- start 2024-09-18T01:27:15.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.705+0000 7f9ca0135800 1 -- start start 2024-09-18T01:27:15.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.705+0000 7f9ca0135800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361b4e0 0x561223713160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.705+0000 7f9ca0135800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561223622550 con 0x56122361b4e0 2024-09-18T01:27:15.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.705+0000 7f9c9beee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361b4e0 0x561223713160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.705+0000 7f9c9beee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361b4e0 0x561223713160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45854/0 (socket says 172.21.15.100:45854) 2024-09-18T01:27:15.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.705+0000 7f9c9beee640 1 -- 172.21.15.100:0/4204017799 learned_addr learned my addr 172.21.15.100:0/4204017799 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.706+0000 7f9c9beee640 1 -- 172.21.15.100:0/4204017799 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612234c9fe0 con 0x56122361b4e0 2024-09-18T01:27:15.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.706+0000 7f9c9beee640 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361b4e0 0x561223713160 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c001e30 tx=0x7f9c8c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.706+0000 7f9b83fff640 1 -- 172.21.15.100:0/4204017799 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8c012030 con 0x56122361b4e0 2024-09-18T01:27:15.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.706+0000 7f9b83fff640 1 -- 172.21.15.100:0/4204017799 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8c01a7a0 con 0x56122361b4e0 2024-09-18T01:27:15.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.706+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612237136a0 con 0x56122361b4e0 2024-09-18T01:27:15.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.706+0000 7f9b83fff640 1 -- 172.21.15.100:0/4204017799 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8c01aaa0 con 0x56122361b4e0 2024-09-18T01:27:15.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.706+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561223713bc0 con 0x56122361b4e0 2024-09-18T01:27:15.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.707+0000 7f9b83fff640 1 -- 172.21.15.100:0/4204017799 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9c8c015020 con 0x56122361b4e0 2024-09-18T01:27:15.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.707+0000 7f9b83fff640 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b84036b40 0x7f9b84039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.707+0000 7f9b83fff640 1 -- 172.21.15.100:0/4204017799 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f9c8c020030 con 0x56122361b4e0 2024-09-18T01:27:15.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.707+0000 7f9c9b6ed640 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b84036b40 0x7f9b84039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.707+0000 7f9ca0135800 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56122361f920 0x56122371a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.707+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56122371a710 con 0x56122361f920 2024-09-18T01:27:15.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.707+0000 7f9c9c6ef640 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56122361f920 0x56122371a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.707+0000 7f9c9b6ed640 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b84036b40 0x7f9b84039000 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x56122361c2e0 tx=0x7f9c90050000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.708+0000 7f9c9c6ef640 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56122361f920 0x56122371a1d0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.708+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/4204017799 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x56122361f920 2024-09-18T01:27:15.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.708+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612237177a0 con 0x56122361f920 2024-09-18T01:27:15.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.708+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/4204017799 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c9400a4a0 con 0x56122361f920 2024-09-18T01:27:15.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.708+0000 7f9ca0135800 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56122371ca60 0x56122371ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.708+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56122371f4f0 con 0x56122371ca60 2024-09-18T01:27:15.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.708+0000 7f9c9beee640 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56122371ca60 0x56122371ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.709+0000 7f9c9beee640 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56122371ca60 0x56122371ee50 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.709+0000 7f9c9beee640 1 -- 172.21.15.100:0/4204017799 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9c8c00dcd0 con 0x56122371ca60 2024-09-18T01:27:15.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.709+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56122371b900 con 0x56122361f920 2024-09-18T01:27:15.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.709+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/4204017799 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c9400a4a0 con 0x56122361f920 2024-09-18T01:27:15.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.709+0000 7f9ca0135800 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x561223720950 0x561223722d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.709+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561223723440 con 0x561223720950 2024-09-18T01:27:15.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.709+0000 7f9c9b6ed640 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x561223720950 0x561223722d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.710+0000 7f9c9b6ed640 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x561223720950 0x561223722d40 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.710+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/4204017799 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9c9005c040 con 0x561223720950 2024-09-18T01:27:15.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.710+0000 7f9ca0135800 1 Processor -- start 2024-09-18T01:27:15.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.710+0000 7f9ca0135800 1 -- start start 2024-09-18T01:27:15.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.710+0000 7f9ca0135800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612237311f0 0x561223731610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.710+0000 7f9ca0135800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5612234b7580 con 0x5612237311f0 2024-09-18T01:27:15.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.711+0000 7f9c9beee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612237311f0 0x561223731610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.711+0000 7f9c9beee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612237311f0 0x561223731610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45856/0 (socket says 172.21.15.100:45856) 2024-09-18T01:27:15.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.711+0000 7f9c9beee640 1 -- 172.21.15.100:0/4175521029 learned_addr learned my addr 172.21.15.100:0/4175521029 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.711+0000 7f9c9beee640 1 -- 172.21.15.100:0/4175521029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561223731b50 con 0x5612237311f0 2024-09-18T01:27:15.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.711+0000 7f9c9beee640 1 --2- 172.21.15.100:0/4175521029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612237311f0 0x561223731610 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c018a00 tx=0x7f9c8c02db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.711+0000 7f9b817fa640 1 -- 172.21.15.100:0/4175521029 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8c03a070 con 0x5612237311f0 2024-09-18T01:27:15.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.711+0000 7f9b817fa640 1 -- 172.21.15.100:0/4175521029 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8c02d3f0 con 0x5612237311f0 2024-09-18T01:27:15.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.711+0000 7f9ca0135800 1 -- 172.21.15.100:0/4175521029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561223731de0 con 0x5612237311f0 2024-09-18T01:27:15.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.711+0000 7f9b817fa640 1 -- 172.21.15.100:0/4175521029 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8c017e60 con 0x5612237311f0 2024-09-18T01:27:15.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.711+0000 7f9ca0135800 1 -- 172.21.15.100:0/4175521029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561223734ac0 con 0x5612237311f0 2024-09-18T01:27:15.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.712+0000 7f9b817fa640 1 -- 172.21.15.100:0/4175521029 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9c8c03d070 con 0x5612237311f0 2024-09-18T01:27:15.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.712+0000 7f9b817fa640 1 --2- 172.21.15.100:0/4175521029 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b74036b90 0x7f9b74039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.712+0000 7f9b817fa640 1 -- 172.21.15.100:0/4175521029 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f9c8c047050 con 0x5612237311f0 2024-09-18T01:27:15.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.712+0000 7f9c9b6ed640 1 --2- 172.21.15.100:0/4175521029 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b74036b90 0x7f9b74039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.712+0000 7f9ca0135800 1 Processor -- start 2024-09-18T01:27:15.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.712+0000 7f9ca0135800 1 -- start start 2024-09-18T01:27:15.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.713+0000 7f9c9b6ed640 1 --2- 172.21.15.100:0/4175521029 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b74036b90 0x7f9b74039050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x5612237176c0 tx=0x7f9c90005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.713+0000 7f9ca0135800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122373dc60 0x56122373e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.713+0000 7f9ca0135800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56122370e600 con 0x56122373dc60 2024-09-18T01:27:15.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.713+0000 7f9c9beee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122373dc60 0x56122373e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.713+0000 7f9c9beee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122373dc60 0x56122373e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45862/0 (socket says 172.21.15.100:45862) 2024-09-18T01:27:15.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.713+0000 7f9c9beee640 1 -- 172.21.15.100:0/2920570302 learned_addr learned my addr 172.21.15.100:0/2920570302 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.713+0000 7f9c9beee640 1 -- 172.21.15.100:0/2920570302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56122373e630 con 0x56122373dc60 2024-09-18T01:27:15.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.713+0000 7f9c9beee640 1 --2- 172.21.15.100:0/2920570302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122373dc60 0x56122373e060 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c044530 tx=0x7f9c8c03f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8607e622490e40da server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.713+0000 7f9b7affd640 1 -- 172.21.15.100:0/2920570302 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8c05f020 con 0x56122373dc60 2024-09-18T01:27:15.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.714+0000 7f9b7affd640 1 -- 172.21.15.100:0/2920570302 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8c00c570 con 0x56122373dc60 2024-09-18T01:27:15.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.714+0000 7f9b7affd640 1 -- 172.21.15.100:0/2920570302 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8c044910 con 0x56122373dc60 2024-09-18T01:27:15.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.714+0000 7f9ca0135800 1 -- 172.21.15.100:0/2920570302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122373dc60 msgr2=0x56122373e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.714+0000 7f9ca0135800 1 --2- 172.21.15.100:0/2920570302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122373dc60 0x56122373e060 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c044530 tx=0x7f9c8c03f5f0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.714+0000 7f9ca0135800 1 -- 172.21.15.100:0/2920570302 shutdown_connections 2024-09-18T01:27:15.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.714+0000 7f9ca0135800 1 --2- 172.21.15.100:0/2920570302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122373dc60 0x56122373e060 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.714+0000 7f9ca0135800 1 -- 172.21.15.100:0/2920570302 >> 172.21.15.100:0/2920570302 conn(0x56122373a010 msgr2=0x561223738110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.714+0000 7f9ca0135800 1 -- 172.21.15.100:0/2920570302 shutdown_connections 2024-09-18T01:27:15.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.714+0000 7f9ca0135800 1 -- 172.21.15.100:0/2920570302 wait complete. 2024-09-18T01:27:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.714+0000 7f9ca0135800 1 Processor -- start 2024-09-18T01:27:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.714+0000 7f9ca0135800 1 -- start start 2024-09-18T01:27:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.715+0000 7f9ca0135800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122373dc60 0x561223744f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.715+0000 7f9ca0135800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56122373ea80 con 0x56122373dc60 2024-09-18T01:27:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.715+0000 7f9c9beee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122373dc60 0x561223744f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.715+0000 7f9c9beee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122373dc60 0x561223744f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45874/0 (socket says 172.21.15.100:45874) 2024-09-18T01:27:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.715+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 learned_addr learned my addr 172.21.15.100:0/3226215289 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.715+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561223745440 con 0x56122373dc60 2024-09-18T01:27:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.715+0000 7f9c9beee640 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122373dc60 0x561223744f00 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009740 tx=0x7f9c8c00dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.715+0000 7f9b797fa640 1 -- 172.21.15.100:0/3226215289 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8c073070 con 0x56122373dc60 2024-09-18T01:27:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.715+0000 7f9b797fa640 1 -- 172.21.15.100:0/3226215289 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8c0247f0 con 0x56122373dc60 2024-09-18T01:27:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.715+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561223745440 con 0x56122373dc60 2024-09-18T01:27:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.715+0000 7f9b797fa640 1 -- 172.21.15.100:0/3226215289 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8c024ad0 con 0x56122373dc60 2024-09-18T01:27:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.715+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561223745440 con 0x56122373dc60 2024-09-18T01:27:15.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.716+0000 7f9b797fa640 1 -- 172.21.15.100:0/3226215289 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9c8c076070 con 0x56122373dc60 2024-09-18T01:27:15.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.716+0000 7f9b797fa640 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b64036b90 0x7f9b64039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.717+0000 7f9b797fa640 1 -- 172.21.15.100:0/3226215289 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f9c8c06b050 con 0x56122373dc60 2024-09-18T01:27:15.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.717+0000 7f9c9b6ed640 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b64036b90 0x7f9b64039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.717+0000 7f9c9b6ed640 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b64036b90 0x7f9b64039050 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9c90054fd0 tx=0x7f9c90062040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.717+0000 7f9ca0135800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.717+0000 7f9ca0135800 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561223750690 0x561223752b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.717+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612237532a0 con 0x561223750690 2024-09-18T01:27:15.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.717+0000 7f9c9c6ef640 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561223750690 0x561223752b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9c9c6ef640 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561223750690 0x561223752b50 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9ca0135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9ca0135800 20 realm 2024-09-18T01:27:15.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9ca0135800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612237536b0 con 0x561223750690 2024-09-18T01:27:15.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9ca0135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9ca0135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:15.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9ca0135800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561223753f80 con 0x561223750690 2024-09-18T01:27:15.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9ca0135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9ca0135800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.718+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223750690 2024-09-18T01:27:15.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.719+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.719+0000 7f9ca0135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:15.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.719+0000 7f9ca0135800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.719+0000 7f9ca0135800 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561223755080 0x561223757470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.719+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561223757a80 con 0x561223755080 2024-09-18T01:27:15.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.719+0000 7f9c9beee640 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561223755080 0x561223757470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.719+0000 7f9c9beee640 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561223755080 0x561223757470 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.719+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.719+0000 7f9ca0135800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:15.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.719+0000 7f9ca0135800 20 searching for the correct realm 2024-09-18T01:27:15.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.719+0000 7f9ca0135800 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x561223759a30 0x56122375bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.719+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56122375c5c0 con 0x561223759a30 2024-09-18T01:27:15.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.719+0000 7f9c9b6ed640 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x561223759a30 0x56122375bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.720+0000 7f9c9b6ed640 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x561223759a30 0x56122375bef0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.720+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c90072030 con 0x561223759a30 2024-09-18T01:27:15.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.720+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56122375c5c0 con 0x561223755080 2024-09-18T01:27:15.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.720+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.720+0000 7f9c9beee640 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9c8c078060 0x7f9c8c04c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.720+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56122375c5c0 con 0x7f9c8c078060 2024-09-18T01:27:15.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.720+0000 7f9c9c6ef640 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9c8c078060 0x7f9c8c04c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.721+0000 7f9c9c6ef640 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9c8c078060 0x7f9c8c04c060 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.721+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.721+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223750690 2024-09-18T01:27:15.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.721+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.721+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223750690 2024-09-18T01:27:15.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.721+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.721+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x7f9c8c078060 2024-09-18T01:27:15.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.722+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.722+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x7f9c8c078060 2024-09-18T01:27:15.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.722+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.722+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223755080 2024-09-18T01:27:15.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.722+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.722+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223759a30 2024-09-18T01:27:15.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.723+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c90072030 con 0x561223759a30 2024-09-18T01:27:15.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.723+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223750690 2024-09-18T01:27:15.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.723+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.723+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223755080 2024-09-18T01:27:15.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.723+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.723+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223750690 2024-09-18T01:27:15.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.723+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.723+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223755080 2024-09-18T01:27:15.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.724+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.724+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223759a30 2024-09-18T01:27:15.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.724+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c90072030 con 0x561223759a30 2024-09-18T01:27:15.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.724+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223759a30 2024-09-18T01:27:15.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.724+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c90072030 con 0x561223759a30 2024-09-18T01:27:15.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.724+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x7f9c8c078060 2024-09-18T01:27:15.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.724+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.724+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223759a30 2024-09-18T01:27:15.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.725+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c90072030 con 0x561223759a30 2024-09-18T01:27:15.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.725+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223759a30 2024-09-18T01:27:15.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.725+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c90072030 con 0x561223759a30 2024-09-18T01:27:15.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.725+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223750690 2024-09-18T01:27:15.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.725+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.725+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223750690 2024-09-18T01:27:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.725+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.725+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x7f9c8c078060 2024-09-18T01:27:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.726+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.726+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223759a30 2024-09-18T01:27:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.726+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c90072030 con 0x561223759a30 2024-09-18T01:27:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.726+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223755080 2024-09-18T01:27:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.726+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.726+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223750690 2024-09-18T01:27:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.726+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.726+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x7f9c8c078060 2024-09-18T01:27:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.726+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.726+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223759a30 2024-09-18T01:27:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.727+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c90072030 con 0x561223759a30 2024-09-18T01:27:15.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.727+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223755080 2024-09-18T01:27:15.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.727+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.727+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223755080 2024-09-18T01:27:15.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.727+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.727+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223759a30 2024-09-18T01:27:15.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.727+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c90072030 con 0x561223759a30 2024-09-18T01:27:15.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.727+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x7f9c8c078060 2024-09-18T01:27:15.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223750690 2024-09-18T01:27:15.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561223754320 con 0x561223755080 2024-09-18T01:27:15.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9ca0135800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:15.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9ca0135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:15.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9ca0135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:15.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9ca0135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:15.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9ca0135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:15.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9ca0135800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:15.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9ca0135800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561223758340 con 0x561223750690 2024-09-18T01:27:15.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9ca0135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9ca0135800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.728+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561223758730 con 0x561223750690 2024-09-18T01:27:15.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:15.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561223758730 con 0x7f9c8c078060 2024-09-18T01:27:15.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:15.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 20 zone default found 2024-09-18T01:27:15.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 4 Realm: () 2024-09-18T01:27:15.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:15.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:15.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:15.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 20 zonegroup default 2024-09-18T01:27:15.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561223757ef0 con 0x7f9c8c078060 2024-09-18T01:27:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.729+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56122375e420 con 0x561223759a30 2024-09-18T01:27:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.730+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c90072030 con 0x561223759a30 2024-09-18T01:27:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.730+0000 7f9ca0135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.730+0000 7f9ca0135800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.730+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56122375e7c0 con 0x561223759a30 2024-09-18T01:27:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.730+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c90072030 con 0x561223759a30 2024-09-18T01:27:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.730+0000 7f9ca0135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.730+0000 7f9ca0135800 20 started sync module instance, tier type = 2024-09-18T01:27:15.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.730+0000 7f9ca0135800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:15.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.730+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56122375d8c0 con 0x561223755080 2024-09-18T01:27:15.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.731+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.731+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94635904324624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56122375eb60 con 0x561223755080 2024-09-18T01:27:15.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.731+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56122375f3f0 con 0x561223750690 2024-09-18T01:27:15.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.732+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94635904324624] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.732+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.732+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94635904326832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56122375f7e0 con 0x561223750690 2024-09-18T01:27:15.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.732+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223760200 con 0x561223759a30 2024-09-18T01:27:15.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.733+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c90072030 con 0x561223759a30 2024-09-18T01:27:15.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.733+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94635904335088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223760ad0 con 0x561223759a30 2024-09-18T01:27:15.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.733+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223761590 con 0x561223755080 2024-09-18T01:27:15.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.733+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94635904326832] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.734+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94635904335088] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c90072030 con 0x561223759a30 2024-09-18T01:27:15.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.734+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.734+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94635904337440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56122375ef00 con 0x561223755080 2024-09-18T01:27:15.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.734+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223761e60 con 0x561223750690 2024-09-18T01:27:15.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.735+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94635904337440] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.735+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.735+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94635904340160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223761e60 con 0x561223750690 2024-09-18T01:27:15.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.735+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223762870 con 0x7f9c8c078060 2024-09-18T01:27:15.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.736+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94635904340160] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.736+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.736+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94635904345504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223761e60 con 0x7f9c8c078060 2024-09-18T01:27:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.736+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223763280 con 0x7f9c8c078060 2024-09-18T01:27:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.737+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94635904345504] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.738+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.738+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94635904342448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223763460 con 0x7f9c8c078060 2024-09-18T01:27:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.738+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223763cb0 con 0x7f9c8c078060 2024-09-18T01:27:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.738+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94635904342448] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.739+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.739+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94635904348560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223763b00 con 0x7f9c8c078060 2024-09-18T01:27:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.739+0000 7f9ca0135800 20 add_watcher() i=0 2024-09-18T01:27:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.739+0000 7f9ca0135800 20 add_watcher() i=1 2024-09-18T01:27:15.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.739+0000 7f9ca0135800 20 add_watcher() i=2 2024-09-18T01:27:15.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.739+0000 7f9ca0135800 20 add_watcher() i=3 2024-09-18T01:27:15.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.739+0000 7f9ca0135800 20 add_watcher() i=4 2024-09-18T01:27:15.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.739+0000 7f9ca0135800 20 add_watcher() i=5 2024-09-18T01:27:15.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.739+0000 7f9ca0135800 20 add_watcher() i=6 2024-09-18T01:27:15.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.739+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94635904348560] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.740+0000 7f9ca0135800 20 add_watcher() i=7 2024-09-18T01:27:15.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.740+0000 7f9ca0135800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:15.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.740+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561223767070 con 0x561223750690 2024-09-18T01:27:15.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.740+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.740+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94635904349616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223764560 con 0x561223750690 2024-09-18T01:27:15.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.741+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94635904349616] v35'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.741+0000 7f9b51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.741+0000 7f9ca0135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.741+0000 7f9ca0135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.741+0000 7f9ca0135800 5 note: GC not initialized 2024-09-18T01:27:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.741+0000 7f9b50fe1640 20 reqs_thread_entry: start 2024-09-18T01:27:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.741+0000 7f9ca0135800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.742+0000 7f9ca0135800 20 Filter name: none 2024-09-18T01:27:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.742+0000 7f9aca7fc640 20 reqs_thread_entry: start 2024-09-18T01:27:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.742+0000 7f9ca0135800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:27:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.742+0000 7f9ca0135800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.742+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56122379a500 con 0x7f9c8c078060 2024-09-18T01:27:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.742+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.742+0000 7f9ca0135800 20 rados_obj.operate() r=0 bl.length=460 2024-09-18T01:27:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.742+0000 7f9ca0135800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:27:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.742+0000 7f9ca0135800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.742+0000 7f9ca0135800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:27:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.743+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612237a0bc0 con 0x7f9c8c078060 2024-09-18T01:27:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.744+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v35'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.744+0000 7f9ca0135800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.744+0000 7f9ca0135800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.744+0000 7f9ca0135800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:27:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.744+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94635904599424 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56122379c220 con 0x561223750690 2024-09-18T01:27:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.744+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== watch-notify(notify (1) cookie 94635904340160 notify 150323855414 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f9c94026410 con 0x561223750690 2024-09-18T01:27:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.744+0000 7f9b7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855414 cookie 94635904340160 notifier 4909 bl.length()=666 2024-09-18T01:27:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.744+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 notify.4 [notify cookie 94635904599424 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.744+0000 7f9b7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:15.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.744+0000 7f9b7affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.744+0000 7f9b7affd640 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f9b60003ea0 con 0x561223750690 2024-09-18T01:27:15.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.744+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.744+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== watch-notify(notify_complete (2) cookie 94635904599424 notify 150323855414 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9c940265e0 con 0x561223750690 2024-09-18T01:27:15.759 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:27:14.265685Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:27:14.265676Z","tags":[],"group_ids":[]} 2024-09-18T01:27:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.745+0000 7f9b51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.745+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94635904349616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223798220 con 0x561223750690 2024-09-18T01:27:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.746+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94635904349616] v35'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.746+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94635904324624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223798220 con 0x561223755080 2024-09-18T01:27:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.747+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94635904324624] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.747+0000 7f9ca0135800 20 remove_watcher() i=0 2024-09-18T01:27:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.747+0000 7f9ca0135800 2 removed watcher, disabling cache 2024-09-18T01:27:15.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.747+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94635904326832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223798220 con 0x561223750690 2024-09-18T01:27:15.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.749+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94635904326832] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.749+0000 7f9ca0135800 20 remove_watcher() i=1 2024-09-18T01:27:15.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.749+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94635904335088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223798220 con 0x561223759a30 2024-09-18T01:27:15.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.750+0000 7f9c9b6ed640 1 -- 172.21.15.100:0/3226215289 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94635904335088] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c90072030 con 0x561223759a30 2024-09-18T01:27:15.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.750+0000 7f9ca0135800 20 remove_watcher() i=2 2024-09-18T01:27:15.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.750+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94635904337440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223799780 con 0x561223755080 2024-09-18T01:27:15.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.750+0000 7f9c9beee640 1 -- 172.21.15.100:0/3226215289 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94635904337440] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c8c075030 con 0x561223755080 2024-09-18T01:27:15.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.750+0000 7f9ca0135800 20 remove_watcher() i=3 2024-09-18T01:27:15.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.750+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94635904340160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223799780 con 0x561223750690 2024-09-18T01:27:15.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.752+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94635904340160] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x561223750690 2024-09-18T01:27:15.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.752+0000 7f9ca0135800 20 remove_watcher() i=4 2024-09-18T01:27:15.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.752+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94635904345504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223799780 con 0x7f9c8c078060 2024-09-18T01:27:15.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.753+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94635904345504] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.753+0000 7f9ca0135800 20 remove_watcher() i=5 2024-09-18T01:27:15.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.753+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94635904342448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561223799780 con 0x7f9c8c078060 2024-09-18T01:27:15.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.754+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94635904342448] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.754+0000 7f9ca0135800 20 remove_watcher() i=6 2024-09-18T01:27:15.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.754+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94635904348560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56122375dcb0 con 0x7f9c8c078060 2024-09-18T01:27:15.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94635904348560] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c9400a4a0 con 0x7f9c8c078060 2024-09-18T01:27:15.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 20 remove_watcher() i=7 2024-09-18T01:27:15.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9c8c078060 msgr2=0x7f9c8c04c060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9c8c078060 0x7f9c8c04c060 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561223750690 msgr2=0x561223752b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x561223750690 0x561223752b50 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561223755080 msgr2=0x561223757470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x561223755080 0x561223757470 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x561223759a30 msgr2=0x56122375bef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x561223759a30 0x56122375bef0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b64036b90 msgr2=0x7f9b64039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b64036b90 0x7f9b64039050 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9c90054fd0 tx=0x7f9c90062040 comp rx=0 tx=0).stop 2024-09-18T01:27:15.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122373dc60 msgr2=0x561223744f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/3226215289 reap_dead start 2024-09-18T01:27:15.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122373dc60 0x561223744f00 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009740 tx=0x7f9c8c00dbf0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 shutdown_connections 2024-09-18T01:27:15.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 --2- 172.21.15.100:0/3226215289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122373dc60 0x561223744f00 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 >> 172.21.15.100:0/3226215289 conn(0x56122373a010 msgr2=0x5612237380e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 shutdown_connections 2024-09-18T01:27:15.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.755+0000 7f9ca0135800 1 -- 172.21.15.100:0/3226215289 wait complete. 2024-09-18T01:27:15.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4175521029 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b74036b90 msgr2=0x7f9b74039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 --2- 172.21.15.100:0/4175521029 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b74036b90 0x7f9b74039050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x5612237176c0 tx=0x7f9c90005a00 comp rx=0 tx=0).stop 2024-09-18T01:27:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4175521029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612237311f0 msgr2=0x561223731610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 --2- 172.21.15.100:0/4175521029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612237311f0 0x561223731610 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c018a00 tx=0x7f9c8c02db90 comp rx=0 tx=0).stop 2024-09-18T01:27:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4175521029 shutdown_connections 2024-09-18T01:27:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 --2- 172.21.15.100:0/4175521029 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b74036b90 0x7f9b74039050 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 --2- 172.21.15.100:0/4175521029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612237311f0 0x561223731610 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4175521029 >> 172.21.15.100:0/4175521029 conn(0x561223726180 msgr2=0x561223728d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4175521029 shutdown_connections 2024-09-18T01:27:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4175521029 wait complete. 2024-09-18T01:27:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x561223720950 msgr2=0x561223722d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x561223720950 0x561223722d40 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56122361f920 msgr2=0x56122371a1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x56122361f920 0x56122371a1d0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56122371ca60 msgr2=0x56122371ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x56122371ca60 0x56122371ee50 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b84036b40 msgr2=0x7f9b84039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9b84036b40 0x7f9b84039000 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x56122361c2e0 tx=0x7f9c90050000 comp rx=0 tx=0).stop 2024-09-18T01:27:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361b4e0 msgr2=0x561223713160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 --2- 172.21.15.100:0/4204017799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122361b4e0 0x561223713160 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c001e30 tx=0x7f9c8c000ed0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9c9c6ef640 1 -- 172.21.15.100:0/4204017799 reap_dead start 2024-09-18T01:27:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 shutdown_connections 2024-09-18T01:27:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 >> 172.21.15.100:0/4204017799 conn(0x561223616db0 msgr2=0x5612237048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 shutdown_connections 2024-09-18T01:27:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.756+0000 7f9ca0135800 1 -- 172.21.15.100:0/4204017799 wait complete. 2024-09-18T01:27:15.772 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:15.772 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:15.772 ERROR:root:0 2024-09-18T01:27:15.772 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:15.777 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx0000065b41c8310a8f76e-0066ea2c73-4237-default', 'HostId': '4237-default-default'} 2024-09-18T01:27:15.777 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-18T01:27:15.778 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-18T01:27:15.778 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-18T01:27:15.824 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:15.824 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:15.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.824+0000 7fd63cf26800 1 Processor -- start 2024-09-18T01:27:15.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.824+0000 7fd63cf26800 1 -- start start 2024-09-18T01:27:15.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.824+0000 7fd63cf26800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x563f2572d920 0x563f2572fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.824+0000 7fd63cf26800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563f255e9b30 con 0x563f257294e0 2024-09-18T01:27:15.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.824+0000 7fd63cf26800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x563f255cb360 con 0x563f2572d920 2024-09-18T01:27:15.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.824+0000 7fd6303e2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x563f2572d920 0x563f2572fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.824+0000 7fd6303e2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x563f2572d920 0x563f2572fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45888/0 (socket says 172.21.15.100:45888) 2024-09-18T01:27:15.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.824+0000 7fd638be3640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x563f257294e0 0x563f257298e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37290/0 (socket says 172.21.15.100:37290) 2024-09-18T01:27:15.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.824+0000 7fd6303e2640 1 -- 172.21.15.100:0/2804938747 learned_addr learned my addr 172.21.15.100:0/2804938747 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.824+0000 7fd6303e2640 1 -- 172.21.15.100:0/2804938747 >> v1:172.21.15.92:6789/0 conn(0x563f257294e0 legacy=0x563f257298e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.824+0000 7fd6303e2640 1 -- 172.21.15.100:0/2804938747 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f255f1e00 con 0x563f2572d920 2024-09-18T01:27:15.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.826+0000 7fd6303e2640 1 --2- 172.21.15.100:0/2804938747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2572d920 0x563f2572fd10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd62000a520 tx=0x7fd620045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3645ea59f72286fc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.826+0000 7fd633fff640 1 -- 172.21.15.100:0/2804938747 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd620055070 con 0x563f2572d920 2024-09-18T01:27:15.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.826+0000 7fd633fff640 1 -- 172.21.15.100:0/2804938747 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6200515b0 con 0x563f2572d920 2024-09-18T01:27:15.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.826+0000 7fd633fff640 1 -- 172.21.15.100:0/2804938747 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6200518d0 con 0x563f2572d920 2024-09-18T01:27:15.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.827+0000 7fd63cf26800 1 -- 172.21.15.100:0/2804938747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2572d920 msgr2=0x563f2572fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.827+0000 7fd63cf26800 1 --2- 172.21.15.100:0/2804938747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2572d920 0x563f2572fd10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd62000a520 tx=0x7fd620045ba0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.827+0000 7fd63cf26800 1 -- 172.21.15.100:0/2804938747 shutdown_connections 2024-09-18T01:27:15.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.827+0000 7fd63cf26800 1 --2- 172.21.15.100:0/2804938747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2572d920 0x563f2572fd10 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.827+0000 7fd63cf26800 1 -- 172.21.15.100:0/2804938747 >> 172.21.15.100:0/2804938747 conn(0x563f25724dd0 msgr2=0x563f257271f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.827+0000 7fd63cf26800 1 -- 172.21.15.100:0/2804938747 shutdown_connections 2024-09-18T01:27:15.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.827+0000 7fd63cf26800 1 -- 172.21.15.100:0/2804938747 wait complete. 2024-09-18T01:27:15.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.840+0000 7fd63cf26800 1 Processor -- start 2024-09-18T01:27:15.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.840+0000 7fd63cf26800 1 -- start start 2024-09-18T01:27:15.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.841+0000 7fd63cf26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f257294e0 0x563f258187d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.841+0000 7fd63cf26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563f25676360 con 0x563f257294e0 2024-09-18T01:27:15.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.841+0000 7fd638be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f257294e0 0x563f258187d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.841+0000 7fd638be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f257294e0 0x563f258187d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45894/0 (socket says 172.21.15.100:45894) 2024-09-18T01:27:15.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.841+0000 7fd638be3640 1 -- 172.21.15.100:0/1772244515 learned_addr learned my addr 172.21.15.100:0/1772244515 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.841+0000 7fd638be3640 1 -- 172.21.15.100:0/1772244515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f255c3bc0 con 0x563f257294e0 2024-09-18T01:27:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.841+0000 7fd638be3640 1 --2- 172.21.15.100:0/1772244515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f257294e0 0x563f258187d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd62800b230 tx=0x7fd62800b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de61e6056104c2b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.841+0000 7fd526e0d640 1 -- 172.21.15.100:0/1772244515 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd62800e5c0 con 0x563f257294e0 2024-09-18T01:27:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.842+0000 7fd526e0d640 1 -- 172.21.15.100:0/1772244515 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd628006070 con 0x563f257294e0 2024-09-18T01:27:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.842+0000 7fd526e0d640 1 -- 172.21.15.100:0/1772244515 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd62800e890 con 0x563f257294e0 2024-09-18T01:27:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.842+0000 7fd63cf26800 1 -- 172.21.15.100:0/1772244515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f257294e0 msgr2=0x563f258187d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.842+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1772244515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f257294e0 0x563f258187d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd62800b230 tx=0x7fd62800b6f0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.842+0000 7fd63cf26800 1 -- 172.21.15.100:0/1772244515 shutdown_connections 2024-09-18T01:27:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.842+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1772244515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f257294e0 0x563f258187d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.842+0000 7fd63cf26800 1 -- 172.21.15.100:0/1772244515 >> 172.21.15.100:0/1772244515 conn(0x563f25724dd0 msgr2=0x563f25814190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.842+0000 7fd63cf26800 1 -- 172.21.15.100:0/1772244515 shutdown_connections 2024-09-18T01:27:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.842+0000 7fd63cf26800 1 -- 172.21.15.100:0/1772244515 wait complete. 2024-09-18T01:27:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.843+0000 7fd63cf26800 1 Processor -- start 2024-09-18T01:27:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.843+0000 7fd63cf26800 1 -- start start 2024-09-18T01:27:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.843+0000 7fd63cf26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f257294e0 0x563f2581f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.843+0000 7fd63cf26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563f25730550 con 0x563f257294e0 2024-09-18T01:27:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.843+0000 7fd638be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f257294e0 0x563f2581f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.843+0000 7fd638be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f257294e0 0x563f2581f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45908/0 (socket says 172.21.15.100:45908) 2024-09-18T01:27:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.843+0000 7fd638be3640 1 -- 172.21.15.100:0/973447585 learned_addr learned my addr 172.21.15.100:0/973447585 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.843+0000 7fd638be3640 1 -- 172.21.15.100:0/973447585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f255d7fe0 con 0x563f257294e0 2024-09-18T01:27:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.844+0000 7fd638be3640 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f257294e0 0x563f2581f0f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd628000c00 tx=0x7fd628000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.844+0000 7fd52560a640 1 -- 172.21.15.100:0/973447585 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd62800f8d0 con 0x563f257294e0 2024-09-18T01:27:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.844+0000 7fd52560a640 1 -- 172.21.15.100:0/973447585 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd62800fa90 con 0x563f257294e0 2024-09-18T01:27:15.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.844+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f2581f630 con 0x563f257294e0 2024-09-18T01:27:15.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.844+0000 7fd52560a640 1 -- 172.21.15.100:0/973447585 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd62800fdb0 con 0x563f257294e0 2024-09-18T01:27:15.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.844+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f2581fb50 con 0x563f257294e0 2024-09-18T01:27:15.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.844+0000 7fd52560a640 1 -- 172.21.15.100:0/973447585 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd628017070 con 0x563f257294e0 2024-09-18T01:27:15.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.845+0000 7fd52560a640 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd520038da0 0x7fd52003b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.845+0000 7fd52560a640 1 -- 172.21.15.100:0/973447585 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd628015020 con 0x563f257294e0 2024-09-18T01:27:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.845+0000 7fd6303e2640 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd520038da0 0x7fd52003b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.845+0000 7fd63cf26800 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563f2572d920 0x563f25826160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.845+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f258266e0 con 0x563f2572d920 2024-09-18T01:27:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.845+0000 7fd6393e4640 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563f2572d920 0x563f25826160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.845+0000 7fd6303e2640 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd520038da0 0x7fd52003b260 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd620057000 tx=0x7fd620052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.845+0000 7fd6393e4640 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563f2572d920 0x563f25826160 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.846+0000 7fd6393e4640 1 -- 172.21.15.100:0/973447585 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f2572d920 2024-09-18T01:27:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.846+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f25823730 con 0x563f2572d920 2024-09-18T01:27:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.846+0000 7fd6393e4640 1 -- 172.21.15.100:0/973447585 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f2572d920 2024-09-18T01:27:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.846+0000 7fd63cf26800 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563f25828a30 0x563f2582ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.846+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f2582b510 con 0x563f25828a30 2024-09-18T01:27:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.846+0000 7fd638be3640 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563f25828a30 0x563f2582ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.846+0000 7fd638be3640 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563f25828a30 0x563f2582ae20 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.847+0000 7fd638be3640 1 -- 172.21.15.100:0/973447585 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd62802e070 con 0x563f25828a30 2024-09-18T01:27:15.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.847+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f258278d0 con 0x563f2572d920 2024-09-18T01:27:15.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.847+0000 7fd6393e4640 1 -- 172.21.15.100:0/973447585 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f2572d920 2024-09-18T01:27:15.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.847+0000 7fd63cf26800 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563f2582c970 0x563f2582ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.847+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f2582f460 con 0x563f2582c970 2024-09-18T01:27:15.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.847+0000 7fd6303e2640 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563f2582c970 0x563f2582ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.847+0000 7fd6303e2640 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563f2582c970 0x563f2582ed60 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.848+0000 7fd6303e2640 1 -- 172.21.15.100:0/973447585 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd620057030 con 0x563f2582c970 2024-09-18T01:27:15.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.848+0000 7fd63cf26800 1 Processor -- start 2024-09-18T01:27:15.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.848+0000 7fd63cf26800 1 -- start start 2024-09-18T01:27:15.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.848+0000 7fd63cf26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f258415e0 0x563f25841a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.848+0000 7fd63cf26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563f255c5580 con 0x563f258415e0 2024-09-18T01:27:15.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.848+0000 7fd638be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f258415e0 0x563f25841a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.848+0000 7fd638be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f258415e0 0x563f25841a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45924/0 (socket says 172.21.15.100:45924) 2024-09-18T01:27:15.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.848+0000 7fd638be3640 1 -- 172.21.15.100:0/1224645645 learned_addr learned my addr 172.21.15.100:0/1224645645 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.849+0000 7fd638be3640 1 -- 172.21.15.100:0/1224645645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f25841f40 con 0x563f258415e0 2024-09-18T01:27:15.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.849+0000 7fd638be3640 1 --2- 172.21.15.100:0/1224645645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f258415e0 0x563f25841a00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd62804b8b0 tx=0x7fd62804d480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.849+0000 7fd51e7fc640 1 -- 172.21.15.100:0/1224645645 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd62804a420 con 0x563f258415e0 2024-09-18T01:27:15.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.849+0000 7fd51e7fc640 1 -- 172.21.15.100:0/1224645645 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6280179a0 con 0x563f258415e0 2024-09-18T01:27:15.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.849+0000 7fd63cf26800 1 -- 172.21.15.100:0/1224645645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f258421d0 con 0x563f258415e0 2024-09-18T01:27:15.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.849+0000 7fd51e7fc640 1 -- 172.21.15.100:0/1224645645 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd628017c80 con 0x563f258415e0 2024-09-18T01:27:15.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.849+0000 7fd63cf26800 1 -- 172.21.15.100:0/1224645645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f258421d0 con 0x563f258415e0 2024-09-18T01:27:15.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.850+0000 7fd51e7fc640 1 -- 172.21.15.100:0/1224645645 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd62801a480 con 0x563f258415e0 2024-09-18T01:27:15.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.850+0000 7fd51e7fc640 1 --2- 172.21.15.100:0/1224645645 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd510036b90 0x7fd510039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.850+0000 7fd51e7fc640 1 -- 172.21.15.100:0/1224645645 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd62803cd40 con 0x563f258415e0 2024-09-18T01:27:15.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.850+0000 7fd6303e2640 1 --2- 172.21.15.100:0/1224645645 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd510036b90 0x7fd510039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.850+0000 7fd63cf26800 1 Processor -- start 2024-09-18T01:27:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.850+0000 7fd63cf26800 1 -- start start 2024-09-18T01:27:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.850+0000 7fd6303e2640 1 --2- 172.21.15.100:0/1224645645 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd510036b90 0x7fd510039050 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd620005570 tx=0x7fd620005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.850+0000 7fd63cf26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2584de80 0x563f2584e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.850+0000 7fd63cf26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563f25818f50 con 0x563f2584de80 2024-09-18T01:27:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.851+0000 7fd638be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2584de80 0x563f2584e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.851+0000 7fd638be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2584de80 0x563f2584e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45930/0 (socket says 172.21.15.100:45930) 2024-09-18T01:27:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.851+0000 7fd638be3640 1 -- 172.21.15.100:0/3931805164 learned_addr learned my addr 172.21.15.100:0/3931805164 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.851+0000 7fd638be3640 1 -- 172.21.15.100:0/3931805164 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f2584e850 con 0x563f2584de80 2024-09-18T01:27:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.851+0000 7fd638be3640 1 --2- 172.21.15.100:0/3931805164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2584de80 0x563f2584e280 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd628045530 tx=0x7fd628048b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614755a49f739b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.851+0000 7fd50ffff640 1 -- 172.21.15.100:0/3931805164 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd62805c020 con 0x563f2584de80 2024-09-18T01:27:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.851+0000 7fd50ffff640 1 -- 172.21.15.100:0/3931805164 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd628048860 con 0x563f2584de80 2024-09-18T01:27:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.851+0000 7fd50ffff640 1 -- 172.21.15.100:0/3931805164 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd628048ca0 con 0x563f2584de80 2024-09-18T01:27:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.852+0000 7fd63cf26800 1 -- 172.21.15.100:0/3931805164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2584de80 msgr2=0x563f2584e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.852+0000 7fd63cf26800 1 --2- 172.21.15.100:0/3931805164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2584de80 0x563f2584e280 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd628045530 tx=0x7fd628048b30 comp rx=0 tx=0).stop 2024-09-18T01:27:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.852+0000 7fd63cf26800 1 -- 172.21.15.100:0/3931805164 shutdown_connections 2024-09-18T01:27:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.852+0000 7fd63cf26800 1 --2- 172.21.15.100:0/3931805164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2584de80 0x563f2584e280 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.852+0000 7fd63cf26800 1 -- 172.21.15.100:0/3931805164 >> 172.21.15.100:0/3931805164 conn(0x563f2584a270 msgr2=0x563f25848370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.852+0000 7fd63cf26800 1 -- 172.21.15.100:0/3931805164 shutdown_connections 2024-09-18T01:27:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.852+0000 7fd63cf26800 1 -- 172.21.15.100:0/3931805164 wait complete. 2024-09-18T01:27:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.852+0000 7fd63cf26800 1 Processor -- start 2024-09-18T01:27:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.852+0000 7fd63cf26800 1 -- start start 2024-09-18T01:27:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.852+0000 7fd63cf26800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2584de80 0x563f25855160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.852+0000 7fd63cf26800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563f2584ece0 con 0x563f2584de80 2024-09-18T01:27:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.852+0000 7fd638be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2584de80 0x563f25855160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.852+0000 7fd638be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2584de80 0x563f25855160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45944/0 (socket says 172.21.15.100:45944) 2024-09-18T01:27:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.852+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 learned_addr learned my addr 172.21.15.100:0/1876845070 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.853+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f258556a0 con 0x563f2584de80 2024-09-18T01:27:15.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.853+0000 7fd638be3640 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2584de80 0x563f25855160 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd628000fd0 tx=0x7fd628014f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.853+0000 7fd50e7fc640 1 -- 172.21.15.100:0/1876845070 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd628071070 con 0x563f2584de80 2024-09-18T01:27:15.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.853+0000 7fd50e7fc640 1 -- 172.21.15.100:0/1876845070 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd628017e20 con 0x563f2584de80 2024-09-18T01:27:15.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.853+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f258556a0 con 0x563f2584de80 2024-09-18T01:27:15.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.853+0000 7fd50e7fc640 1 -- 172.21.15.100:0/1876845070 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd628044ee0 con 0x563f2584de80 2024-09-18T01:27:15.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.853+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f258556a0 con 0x563f2584de80 2024-09-18T01:27:15.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.854+0000 7fd50e7fc640 1 -- 172.21.15.100:0/1876845070 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd628074070 con 0x563f2584de80 2024-09-18T01:27:15.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.854+0000 7fd50e7fc640 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd504036b40 0x7fd504039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.854+0000 7fd50e7fc640 1 -- 172.21.15.100:0/1876845070 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd628068030 con 0x563f2584de80 2024-09-18T01:27:15.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.854+0000 7fd6303e2640 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd504036b40 0x7fd504039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.854+0000 7fd6303e2640 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd504036b40 0x7fd504039000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd620045be0 tx=0x7fd62006d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd63cf26800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563f258608a0 0x563f25862d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f258634b0 con 0x563f258608a0 2024-09-18T01:27:15.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd6393e4640 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563f258608a0 0x563f25862d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd6393e4640 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563f258608a0 0x563f25862d60 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd63cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd63cf26800 20 realm 2024-09-18T01:27:15.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd63cf26800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f258638c0 con 0x563f258608a0 2024-09-18T01:27:15.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd63cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd63cf26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:15.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd63cf26800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.855+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f25864190 con 0x563f258608a0 2024-09-18T01:27:15.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.856+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.856+0000 7fd63cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.856+0000 7fd63cf26800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.856+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f258608a0 2024-09-18T01:27:15.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.856+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.856+0000 7fd63cf26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:15.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.856+0000 7fd63cf26800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.856+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563f25865290 0x563f25867680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.856+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f25867c40 con 0x563f25865290 2024-09-18T01:27:15.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.856+0000 7fd638be3640 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563f25865290 0x563f25867680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.856+0000 7fd638be3640 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563f25865290 0x563f25867680 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.856+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.856+0000 7fd63cf26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:15.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.857+0000 7fd63cf26800 20 searching for the correct realm 2024-09-18T01:27:15.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.857+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563f25869bd0 0x563f2586c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.857+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f2586c760 con 0x563f25869bd0 2024-09-18T01:27:15.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.857+0000 7fd6303e2640 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563f25869bd0 0x563f2586c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.857+0000 7fd6303e2640 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563f25869bd0 0x563f2586c090 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.857+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd620057030 con 0x563f25869bd0 2024-09-18T01:27:15.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.857+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f2586c760 con 0x563f25865290 2024-09-18T01:27:15.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.857+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.857+0000 7fd638be3640 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd628076060 0x7fd628032740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.857+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f2586c760 con 0x7fd628076060 2024-09-18T01:27:15.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.858+0000 7fd6393e4640 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd628076060 0x7fd628032740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.858+0000 7fd6393e4640 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd628076060 0x7fd628032740 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.859+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.859+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f258608a0 2024-09-18T01:27:15.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.859+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.859+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f258608a0 2024-09-18T01:27:15.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.859+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.859+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x7fd628076060 2024-09-18T01:27:15.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.859+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.859+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x7fd628076060 2024-09-18T01:27:15.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.859+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.860+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25865290 2024-09-18T01:27:15.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.860+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.860+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25869bd0 2024-09-18T01:27:15.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.860+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd620057030 con 0x563f25869bd0 2024-09-18T01:27:15.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.860+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f258608a0 2024-09-18T01:27:15.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.860+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.860+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25865290 2024-09-18T01:27:15.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.860+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.860+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f258608a0 2024-09-18T01:27:15.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.861+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.861+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25865290 2024-09-18T01:27:15.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.861+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.861+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25869bd0 2024-09-18T01:27:15.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.861+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd620057030 con 0x563f25869bd0 2024-09-18T01:27:15.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.861+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25869bd0 2024-09-18T01:27:15.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.861+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd620057030 con 0x563f25869bd0 2024-09-18T01:27:15.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.861+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x7fd628076060 2024-09-18T01:27:15.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.862+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.862+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25869bd0 2024-09-18T01:27:15.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.862+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd620057030 con 0x563f25869bd0 2024-09-18T01:27:15.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.862+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25869bd0 2024-09-18T01:27:15.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.862+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd620057030 con 0x563f25869bd0 2024-09-18T01:27:15.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.862+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f258608a0 2024-09-18T01:27:15.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.862+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.862+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f258608a0 2024-09-18T01:27:15.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.862+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.862+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x7fd628076060 2024-09-18T01:27:15.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.863+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.863+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25869bd0 2024-09-18T01:27:15.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.863+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd620057030 con 0x563f25869bd0 2024-09-18T01:27:15.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.863+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25865290 2024-09-18T01:27:15.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.863+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.863+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f258608a0 2024-09-18T01:27:15.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.864+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.864+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x7fd628076060 2024-09-18T01:27:15.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.864+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.864+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25869bd0 2024-09-18T01:27:15.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.864+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd620057030 con 0x563f25869bd0 2024-09-18T01:27:15.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.864+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25865290 2024-09-18T01:27:15.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.864+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.864+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25865290 2024-09-18T01:27:15.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.865+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.865+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25869bd0 2024-09-18T01:27:15.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.865+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd620057030 con 0x563f25869bd0 2024-09-18T01:27:15.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.865+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x7fd628076060 2024-09-18T01:27:15.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.865+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.865+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f258608a0 2024-09-18T01:27:15.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.865+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.865+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563f25864530 con 0x563f25865290 2024-09-18T01:27:15.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:15.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:15.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:15.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:15.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:15.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:15.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f25868500 con 0x563f258608a0 2024-09-18T01:27:15.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f258688f0 con 0x563f258608a0 2024-09-18T01:27:15.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:15.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f258688f0 con 0x7fd628076060 2024-09-18T01:27:15.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:15.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 zone default found 2024-09-18T01:27:15.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 4 Realm: () 2024-09-18T01:27:15.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:15.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:15.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:15.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 zonegroup default 2024-09-18T01:27:15.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.866+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f25868120 con 0x7fd628076060 2024-09-18T01:27:15.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.867+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.867+0000 7fd63cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.867+0000 7fd63cf26800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.867+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f2586e5c0 con 0x563f25869bd0 2024-09-18T01:27:15.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.867+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd620057030 con 0x563f25869bd0 2024-09-18T01:27:15.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.867+0000 7fd63cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.867+0000 7fd63cf26800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.867+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f2586e960 con 0x563f25869bd0 2024-09-18T01:27:15.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.867+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd620057030 con 0x563f25869bd0 2024-09-18T01:27:15.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.867+0000 7fd63cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:15.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.867+0000 7fd63cf26800 20 started sync module instance, tier type = 2024-09-18T01:27:15.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.867+0000 7fd63cf26800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:15.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.867+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f2586da60 con 0x563f25865290 2024-09-18T01:27:15.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.868+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.868+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94829212521904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f2586ed00 con 0x563f25865290 2024-09-18T01:27:15.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.868+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f2586f5d0 con 0x563f258608a0 2024-09-18T01:27:15.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.869+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94829212521904] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.869+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.869+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94829212528800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f2586f9c0 con 0x563f258608a0 2024-09-18T01:27:15.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.869+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f25870420 con 0x563f25869bd0 2024-09-18T01:27:15.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.870+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94829212528800] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.871+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd620057030 con 0x563f25869bd0 2024-09-18T01:27:15.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.871+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94829212524160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f25870810 con 0x563f25869bd0 2024-09-18T01:27:15.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.871+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f25871270 con 0x563f25865290 2024-09-18T01:27:15.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.872+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94829212524160] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd620057030 con 0x563f25869bd0 2024-09-18T01:27:15.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.872+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.872+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94829212532480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f25871660 con 0x563f25865290 2024-09-18T01:27:15.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.872+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f25872060 con 0x563f258608a0 2024-09-18T01:27:15.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.873+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94829212532480] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.873+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.873+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94829212536144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f25872020 con 0x563f258608a0 2024-09-18T01:27:15.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.873+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f25872aa0 con 0x7fd628076060 2024-09-18T01:27:15.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.874+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94829212536144] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.874+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.874+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94829212542928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f25872020 con 0x7fd628076060 2024-09-18T01:27:15.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.874+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f258734b0 con 0x7fd628076060 2024-09-18T01:27:15.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.875+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94829212542928] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.875+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.875+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94829212540240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f258734b0 con 0x7fd628076060 2024-09-18T01:27:15.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.875+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f25873e70 con 0x7fd628076060 2024-09-18T01:27:15.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.876+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94829212540240] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.876+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.876+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94829212545504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f25873e70 con 0x7fd628076060 2024-09-18T01:27:15.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.876+0000 7fd63cf26800 20 add_watcher() i=0 2024-09-18T01:27:15.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.876+0000 7fd63cf26800 20 add_watcher() i=1 2024-09-18T01:27:15.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.876+0000 7fd63cf26800 20 add_watcher() i=2 2024-09-18T01:27:15.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.876+0000 7fd63cf26800 20 add_watcher() i=3 2024-09-18T01:27:15.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.876+0000 7fd63cf26800 20 add_watcher() i=4 2024-09-18T01:27:15.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.876+0000 7fd63cf26800 20 add_watcher() i=5 2024-09-18T01:27:15.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.876+0000 7fd63cf26800 20 add_watcher() i=6 2024-09-18T01:27:15.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.877+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94829212545504] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.877+0000 7fd63cf26800 20 add_watcher() i=7 2024-09-18T01:27:15.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.877+0000 7fd63cf26800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:15.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.877+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f25877270 con 0x563f258608a0 2024-09-18T01:27:15.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.877+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.877+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94829212547984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f258747c0 con 0x563f258608a0 2024-09-18T01:27:15.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.878+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94829212547984] v35'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.879+0000 7fd4eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:15.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.879+0000 7fd63cf26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:15.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.879+0000 7fd63cf26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:15.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.879+0000 7fd63cf26800 5 note: GC not initialized 2024-09-18T01:27:15.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.879+0000 7fd4edfe3640 20 reqs_thread_entry: start 2024-09-18T01:27:15.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.879+0000 7fd63cf26800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:15.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.879+0000 7fd63cf26800 20 Filter name: none 2024-09-18T01:27:15.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.879+0000 7fd45f7fe640 20 reqs_thread_entry: start 2024-09-18T01:27:15.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.879+0000 7fd63cf26800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:27:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.879+0000 7fd63cf26800 20 rados->read ofs=0 len=0 2024-09-18T01:27:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.879+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f258aa6b0 con 0x7fd628076060 2024-09-18T01:27:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.880+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.880+0000 7fd63cf26800 20 rados_obj.operate() r=0 bl.length=490 2024-09-18T01:27:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.880+0000 7fd63cf26800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:27:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.880+0000 7fd63cf26800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.880+0000 7fd63cf26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:27:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.880+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f258b0e80 con 0x7fd628076060 2024-09-18T01:27:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.881+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v35'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.881+0000 7fd63cf26800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.881+0000 7fd63cf26800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.881+0000 7fd63cf26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:27:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.881+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94829212796992 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563f258ac4c0 con 0x563f258608a0 2024-09-18T01:27:15.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.882+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== watch-notify(notify (1) cookie 94829212536144 notify 150323855415 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fd634026410 con 0x563f258608a0 2024-09-18T01:27:15.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.882+0000 7fd50ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855415 cookie 94829212536144 notifier 4916 bl.length()=636 2024-09-18T01:27:15.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.882+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 notify.4 [notify cookie 94829212796992 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.882+0000 7fd50ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:15.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.882+0000 7fd50ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:15.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.882+0000 7fd50ffff640 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd4fc003ea0 con 0x563f258608a0 2024-09-18T01:27:15.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.882+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.882+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== watch-notify(notify_complete (2) cookie 94829212796992 notify 150323855415 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd6340265e0 con 0x563f258608a0 2024-09-18T01:27:15.896 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:27:14.265685Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:27:14.265676Z","tags":[],"group_ids":[]} 2024-09-18T01:27:15.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.883+0000 7fd4eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:15.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.883+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94829212547984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f258a83d0 con 0x563f258608a0 2024-09-18T01:27:15.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.884+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94829212547984] v35'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.884+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94829212521904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f258a83d0 con 0x563f25865290 2024-09-18T01:27:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.885+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94829212521904] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.885+0000 7fd63cf26800 20 remove_watcher() i=0 2024-09-18T01:27:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.885+0000 7fd63cf26800 2 removed watcher, disabling cache 2024-09-18T01:27:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.885+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94829212528800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f258a83d0 con 0x563f258608a0 2024-09-18T01:27:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.886+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94829212528800] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.886+0000 7fd63cf26800 20 remove_watcher() i=1 2024-09-18T01:27:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.886+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94829212524160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f258a83d0 con 0x563f25869bd0 2024-09-18T01:27:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.887+0000 7fd6303e2640 1 -- 172.21.15.100:0/1876845070 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94829212524160] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd620057030 con 0x563f25869bd0 2024-09-18T01:27:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.887+0000 7fd63cf26800 20 remove_watcher() i=2 2024-09-18T01:27:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.887+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94829212532480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f2586f0a0 con 0x563f25865290 2024-09-18T01:27:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.888+0000 7fd638be3640 1 -- 172.21.15.100:0/1876845070 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94829212532480] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd628073030 con 0x563f25865290 2024-09-18T01:27:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.888+0000 7fd63cf26800 20 remove_watcher() i=3 2024-09-18T01:27:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.888+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94829212536144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f2586de80 con 0x563f258608a0 2024-09-18T01:27:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.889+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94829212536144] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x563f258608a0 2024-09-18T01:27:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.889+0000 7fd63cf26800 20 remove_watcher() i=4 2024-09-18T01:27:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.889+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94829212542928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f2586f0a0 con 0x7fd628076060 2024-09-18T01:27:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.890+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94829212542928] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.890+0000 7fd63cf26800 20 remove_watcher() i=5 2024-09-18T01:27:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.890+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94829212540240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f25870d50 con 0x7fd628076060 2024-09-18T01:27:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.891+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94829212540240] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.891+0000 7fd63cf26800 20 remove_watcher() i=6 2024-09-18T01:27:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.891+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94829212545504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563f2586de80 con 0x7fd628076060 2024-09-18T01:27:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.892+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94829212545504] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd63400a4a0 con 0x7fd628076060 2024-09-18T01:27:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.892+0000 7fd63cf26800 20 remove_watcher() i=7 2024-09-18T01:27:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.892+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd628076060 msgr2=0x7fd628032740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.892+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7fd628076060 0x7fd628032740 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.892+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563f258608a0 msgr2=0x563f25862d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.892+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563f258608a0 0x563f25862d60 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.892+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563f25865290 msgr2=0x563f25867680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.892+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563f25865290 0x563f25867680 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.892+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563f25869bd0 msgr2=0x563f2586c090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.892+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x563f25869bd0 0x563f2586c090 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd504036b40 msgr2=0x7fd504039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd504036b40 0x7fd504039000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd620045be0 tx=0x7fd62006d040 comp rx=0 tx=0).stop 2024-09-18T01:27:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2584de80 msgr2=0x563f25855160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1876845070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f2584de80 0x563f25855160 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd628000fd0 tx=0x7fd628014f60 comp rx=0 tx=0).stop 2024-09-18T01:27:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 reap_dead start 2024-09-18T01:27:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd6393e4640 1 -- 172.21.15.100:0/1876845070 reap_dead start 2024-09-18T01:27:15.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 shutdown_connections 2024-09-18T01:27:15.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 >> 172.21.15.100:0/1876845070 conn(0x563f2584a270 msgr2=0x563f25848340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 shutdown_connections 2024-09-18T01:27:15.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/1876845070 wait complete. 2024-09-18T01:27:15.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/1224645645 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd510036b90 msgr2=0x7fd510039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1224645645 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd510036b90 0x7fd510039050 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd620005570 tx=0x7fd620005ac0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/1224645645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f258415e0 msgr2=0x563f25841a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1224645645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f258415e0 0x563f25841a00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd62804b8b0 tx=0x7fd62804d480 comp rx=0 tx=0).stop 2024-09-18T01:27:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/1224645645 shutdown_connections 2024-09-18T01:27:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1224645645 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd510036b90 0x7fd510039050 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 --2- 172.21.15.100:0/1224645645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f258415e0 0x563f25841a00 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/1224645645 >> 172.21.15.100:0/1224645645 conn(0x563f25832160 msgr2=0x563f25834ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/1224645645 shutdown_connections 2024-09-18T01:27:15.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/1224645645 wait complete. 2024-09-18T01:27:15.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563f2582c970 msgr2=0x563f2582ed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x563f2582c970 0x563f2582ed60 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563f2572d920 msgr2=0x563f25826160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x563f2572d920 0x563f25826160 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563f25828a30 msgr2=0x563f2582ae20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x563f25828a30 0x563f2582ae20 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd520038da0 msgr2=0x7fd52003b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd520038da0 0x7fd52003b260 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd620057000 tx=0x7fd620052000 comp rx=0 tx=0).stop 2024-09-18T01:27:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f257294e0 msgr2=0x563f2581f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd63cf26800 1 --2- 172.21.15.100:0/973447585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f257294e0 0x563f2581f0f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd628000c00 tx=0x7fd628000ed0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.893+0000 7fd6393e4640 1 -- 172.21.15.100:0/973447585 reap_dead start 2024-09-18T01:27:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.894+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 shutdown_connections 2024-09-18T01:27:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.894+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 >> 172.21.15.100:0/973447585 conn(0x563f25724dd0 msgr2=0x563f25812a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.894+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 shutdown_connections 2024-09-18T01:27:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.894+0000 7fd63cf26800 1 -- 172.21.15.100:0/973447585 wait complete. 2024-09-18T01:27:15.911 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:15.911 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:15.911 ERROR:root:0 2024-09-18T01:27:15.911 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:27:15.912 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:27:15.912 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-18T01:27:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:15.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.958+0000 7f44d340f800 1 Processor -- start 2024-09-18T01:27:15.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.958+0000 7f44d340f800 1 -- start start 2024-09-18T01:27:15.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.958+0000 7f44d340f800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55911615f650 0x5591161ee1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.958+0000 7f44d340f800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5591160aab30 con 0x5591161ee720 2024-09-18T01:27:15.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.958+0000 7f44d340f800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55911608c360 con 0x55911615f650 2024-09-18T01:27:15.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.958+0000 7f44ceae7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55911615f650 0x5591161ee1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.958+0000 7f44c62e6640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x5591161ee720 0x5591161f0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37298/0 (socket says 172.21.15.100:37298) 2024-09-18T01:27:15.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.958+0000 7f44ceae7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55911615f650 0x5591161ee1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45948/0 (socket says 172.21.15.100:45948) 2024-09-18T01:27:15.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.958+0000 7f44c62e6640 1 -- 172.21.15.100:0/2733511871 learned_addr learned my addr 172.21.15.100:0/2733511871 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:15.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.958+0000 7f44ceae7640 1 -- 172.21.15.100:0/2733511871 >> v1:172.21.15.92:6789/0 conn(0x5591161ee720 legacy=0x5591161f0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.958+0000 7f44ceae7640 1 -- 172.21.15.100:0/2733511871 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591160b2e00 con 0x55911615f650 2024-09-18T01:27:15.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.960+0000 7f44ceae7640 1 --2- 172.21.15.100:0/2733511871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 0x5591161ee1e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f44c000a470 tx=0x7f44c0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ae0df0d572b28e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.960+0000 7f44ce2e6640 1 -- 172.21.15.100:0/2733511871 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c0053570 con 0x55911615f650 2024-09-18T01:27:15.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.960+0000 7f44ce2e6640 1 -- 172.21.15.100:0/2733511871 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c0058070 con 0x55911615f650 2024-09-18T01:27:15.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.960+0000 7f44ce2e6640 1 -- 172.21.15.100:0/2733511871 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c0053880 con 0x55911615f650 2024-09-18T01:27:15.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.961+0000 7f44d340f800 1 -- 172.21.15.100:0/2733511871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 msgr2=0x5591161ee1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.961+0000 7f44d340f800 1 --2- 172.21.15.100:0/2733511871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 0x5591161ee1e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f44c000a470 tx=0x7f44c0045a20 comp rx=0 tx=0).stop 2024-09-18T01:27:15.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.961+0000 7f44d340f800 1 -- 172.21.15.100:0/2733511871 shutdown_connections 2024-09-18T01:27:15.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.961+0000 7f44d340f800 1 --2- 172.21.15.100:0/2733511871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 0x5591161ee1e0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.961+0000 7f44d340f800 1 -- 172.21.15.100:0/2733511871 >> 172.21.15.100:0/2733511871 conn(0x5591161e5db0 msgr2=0x5591161e81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.961+0000 7f44d340f800 1 -- 172.21.15.100:0/2733511871 shutdown_connections 2024-09-18T01:27:15.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.961+0000 7f44d340f800 1 -- 172.21.15.100:0/2733511871 wait complete. 2024-09-18T01:27:15.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.975+0000 7f44d340f800 1 Processor -- start 2024-09-18T01:27:15.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.975+0000 7f44d340f800 1 -- start start 2024-09-18T01:27:15.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.975+0000 7f44d340f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 0x5591161ebb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.975+0000 7f44d340f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559116137360 con 0x55911615f650 2024-09-18T01:27:15.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.976+0000 7f44ceae7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 0x5591161ebb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.976+0000 7f44ceae7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 0x5591161ebb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45950/0 (socket says 172.21.15.100:45950) 2024-09-18T01:27:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.976+0000 7f44ceae7640 1 -- 172.21.15.100:0/1453466909 learned_addr learned my addr 172.21.15.100:0/1453466909 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.976+0000 7f44ceae7640 1 -- 172.21.15.100:0/1453466909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559116084bc0 con 0x55911615f650 2024-09-18T01:27:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.976+0000 7f44ceae7640 1 --2- 172.21.15.100:0/1453466909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 0x5591161ebb10 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f44c0025c20 tx=0x7f44c0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a42c7ee639d8517 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.976+0000 7f43bce09640 1 -- 172.21.15.100:0/1453466909 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c0053ba0 con 0x55911615f650 2024-09-18T01:27:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.976+0000 7f43bce09640 1 -- 172.21.15.100:0/1453466909 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c0063030 con 0x55911615f650 2024-09-18T01:27:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.976+0000 7f43bce09640 1 -- 172.21.15.100:0/1453466909 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c0053440 con 0x55911615f650 2024-09-18T01:27:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.977+0000 7f44d340f800 1 -- 172.21.15.100:0/1453466909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 msgr2=0x5591161ebb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.977+0000 7f44d340f800 1 --2- 172.21.15.100:0/1453466909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 0x5591161ebb10 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f44c0025c20 tx=0x7f44c0051000 comp rx=0 tx=0).stop 2024-09-18T01:27:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.977+0000 7f44d340f800 1 -- 172.21.15.100:0/1453466909 shutdown_connections 2024-09-18T01:27:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.977+0000 7f44d340f800 1 --2- 172.21.15.100:0/1453466909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 0x5591161ebb10 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.977+0000 7f44d340f800 1 -- 172.21.15.100:0/1453466909 >> 172.21.15.100:0/1453466909 conn(0x5591161e5db0 msgr2=0x5591162d62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.977+0000 7f44d340f800 1 -- 172.21.15.100:0/1453466909 shutdown_connections 2024-09-18T01:27:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.977+0000 7f44d340f800 1 -- 172.21.15.100:0/1453466909 wait complete. 2024-09-18T01:27:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.977+0000 7f44d340f800 1 Processor -- start 2024-09-18T01:27:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.977+0000 7f44d340f800 1 -- start start 2024-09-18T01:27:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.978+0000 7f44d340f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 0x5591162e43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.978+0000 7f44d340f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5591161f2620 con 0x55911615f650 2024-09-18T01:27:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.978+0000 7f44ceae7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 0x5591162e43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.978+0000 7f44ceae7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 0x5591162e43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45954/0 (socket says 172.21.15.100:45954) 2024-09-18T01:27:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.978+0000 7f44ceae7640 1 -- 172.21.15.100:0/3882538937 learned_addr learned my addr 172.21.15.100:0/3882538937 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.978+0000 7f44ceae7640 1 -- 172.21.15.100:0/3882538937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559116098fe0 con 0x55911615f650 2024-09-18T01:27:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.978+0000 7f44ceae7640 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 0x5591162e43c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x5591161eb210 tx=0x7f44c0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.978+0000 7f43bb606640 1 -- 172.21.15.100:0/3882538937 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c0078070 con 0x55911615f650 2024-09-18T01:27:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.978+0000 7f43bb606640 1 -- 172.21.15.100:0/3882538937 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c0053570 con 0x55911615f650 2024-09-18T01:27:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.978+0000 7f43bb606640 1 -- 172.21.15.100:0/3882538937 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c0053850 con 0x55911615f650 2024-09-18T01:27:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.978+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591162e4900 con 0x55911615f650 2024-09-18T01:27:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.978+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591162e4e80 con 0x55911615f650 2024-09-18T01:27:15.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.979+0000 7f43bb606640 1 -- 172.21.15.100:0/3882538937 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f44c007b070 con 0x55911615f650 2024-09-18T01:27:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.979+0000 7f43bb606640 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f43b4036b40 0x7f43b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.979+0000 7f43bb606640 1 -- 172.21.15.100:0/3882538937 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f44c0070070 con 0x55911615f650 2024-09-18T01:27:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.979+0000 7f44c62e6640 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f43b4036b40 0x7f43b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.980+0000 7f44d340f800 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591161ee720 0x5591162eb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.980+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591162eba50 con 0x5591161ee720 2024-09-18T01:27:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.980+0000 7f44cf2e8640 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591161ee720 0x5591162eb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.980+0000 7f44c62e6640 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f43b4036b40 0x7f43b4039000 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f44b8000f60 tx=0x7f44b80012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.980+0000 7f44cf2e8640 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591161ee720 0x5591162eb430 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.980+0000 7f44cf2e8640 1 -- 172.21.15.100:0/3882538937 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x5591161ee720 2024-09-18T01:27:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.980+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591162e8a00 con 0x5591161ee720 2024-09-18T01:27:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.980+0000 7f44cf2e8640 1 -- 172.21.15.100:0/3882538937 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f44c800a4a0 con 0x5591161ee720 2024-09-18T01:27:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.980+0000 7f44d340f800 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591162edda0 0x5591162f0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.981+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591162f0880 con 0x5591162edda0 2024-09-18T01:27:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.981+0000 7f44ceae7640 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591162edda0 0x5591162f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.981+0000 7f44ceae7640 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591162edda0 0x5591162f0190 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.981+0000 7f44ceae7640 1 -- 172.21.15.100:0/3882538937 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f44c007a030 con 0x5591162edda0 2024-09-18T01:27:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.981+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591162ecb80 con 0x5591161ee720 2024-09-18T01:27:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.981+0000 7f44cf2e8640 1 -- 172.21.15.100:0/3882538937 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f44c800a4a0 con 0x5591161ee720 2024-09-18T01:27:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.981+0000 7f44d340f800 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5591162f1ce0 0x5591162f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.981+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591162f4720 con 0x5591162f1ce0 2024-09-18T01:27:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.982+0000 7f44c62e6640 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5591162f1ce0 0x5591162f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.982+0000 7f44c62e6640 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5591162f1ce0 0x5591162f40d0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.982+0000 7f44c62e6640 1 -- 172.21.15.100:0/3882538937 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f44b8009050 con 0x5591162f1ce0 2024-09-18T01:27:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.983+0000 7f44d340f800 1 Processor -- start 2024-09-18T01:27:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.983+0000 7f44d340f800 1 -- start start 2024-09-18T01:27:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.983+0000 7f44d340f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591163024d0 0x5591163028f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.983+0000 7f44d340f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559116086580 con 0x5591163024d0 2024-09-18T01:27:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.983+0000 7f44ceae7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591163024d0 0x5591163028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.983+0000 7f44ceae7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591163024d0 0x5591163028f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45968/0 (socket says 172.21.15.100:45968) 2024-09-18T01:27:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.983+0000 7f44ceae7640 1 -- 172.21.15.100:0/2346269737 learned_addr learned my addr 172.21.15.100:0/2346269737 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.983+0000 7f44ceae7640 1 -- 172.21.15.100:0/2346269737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559116302e30 con 0x5591163024d0 2024-09-18T01:27:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.983+0000 7f44ceae7640 1 --2- 172.21.15.100:0/2346269737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591163024d0 0x5591163028f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f44c007ae20 tx=0x7f44c0005260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.983+0000 7f43b8e01640 1 -- 172.21.15.100:0/2346269737 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c0083200 con 0x5591163024d0 2024-09-18T01:27:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.983+0000 7f43b8e01640 1 -- 172.21.15.100:0/2346269737 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c007c9d0 con 0x5591163024d0 2024-09-18T01:27:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.984+0000 7f44d340f800 1 -- 172.21.15.100:0/2346269737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591163030c0 con 0x5591163024d0 2024-09-18T01:27:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.984+0000 7f43b8e01640 1 -- 172.21.15.100:0/2346269737 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c007ccd0 con 0x5591163024d0 2024-09-18T01:27:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.984+0000 7f44d340f800 1 -- 172.21.15.100:0/2346269737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559116305da0 con 0x5591163024d0 2024-09-18T01:27:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.984+0000 7f43b8e01640 1 -- 172.21.15.100:0/2346269737 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f44c00909c0 con 0x5591163024d0 2024-09-18T01:27:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.984+0000 7f43b8e01640 1 --2- 172.21.15.100:0/2346269737 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f43a8036b90 0x7f43a8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.984+0000 7f43b8e01640 1 -- 172.21.15.100:0/2346269737 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f44c0088030 con 0x5591163024d0 2024-09-18T01:27:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.984+0000 7f44c62e6640 1 --2- 172.21.15.100:0/2346269737 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f43a8036b90 0x7f43a8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.985+0000 7f44d340f800 1 Processor -- start 2024-09-18T01:27:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.985+0000 7f44d340f800 1 -- start start 2024-09-18T01:27:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.985+0000 7f44c62e6640 1 --2- 172.21.15.100:0/2346269737 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f43a8036b90 0x7f43a8039050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f44b800bf50 tx=0x7f44b800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.985+0000 7f44d340f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911630f030 0x55911630f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.985+0000 7f44d340f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5591161ea180 con 0x55911630f030 2024-09-18T01:27:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.985+0000 7f44ceae7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911630f030 0x55911630f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.985+0000 7f44ceae7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911630f030 0x55911630f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45972/0 (socket says 172.21.15.100:45972) 2024-09-18T01:27:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.985+0000 7f44ceae7640 1 -- 172.21.15.100:0/2680620173 learned_addr learned my addr 172.21.15.100:0/2680620173 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.985+0000 7f44ceae7640 1 -- 172.21.15.100:0/2680620173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55911630fa00 con 0x55911630f030 2024-09-18T01:27:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.985+0000 7f44ceae7640 1 --2- 172.21.15.100:0/2680620173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911630f030 0x55911630f430 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f44c0054e30 tx=0x7f44c009bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfdf8378d6f8b80 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.986+0000 7f43b27fc640 1 -- 172.21.15.100:0/2680620173 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c007a7d0 con 0x55911630f030 2024-09-18T01:27:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.986+0000 7f43b27fc640 1 -- 172.21.15.100:0/2680620173 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c0068420 con 0x55911630f030 2024-09-18T01:27:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.986+0000 7f43b27fc640 1 -- 172.21.15.100:0/2680620173 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c008e3f0 con 0x55911630f030 2024-09-18T01:27:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.986+0000 7f44d340f800 1 -- 172.21.15.100:0/2680620173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911630f030 msgr2=0x55911630f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.986+0000 7f44d340f800 1 --2- 172.21.15.100:0/2680620173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911630f030 0x55911630f430 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f44c0054e30 tx=0x7f44c009bf90 comp rx=0 tx=0).stop 2024-09-18T01:27:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.986+0000 7f44d340f800 1 -- 172.21.15.100:0/2680620173 shutdown_connections 2024-09-18T01:27:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.986+0000 7f44d340f800 1 --2- 172.21.15.100:0/2680620173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911630f030 0x55911630f430 secure :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f44c0054e30 tx=0x7f44c009bf90 comp rx=0 tx=0).stop 2024-09-18T01:27:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.986+0000 7f44d340f800 1 -- 172.21.15.100:0/2680620173 >> 172.21.15.100:0/2680620173 conn(0x55911630b390 msgr2=0x559116309490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.986+0000 7f44d340f800 1 -- 172.21.15.100:0/2680620173 shutdown_connections 2024-09-18T01:27:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.986+0000 7f44d340f800 1 -- 172.21.15.100:0/2680620173 wait complete. 2024-09-18T01:27:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.986+0000 7f44d340f800 1 Processor -- start 2024-09-18T01:27:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.986+0000 7f44d340f800 1 -- start start 2024-09-18T01:27:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.987+0000 7f44d340f800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559116316440 0x559116316860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.987+0000 7f44d340f800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55911630ff80 con 0x559116316440 2024-09-18T01:27:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.987+0000 7f44ceae7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559116316440 0x559116316860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.987+0000 7f44ceae7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559116316440 0x559116316860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45974/0 (socket says 172.21.15.100:45974) 2024-09-18T01:27:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.987+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 learned_addr learned my addr 172.21.15.100:0/2652904120 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.987+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559116316da0 con 0x559116316440 2024-09-18T01:27:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.987+0000 7f44ceae7640 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559116316440 0x559116316860 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f44c008cf70 tx=0x7f44c008cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.987+0000 7f43b0ff9640 1 -- 172.21.15.100:0/2652904120 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c00bb070 con 0x559116316440 2024-09-18T01:27:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.987+0000 7f43b0ff9640 1 -- 172.21.15.100:0/2652904120 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c005c9f0 con 0x559116316440 2024-09-18T01:27:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.987+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559116316da0 con 0x559116316440 2024-09-18T01:27:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.987+0000 7f43b0ff9640 1 -- 172.21.15.100:0/2652904120 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c008e3f0 con 0x559116316440 2024-09-18T01:27:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.987+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559116316da0 con 0x559116316440 2024-09-18T01:27:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.988+0000 7f43b0ff9640 1 -- 172.21.15.100:0/2652904120 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f44c00be070 con 0x559116316440 2024-09-18T01:27:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.988+0000 7f43b0ff9640 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4398036aa0 0x7f4398038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.988+0000 7f43b0ff9640 1 -- 172.21.15.100:0/2652904120 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f44c00b3070 con 0x559116316440 2024-09-18T01:27:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.988+0000 7f44c62e6640 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4398036aa0 0x7f4398038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.989+0000 7f44c62e6640 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4398036aa0 0x7f4398038f60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f44b8001b60 tx=0x7f44b8010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.989+0000 7f44d340f800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.989+0000 7f44d340f800 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559116321fa0 0x559116324460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.989+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559116324bb0 con 0x559116321fa0 2024-09-18T01:27:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.989+0000 7f44cf2e8640 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559116321fa0 0x559116324460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.989+0000 7f44cf2e8640 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559116321fa0 0x559116324460 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 20 realm 2024-09-18T01:27:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559116324fc0 con 0x559116321fa0 2024-09-18T01:27:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559116325890 con 0x559116321fa0 2024-09-18T01:27:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116321fa0 2024-09-18T01:27:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559116326990 0x559116328d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559116329390 con 0x559116326990 2024-09-18T01:27:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.990+0000 7f44ceae7640 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559116326990 0x559116328d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.991+0000 7f44ceae7640 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559116326990 0x559116328d80 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.991+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.991+0000 7f44d340f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.991+0000 7f44d340f800 20 searching for the correct realm 2024-09-18T01:27:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.991+0000 7f44d340f800 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55911632b340 0x55911632d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.991+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55911632ded0 con 0x55911632b340 2024-09-18T01:27:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.991+0000 7f44c62e6640 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55911632b340 0x55911632d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.991+0000 7f44c62e6640 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55911632b340 0x55911632d800 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.992+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b8009050 con 0x55911632b340 2024-09-18T01:27:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.992+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55911632ded0 con 0x559116326990 2024-09-18T01:27:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.992+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.992+0000 7f44ceae7640 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f44c00c0060 0x7f44c0078210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.992+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55911632ded0 con 0x7f44c00c0060 2024-09-18T01:27:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.992+0000 7f44cf2e8640 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f44c00c0060 0x7f44c0078210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.992+0000 7f44cf2e8640 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f44c00c0060 0x7f44c0078210 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.993+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.993+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116321fa0 2024-09-18T01:27:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.993+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.993+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116321fa0 2024-09-18T01:27:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.993+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.993+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x7f44c00c0060 2024-09-18T01:27:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.993+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.993+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x7f44c00c0060 2024-09-18T01:27:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.993+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.994+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116326990 2024-09-18T01:27:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.994+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.994+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x55911632b340 2024-09-18T01:27:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.994+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b8009050 con 0x55911632b340 2024-09-18T01:27:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.994+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116321fa0 2024-09-18T01:27:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.994+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.994+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116326990 2024-09-18T01:27:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.994+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.994+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116321fa0 2024-09-18T01:27:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.995+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.995+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116326990 2024-09-18T01:27:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.995+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.995+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x55911632b340 2024-09-18T01:27:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.995+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b8009050 con 0x55911632b340 2024-09-18T01:27:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.995+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x55911632b340 2024-09-18T01:27:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.995+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b8009050 con 0x55911632b340 2024-09-18T01:27:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.995+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x7f44c00c0060 2024-09-18T01:27:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.996+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.996+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x55911632b340 2024-09-18T01:27:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.996+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b8009050 con 0x55911632b340 2024-09-18T01:27:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.996+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x55911632b340 2024-09-18T01:27:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.996+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b8009050 con 0x55911632b340 2024-09-18T01:27:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.996+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116321fa0 2024-09-18T01:27:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.997+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.997+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116321fa0 2024-09-18T01:27:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.997+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.997+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x7f44c00c0060 2024-09-18T01:27:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.997+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.997+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x55911632b340 2024-09-18T01:27:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.997+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b8009050 con 0x55911632b340 2024-09-18T01:27:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.997+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116326990 2024-09-18T01:27:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.998+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.998+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116321fa0 2024-09-18T01:27:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.998+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.998+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x7f44c00c0060 2024-09-18T01:27:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.998+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.998+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x55911632b340 2024-09-18T01:27:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.998+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b8009050 con 0x55911632b340 2024-09-18T01:27:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.998+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116326990 2024-09-18T01:27:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.998+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.998+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116326990 2024-09-18T01:27:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.999+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.999+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x55911632b340 2024-09-18T01:27:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.999+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b8009050 con 0x55911632b340 2024-09-18T01:27:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.999+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x7f44c00c0060 2024-09-18T01:27:16.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.999+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.999+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116321fa0 2024-09-18T01:27:16.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.999+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:15.999+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559116325c30 con 0x559116326990 2024-09-18T01:27:16.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:16.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:16.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:16.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:16.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:16.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:16.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559116329c50 con 0x559116321fa0 2024-09-18T01:27:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55911632a040 con 0x559116321fa0 2024-09-18T01:27:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55911632a040 con 0x7f44c00c0060 2024-09-18T01:27:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 zone default found 2024-09-18T01:27:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 4 Realm: () 2024-09-18T01:27:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 zonegroup default 2024-09-18T01:27:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.000+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591163298b0 con 0x7f44c00c0060 2024-09-18T01:27:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.001+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.001+0000 7f44d340f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.001+0000 7f44d340f800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.001+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591163298b0 con 0x55911632b340 2024-09-18T01:27:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.001+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f44b8009050 con 0x55911632b340 2024-09-18T01:27:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.001+0000 7f44d340f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.001+0000 7f44d340f800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.001+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55911632fe50 con 0x55911632b340 2024-09-18T01:27:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.001+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f44b8009050 con 0x55911632b340 2024-09-18T01:27:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.001+0000 7f44d340f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.001+0000 7f44d340f800 20 started sync module instance, tier type = 2024-09-18T01:27:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.001+0000 7f44d340f800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.001+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55911632f1d0 con 0x559116326990 2024-09-18T01:27:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.002+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.002+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94081631057344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116330760 con 0x559116326990 2024-09-18T01:27:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.002+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116330fb0 con 0x559116321fa0 2024-09-18T01:27:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.003+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94081631057344] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.003+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.004+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94081631060656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116331030 con 0x559116321fa0 2024-09-18T01:27:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.004+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116331b50 con 0x55911632b340 2024-09-18T01:27:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.005+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94081631060656] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.005+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b8009050 con 0x55911632b340 2024-09-18T01:27:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.005+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94081631065632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116331f40 con 0x55911632b340 2024-09-18T01:27:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.005+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116332980 con 0x559116326990 2024-09-18T01:27:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.006+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94081631065632] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b8009050 con 0x55911632b340 2024-09-18T01:27:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.006+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.006+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94081631069264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116332d70 con 0x559116326990 2024-09-18T01:27:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.006+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591163337b0 con 0x559116321fa0 2024-09-18T01:27:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.007+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.007+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94081631072896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116333770 con 0x559116321fa0 2024-09-18T01:27:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.007+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116334710 con 0x7f44c00c0060 2024-09-18T01:27:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.007+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94081631069264] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.008+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94081631072896] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.009+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.009+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94081631076896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116333950 con 0x7f44c00c0060 2024-09-18T01:27:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.009+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116334fb0 con 0x7f44c00c0060 2024-09-18T01:27:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.010+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94081631076896] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.010+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.010+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94081631062784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116334d50 con 0x7f44c00c0060 2024-09-18T01:27:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.010+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591163355a0 con 0x7f44c00c0060 2024-09-18T01:27:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.011+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(58 notify.7 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.011+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94081631062784] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.011+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94081631080272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591163359c0 con 0x7f44c00c0060 2024-09-18T01:27:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.011+0000 7f44d340f800 20 add_watcher() i=0 2024-09-18T01:27:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.011+0000 7f44d340f800 20 add_watcher() i=1 2024-09-18T01:27:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.011+0000 7f44d340f800 20 add_watcher() i=2 2024-09-18T01:27:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.011+0000 7f44d340f800 20 add_watcher() i=3 2024-09-18T01:27:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.011+0000 7f44d340f800 20 add_watcher() i=4 2024-09-18T01:27:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.011+0000 7f44d340f800 20 add_watcher() i=5 2024-09-18T01:27:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.011+0000 7f44d340f800 20 add_watcher() i=6 2024-09-18T01:27:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.012+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94081631080272] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.012+0000 7f44d340f800 20 add_watcher() i=7 2024-09-18T01:27:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.012+0000 7f44d340f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.012+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5591163359c0 con 0x559116321fa0 2024-09-18T01:27:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.012+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.012+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94081631081552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116336290 con 0x559116321fa0 2024-09-18T01:27:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.013+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94081631081552] v35'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.013+0000 7f43857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.013+0000 7f44d340f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.013+0000 7f44d340f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.013+0000 7f44d340f800 5 note: GC not initialized 2024-09-18T01:27:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.013+0000 7f42fffff640 20 reqs_thread_entry: start 2024-09-18T01:27:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.014+0000 7f44d340f800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.014+0000 7f44d340f800 20 Filter name: none 2024-09-18T01:27:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.014+0000 7f42fdffb640 20 reqs_thread_entry: start 2024-09-18T01:27:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.014+0000 7f44d340f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:27:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.014+0000 7f44d340f800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.014+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55911636bee0 con 0x7f44c00c0060 2024-09-18T01:27:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.014+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.014+0000 7f44d340f800 20 rados_obj.operate() r=0 bl.length=460 2024-09-18T01:27:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.014+0000 7f44d340f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:27:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.014+0000 7f44d340f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.014+0000 7f44d340f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:27:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.014+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116372590 con 0x7f44c00c0060 2024-09-18T01:27:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.016+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v35'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.016+0000 7f44d340f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.016+0000 7f44d340f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.016+0000 7f44d340f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:27:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.016+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94081631330128 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55911636dbd0 con 0x559116321fa0 2024-09-18T01:27:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.016+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== watch-notify(notify (1) cookie 94081631072896 notify 150323855416 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f44c8026410 con 0x559116321fa0 2024-09-18T01:27:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.016+0000 7f43b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855416 cookie 94081631072896 notifier 4923 bl.length()=649 2024-09-18T01:27:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.016+0000 7f43b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.016+0000 7f43b27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.016+0000 7f43b27fc640 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f4394003ea0 con 0x559116321fa0 2024-09-18T01:27:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.016+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 notify.4 [notify cookie 94081631330128 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.016+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.016+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== watch-notify(notify_complete (2) cookie 94081631330128 notify 150323855416 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f44c80265e0 con 0x559116321fa0 2024-09-18T01:27:16.030 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:27:14.265685Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:27:14.265676Z","tags":[],"group_ids":[]} 2024-09-18T01:27:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.017+0000 7f43857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.017+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94081631081552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55911636e390 con 0x559116321fa0 2024-09-18T01:27:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.018+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94081631081552] v35'276 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.018+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94081631057344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55911636e390 con 0x559116326990 2024-09-18T01:27:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.019+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94081631057344] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.019+0000 7f44d340f800 20 remove_watcher() i=0 2024-09-18T01:27:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.019+0000 7f44d340f800 2 removed watcher, disabling cache 2024-09-18T01:27:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.019+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94081631060656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116369c00 con 0x559116321fa0 2024-09-18T01:27:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.020+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94081631060656] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.020+0000 7f44d340f800 20 remove_watcher() i=1 2024-09-18T01:27:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.020+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94081631065632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116369c00 con 0x55911632b340 2024-09-18T01:27:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.021+0000 7f44c62e6640 1 -- 172.21.15.100:0/2652904120 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94081631065632] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b8009050 con 0x55911632b340 2024-09-18T01:27:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.021+0000 7f44d340f800 20 remove_watcher() i=2 2024-09-18T01:27:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.021+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94081631069264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591163302b0 con 0x559116326990 2024-09-18T01:27:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.022+0000 7f44ceae7640 1 -- 172.21.15.100:0/2652904120 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94081631069264] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c00bd030 con 0x559116326990 2024-09-18T01:27:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.022+0000 7f44d340f800 20 remove_watcher() i=3 2024-09-18T01:27:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.022+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94081631072896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116331620 con 0x559116321fa0 2024-09-18T01:27:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.023+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94081631072896] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x559116321fa0 2024-09-18T01:27:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.023+0000 7f44d340f800 20 remove_watcher() i=4 2024-09-18T01:27:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.023+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94081631076896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116332450 con 0x7f44c00c0060 2024-09-18T01:27:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.024+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94081631076896] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.024+0000 7f44d340f800 20 remove_watcher() i=5 2024-09-18T01:27:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.024+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94081631062784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5591163302b0 con 0x7f44c00c0060 2024-09-18T01:27:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.025+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94081631062784] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.025+0000 7f44d340f800 20 remove_watcher() i=6 2024-09-18T01:27:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.025+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94081631080272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559116333280 con 0x7f44c00c0060 2024-09-18T01:27:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.026+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94081631080272] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c800a4a0 con 0x7f44c00c0060 2024-09-18T01:27:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.026+0000 7f44d340f800 20 remove_watcher() i=7 2024-09-18T01:27:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f44c00c0060 msgr2=0x7f44c0078210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f44c00c0060 0x7f44c0078210 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559116321fa0 msgr2=0x559116324460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x559116321fa0 0x559116324460 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559116326990 msgr2=0x559116328d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x559116326990 0x559116328d80 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55911632b340 msgr2=0x55911632d800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55911632b340 0x55911632d800 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4398036aa0 msgr2=0x7f4398038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4398036aa0 0x7f4398038f60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f44b8001b60 tx=0x7f44b8010000 comp rx=0 tx=0).stop 2024-09-18T01:27:16.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559116316440 msgr2=0x559116316860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 --2- 172.21.15.100:0/2652904120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559116316440 0x559116316860 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f44c008cf70 tx=0x7f44c008cea0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 reap_dead start 2024-09-18T01:27:16.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44cf2e8640 1 -- 172.21.15.100:0/2652904120 reap_dead start 2024-09-18T01:27:16.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 shutdown_connections 2024-09-18T01:27:16.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 >> 172.21.15.100:0/2652904120 conn(0x55911630b390 msgr2=0x559116309460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:16.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 shutdown_connections 2024-09-18T01:27:16.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2652904120 wait complete. 2024-09-18T01:27:16.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2346269737 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f43a8036b90 msgr2=0x7f43a8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 --2- 172.21.15.100:0/2346269737 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f43a8036b90 0x7f43a8039050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f44b800bf50 tx=0x7f44b800f000 comp rx=0 tx=0).stop 2024-09-18T01:27:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2346269737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591163024d0 msgr2=0x5591163028f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 --2- 172.21.15.100:0/2346269737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591163024d0 0x5591163028f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f44c007ae20 tx=0x7f44c0005260 comp rx=0 tx=0).stop 2024-09-18T01:27:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2346269737 shutdown_connections 2024-09-18T01:27:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 --2- 172.21.15.100:0/2346269737 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f43a8036b90 0x7f43a8039050 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 --2- 172.21.15.100:0/2346269737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591163024d0 0x5591163028f0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2346269737 >> 172.21.15.100:0/2346269737 conn(0x5591162f7460 msgr2=0x5591162f9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2346269737 shutdown_connections 2024-09-18T01:27:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.027+0000 7f44d340f800 1 -- 172.21.15.100:0/2346269737 wait complete. 2024-09-18T01:27:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5591162f1ce0 msgr2=0x5591162f40d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44d340f800 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x5591162f1ce0 0x5591162f40d0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591161ee720 msgr2=0x5591162eb430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44d340f800 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x5591161ee720 0x5591162eb430 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591162edda0 msgr2=0x5591162f0190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44d340f800 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x5591162edda0 0x5591162f0190 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f43b4036b40 msgr2=0x7f43b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44d340f800 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f43b4036b40 0x7f43b4039000 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f44b8000f60 tx=0x7f44b80012b0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 msgr2=0x5591162e43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44d340f800 1 --2- 172.21.15.100:0/3882538937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55911615f650 0x5591162e43c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x5591161eb210 tx=0x7f44c0002fb0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44cf2e8640 1 -- 172.21.15.100:0/3882538937 reap_dead start 2024-09-18T01:27:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 shutdown_connections 2024-09-18T01:27:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 >> 172.21.15.100:0/3882538937 conn(0x5591161e5db0 msgr2=0x5591162d5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 shutdown_connections 2024-09-18T01:27:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.028+0000 7f44d340f800 1 -- 172.21.15.100:0/3882538937 wait complete. 2024-09-18T01:27:16.043 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:16.043 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:16.043 ERROR:root:0 2024-09-18T01:27:16.044 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:27:16.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:27:16.044 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-18T01:27:16.090 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:27:16.090 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:27:16.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.090+0000 7f9aa6e0e800 1 Processor -- start 2024-09-18T01:27:16.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.090+0000 7f9aa6e0e800 1 -- start start 2024-09-18T01:27:16.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.090+0000 7f9aa6e0e800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ed72fb8d40 0x55ed72fbb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.090+0000 7f9aa6e0e800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ed72e71b30 con 0x55ed72f25df0 2024-09-18T01:27:16.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.090+0000 7f9aa6e0e800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x55ed72e53360 con 0x55ed72fb8d40 2024-09-18T01:27:16.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.090+0000 7f9a99d74640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ed72fb8d40 0x55ed72fbb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.090+0000 7f9aa2575640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x55ed72f25df0 0x55ed72fb7620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:37302/0 (socket says 172.21.15.100:37302) 2024-09-18T01:27:16.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.090+0000 7f9aa2575640 1 -- 172.21.15.100:0/815560283 learned_addr learned my addr 172.21.15.100:0/815560283 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:27:16.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.090+0000 7f9a99d74640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x55ed72fb8d40 0x55ed72fbb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45984/0 (socket says 172.21.15.100:45984) 2024-09-18T01:27:16.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.091+0000 7f9a99d74640 1 -- 172.21.15.100:0/815560283 >> v1:172.21.15.92:6789/0 conn(0x55ed72f25df0 legacy=0x55ed72fb7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.091+0000 7f9a99d74640 1 -- 172.21.15.100:0/815560283 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed72e79e00 con 0x55ed72fb8d40 2024-09-18T01:27:16.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.092+0000 7f9a99d74640 1 --2- 172.21.15.100:0/815560283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72fb8d40 0x55ed72fbb130 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00a470 tx=0x7f9a8c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cf6dd9932ec4a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.093+0000 7f9aa1d74640 1 -- 172.21.15.100:0/815560283 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a8c053570 con 0x55ed72fb8d40 2024-09-18T01:27:16.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.093+0000 7f9aa1d74640 1 -- 172.21.15.100:0/815560283 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a8c058070 con 0x55ed72fb8d40 2024-09-18T01:27:16.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.093+0000 7f9aa1d74640 1 -- 172.21.15.100:0/815560283 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a8c053880 con 0x55ed72fb8d40 2024-09-18T01:27:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.093+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/815560283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72fb8d40 msgr2=0x55ed72fbb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.093+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/815560283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72fb8d40 0x55ed72fbb130 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00a470 tx=0x7f9a8c045a20 comp rx=0 tx=0).stop 2024-09-18T01:27:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.093+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/815560283 shutdown_connections 2024-09-18T01:27:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.093+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/815560283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72fb8d40 0x55ed72fbb130 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.093+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/815560283 >> 172.21.15.100:0/815560283 conn(0x55ed72facdd0 msgr2=0x55ed72faf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.093+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/815560283 shutdown_connections 2024-09-18T01:27:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.093+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/815560283 wait complete. 2024-09-18T01:27:16.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.107+0000 7f9aa6e0e800 1 Processor -- start 2024-09-18T01:27:16.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.107+0000 7f9aa6e0e800 1 -- start start 2024-09-18T01:27:16.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.107+0000 7f9aa6e0e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72f25df0 0x55ed730a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.107+0000 7f9aa6e0e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ed72efe360 con 0x55ed72f25df0 2024-09-18T01:27:16.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.107+0000 7f9aa2575640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72f25df0 0x55ed730a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.107+0000 7f9aa2575640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72f25df0 0x55ed730a3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:45992/0 (socket says 172.21.15.100:45992) 2024-09-18T01:27:16.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.107+0000 7f9aa2575640 1 -- 172.21.15.100:0/1920874392 learned_addr learned my addr 172.21.15.100:0/1920874392 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:16.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.108+0000 7f9aa2575640 1 -- 172.21.15.100:0/1920874392 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed72e4bbc0 con 0x55ed72f25df0 2024-09-18T01:27:16.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.108+0000 7f9aa2575640 1 --2- 172.21.15.100:0/1920874392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72f25df0 0x55ed730a3af0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9a94001e10 tx=0x7f9a9400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c25b6240f4e897 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.108+0000 7f9990608640 1 -- 172.21.15.100:0/1920874392 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a94012020 con 0x55ed72f25df0 2024-09-18T01:27:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.108+0000 7f9990608640 1 -- 172.21.15.100:0/1920874392 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9400e5a0 con 0x55ed72f25df0 2024-09-18T01:27:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.108+0000 7f9990608640 1 -- 172.21.15.100:0/1920874392 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a9400e8e0 con 0x55ed72f25df0 2024-09-18T01:27:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.109+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1920874392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72f25df0 msgr2=0x55ed730a3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.109+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/1920874392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72f25df0 0x55ed730a3af0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9a94001e10 tx=0x7f9a9400b780 comp rx=0 tx=0).stop 2024-09-18T01:27:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.109+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1920874392 shutdown_connections 2024-09-18T01:27:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.109+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/1920874392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72f25df0 0x55ed730a3af0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.109+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1920874392 >> 172.21.15.100:0/1920874392 conn(0x55ed72facdd0 msgr2=0x55ed7309f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.109+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1920874392 shutdown_connections 2024-09-18T01:27:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.109+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1920874392 wait complete. 2024-09-18T01:27:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.109+0000 7f9aa6e0e800 1 Processor -- start 2024-09-18T01:27:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.109+0000 7f9aa6e0e800 1 -- start start 2024-09-18T01:27:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.109+0000 7f9aa6e0e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72f25df0 0x55ed730ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.109+0000 7f9aa6e0e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ed72fbb910 con 0x55ed72f25df0 2024-09-18T01:27:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.109+0000 7f9aa2575640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72f25df0 0x55ed730ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.109+0000 7f9aa2575640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72f25df0 0x55ed730ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:46000/0 (socket says 172.21.15.100:46000) 2024-09-18T01:27:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.109+0000 7f9aa2575640 1 -- 172.21.15.100:0/1136595929 learned_addr learned my addr 172.21.15.100:0/1136595929 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.110+0000 7f9aa2575640 1 -- 172.21.15.100:0/1136595929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed72e5ffe0 con 0x55ed72f25df0 2024-09-18T01:27:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.110+0000 7f9aa2575640 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72f25df0 0x55ed730ab4d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9a94001e10 tx=0x7f9a94000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.110+0000 7f998ee05640 1 -- 172.21.15.100:0/1136595929 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a94012030 con 0x55ed72f25df0 2024-09-18T01:27:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.110+0000 7f998ee05640 1 -- 172.21.15.100:0/1136595929 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9401a7a0 con 0x55ed72f25df0 2024-09-18T01:27:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.110+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed730aba10 con 0x55ed72f25df0 2024-09-18T01:27:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.110+0000 7f998ee05640 1 -- 172.21.15.100:0/1136595929 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a9401aac0 con 0x55ed72f25df0 2024-09-18T01:27:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.110+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed730abf30 con 0x55ed72f25df0 2024-09-18T01:27:16.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.111+0000 7f998ee05640 1 -- 172.21.15.100:0/1136595929 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9a94015020 con 0x55ed72f25df0 2024-09-18T01:27:16.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.111+0000 7f998ee05640 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9988036b40 0x7f9988039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.111+0000 7f998ee05640 1 -- 172.21.15.100:0/1136595929 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f9a94020030 con 0x55ed72f25df0 2024-09-18T01:27:16.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.111+0000 7f9a99d74640 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9988036b40 0x7f9988039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.111+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ed72fb8d40 0x55ed730b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.111+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730b2a80 con 0x55ed72fb8d40 2024-09-18T01:27:16.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.111+0000 7f9aa2d76640 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ed72fb8d40 0x55ed730b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.111+0000 7f9a99d74640 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9988036b40 0x7f9988039000 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c057000 tx=0x7f9a8c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.112+0000 7f9aa2d76640 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ed72fb8d40 0x55ed730b2540 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.112+0000 7f9aa2d76640 1 -- 172.21.15.100:0/1136595929 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed72fb8d40 2024-09-18T01:27:16.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.112+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730afb10 con 0x55ed72fb8d40 2024-09-18T01:27:16.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.112+0000 7f9aa2d76640 1 -- 172.21.15.100:0/1136595929 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed72fb8d40 2024-09-18T01:27:16.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.112+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ed730b4d90 0x55ed730b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.112+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730b7820 con 0x55ed730b4d90 2024-09-18T01:27:16.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.112+0000 7f9aa2575640 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ed730b4d90 0x55ed730b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.112+0000 7f9aa2575640 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ed730b4d90 0x55ed730b7180 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.113+0000 7f9aa2575640 1 -- 172.21.15.100:0/1136595929 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730b4d90 2024-09-18T01:27:16.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.113+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730b3c30 con 0x55ed72fb8d40 2024-09-18T01:27:16.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.113+0000 7f9aa2d76640 1 -- 172.21.15.100:0/1136595929 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed72fb8d40 2024-09-18T01:27:16.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.113+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ed730b8c80 0x55ed730bb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.113+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730bb770 con 0x55ed730b8c80 2024-09-18T01:27:16.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.113+0000 7f9a99d74640 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ed730b8c80 0x55ed730bb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.114+0000 7f9a99d74640 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ed730b8c80 0x55ed730bb070 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.114+0000 7f9a99d74640 1 -- 172.21.15.100:0/1136595929 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730b8c80 2024-09-18T01:27:16.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.114+0000 7f9aa6e0e800 1 Processor -- start 2024-09-18T01:27:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.114+0000 7f9aa6e0e800 1 -- start start 2024-09-18T01:27:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.114+0000 7f9aa6e0e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730c9520 0x55ed730c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.114+0000 7f9aa6e0e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ed72e4d580 con 0x55ed730c9520 2024-09-18T01:27:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.115+0000 7f9aa2575640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730c9520 0x55ed730c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.115+0000 7f9aa2575640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730c9520 0x55ed730c9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:46004/0 (socket says 172.21.15.100:46004) 2024-09-18T01:27:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.115+0000 7f9aa2575640 1 -- 172.21.15.100:0/3492661971 learned_addr learned my addr 172.21.15.100:0/3492661971 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.115+0000 7f9aa2575640 1 -- 172.21.15.100:0/3492661971 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed730c9e80 con 0x55ed730c9520 2024-09-18T01:27:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.115+0000 7f9aa2575640 1 --2- 172.21.15.100:0/3492661971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730c9520 0x55ed730c9940 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9a9404afe0 tx=0x7f9a94018640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.115+0000 7f9987fff640 1 -- 172.21.15.100:0/3492661971 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a94016530 con 0x55ed730c9520 2024-09-18T01:27:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.115+0000 7f9987fff640 1 -- 172.21.15.100:0/3492661971 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a94017c50 con 0x55ed730c9520 2024-09-18T01:27:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.115+0000 7f9987fff640 1 -- 172.21.15.100:0/3492661971 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a94044050 con 0x55ed730c9520 2024-09-18T01:27:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.115+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/3492661971 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed730ca110 con 0x55ed730c9520 2024-09-18T01:27:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.115+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/3492661971 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed730ccdf0 con 0x55ed730c9520 2024-09-18T01:27:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.116+0000 7f9987fff640 1 -- 172.21.15.100:0/3492661971 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9a940441f0 con 0x55ed730c9520 2024-09-18T01:27:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.116+0000 7f9987fff640 1 --2- 172.21.15.100:0/3492661971 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f997c036b90 0x7f997c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.116+0000 7f9987fff640 1 -- 172.21.15.100:0/3492661971 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f9a94038d90 con 0x55ed730c9520 2024-09-18T01:27:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.116+0000 7f9a99d74640 1 --2- 172.21.15.100:0/3492661971 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f997c036b90 0x7f997c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.117+0000 7f9aa6e0e800 1 Processor -- start 2024-09-18T01:27:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.117+0000 7f9aa6e0e800 1 -- start start 2024-09-18T01:27:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.117+0000 7f9a99d74640 1 --2- 172.21.15.100:0/3492661971 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f997c036b90 0x7f997c039050 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55ed730afa30 tx=0x7f9a8c005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.117+0000 7f9aa6e0e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730d5f50 0x55ed730d6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.117+0000 7f9aa6e0e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ed730a42a0 con 0x55ed730d5f50 2024-09-18T01:27:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.117+0000 7f9aa2575640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730d5f50 0x55ed730d6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.117+0000 7f9aa2575640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730d5f50 0x55ed730d6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:46014/0 (socket says 172.21.15.100:46014) 2024-09-18T01:27:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.117+0000 7f9aa2575640 1 -- 172.21.15.100:0/2920022813 learned_addr learned my addr 172.21.15.100:0/2920022813 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.117+0000 7f9aa2575640 1 -- 172.21.15.100:0/2920022813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed730d6920 con 0x55ed730d5f50 2024-09-18T01:27:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.117+0000 7f9aa2575640 1 --2- 172.21.15.100:0/2920022813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730d5f50 0x55ed730d6350 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9a94026040 tx=0x7f9a940246c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f5834f9b2d617f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.117+0000 7f9985ffb640 1 -- 172.21.15.100:0/2920022813 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a9405d070 con 0x55ed730d5f50 2024-09-18T01:27:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.117+0000 7f9985ffb640 1 -- 172.21.15.100:0/2920022813 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9404c750 con 0x55ed730d5f50 2024-09-18T01:27:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.117+0000 7f9985ffb640 1 -- 172.21.15.100:0/2920022813 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a9402ee10 con 0x55ed730d5f50 2024-09-18T01:27:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.118+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/2920022813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730d5f50 msgr2=0x55ed730d6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.118+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/2920022813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730d5f50 0x55ed730d6350 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9a94026040 tx=0x7f9a940246c0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.118+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/2920022813 shutdown_connections 2024-09-18T01:27:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.118+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/2920022813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730d5f50 0x55ed730d6350 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.118+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/2920022813 >> 172.21.15.100:0/2920022813 conn(0x55ed730d2350 msgr2=0x55ed730d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.118+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/2920022813 shutdown_connections 2024-09-18T01:27:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.118+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/2920022813 wait complete. 2024-09-18T01:27:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.118+0000 7f9aa6e0e800 1 Processor -- start 2024-09-18T01:27:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.118+0000 7f9aa6e0e800 1 -- start start 2024-09-18T01:27:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.118+0000 7f9aa6e0e800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730d5f50 0x55ed730dd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.118+0000 7f9aa6e0e800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ed730d6e00 con 0x55ed730d5f50 2024-09-18T01:27:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.119+0000 7f9aa2575640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730d5f50 0x55ed730dd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.119+0000 7f9aa2575640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730d5f50 0x55ed730dd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:46018/0 (socket says 172.21.15.100:46018) 2024-09-18T01:27:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.119+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 learned_addr learned my addr 172.21.15.100:0/213959014 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:27:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.119+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed730dd790 con 0x55ed730d5f50 2024-09-18T01:27:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.119+0000 7f9aa2575640 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730d5f50 0x55ed730dd250 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9a9404a4c0 tx=0x7f9a94012ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.119+0000 7f9973fff640 1 -- 172.21.15.100:0/213959014 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a94068020 con 0x55ed730d5f50 2024-09-18T01:27:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.119+0000 7f9973fff640 1 -- 172.21.15.100:0/213959014 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a940447f0 con 0x55ed730d5f50 2024-09-18T01:27:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.119+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed730dd790 con 0x55ed730d5f50 2024-09-18T01:27:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.119+0000 7f9973fff640 1 -- 172.21.15.100:0/213959014 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a9405d030 con 0x55ed730d5f50 2024-09-18T01:27:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.119+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed730dd790 con 0x55ed730d5f50 2024-09-18T01:27:16.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.120+0000 7f9973fff640 1 -- 172.21.15.100:0/213959014 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9a9406b020 con 0x55ed730d5f50 2024-09-18T01:27:16.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.120+0000 7f9973fff640 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f996c036b90 0x7f996c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.120+0000 7f9973fff640 1 -- 172.21.15.100:0/213959014 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f9a9405e070 con 0x55ed730d5f50 2024-09-18T01:27:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.120+0000 7f9a99d74640 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f996c036b90 0x7f996c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.121+0000 7f9a99d74640 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f996c036b90 0x7f996c039050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c053570 tx=0x7f9a8c053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.121+0000 7f9aa6e0e800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.121+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ed730e8a10 0x55ed730eaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.121+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730eb620 con 0x55ed730e8a10 2024-09-18T01:27:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.121+0000 7f9aa2d76640 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ed730e8a10 0x55ed730eaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.121+0000 7f9aa2d76640 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ed730e8a10 0x55ed730eaed0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.121+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.121+0000 7f9aa6e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa6e0e800 20 realm 2024-09-18T01:27:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa6e0e800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730eba30 con 0x55ed730e8a10 2024-09-18T01:27:16.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa6e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:16.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa6e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:27:16.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa6e0e800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec300 con 0x55ed730e8a10 2024-09-18T01:27:16.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa6e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:16.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa6e0e800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730e8a10 2024-09-18T01:27:16.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa6e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:16.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa6e0e800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ed730ed400 0x55ed730ef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730efe00 con 0x55ed730ed400 2024-09-18T01:27:16.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.122+0000 7f9aa2575640 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ed730ed400 0x55ed730ef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.123+0000 7f9aa2575640 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ed730ed400 0x55ed730ef7f0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.123+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.123+0000 7f9aa6e0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:27:16.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.123+0000 7f9aa6e0e800 20 searching for the correct realm 2024-09-18T01:27:16.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.123+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ed730f1db0 0x55ed730f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.123+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f4940 con 0x55ed730f1db0 2024-09-18T01:27:16.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.123+0000 7f9a99d74640 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ed730f1db0 0x55ed730f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.123+0000 7f9a99d74640 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ed730f1db0 0x55ed730f4270 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.124+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730f1db0 2024-09-18T01:27:16.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.124+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f4940 con 0x55ed730ed400 2024-09-18T01:27:16.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.124+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.124+0000 7f9aa2575640 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9a94078040 0x7f9a9404a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:27:16.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.124+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f4940 con 0x7f9a94078040 2024-09-18T01:27:16.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.124+0000 7f9aa2d76640 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9a94078040 0x7f9a9404a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:27:16.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.124+0000 7f9aa2d76640 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9a94078040 0x7f9a9404a730 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:27:16.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.125+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.125+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730e8a10 2024-09-18T01:27:16.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.125+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.125+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730e8a10 2024-09-18T01:27:16.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.125+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.125+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x7f9a94078040 2024-09-18T01:27:16.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.125+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.125+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x7f9a94078040 2024-09-18T01:27:16.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.125+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.125+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730ed400 2024-09-18T01:27:16.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.126+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.126+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730f1db0 2024-09-18T01:27:16.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.126+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730f1db0 2024-09-18T01:27:16.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.126+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730e8a10 2024-09-18T01:27:16.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.126+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.126+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730ed400 2024-09-18T01:27:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.126+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.126+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730e8a10 2024-09-18T01:27:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.127+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.127+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730ed400 2024-09-18T01:27:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.127+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.127+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730f1db0 2024-09-18T01:27:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.127+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730f1db0 2024-09-18T01:27:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.127+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730f1db0 2024-09-18T01:27:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.127+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730f1db0 2024-09-18T01:27:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.127+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x7f9a94078040 2024-09-18T01:27:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.128+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.128+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730f1db0 2024-09-18T01:27:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.128+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730f1db0 2024-09-18T01:27:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.128+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730f1db0 2024-09-18T01:27:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.128+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730f1db0 2024-09-18T01:27:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.128+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730e8a10 2024-09-18T01:27:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.128+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.128+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730e8a10 2024-09-18T01:27:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.128+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.128+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x7f9a94078040 2024-09-18T01:27:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.129+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.129+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730f1db0 2024-09-18T01:27:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.129+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730f1db0 2024-09-18T01:27:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.129+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730ed400 2024-09-18T01:27:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.129+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.129+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730e8a10 2024-09-18T01:27:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.129+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.129+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x7f9a94078040 2024-09-18T01:27:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.130+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.130+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730f1db0 2024-09-18T01:27:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.130+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730f1db0 2024-09-18T01:27:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.130+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730ed400 2024-09-18T01:27:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.130+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.130+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730ed400 2024-09-18T01:27:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.130+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.130+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730f1db0 2024-09-18T01:27:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730f1db0 2024-09-18T01:27:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x7f9a94078040 2024-09-18T01:27:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730e8a10 2024-09-18T01:27:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ec6a0 con 0x55ed730ed400 2024-09-18T01:27:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9aa6e0e800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:27:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9aa6e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:27:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9aa6e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:27:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9aa6e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:27:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9aa6e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:27:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9aa6e0e800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:27:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9aa6e0e800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.131+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f06c0 con 0x55ed730e8a10 2024-09-18T01:27:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f0ab0 con 0x55ed730e8a10 2024-09-18T01:27:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:27:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f0ab0 con 0x7f9a94078040 2024-09-18T01:27:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:27:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 20 zone default found 2024-09-18T01:27:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 4 Realm: () 2024-09-18T01:27:16.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:27:16.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:27:16.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:27:16.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 20 zonegroup default 2024-09-18T01:27:16.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.132+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f0300 con 0x7f9a94078040 2024-09-18T01:27:16.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.133+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.133+0000 7f9aa6e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:16.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.133+0000 7f9aa6e0e800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.133+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f67a0 con 0x55ed730f1db0 2024-09-18T01:27:16.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.133+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730f1db0 2024-09-18T01:27:16.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.133+0000 7f9aa6e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.133+0000 7f9aa6e0e800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.133+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f6b40 con 0x55ed730f1db0 2024-09-18T01:27:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.133+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730f1db0 2024-09-18T01:27:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.133+0000 7f9aa6e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:27:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.133+0000 7f9aa6e0e800 20 started sync module instance, tier type = 2024-09-18T01:27:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.133+0000 7f9aa6e0e800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:27:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.133+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f5c40 con 0x55ed730ed400 2024-09-18T01:27:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.134+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.134+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94478325995408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f6ee0 con 0x55ed730ed400 2024-09-18T01:27:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.134+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f7770 con 0x55ed730e8a10 2024-09-18T01:27:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.135+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94478325995408] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.136+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.136+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94478325997664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f7b60 con 0x55ed730e8a10 2024-09-18T01:27:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.136+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f8560 con 0x55ed730f1db0 2024-09-18T01:27:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.137+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730f1db0 2024-09-18T01:27:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.137+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94478326005872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f8e30 con 0x55ed730f1db0 2024-09-18T01:27:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.137+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f9900 con 0x55ed730ed400 2024-09-18T01:27:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.137+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94478325997664] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.138+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94478326005872] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730f1db0 2024-09-18T01:27:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.138+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.138+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94478326002304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730f9cf0 con 0x55ed730ed400 2024-09-18T01:27:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.138+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730fa580 con 0x55ed730e8a10 2024-09-18T01:27:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.139+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94478326002304] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.139+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.139+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94478326010816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730fa1a0 con 0x55ed730e8a10 2024-09-18T01:27:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.139+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730faf90 con 0x7f9a94078040 2024-09-18T01:27:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.140+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.140+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94478326016736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730fb3b0 con 0x7f9a94078040 2024-09-18T01:27:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.140+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730fbe70 con 0x7f9a94078040 2024-09-18T01:27:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.140+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94478326010816] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.141+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94478326016736] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.141+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.141+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94478326020416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730faf00 con 0x7f9a94078040 2024-09-18T01:27:16.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.141+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730fc500 con 0x7f9a94078040 2024-09-18T01:27:16.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.142+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94478326020416] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.142+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(58 notify.7 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.142+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94478326013168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730fc500 con 0x7f9a94078040 2024-09-18T01:27:16.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.142+0000 7f9aa6e0e800 20 add_watcher() i=0 2024-09-18T01:27:16.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.142+0000 7f9aa6e0e800 20 add_watcher() i=1 2024-09-18T01:27:16.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.142+0000 7f9aa6e0e800 20 add_watcher() i=2 2024-09-18T01:27:16.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.142+0000 7f9aa6e0e800 20 add_watcher() i=3 2024-09-18T01:27:16.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.142+0000 7f9aa6e0e800 20 add_watcher() i=4 2024-09-18T01:27:16.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.142+0000 7f9aa6e0e800 20 add_watcher() i=5 2024-09-18T01:27:16.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.142+0000 7f9aa6e0e800 20 add_watcher() i=6 2024-09-18T01:27:16.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.143+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94478326013168] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.143+0000 7f9aa6e0e800 20 add_watcher() i=7 2024-09-18T01:27:16.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.143+0000 7f9aa6e0e800 2 all 8 watchers are set, enabling cache 2024-09-18T01:27:16.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.143+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed730ff810 con 0x55ed730e8a10 2024-09-18T01:27:16.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.144+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.144+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94478326022592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed730fca90 con 0x55ed730e8a10 2024-09-18T01:27:16.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.145+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94478326022592] v35'277 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.145+0000 7f9958fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:16.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.145+0000 7f9aa6e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:27:16.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.145+0000 7f9aa6e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:27:16.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.145+0000 7f9aa6e0e800 5 note: GC not initialized 2024-09-18T01:27:16.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.145+0000 7f98d37fe640 20 reqs_thread_entry: start 2024-09-18T01:27:16.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.145+0000 7f9aa6e0e800 20 init_complete bucket index max shards: 11 2024-09-18T01:27:16.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.145+0000 7f9aa6e0e800 20 Filter name: none 2024-09-18T01:27:16.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.145+0000 7f98d17fa640 20 reqs_thread_entry: start 2024-09-18T01:27:16.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.146+0000 7f9aa6e0e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:27:16.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.146+0000 7f9aa6e0e800 20 rados->read ofs=0 len=0 2024-09-18T01:27:16.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.146+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed73132aa0 con 0x7f9a94078040 2024-09-18T01:27:16.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.146+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.146+0000 7f9aa6e0e800 20 rados_obj.operate() r=0 bl.length=473 2024-09-18T01:27:16.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.146+0000 7f9aa6e0e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:27:16.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.146+0000 7f9aa6e0e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:16.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.146+0000 7f9aa6e0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:27:16.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.146+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed73139450 con 0x7f9a94078040 2024-09-18T01:27:16.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.148+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v35'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.148+0000 7f9aa6e0e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:16.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.148+0000 7f9aa6e0e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:16.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.148+0000 7f9aa6e0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:27:16.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.148+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94478326271504 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ed73134ab0 con 0x55ed730e8a10 2024-09-18T01:27:16.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.148+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== watch-notify(notify (1) cookie 94478326010816 notify 150323855417 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f9a9c026410 con 0x55ed730e8a10 2024-09-18T01:27:16.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.148+0000 7f9985ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855417 cookie 94478326010816 notifier 4930 bl.length()=649 2024-09-18T01:27:16.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.148+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(64 notify.4 [notify cookie 94478326271504 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.148+0000 7f9985ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:27:16.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.148+0000 7f9985ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:27:16.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.148+0000 7f9985ffb640 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f9968003ea0 con 0x55ed730e8a10 2024-09-18T01:27:16.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.148+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.148+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== watch-notify(notify_complete (2) cookie 94478326271504 notify 150323855417 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9a9c0265e0 con 0x55ed730e8a10 2024-09-18T01:27:16.163 INFO:teuthology.orchestra.run.smithi100.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:27:14.265685Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:27:14.265676Z","tags":[],"group_ids":[]} 2024-09-18T01:27:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.149+0000 7f9958fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:27:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.149+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94478326022592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed73135270 con 0x55ed730e8a10 2024-09-18T01:27:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.150+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94478326022592] v35'278 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.150+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94478325995408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed73135270 con 0x55ed730ed400 2024-09-18T01:27:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.151+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94478325995408] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.151+0000 7f9aa6e0e800 20 remove_watcher() i=0 2024-09-18T01:27:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.151+0000 7f9aa6e0e800 2 removed watcher, disabling cache 2024-09-18T01:27:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.151+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94478325997664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed73135270 con 0x55ed730e8a10 2024-09-18T01:27:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.153+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94478325997664] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.153+0000 7f9aa6e0e800 20 remove_watcher() i=1 2024-09-18T01:27:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.153+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94478326005872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed73135270 con 0x55ed730f1db0 2024-09-18T01:27:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.154+0000 7f9a99d74640 1 -- 172.21.15.100:0/213959014 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94478326005872] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a8c051070 con 0x55ed730f1db0 2024-09-18T01:27:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.154+0000 7f9aa6e0e800 20 remove_watcher() i=2 2024-09-18T01:27:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.154+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94478326002304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed731307c0 con 0x55ed730ed400 2024-09-18T01:27:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.155+0000 7f9aa2575640 1 -- 172.21.15.100:0/213959014 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94478326002304] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9400dcd0 con 0x55ed730ed400 2024-09-18T01:27:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.155+0000 7f9aa6e0e800 20 remove_watcher() i=3 2024-09-18T01:27:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.155+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94478326010816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed731307c0 con 0x55ed730e8a10 2024-09-18T01:27:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.155+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94478326010816] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x55ed730e8a10 2024-09-18T01:27:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.156+0000 7f9aa6e0e800 20 remove_watcher() i=4 2024-09-18T01:27:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.156+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94478326016736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed731307c0 con 0x7f9a94078040 2024-09-18T01:27:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.157+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94478326016736] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.157+0000 7f9aa6e0e800 20 remove_watcher() i=5 2024-09-18T01:27:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.157+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94478326020416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed731307c0 con 0x7f9a94078040 2024-09-18T01:27:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.158+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94478326020416] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.158+0000 7f9aa6e0e800 20 remove_watcher() i=6 2024-09-18T01:27:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.158+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94478326013168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ed731307c0 con 0x7f9a94078040 2024-09-18T01:27:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94478326013168] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c00a4a0 con 0x7f9a94078040 2024-09-18T01:27:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 20 remove_watcher() i=7 2024-09-18T01:27:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9a94078040 msgr2=0x7f9a9404a730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f9a94078040 0x7f9a9404a730 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ed730e8a10 msgr2=0x55ed730eaed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ed730e8a10 0x55ed730eaed0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ed730ed400 msgr2=0x55ed730ef7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ed730ed400 0x55ed730ef7f0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ed730f1db0 msgr2=0x55ed730f4270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x55ed730f1db0 0x55ed730f4270 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f996c036b90 msgr2=0x7f996c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f996c036b90 0x7f996c039050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c053570 tx=0x7f9a8c053000 comp rx=0 tx=0).stop 2024-09-18T01:27:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730d5f50 msgr2=0x55ed730dd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa2d76640 1 -- 172.21.15.100:0/213959014 reap_dead start 2024-09-18T01:27:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730d5f50 0x55ed730dd250 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9a9404a4c0 tx=0x7f9a94012ed0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 shutdown_connections 2024-09-18T01:27:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/213959014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730d5f50 0x55ed730dd250 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 >> 172.21.15.100:0/213959014 conn(0x55ed730d2350 msgr2=0x55ed730d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 shutdown_connections 2024-09-18T01:27:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.159+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/213959014 wait complete. 2024-09-18T01:27:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/3492661971 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f997c036b90 msgr2=0x7f997c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/3492661971 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f997c036b90 0x7f997c039050 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55ed730afa30 tx=0x7f9a8c005a00 comp rx=0 tx=0).stop 2024-09-18T01:27:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/3492661971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730c9520 msgr2=0x55ed730c9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/3492661971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730c9520 0x55ed730c9940 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9a9404afe0 tx=0x7f9a94018640 comp rx=0 tx=0).stop 2024-09-18T01:27:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/3492661971 shutdown_connections 2024-09-18T01:27:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/3492661971 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f997c036b90 0x7f997c039050 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/3492661971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed730c9520 0x55ed730c9940 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/3492661971 >> 172.21.15.100:0/3492661971 conn(0x55ed730be4b0 msgr2=0x55ed730c1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/3492661971 shutdown_connections 2024-09-18T01:27:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/3492661971 wait complete. 2024-09-18T01:27:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ed730b8c80 msgr2=0x55ed730bb070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x55ed730b8c80 0x55ed730bb070 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ed72fb8d40 msgr2=0x55ed730b2540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x55ed72fb8d40 0x55ed730b2540 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ed730b4d90 msgr2=0x55ed730b7180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x55ed730b4d90 0x55ed730b7180 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9988036b40 msgr2=0x7f9988039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f9988036b40 0x7f9988039000 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c057000 tx=0x7f9a8c052000 comp rx=0 tx=0).stop 2024-09-18T01:27:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72f25df0 msgr2=0x55ed730ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:27:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 --2- 172.21.15.100:0/1136595929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed72f25df0 0x55ed730ab4d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9a94001e10 tx=0x7f9a94000ed0 comp rx=0 tx=0).stop 2024-09-18T01:27:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa2d76640 1 -- 172.21.15.100:0/1136595929 reap_dead start 2024-09-18T01:27:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 shutdown_connections 2024-09-18T01:27:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 >> 172.21.15.100:0/1136595929 conn(0x55ed72facdd0 msgr2=0x55ed7309dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:27:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 shutdown_connections 2024-09-18T01:27:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:27:16.160+0000 7f9aa6e0e800 1 -- 172.21.15.100:0/1136595929 wait complete. 2024-09-18T01:27:16.174 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:16.174 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:27:14.265685Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:27:14.265676Z', 'tags': [], 'group_ids': []} 2024-09-18T01:27:16.174 ERROR:root:0 2024-09-18T01:27:16.175 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-18T01:27:16.181 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:16.181 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:16.185 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:16.185 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-18T01:27:16.191 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:16.191 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:16.194 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:16.194 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-18T01:27:16.202 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-18T01:27:16.202 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:16.206 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:16.206 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-18T01:27:16.213 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:27:16.213 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:16.217 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:16.217 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-18T01:27:16.225 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-18T01:27:16.225 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:16.229 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:16.229 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-18T01:27:16.237 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-18T01:27:16.237 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:16.240 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:16.241 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-18T01:27:16.247 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:27:16.247 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:16.251 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:16.251 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-18T01:27:16.256 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:27:16.257 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:16.260 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:16.260 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-18T01:27:16.267 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:27:16.268 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:27:16.271 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:16.272 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-18T01:27:16.275 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-18T01:27:16.276 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-18T01:27:16.280 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-18T01:27:16.292 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-18T01:27:16.295 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-18T01:27:16.296 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-18T01:27:16.300 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2d75eca1-60da-4ca3-af9b-0b09072c949e', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '153b7754-209b-4898-8796-577da7c1273d.4237.11', 'marker': '153b7754-209b-4898-8796-577da7c1273d.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:27:16.287650Z', 'creation_time': '2024-09-18T01:27:16.283960Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T01:27:16.301 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-18T01:27:16.306 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2d75eca1-60da-4ca3-af9b-0b09072c949e', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '153b7754-209b-4898-8796-577da7c1273d.4237.11', 'marker': '153b7754-209b-4898-8796-577da7c1273d.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:27:16.287650Z', 'creation_time': '2024-09-18T01:27:16.283960Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-18T01:27:16.311 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-18T01:27:16.316 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2d75eca1-60da-4ca3-af9b-0b09072c949e', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '153b7754-209b-4898-8796-577da7c1273d.4237.11', 'marker': '153b7754-209b-4898-8796-577da7c1273d.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:27:16.287650Z', 'creation_time': '2024-09-18T01:27:16.283960Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T01:27:16.317 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-18T01:27:16.321 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx000007d40b2e7d04237c8-0066ea2c74-4237-default', 'HostId': '4237-default-default'} 2024-09-18T01:27:16.327 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-18T01:27:16.334 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:27:16.334 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-18T01:27:16.342 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:27:16.389 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '153b7754-209b-4898-8796-577da7c1273d.4237.11'} 2024-09-18T01:27:16.399 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:27:16.404 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '153b7754-209b-4898-8796-577da7c1273d.4237.11'} 2024-09-18T01:27:16.414 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:27:16.414 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-18T01:27:16.423 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:27:16.429 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-18T01:27:16.435 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:27:16.435 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-18T01:27:16.440 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2d75eca1-60da-4ca3-af9b-0b09072c949e', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '153b7754-209b-4898-8796-577da7c1273d.4237.11', 'marker': '153b7754-209b-4898-8796-577da7c1273d.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:27:16.409354Z', 'creation_time': '2024-09-18T01:27:16.283960Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T01:28:16.490 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-18T01:28:16.508 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-18T01:28:16.509 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-18T01:28:16.524 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-18T01:28:16.524 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-18T01:28:16.529 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-18T01:28:16.530 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-18T01:28:16.534 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-18T01:28:16.535 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-18T01:28:16.539 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-18T01:28:16.539 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-18T01:28:16.544 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-18T01:28:16.544 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-18T01:28:16.548 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-18T01:28:16.549 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-18T01:28:16.556 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:28:16.556 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-18T01:28:16.561 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-18T01:28:16.561 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-18T01:28:16.570 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:28:16.574 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-18T01:28:16.583 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:28:16.836 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-18T01:28:16.841 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000eea26bbb18179bf7-0066ea2cb0-4237-default', 'HostId': '4237-default-default'} 2024-09-18T01:28:16.937 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-18T01:28:16.942 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-18T01:28:16.946 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-18T01:28:16.950 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-18T01:28:17.069 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-18T01:28:17.110 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:28:17.110 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-18T01:28:17.116 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-18T01:28:17.116 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-18T01:28:17.122 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-18T01:28:17.134 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-18T01:28:17.138 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000000a7344060121081a-0066ea2cb1-4237-default', 'HostId': '4237-default-default'} 2024-09-18T01:28:17.162 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-18T01:28:17.192 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:28:17.193 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:28:17.197 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000f0cf9a0ad7d9f153-0066ea2cb1-4237-default', 'HostId': '4237-default-default'} 2024-09-18T01:28:17.198 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-18T01:28:17.201 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'b78e7965-b05a-4410-91d0-045de6d3262c'}]}} 2024-09-18T01:28:17.202 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-18T01:28:17.212 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:28:17.212 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-18T01:28:17.216 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-18T01:28:17.216 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-18T01:28:17.220 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b365f3c587394ccb-0066ea2cb1-4237-default', 'HostId': '4237-default-default'} 2024-09-18T01:28:17.221 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-18T01:28:17.224 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000c3b2bceb085a3627-0066ea2cb1-4237-default', 'HostId': '4237-default-default'} 2024-09-18T01:28:17.235 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-18T01:28:17.240 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-18T01:28:17.240 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-18T01:28:17.244 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000d5db98b730a37765-0066ea2cb1-4237-default', 'HostId': '4237-default-default'} 2024-09-18T01:28:17.244 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-18T01:28:17.248 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000009290641ac0f922af-0066ea2cb1-4237-default', 'HostId': '4237-default-default'} 2024-09-18T01:28:17.248 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-18T01:28:17.251 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-18T01:28:17.252 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-18T01:28:17.255 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000fa152e25a0c09ba4-0066ea2cb1-4237-default', 'HostId': '4237-default-default'} 2024-09-18T01:28:17.255 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-18T01:28:17.259 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000046eedbe0bb90bfbf-0066ea2cb1-4237-default', 'HostId': '4237-default-default'} 2024-09-18T01:28:17.259 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-18T01:28:17.262 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000242134136f3f6ed8-0066ea2cb1-4237-default', 'HostId': '4237-default-default'} 2024-09-18T01:28:17.263 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-18T01:28:17.266 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000fe75dc88ddefb1bf-0066ea2cb1-4237-default', 'HostId': '4237-default-default'} 2024-09-18T01:28:17.266 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-18T01:28:17.275 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:28:17.276 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-18T01:28:17.279 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-18T01:28:17.279 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-18T01:28:17.289 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:28:17.289 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-18T01:28:17.293 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-18T01:28:17.293 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-18T01:28:17.298 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:28:17.303 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-18T01:28:17.311 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-18T01:28:17.311 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T01:28:17.313 INFO:tasks.rgw.client.0.smithi100.stdout:2024-09-18T01:28:17.311+0000 7fa507a77640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 35789) UID: 0 2024-09-18T01:28:17.313 INFO:tasks.rgw.client.0.smithi100.stdout:2024-09-18T01:28:17.311+0000 7fa50d326880 -1 shutting down 2024-09-18T01:28:23.413 INFO:tasks.rgw.client.0:Stopped 2024-09-18T01:28:23.414 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-18T01:28:23.433 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/vault-root-token 2024-09-18T01:28:23.503 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-18T01:28:23.571 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-18T01:28:23.571 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-18T01:28:23.571 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-18T01:28:23.658 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:28:23.658 INFO:teuthology.orchestra.run.smithi100.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:28:23.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.657+0000 7f8378921800 1 Processor -- start 2024-09-18T01:28:23.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.657+0000 7f8378921800 1 -- start start 2024-09-18T01:28:23.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.657+0000 7f8378921800 1 --2- >> v2:172.21.15.92:3300/0 conn(0x562585d9b860 0x562585d9dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.657+0000 7f8378921800 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562585c56b30 con 0x562585d0ae90 2024-09-18T01:28:23.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.657+0000 7f8378921800 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x562585c38360 con 0x562585d9b860 2024-09-18T01:28:23.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.657+0000 7f8373e4d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x562585d9b860 0x562585d9dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.657+0000 7f837464e640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x562585d0ae90 0x562585d9a140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.100:52316/0 (socket says 172.21.15.100:52316) 2024-09-18T01:28:23.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.657+0000 7f837464e640 1 -- 172.21.15.100:0/3801595290 learned_addr learned my addr 172.21.15.100:0/3801595290 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-18T01:28:23.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.657+0000 7f8373e4d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x562585d9b860 0x562585d9dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:43182/0 (socket says 172.21.15.100:43182) 2024-09-18T01:28:23.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.657+0000 7f8373e4d640 1 -- 172.21.15.100:0/3801595290 >> v1:172.21.15.92:6789/0 conn(0x562585d0ae90 legacy=0x562585d9a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.657+0000 7f8373e4d640 1 -- 172.21.15.100:0/3801595290 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562585c5ee00 con 0x562585d9b860 2024-09-18T01:28:23.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.659+0000 7f8373e4d640 1 --2- 172.21.15.100:0/3801595290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d9b860 0x562585d9dc70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f836800a470 tx=0x7f8368045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d481a34ec40e0c4e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.659+0000 7f837364c640 1 -- 172.21.15.100:0/3801595290 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8368053570 con 0x562585d9b860 2024-09-18T01:28:23.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.659+0000 7f837364c640 1 -- 172.21.15.100:0/3801595290 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8368058070 con 0x562585d9b860 2024-09-18T01:28:23.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.659+0000 7f837364c640 1 -- 172.21.15.100:0/3801595290 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8368053880 con 0x562585d9b860 2024-09-18T01:28:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.660+0000 7f8378921800 1 -- 172.21.15.100:0/3801595290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d9b860 msgr2=0x562585d9dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.660+0000 7f8378921800 1 --2- 172.21.15.100:0/3801595290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d9b860 0x562585d9dc70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f836800a470 tx=0x7f8368045a20 comp rx=0 tx=0).stop 2024-09-18T01:28:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.660+0000 7f8378921800 1 -- 172.21.15.100:0/3801595290 shutdown_connections 2024-09-18T01:28:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.660+0000 7f8378921800 1 --2- 172.21.15.100:0/3801595290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d9b860 0x562585d9dc70 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.660+0000 7f8378921800 1 -- 172.21.15.100:0/3801595290 >> 172.21.15.100:0/3801595290 conn(0x562585d91df0 msgr2=0x562585d94210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.660+0000 7f8378921800 1 -- 172.21.15.100:0/3801595290 shutdown_connections 2024-09-18T01:28:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.660+0000 7f8378921800 1 -- 172.21.15.100:0/3801595290 wait complete. 2024-09-18T01:28:23.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.675+0000 7f8378921800 1 Processor -- start 2024-09-18T01:28:23.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.675+0000 7f8378921800 1 -- start start 2024-09-18T01:28:23.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.675+0000 7f8378921800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d0ae90 0x562585e86860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.675+0000 7f8378921800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562585ce3330 con 0x562585d0ae90 2024-09-18T01:28:23.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.675+0000 7f837464e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d0ae90 0x562585e86860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.675+0000 7f837464e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d0ae90 0x562585e86860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:43188/0 (socket says 172.21.15.100:43188) 2024-09-18T01:28:23.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.675+0000 7f837464e640 1 -- 172.21.15.100:0/1334641652 learned_addr learned my addr 172.21.15.100:0/1334641652 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:28:23.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.676+0000 7f837464e640 1 -- 172.21.15.100:0/1334641652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562585c30bc0 con 0x562585d0ae90 2024-09-18T01:28:23.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.676+0000 7f837464e640 1 --2- 172.21.15.100:0/1334641652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d0ae90 0x562585e86860 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f83640017a0 tx=0x7f8364001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc571d3c452d3e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.676+0000 7f826260c640 1 -- 172.21.15.100:0/1334641652 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8364016070 con 0x562585d0ae90 2024-09-18T01:28:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.676+0000 7f826260c640 1 -- 172.21.15.100:0/1334641652 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8364004520 con 0x562585d0ae90 2024-09-18T01:28:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.676+0000 7f826260c640 1 -- 172.21.15.100:0/1334641652 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8364004820 con 0x562585d0ae90 2024-09-18T01:28:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.677+0000 7f8378921800 1 -- 172.21.15.100:0/1334641652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d0ae90 msgr2=0x562585e86860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.677+0000 7f8378921800 1 --2- 172.21.15.100:0/1334641652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d0ae90 0x562585e86860 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f83640017a0 tx=0x7f8364001c60 comp rx=0 tx=0).stop 2024-09-18T01:28:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.677+0000 7f8378921800 1 -- 172.21.15.100:0/1334641652 shutdown_connections 2024-09-18T01:28:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.677+0000 7f8378921800 1 --2- 172.21.15.100:0/1334641652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d0ae90 0x562585e86860 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.677+0000 7f8378921800 1 -- 172.21.15.100:0/1334641652 >> 172.21.15.100:0/1334641652 conn(0x562585d91df0 msgr2=0x562585e82220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.677+0000 7f8378921800 1 -- 172.21.15.100:0/1334641652 shutdown_connections 2024-09-18T01:28:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.677+0000 7f8378921800 1 -- 172.21.15.100:0/1334641652 wait complete. 2024-09-18T01:28:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.677+0000 7f8378921800 1 Processor -- start 2024-09-18T01:28:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.677+0000 7f8378921800 1 -- start start 2024-09-18T01:28:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.677+0000 7f8378921800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d0ae90 0x562585e8e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.677+0000 7f8378921800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562585d9e5f0 con 0x562585d0ae90 2024-09-18T01:28:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.678+0000 7f837464e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d0ae90 0x562585e8e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.678+0000 7f837464e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d0ae90 0x562585e8e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:43194/0 (socket says 172.21.15.100:43194) 2024-09-18T01:28:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.678+0000 7f837464e640 1 -- 172.21.15.100:0/349423229 learned_addr learned my addr 172.21.15.100:0/349423229 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:28:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.678+0000 7f837464e640 1 -- 172.21.15.100:0/349423229 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562585c44fe0 con 0x562585d0ae90 2024-09-18T01:28:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.678+0000 7f837464e640 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d0ae90 0x562585e8e2b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8364000f80 tx=0x7f8364001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.678+0000 7f8260e09640 1 -- 172.21.15.100:0/349423229 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8364016040 con 0x562585d0ae90 2024-09-18T01:28:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.678+0000 7f8260e09640 1 -- 172.21.15.100:0/349423229 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8364011530 con 0x562585d0ae90 2024-09-18T01:28:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.678+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562585e8e7f0 con 0x562585d0ae90 2024-09-18T01:28:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.678+0000 7f8260e09640 1 -- 172.21.15.100:0/349423229 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8364011890 con 0x562585d0ae90 2024-09-18T01:28:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.678+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562585e8ed70 con 0x562585d0ae90 2024-09-18T01:28:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.679+0000 7f8260e09640 1 -- 172.21.15.100:0/349423229 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f836401c3f0 con 0x562585d0ae90 2024-09-18T01:28:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.679+0000 7f8260e09640 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f825c036b40 0x7f825c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.680+0000 7f8260e09640 1 -- 172.21.15.100:0/349423229 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f836404bcd0 con 0x562585d0ae90 2024-09-18T01:28:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.680+0000 7f8373e4d640 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f825c036b40 0x7f825c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.680+0000 7f8378921800 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562585d9b860 0x562585e95280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.680+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585e958c0 con 0x562585d9b860 2024-09-18T01:28:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.680+0000 7f8374e4f640 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562585d9b860 0x562585e95280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.680+0000 7f8373e4d640 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f825c036b40 0x7f825c039000 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8368057000 tx=0x7f8368052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.680+0000 7f8374e4f640 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562585d9b860 0x562585e95280 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.680+0000 7f8374e4f640 1 -- 172.21.15.100:0/349423229 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f836c0083e0 con 0x562585d9b860 2024-09-18T01:28:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.680+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585e928d0 con 0x562585d9b860 2024-09-18T01:28:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.681+0000 7f8374e4f640 1 -- 172.21.15.100:0/349423229 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f836c0083e0 con 0x562585d9b860 2024-09-18T01:28:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.681+0000 7f8378921800 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562585e97bc0 0x562585e99fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.681+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:3 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585e9a680 con 0x562585e97bc0 2024-09-18T01:28:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.681+0000 7f837464e640 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562585e97bc0 0x562585e99fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.681+0000 7f837464e640 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562585e97bc0 0x562585e99fb0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.682+0000 7f837464e640 1 -- 172.21.15.100:0/349423229 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(3 zone_info.153b7754-209b-4898-8796-577da7c1273d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8364019050 con 0x562585e97bc0 2024-09-18T01:28:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.682+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585e96a60 con 0x562585d9b860 2024-09-18T01:28:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.682+0000 7f8374e4f640 1 -- 172.21.15.100:0/349423229 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f836c0083e0 con 0x562585d9b860 2024-09-18T01:28:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.682+0000 7f8378921800 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562585e9bae0 0x562585e9ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.682+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:5 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585e9e640 con 0x562585e9bae0 2024-09-18T01:28:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.682+0000 7f8373e4d640 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562585e9bae0 0x562585e9ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.683+0000 7f8373e4d640 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562585e9bae0 0x562585e9ded0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.683+0000 7f8373e4d640 1 -- 172.21.15.100:0/349423229 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(5 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8368051070 con 0x562585e9bae0 2024-09-18T01:28:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.683+0000 7f8378921800 1 Processor -- start 2024-09-18T01:28:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.683+0000 7f8378921800 1 -- start start 2024-09-18T01:28:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.684+0000 7f8378921800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eac380 0x562585eac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.684+0000 7f8378921800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562585c32580 con 0x562585eac380 2024-09-18T01:28:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.684+0000 7f837464e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eac380 0x562585eac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.684+0000 7f837464e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eac380 0x562585eac7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:43198/0 (socket says 172.21.15.100:43198) 2024-09-18T01:28:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.684+0000 7f837464e640 1 -- 172.21.15.100:0/1616941945 learned_addr learned my addr 172.21.15.100:0/1616941945 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:28:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.684+0000 7f837464e640 1 -- 172.21.15.100:0/1616941945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562585eacce0 con 0x562585eac380 2024-09-18T01:28:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.684+0000 7f837464e640 1 --2- 172.21.15.100:0/1616941945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eac380 0x562585eac7a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8364019860 tx=0x7f8364010f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.684+0000 7f8259ffb640 1 -- 172.21.15.100:0/1616941945 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8364043400 con 0x562585eac380 2024-09-18T01:28:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.684+0000 7f8259ffb640 1 -- 172.21.15.100:0/1616941945 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836400f9a0 con 0x562585eac380 2024-09-18T01:28:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.684+0000 7f8259ffb640 1 -- 172.21.15.100:0/1616941945 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f836400fca0 con 0x562585eac380 2024-09-18T01:28:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.684+0000 7f8378921800 1 -- 172.21.15.100:0/1616941945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562585eacf70 con 0x562585eac380 2024-09-18T01:28:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.684+0000 7f8378921800 1 -- 172.21.15.100:0/1616941945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562585eafc50 con 0x562585eac380 2024-09-18T01:28:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.685+0000 7f8259ffb640 1 -- 172.21.15.100:0/1616941945 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f836400f300 con 0x562585eac380 2024-09-18T01:28:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.685+0000 7f8259ffb640 1 --2- 172.21.15.100:0/1616941945 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f824c036b40 0x7f824c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.685+0000 7f8259ffb640 1 -- 172.21.15.100:0/1616941945 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f8364043e00 con 0x562585eac380 2024-09-18T01:28:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.686+0000 7f8373e4d640 1 --2- 172.21.15.100:0/1616941945 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f824c036b40 0x7f824c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.686+0000 7f8378921800 1 Processor -- start 2024-09-18T01:28:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.686+0000 7f8378921800 1 -- start start 2024-09-18T01:28:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.686+0000 7f8373e4d640 1 --2- 172.21.15.100:0/1616941945 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f824c036b40 0x7f824c039000 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x562585e9aa20 tx=0x7f8368005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.686+0000 7f8378921800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eb8e40 0x562585eb9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.686+0000 7f8378921800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562585e87010 con 0x562585eb8e40 2024-09-18T01:28:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.686+0000 7f837464e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eb8e40 0x562585eb9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.686+0000 7f837464e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eb8e40 0x562585eb9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:43202/0 (socket says 172.21.15.100:43202) 2024-09-18T01:28:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.686+0000 7f837464e640 1 -- 172.21.15.100:0/1741991603 learned_addr learned my addr 172.21.15.100:0/1741991603 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:28:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.687+0000 7f837464e640 1 -- 172.21.15.100:0/1741991603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562585eb9810 con 0x562585eb8e40 2024-09-18T01:28:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.687+0000 7f837464e640 1 --2- 172.21.15.100:0/1741991603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eb8e40 0x562585eb9240 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8364019810 tx=0x7f8364003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98bb791215656ab server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.687+0000 7f824b7fe640 1 -- 172.21.15.100:0/1741991603 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f836403e510 con 0x562585eb8e40 2024-09-18T01:28:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.687+0000 7f824b7fe640 1 -- 172.21.15.100:0/1741991603 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836404b890 con 0x562585eb8e40 2024-09-18T01:28:23.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.687+0000 7f824b7fe640 1 -- 172.21.15.100:0/1741991603 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83640436a0 con 0x562585eb8e40 2024-09-18T01:28:23.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.687+0000 7f8378921800 1 -- 172.21.15.100:0/1741991603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eb8e40 msgr2=0x562585eb9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.687+0000 7f8378921800 1 --2- 172.21.15.100:0/1741991603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eb8e40 0x562585eb9240 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8364019810 tx=0x7f8364003820 comp rx=0 tx=0).stop 2024-09-18T01:28:23.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.687+0000 7f8378921800 1 -- 172.21.15.100:0/1741991603 shutdown_connections 2024-09-18T01:28:23.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.687+0000 7f8378921800 1 --2- 172.21.15.100:0/1741991603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eb8e40 0x562585eb9240 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:23.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.687+0000 7f8378921800 1 -- 172.21.15.100:0/1741991603 >> 172.21.15.100:0/1741991603 conn(0x562585eb51a0 msgr2=0x562585eb32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:23.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.687+0000 7f8378921800 1 -- 172.21.15.100:0/1741991603 shutdown_connections 2024-09-18T01:28:23.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.687+0000 7f8378921800 1 -- 172.21.15.100:0/1741991603 wait complete. 2024-09-18T01:28:23.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.688+0000 7f8378921800 1 Processor -- start 2024-09-18T01:28:23.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.688+0000 7f8378921800 1 -- start start 2024-09-18T01:28:23.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.688+0000 7f8378921800 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eb8e40 0x562585ec0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.688+0000 7f8378921800 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562585eb9dd0 con 0x562585eb8e40 2024-09-18T01:28:23.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.688+0000 7f837464e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eb8e40 0x562585ec0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.688+0000 7f837464e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eb8e40 0x562585ec0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.100:43212/0 (socket says 172.21.15.100:43212) 2024-09-18T01:28:23.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.688+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 learned_addr learned my addr 172.21.15.100:0/384488582 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-18T01:28:23.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.688+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562585ec06a0 con 0x562585eb8e40 2024-09-18T01:28:23.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.689+0000 7f837464e640 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eb8e40 0x562585ec0160 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8364019fb0 tx=0x7f8364012f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.689+0000 7f8249ffb640 1 -- 172.21.15.100:0/384488582 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f836402e480 con 0x562585eb8e40 2024-09-18T01:28:23.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.689+0000 7f8249ffb640 1 -- 172.21.15.100:0/384488582 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836403e510 con 0x562585eb8e40 2024-09-18T01:28:23.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.689+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562585ec06a0 con 0x562585eb8e40 2024-09-18T01:28:23.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.689+0000 7f8249ffb640 1 -- 172.21.15.100:0/384488582 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f836404ca00 con 0x562585eb8e40 2024-09-18T01:28:23.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.689+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562585ec06a0 con 0x562585eb8e40 2024-09-18T01:28:23.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.690+0000 7f8249ffb640 1 -- 172.21.15.100:0/384488582 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8364054040 con 0x562585eb8e40 2024-09-18T01:28:23.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.690+0000 7f8249ffb640 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f823c036b40 0x7f823c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.690+0000 7f8249ffb640 1 -- 172.21.15.100:0/384488582 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f8364051040 con 0x562585eb8e40 2024-09-18T01:28:23.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.690+0000 7f8373e4d640 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f823c036b40 0x7f823c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.690+0000 7f8373e4d640 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f823c036b40 0x7f823c039000 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8368053570 tx=0x7f8368053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8378921800 20 rados->read ofs=0 len=0 2024-09-18T01:28:23.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8378921800 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562585ecb810 0x562585ecdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585ece420 con 0x562585ecb810 2024-09-18T01:28:23.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8374e4f640 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562585ecb810 0x562585ecdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8374e4f640 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562585ecb810 0x562585ecdcd0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f836c0083e0 con 0x562585ecb810 2024-09-18T01:28:23.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8378921800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:28:23.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8378921800 20 realm 2024-09-18T01:28:23.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8378921800 20 rados->read ofs=0 len=0 2024-09-18T01:28:23.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585ece830 con 0x562585ecb810 2024-09-18T01:28:23.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f836c0083e0 con 0x562585ecb810 2024-09-18T01:28:23.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8378921800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:28:23.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8378921800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:28:23.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8378921800 20 rados->read ofs=0 len=0 2024-09-18T01:28:23.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.691+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecb810 2024-09-18T01:28:23.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.692+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f836c0083e0 con 0x562585ecb810 2024-09-18T01:28:23.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.692+0000 7f8378921800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:28:23.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.692+0000 7f8378921800 20 rados->read ofs=0 len=0 2024-09-18T01:28:23.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.692+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf4a0 con 0x562585ecb810 2024-09-18T01:28:23.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.692+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f836c0083e0 con 0x562585ecb810 2024-09-18T01:28:23.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.692+0000 7f8378921800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:28:23.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.692+0000 7f8378921800 20 rados->read ofs=0 len=0 2024-09-18T01:28:23.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.692+0000 7f8378921800 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562585ecfe60 0x562585ed2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.692+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:5 5.1f 5:f9096d4e:::zone_info.153b7754-209b-4898-8796-577da7c1273d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585ed2810 con 0x562585ecfe60 2024-09-18T01:28:23.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.692+0000 7f837464e640 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562585ecfe60 0x562585ed2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.692+0000 7f837464e640 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562585ecfe60 0x562585ed2250 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.693+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== osd_op_reply(5 zone_info.153b7754-209b-4898-8796-577da7c1273d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.693+0000 7f8378921800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:28:23.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.693+0000 7f8378921800 20 searching for the correct realm 2024-09-18T01:28:23.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.693+0000 7f8378921800 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562585ed47c0 0x562585ed6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.693+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ed7350 con 0x562585ed47c0 2024-09-18T01:28:23.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.693+0000 7f8373e4d640 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562585ed47c0 0x562585ed6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.693+0000 7f8373e4d640 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562585ed47c0 0x562585ed6c80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.693+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.693+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ed7350 con 0x562585ecfe60 2024-09-18T01:28:23.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.694+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.694+0000 7f837464e640 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f836405f070 0x7f8364061460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:23.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.694+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ed7350 con 0x7f836405f070 2024-09-18T01:28:23.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.694+0000 7f8374e4f640 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f836405f070 0x7f8364061460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:23.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.694+0000 7f8374e4f640 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f836405f070 0x7f8364061460 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:23.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.695+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f836c0083e0 con 0x7f836405f070 2024-09-18T01:28:23.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.695+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecb810 2024-09-18T01:28:23.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.695+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c0083e0 con 0x562585ecb810 2024-09-18T01:28:23.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.695+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecb810 2024-09-18T01:28:23.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.695+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c026040 con 0x562585ecb810 2024-09-18T01:28:23.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.695+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x7f836405f070 2024-09-18T01:28:23.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.695+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c026040 con 0x7f836405f070 2024-09-18T01:28:23.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.695+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x7f836405f070 2024-09-18T01:28:23.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.696+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c026040 con 0x7f836405f070 2024-09-18T01:28:23.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.696+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecfe60 2024-09-18T01:28:23.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.696+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.696+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ed47c0 2024-09-18T01:28:23.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.697+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.697+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecb810 2024-09-18T01:28:23.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.697+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c026040 con 0x562585ecb810 2024-09-18T01:28:23.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.697+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecfe60 2024-09-18T01:28:23.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.697+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.697+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecb810 2024-09-18T01:28:23.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.697+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c026040 con 0x562585ecb810 2024-09-18T01:28:23.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.697+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecfe60 2024-09-18T01:28:23.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.697+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 5 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.698+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ed47c0 2024-09-18T01:28:23.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.698+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.698+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ed47c0 2024-09-18T01:28:23.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.698+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.698+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x7f836405f070 2024-09-18T01:28:23.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.698+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 4 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c026040 con 0x7f836405f070 2024-09-18T01:28:23.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.698+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ed47c0 2024-09-18T01:28:23.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.698+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.698+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ed47c0 2024-09-18T01:28:23.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.699+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.699+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecb810 2024-09-18T01:28:23.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.699+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c026040 con 0x562585ecb810 2024-09-18T01:28:23.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.699+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecb810 2024-09-18T01:28:23.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.699+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f836c026040 con 0x562585ecb810 2024-09-18T01:28:23.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.699+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x7f836405f070 2024-09-18T01:28:23.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.700+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c026040 con 0x7f836405f070 2024-09-18T01:28:23.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.700+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ed47c0 2024-09-18T01:28:23.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.700+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.700+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecfe60 2024-09-18T01:28:23.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.700+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 6 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.700+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecb810 2024-09-18T01:28:23.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.700+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c026040 con 0x562585ecb810 2024-09-18T01:28:23.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.700+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x7f836405f070 2024-09-18T01:28:23.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.701+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=82b] v35'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.701+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ed47c0 2024-09-18T01:28:23.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.701+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.701+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecfe60 2024-09-18T01:28:23.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.701+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.701+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecfe60 2024-09-18T01:28:23.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.701+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.701+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ed47c0 2024-09-18T01:28:23.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.702+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.702+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x7f836405f070 2024-09-18T01:28:23.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.702+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.702+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecb810 2024-09-18T01:28:23.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.702+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.702+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562585ecf100 con 0x562585ecfe60 2024-09-18T01:28:23.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 9 ==== osd_op_reply(37 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 20 RGWRados::pool_iterate: got zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e 2024-09-18T01:28:23.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:28:23.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:28:23.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 20 RGWRados::pool_iterate: got period_config.default 2024-09-18T01:28:23.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:28:23.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:28:23.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 20 RGWRados::pool_iterate: got zone_info.153b7754-209b-4898-8796-577da7c1273d 2024-09-18T01:28:23.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 20 rados->read ofs=0 len=0 2024-09-18T01:28:23.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585ed30d0 con 0x562585ecb810 2024-09-18T01:28:23.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:28:23.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 20 rados->read ofs=0 len=0 2024-09-18T01:28:23.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585ed34c0 con 0x562585ecb810 2024-09-18T01:28:23.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:28:23.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 20 rados->read ofs=0 len=0 2024-09-18T01:28:23.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.703+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:40 5.8 5:15cee490:::zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585ed34c0 con 0x7f836405f070 2024-09-18T01:28:23.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 8 ==== osd_op_reply(40 zonegroup_info.2d75eca1-60da-4ca3-af9b-0b09072c949e [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:28:23.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 20 zone default found 2024-09-18T01:28:23.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 4 Realm: () 2024-09-18T01:28:23.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 4 ZoneGroup: default (2d75eca1-60da-4ca3-af9b-0b09072c949e) 2024-09-18T01:28:23.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 4 Zone: default (153b7754-209b-4898-8796-577da7c1273d) 2024-09-18T01:28:23.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:28:23.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 20 zonegroup default 2024-09-18T01:28:23.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 20 rados->read ofs=0 len=0 2024-09-18T01:28:23.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585ed77d0 con 0x7f836405f070 2024-09-18T01:28:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 20 rados_obj.operate() r=0 bl.length=187 2024-09-18T01:28:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 20 rados->read ofs=0 len=0 2024-09-18T01:28:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585ed91b0 con 0x562585ed47c0 2024-09-18T01:28:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:28:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 20 rados->read ofs=0 len=0 2024-09-18T01:28:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.704+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585ed9550 con 0x562585ed47c0 2024-09-18T01:28:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.705+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.705+0000 7f8378921800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:28:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.705+0000 7f8378921800 20 started sync module instance, tier type = 2024-09-18T01:28:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.705+0000 7f8378921800 20 started zone id=153b7754-209b-4898-8796-577da7c1273d (name=default) with tier type = 2024-09-18T01:28:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.705+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ed8650 con 0x562585ecfe60 2024-09-18T01:28:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.706+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 10 ==== osd_op_reply(44 notify.0 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.706+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94719160715888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ed9da0 con 0x562585ecfe60 2024-09-18T01:28:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.706+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eda5f0 con 0x562585ecb810 2024-09-18T01:28:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.707+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94719160715888] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.707+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 15 ==== osd_op_reply(46 notify.1 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.707+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94719160719600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eda5f0 con 0x562585ecb810 2024-09-18T01:28:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.707+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585edaff0 con 0x562585ed47c0 2024-09-18T01:28:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.708+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 12 ==== osd_op_reply(48 notify.2 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.709+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94719160724224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585edb890 con 0x562585ed47c0 2024-09-18T01:28:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.709+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585edc370 con 0x562585ecfe60 2024-09-18T01:28:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.709+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94719160719600] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.710+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 12 ==== osd_op_reply(50 notify.3 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.710+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94719160721728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585edcc10 con 0x562585ecfe60 2024-09-18T01:28:23.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.710+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585edd5d0 con 0x562585ecb810 2024-09-18T01:28:23.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.710+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94719160724224] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.711+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94719160721728] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.711+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 17 ==== osd_op_reply(52 notify.4 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.711+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94719160731488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585edcb80 con 0x562585ecb810 2024-09-18T01:28:23.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.711+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585edda80 con 0x7f836405f070 2024-09-18T01:28:23.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.712+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94719160731488] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.712+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 10 ==== osd_op_reply(54 notify.5 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.712+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94719160733984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585edd9f0 con 0x7f836405f070 2024-09-18T01:28:23.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.712+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ede3b0 con 0x7f836405f070 2024-09-18T01:28:23.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.713+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94719160733984] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.714+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 12 ==== osd_op_reply(56 notify.6 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.714+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94719160735040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ede590 con 0x7f836405f070 2024-09-18T01:28:23.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.714+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585edede0 con 0x7f836405f070 2024-09-18T01:28:23.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.715+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 13 ==== osd_op_reply(58 notify.7 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.715+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94719160739696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585edf180 con 0x7f836405f070 2024-09-18T01:28:23.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.715+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94719160735040] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.715+0000 7f8378921800 20 add_watcher() i=0 2024-09-18T01:28:23.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.715+0000 7f8378921800 20 add_watcher() i=1 2024-09-18T01:28:23.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.715+0000 7f8378921800 20 add_watcher() i=2 2024-09-18T01:28:23.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.715+0000 7f8378921800 20 add_watcher() i=3 2024-09-18T01:28:23.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.715+0000 7f8378921800 20 add_watcher() i=4 2024-09-18T01:28:23.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.715+0000 7f8378921800 20 add_watcher() i=5 2024-09-18T01:28:23.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.715+0000 7f8378921800 20 add_watcher() i=6 2024-09-18T01:28:23.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.716+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94719160739696] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.716+0000 7f8378921800 20 add_watcher() i=7 2024-09-18T01:28:23.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.716+0000 7f8378921800 2 all 8 watchers are set, enabling cache 2024-09-18T01:28:23.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.716+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585ede1a0 con 0x562585ecb810 2024-09-18T01:28:23.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.716+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.716+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94719160740880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ede1a0 con 0x562585ecb810 2024-09-18T01:28:23.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.717+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94719160740880] v35'280 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.717+0000 7f822a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:28:23.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.717+0000 7f8378921800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:28:23.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.717+0000 7f8378921800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:28:23.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.717+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eeab60 con 0x562585ecb810 2024-09-18T01:28:23.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.719+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'61 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.719+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eeb230 con 0x7f836405f070 2024-09-18T01:28:23.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.720+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.720+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eeb650 con 0x562585ed47c0 2024-09-18T01:28:23.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.721+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.721+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eec070 con 0x562585ecb810 2024-09-18T01:28:23.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.722+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'281 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.722+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ee6830 con 0x562585ecfe60 2024-09-18T01:28:23.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.723+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'90 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.723+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ee6830 con 0x562585ed47c0 2024-09-18T01:28:23.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.724+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'68 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.724+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ee6830 con 0x562585ecb810 2024-09-18T01:28:23.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.725+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.725+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ee6830 con 0x7f836405f070 2024-09-18T01:28:23.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.727+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'62 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.727+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ee6830 con 0x562585ecfe60 2024-09-18T01:28:23.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.728+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.728+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eecec0 con 0x562585ed47c0 2024-09-18T01:28:23.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.729+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.729+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed370 con 0x562585ecfe60 2024-09-18T01:28:23.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.730+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'91 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.730+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed370 con 0x7f836405f070 2024-09-18T01:28:23.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.731+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.731+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed2f0 con 0x562585ecfe60 2024-09-18T01:28:23.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.732+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.732+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed2f0 con 0x7f836405f070 2024-09-18T01:28:23.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.733+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'77 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.733+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed2f0 con 0x562585ecb810 2024-09-18T01:28:23.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.734+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'282 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.734+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed2f0 con 0x562585ed47c0 2024-09-18T01:28:23.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.736+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'83 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.736+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x562585ecfe60 2024-09-18T01:28:23.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.737+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'92 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.737+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x562585ed47c0 2024-09-18T01:28:23.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.738+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.738+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x562585ecb810 2024-09-18T01:28:23.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.739+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.739+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x562585ecb810 2024-09-18T01:28:23.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.740+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'283 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.740+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x562585ed47c0 2024-09-18T01:28:23.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.741+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.741+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x562585ecfe60 2024-09-18T01:28:23.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.742+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'48 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.742+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x562585ed47c0 2024-09-18T01:28:23.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.743+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.743+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x562585ed47c0 2024-09-18T01:28:23.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.744+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'49 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.744+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x562585ed47c0 2024-09-18T01:28:23.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.745+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.745+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x562585ed47c0 2024-09-18T01:28:23.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.746+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'69 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.746+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x7f836405f070 2024-09-18T01:28:23.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.747+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.747+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x562585ed47c0 2024-09-18T01:28:23.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.748+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'46 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.748+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x7f836405f070 2024-09-18T01:28:23.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.750+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'63 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.750+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x562585ed47c0 2024-09-18T01:28:23.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.751+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.751+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x7f836405f070 2024-09-18T01:28:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.752+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'78 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.752+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585eed4c0 con 0x562585ecfe60 2024-09-18T01:28:23.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.753+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.753+0000 7f82297e2640 20 reqs_thread_entry: start 2024-09-18T01:28:23.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.753+0000 7f8378921800 20 init_complete bucket index max shards: 11 2024-09-18T01:28:23.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.754+0000 7f8378921800 20 Filter name: none 2024-09-18T01:28:23.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.754+0000 7f819affd640 20 reqs_thread_entry: start 2024-09-18T01:28:23.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.754+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-18T01:28:23.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.754+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:94 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.755+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 23 ==== osd_op_reply(94 gc.28 [call] v35'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.755+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:95 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.755+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 24 ==== osd_op_reply(95 gc.28 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.755+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.755+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:96 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x7f836405f070 2024-09-18T01:28:23.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.756+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 25 ==== osd_op_reply(96 gc.28 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.756+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:97 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.756+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 26 ==== osd_op_reply(97 gc.28 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.756+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.756+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:98 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.756+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 27 ==== osd_op_reply(98 gc.28 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.756+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.756+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:99 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.757+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 28 ==== osd_op_reply(99 gc.28 [call] v35'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.757+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-18T01:28:23.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.757+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:100 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.759+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 26 ==== osd_op_reply(100 gc.29 [call] v35'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.759+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:101 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.759+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 27 ==== osd_op_reply(101 gc.29 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.759+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.759+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:102 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ed47c0 2024-09-18T01:28:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.759+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 28 ==== osd_op_reply(102 gc.29 [call out=24b] v0'0 uv86 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.759+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:103 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.759+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 29 ==== osd_op_reply(103 gc.29 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.759+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.759+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:104 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.760+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 30 ==== osd_op_reply(104 gc.29 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.760+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.760+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:105 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.761+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 31 ==== osd_op_reply(105 gc.29 [call] v35'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.761+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-18T01:28:23.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.761+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:106 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.762+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 29 ==== osd_op_reply(106 gc.30 [call] v35'79 uv79 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.762+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:107 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.762+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 30 ==== osd_op_reply(107 gc.30 [call out=15b] v0'0 uv79 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.762+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.762+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:108 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x7f836405f070 2024-09-18T01:28:23.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.763+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 31 ==== osd_op_reply(108 gc.30 [call out=24b] v0'0 uv79 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.763+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:109 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.763+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 32 ==== osd_op_reply(109 gc.30 [call out=15b] v0'0 uv79 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.763+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.763+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:110 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.764+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 33 ==== osd_op_reply(110 gc.30 [call out=15b] v0'0 uv79 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.764+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.764+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:111 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.765+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 34 ==== osd_op_reply(111 gc.30 [call] v35'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.765+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-18T01:28:23.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.765+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:112 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.766+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 21 ==== osd_op_reply(112 gc.31 [call] v35'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.766+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:113 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.766+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 22 ==== osd_op_reply(113 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.766+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.766+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:114 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ecfe60 2024-09-18T01:28:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.766+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 23 ==== osd_op_reply(114 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.766+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:115 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.767+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 24 ==== osd_op_reply(115 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.767+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.767+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:116 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.767+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 25 ==== osd_op_reply(116 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.767+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.767+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:117 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.768+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 26 ==== osd_op_reply(117 gc.31 [call] v35'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.768+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-18T01:28:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.768+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:118 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.769+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 27 ==== osd_op_reply(118 gc.0 [call] v35'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.769+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:119 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.770+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 28 ==== osd_op_reply(119 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.770+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.770+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:120 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ecb810 2024-09-18T01:28:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.770+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 29 ==== osd_op_reply(120 gc.0 [call out=24b] v0'0 uv62 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.770+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:121 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.770+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 30 ==== osd_op_reply(121 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.770+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.770+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:122 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.770+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 31 ==== osd_op_reply(122 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.770+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.770+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:123 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.771+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 32 ==== osd_op_reply(123 gc.0 [call] v35'63 uv63 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.772+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-18T01:28:23.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.772+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:124 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.773+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 35 ==== osd_op_reply(124 gc.1 [call] v35'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.773+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:125 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.773+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 36 ==== osd_op_reply(125 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.773+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.773+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:126 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x7f836405f070 2024-09-18T01:28:23.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.773+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 37 ==== osd_op_reply(126 gc.1 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.773+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:127 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.774+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 38 ==== osd_op_reply(127 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.774+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.774+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:128 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.774+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 39 ==== osd_op_reply(128 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.774+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.774+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:129 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.776+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 40 ==== osd_op_reply(129 gc.1 [call] v35'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.776+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-18T01:28:23.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.776+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:130 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.776+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 32 ==== osd_op_reply(130 gc.2 [call] v35'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.776+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:131 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.777+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 33 ==== osd_op_reply(131 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.777+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.777+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:132 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ed47c0 2024-09-18T01:28:23.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.777+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 34 ==== osd_op_reply(132 gc.2 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.777+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:133 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.777+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 35 ==== osd_op_reply(133 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.777+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.777+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:134 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.777+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 36 ==== osd_op_reply(134 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.777+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.777+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:135 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.778+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 37 ==== osd_op_reply(135 gc.2 [call] v35'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.778+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-18T01:28:23.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.778+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:136 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.779+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 33 ==== osd_op_reply(136 gc.3 [call] v35'284 uv284 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.779+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:137 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.779+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 34 ==== osd_op_reply(137 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.779+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.779+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:138 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ecb810 2024-09-18T01:28:23.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.780+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 35 ==== osd_op_reply(138 gc.3 [call out=24b] v0'0 uv284 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.780+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:139 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.780+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 36 ==== osd_op_reply(139 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.780+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.780+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:140 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.780+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 37 ==== osd_op_reply(140 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.780+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.780+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:141 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.781+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 38 ==== osd_op_reply(141 gc.3 [call] v35'285 uv285 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.781+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-18T01:28:23.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.781+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:142 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.782+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 27 ==== osd_op_reply(142 gc.4 [call] v35'93 uv93 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.782+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:143 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.782+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 28 ==== osd_op_reply(143 gc.4 [call out=15b] v0'0 uv93 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.782+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.782+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:144 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ecfe60 2024-09-18T01:28:23.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.782+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 29 ==== osd_op_reply(144 gc.4 [call out=24b] v0'0 uv93 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.782+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:145 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.783+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 30 ==== osd_op_reply(145 gc.4 [call out=15b] v0'0 uv93 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.783+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.783+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:146 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.783+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 31 ==== osd_op_reply(146 gc.4 [call out=15b] v0'0 uv93 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.783+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.783+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:147 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.784+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 32 ==== osd_op_reply(147 gc.4 [call] v35'94 uv94 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.784+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-18T01:28:23.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.784+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:148 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.785+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 38 ==== osd_op_reply(148 gc.5 [call] v35'70 uv70 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.785+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:149 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.785+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 39 ==== osd_op_reply(149 gc.5 [call out=15b] v0'0 uv70 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.785+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.785+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:150 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ed47c0 2024-09-18T01:28:23.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.785+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 40 ==== osd_op_reply(150 gc.5 [call out=24b] v0'0 uv70 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.785+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:151 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.786+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 41 ==== osd_op_reply(151 gc.5 [call out=15b] v0'0 uv70 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.786+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.786+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:152 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.786+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 42 ==== osd_op_reply(152 gc.5 [call out=15b] v0'0 uv70 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.786+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.786+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:153 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.787+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 43 ==== osd_op_reply(153 gc.5 [call] v35'71 uv71 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.787+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-18T01:28:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.787+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:154 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.788+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 39 ==== osd_op_reply(154 gc.6 [call] v35'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.788+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:155 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.788+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 40 ==== osd_op_reply(155 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.788+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.788+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:156 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ecb810 2024-09-18T01:28:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.788+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 41 ==== osd_op_reply(156 gc.6 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.788+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:157 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.789+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 42 ==== osd_op_reply(157 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.789+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.789+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:158 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.789+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 43 ==== osd_op_reply(158 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.789+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.789+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:159 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.790+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 44 ==== osd_op_reply(159 gc.6 [call] v35'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.790+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-18T01:28:23.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.790+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:160 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.791+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 41 ==== osd_op_reply(160 gc.7 [call] v35'66 uv66 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.791+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:161 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.792+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 42 ==== osd_op_reply(161 gc.7 [call out=15b] v0'0 uv66 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.792+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.792+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:162 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x7f836405f070 2024-09-18T01:28:23.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.792+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 43 ==== osd_op_reply(162 gc.7 [call out=24b] v0'0 uv66 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.792+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:163 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.792+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 44 ==== osd_op_reply(163 gc.7 [call out=15b] v0'0 uv66 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.792+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.792+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:164 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.793+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 45 ==== osd_op_reply(164 gc.7 [call out=15b] v0'0 uv66 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.793+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.793+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:165 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.794+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 46 ==== osd_op_reply(165 gc.7 [call] v35'67 uv67 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.794+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-18T01:28:23.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.794+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:166 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.795+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 33 ==== osd_op_reply(166 gc.8 [call] v35'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.795+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:167 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.795+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 34 ==== osd_op_reply(167 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.795+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.795+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:168 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ecfe60 2024-09-18T01:28:23.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.795+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 35 ==== osd_op_reply(168 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.795+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:169 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.796+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 36 ==== osd_op_reply(169 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.796+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.796+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:170 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.796+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 37 ==== osd_op_reply(170 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.796+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.796+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:171 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.797+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 38 ==== osd_op_reply(171 gc.8 [call] v35'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.797+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-18T01:28:23.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.797+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:172 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.798+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 44 ==== osd_op_reply(172 gc.9 [call] v35'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.798+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:173 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.798+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 45 ==== osd_op_reply(173 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.798+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.798+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:174 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ed47c0 2024-09-18T01:28:23.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.798+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 46 ==== osd_op_reply(174 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.798+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:175 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.799+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 47 ==== osd_op_reply(175 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.799+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.799+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:176 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.799+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 48 ==== osd_op_reply(176 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.799+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.799+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:177 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.800+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 49 ==== osd_op_reply(177 gc.9 [call] v35'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.800+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-18T01:28:23.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.800+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:178 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.801+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 39 ==== osd_op_reply(178 gc.10 [call] v35'95 uv95 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.801+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:179 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.801+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 40 ==== osd_op_reply(179 gc.10 [call out=15b] v0'0 uv95 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.801+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.801+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:180 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ecfe60 2024-09-18T01:28:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.801+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 41 ==== osd_op_reply(180 gc.10 [call out=24b] v0'0 uv95 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.801+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:181 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.802+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 42 ==== osd_op_reply(181 gc.10 [call out=15b] v0'0 uv95 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.802+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.802+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:182 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.802+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 43 ==== osd_op_reply(182 gc.10 [call out=15b] v0'0 uv95 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.802+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.802+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:183 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.803+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 44 ==== osd_op_reply(183 gc.10 [call] v35'96 uv96 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.803+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-18T01:28:23.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.803+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:184 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.804+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 47 ==== osd_op_reply(184 gc.11 [call] v35'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.804+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:185 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.804+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 48 ==== osd_op_reply(185 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.804+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.804+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:186 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x7f836405f070 2024-09-18T01:28:23.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.805+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 49 ==== osd_op_reply(186 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.805+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:187 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.805+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 50 ==== osd_op_reply(187 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.805+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.805+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:188 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.805+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 51 ==== osd_op_reply(188 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.805+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.805+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:189 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.806+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 52 ==== osd_op_reply(189 gc.11 [call] v35'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.806+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-18T01:28:23.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.806+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:190 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.807+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 45 ==== osd_op_reply(190 gc.12 [call] v35'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.807+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:191 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.808+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 46 ==== osd_op_reply(191 gc.12 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.808+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.808+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:192 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ecfe60 2024-09-18T01:28:23.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.808+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 47 ==== osd_op_reply(192 gc.12 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.808+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:193 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.808+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 48 ==== osd_op_reply(193 gc.12 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.808+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.808+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:194 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.808+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 49 ==== osd_op_reply(194 gc.12 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.808+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.808+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:195 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.809+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 50 ==== osd_op_reply(195 gc.12 [call] v35'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.809+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-18T01:28:23.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.809+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:196 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.811+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 53 ==== osd_op_reply(196 gc.13 [call] v35'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.811+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:197 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.811+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 54 ==== osd_op_reply(197 gc.13 [call out=15b] v0'0 uv81 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.811+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.811+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:198 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x7f836405f070 2024-09-18T01:28:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.811+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 55 ==== osd_op_reply(198 gc.13 [call out=24b] v0'0 uv81 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.811+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:199 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.811+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 56 ==== osd_op_reply(199 gc.13 [call out=15b] v0'0 uv81 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.811+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.811+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:200 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.812+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 57 ==== osd_op_reply(200 gc.13 [call out=15b] v0'0 uv81 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.812+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.812+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:201 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x7f836405f070 2024-09-18T01:28:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.813+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 58 ==== osd_op_reply(201 gc.13 [call] v35'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.813+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-18T01:28:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.813+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:202 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.814+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 45 ==== osd_op_reply(202 gc.14 [call] v35'286 uv286 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.814+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:203 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.814+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 46 ==== osd_op_reply(203 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.814+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.814+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:204 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ecb810 2024-09-18T01:28:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.815+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 47 ==== osd_op_reply(204 gc.14 [call out=24b] v0'0 uv286 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.815+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:205 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.815+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 48 ==== osd_op_reply(205 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.815+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.815+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:206 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.815+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 49 ==== osd_op_reply(206 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.815+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.815+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:207 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.816+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 50 ==== osd_op_reply(207 gc.14 [call] v35'287 uv287 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.816+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-18T01:28:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.816+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:208 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.818+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 50 ==== osd_op_reply(208 gc.15 [call] v35'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.818+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:209 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.818+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 51 ==== osd_op_reply(209 gc.15 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.818+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.818+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:210 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ed47c0 2024-09-18T01:28:23.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.818+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 52 ==== osd_op_reply(210 gc.15 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.818+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:211 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.818+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 53 ==== osd_op_reply(211 gc.15 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.818+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.818+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:212 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.819+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 54 ==== osd_op_reply(212 gc.15 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.819+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.819+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:213 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.820+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 55 ==== osd_op_reply(213 gc.15 [call] v35'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.820+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-18T01:28:23.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.820+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:214 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.821+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 51 ==== osd_op_reply(214 gc.16 [call] v35'97 uv97 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.821+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:215 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.821+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 52 ==== osd_op_reply(215 gc.16 [call out=15b] v0'0 uv97 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.821+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.821+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:216 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ecfe60 2024-09-18T01:28:23.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.821+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 53 ==== osd_op_reply(216 gc.16 [call out=24b] v0'0 uv97 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.821+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:217 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.821+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 54 ==== osd_op_reply(217 gc.16 [call out=15b] v0'0 uv97 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.821+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.821+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:218 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.822+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 55 ==== osd_op_reply(218 gc.16 [call out=15b] v0'0 uv97 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.822+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.822+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:219 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.823+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 56 ==== osd_op_reply(219 gc.16 [call] v35'98 uv98 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.823+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-18T01:28:23.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.823+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:220 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.824+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 56 ==== osd_op_reply(220 gc.17 [call] v35'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.824+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:221 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.824+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 57 ==== osd_op_reply(221 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.824+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.824+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:222 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ed47c0 2024-09-18T01:28:23.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.824+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 58 ==== osd_op_reply(222 gc.17 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.824+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:223 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.824+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 59 ==== osd_op_reply(223 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.825+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.825+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:224 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.825+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 60 ==== osd_op_reply(224 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.825+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.825+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:225 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.826+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 61 ==== osd_op_reply(225 gc.17 [call] v35'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.826+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-18T01:28:23.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.826+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:226 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.827+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 51 ==== osd_op_reply(226 gc.18 [call] v35'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.827+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:227 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.827+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 52 ==== osd_op_reply(227 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.827+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.827+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:228 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ecb810 2024-09-18T01:28:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.828+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 53 ==== osd_op_reply(228 gc.18 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.828+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:229 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.828+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 54 ==== osd_op_reply(229 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.828+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.828+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:230 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.828+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 55 ==== osd_op_reply(230 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.828+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.828+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:231 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.829+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 56 ==== osd_op_reply(231 gc.18 [call] v35'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.829+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-18T01:28:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.829+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:232 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.830+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 57 ==== osd_op_reply(232 gc.19 [call] v35'288 uv288 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.830+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:233 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.830+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 58 ==== osd_op_reply(233 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.830+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.830+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:234 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ecb810 2024-09-18T01:28:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.831+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 59 ==== osd_op_reply(234 gc.19 [call out=24b] v0'0 uv288 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.831+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:235 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.831+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 60 ==== osd_op_reply(235 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.831+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.831+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:236 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.831+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 61 ==== osd_op_reply(236 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.831+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.831+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:237 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecb810 2024-09-18T01:28:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.832+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 62 ==== osd_op_reply(237 gc.19 [call] v35'289 uv289 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.832+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-18T01:28:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.832+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:238 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.833+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 62 ==== osd_op_reply(238 gc.20 [call] v35'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.833+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:239 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.834+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 63 ==== osd_op_reply(239 gc.20 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.834+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.834+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:240 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ed47c0 2024-09-18T01:28:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.834+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 64 ==== osd_op_reply(240 gc.20 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.834+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:241 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.834+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 65 ==== osd_op_reply(241 gc.20 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.834+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.834+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:242 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.834+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 66 ==== osd_op_reply(242 gc.20 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.834+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.834+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:243 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.835+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 67 ==== osd_op_reply(243 gc.20 [call] v35'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.835+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-18T01:28:23.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.835+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:244 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.837+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 57 ==== osd_op_reply(244 gc.21 [call] v35'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.837+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:245 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.837+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 58 ==== osd_op_reply(245 gc.21 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.837+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.837+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:246 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ecfe60 2024-09-18T01:28:23.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.837+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 59 ==== osd_op_reply(246 gc.21 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.837+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:247 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.837+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 60 ==== osd_op_reply(247 gc.21 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.837+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.837+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:248 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.838+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 61 ==== osd_op_reply(248 gc.21 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.838+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.838+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:249 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ecfe60 2024-09-18T01:28:23.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.839+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 62 ==== osd_op_reply(249 gc.21 [call] v35'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.839+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-18T01:28:23.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.839+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:250 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.840+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 68 ==== osd_op_reply(250 gc.22 [call] v35'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.840+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:251 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.840+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 69 ==== osd_op_reply(251 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.840+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.840+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:252 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ed47c0 2024-09-18T01:28:23.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.840+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 70 ==== osd_op_reply(252 gc.22 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.840+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:253 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.840+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 71 ==== osd_op_reply(253 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.841+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.841+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:254 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.841+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 72 ==== osd_op_reply(254 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.841+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.841+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:255 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.842+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 73 ==== osd_op_reply(255 gc.22 [call] v35'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.842+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-18T01:28:23.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.842+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:256 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.843+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 74 ==== osd_op_reply(256 gc.23 [call] v35'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.843+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:257 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.843+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 75 ==== osd_op_reply(257 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.843+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.843+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:258 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ed47c0 2024-09-18T01:28:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.843+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 76 ==== osd_op_reply(258 gc.23 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.843+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:259 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.844+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 77 ==== osd_op_reply(259 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.844+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.844+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:260 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.844+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 78 ==== osd_op_reply(260 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.844+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.844+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:261 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.845+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 79 ==== osd_op_reply(261 gc.23 [call] v35'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.845+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-18T01:28:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.845+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:262 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.846+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 80 ==== osd_op_reply(262 gc.24 [call] v35'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.846+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:263 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.846+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 81 ==== osd_op_reply(263 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.846+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.846+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:264 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ed47c0 2024-09-18T01:28:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.846+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 82 ==== osd_op_reply(264 gc.24 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.846+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:265 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.846+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 83 ==== osd_op_reply(265 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.847+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.847+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:266 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.847+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 84 ==== osd_op_reply(266 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.847+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.847+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:267 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.848+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 85 ==== osd_op_reply(267 gc.24 [call] v35'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.848+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-18T01:28:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.848+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:268 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.849+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 86 ==== osd_op_reply(268 gc.25 [call] v35'72 uv72 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.849+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:269 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.849+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 87 ==== osd_op_reply(269 gc.25 [call out=15b] v0'0 uv72 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.849+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.849+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:270 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f184a0 con 0x562585ed47c0 2024-09-18T01:28:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.849+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 88 ==== osd_op_reply(270 gc.25 [call out=24b] v0'0 uv72 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.849+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:271 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.849+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 89 ==== osd_op_reply(271 gc.25 [call out=15b] v0'0 uv72 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.849+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.849+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:272 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f194b0 con 0x562585ed47c0 2024-09-18T01:28:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 90 ==== osd_op_reply(272 gc.25 [call out=1716b] v0'0 uv72 ondisk = 0) ==== 149+0+1716 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-18T01:28:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 20 garbage collection: RGWGC::process iterating over entry tag='153b7754-209b-4898-8796-577da7c1273d.4237.17558432607232394811', time=2024-09-18T01:28:31.834882+0000, chain.objs.size()=7 2024-09-18T01:28:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_1 2024-09-18T01:28:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:273 3.as0 3:525b3941:::153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f17750 con 0x562585ed47c0 2024-09-18T01:28:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_2 2024-09-18T01:28:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:274 3.4s0 3:236da944:::153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f1c7e0 con 0x7f836405f070 2024-09-18T01:28:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_3 2024-09-18T01:28:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:275 3.3es0 3:7e092724:::153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f1f160 con 0x7f836405f070 2024-09-18T01:28:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_4 2024-09-18T01:28:23.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:276 3.2bs0 3:d497be21:::153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f1c7e0 con 0x562585ecb810 2024-09-18T01:28:23.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_5 2024-09-18T01:28:23.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:277 3.1ds0 3:ba356fac:::153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f1f160 con 0x562585ed47c0 2024-09-18T01:28:23.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_6 2024-09-18T01:28:23.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:278 3.0s0 3:035bf29b:::153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f26720 con 0x7f836405f070 2024-09-18T01:28:23.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_7 2024-09-18T01:28:23.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.850+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:279 3.16s0 3:6b1b4eaf:::153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f28bf0 con 0x562585ecfe60 2024-09-18T01:28:23.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.852+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 91 ==== osd_op_reply(273 153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_1 [call] v35'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.852+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 92 ==== osd_op_reply(277 153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_5 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.853+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 63 ==== osd_op_reply(279 153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_7 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.853+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 59 ==== osd_op_reply(275 153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_3 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.853+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 60 ==== osd_op_reply(278 153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_6 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.853+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 63 ==== osd_op_reply(276 153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_4 [call] v35'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.855+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 61 ==== osd_op_reply(274 153b7754-209b-4898-8796-577da7c1273d.4237.11__shadow_.3JJeltT-I3ay-NMiOs9dwB2gcs68rWg_2 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.855+0000 7f8378921800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-18T01:28:23.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.855+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:280 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f17180 con 0x562585ed47c0 2024-09-18T01:28:23.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.857+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 93 ==== osd_op_reply(280 gc.25 [call] v35'73 uv73 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.857+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:281 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f23ad0 con 0x562585ed47c0 2024-09-18T01:28:23.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.858+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 94 ==== osd_op_reply(281 gc.25 [call] v35'74 uv74 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.858+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-18T01:28:23.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.858+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:282 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f17180 con 0x7f836405f070 2024-09-18T01:28:23.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.859+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 62 ==== osd_op_reply(282 gc.26 [call] v35'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.859+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:283 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f17180 con 0x7f836405f070 2024-09-18T01:28:23.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.860+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 63 ==== osd_op_reply(283 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.860+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.860+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:284 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f1dbe0 con 0x7f836405f070 2024-09-18T01:28:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.860+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 64 ==== osd_op_reply(284 gc.26 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.860+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:285 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f23a60 con 0x7f836405f070 2024-09-18T01:28:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.860+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 65 ==== osd_op_reply(285 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.860+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.860+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:286 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f23a60 con 0x7f836405f070 2024-09-18T01:28:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.860+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 66 ==== osd_op_reply(286 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.860+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.860+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:287 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f23a60 con 0x7f836405f070 2024-09-18T01:28:23.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.862+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 67 ==== osd_op_reply(287 gc.26 [call] v35'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.862+0000 7f8378921800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-18T01:28:23.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.862+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:288 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f23a60 con 0x562585ed47c0 2024-09-18T01:28:23.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.863+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 95 ==== osd_op_reply(288 gc.27 [call] v35'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.863+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:289 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f1eb70 con 0x562585ed47c0 2024-09-18T01:28:23.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.863+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 96 ==== osd_op_reply(289 gc.27 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.863+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.863+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:290 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f1db60 con 0x562585ed47c0 2024-09-18T01:28:23.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.863+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 97 ==== osd_op_reply(290 gc.27 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.863+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:291 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f1eb70 con 0x562585ed47c0 2024-09-18T01:28:23.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.863+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 98 ==== osd_op_reply(291 gc.27 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.863+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:28:23.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.863+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:292 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562585f1eb70 con 0x562585ed47c0 2024-09-18T01:28:23.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.864+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 99 ==== osd_op_reply(292 gc.27 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.864+0000 7f8378921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:28:23.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.864+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:293 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f1eb70 con 0x562585ed47c0 2024-09-18T01:28:23.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.864+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 100 ==== osd_op_reply(293 gc.27 [call] v35'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.865+0000 7f822a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:28:23.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.865+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94719160740880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ee9e50 con 0x562585ecb810 2024-09-18T01:28:23.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.866+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94719160740880] v35'290 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.866+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94719160715888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585f17180 con 0x562585ecfe60 2024-09-18T01:28:23.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.867+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94719160715888] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.867+0000 7f8378921800 20 remove_watcher() i=0 2024-09-18T01:28:23.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.867+0000 7f8378921800 2 removed watcher, disabling cache 2024-09-18T01:28:23.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.867+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94719160719600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ed8a70 con 0x562585ecb810 2024-09-18T01:28:23.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.869+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94719160719600] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.869+0000 7f8378921800 20 remove_watcher() i=1 2024-09-18T01:28:23.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.869+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94719160724224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ed98f0 con 0x562585ed47c0 2024-09-18T01:28:23.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.870+0000 7f8373e4d640 1 -- 172.21.15.100:0/384488582 <== osd.3 v2:172.21.15.100:6816/595195757 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94719160724224] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8368051070 con 0x562585ed47c0 2024-09-18T01:28:23.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.870+0000 7f8378921800 20 remove_watcher() i=2 2024-09-18T01:28:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.870+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94719160721728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ed98f0 con 0x562585ecfe60 2024-09-18T01:28:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.871+0000 7f837464e640 1 -- 172.21.15.100:0/384488582 <== osd.2 v2:172.21.15.100:6808/3104327688 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94719160721728] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8364070020 con 0x562585ecfe60 2024-09-18T01:28:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.871+0000 7f8378921800 20 remove_watcher() i=3 2024-09-18T01:28:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.871+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94719160731488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585ed98f0 con 0x562585ecb810 2024-09-18T01:28:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.873+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.1 v2:172.21.15.100:6800/170575980 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94719160731488] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x562585ecb810 2024-09-18T01:28:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.873+0000 7f8378921800 20 remove_watcher() i=4 2024-09-18T01:28:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.873+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94719160733984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585edc760 con 0x7f836405f070 2024-09-18T01:28:23.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.874+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94719160733984] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.874+0000 7f8378921800 20 remove_watcher() i=5 2024-09-18T01:28:23.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.874+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94719160735040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585edd120 con 0x7f836405f070 2024-09-18T01:28:23.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.875+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94719160735040] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.875+0000 7f8378921800 20 remove_watcher() i=6 2024-09-18T01:28:23.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.875+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94719160739696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562585edc760 con 0x7f836405f070 2024-09-18T01:28:23.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.876+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 <== osd.0 v2:172.21.15.92:6800/2777570747 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94719160739696] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c037040 con 0x7f836405f070 2024-09-18T01:28:23.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.876+0000 7f8378921800 20 remove_watcher() i=7 2024-09-18T01:28:23.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.876+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f836405f070 msgr2=0x7f8364061460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.876+0000 7f8378921800 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f836405f070 0x7f8364061460 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:23.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.876+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562585ecb810 msgr2=0x562585ecdcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.876+0000 7f8378921800 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562585ecb810 0x562585ecdcd0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:23.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.876+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562585ecfe60 msgr2=0x562585ed2250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.876+0000 7f8378921800 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562585ecfe60 0x562585ed2250 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:23.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562585ed47c0 msgr2=0x562585ed6c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x562585ed47c0 0x562585ed6c80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:23.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f823c036b40 msgr2=0x7f823c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f823c036b40 0x7f823c039000 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8368053570 tx=0x7f8368053000 comp rx=0 tx=0).stop 2024-09-18T01:28:23.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eb8e40 msgr2=0x562585ec0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8374e4f640 1 -- 172.21.15.100:0/384488582 reap_dead start 2024-09-18T01:28:23.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eb8e40 0x562585ec0160 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8364019fb0 tx=0x7f8364012f70 comp rx=0 tx=0).stop 2024-09-18T01:28:23.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 shutdown_connections 2024-09-18T01:28:23.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 --2- 172.21.15.100:0/384488582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eb8e40 0x562585ec0160 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:23.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 >> 172.21.15.100:0/384488582 conn(0x562585eb51a0 msgr2=0x562585eb3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:23.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 shutdown_connections 2024-09-18T01:28:23.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 -- 172.21.15.100:0/384488582 wait complete. 2024-09-18T01:28:23.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 -- 172.21.15.100:0/1616941945 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f824c036b40 msgr2=0x7f824c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 --2- 172.21.15.100:0/1616941945 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f824c036b40 0x7f824c039000 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x562585e9aa20 tx=0x7f8368005a00 comp rx=0 tx=0).stop 2024-09-18T01:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 -- 172.21.15.100:0/1616941945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eac380 msgr2=0x562585eac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 --2- 172.21.15.100:0/1616941945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eac380 0x562585eac7a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8364019860 tx=0x7f8364010f50 comp rx=0 tx=0).stop 2024-09-18T01:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 -- 172.21.15.100:0/1616941945 shutdown_connections 2024-09-18T01:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 --2- 172.21.15.100:0/1616941945 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f824c036b40 0x7f824c039000 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 --2- 172.21.15.100:0/1616941945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585eac380 0x562585eac7a0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 -- 172.21.15.100:0/1616941945 >> 172.21.15.100:0/1616941945 conn(0x562585ea1310 msgr2=0x562585ea3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 -- 172.21.15.100:0/1616941945 shutdown_connections 2024-09-18T01:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.877+0000 7f8378921800 1 -- 172.21.15.100:0/1616941945 wait complete. 2024-09-18T01:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562585e9bae0 msgr2=0x562585e9ded0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8378921800 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x562585e9bae0 0x562585e9ded0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562585d9b860 msgr2=0x562585e95280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8378921800 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x562585d9b860 0x562585e95280 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562585e97bc0 msgr2=0x562585e99fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8378921800 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x562585e97bc0 0x562585e99fb0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f825c036b40 msgr2=0x7f825c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8378921800 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f825c036b40 0x7f825c039000 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8368057000 tx=0x7f8368052000 comp rx=0 tx=0).stop 2024-09-18T01:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d0ae90 msgr2=0x562585e8e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8378921800 1 --2- 172.21.15.100:0/349423229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562585d0ae90 0x562585e8e2b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8364000f80 tx=0x7f8364001250 comp rx=0 tx=0).stop 2024-09-18T01:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8374e4f640 1 -- 172.21.15.100:0/349423229 reap_dead start 2024-09-18T01:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 shutdown_connections 2024-09-18T01:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 >> 172.21.15.100:0/349423229 conn(0x562585d91df0 msgr2=0x562585e80ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 shutdown_connections 2024-09-18T01:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T01:28:23.878+0000 7f8378921800 1 -- 172.21.15.100:0/349423229 wait complete. 2024-09-18T01:28:23.888 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-18T01:28:23.897 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T01:28:23.897 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:28:24.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.003+0000 7fe2e49bd640 1 Processor -- start 2024-09-18T01:28:24.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.003+0000 7fe2e49bd640 1 -- start start 2024-09-18T01:28:24.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.003+0000 7fe2e49bd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe2e006eda0 0x7fe2e006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:24.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.003+0000 7fe2e49bd640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2e006eba0 con 0x7fe2e006f6c0 2024-09-18T01:28:24.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.003+0000 7fe2e49bd640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fe2e006d2f0 con 0x7fe2e006eda0 2024-09-18T01:28:24.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.004+0000 7fe2de59c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe2e006eda0 0x7fe2e006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:24.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.004+0000 7fe2ddd9b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fe2e006f6c0 0x7fe2e0121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56630/0 (socket says 172.21.15.92:56630) 2024-09-18T01:28:24.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.004+0000 7fe2ddd9b640 1 -- 172.21.15.92:0/4153164775 learned_addr learned my addr 172.21.15.92:0/4153164775 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:28:24.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.004+0000 7fe2de59c640 1 -- 172.21.15.92:0/4153164775 >> v1:172.21.15.92:6789/0 conn(0x7fe2e006f6c0 legacy=0x7fe2e0121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:24.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.004+0000 7fe2de59c640 1 -- 172.21.15.92:0/4153164775 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e0070d50 con 0x7fe2e006eda0 2024-09-18T01:28:24.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.004+0000 7fe2dd59a640 1 -- 172.21.15.92:0/4153164775 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 469444044 0 0) 0x7fe2e006eba0 con 0x7fe2e006f6c0 2024-09-18T01:28:24.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.005+0000 7fe2de59c640 1 --2- 172.21.15.92:0/4153164775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2e006eda0 0x7fe2e006f180 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009720 tx=0x7fe2d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36804014e1de0046 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:24.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.005+0000 7fe2dd59a640 1 -- 172.21.15.92:0/4153164775 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d0037070 con 0x7fe2e006eda0 2024-09-18T01:28:24.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.005+0000 7fe2dd59a640 1 -- 172.21.15.92:0/4153164775 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d002ae20 con 0x7fe2e006eda0 2024-09-18T01:28:24.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.005+0000 7fe2dd59a640 1 -- 172.21.15.92:0/4153164775 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d0032590 con 0x7fe2e006eda0 2024-09-18T01:28:24.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.005+0000 7fe2e49bd640 1 -- 172.21.15.92:0/4153164775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2e006eda0 msgr2=0x7fe2e006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:24.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.005+0000 7fe2e49bd640 1 --2- 172.21.15.92:0/4153164775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2e006eda0 0x7fe2e006f180 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009720 tx=0x7fe2d002a1a0 comp rx=0 tx=0).stop 2024-09-18T01:28:24.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.005+0000 7fe2e49bd640 1 -- 172.21.15.92:0/4153164775 shutdown_connections 2024-09-18T01:28:24.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.005+0000 7fe2e49bd640 1 --2- 172.21.15.92:0/4153164775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2e006eda0 0x7fe2e006f180 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:24.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.005+0000 7fe2e49bd640 1 -- 172.21.15.92:0/4153164775 >> 172.21.15.92:0/4153164775 conn(0x7fe2e009a890 msgr2=0x7fe2e009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:24.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.005+0000 7fe2e49bd640 1 -- 172.21.15.92:0/4153164775 shutdown_connections 2024-09-18T01:28:24.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.005+0000 7fe2e49bd640 1 -- 172.21.15.92:0/4153164775 wait complete. 2024-09-18T01:28:24.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.006+0000 7fe2e49bd640 1 Processor -- start 2024-09-18T01:28:24.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.006+0000 7fe2e49bd640 1 -- start start 2024-09-18T01:28:24.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.007+0000 7fe2e49bd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2e006eda0 0x7fe2e006d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:24.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.007+0000 7fe2e49bd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e0122160 con 0x7fe2e006eda0 2024-09-18T01:28:24.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.007+0000 7fe2de59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2e006eda0 0x7fe2e006d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:24.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.007+0000 7fe2de59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2e006eda0 0x7fe2e006d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56912/0 (socket says 172.21.15.92:56912) 2024-09-18T01:28:24.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.007+0000 7fe2de59c640 1 -- 172.21.15.92:0/1307512270 learned_addr learned my addr 172.21.15.92:0/1307512270 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:24.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.007+0000 7fe2de59c640 1 -- 172.21.15.92:0/1307512270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e0128ba0 con 0x7fe2e006eda0 2024-09-18T01:28:24.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.007+0000 7fe2de59c640 1 --2- 172.21.15.92:0/1307512270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2e006eda0 0x7fe2e006d910 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0035040 tx=0x7fe2d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:24.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.007+0000 7fe2ceffd640 1 -- 172.21.15.92:0/1307512270 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d0037040 con 0x7fe2e006eda0 2024-09-18T01:28:24.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.007+0000 7fe2ceffd640 1 -- 172.21.15.92:0/1307512270 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d0032e30 con 0x7fe2e006eda0 2024-09-18T01:28:24.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.007+0000 7fe2e49bd640 1 -- 172.21.15.92:0/1307512270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e008c400 con 0x7fe2e006eda0 2024-09-18T01:28:24.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.007+0000 7fe2ceffd640 1 -- 172.21.15.92:0/1307512270 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d0004160 con 0x7fe2e006eda0 2024-09-18T01:28:24.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.008+0000 7fe2e49bd640 1 -- 172.21.15.92:0/1307512270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e006e030 con 0x7fe2e006eda0 2024-09-18T01:28:24.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.008+0000 7fe2ceffd640 1 -- 172.21.15.92:0/1307512270 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe2d003a040 con 0x7fe2e006eda0 2024-09-18T01:28:24.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.008+0000 7fe2e49bd640 1 -- 172.21.15.92:0/1307512270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e0122670 con 0x7fe2e006eda0 2024-09-18T01:28:24.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.008+0000 7fe2ceffd640 1 --2- 172.21.15.92:0/1307512270 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe2c00382a0 0x7fe2c003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:24.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.009+0000 7fe2ceffd640 1 -- 172.21.15.92:0/1307512270 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fe2d006c670 con 0x7fe2e006eda0 2024-09-18T01:28:24.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.009+0000 7fe2ddd9b640 1 --2- 172.21.15.92:0/1307512270 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe2c00382a0 0x7fe2c003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:24.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.009+0000 7fe2ddd9b640 1 --2- 172.21.15.92:0/1307512270 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe2c00382a0 0x7fe2c003a760 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4000c00 tx=0x7fe2d4007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:24.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.013+0000 7fe2ceffd640 1 -- 172.21.15.92:0/1307512270 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe2d0042020 con 0x7fe2e006eda0 2024-09-18T01:28:24.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.176+0000 7fe2e49bd640 1 -- 172.21.15.92:0/1307512270 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe2e008cee0 con 0x7fe2c00382a0 2024-09-18T01:28:24.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.192+0000 7fe2ceffd640 1 -- 172.21.15.92:0/1307512270 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666082 (secure 0 0 0) 0x7fe2e008cee0 con 0x7fe2c00382a0 2024-09-18T01:28:24.201 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:28:24.207 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-18T01:28:24.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.197+0000 7fe2e49bd640 1 -- 172.21.15.92:0/1307512270 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe2c00382a0 msgr2=0x7fe2c003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:24.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.197+0000 7fe2e49bd640 1 --2- 172.21.15.92:0/1307512270 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe2c00382a0 0x7fe2c003a760 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4000c00 tx=0x7fe2d4007910 comp rx=0 tx=0).stop 2024-09-18T01:28:24.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.197+0000 7fe2e49bd640 1 -- 172.21.15.92:0/1307512270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2e006eda0 msgr2=0x7fe2e006d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:24.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.197+0000 7fe2e49bd640 1 --2- 172.21.15.92:0/1307512270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2e006eda0 0x7fe2e006d910 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0035040 tx=0x7fe2d00046c0 comp rx=0 tx=0).stop 2024-09-18T01:28:24.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.197+0000 7fe2e49bd640 1 -- 172.21.15.92:0/1307512270 shutdown_connections 2024-09-18T01:28:24.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.197+0000 7fe2e49bd640 1 --2- 172.21.15.92:0/1307512270 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fe2c00382a0 0x7fe2c003a760 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:24.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.197+0000 7fe2e49bd640 1 --2- 172.21.15.92:0/1307512270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2e006eda0 0x7fe2e006d910 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:24.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.197+0000 7fe2e49bd640 1 -- 172.21.15.92:0/1307512270 >> 172.21.15.92:0/1307512270 conn(0x7fe2e009a890 msgr2=0x7fe2e0098040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:24.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.197+0000 7fe2e49bd640 1 -- 172.21.15.92:0/1307512270 shutdown_connections 2024-09-18T01:28:24.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.197+0000 7fe2e49bd640 1 -- 172.21.15.92:0/1307512270 wait complete. 2024-09-18T01:28:24.211 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-18T01:28:22.826312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416905,"num_objects":261,"num_object_clones":0,"num_object_copies":536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5167,"num_read_kb":4712,"num_write":2298,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":993,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4671,"ondisk_log_size":4671,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186264,"kb_used_data":36568,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377301096,"statfs":{"total":386547056640,"available":386356322304,"internally_reserved":0,"allocated":37445632,"data_stored":36225546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004131"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846091+0000","last_change":"2024-09-18T01:25:06.692305+0000","last_active":"2024-09-18T01:25:43.846091+0000","last_peered":"2024-09-18T01:25:43.846091+0000","last_clean":"2024-09-18T01:25:43.846091+0000","last_became_active":"2024-09-18T01:25:06.691940+0000","last_became_peered":"2024-09-18T01:25:06.691940+0000","last_unstale":"2024-09-18T01:25:43.846091+0000","last_undegraded":"2024-09-18T01:25:43.846091+0000","last_fullsized":"2024-09-18T01:25:43.846091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:24.579150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'13","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153106+0000","last_change":"2024-09-18T01:25:08.683809+0000","last_active":"2024-09-18T01:28:17.153106+0000","last_peered":"2024-09-18T01:28:17.153106+0000","last_clean":"2024-09-18T01:28:17.153106+0000","last_became_active":"2024-09-18T01:25:08.683538+0000","last_became_peered":"2024-09-18T01:25:08.683538+0000","last_unstale":"2024-09-18T01:28:17.153106+0000","last_undegraded":"2024-09-18T01:28:17.153106+0000","last_fullsized":"2024-09-18T01:28:17.153106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:05.611732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.796081+0000","last_change":"2024-09-18T01:25:06.687454+0000","last_active":"2024-09-18T01:27:12.796081+0000","last_peered":"2024-09-18T01:27:12.796081+0000","last_clean":"2024-09-18T01:27:12.796081+0000","last_became_active":"2024-09-18T01:25:06.686950+0000","last_became_peered":"2024-09-18T01:25:06.686950+0000","last_unstale":"2024-09-18T01:27:12.796081+0000","last_undegraded":"2024-09-18T01:27:12.796081+0000","last_fullsized":"2024-09-18T01:27:12.796081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:03.894308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'20","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954431+0000","last_change":"2024-09-18T01:25:08.673859+0000","last_active":"2024-09-18T01:28:16.954431+0000","last_peered":"2024-09-18T01:28:16.954431+0000","last_clean":"2024-09-18T01:28:16.954431+0000","last_became_active":"2024-09-18T01:25:08.673552+0000","last_became_peered":"2024-09-18T01:25:08.673552+0000","last_unstale":"2024-09-18T01:28:16.954431+0000","last_undegraded":"2024-09-18T01:28:16.954431+0000","last_fullsized":"2024-09-18T01:28:16.954431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:50:57.219183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.852159+0000","last_change":"2024-09-18T01:25:06.687698+0000","last_active":"2024-09-18T01:25:43.852159+0000","last_peered":"2024-09-18T01:25:43.852159+0000","last_clean":"2024-09-18T01:25:43.852159+0000","last_became_active":"2024-09-18T01:25:06.687068+0000","last_became_peered":"2024-09-18T01:25:06.687068+0000","last_unstale":"2024-09-18T01:25:43.852159+0000","last_undegraded":"2024-09-18T01:25:43.852159+0000","last_fullsized":"2024-09-18T01:25:43.852159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:28.131866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'10","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097039+0000","last_change":"2024-09-18T01:25:08.685372+0000","last_active":"2024-09-18T01:28:17.097039+0000","last_peered":"2024-09-18T01:28:17.097039+0000","last_clean":"2024-09-18T01:28:17.097039+0000","last_became_active":"2024-09-18T01:25:08.685074+0000","last_became_peered":"2024-09-18T01:25:08.685074+0000","last_unstale":"2024-09-18T01:28:17.097039+0000","last_undegraded":"2024-09-18T01:28:17.097039+0000","last_fullsized":"2024-09-18T01:28:17.097039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:49.546714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844176+0000","last_change":"2024-09-18T01:25:06.690926+0000","last_active":"2024-09-18T01:25:43.844176+0000","last_peered":"2024-09-18T01:25:43.844176+0000","last_clean":"2024-09-18T01:25:43.844176+0000","last_became_active":"2024-09-18T01:25:06.690552+0000","last_became_peered":"2024-09-18T01:25:06.690552+0000","last_unstale":"2024-09-18T01:25:43.844176+0000","last_undegraded":"2024-09-18T01:25:43.844176+0000","last_fullsized":"2024-09-18T01:25:43.844176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:39:53.953032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'8","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.453023+0000","last_change":"2024-09-18T01:25:08.676582+0000","last_active":"2024-09-18T01:25:50.453023+0000","last_peered":"2024-09-18T01:25:50.453023+0000","last_clean":"2024-09-18T01:25:50.453023+0000","last_became_active":"2024-09-18T01:25:08.674210+0000","last_became_peered":"2024-09-18T01:25:08.674210+0000","last_unstale":"2024-09-18T01:25:50.453023+0000","last_undegraded":"2024-09-18T01:25:50.453023+0000","last_fullsized":"2024-09-18T01:25:50.453023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:19:54.471269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.435444+0000","last_change":"2024-09-18T01:25:06.689859+0000","last_active":"2024-09-18T01:27:16.435444+0000","last_peered":"2024-09-18T01:27:16.435444+0000","last_clean":"2024-09-18T01:27:16.435444+0000","last_became_active":"2024-09-18T01:25:06.687608+0000","last_became_peered":"2024-09-18T01:25:06.687608+0000","last_unstale":"2024-09-18T01:27:16.435444+0000","last_undegraded":"2024-09-18T01:27:16.435444+0000","last_fullsized":"2024-09-18T01:27:16.435444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:30:22.917213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.387179+0000","last_change":"2024-09-18T01:25:08.684086+0000","last_active":"2024-09-18T01:27:13.387179+0000","last_peered":"2024-09-18T01:27:13.387179+0000","last_clean":"2024-09-18T01:27:13.387179+0000","last_became_active":"2024-09-18T01:25:08.683812+0000","last_became_peered":"2024-09-18T01:25:08.683812+0000","last_unstale":"2024-09-18T01:27:13.387179+0000","last_undegraded":"2024-09-18T01:27:13.387179+0000","last_fullsized":"2024-09-18T01:27:13.387179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:37.287772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.092252+0000","last_change":"2024-09-18T01:25:06.702940+0000","last_active":"2024-09-18T01:28:17.092252+0000","last_peered":"2024-09-18T01:28:17.092252+0000","last_clean":"2024-09-18T01:28:17.092252+0000","last_became_active":"2024-09-18T01:25:06.702616+0000","last_became_peered":"2024-09-18T01:25:06.702616+0000","last_unstale":"2024-09-18T01:28:17.092252+0000","last_undegraded":"2024-09-18T01:28:17.092252+0000","last_fullsized":"2024-09-18T01:28:17.092252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:53.580899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'8","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.956371+0000","last_change":"2024-09-18T01:25:43.904757+0000","last_active":"2024-09-18T01:28:16.956371+0000","last_peered":"2024-09-18T01:28:16.956371+0000","last_clean":"2024-09-18T01:28:16.956371+0000","last_became_active":"2024-09-18T01:25:43.904427+0000","last_became_peered":"2024-09-18T01:25:43.904427+0000","last_unstale":"2024-09-18T01:28:16.956371+0000","last_undegraded":"2024-09-18T01:28:16.956371+0000","last_fullsized":"2024-09-18T01:28:16.956371+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:33:47.798452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848729+0000","last_change":"2024-09-18T01:25:06.683548+0000","last_active":"2024-09-18T01:25:43.848729+0000","last_peered":"2024-09-18T01:25:43.848729+0000","last_clean":"2024-09-18T01:25:43.848729+0000","last_became_active":"2024-09-18T01:25:06.683195+0000","last_became_peered":"2024-09-18T01:25:06.683195+0000","last_unstale":"2024-09-18T01:25:43.848729+0000","last_undegraded":"2024-09-18T01:25:43.848729+0000","last_fullsized":"2024-09-18T01:25:43.848729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:13.167515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.796067+0000","last_change":"2024-09-18T01:25:08.677859+0000","last_active":"2024-09-18T01:27:14.796067+0000","last_peered":"2024-09-18T01:27:14.796067+0000","last_clean":"2024-09-18T01:27:14.796067+0000","last_became_active":"2024-09-18T01:25:08.677579+0000","last_became_peered":"2024-09-18T01:25:08.677579+0000","last_unstale":"2024-09-18T01:27:14.796067+0000","last_undegraded":"2024-09-18T01:27:14.796067+0000","last_fullsized":"2024-09-18T01:27:14.796067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:39.586169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844028+0000","last_change":"2024-09-18T01:25:06.686453+0000","last_active":"2024-09-18T01:25:43.844028+0000","last_peered":"2024-09-18T01:25:43.844028+0000","last_clean":"2024-09-18T01:25:43.844028+0000","last_became_active":"2024-09-18T01:25:06.686049+0000","last_became_peered":"2024-09-18T01:25:06.686049+0000","last_unstale":"2024-09-18T01:25:43.844028+0000","last_undegraded":"2024-09-18T01:25:43.844028+0000","last_fullsized":"2024-09-18T01:25:43.844028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:53.580899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.477318+0000","last_change":"2024-09-18T01:25:08.676582+0000","last_active":"2024-09-18T01:27:16.477318+0000","last_peered":"2024-09-18T01:27:16.477318+0000","last_clean":"2024-09-18T01:27:16.477318+0000","last_became_active":"2024-09-18T01:25:08.676310+0000","last_became_peered":"2024-09-18T01:25:08.676310+0000","last_unstale":"2024-09-18T01:27:16.477318+0000","last_undegraded":"2024-09-18T01:27:16.477318+0000","last_fullsized":"2024-09-18T01:27:16.477318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:55:06.296443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'24","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.104105+0000","last_change":"2024-09-18T01:25:08.673269+0000","last_active":"2024-09-18T01:28:17.104105+0000","last_peered":"2024-09-18T01:28:17.104105+0000","last_clean":"2024-09-18T01:28:17.104105+0000","last_became_active":"2024-09-18T01:25:08.671858+0000","last_became_peered":"2024-09-18T01:25:08.671858+0000","last_unstale":"2024-09-18T01:28:17.104105+0000","last_undegraded":"2024-09-18T01:28:17.104105+0000","last_fullsized":"2024-09-18T01:28:17.104105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:50:36.347808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":55,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.907039+0000","last_change":"2024-09-18T01:25:06.691701+0000","last_active":"2024-09-18T01:25:43.907039+0000","last_peered":"2024-09-18T01:25:43.907039+0000","last_clean":"2024-09-18T01:25:43.907039+0000","last_became_active":"2024-09-18T01:25:06.691034+0000","last_became_peered":"2024-09-18T01:25:06.691034+0000","last_unstale":"2024-09-18T01:25:43.907039+0000","last_undegraded":"2024-09-18T01:25:43.907039+0000","last_fullsized":"2024-09-18T01:25:43.907039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:43.801545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'3","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799237+0000","last_change":"2024-09-18T01:25:08.685309+0000","last_active":"2024-09-18T01:27:29.799237+0000","last_peered":"2024-09-18T01:27:29.799237+0000","last_clean":"2024-09-18T01:27:29.799237+0000","last_became_active":"2024-09-18T01:25:08.685043+0000","last_became_peered":"2024-09-18T01:25:08.685043+0000","last_unstale":"2024-09-18T01:27:29.799237+0000","last_undegraded":"2024-09-18T01:27:29.799237+0000","last_fullsized":"2024-09-18T01:27:29.799237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:39.586169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846314+0000","last_change":"2024-09-18T01:25:06.704767+0000","last_active":"2024-09-18T01:25:43.846314+0000","last_peered":"2024-09-18T01:25:43.846314+0000","last_clean":"2024-09-18T01:25:43.846314+0000","last_became_active":"2024-09-18T01:25:06.704414+0000","last_became_peered":"2024-09-18T01:25:06.704414+0000","last_unstale":"2024-09-18T01:25:43.846314+0000","last_undegraded":"2024-09-18T01:25:43.846314+0000","last_fullsized":"2024-09-18T01:25:43.846314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:43.801545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097079+0000","last_change":"2024-09-18T01:25:08.685665+0000","last_active":"2024-09-18T01:28:17.097079+0000","last_peered":"2024-09-18T01:28:17.097079+0000","last_clean":"2024-09-18T01:28:17.097079+0000","last_became_active":"2024-09-18T01:25:08.684921+0000","last_became_peered":"2024-09-18T01:25:08.684921+0000","last_unstale":"2024-09-18T01:28:17.097079+0000","last_undegraded":"2024-09-18T01:28:17.097079+0000","last_fullsized":"2024-09-18T01:28:17.097079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:15:04.998223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'3","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.741010+0000","last_change":"2024-09-18T01:25:06.688208+0000","last_active":"2024-09-18T01:26:32.741010+0000","last_peered":"2024-09-18T01:26:32.741010+0000","last_clean":"2024-09-18T01:26:32.741010+0000","last_became_active":"2024-09-18T01:25:06.687737+0000","last_became_peered":"2024-09-18T01:25:06.687737+0000","last_unstale":"2024-09-18T01:26:32.741010+0000","last_undegraded":"2024-09-18T01:26:32.741010+0000","last_fullsized":"2024-09-18T01:26:32.741010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:16.022647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'16","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.394341+0000","last_change":"2024-09-18T01:25:08.671649+0000","last_active":"2024-09-18T01:27:13.394341+0000","last_peered":"2024-09-18T01:27:13.394341+0000","last_clean":"2024-09-18T01:27:13.394341+0000","last_became_active":"2024-09-18T01:25:08.671338+0000","last_became_peered":"2024-09-18T01:25:08.671338+0000","last_unstale":"2024-09-18T01:27:13.394341+0000","last_undegraded":"2024-09-18T01:27:13.394341+0000","last_fullsized":"2024-09-18T01:27:13.394341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:55:06.296443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905086+0000","last_change":"2024-09-18T01:25:06.688689+0000","last_active":"2024-09-18T01:25:43.905086+0000","last_peered":"2024-09-18T01:25:43.905086+0000","last_clean":"2024-09-18T01:25:43.905086+0000","last_became_active":"2024-09-18T01:25:06.688356+0000","last_became_peered":"2024-09-18T01:25:06.688356+0000","last_unstale":"2024-09-18T01:25:43.905086+0000","last_undegraded":"2024-09-18T01:25:43.905086+0000","last_fullsized":"2024-09-18T01:25:43.905086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:22.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941235+0000","last_change":"2024-09-18T01:25:08.674151+0000","last_active":"2024-09-18T01:26:32.941235+0000","last_peered":"2024-09-18T01:26:32.941235+0000","last_clean":"2024-09-18T01:26:32.941235+0000","last_became_active":"2024-09-18T01:25:08.673915+0000","last_became_peered":"2024-09-18T01:25:08.673915+0000","last_unstale":"2024-09-18T01:26:32.941235+0000","last_undegraded":"2024-09-18T01:26:32.941235+0000","last_fullsized":"2024-09-18T01:26:32.941235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:42:49.663850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846696+0000","last_change":"2024-09-18T01:25:06.687453+0000","last_active":"2024-09-18T01:25:43.846696+0000","last_peered":"2024-09-18T01:25:43.846696+0000","last_clean":"2024-09-18T01:25:43.846696+0000","last_became_active":"2024-09-18T01:25:06.686900+0000","last_became_peered":"2024-09-18T01:25:06.686900+0000","last_unstale":"2024-09-18T01:25:43.846696+0000","last_undegraded":"2024-09-18T01:25:43.846696+0000","last_fullsized":"2024-09-18T01:25:43.846696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:18.475907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.142353+0000","last_change":"2024-09-18T01:25:08.682513+0000","last_active":"2024-09-18T01:28:17.142353+0000","last_peered":"2024-09-18T01:28:17.142353+0000","last_clean":"2024-09-18T01:28:17.142353+0000","last_became_active":"2024-09-18T01:25:08.682225+0000","last_became_peered":"2024-09-18T01:25:08.682225+0000","last_unstale":"2024-09-18T01:28:17.142353+0000","last_undegraded":"2024-09-18T01:28:17.142353+0000","last_fullsized":"2024-09-18T01:28:17.142353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:34:57.289152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849721+0000","last_change":"2024-09-18T01:25:06.695620+0000","last_active":"2024-09-18T01:25:43.849721+0000","last_peered":"2024-09-18T01:25:43.849721+0000","last_clean":"2024-09-18T01:25:43.849721+0000","last_became_active":"2024-09-18T01:25:06.693647+0000","last_became_peered":"2024-09-18T01:25:06.693647+0000","last_unstale":"2024-09-18T01:25:43.849721+0000","last_undegraded":"2024-09-18T01:25:43.849721+0000","last_fullsized":"2024-09-18T01:25:43.849721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:00:13.013796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'35","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.121409+0000","last_change":"2024-09-18T01:25:16.712693+0000","last_active":"2024-09-18T01:28:17.121409+0000","last_peered":"2024-09-18T01:28:17.121409+0000","last_clean":"2024-09-18T01:28:17.121409+0000","last_became_active":"2024-09-18T01:25:16.712438+0000","last_became_peered":"2024-09-18T01:25:16.712438+0000","last_unstale":"2024-09-18T01:28:17.121409+0000","last_undegraded":"2024-09-18T01:28:17.121409+0000","last_fullsized":"2024-09-18T01:28:17.121409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:49.191321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.485988+0000","last_change":"2024-09-18T01:25:08.673859+0000","last_active":"2024-09-18T01:27:16.485988+0000","last_peered":"2024-09-18T01:27:16.485988+0000","last_clean":"2024-09-18T01:27:16.485988+0000","last_became_active":"2024-09-18T01:25:08.673605+0000","last_became_peered":"2024-09-18T01:25:08.673605+0000","last_unstale":"2024-09-18T01:27:16.485988+0000","last_undegraded":"2024-09-18T01:27:16.485988+0000","last_fullsized":"2024-09-18T01:27:16.485988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:55:33.999113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849855+0000","last_change":"2024-09-18T01:25:06.687788+0000","last_active":"2024-09-18T01:25:43.849855+0000","last_peered":"2024-09-18T01:25:43.849855+0000","last_clean":"2024-09-18T01:25:43.849855+0000","last_became_active":"2024-09-18T01:25:06.685173+0000","last_became_peered":"2024-09-18T01:25:06.685173+0000","last_unstale":"2024-09-18T01:25:43.849855+0000","last_undegraded":"2024-09-18T01:25:43.849855+0000","last_fullsized":"2024-09-18T01:25:43.849855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:13.192602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850787+0000","last_change":"2024-09-18T01:25:10.684730+0000","last_active":"2024-09-18T01:25:43.850787+0000","last_peered":"2024-09-18T01:25:43.850787+0000","last_clean":"2024-09-18T01:25:43.850787+0000","last_became_active":"2024-09-18T01:25:10.684454+0000","last_became_peered":"2024-09-18T01:25:10.684454+0000","last_unstale":"2024-09-18T01:25:43.850787+0000","last_undegraded":"2024-09-18T01:25:43.850787+0000","last_fullsized":"2024-09-18T01:25:43.850787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:30:35.363182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'42","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.063374+0000","last_change":"2024-09-18T01:25:12.692370+0000","last_active":"2024-09-18T01:27:15.063374+0000","last_peered":"2024-09-18T01:27:15.063374+0000","last_clean":"2024-09-18T01:27:15.063374+0000","last_became_active":"2024-09-18T01:25:12.692059+0000","last_became_peered":"2024-09-18T01:25:12.692059+0000","last_unstale":"2024-09-18T01:27:15.063374+0000","last_undegraded":"2024-09-18T01:27:15.063374+0000","last_fullsized":"2024-09-18T01:27:15.063374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:17:50.198957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906790+0000","last_change":"2024-09-18T01:25:14.710315+0000","last_active":"2024-09-18T01:25:43.906790+0000","last_peered":"2024-09-18T01:25:43.906790+0000","last_clean":"2024-09-18T01:25:43.906790+0000","last_became_active":"2024-09-18T01:25:14.709879+0000","last_became_peered":"2024-09-18T01:25:14.709879+0000","last_unstale":"2024-09-18T01:25:43.906790+0000","last_undegraded":"2024-09-18T01:25:43.906790+0000","last_fullsized":"2024-09-18T01:25:43.906790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:49.524031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.757439+0000","last_change":"2024-09-18T01:25:16.712032+0000","last_active":"2024-09-18T01:26:32.757439+0000","last_peered":"2024-09-18T01:26:32.757439+0000","last_clean":"2024-09-18T01:26:32.757439+0000","last_became_active":"2024-09-18T01:25:16.711764+0000","last_became_peered":"2024-09-18T01:25:16.711764+0000","last_unstale":"2024-09-18T01:26:32.757439+0000","last_undegraded":"2024-09-18T01:26:32.757439+0000","last_fullsized":"2024-09-18T01:26:32.757439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:53:25.033231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:44.783814+0000","last_change":"2024-09-18T01:25:43.852201+0000","last_active":"2024-09-18T01:25:44.783814+0000","last_peered":"2024-09-18T01:25:44.783814+0000","last_clean":"2024-09-18T01:25:44.783814+0000","last_became_active":"2024-09-18T01:25:43.848631+0000","last_became_peered":"2024-09-18T01:25:43.848631+0000","last_unstale":"2024-09-18T01:25:44.783814+0000","last_undegraded":"2024-09-18T01:25:44.783814+0000","last_fullsized":"2024-09-18T01:25:44.783814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:19:57.986757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:49.297524+0000","last_change":"2024-09-18T01:25:06.691194+0000","last_active":"2024-09-18T01:25:49.297524+0000","last_peered":"2024-09-18T01:25:49.297524+0000","last_clean":"2024-09-18T01:25:49.297524+0000","last_became_active":"2024-09-18T01:25:06.690813+0000","last_became_peered":"2024-09-18T01:25:06.690813+0000","last_unstale":"2024-09-18T01:25:49.297524+0000","last_undegraded":"2024-09-18T01:25:49.297524+0000","last_fullsized":"2024-09-18T01:25:49.297524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:22.518297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844623+0000","last_change":"2024-09-18T01:25:10.677775+0000","last_active":"2024-09-18T01:25:43.844623+0000","last_peered":"2024-09-18T01:25:43.844623+0000","last_clean":"2024-09-18T01:25:43.844623+0000","last_became_active":"2024-09-18T01:25:10.677226+0000","last_became_peered":"2024-09-18T01:25:10.677226+0000","last_unstale":"2024-09-18T01:25:43.844623+0000","last_undegraded":"2024-09-18T01:25:43.844623+0000","last_fullsized":"2024-09-18T01:25:43.844623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:49:15.909145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'13","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906372+0000","last_change":"2024-09-18T01:25:12.688633+0000","last_active":"2024-09-18T01:25:43.906372+0000","last_peered":"2024-09-18T01:25:43.906372+0000","last_clean":"2024-09-18T01:25:43.906372+0000","last_became_active":"2024-09-18T01:25:12.688366+0000","last_became_peered":"2024-09-18T01:25:12.688366+0000","last_unstale":"2024-09-18T01:25:43.906372+0000","last_undegraded":"2024-09-18T01:25:43.906372+0000","last_fullsized":"2024-09-18T01:25:43.906372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:39:55.232921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905614+0000","last_change":"2024-09-18T01:25:14.703217+0000","last_active":"2024-09-18T01:25:43.905614+0000","last_peered":"2024-09-18T01:25:43.905614+0000","last_clean":"2024-09-18T01:25:43.905614+0000","last_became_active":"2024-09-18T01:25:14.702918+0000","last_became_peered":"2024-09-18T01:25:14.702918+0000","last_unstale":"2024-09-18T01:25:43.905614+0000","last_undegraded":"2024-09-18T01:25:43.905614+0000","last_fullsized":"2024-09-18T01:25:43.905614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:23.103965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.232357+0000","last_change":"2024-09-18T01:25:16.714035+0000","last_active":"2024-09-18T01:28:17.232357+0000","last_peered":"2024-09-18T01:28:17.232357+0000","last_clean":"2024-09-18T01:28:17.232357+0000","last_became_active":"2024-09-18T01:25:16.713571+0000","last_became_peered":"2024-09-18T01:25:16.713571+0000","last_unstale":"2024-09-18T01:28:17.232357+0000","last_undegraded":"2024-09-18T01:28:17.232357+0000","last_fullsized":"2024-09-18T01:28:17.232357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:32:22.558708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'8","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176653+0000","last_change":"2024-09-18T01:25:08.673278+0000","last_active":"2024-09-18T01:28:17.176653+0000","last_peered":"2024-09-18T01:28:17.176653+0000","last_clean":"2024-09-18T01:28:17.176653+0000","last_became_active":"2024-09-18T01:25:08.671904+0000","last_became_peered":"2024-09-18T01:25:08.671904+0000","last_unstale":"2024-09-18T01:28:17.176653+0000","last_undegraded":"2024-09-18T01:28:17.176653+0000","last_fullsized":"2024-09-18T01:28:17.176653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:58:59.174725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848365+0000","last_change":"2024-09-18T01:25:06.681491+0000","last_active":"2024-09-18T01:25:43.848365+0000","last_peered":"2024-09-18T01:25:43.848365+0000","last_clean":"2024-09-18T01:25:43.848365+0000","last_became_active":"2024-09-18T01:25:06.681065+0000","last_became_peered":"2024-09-18T01:25:06.681065+0000","last_unstale":"2024-09-18T01:25:43.848365+0000","last_undegraded":"2024-09-18T01:25:43.848365+0000","last_fullsized":"2024-09-18T01:25:43.848365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:46:18.563504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847654+0000","last_change":"2024-09-18T01:25:10.677498+0000","last_active":"2024-09-18T01:25:43.847654+0000","last_peered":"2024-09-18T01:25:43.847654+0000","last_clean":"2024-09-18T01:25:43.847654+0000","last_became_active":"2024-09-18T01:25:10.677118+0000","last_became_peered":"2024-09-18T01:25:10.677118+0000","last_unstale":"2024-09-18T01:25:43.847654+0000","last_undegraded":"2024-09-18T01:25:43.847654+0000","last_fullsized":"2024-09-18T01:25:43.847654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:13.973263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'22","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844252+0000","last_change":"2024-09-18T01:25:12.693775+0000","last_active":"2024-09-18T01:25:43.844252+0000","last_peered":"2024-09-18T01:25:43.844252+0000","last_clean":"2024-09-18T01:25:43.844252+0000","last_became_active":"2024-09-18T01:25:12.693426+0000","last_became_peered":"2024-09-18T01:25:12.693426+0000","last_unstale":"2024-09-18T01:25:43.844252+0000","last_undegraded":"2024-09-18T01:25:43.844252+0000","last_fullsized":"2024-09-18T01:25:43.844252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:03.617713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'282","reported_seq":381,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:15.763451+0000","last_change":"2024-09-18T01:25:14.707813+0000","last_active":"2024-09-18T01:28:15.763451+0000","last_peered":"2024-09-18T01:28:15.763451+0000","last_clean":"2024-09-18T01:28:15.763451+0000","last_became_active":"2024-09-18T01:25:14.707544+0000","last_became_peered":"2024-09-18T01:25:14.707544+0000","last_unstale":"2024-09-18T01:28:15.763451+0000","last_undegraded":"2024-09-18T01:28:15.763451+0000","last_fullsized":"2024-09-18T01:28:15.763451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:19.273177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843579+0000","last_change":"2024-09-18T01:25:16.714182+0000","last_active":"2024-09-18T01:25:43.843579+0000","last_peered":"2024-09-18T01:25:43.843579+0000","last_clean":"2024-09-18T01:25:43.843579+0000","last_became_active":"2024-09-18T01:25:16.713458+0000","last_became_peered":"2024-09-18T01:25:16.713458+0000","last_unstale":"2024-09-18T01:25:43.843579+0000","last_undegraded":"2024-09-18T01:25:43.843579+0000","last_fullsized":"2024-09-18T01:25:43.843579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:25.118447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847600+0000","last_change":"2024-09-18T01:25:08.681420+0000","last_active":"2024-09-18T01:25:43.847600+0000","last_peered":"2024-09-18T01:25:43.847600+0000","last_clean":"2024-09-18T01:25:43.847600+0000","last_became_active":"2024-09-18T01:25:08.680700+0000","last_became_peered":"2024-09-18T01:25:08.680700+0000","last_unstale":"2024-09-18T01:25:43.847600+0000","last_undegraded":"2024-09-18T01:25:43.847600+0000","last_fullsized":"2024-09-18T01:25:43.847600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:15:04.998223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.442367+0000","last_change":"2024-09-18T01:25:06.691595+0000","last_active":"2024-09-18T01:25:50.442367+0000","last_peered":"2024-09-18T01:25:50.442367+0000","last_clean":"2024-09-18T01:25:50.442367+0000","last_became_active":"2024-09-18T01:25:06.691107+0000","last_became_peered":"2024-09-18T01:25:06.691107+0000","last_unstale":"2024-09-18T01:25:50.442367+0000","last_undegraded":"2024-09-18T01:25:50.442367+0000","last_fullsized":"2024-09-18T01:25:50.442367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:50.530673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850726+0000","last_change":"2024-09-18T01:25:10.681604+0000","last_active":"2024-09-18T01:25:43.850726+0000","last_peered":"2024-09-18T01:25:43.850726+0000","last_clean":"2024-09-18T01:25:43.850726+0000","last_became_active":"2024-09-18T01:25:10.681273+0000","last_became_peered":"2024-09-18T01:25:10.681273+0000","last_unstale":"2024-09-18T01:25:43.850726+0000","last_undegraded":"2024-09-18T01:25:43.850726+0000","last_fullsized":"2024-09-18T01:25:43.850726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:22.269662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'39","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.058017+0000","last_change":"2024-09-18T01:25:12.697422+0000","last_active":"2024-09-18T01:27:15.058017+0000","last_peered":"2024-09-18T01:27:15.058017+0000","last_clean":"2024-09-18T01:27:15.058017+0000","last_became_active":"2024-09-18T01:25:12.697114+0000","last_became_peered":"2024-09-18T01:25:12.697114+0000","last_unstale":"2024-09-18T01:27:15.058017+0000","last_undegraded":"2024-09-18T01:27:15.058017+0000","last_fullsized":"2024-09-18T01:27:15.058017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:43:37.538211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":52,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'282","reported_seq":405,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.288775+0000","last_change":"2024-09-18T01:25:14.699167+0000","last_active":"2024-09-18T01:28:17.288775+0000","last_peered":"2024-09-18T01:28:17.288775+0000","last_clean":"2024-09-18T01:28:17.288775+0000","last_became_active":"2024-09-18T01:25:14.698792+0000","last_became_peered":"2024-09-18T01:25:14.698792+0000","last_unstale":"2024-09-18T01:28:17.288775+0000","last_undegraded":"2024-09-18T01:28:17.288775+0000","last_fullsized":"2024-09-18T01:28:17.288775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:49.524031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.147884+0000","last_change":"2024-09-18T01:25:08.680575+0000","last_active":"2024-09-18T01:28:17.147884+0000","last_peered":"2024-09-18T01:28:17.147884+0000","last_clean":"2024-09-18T01:28:17.147884+0000","last_became_active":"2024-09-18T01:25:08.680143+0000","last_became_peered":"2024-09-18T01:25:08.680143+0000","last_unstale":"2024-09-18T01:28:17.147884+0000","last_undegraded":"2024-09-18T01:28:17.147884+0000","last_fullsized":"2024-09-18T01:28:17.147884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:30:09.036921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845910+0000","last_change":"2024-09-18T01:25:06.701050+0000","last_active":"2024-09-18T01:25:43.845910+0000","last_peered":"2024-09-18T01:25:43.845910+0000","last_clean":"2024-09-18T01:25:43.845910+0000","last_became_active":"2024-09-18T01:25:06.700650+0000","last_became_peered":"2024-09-18T01:25:06.700650+0000","last_unstale":"2024-09-18T01:25:43.845910+0000","last_undegraded":"2024-09-18T01:25:43.845910+0000","last_fullsized":"2024-09-18T01:25:43.845910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:03.343944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904327+0000","last_change":"2024-09-18T01:25:10.683497+0000","last_active":"2024-09-18T01:25:43.904327+0000","last_peered":"2024-09-18T01:25:43.904327+0000","last_clean":"2024-09-18T01:25:43.904327+0000","last_became_active":"2024-09-18T01:25:10.683195+0000","last_became_peered":"2024-09-18T01:25:10.683195+0000","last_unstale":"2024-09-18T01:25:43.904327+0000","last_undegraded":"2024-09-18T01:25:43.904327+0000","last_fullsized":"2024-09-18T01:25:43.904327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:18:42.429992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'47","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.067406+0000","last_change":"2024-09-18T01:25:12.688936+0000","last_active":"2024-09-18T01:27:15.067406+0000","last_peered":"2024-09-18T01:27:15.067406+0000","last_clean":"2024-09-18T01:27:15.067406+0000","last_became_active":"2024-09-18T01:25:12.687943+0000","last_became_peered":"2024-09-18T01:25:12.687943+0000","last_unstale":"2024-09-18T01:27:15.067406+0000","last_undegraded":"2024-09-18T01:27:15.067406+0000","last_fullsized":"2024-09-18T01:27:15.067406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:18:44.438408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846245+0000","last_change":"2024-09-18T01:25:14.699129+0000","last_active":"2024-09-18T01:25:43.846245+0000","last_peered":"2024-09-18T01:25:43.846245+0000","last_clean":"2024-09-18T01:25:43.846245+0000","last_became_active":"2024-09-18T01:25:14.698795+0000","last_became_peered":"2024-09-18T01:25:14.698795+0000","last_unstale":"2024-09-18T01:25:43.846245+0000","last_undegraded":"2024-09-18T01:25:43.846245+0000","last_fullsized":"2024-09-18T01:25:43.846245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:48.579196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'3","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.759291+0000","last_change":"2024-09-18T01:25:16.707493+0000","last_active":"2024-09-18T01:26:32.759291+0000","last_peered":"2024-09-18T01:26:32.759291+0000","last_clean":"2024-09-18T01:26:32.759291+0000","last_became_active":"2024-09-18T01:25:16.707206+0000","last_became_peered":"2024-09-18T01:25:16.707206+0000","last_unstale":"2024-09-18T01:26:32.759291+0000","last_undegraded":"2024-09-18T01:26:32.759291+0000","last_fullsized":"2024-09-18T01:26:32.759291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:51.538514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.867670+0000","last_change":"2024-09-18T01:25:08.683170+0000","last_active":"2024-09-18T01:28:16.867670+0000","last_peered":"2024-09-18T01:28:16.867670+0000","last_clean":"2024-09-18T01:28:16.867670+0000","last_became_active":"2024-09-18T01:25:08.682878+0000","last_became_peered":"2024-09-18T01:25:08.682878+0000","last_unstale":"2024-09-18T01:28:16.867670+0000","last_undegraded":"2024-09-18T01:28:16.867670+0000","last_fullsized":"2024-09-18T01:28:16.867670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:29.205884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.170801+0000","last_change":"2024-09-18T01:25:06.700753+0000","last_active":"2024-09-18T01:28:17.170801+0000","last_peered":"2024-09-18T01:28:17.170801+0000","last_clean":"2024-09-18T01:28:17.170801+0000","last_became_active":"2024-09-18T01:25:06.700357+0000","last_became_peered":"2024-09-18T01:25:06.700357+0000","last_unstale":"2024-09-18T01:28:17.170801+0000","last_undegraded":"2024-09-18T01:28:17.170801+0000","last_fullsized":"2024-09-18T01:28:17.170801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:08.432830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":218,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.133643+0000","last_change":"2024-09-18T01:25:10.680004+0000","last_active":"2024-09-18T01:27:16.133643+0000","last_peered":"2024-09-18T01:27:16.133643+0000","last_clean":"2024-09-18T01:27:16.133643+0000","last_became_active":"2024-09-18T01:25:10.679652+0000","last_became_peered":"2024-09-18T01:25:10.679652+0000","last_unstale":"2024-09-18T01:27:16.133643+0000","last_undegraded":"2024-09-18T01:27:16.133643+0000","last_fullsized":"2024-09-18T01:27:16.133643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:02.192046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'36","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.047616+0000","last_change":"2024-09-18T01:25:12.691981+0000","last_active":"2024-09-18T01:27:15.047616+0000","last_peered":"2024-09-18T01:27:15.047616+0000","last_clean":"2024-09-18T01:27:15.047616+0000","last_became_active":"2024-09-18T01:25:12.691691+0000","last_became_peered":"2024-09-18T01:25:12.691691+0000","last_unstale":"2024-09-18T01:27:15.047616+0000","last_undegraded":"2024-09-18T01:27:15.047616+0000","last_fullsized":"2024-09-18T01:27:15.047616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:40:21.738974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844437+0000","last_change":"2024-09-18T01:25:14.706870+0000","last_active":"2024-09-18T01:25:43.844437+0000","last_peered":"2024-09-18T01:25:43.844437+0000","last_clean":"2024-09-18T01:25:43.844437+0000","last_became_active":"2024-09-18T01:25:14.706505+0000","last_became_peered":"2024-09-18T01:25:14.706505+0000","last_unstale":"2024-09-18T01:25:43.844437+0000","last_undegraded":"2024-09-18T01:25:43.844437+0000","last_fullsized":"2024-09-18T01:25:43.844437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:31:17.162597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'3","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:27.222234+0000","last_change":"2024-09-18T01:25:16.713810+0000","last_active":"2024-09-18T01:26:27.222234+0000","last_peered":"2024-09-18T01:26:27.222234+0000","last_clean":"2024-09-18T01:26:27.222234+0000","last_became_active":"2024-09-18T01:25:16.713453+0000","last_became_peered":"2024-09-18T01:25:16.713453+0000","last_unstale":"2024-09-18T01:26:27.222234+0000","last_undegraded":"2024-09-18T01:26:27.222234+0000","last_fullsized":"2024-09-18T01:26:27.222234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:37.223946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'5","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.796758+0000","last_change":"2024-09-18T01:25:08.674795+0000","last_active":"2024-09-18T01:27:19.796758+0000","last_peered":"2024-09-18T01:27:19.796758+0000","last_clean":"2024-09-18T01:27:19.796758+0000","last_became_active":"2024-09-18T01:25:08.674525+0000","last_became_peered":"2024-09-18T01:25:08.674525+0000","last_unstale":"2024-09-18T01:27:19.796758+0000","last_undegraded":"2024-09-18T01:27:19.796758+0000","last_fullsized":"2024-09-18T01:27:19.796758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:55:50.100041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.083065+0000","last_change":"2024-09-18T01:25:06.696117+0000","last_active":"2024-09-18T01:28:17.083065+0000","last_peered":"2024-09-18T01:28:17.083065+0000","last_clean":"2024-09-18T01:28:17.083065+0000","last_became_active":"2024-09-18T01:25:06.694058+0000","last_became_peered":"2024-09-18T01:25:06.694058+0000","last_unstale":"2024-09-18T01:28:17.083065+0000","last_undegraded":"2024-09-18T01:28:17.083065+0000","last_fullsized":"2024-09-18T01:28:17.083065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:58:41.570989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:44.783777+0000","last_change":"2024-09-18T01:25:43.903991+0000","last_active":"2024-09-18T01:25:44.783777+0000","last_peered":"2024-09-18T01:25:44.783777+0000","last_clean":"2024-09-18T01:25:44.783777+0000","last_became_active":"2024-09-18T01:25:43.903638+0000","last_became_peered":"2024-09-18T01:25:43.903638+0000","last_unstale":"2024-09-18T01:25:44.783777+0000","last_undegraded":"2024-09-18T01:25:44.783777+0000","last_fullsized":"2024-09-18T01:25:44.783777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:53:19.003232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'48","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.069310+0000","last_change":"2024-09-18T01:25:12.694029+0000","last_active":"2024-09-18T01:27:15.069310+0000","last_peered":"2024-09-18T01:27:15.069310+0000","last_clean":"2024-09-18T01:27:15.069310+0000","last_became_active":"2024-09-18T01:25:12.693182+0000","last_became_peered":"2024-09-18T01:25:12.693182+0000","last_unstale":"2024-09-18T01:27:15.069310+0000","last_undegraded":"2024-09-18T01:27:15.069310+0000","last_fullsized":"2024-09-18T01:27:15.069310+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:08:39.434682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'282","reported_seq":348,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.298524+0000","last_change":"2024-09-18T01:25:14.706933+0000","last_active":"2024-09-18T01:28:17.298524+0000","last_peered":"2024-09-18T01:28:17.298524+0000","last_clean":"2024-09-18T01:28:17.298524+0000","last_became_active":"2024-09-18T01:25:14.706540+0000","last_became_peered":"2024-09-18T01:25:14.706540+0000","last_unstale":"2024-09-18T01:28:17.298524+0000","last_undegraded":"2024-09-18T01:28:17.298524+0000","last_fullsized":"2024-09-18T01:28:17.298524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:27.416743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.391512+0000","last_change":"2024-09-18T01:25:16.714648+0000","last_active":"2024-09-18T01:27:13.391512+0000","last_peered":"2024-09-18T01:27:13.391512+0000","last_clean":"2024-09-18T01:27:13.391512+0000","last_became_active":"2024-09-18T01:25:16.714363+0000","last_became_peered":"2024-09-18T01:25:16.714363+0000","last_unstale":"2024-09-18T01:27:13.391512+0000","last_undegraded":"2024-09-18T01:27:13.391512+0000","last_fullsized":"2024-09-18T01:27:13.391512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:59:11.881576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.866295+0000","last_change":"2024-09-18T01:25:08.670862+0000","last_active":"2024-09-18T01:28:16.866295+0000","last_peered":"2024-09-18T01:28:16.866295+0000","last_clean":"2024-09-18T01:28:16.866295+0000","last_became_active":"2024-09-18T01:25:08.670617+0000","last_became_peered":"2024-09-18T01:25:08.670617+0000","last_unstale":"2024-09-18T01:28:16.866295+0000","last_undegraded":"2024-09-18T01:28:16.866295+0000","last_fullsized":"2024-09-18T01:28:16.866295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:29.205884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849958+0000","last_change":"2024-09-18T01:25:06.693637+0000","last_active":"2024-09-18T01:25:43.849958+0000","last_peered":"2024-09-18T01:25:43.849958+0000","last_clean":"2024-09-18T01:25:43.849958+0000","last_became_active":"2024-09-18T01:25:06.689545+0000","last_became_peered":"2024-09-18T01:25:06.689545+0000","last_unstale":"2024-09-18T01:25:43.849958+0000","last_undegraded":"2024-09-18T01:25:43.849958+0000","last_fullsized":"2024-09-18T01:25:43.849958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:57.969892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:44.783756+0000","last_change":"2024-09-18T01:25:43.907490+0000","last_active":"2024-09-18T01:25:44.783756+0000","last_peered":"2024-09-18T01:25:44.783756+0000","last_clean":"2024-09-18T01:25:44.783756+0000","last_became_active":"2024-09-18T01:25:43.907094+0000","last_became_peered":"2024-09-18T01:25:43.907094+0000","last_unstale":"2024-09-18T01:25:44.783756+0000","last_undegraded":"2024-09-18T01:25:44.783756+0000","last_fullsized":"2024-09-18T01:25:44.783756+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:26:05.185230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'67","reported_seq":135,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798143+0000","last_change":"2024-09-18T01:25:12.693226+0000","last_active":"2024-09-18T01:27:24.798143+0000","last_peered":"2024-09-18T01:27:24.798143+0000","last_clean":"2024-09-18T01:27:24.798143+0000","last_became_active":"2024-09-18T01:25:12.692821+0000","last_became_peered":"2024-09-18T01:25:12.692821+0000","last_unstale":"2024-09-18T01:27:24.798143+0000","last_undegraded":"2024-09-18T01:27:24.798143+0000","last_fullsized":"2024-09-18T01:27:24.798143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:15.391395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5917,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":32,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843893+0000","last_change":"2024-09-18T01:25:14.707691+0000","last_active":"2024-09-18T01:25:43.843893+0000","last_peered":"2024-09-18T01:25:43.843893+0000","last_clean":"2024-09-18T01:25:43.843893+0000","last_became_active":"2024-09-18T01:25:14.707514+0000","last_became_peered":"2024-09-18T01:25:14.707514+0000","last_unstale":"2024-09-18T01:25:43.843893+0000","last_undegraded":"2024-09-18T01:25:43.843893+0000","last_fullsized":"2024-09-18T01:25:43.843893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:57.575198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.271704+0000","last_change":"2024-09-18T01:25:16.706301+0000","last_active":"2024-09-18T01:28:17.271704+0000","last_peered":"2024-09-18T01:28:17.271704+0000","last_clean":"2024-09-18T01:28:17.271704+0000","last_became_active":"2024-09-18T01:25:16.705938+0000","last_became_peered":"2024-09-18T01:25:16.705938+0000","last_unstale":"2024-09-18T01:28:17.271704+0000","last_undegraded":"2024-09-18T01:28:17.271704+0000","last_fullsized":"2024-09-18T01:28:17.271704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:48:53.777539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176669+0000","last_change":"2024-09-18T01:25:08.687495+0000","last_active":"2024-09-18T01:28:17.176669+0000","last_peered":"2024-09-18T01:28:17.176669+0000","last_clean":"2024-09-18T01:28:17.176669+0000","last_became_active":"2024-09-18T01:25:08.687135+0000","last_became_peered":"2024-09-18T01:25:08.687135+0000","last_unstale":"2024-09-18T01:28:17.176669+0000","last_undegraded":"2024-09-18T01:28:17.176669+0000","last_fullsized":"2024-09-18T01:28:17.176669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:15.493296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845740+0000","last_change":"2024-09-18T01:25:06.681219+0000","last_active":"2024-09-18T01:25:43.845740+0000","last_peered":"2024-09-18T01:25:43.845740+0000","last_clean":"2024-09-18T01:25:43.845740+0000","last_became_active":"2024-09-18T01:25:06.680774+0000","last_became_peered":"2024-09-18T01:25:06.680774+0000","last_unstale":"2024-09-18T01:25:43.845740+0000","last_undegraded":"2024-09-18T01:25:43.845740+0000","last_fullsized":"2024-09-18T01:25:43.845740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:33:48.652888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845831+0000","last_change":"2024-09-18T01:25:10.675268+0000","last_active":"2024-09-18T01:25:43.845831+0000","last_peered":"2024-09-18T01:25:43.845831+0000","last_clean":"2024-09-18T01:25:43.845831+0000","last_became_active":"2024-09-18T01:25:10.674983+0000","last_became_peered":"2024-09-18T01:25:10.674983+0000","last_unstale":"2024-09-18T01:25:43.845831+0000","last_undegraded":"2024-09-18T01:25:43.845831+0000","last_fullsized":"2024-09-18T01:25:43.845831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:25:15.816622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'38","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.051893+0000","last_change":"2024-09-18T01:25:12.683645+0000","last_active":"2024-09-18T01:27:15.051893+0000","last_peered":"2024-09-18T01:27:15.051893+0000","last_clean":"2024-09-18T01:27:15.051893+0000","last_became_active":"2024-09-18T01:25:12.683339+0000","last_became_peered":"2024-09-18T01:25:12.683339+0000","last_unstale":"2024-09-18T01:27:15.051893+0000","last_undegraded":"2024-09-18T01:27:15.051893+0000","last_fullsized":"2024-09-18T01:27:15.051893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:55:20.974738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851387+0000","last_change":"2024-09-18T01:25:14.708366+0000","last_active":"2024-09-18T01:25:43.851387+0000","last_peered":"2024-09-18T01:25:43.851387+0000","last_clean":"2024-09-18T01:25:43.851387+0000","last_became_active":"2024-09-18T01:25:14.707116+0000","last_became_peered":"2024-09-18T01:25:14.707116+0000","last_unstale":"2024-09-18T01:25:43.851387+0000","last_undegraded":"2024-09-18T01:25:43.851387+0000","last_fullsized":"2024-09-18T01:25:43.851387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:38.584056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797258+0000","last_change":"2024-09-18T01:25:16.708368+0000","last_active":"2024-09-18T01:27:19.797258+0000","last_peered":"2024-09-18T01:27:19.797258+0000","last_clean":"2024-09-18T01:27:19.797258+0000","last_became_active":"2024-09-18T01:25:16.708095+0000","last_became_peered":"2024-09-18T01:25:16.708095+0000","last_unstale":"2024-09-18T01:27:19.797258+0000","last_undegraded":"2024-09-18T01:27:19.797258+0000","last_fullsized":"2024-09-18T01:27:19.797258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:48.121756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.752010+0000","last_change":"2024-09-18T01:25:08.688693+0000","last_active":"2024-09-18T01:26:32.752010+0000","last_peered":"2024-09-18T01:26:32.752010+0000","last_clean":"2024-09-18T01:26:32.752010+0000","last_became_active":"2024-09-18T01:25:08.688251+0000","last_became_peered":"2024-09-18T01:25:08.688251+0000","last_unstale":"2024-09-18T01:26:32.752010+0000","last_undegraded":"2024-09-18T01:26:32.752010+0000","last_fullsized":"2024-09-18T01:26:32.752010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:56.803513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797428+0000","last_change":"2024-09-18T01:25:06.684669+0000","last_active":"2024-09-18T01:27:19.797428+0000","last_peered":"2024-09-18T01:27:19.797428+0000","last_clean":"2024-09-18T01:27:19.797428+0000","last_became_active":"2024-09-18T01:25:06.683437+0000","last_became_peered":"2024-09-18T01:25:06.683437+0000","last_unstale":"2024-09-18T01:27:19.797428+0000","last_undegraded":"2024-09-18T01:27:19.797428+0000","last_fullsized":"2024-09-18T01:27:19.797428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:23.462064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844681+0000","last_change":"2024-09-18T01:25:10.680258+0000","last_active":"2024-09-18T01:25:43.844681+0000","last_peered":"2024-09-18T01:25:43.844681+0000","last_clean":"2024-09-18T01:25:43.844681+0000","last_became_active":"2024-09-18T01:25:10.679740+0000","last_became_peered":"2024-09-18T01:25:10.679740+0000","last_unstale":"2024-09-18T01:25:43.844681+0000","last_undegraded":"2024-09-18T01:25:43.844681+0000","last_fullsized":"2024-09-18T01:25:43.844681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:40.355268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'36","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.077766+0000","last_change":"2024-09-18T01:25:12.687798+0000","last_active":"2024-09-18T01:27:15.077766+0000","last_peered":"2024-09-18T01:27:15.077766+0000","last_clean":"2024-09-18T01:27:15.077766+0000","last_became_active":"2024-09-18T01:25:12.686455+0000","last_became_peered":"2024-09-18T01:25:12.686455+0000","last_unstale":"2024-09-18T01:27:15.077766+0000","last_undegraded":"2024-09-18T01:27:15.077766+0000","last_fullsized":"2024-09-18T01:27:15.077766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:43.085499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'282","reported_seq":403,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.275706+0000","last_change":"2024-09-18T01:25:14.704198+0000","last_active":"2024-09-18T01:28:17.275706+0000","last_peered":"2024-09-18T01:28:17.275706+0000","last_clean":"2024-09-18T01:28:17.275706+0000","last_became_active":"2024-09-18T01:25:14.703877+0000","last_became_peered":"2024-09-18T01:25:14.703877+0000","last_unstale":"2024-09-18T01:28:17.275706+0000","last_undegraded":"2024-09-18T01:28:17.275706+0000","last_fullsized":"2024-09-18T01:28:17.275706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:39:57.240022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'12","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:22.797572+0000","last_change":"2024-09-18T01:25:16.714095+0000","last_active":"2024-09-18T01:27:22.797572+0000","last_peered":"2024-09-18T01:27:22.797572+0000","last_clean":"2024-09-18T01:27:22.797572+0000","last_became_active":"2024-09-18T01:25:16.713677+0000","last_became_peered":"2024-09-18T01:25:16.713677+0000","last_unstale":"2024-09-18T01:27:22.797572+0000","last_undegraded":"2024-09-18T01:27:22.797572+0000","last_fullsized":"2024-09-18T01:27:22.797572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:37.223946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954552+0000","last_change":"2024-09-18T01:25:08.673535+0000","last_active":"2024-09-18T01:28:16.954552+0000","last_peered":"2024-09-18T01:28:16.954552+0000","last_clean":"2024-09-18T01:28:16.954552+0000","last_became_active":"2024-09-18T01:25:08.673276+0000","last_became_peered":"2024-09-18T01:25:08.673276+0000","last_unstale":"2024-09-18T01:28:16.954552+0000","last_undegraded":"2024-09-18T01:28:16.954552+0000","last_fullsized":"2024-09-18T01:28:16.954552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:58.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.463022+0000","last_change":"2024-09-18T01:25:06.683319+0000","last_active":"2024-09-18T01:27:16.463022+0000","last_peered":"2024-09-18T01:27:16.463022+0000","last_clean":"2024-09-18T01:27:16.463022+0000","last_became_active":"2024-09-18T01:25:06.682841+0000","last_became_peered":"2024-09-18T01:25:06.682841+0000","last_unstale":"2024-09-18T01:27:16.463022+0000","last_undegraded":"2024-09-18T01:27:16.463022+0000","last_fullsized":"2024-09-18T01:27:16.463022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:52:44.524173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":413,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.133229+0000","last_change":"2024-09-18T01:25:10.680374+0000","last_active":"2024-09-18T01:27:16.133229+0000","last_peered":"2024-09-18T01:27:16.133229+0000","last_clean":"2024-09-18T01:27:16.133229+0000","last_became_active":"2024-09-18T01:25:10.679483+0000","last_became_peered":"2024-09-18T01:25:10.679483+0000","last_unstale":"2024-09-18T01:27:16.133229+0000","last_undegraded":"2024-09-18T01:27:16.133229+0000","last_fullsized":"2024-09-18T01:27:16.133229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:41.077084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851675+0000","last_change":"2024-09-18T01:25:12.697050+0000","last_active":"2024-09-18T01:25:43.851675+0000","last_peered":"2024-09-18T01:25:43.851675+0000","last_clean":"2024-09-18T01:25:43.851675+0000","last_became_active":"2024-09-18T01:25:12.696726+0000","last_became_peered":"2024-09-18T01:25:12.696726+0000","last_unstale":"2024-09-18T01:25:43.851675+0000","last_undegraded":"2024-09-18T01:25:43.851675+0000","last_fullsized":"2024-09-18T01:25:43.851675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:25.931338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'282","reported_seq":510,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.234675+0000","last_change":"2024-09-18T01:25:14.705212+0000","last_active":"2024-09-18T01:28:17.234675+0000","last_peered":"2024-09-18T01:28:17.234675+0000","last_clean":"2024-09-18T01:28:17.234675+0000","last_became_active":"2024-09-18T01:25:14.702900+0000","last_became_peered":"2024-09-18T01:25:14.702900+0000","last_unstale":"2024-09-18T01:28:17.234675+0000","last_undegraded":"2024-09-18T01:28:17.234675+0000","last_fullsized":"2024-09-18T01:28:17.234675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:44.393089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.267015+0000","last_change":"2024-09-18T01:25:16.712364+0000","last_active":"2024-09-18T01:27:16.267015+0000","last_peered":"2024-09-18T01:27:16.267015+0000","last_clean":"2024-09-18T01:27:16.267015+0000","last_became_active":"2024-09-18T01:25:16.712084+0000","last_became_peered":"2024-09-18T01:25:16.712084+0000","last_unstale":"2024-09-18T01:27:16.267015+0000","last_undegraded":"2024-09-18T01:27:16.267015+0000","last_fullsized":"2024-09-18T01:27:16.267015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:46.407572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'8","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.144995+0000","last_change":"2024-09-18T01:25:08.687109+0000","last_active":"2024-09-18T01:28:17.144995+0000","last_peered":"2024-09-18T01:28:17.144995+0000","last_clean":"2024-09-18T01:28:17.144995+0000","last_became_active":"2024-09-18T01:25:08.686802+0000","last_became_peered":"2024-09-18T01:25:08.686802+0000","last_unstale":"2024-09-18T01:28:17.144995+0000","last_undegraded":"2024-09-18T01:28:17.144995+0000","last_fullsized":"2024-09-18T01:28:17.144995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:13.745242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.080072+0000","last_change":"2024-09-18T01:25:06.695782+0000","last_active":"2024-09-18T01:28:17.080072+0000","last_peered":"2024-09-18T01:28:17.080072+0000","last_clean":"2024-09-18T01:28:17.080072+0000","last_became_active":"2024-09-18T01:25:06.691644+0000","last_became_peered":"2024-09-18T01:25:06.691644+0000","last_unstale":"2024-09-18T01:28:17.080072+0000","last_undegraded":"2024-09-18T01:28:17.080072+0000","last_fullsized":"2024-09-18T01:28:17.080072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:51:10.947372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851329+0000","last_change":"2024-09-18T01:25:10.682385+0000","last_active":"2024-09-18T01:25:43.851329+0000","last_peered":"2024-09-18T01:25:43.851329+0000","last_clean":"2024-09-18T01:25:43.851329+0000","last_became_active":"2024-09-18T01:25:10.682075+0000","last_became_peered":"2024-09-18T01:25:10.682075+0000","last_unstale":"2024-09-18T01:25:43.851329+0000","last_undegraded":"2024-09-18T01:25:43.851329+0000","last_fullsized":"2024-09-18T01:25:43.851329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:28.482490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'39","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.064387+0000","last_change":"2024-09-18T01:25:12.686750+0000","last_active":"2024-09-18T01:27:15.064387+0000","last_peered":"2024-09-18T01:27:15.064387+0000","last_clean":"2024-09-18T01:27:15.064387+0000","last_became_active":"2024-09-18T01:25:12.686460+0000","last_became_peered":"2024-09-18T01:25:12.686460+0000","last_unstale":"2024-09-18T01:27:15.064387+0000","last_undegraded":"2024-09-18T01:27:15.064387+0000","last_fullsized":"2024-09-18T01:27:15.064387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:56.008777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843863+0000","last_change":"2024-09-18T01:25:14.706837+0000","last_active":"2024-09-18T01:25:43.843863+0000","last_peered":"2024-09-18T01:25:43.843863+0000","last_clean":"2024-09-18T01:25:43.843863+0000","last_became_active":"2024-09-18T01:25:14.706506+0000","last_became_peered":"2024-09-18T01:25:14.706506+0000","last_unstale":"2024-09-18T01:25:43.843863+0000","last_undegraded":"2024-09-18T01:25:43.843863+0000","last_fullsized":"2024-09-18T01:25:43.843863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:31:25.019479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.209468+0000","last_change":"2024-09-18T01:25:16.709338+0000","last_active":"2024-09-18T01:28:17.209468+0000","last_peered":"2024-09-18T01:28:17.209468+0000","last_clean":"2024-09-18T01:28:17.209468+0000","last_became_active":"2024-09-18T01:25:16.709084+0000","last_became_peered":"2024-09-18T01:25:16.709084+0000","last_unstale":"2024-09-18T01:28:17.209468+0000","last_undegraded":"2024-09-18T01:28:17.209468+0000","last_fullsized":"2024-09-18T01:28:17.209468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:26:11.215230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'7","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183392+0000","last_change":"2024-09-18T01:25:08.688515+0000","last_active":"2024-09-18T01:28:17.183392+0000","last_peered":"2024-09-18T01:28:17.183392+0000","last_clean":"2024-09-18T01:28:17.183392+0000","last_became_active":"2024-09-18T01:25:08.687896+0000","last_became_peered":"2024-09-18T01:25:08.687896+0000","last_unstale":"2024-09-18T01:28:17.183392+0000","last_undegraded":"2024-09-18T01:28:17.183392+0000","last_fullsized":"2024-09-18T01:28:17.183392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:47:23.724986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":204,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903661+0000","last_change":"2024-09-18T01:24:52.297138+0000","last_active":"2024-09-18T01:25:43.903661+0000","last_peered":"2024-09-18T01:25:43.903661+0000","last_clean":"2024-09-18T01:25:43.903661+0000","last_became_active":"2024-09-18T01:24:52.296214+0000","last_became_peered":"2024-09-18T01:24:52.296214+0000","last_unstale":"2024-09-18T01:25:43.903661+0000","last_undegraded":"2024-09-18T01:25:43.903661+0000","last_fullsized":"2024-09-18T01:25:43.903661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_clean_scrub_stamp":"2024-09-18T01:24:51.161687+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:36:16.487345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850355+0000","last_change":"2024-09-18T01:24:58.197569+0000","last_active":"2024-09-18T01:25:43.850355+0000","last_peered":"2024-09-18T01:25:43.850355+0000","last_clean":"2024-09-18T01:25:43.850355+0000","last_became_active":"2024-09-18T01:24:56.194443+0000","last_became_peered":"2024-09-18T01:24:56.194443+0000","last_unstale":"2024-09-18T01:25:43.850355+0000","last_undegraded":"2024-09-18T01:25:43.850355+0000","last_fullsized":"2024-09-18T01:25:43.850355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:43:12.854702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033763700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.850186+0000","last_change":"2024-09-18T01:25:06.684714+0000","last_active":"2024-09-18T01:28:16.850186+0000","last_peered":"2024-09-18T01:28:16.850186+0000","last_clean":"2024-09-18T01:28:16.850186+0000","last_became_active":"2024-09-18T01:25:06.683975+0000","last_became_peered":"2024-09-18T01:25:06.683975+0000","last_unstale":"2024-09-18T01:28:16.850186+0000","last_undegraded":"2024-09-18T01:28:16.850186+0000","last_fullsized":"2024-09-18T01:28:16.850186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:47.187628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904635+0000","last_change":"2024-09-18T01:25:10.679847+0000","last_active":"2024-09-18T01:25:43.904635+0000","last_peered":"2024-09-18T01:25:43.904635+0000","last_clean":"2024-09-18T01:25:43.904635+0000","last_became_active":"2024-09-18T01:25:10.679572+0000","last_became_peered":"2024-09-18T01:25:10.679572+0000","last_unstale":"2024-09-18T01:25:43.904635+0000","last_undegraded":"2024-09-18T01:25:43.904635+0000","last_fullsized":"2024-09-18T01:25:43.904635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:53:26.506877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'82","reported_seq":157,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.075538+0000","last_change":"2024-09-18T01:25:12.692243+0000","last_active":"2024-09-18T01:27:15.075538+0000","last_peered":"2024-09-18T01:27:15.075538+0000","last_clean":"2024-09-18T01:27:15.075538+0000","last_became_active":"2024-09-18T01:25:12.691952+0000","last_became_peered":"2024-09-18T01:25:12.691952+0000","last_unstale":"2024-09-18T01:27:15.075538+0000","last_undegraded":"2024-09-18T01:27:15.075538+0000","last_fullsized":"2024-09-18T01:27:15.075538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:38.540516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845488+0000","last_change":"2024-09-18T01:25:14.707170+0000","last_active":"2024-09-18T01:25:43.845488+0000","last_peered":"2024-09-18T01:25:43.845488+0000","last_clean":"2024-09-18T01:25:43.845488+0000","last_became_active":"2024-09-18T01:25:14.706519+0000","last_became_peered":"2024-09-18T01:25:14.706519+0000","last_unstale":"2024-09-18T01:25:43.845488+0000","last_undegraded":"2024-09-18T01:25:43.845488+0000","last_fullsized":"2024-09-18T01:25:43.845488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:53.286034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'85","reported_seq":168,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.185765+0000","last_change":"2024-09-18T01:25:16.712377+0000","last_active":"2024-09-18T01:28:17.185765+0000","last_peered":"2024-09-18T01:28:17.185765+0000","last_clean":"2024-09-18T01:28:17.185765+0000","last_became_active":"2024-09-18T01:25:16.712102+0000","last_became_peered":"2024-09-18T01:25:16.712102+0000","last_unstale":"2024-09-18T01:28:17.185765+0000","last_undegraded":"2024-09-18T01:28:17.185765+0000","last_fullsized":"2024-09-18T01:28:17.185765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:59.589681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":221,"num_write":168,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'7","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797548+0000","last_change":"2024-09-18T01:25:08.672900+0000","last_active":"2024-09-18T01:27:19.797548+0000","last_peered":"2024-09-18T01:27:19.797548+0000","last_clean":"2024-09-18T01:27:19.797548+0000","last_became_active":"2024-09-18T01:25:08.671578+0000","last_became_peered":"2024-09-18T01:25:08.671578+0000","last_unstale":"2024-09-18T01:27:19.797548+0000","last_undegraded":"2024-09-18T01:27:19.797548+0000","last_fullsized":"2024-09-18T01:27:19.797548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:01:40.367586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847748+0000","last_change":"2024-09-18T01:24:58.197615+0000","last_active":"2024-09-18T01:25:43.847748+0000","last_peered":"2024-09-18T01:25:43.847748+0000","last_clean":"2024-09-18T01:25:43.847748+0000","last_became_active":"2024-09-18T01:24:56.191554+0000","last_became_peered":"2024-09-18T01:24:56.191554+0000","last_unstale":"2024-09-18T01:25:43.847748+0000","last_undegraded":"2024-09-18T01:25:43.847748+0000","last_fullsized":"2024-09-18T01:25:43.847748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:55.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041584599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843970+0000","last_change":"2024-09-18T01:25:06.681216+0000","last_active":"2024-09-18T01:25:43.843970+0000","last_peered":"2024-09-18T01:25:43.843970+0000","last_clean":"2024-09-18T01:25:43.843970+0000","last_became_active":"2024-09-18T01:25:06.680635+0000","last_became_peered":"2024-09-18T01:25:06.680635+0000","last_unstale":"2024-09-18T01:25:43.843970+0000","last_undegraded":"2024-09-18T01:25:43.843970+0000","last_fullsized":"2024-09-18T01:25:43.843970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:43.801545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851531+0000","last_change":"2024-09-18T01:25:10.682266+0000","last_active":"2024-09-18T01:25:43.851531+0000","last_peered":"2024-09-18T01:25:43.851531+0000","last_clean":"2024-09-18T01:25:43.851531+0000","last_became_active":"2024-09-18T01:25:10.681988+0000","last_became_peered":"2024-09-18T01:25:10.681988+0000","last_unstale":"2024-09-18T01:25:43.851531+0000","last_undegraded":"2024-09-18T01:25:43.851531+0000","last_fullsized":"2024-09-18T01:25:43.851531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:53:03.896010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'279","reported_seq":488,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:15.763669+0000","last_change":"2024-09-18T01:25:12.694263+0000","last_active":"2024-09-18T01:28:15.763669+0000","last_peered":"2024-09-18T01:28:15.763669+0000","last_clean":"2024-09-18T01:28:15.763669+0000","last_became_active":"2024-09-18T01:25:12.693664+0000","last_became_peered":"2024-09-18T01:25:12.693664+0000","last_unstale":"2024-09-18T01:28:15.763669+0000","last_undegraded":"2024-09-18T01:28:15.763669+0000","last_fullsized":"2024-09-18T01:28:15.763669+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:31:23.012378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850081+0000","last_change":"2024-09-18T01:25:14.707563+0000","last_active":"2024-09-18T01:25:43.850081+0000","last_peered":"2024-09-18T01:25:43.850081+0000","last_clean":"2024-09-18T01:25:43.850081+0000","last_became_active":"2024-09-18T01:25:14.707143+0000","last_became_peered":"2024-09-18T01:25:14.707143+0000","last_unstale":"2024-09-18T01:25:43.850081+0000","last_undegraded":"2024-09-18T01:25:43.850081+0000","last_fullsized":"2024-09-18T01:25:43.850081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:07.461296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.886187+0000","last_change":"2024-09-18T01:25:16.714554+0000","last_active":"2024-09-18T01:28:16.886187+0000","last_peered":"2024-09-18T01:28:16.886187+0000","last_clean":"2024-09-18T01:28:16.886187+0000","last_became_active":"2024-09-18T01:25:16.712931+0000","last_became_peered":"2024-09-18T01:25:16.712931+0000","last_unstale":"2024-09-18T01:28:16.886187+0000","last_undegraded":"2024-09-18T01:28:16.886187+0000","last_fullsized":"2024-09-18T01:28:16.886187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:20:06.027889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954356+0000","last_change":"2024-09-18T01:25:08.681154+0000","last_active":"2024-09-18T01:28:16.954356+0000","last_peered":"2024-09-18T01:28:16.954356+0000","last_clean":"2024-09-18T01:28:16.954356+0000","last_became_active":"2024-09-18T01:25:08.680541+0000","last_became_peered":"2024-09-18T01:25:08.680541+0000","last_unstale":"2024-09-18T01:28:16.954356+0000","last_undegraded":"2024-09-18T01:28:16.954356+0000","last_fullsized":"2024-09-18T01:28:16.954356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:15.493296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843251+0000","last_change":"2024-09-18T01:24:58.350485+0000","last_active":"2024-09-18T01:25:43.843251+0000","last_peered":"2024-09-18T01:25:43.843251+0000","last_clean":"2024-09-18T01:25:43.843251+0000","last_became_active":"2024-09-18T01:24:56.191162+0000","last_became_peered":"2024-09-18T01:24:56.191162+0000","last_unstale":"2024-09-18T01:25:43.843251+0000","last_undegraded":"2024-09-18T01:25:43.843251+0000","last_fullsized":"2024-09-18T01:25:43.843251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:38:00.033247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040921399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:07.795274+0000","last_change":"2024-09-18T01:25:06.686498+0000","last_active":"2024-09-18T01:27:07.795274+0000","last_peered":"2024-09-18T01:27:07.795274+0000","last_clean":"2024-09-18T01:27:07.795274+0000","last_became_active":"2024-09-18T01:25:06.686053+0000","last_became_peered":"2024-09-18T01:25:06.686053+0000","last_unstale":"2024-09-18T01:27:07.795274+0000","last_undegraded":"2024-09-18T01:27:07.795274+0000","last_fullsized":"2024-09-18T01:27:07.795274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:22.518297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845792+0000","last_change":"2024-09-18T01:25:10.677853+0000","last_active":"2024-09-18T01:25:43.845792+0000","last_peered":"2024-09-18T01:25:43.845792+0000","last_clean":"2024-09-18T01:25:43.845792+0000","last_became_active":"2024-09-18T01:25:10.677597+0000","last_became_peered":"2024-09-18T01:25:10.677597+0000","last_unstale":"2024-09-18T01:25:43.845792+0000","last_undegraded":"2024-09-18T01:25:43.845792+0000","last_fullsized":"2024-09-18T01:25:43.845792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:29.066415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:15.763577+0000","last_change":"2024-09-18T01:25:12.688147+0000","last_active":"2024-09-18T01:28:15.763577+0000","last_peered":"2024-09-18T01:28:15.763577+0000","last_clean":"2024-09-18T01:28:15.763577+0000","last_became_active":"2024-09-18T01:25:12.687799+0000","last_became_peered":"2024-09-18T01:25:12.687799+0000","last_unstale":"2024-09-18T01:28:15.763577+0000","last_undegraded":"2024-09-18T01:28:15.763577+0000","last_fullsized":"2024-09-18T01:28:15.763577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:03:37.628556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845029+0000","last_change":"2024-09-18T01:25:14.706976+0000","last_active":"2024-09-18T01:25:43.845029+0000","last_peered":"2024-09-18T01:25:43.845029+0000","last_clean":"2024-09-18T01:25:43.845029+0000","last_became_active":"2024-09-18T01:25:14.706611+0000","last_became_peered":"2024-09-18T01:25:14.706611+0000","last_unstale":"2024-09-18T01:25:43.845029+0000","last_undegraded":"2024-09-18T01:25:43.845029+0000","last_fullsized":"2024-09-18T01:25:43.845029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:15.483666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849369+0000","last_change":"2024-09-18T01:25:16.711670+0000","last_active":"2024-09-18T01:25:43.849369+0000","last_peered":"2024-09-18T01:25:43.849369+0000","last_clean":"2024-09-18T01:25:43.849369+0000","last_became_active":"2024-09-18T01:25:16.711404+0000","last_became_peered":"2024-09-18T01:25:16.711404+0000","last_unstale":"2024-09-18T01:25:43.849369+0000","last_undegraded":"2024-09-18T01:25:43.849369+0000","last_fullsized":"2024-09-18T01:25:43.849369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:12:32.036544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097075+0000","last_change":"2024-09-18T01:25:08.673345+0000","last_active":"2024-09-18T01:28:17.097075+0000","last_peered":"2024-09-18T01:28:17.097075+0000","last_clean":"2024-09-18T01:28:17.097075+0000","last_became_active":"2024-09-18T01:25:08.672969+0000","last_became_peered":"2024-09-18T01:25:08.672969+0000","last_unstale":"2024-09-18T01:28:17.097075+0000","last_undegraded":"2024-09-18T01:28:17.097075+0000","last_fullsized":"2024-09-18T01:28:17.097075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:37.287772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849309+0000","last_change":"2024-09-18T01:24:58.198236+0000","last_active":"2024-09-18T01:25:43.849309+0000","last_peered":"2024-09-18T01:25:43.849309+0000","last_clean":"2024-09-18T01:25:43.849309+0000","last_became_active":"2024-09-18T01:24:56.191713+0000","last_became_peered":"2024-09-18T01:24:56.191713+0000","last_unstale":"2024-09-18T01:25:43.849309+0000","last_undegraded":"2024-09-18T01:25:43.849309+0000","last_fullsized":"2024-09-18T01:25:43.849309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:55:46.520977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010043490000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844211+0000","last_change":"2024-09-18T01:25:06.700684+0000","last_active":"2024-09-18T01:25:43.844211+0000","last_peered":"2024-09-18T01:25:43.844211+0000","last_clean":"2024-09-18T01:25:43.844211+0000","last_became_active":"2024-09-18T01:25:06.700397+0000","last_became_peered":"2024-09-18T01:25:06.700397+0000","last_unstale":"2024-09-18T01:25:43.844211+0000","last_undegraded":"2024-09-18T01:25:43.844211+0000","last_fullsized":"2024-09-18T01:25:43.844211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:22.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845266+0000","last_change":"2024-09-18T01:25:10.676620+0000","last_active":"2024-09-18T01:25:43.845266+0000","last_peered":"2024-09-18T01:25:43.845266+0000","last_clean":"2024-09-18T01:25:43.845266+0000","last_became_active":"2024-09-18T01:25:10.676320+0000","last_became_peered":"2024-09-18T01:25:10.676320+0000","last_unstale":"2024-09-18T01:25:43.845266+0000","last_undegraded":"2024-09-18T01:25:43.845266+0000","last_fullsized":"2024-09-18T01:25:43.845266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:01:00.415475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'13","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.498611+0000","last_change":"2024-09-18T01:25:12.692628+0000","last_active":"2024-09-18T01:28:16.498611+0000","last_peered":"2024-09-18T01:28:16.498611+0000","last_clean":"2024-09-18T01:28:16.498611+0000","last_became_active":"2024-09-18T01:25:12.692373+0000","last_became_peered":"2024-09-18T01:25:12.692373+0000","last_unstale":"2024-09-18T01:28:16.498611+0000","last_undegraded":"2024-09-18T01:28:16.498611+0000","last_fullsized":"2024-09-18T01:28:16.498611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:48.277377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851686+0000","last_change":"2024-09-18T01:25:14.709358+0000","last_active":"2024-09-18T01:25:43.851686+0000","last_peered":"2024-09-18T01:25:43.851686+0000","last_clean":"2024-09-18T01:25:43.851686+0000","last_became_active":"2024-09-18T01:25:14.707409+0000","last_became_peered":"2024-09-18T01:25:14.707409+0000","last_unstale":"2024-09-18T01:25:43.851686+0000","last_undegraded":"2024-09-18T01:25:43.851686+0000","last_fullsized":"2024-09-18T01:25:43.851686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:44:50.425957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'6","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.246929+0000","last_change":"2024-09-18T01:25:16.711391+0000","last_active":"2024-09-18T01:27:16.246929+0000","last_peered":"2024-09-18T01:27:16.246929+0000","last_clean":"2024-09-18T01:27:16.246929+0000","last_became_active":"2024-09-18T01:25:16.711104+0000","last_became_peered":"2024-09-18T01:25:16.711104+0000","last_unstale":"2024-09-18T01:27:16.246929+0000","last_undegraded":"2024-09-18T01:27:16.246929+0000","last_fullsized":"2024-09-18T01:27:16.246929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:20.551132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.751886+0000","last_change":"2024-09-18T01:25:08.687474+0000","last_active":"2024-09-18T01:26:32.751886+0000","last_peered":"2024-09-18T01:26:32.751886+0000","last_clean":"2024-09-18T01:26:32.751886+0000","last_became_active":"2024-09-18T01:25:08.687139+0000","last_became_peered":"2024-09-18T01:25:08.687139+0000","last_unstale":"2024-09-18T01:26:32.751886+0000","last_undegraded":"2024-09-18T01:26:32.751886+0000","last_fullsized":"2024-09-18T01:26:32.751886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:17.472878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845078+0000","last_change":"2024-09-18T01:25:06.692246+0000","last_active":"2024-09-18T01:25:43.845078+0000","last_peered":"2024-09-18T01:25:43.845078+0000","last_clean":"2024-09-18T01:25:43.845078+0000","last_became_active":"2024-09-18T01:25:06.691871+0000","last_became_peered":"2024-09-18T01:25:06.691871+0000","last_unstale":"2024-09-18T01:25:43.845078+0000","last_undegraded":"2024-09-18T01:25:43.845078+0000","last_fullsized":"2024-09-18T01:25:43.845078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:18.475907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844899+0000","last_change":"2024-09-18T01:24:58.199959+0000","last_active":"2024-09-18T01:25:43.844899+0000","last_peered":"2024-09-18T01:25:43.844899+0000","last_clean":"2024-09-18T01:25:43.844899+0000","last_became_active":"2024-09-18T01:24:56.191033+0000","last_became_peered":"2024-09-18T01:24:56.191033+0000","last_unstale":"2024-09-18T01:25:43.844899+0000","last_undegraded":"2024-09-18T01:25:43.844899+0000","last_fullsized":"2024-09-18T01:25:43.844899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:45.677191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000547898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:17.796664+0000","last_change":"2024-09-18T01:25:10.676817+0000","last_active":"2024-09-18T01:27:17.796664+0000","last_peered":"2024-09-18T01:27:17.796664+0000","last_clean":"2024-09-18T01:27:17.796664+0000","last_became_active":"2024-09-18T01:25:10.676531+0000","last_became_peered":"2024-09-18T01:25:10.676531+0000","last_unstale":"2024-09-18T01:27:17.796664+0000","last_undegraded":"2024-09-18T01:27:17.796664+0000","last_fullsized":"2024-09-18T01:27:17.796664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:30:17.964806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'76","reported_seq":147,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.878002+0000","last_change":"2024-09-18T01:25:12.693490+0000","last_active":"2024-09-18T01:28:16.878002+0000","last_peered":"2024-09-18T01:28:16.878002+0000","last_clean":"2024-09-18T01:28:16.878002+0000","last_became_active":"2024-09-18T01:25:12.693127+0000","last_became_peered":"2024-09-18T01:25:12.693127+0000","last_unstale":"2024-09-18T01:28:16.878002+0000","last_undegraded":"2024-09-18T01:28:16.878002+0000","last_fullsized":"2024-09-18T01:28:16.878002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:53:39.113408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.842921+0000","last_change":"2024-09-18T01:25:14.704345+0000","last_active":"2024-09-18T01:25:43.842921+0000","last_peered":"2024-09-18T01:25:43.842921+0000","last_clean":"2024-09-18T01:25:43.842921+0000","last_became_active":"2024-09-18T01:25:14.703993+0000","last_became_peered":"2024-09-18T01:25:14.703993+0000","last_unstale":"2024-09-18T01:25:43.842921+0000","last_undegraded":"2024-09-18T01:25:43.842921+0000","last_fullsized":"2024-09-18T01:25:43.842921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:48.964473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.422802+0000","last_change":"2024-09-18T01:25:16.703557+0000","last_active":"2024-09-18T01:27:16.422802+0000","last_peered":"2024-09-18T01:27:16.422802+0000","last_clean":"2024-09-18T01:27:16.422802+0000","last_became_active":"2024-09-18T01:25:16.703278+0000","last_became_peered":"2024-09-18T01:25:16.703278+0000","last_unstale":"2024-09-18T01:27:16.422802+0000","last_undegraded":"2024-09-18T01:27:16.422802+0000","last_fullsized":"2024-09-18T01:27:16.422802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:50:43.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097370+0000","last_change":"2024-09-18T01:25:08.686341+0000","last_active":"2024-09-18T01:28:17.097370+0000","last_peered":"2024-09-18T01:28:17.097370+0000","last_clean":"2024-09-18T01:28:17.097370+0000","last_became_active":"2024-09-18T01:25:08.686087+0000","last_became_peered":"2024-09-18T01:25:08.686087+0000","last_unstale":"2024-09-18T01:28:17.097370+0000","last_undegraded":"2024-09-18T01:28:17.097370+0000","last_fullsized":"2024-09-18T01:28:17.097370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:58.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.796033+0000","last_change":"2024-09-18T01:25:06.681153+0000","last_active":"2024-09-18T01:27:12.796033+0000","last_peered":"2024-09-18T01:27:12.796033+0000","last_clean":"2024-09-18T01:27:12.796033+0000","last_became_active":"2024-09-18T01:25:06.680623+0000","last_became_peered":"2024-09-18T01:25:06.680623+0000","last_unstale":"2024-09-18T01:27:12.796033+0000","last_undegraded":"2024-09-18T01:27:12.796033+0000","last_fullsized":"2024-09-18T01:27:12.796033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:43.847905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851403+0000","last_change":"2024-09-18T01:24:58.198528+0000","last_active":"2024-09-18T01:25:43.851403+0000","last_peered":"2024-09-18T01:25:43.851403+0000","last_clean":"2024-09-18T01:25:43.851403+0000","last_became_active":"2024-09-18T01:24:56.191687+0000","last_became_peered":"2024-09-18T01:24:56.191687+0000","last_unstale":"2024-09-18T01:25:43.851403+0000","last_undegraded":"2024-09-18T01:25:43.851403+0000","last_fullsized":"2024-09-18T01:25:43.851403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:11:00.731633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012745390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848299+0000","last_change":"2024-09-18T01:25:10.681568+0000","last_active":"2024-09-18T01:25:43.848299+0000","last_peered":"2024-09-18T01:25:43.848299+0000","last_clean":"2024-09-18T01:25:43.848299+0000","last_became_active":"2024-09-18T01:25:10.681311+0000","last_became_peered":"2024-09-18T01:25:10.681311+0000","last_unstale":"2024-09-18T01:25:43.848299+0000","last_undegraded":"2024-09-18T01:25:43.848299+0000","last_fullsized":"2024-09-18T01:25:43.848299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:18:53.465821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'21","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797770+0000","last_change":"2024-09-18T01:25:12.692614+0000","last_active":"2024-09-18T01:27:19.797770+0000","last_peered":"2024-09-18T01:27:19.797770+0000","last_clean":"2024-09-18T01:27:19.797770+0000","last_became_active":"2024-09-18T01:25:12.692357+0000","last_became_peered":"2024-09-18T01:25:12.692357+0000","last_unstale":"2024-09-18T01:27:19.797770+0000","last_undegraded":"2024-09-18T01:27:19.797770+0000","last_fullsized":"2024-09-18T01:27:19.797770+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:53.053242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'282","reported_seq":386,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:15.763471+0000","last_change":"2024-09-18T01:25:14.706009+0000","last_active":"2024-09-18T01:28:15.763471+0000","last_peered":"2024-09-18T01:28:15.763471+0000","last_clean":"2024-09-18T01:28:15.763471+0000","last_became_active":"2024-09-18T01:25:14.705703+0000","last_became_peered":"2024-09-18T01:25:14.705703+0000","last_unstale":"2024-09-18T01:28:15.763471+0000","last_undegraded":"2024-09-18T01:28:15.763471+0000","last_fullsized":"2024-09-18T01:28:15.763471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:27.416743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850789+0000","last_change":"2024-09-18T01:25:16.711811+0000","last_active":"2024-09-18T01:25:43.850789+0000","last_peered":"2024-09-18T01:25:43.850789+0000","last_clean":"2024-09-18T01:25:43.850789+0000","last_became_active":"2024-09-18T01:25:16.711531+0000","last_became_peered":"2024-09-18T01:25:16.711531+0000","last_unstale":"2024-09-18T01:25:43.850789+0000","last_undegraded":"2024-09-18T01:25:43.850789+0000","last_fullsized":"2024-09-18T01:25:43.850789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:37:22.949714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'20","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.145097+0000","last_change":"2024-09-18T01:25:08.681868+0000","last_active":"2024-09-18T01:28:17.145097+0000","last_peered":"2024-09-18T01:28:17.145097+0000","last_clean":"2024-09-18T01:28:17.145097+0000","last_became_active":"2024-09-18T01:25:08.681285+0000","last_became_peered":"2024-09-18T01:25:08.681285+0000","last_unstale":"2024-09-18T01:28:17.145097+0000","last_undegraded":"2024-09-18T01:28:17.145097+0000","last_fullsized":"2024-09-18T01:28:17.145097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:17:00.419181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":56,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.852230+0000","last_change":"2024-09-18T01:25:06.684116+0000","last_active":"2024-09-18T01:25:43.852230+0000","last_peered":"2024-09-18T01:25:43.852230+0000","last_clean":"2024-09-18T01:25:43.852230+0000","last_became_active":"2024-09-18T01:25:06.683740+0000","last_became_peered":"2024-09-18T01:25:06.683740+0000","last_unstale":"2024-09-18T01:25:43.852230+0000","last_undegraded":"2024-09-18T01:25:43.852230+0000","last_fullsized":"2024-09-18T01:25:43.852230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:01.765123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846258+0000","last_change":"2024-09-18T01:24:58.199970+0000","last_active":"2024-09-18T01:25:43.846258+0000","last_peered":"2024-09-18T01:25:43.846258+0000","last_clean":"2024-09-18T01:25:43.846258+0000","last_became_active":"2024-09-18T01:24:56.192301+0000","last_became_peered":"2024-09-18T01:24:56.192301+0000","last_unstale":"2024-09-18T01:25:43.846258+0000","last_undegraded":"2024-09-18T01:25:43.846258+0000","last_fullsized":"2024-09-18T01:25:43.846258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:15.228308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056449699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848267+0000","last_change":"2024-09-18T01:25:10.682420+0000","last_active":"2024-09-18T01:25:43.848267+0000","last_peered":"2024-09-18T01:25:43.848267+0000","last_clean":"2024-09-18T01:25:43.848267+0000","last_became_active":"2024-09-18T01:25:10.682111+0000","last_became_peered":"2024-09-18T01:25:10.682111+0000","last_unstale":"2024-09-18T01:25:43.848267+0000","last_undegraded":"2024-09-18T01:25:43.848267+0000","last_fullsized":"2024-09-18T01:25:43.848267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:50.968119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'17","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797411+0000","last_change":"2024-09-18T01:25:12.692600+0000","last_active":"2024-09-18T01:27:19.797411+0000","last_peered":"2024-09-18T01:27:19.797411+0000","last_clean":"2024-09-18T01:27:19.797411+0000","last_became_active":"2024-09-18T01:25:12.692313+0000","last_became_peered":"2024-09-18T01:25:12.692313+0000","last_unstale":"2024-09-18T01:27:19.797411+0000","last_undegraded":"2024-09-18T01:27:19.797411+0000","last_fullsized":"2024-09-18T01:27:19.797411+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:07:06.091989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'282","reported_seq":398,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.272287+0000","last_change":"2024-09-18T01:25:14.699037+0000","last_active":"2024-09-18T01:28:17.272287+0000","last_peered":"2024-09-18T01:28:17.272287+0000","last_clean":"2024-09-18T01:28:17.272287+0000","last_became_active":"2024-09-18T01:25:14.698755+0000","last_became_peered":"2024-09-18T01:25:14.698755+0000","last_unstale":"2024-09-18T01:28:17.272287+0000","last_undegraded":"2024-09-18T01:28:17.272287+0000","last_fullsized":"2024-09-18T01:28:17.272287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:44.393089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.218389+0000","last_change":"2024-09-18T01:25:16.712818+0000","last_active":"2024-09-18T01:25:50.218389+0000","last_peered":"2024-09-18T01:25:50.218389+0000","last_clean":"2024-09-18T01:25:50.218389+0000","last_became_active":"2024-09-18T01:25:16.712556+0000","last_became_peered":"2024-09-18T01:25:16.712556+0000","last_unstale":"2024-09-18T01:25:50.218389+0000","last_undegraded":"2024-09-18T01:25:50.218389+0000","last_fullsized":"2024-09-18T01:25:50.218389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:33:55.839584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'13","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183683+0000","last_change":"2024-09-18T01:25:08.674848+0000","last_active":"2024-09-18T01:28:17.183683+0000","last_peered":"2024-09-18T01:28:17.183683+0000","last_clean":"2024-09-18T01:28:17.183683+0000","last_became_active":"2024-09-18T01:25:08.674560+0000","last_became_peered":"2024-09-18T01:25:08.674560+0000","last_unstale":"2024-09-18T01:28:17.183683+0000","last_undegraded":"2024-09-18T01:28:17.183683+0000","last_fullsized":"2024-09-18T01:28:17.183683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:10.873516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.389587+0000","last_change":"2024-09-18T01:25:06.693785+0000","last_active":"2024-09-18T01:27:16.389587+0000","last_peered":"2024-09-18T01:27:16.389587+0000","last_clean":"2024-09-18T01:27:16.389587+0000","last_became_active":"2024-09-18T01:25:06.686277+0000","last_became_peered":"2024-09-18T01:25:06.686277+0000","last_unstale":"2024-09-18T01:27:16.389587+0000","last_undegraded":"2024-09-18T01:27:16.389587+0000","last_fullsized":"2024-09-18T01:27:16.389587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:22.518297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851867+0000","last_change":"2024-09-18T01:24:58.198307+0000","last_active":"2024-09-18T01:25:43.851867+0000","last_peered":"2024-09-18T01:25:43.851867+0000","last_clean":"2024-09-18T01:25:43.851867+0000","last_became_active":"2024-09-18T01:24:56.602991+0000","last_became_peered":"2024-09-18T01:24:56.602991+0000","last_unstale":"2024-09-18T01:25:43.851867+0000","last_undegraded":"2024-09-18T01:25:43.851867+0000","last_fullsized":"2024-09-18T01:25:43.851867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:37:38.935073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077351,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847636+0000","last_change":"2024-09-18T01:25:10.683146+0000","last_active":"2024-09-18T01:25:43.847636+0000","last_peered":"2024-09-18T01:25:43.847636+0000","last_clean":"2024-09-18T01:25:43.847636+0000","last_became_active":"2024-09-18T01:25:10.682057+0000","last_became_peered":"2024-09-18T01:25:10.682057+0000","last_unstale":"2024-09-18T01:25:43.847636+0000","last_undegraded":"2024-09-18T01:25:43.847636+0000","last_fullsized":"2024-09-18T01:25:43.847636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:50:53.226062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'89","reported_seq":167,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.062380+0000","last_change":"2024-09-18T01:25:12.694747+0000","last_active":"2024-09-18T01:27:15.062380+0000","last_peered":"2024-09-18T01:27:15.062380+0000","last_clean":"2024-09-18T01:27:15.062380+0000","last_became_active":"2024-09-18T01:25:12.694361+0000","last_became_peered":"2024-09-18T01:25:12.694361+0000","last_unstale":"2024-09-18T01:27:15.062380+0000","last_undegraded":"2024-09-18T01:27:15.062380+0000","last_fullsized":"2024-09-18T01:27:15.062380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:01:02.423890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844037+0000","last_change":"2024-09-18T01:25:14.707331+0000","last_active":"2024-09-18T01:25:43.844037+0000","last_peered":"2024-09-18T01:25:43.844037+0000","last_clean":"2024-09-18T01:25:43.844037+0000","last_became_active":"2024-09-18T01:25:14.706960+0000","last_became_peered":"2024-09-18T01:25:14.706960+0000","last_unstale":"2024-09-18T01:25:43.844037+0000","last_undegraded":"2024-09-18T01:25:43.844037+0000","last_fullsized":"2024-09-18T01:25:43.844037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:23.103965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846489+0000","last_change":"2024-09-18T01:25:16.716922+0000","last_active":"2024-09-18T01:25:43.846489+0000","last_peered":"2024-09-18T01:25:43.846489+0000","last_clean":"2024-09-18T01:25:43.846489+0000","last_became_active":"2024-09-18T01:25:16.716607+0000","last_became_peered":"2024-09-18T01:25:16.716607+0000","last_unstale":"2024-09-18T01:25:43.846489+0000","last_undegraded":"2024-09-18T01:25:43.846489+0000","last_fullsized":"2024-09-18T01:25:43.846489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:31:19.177080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845585+0000","last_change":"2024-09-18T01:25:16.717173+0000","last_active":"2024-09-18T01:25:43.845585+0000","last_peered":"2024-09-18T01:25:43.845585+0000","last_clean":"2024-09-18T01:25:43.845585+0000","last_became_active":"2024-09-18T01:25:16.716867+0000","last_became_peered":"2024-09-18T01:25:16.716867+0000","last_unstale":"2024-09-18T01:25:43.845585+0000","last_undegraded":"2024-09-18T01:25:43.845585+0000","last_fullsized":"2024-09-18T01:25:43.845585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:29.431226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941573+0000","last_change":"2024-09-18T01:25:08.676006+0000","last_active":"2024-09-18T01:26:32.941573+0000","last_peered":"2024-09-18T01:26:32.941573+0000","last_clean":"2024-09-18T01:26:32.941573+0000","last_became_active":"2024-09-18T01:25:08.675590+0000","last_became_peered":"2024-09-18T01:25:08.675590+0000","last_unstale":"2024-09-18T01:26:32.941573+0000","last_undegraded":"2024-09-18T01:26:32.941573+0000","last_fullsized":"2024-09-18T01:26:32.941573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:41.267347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850033+0000","last_change":"2024-09-18T01:25:06.693775+0000","last_active":"2024-09-18T01:25:43.850033+0000","last_peered":"2024-09-18T01:25:43.850033+0000","last_clean":"2024-09-18T01:25:43.850033+0000","last_became_active":"2024-09-18T01:25:06.689996+0000","last_became_peered":"2024-09-18T01:25:06.689996+0000","last_unstale":"2024-09-18T01:25:43.850033+0000","last_undegraded":"2024-09-18T01:25:43.850033+0000","last_fullsized":"2024-09-18T01:25:43.850033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:08:19.802935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904820+0000","last_change":"2024-09-18T01:25:10.680563+0000","last_active":"2024-09-18T01:25:43.904820+0000","last_peered":"2024-09-18T01:25:43.904820+0000","last_clean":"2024-09-18T01:25:43.904820+0000","last_became_active":"2024-09-18T01:25:10.679704+0000","last_became_peered":"2024-09-18T01:25:10.679704+0000","last_unstale":"2024-09-18T01:25:43.904820+0000","last_undegraded":"2024-09-18T01:25:43.904820+0000","last_fullsized":"2024-09-18T01:25:43.904820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:43:35.529795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'38","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.068437+0000","last_change":"2024-09-18T01:25:12.693302+0000","last_active":"2024-09-18T01:27:15.068437+0000","last_peered":"2024-09-18T01:27:15.068437+0000","last_clean":"2024-09-18T01:27:15.068437+0000","last_became_active":"2024-09-18T01:25:12.692870+0000","last_became_peered":"2024-09-18T01:25:12.692870+0000","last_unstale":"2024-09-18T01:27:15.068437+0000","last_undegraded":"2024-09-18T01:27:15.068437+0000","last_fullsized":"2024-09-18T01:27:15.068437+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:53:57.208130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848675+0000","last_change":"2024-09-18T01:25:14.707283+0000","last_active":"2024-09-18T01:25:43.848675+0000","last_peered":"2024-09-18T01:25:43.848675+0000","last_clean":"2024-09-18T01:25:43.848675+0000","last_became_active":"2024-09-18T01:25:14.706381+0000","last_became_peered":"2024-09-18T01:25:14.706381+0000","last_unstale":"2024-09-18T01:25:43.848675+0000","last_undegraded":"2024-09-18T01:25:43.848675+0000","last_fullsized":"2024-09-18T01:25:43.848675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:43:26.455220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'17","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.580259+0000","last_change":"2024-09-18T01:25:16.703483+0000","last_active":"2024-09-18T01:28:16.580259+0000","last_peered":"2024-09-18T01:28:16.580259+0000","last_clean":"2024-09-18T01:28:16.580259+0000","last_became_active":"2024-09-18T01:25:16.703227+0000","last_became_peered":"2024-09-18T01:25:16.703227+0000","last_unstale":"2024-09-18T01:28:16.580259+0000","last_undegraded":"2024-09-18T01:28:16.580259+0000","last_fullsized":"2024-09-18T01:28:16.580259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:31.864546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904703+0000","last_change":"2024-09-18T01:25:08.687780+0000","last_active":"2024-09-18T01:25:43.904703+0000","last_peered":"2024-09-18T01:25:43.904703+0000","last_clean":"2024-09-18T01:25:43.904703+0000","last_became_active":"2024-09-18T01:25:08.687482+0000","last_became_peered":"2024-09-18T01:25:08.687482+0000","last_unstale":"2024-09-18T01:25:43.904703+0000","last_undegraded":"2024-09-18T01:25:43.904703+0000","last_fullsized":"2024-09-18T01:25:43.904703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:19.129968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845694+0000","last_change":"2024-09-18T01:25:06.705764+0000","last_active":"2024-09-18T01:25:43.845694+0000","last_peered":"2024-09-18T01:25:43.845694+0000","last_clean":"2024-09-18T01:25:43.845694+0000","last_became_active":"2024-09-18T01:25:06.705406+0000","last_became_peered":"2024-09-18T01:25:06.705406+0000","last_unstale":"2024-09-18T01:25:43.845694+0000","last_undegraded":"2024-09-18T01:25:43.845694+0000","last_fullsized":"2024-09-18T01:25:43.845694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:16.022647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849629+0000","last_change":"2024-09-18T01:25:10.682648+0000","last_active":"2024-09-18T01:25:43.849629+0000","last_peered":"2024-09-18T01:25:43.849629+0000","last_clean":"2024-09-18T01:25:43.849629+0000","last_became_active":"2024-09-18T01:25:10.682230+0000","last_became_peered":"2024-09-18T01:25:10.682230+0000","last_unstale":"2024-09-18T01:25:43.849629+0000","last_undegraded":"2024-09-18T01:25:43.849629+0000","last_fullsized":"2024-09-18T01:25:43.849629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:46:29.499833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'5","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.503052+0000","last_change":"2024-09-18T01:25:12.687325+0000","last_active":"2024-09-18T01:28:16.503052+0000","last_peered":"2024-09-18T01:28:16.503052+0000","last_clean":"2024-09-18T01:28:16.503052+0000","last_became_active":"2024-09-18T01:25:12.687018+0000","last_became_peered":"2024-09-18T01:25:12.687018+0000","last_unstale":"2024-09-18T01:28:16.503052+0000","last_undegraded":"2024-09-18T01:28:16.503052+0000","last_fullsized":"2024-09-18T01:28:16.503052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:38.338819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843144+0000","last_change":"2024-09-18T01:25:14.707285+0000","last_active":"2024-09-18T01:25:43.843144+0000","last_peered":"2024-09-18T01:25:43.843144+0000","last_clean":"2024-09-18T01:25:43.843144+0000","last_became_active":"2024-09-18T01:25:14.707008+0000","last_became_peered":"2024-09-18T01:25:14.707008+0000","last_unstale":"2024-09-18T01:25:43.843144+0000","last_undegraded":"2024-09-18T01:25:43.843144+0000","last_fullsized":"2024-09-18T01:25:43.843144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:37.834091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.131556+0000","last_change":"2024-09-18T01:25:16.714484+0000","last_active":"2024-09-18T01:28:17.131556+0000","last_peered":"2024-09-18T01:28:17.131556+0000","last_clean":"2024-09-18T01:28:17.131556+0000","last_became_active":"2024-09-18T01:25:16.714160+0000","last_became_peered":"2024-09-18T01:25:16.714160+0000","last_unstale":"2024-09-18T01:28:17.131556+0000","last_undegraded":"2024-09-18T01:28:17.131556+0000","last_fullsized":"2024-09-18T01:28:17.131556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:00:21.563802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844674+0000","last_change":"2024-09-18T01:25:08.671711+0000","last_active":"2024-09-18T01:25:43.844674+0000","last_peered":"2024-09-18T01:25:43.844674+0000","last_clean":"2024-09-18T01:25:43.844674+0000","last_became_active":"2024-09-18T01:25:08.671365+0000","last_became_peered":"2024-09-18T01:25:08.671365+0000","last_unstale":"2024-09-18T01:25:43.844674+0000","last_undegraded":"2024-09-18T01:25:43.844674+0000","last_fullsized":"2024-09-18T01:25:43.844674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:42:49.663850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799230+0000","last_change":"2024-09-18T01:25:06.703718+0000","last_active":"2024-09-18T01:27:34.799230+0000","last_peered":"2024-09-18T01:27:34.799230+0000","last_clean":"2024-09-18T01:27:34.799230+0000","last_became_active":"2024-09-18T01:25:06.703081+0000","last_became_peered":"2024-09-18T01:25:06.703081+0000","last_unstale":"2024-09-18T01:27:34.799230+0000","last_undegraded":"2024-09-18T01:27:34.799230+0000","last_fullsized":"2024-09-18T01:27:34.799230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:43.847905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843418+0000","last_change":"2024-09-18T01:25:10.680659+0000","last_active":"2024-09-18T01:25:43.843418+0000","last_peered":"2024-09-18T01:25:43.843418+0000","last_clean":"2024-09-18T01:25:43.843418+0000","last_became_active":"2024-09-18T01:25:10.680316+0000","last_became_peered":"2024-09-18T01:25:10.680316+0000","last_unstale":"2024-09-18T01:25:43.843418+0000","last_undegraded":"2024-09-18T01:25:43.843418+0000","last_fullsized":"2024-09-18T01:25:43.843418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:15.756375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'40","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.560764+0000","last_change":"2024-09-18T01:25:12.682598+0000","last_active":"2024-09-18T01:28:16.560764+0000","last_peered":"2024-09-18T01:28:16.560764+0000","last_clean":"2024-09-18T01:28:16.560764+0000","last_became_active":"2024-09-18T01:25:12.682270+0000","last_became_peered":"2024-09-18T01:25:12.682270+0000","last_unstale":"2024-09-18T01:28:16.560764+0000","last_undegraded":"2024-09-18T01:28:16.560764+0000","last_fullsized":"2024-09-18T01:28:16.560764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:44.205915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903990+0000","last_change":"2024-09-18T01:25:14.705277+0000","last_active":"2024-09-18T01:25:43.903990+0000","last_peered":"2024-09-18T01:25:43.903990+0000","last_clean":"2024-09-18T01:25:43.903990+0000","last_became_active":"2024-09-18T01:25:14.703583+0000","last_became_peered":"2024-09-18T01:25:14.703583+0000","last_unstale":"2024-09-18T01:25:43.903990+0000","last_undegraded":"2024-09-18T01:25:43.903990+0000","last_fullsized":"2024-09-18T01:25:43.903990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:01:53.638099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849566+0000","last_change":"2024-09-18T01:25:16.714459+0000","last_active":"2024-09-18T01:25:43.849566+0000","last_peered":"2024-09-18T01:25:43.849566+0000","last_clean":"2024-09-18T01:25:43.849566+0000","last_became_active":"2024-09-18T01:25:16.714061+0000","last_became_peered":"2024-09-18T01:25:16.714061+0000","last_unstale":"2024-09-18T01:25:43.849566+0000","last_undegraded":"2024-09-18T01:25:43.849566+0000","last_fullsized":"2024-09-18T01:25:43.849566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:00:46.823041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'4","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941172+0000","last_change":"2024-09-18T01:25:08.688282+0000","last_active":"2024-09-18T01:26:32.941172+0000","last_peered":"2024-09-18T01:26:32.941172+0000","last_clean":"2024-09-18T01:26:32.941172+0000","last_became_active":"2024-09-18T01:25:08.688016+0000","last_became_peered":"2024-09-18T01:25:08.688016+0000","last_unstale":"2024-09-18T01:26:32.941172+0000","last_undegraded":"2024-09-18T01:26:32.941172+0000","last_fullsized":"2024-09-18T01:26:32.941172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:37:29.581979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906628+0000","last_change":"2024-09-18T01:25:06.691298+0000","last_active":"2024-09-18T01:25:43.906628+0000","last_peered":"2024-09-18T01:25:43.906628+0000","last_clean":"2024-09-18T01:25:43.906628+0000","last_became_active":"2024-09-18T01:25:06.688747+0000","last_became_peered":"2024-09-18T01:25:06.688747+0000","last_unstale":"2024-09-18T01:25:43.906628+0000","last_undegraded":"2024-09-18T01:25:43.906628+0000","last_fullsized":"2024-09-18T01:25:43.906628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:03.343944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848182+0000","last_change":"2024-09-18T01:25:10.681110+0000","last_active":"2024-09-18T01:25:43.848182+0000","last_peered":"2024-09-18T01:25:43.848182+0000","last_clean":"2024-09-18T01:25:43.848182+0000","last_became_active":"2024-09-18T01:25:10.680831+0000","last_became_peered":"2024-09-18T01:25:10.680831+0000","last_unstale":"2024-09-18T01:25:43.848182+0000","last_undegraded":"2024-09-18T01:25:43.848182+0000","last_fullsized":"2024-09-18T01:25:43.848182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:27.094941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.053701+0000","last_change":"2024-09-18T01:25:12.687200+0000","last_active":"2024-09-18T01:27:15.053701+0000","last_peered":"2024-09-18T01:27:15.053701+0000","last_clean":"2024-09-18T01:27:15.053701+0000","last_became_active":"2024-09-18T01:25:12.686918+0000","last_became_peered":"2024-09-18T01:25:12.686918+0000","last_unstale":"2024-09-18T01:27:15.053701+0000","last_undegraded":"2024-09-18T01:27:15.053701+0000","last_fullsized":"2024-09-18T01:27:15.053701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:15.981679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843880+0000","last_change":"2024-09-18T01:25:14.695864+0000","last_active":"2024-09-18T01:25:43.843880+0000","last_peered":"2024-09-18T01:25:43.843880+0000","last_clean":"2024-09-18T01:25:43.843880+0000","last_became_active":"2024-09-18T01:25:14.695120+0000","last_became_peered":"2024-09-18T01:25:14.695120+0000","last_unstale":"2024-09-18T01:25:43.843880+0000","last_undegraded":"2024-09-18T01:25:43.843880+0000","last_fullsized":"2024-09-18T01:25:43.843880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:18.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'5","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153256+0000","last_change":"2024-09-18T01:25:08.678193+0000","last_active":"2024-09-18T01:28:17.153256+0000","last_peered":"2024-09-18T01:28:17.153256+0000","last_clean":"2024-09-18T01:28:17.153256+0000","last_became_active":"2024-09-18T01:25:08.677941+0000","last_became_peered":"2024-09-18T01:25:08.677941+0000","last_unstale":"2024-09-18T01:28:17.153256+0000","last_undegraded":"2024-09-18T01:28:17.153256+0000","last_fullsized":"2024-09-18T01:28:17.153256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:50:00.350138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.086109+0000","last_change":"2024-09-18T01:25:06.695779+0000","last_active":"2024-09-18T01:28:17.086109+0000","last_peered":"2024-09-18T01:28:17.086109+0000","last_clean":"2024-09-18T01:28:17.086109+0000","last_became_active":"2024-09-18T01:25:06.692823+0000","last_became_peered":"2024-09-18T01:25:06.692823+0000","last_unstale":"2024-09-18T01:28:17.086109+0000","last_undegraded":"2024-09-18T01:28:17.086109+0000","last_fullsized":"2024-09-18T01:28:17.086109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:25:48.076699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845675+0000","last_change":"2024-09-18T01:25:10.677782+0000","last_active":"2024-09-18T01:25:43.845675+0000","last_peered":"2024-09-18T01:25:43.845675+0000","last_clean":"2024-09-18T01:25:43.845675+0000","last_became_active":"2024-09-18T01:25:10.677481+0000","last_became_peered":"2024-09-18T01:25:10.677481+0000","last_unstale":"2024-09-18T01:25:43.845675+0000","last_undegraded":"2024-09-18T01:25:43.845675+0000","last_fullsized":"2024-09-18T01:25:43.845675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:01.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'61","reported_seq":123,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.074592+0000","last_change":"2024-09-18T01:25:12.687399+0000","last_active":"2024-09-18T01:27:15.074592+0000","last_peered":"2024-09-18T01:27:15.074592+0000","last_clean":"2024-09-18T01:27:15.074592+0000","last_became_active":"2024-09-18T01:25:12.687014+0000","last_became_peered":"2024-09-18T01:25:12.687014+0000","last_unstale":"2024-09-18T01:27:15.074592+0000","last_undegraded":"2024-09-18T01:27:15.074592+0000","last_fullsized":"2024-09-18T01:27:15.074592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:35.687671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843869+0000","last_change":"2024-09-18T01:25:14.699051+0000","last_active":"2024-09-18T01:25:43.843869+0000","last_peered":"2024-09-18T01:25:43.843869+0000","last_clean":"2024-09-18T01:25:43.843869+0000","last_became_active":"2024-09-18T01:25:14.698753+0000","last_became_peered":"2024-09-18T01:25:14.698753+0000","last_unstale":"2024-09-18T01:25:43.843869+0000","last_undegraded":"2024-09-18T01:25:43.843869+0000","last_fullsized":"2024-09-18T01:25:43.843869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:55.060343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'20","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.149094+0000","last_change":"2024-09-18T01:25:16.714340+0000","last_active":"2024-09-18T01:28:17.149094+0000","last_peered":"2024-09-18T01:28:17.149094+0000","last_clean":"2024-09-18T01:28:17.149094+0000","last_became_active":"2024-09-18T01:25:16.713750+0000","last_became_peered":"2024-09-18T01:25:16.713750+0000","last_unstale":"2024-09-18T01:28:17.149094+0000","last_undegraded":"2024-09-18T01:28:17.149094+0000","last_fullsized":"2024-09-18T01:28:17.149094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:00:32.755321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097065+0000","last_change":"2024-09-18T01:25:08.681356+0000","last_active":"2024-09-18T01:28:17.097065+0000","last_peered":"2024-09-18T01:28:17.097065+0000","last_clean":"2024-09-18T01:28:17.097065+0000","last_became_active":"2024-09-18T01:25:08.680604+0000","last_became_peered":"2024-09-18T01:25:08.680604+0000","last_unstale":"2024-09-18T01:28:17.097065+0000","last_undegraded":"2024-09-18T01:28:17.097065+0000","last_fullsized":"2024-09-18T01:28:17.097065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:58.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903568+0000","last_change":"2024-09-18T01:25:06.688269+0000","last_active":"2024-09-18T01:25:43.903568+0000","last_peered":"2024-09-18T01:25:43.903568+0000","last_clean":"2024-09-18T01:25:43.903568+0000","last_became_active":"2024-09-18T01:25:06.686125+0000","last_became_peered":"2024-09-18T01:25:06.686125+0000","last_unstale":"2024-09-18T01:25:43.903568+0000","last_undegraded":"2024-09-18T01:25:43.903568+0000","last_fullsized":"2024-09-18T01:25:43.903568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:36.036192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":235,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.114042+0000","last_change":"2024-09-18T01:25:43.912490+0000","last_active":"2024-09-18T01:27:16.114042+0000","last_peered":"2024-09-18T01:27:16.114042+0000","last_clean":"2024-09-18T01:27:16.114042+0000","last_became_active":"2024-09-18T01:25:43.908273+0000","last_became_peered":"2024-09-18T01:25:43.908273+0000","last_unstale":"2024-09-18T01:27:16.114042+0000","last_undegraded":"2024-09-18T01:27:16.114042+0000","last_fullsized":"2024-09-18T01:27:16.114042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:43.161322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'36","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.054864+0000","last_change":"2024-09-18T01:25:12.693001+0000","last_active":"2024-09-18T01:27:15.054864+0000","last_peered":"2024-09-18T01:27:15.054864+0000","last_clean":"2024-09-18T01:27:15.054864+0000","last_became_active":"2024-09-18T01:25:12.692486+0000","last_became_peered":"2024-09-18T01:25:12.692486+0000","last_unstale":"2024-09-18T01:27:15.054864+0000","last_undegraded":"2024-09-18T01:27:15.054864+0000","last_fullsized":"2024-09-18T01:27:15.054864+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:55:54.041872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904750+0000","last_change":"2024-09-18T01:25:14.710345+0000","last_active":"2024-09-18T01:25:43.904750+0000","last_peered":"2024-09-18T01:25:43.904750+0000","last_clean":"2024-09-18T01:25:43.904750+0000","last_became_active":"2024-09-18T01:25:14.709980+0000","last_became_peered":"2024-09-18T01:25:14.709980+0000","last_unstale":"2024-09-18T01:25:43.904750+0000","last_undegraded":"2024-09-18T01:25:43.904750+0000","last_fullsized":"2024-09-18T01:25:43.904750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:57.575198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848068+0000","last_change":"2024-09-18T01:25:16.709176+0000","last_active":"2024-09-18T01:25:43.848068+0000","last_peered":"2024-09-18T01:25:43.848068+0000","last_clean":"2024-09-18T01:25:43.848068+0000","last_became_active":"2024-09-18T01:25:16.708905+0000","last_became_peered":"2024-09-18T01:25:16.708905+0000","last_unstale":"2024-09-18T01:25:43.848068+0000","last_undegraded":"2024-09-18T01:25:43.848068+0000","last_fullsized":"2024-09-18T01:25:43.848068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:47:16.419410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.484946+0000","last_change":"2024-09-18T01:25:08.688875+0000","last_active":"2024-09-18T01:27:16.484946+0000","last_peered":"2024-09-18T01:27:16.484946+0000","last_clean":"2024-09-18T01:27:16.484946+0000","last_became_active":"2024-09-18T01:25:08.688610+0000","last_became_peered":"2024-09-18T01:25:08.688610+0000","last_unstale":"2024-09-18T01:27:16.484946+0000","last_undegraded":"2024-09-18T01:27:16.484946+0000","last_fullsized":"2024-09-18T01:27:16.484946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:31:14.516270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904539+0000","last_change":"2024-09-18T01:25:06.685750+0000","last_active":"2024-09-18T01:25:43.904539+0000","last_peered":"2024-09-18T01:25:43.904539+0000","last_clean":"2024-09-18T01:25:43.904539+0000","last_became_active":"2024-09-18T01:25:06.685167+0000","last_became_peered":"2024-09-18T01:25:06.685167+0000","last_unstale":"2024-09-18T01:25:43.904539+0000","last_undegraded":"2024-09-18T01:25:43.904539+0000","last_fullsized":"2024-09-18T01:25:43.904539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:39:53.953032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845066+0000","last_change":"2024-09-18T01:25:10.678850+0000","last_active":"2024-09-18T01:25:43.845066+0000","last_peered":"2024-09-18T01:25:43.845066+0000","last_clean":"2024-09-18T01:25:43.845066+0000","last_became_active":"2024-09-18T01:25:10.678586+0000","last_became_peered":"2024-09-18T01:25:10.678586+0000","last_unstale":"2024-09-18T01:25:43.845066+0000","last_undegraded":"2024-09-18T01:25:43.845066+0000","last_fullsized":"2024-09-18T01:25:43.845066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:12.616019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'38","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.072271+0000","last_change":"2024-09-18T01:25:12.688276+0000","last_active":"2024-09-18T01:27:15.072271+0000","last_peered":"2024-09-18T01:27:15.072271+0000","last_clean":"2024-09-18T01:27:15.072271+0000","last_became_active":"2024-09-18T01:25:12.687935+0000","last_became_peered":"2024-09-18T01:25:12.687935+0000","last_unstale":"2024-09-18T01:27:15.072271+0000","last_undegraded":"2024-09-18T01:27:15.072271+0000","last_fullsized":"2024-09-18T01:27:15.072271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:46.957372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845272+0000","last_change":"2024-09-18T01:25:14.701993+0000","last_active":"2024-09-18T01:25:43.845272+0000","last_peered":"2024-09-18T01:25:43.845272+0000","last_clean":"2024-09-18T01:25:43.845272+0000","last_became_active":"2024-09-18T01:25:14.701702+0000","last_became_peered":"2024-09-18T01:25:14.701702+0000","last_unstale":"2024-09-18T01:25:43.845272+0000","last_undegraded":"2024-09-18T01:25:43.845272+0000","last_fullsized":"2024-09-18T01:25:43.845272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:44:32.330079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.480417+0000","last_change":"2024-09-18T01:25:16.716015+0000","last_active":"2024-09-18T01:27:16.480417+0000","last_peered":"2024-09-18T01:27:16.480417+0000","last_clean":"2024-09-18T01:27:16.480417+0000","last_became_active":"2024-09-18T01:25:16.715669+0000","last_became_peered":"2024-09-18T01:25:16.715669+0000","last_unstale":"2024-09-18T01:27:16.480417+0000","last_undegraded":"2024-09-18T01:27:16.480417+0000","last_fullsized":"2024-09-18T01:27:16.480417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:36.833223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"35'15","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153107+0000","last_change":"2024-09-18T01:25:08.672922+0000","last_active":"2024-09-18T01:28:17.153107+0000","last_peered":"2024-09-18T01:28:17.153107+0000","last_clean":"2024-09-18T01:28:17.153107+0000","last_became_active":"2024-09-18T01:25:08.672541+0000","last_became_peered":"2024-09-18T01:25:08.672541+0000","last_unstale":"2024-09-18T01:28:17.153107+0000","last_undegraded":"2024-09-18T01:28:17.153107+0000","last_fullsized":"2024-09-18T01:28:17.153107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:39.586169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850020+0000","last_change":"2024-09-18T01:25:06.687447+0000","last_active":"2024-09-18T01:25:43.850020+0000","last_peered":"2024-09-18T01:25:43.850020+0000","last_clean":"2024-09-18T01:25:43.850020+0000","last_became_active":"2024-09-18T01:25:06.684658+0000","last_became_peered":"2024-09-18T01:25:06.684658+0000","last_unstale":"2024-09-18T01:25:43.850020+0000","last_undegraded":"2024-09-18T01:25:43.850020+0000","last_fullsized":"2024-09-18T01:25:43.850020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:33:25.718581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905255+0000","last_change":"2024-09-18T01:25:10.679752+0000","last_active":"2024-09-18T01:25:43.905255+0000","last_peered":"2024-09-18T01:25:43.905255+0000","last_clean":"2024-09-18T01:25:43.905255+0000","last_became_active":"2024-09-18T01:25:10.679369+0000","last_became_peered":"2024-09-18T01:25:10.679369+0000","last_unstale":"2024-09-18T01:25:43.905255+0000","last_undegraded":"2024-09-18T01:25:43.905255+0000","last_fullsized":"2024-09-18T01:25:43.905255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:03:35.620140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'16","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851610+0000","last_change":"2024-09-18T01:25:12.697092+0000","last_active":"2024-09-18T01:25:43.851610+0000","last_peered":"2024-09-18T01:25:43.851610+0000","last_clean":"2024-09-18T01:25:43.851610+0000","last_became_active":"2024-09-18T01:25:12.696757+0000","last_became_peered":"2024-09-18T01:25:12.696757+0000","last_unstale":"2024-09-18T01:25:43.851610+0000","last_undegraded":"2024-09-18T01:25:43.851610+0000","last_fullsized":"2024-09-18T01:25:43.851610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:43:07.633393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'282","reported_seq":372,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:15.763467+0000","last_change":"2024-09-18T01:25:14.709994+0000","last_active":"2024-09-18T01:28:15.763467+0000","last_peered":"2024-09-18T01:28:15.763467+0000","last_clean":"2024-09-18T01:28:15.763467+0000","last_became_active":"2024-09-18T01:25:14.708840+0000","last_became_peered":"2024-09-18T01:25:14.708840+0000","last_unstale":"2024-09-18T01:28:15.763467+0000","last_undegraded":"2024-09-18T01:28:15.763467+0000","last_fullsized":"2024-09-18T01:28:15.763467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:58.015878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847427+0000","last_change":"2024-09-18T01:25:16.707474+0000","last_active":"2024-09-18T01:25:43.847427+0000","last_peered":"2024-09-18T01:25:43.847427+0000","last_clean":"2024-09-18T01:25:43.847427+0000","last_became_active":"2024-09-18T01:25:16.706764+0000","last_became_peered":"2024-09-18T01:25:16.706764+0000","last_unstale":"2024-09-18T01:25:43.847427+0000","last_undegraded":"2024-09-18T01:25:43.847427+0000","last_fullsized":"2024-09-18T01:25:43.847427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:36.072052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.486245+0000","last_change":"2024-09-18T01:25:08.670258+0000","last_active":"2024-09-18T01:27:16.486245+0000","last_peered":"2024-09-18T01:27:16.486245+0000","last_clean":"2024-09-18T01:27:16.486245+0000","last_became_active":"2024-09-18T01:25:08.669920+0000","last_became_peered":"2024-09-18T01:25:08.669920+0000","last_unstale":"2024-09-18T01:27:16.486245+0000","last_undegraded":"2024-09-18T01:27:16.486245+0000","last_fullsized":"2024-09-18T01:27:16.486245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:54:53.349504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905430+0000","last_change":"2024-09-18T01:25:06.685435+0000","last_active":"2024-09-18T01:25:43.905430+0000","last_peered":"2024-09-18T01:25:43.905430+0000","last_clean":"2024-09-18T01:25:43.905430+0000","last_became_active":"2024-09-18T01:25:06.684984+0000","last_became_peered":"2024-09-18T01:25:06.684984+0000","last_unstale":"2024-09-18T01:25:43.905430+0000","last_undegraded":"2024-09-18T01:25:43.905430+0000","last_fullsized":"2024-09-18T01:25:43.905430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:18.475907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904219+0000","last_change":"2024-09-18T01:25:10.679758+0000","last_active":"2024-09-18T01:25:43.904219+0000","last_peered":"2024-09-18T01:25:43.904219+0000","last_clean":"2024-09-18T01:25:43.904219+0000","last_became_active":"2024-09-18T01:25:10.679468+0000","last_became_peered":"2024-09-18T01:25:10.679468+0000","last_unstale":"2024-09-18T01:25:43.904219+0000","last_undegraded":"2024-09-18T01:25:43.904219+0000","last_fullsized":"2024-09-18T01:25:43.904219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:13:07.466593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'60","reported_seq":129,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.045605+0000","last_change":"2024-09-18T01:25:12.689122+0000","last_active":"2024-09-18T01:27:15.045605+0000","last_peered":"2024-09-18T01:27:15.045605+0000","last_clean":"2024-09-18T01:27:15.045605+0000","last_became_active":"2024-09-18T01:25:12.688618+0000","last_became_peered":"2024-09-18T01:25:12.688618+0000","last_unstale":"2024-09-18T01:27:15.045605+0000","last_undegraded":"2024-09-18T01:27:15.045605+0000","last_fullsized":"2024-09-18T01:27:15.045605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:35.826990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843695+0000","last_change":"2024-09-18T01:25:14.707373+0000","last_active":"2024-09-18T01:25:43.843695+0000","last_peered":"2024-09-18T01:25:43.843695+0000","last_clean":"2024-09-18T01:25:43.843695+0000","last_became_active":"2024-09-18T01:25:14.706586+0000","last_became_peered":"2024-09-18T01:25:14.706586+0000","last_unstale":"2024-09-18T01:25:43.843695+0000","last_undegraded":"2024-09-18T01:25:43.843695+0000","last_fullsized":"2024-09-18T01:25:43.843695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:04:52.409201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.907198+0000","last_change":"2024-09-18T01:25:16.714536+0000","last_active":"2024-09-18T01:25:43.907198+0000","last_peered":"2024-09-18T01:25:43.907198+0000","last_clean":"2024-09-18T01:25:43.907198+0000","last_became_active":"2024-09-18T01:25:16.713789+0000","last_became_peered":"2024-09-18T01:25:16.713789+0000","last_unstale":"2024-09-18T01:25:43.907198+0000","last_undegraded":"2024-09-18T01:25:43.907198+0000","last_fullsized":"2024-09-18T01:25:43.907198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:32:22.558708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176266+0000","last_change":"2024-09-18T01:25:08.670550+0000","last_active":"2024-09-18T01:28:17.176266+0000","last_peered":"2024-09-18T01:28:17.176266+0000","last_clean":"2024-09-18T01:28:17.176266+0000","last_became_active":"2024-09-18T01:25:08.670268+0000","last_became_peered":"2024-09-18T01:25:08.670268+0000","last_unstale":"2024-09-18T01:28:17.176266+0000","last_undegraded":"2024-09-18T01:28:17.176266+0000","last_fullsized":"2024-09-18T01:28:17.176266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:41.660195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800885+0000","last_change":"2024-09-18T01:25:06.689500+0000","last_active":"2024-09-18T01:27:39.800885+0000","last_peered":"2024-09-18T01:27:39.800885+0000","last_clean":"2024-09-18T01:27:39.800885+0000","last_became_active":"2024-09-18T01:25:06.687382+0000","last_became_peered":"2024-09-18T01:25:06.687382+0000","last_unstale":"2024-09-18T01:27:39.800885+0000","last_undegraded":"2024-09-18T01:27:39.800885+0000","last_fullsized":"2024-09-18T01:27:39.800885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:30:33.161052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845025+0000","last_change":"2024-09-18T01:25:10.682652+0000","last_active":"2024-09-18T01:25:43.845025+0000","last_peered":"2024-09-18T01:25:43.845025+0000","last_clean":"2024-09-18T01:25:43.845025+0000","last_became_active":"2024-09-18T01:25:10.682337+0000","last_became_peered":"2024-09-18T01:25:10.682337+0000","last_unstale":"2024-09-18T01:25:43.845025+0000","last_undegraded":"2024-09-18T01:25:43.845025+0000","last_fullsized":"2024-09-18T01:25:43.845025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:07.622864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'36","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.046668+0000","last_change":"2024-09-18T01:25:12.693400+0000","last_active":"2024-09-18T01:27:15.046668+0000","last_peered":"2024-09-18T01:27:15.046668+0000","last_clean":"2024-09-18T01:27:15.046668+0000","last_became_active":"2024-09-18T01:25:12.693129+0000","last_became_peered":"2024-09-18T01:25:12.693129+0000","last_unstale":"2024-09-18T01:27:15.046668+0000","last_undegraded":"2024-09-18T01:27:15.046668+0000","last_fullsized":"2024-09-18T01:27:15.046668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:02:54.566116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847932+0000","last_change":"2024-09-18T01:25:14.707262+0000","last_active":"2024-09-18T01:25:43.847932+0000","last_peered":"2024-09-18T01:25:43.847932+0000","last_clean":"2024-09-18T01:25:43.847932+0000","last_became_active":"2024-09-18T01:25:14.706325+0000","last_became_peered":"2024-09-18T01:25:14.706325+0000","last_unstale":"2024-09-18T01:25:43.847932+0000","last_undegraded":"2024-09-18T01:25:43.847932+0000","last_fullsized":"2024-09-18T01:25:43.847932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:31.363572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851735+0000","last_change":"2024-09-18T01:25:16.716357+0000","last_active":"2024-09-18T01:25:43.851735+0000","last_peered":"2024-09-18T01:25:43.851735+0000","last_clean":"2024-09-18T01:25:43.851735+0000","last_became_active":"2024-09-18T01:25:16.716084+0000","last_became_peered":"2024-09-18T01:25:16.716084+0000","last_unstale":"2024-09-18T01:25:43.851735+0000","last_undegraded":"2024-09-18T01:25:43.851735+0000","last_fullsized":"2024-09-18T01:25:43.851735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:49:46.781345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848361+0000","last_change":"2024-09-18T01:25:08.678786+0000","last_active":"2024-09-18T01:25:43.848361+0000","last_peered":"2024-09-18T01:25:43.848361+0000","last_clean":"2024-09-18T01:25:43.848361+0000","last_became_active":"2024-09-18T01:25:08.678539+0000","last_became_peered":"2024-09-18T01:25:08.678539+0000","last_unstale":"2024-09-18T01:25:43.848361+0000","last_undegraded":"2024-09-18T01:25:43.848361+0000","last_fullsized":"2024-09-18T01:25:43.848361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:26:37.929696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846243+0000","last_change":"2024-09-18T01:25:06.682960+0000","last_active":"2024-09-18T01:25:43.846243+0000","last_peered":"2024-09-18T01:25:43.846243+0000","last_clean":"2024-09-18T01:25:43.846243+0000","last_became_active":"2024-09-18T01:25:06.682592+0000","last_became_peered":"2024-09-18T01:25:06.682592+0000","last_unstale":"2024-09-18T01:25:43.846243+0000","last_undegraded":"2024-09-18T01:25:43.846243+0000","last_fullsized":"2024-09-18T01:25:43.846243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:39.148193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903424+0000","last_change":"2024-09-18T01:25:10.684259+0000","last_active":"2024-09-18T01:25:43.903424+0000","last_peered":"2024-09-18T01:25:43.903424+0000","last_clean":"2024-09-18T01:25:43.903424+0000","last_became_active":"2024-09-18T01:25:10.683833+0000","last_became_peered":"2024-09-18T01:25:10.683833+0000","last_unstale":"2024-09-18T01:25:43.903424+0000","last_undegraded":"2024-09-18T01:25:43.903424+0000","last_fullsized":"2024-09-18T01:25:43.903424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:01.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'32","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.070164+0000","last_change":"2024-09-18T01:25:12.693138+0000","last_active":"2024-09-18T01:27:15.070164+0000","last_peered":"2024-09-18T01:27:15.070164+0000","last_clean":"2024-09-18T01:27:15.070164+0000","last_became_active":"2024-09-18T01:25:12.691752+0000","last_became_peered":"2024-09-18T01:25:12.691752+0000","last_unstale":"2024-09-18T01:27:15.070164+0000","last_undegraded":"2024-09-18T01:27:15.070164+0000","last_fullsized":"2024-09-18T01:27:15.070164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:47:16.533005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849229+0000","last_change":"2024-09-18T01:25:14.711982+0000","last_active":"2024-09-18T01:25:43.849229+0000","last_peered":"2024-09-18T01:25:43.849229+0000","last_clean":"2024-09-18T01:25:43.849229+0000","last_became_active":"2024-09-18T01:25:14.711635+0000","last_became_peered":"2024-09-18T01:25:14.711635+0000","last_unstale":"2024-09-18T01:25:43.849229+0000","last_undegraded":"2024-09-18T01:25:43.849229+0000","last_fullsized":"2024-09-18T01:25:43.849229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:51:20.322887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.080053+0000","last_change":"2024-09-18T01:25:16.715865+0000","last_active":"2024-09-18T01:27:15.080053+0000","last_peered":"2024-09-18T01:27:15.080053+0000","last_clean":"2024-09-18T01:27:15.080053+0000","last_became_active":"2024-09-18T01:25:16.715581+0000","last_became_peered":"2024-09-18T01:25:16.715581+0000","last_unstale":"2024-09-18T01:27:15.080053+0000","last_undegraded":"2024-09-18T01:27:15.080053+0000","last_fullsized":"2024-09-18T01:27:15.080053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:23.172601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'8","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176264+0000","last_change":"2024-09-18T01:25:08.669854+0000","last_active":"2024-09-18T01:28:17.176264+0000","last_peered":"2024-09-18T01:28:17.176264+0000","last_clean":"2024-09-18T01:28:17.176264+0000","last_became_active":"2024-09-18T01:25:08.668430+0000","last_became_peered":"2024-09-18T01:25:08.668430+0000","last_unstale":"2024-09-18T01:28:17.176264+0000","last_undegraded":"2024-09-18T01:28:17.176264+0000","last_fullsized":"2024-09-18T01:28:17.176264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:43:08.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906927+0000","last_change":"2024-09-18T01:25:06.687779+0000","last_active":"2024-09-18T01:25:43.906927+0000","last_peered":"2024-09-18T01:25:43.906927+0000","last_clean":"2024-09-18T01:25:43.906927+0000","last_became_active":"2024-09-18T01:25:06.686394+0000","last_became_peered":"2024-09-18T01:25:06.686394+0000","last_unstale":"2024-09-18T01:25:43.906927+0000","last_undegraded":"2024-09-18T01:25:43.906927+0000","last_fullsized":"2024-09-18T01:25:43.906927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:53.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.760367+0000","last_change":"2024-09-18T01:25:10.683660+0000","last_active":"2024-09-18T01:27:13.760367+0000","last_peered":"2024-09-18T01:27:13.760367+0000","last_clean":"2024-09-18T01:27:13.760367+0000","last_became_active":"2024-09-18T01:25:10.683351+0000","last_became_peered":"2024-09-18T01:25:10.683351+0000","last_unstale":"2024-09-18T01:27:13.760367+0000","last_undegraded":"2024-09-18T01:27:13.760367+0000","last_fullsized":"2024-09-18T01:27:13.760367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:13.973263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'45","reported_seq":101,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.503821+0000","last_change":"2024-09-18T01:25:12.692015+0000","last_active":"2024-09-18T01:28:16.503821+0000","last_peered":"2024-09-18T01:28:16.503821+0000","last_clean":"2024-09-18T01:28:16.503821+0000","last_became_active":"2024-09-18T01:25:12.691715+0000","last_became_peered":"2024-09-18T01:25:12.691715+0000","last_unstale":"2024-09-18T01:28:16.503821+0000","last_undegraded":"2024-09-18T01:28:16.503821+0000","last_fullsized":"2024-09-18T01:28:16.503821+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:52:06.633359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844813+0000","last_change":"2024-09-18T01:25:14.707331+0000","last_active":"2024-09-18T01:25:43.844813+0000","last_peered":"2024-09-18T01:25:43.844813+0000","last_clean":"2024-09-18T01:25:43.844813+0000","last_became_active":"2024-09-18T01:25:14.706398+0000","last_became_peered":"2024-09-18T01:25:14.706398+0000","last_unstale":"2024-09-18T01:25:43.844813+0000","last_undegraded":"2024-09-18T01:25:43.844813+0000","last_fullsized":"2024-09-18T01:25:43.844813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:01:53.638099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.082692+0000","last_change":"2024-09-18T01:25:16.714114+0000","last_active":"2024-09-18T01:27:15.082692+0000","last_peered":"2024-09-18T01:27:15.082692+0000","last_clean":"2024-09-18T01:27:15.082692+0000","last_became_active":"2024-09-18T01:25:16.713579+0000","last_became_peered":"2024-09-18T01:25:16.713579+0000","last_unstale":"2024-09-18T01:27:15.082692+0000","last_undegraded":"2024-09-18T01:27:15.082692+0000","last_fullsized":"2024-09-18T01:27:15.082692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:14.993371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'8","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176775+0000","last_change":"2024-09-18T01:25:08.686807+0000","last_active":"2024-09-18T01:28:17.176775+0000","last_peered":"2024-09-18T01:28:17.176775+0000","last_clean":"2024-09-18T01:28:17.176775+0000","last_became_active":"2024-09-18T01:25:08.686645+0000","last_became_peered":"2024-09-18T01:25:08.686645+0000","last_unstale":"2024-09-18T01:28:17.176775+0000","last_undegraded":"2024-09-18T01:28:17.176775+0000","last_fullsized":"2024-09-18T01:28:17.176775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:25:13.805489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.842839+0000","last_change":"2024-09-18T01:25:06.703432+0000","last_active":"2024-09-18T01:25:43.842839+0000","last_peered":"2024-09-18T01:25:43.842839+0000","last_clean":"2024-09-18T01:25:43.842839+0000","last_became_active":"2024-09-18T01:25:06.702991+0000","last_became_peered":"2024-09-18T01:25:06.702991+0000","last_unstale":"2024-09-18T01:25:43.842839+0000","last_undegraded":"2024-09-18T01:25:43.842839+0000","last_fullsized":"2024-09-18T01:25:43.842839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:05.206190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176373+0000","last_change":"2024-09-18T01:25:08.673285+0000","last_active":"2024-09-18T01:28:17.176373+0000","last_peered":"2024-09-18T01:28:17.176373+0000","last_clean":"2024-09-18T01:28:17.176373+0000","last_became_active":"2024-09-18T01:25:08.672983+0000","last_became_peered":"2024-09-18T01:25:08.672983+0000","last_unstale":"2024-09-18T01:28:17.176373+0000","last_undegraded":"2024-09-18T01:28:17.176373+0000","last_fullsized":"2024-09-18T01:28:17.176373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:17.472878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843899+0000","last_change":"2024-09-18T01:25:06.681343+0000","last_active":"2024-09-18T01:25:43.843899+0000","last_peered":"2024-09-18T01:25:43.843899+0000","last_clean":"2024-09-18T01:25:43.843899+0000","last_became_active":"2024-09-18T01:25:06.680853+0000","last_became_peered":"2024-09-18T01:25:06.680853+0000","last_unstale":"2024-09-18T01:25:43.843899+0000","last_undegraded":"2024-09-18T01:25:43.843899+0000","last_fullsized":"2024-09-18T01:25:43.843899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:16.022647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'8","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941003+0000","last_change":"2024-09-18T01:25:08.682876+0000","last_active":"2024-09-18T01:26:32.941003+0000","last_peered":"2024-09-18T01:26:32.941003+0000","last_clean":"2024-09-18T01:26:32.941003+0000","last_became_active":"2024-09-18T01:25:08.682254+0000","last_became_peered":"2024-09-18T01:25:08.682254+0000","last_unstale":"2024-09-18T01:26:32.941003+0000","last_undegraded":"2024-09-18T01:26:32.941003+0000","last_fullsized":"2024-09-18T01:26:32.941003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:32:31.867039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849439+0000","last_change":"2024-09-18T01:25:06.684384+0000","last_active":"2024-09-18T01:25:43.849439+0000","last_peered":"2024-09-18T01:25:43.849439+0000","last_clean":"2024-09-18T01:25:43.849439+0000","last_became_active":"2024-09-18T01:25:06.682878+0000","last_became_peered":"2024-09-18T01:25:06.682878+0000","last_unstale":"2024-09-18T01:25:43.849439+0000","last_undegraded":"2024-09-18T01:25:43.849439+0000","last_fullsized":"2024-09-18T01:25:43.849439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:16:23.251760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.144979+0000","last_change":"2024-09-18T01:25:08.673238+0000","last_active":"2024-09-18T01:28:17.144979+0000","last_peered":"2024-09-18T01:28:17.144979+0000","last_clean":"2024-09-18T01:28:17.144979+0000","last_became_active":"2024-09-18T01:25:08.672574+0000","last_became_peered":"2024-09-18T01:25:08.672574+0000","last_unstale":"2024-09-18T01:28:17.144979+0000","last_undegraded":"2024-09-18T01:28:17.144979+0000","last_fullsized":"2024-09-18T01:28:17.144979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:41.660195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846440+0000","last_change":"2024-09-18T01:25:06.681262+0000","last_active":"2024-09-18T01:25:43.846440+0000","last_peered":"2024-09-18T01:25:43.846440+0000","last_clean":"2024-09-18T01:25:43.846440+0000","last_became_active":"2024-09-18T01:25:06.680712+0000","last_became_peered":"2024-09-18T01:25:06.680712+0000","last_unstale":"2024-09-18T01:25:43.846440+0000","last_undegraded":"2024-09-18T01:25:43.846440+0000","last_fullsized":"2024-09-18T01:25:43.846440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:03.343944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'5","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.394294+0000","last_change":"2024-09-18T01:25:08.671686+0000","last_active":"2024-09-18T01:27:13.394294+0000","last_peered":"2024-09-18T01:27:13.394294+0000","last_clean":"2024-09-18T01:27:13.394294+0000","last_became_active":"2024-09-18T01:25:08.671408+0000","last_became_peered":"2024-09-18T01:25:08.671408+0000","last_unstale":"2024-09-18T01:27:13.394294+0000","last_undegraded":"2024-09-18T01:27:13.394294+0000","last_fullsized":"2024-09-18T01:27:13.394294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:19.129968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845199+0000","last_change":"2024-09-18T01:25:06.683019+0000","last_active":"2024-09-18T01:25:43.845199+0000","last_peered":"2024-09-18T01:25:43.845199+0000","last_clean":"2024-09-18T01:25:43.845199+0000","last_became_active":"2024-09-18T01:25:06.682577+0000","last_became_peered":"2024-09-18T01:25:06.682577+0000","last_unstale":"2024-09-18T01:25:43.845199+0000","last_undegraded":"2024-09-18T01:25:43.845199+0000","last_fullsized":"2024-09-18T01:25:43.845199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:53.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'8","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954296+0000","last_change":"2024-09-18T01:25:08.688824+0000","last_active":"2024-09-18T01:28:16.954296+0000","last_peered":"2024-09-18T01:28:16.954296+0000","last_clean":"2024-09-18T01:28:16.954296+0000","last_became_active":"2024-09-18T01:25:08.687797+0000","last_became_peered":"2024-09-18T01:25:08.687797+0000","last_unstale":"2024-09-18T01:28:16.954296+0000","last_undegraded":"2024-09-18T01:28:16.954296+0000","last_fullsized":"2024-09-18T01:28:16.954296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:43:40.299678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905421+0000","last_change":"2024-09-18T01:25:06.687325+0000","last_active":"2024-09-18T01:25:43.905421+0000","last_peered":"2024-09-18T01:25:43.905421+0000","last_clean":"2024-09-18T01:25:43.905421+0000","last_became_active":"2024-09-18T01:25:06.686154+0000","last_became_peered":"2024-09-18T01:25:06.686154+0000","last_unstale":"2024-09-18T01:25:43.905421+0000","last_undegraded":"2024-09-18T01:25:43.905421+0000","last_fullsized":"2024-09-18T01:25:43.905421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:24.579150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176363+0000","last_change":"2024-09-18T01:25:08.681610+0000","last_active":"2024-09-18T01:28:17.176363+0000","last_peered":"2024-09-18T01:28:17.176363+0000","last_clean":"2024-09-18T01:28:17.176363+0000","last_became_active":"2024-09-18T01:25:08.680947+0000","last_became_peered":"2024-09-18T01:25:08.680947+0000","last_unstale":"2024-09-18T01:28:17.176363+0000","last_undegraded":"2024-09-18T01:28:17.176363+0000","last_fullsized":"2024-09-18T01:28:17.176363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:41.267347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845952+0000","last_change":"2024-09-18T01:25:06.704000+0000","last_active":"2024-09-18T01:25:43.845952+0000","last_peered":"2024-09-18T01:25:43.845952+0000","last_clean":"2024-09-18T01:25:43.845952+0000","last_became_active":"2024-09-18T01:25:06.703622+0000","last_became_peered":"2024-09-18T01:25:06.703622+0000","last_unstale":"2024-09-18T01:25:43.845952+0000","last_undegraded":"2024-09-18T01:25:43.845952+0000","last_fullsized":"2024-09-18T01:25:43.845952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:33:48.652888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'6","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.142304+0000","last_change":"2024-09-18T01:25:08.682682+0000","last_active":"2024-09-18T01:28:17.142304+0000","last_peered":"2024-09-18T01:28:17.142304+0000","last_clean":"2024-09-18T01:28:17.142304+0000","last_became_active":"2024-09-18T01:25:08.682143+0000","last_became_peered":"2024-09-18T01:25:08.682143+0000","last_unstale":"2024-09-18T01:28:17.142304+0000","last_undegraded":"2024-09-18T01:28:17.142304+0000","last_fullsized":"2024-09-18T01:28:17.142304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:10.604887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.435644+0000","last_change":"2024-09-18T01:25:06.687744+0000","last_active":"2024-09-18T01:25:50.435644+0000","last_peered":"2024-09-18T01:25:50.435644+0000","last_clean":"2024-09-18T01:25:50.435644+0000","last_became_active":"2024-09-18T01:25:06.687436+0000","last_became_peered":"2024-09-18T01:25:06.687436+0000","last_unstale":"2024-09-18T01:25:50.435644+0000","last_undegraded":"2024-09-18T01:25:50.435644+0000","last_fullsized":"2024-09-18T01:25:50.435644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:08.432830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'14","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097381+0000","last_change":"2024-09-18T01:25:08.676069+0000","last_active":"2024-09-18T01:28:17.097381+0000","last_peered":"2024-09-18T01:28:17.097381+0000","last_clean":"2024-09-18T01:28:17.097381+0000","last_became_active":"2024-09-18T01:25:08.675801+0000","last_became_peered":"2024-09-18T01:25:08.675801+0000","last_unstale":"2024-09-18T01:28:17.097381+0000","last_undegraded":"2024-09-18T01:28:17.097381+0000","last_fullsized":"2024-09-18T01:28:17.097381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:27.055282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.439101+0000","last_change":"2024-09-18T01:25:06.693564+0000","last_active":"2024-09-18T01:25:50.439101+0000","last_peered":"2024-09-18T01:25:50.439101+0000","last_clean":"2024-09-18T01:25:50.439101+0000","last_became_active":"2024-09-18T01:25:06.691345+0000","last_became_peered":"2024-09-18T01:25:06.691345+0000","last_unstale":"2024-09-18T01:25:50.439101+0000","last_undegraded":"2024-09-18T01:25:50.439101+0000","last_fullsized":"2024-09-18T01:25:50.439101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:23:21.828422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'16","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097074+0000","last_change":"2024-09-18T01:25:08.685632+0000","last_active":"2024-09-18T01:28:17.097074+0000","last_peered":"2024-09-18T01:28:17.097074+0000","last_clean":"2024-09-18T01:28:17.097074+0000","last_became_active":"2024-09-18T01:25:08.685358+0000","last_became_peered":"2024-09-18T01:25:08.685358+0000","last_unstale":"2024-09-18T01:28:17.097074+0000","last_undegraded":"2024-09-18T01:28:17.097074+0000","last_fullsized":"2024-09-18T01:28:17.097074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:56:00.059201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844121+0000","last_change":"2024-09-18T01:25:06.696372+0000","last_active":"2024-09-18T01:25:43.844121+0000","last_peered":"2024-09-18T01:25:43.844121+0000","last_clean":"2024-09-18T01:25:43.844121+0000","last_became_active":"2024-09-18T01:25:06.695735+0000","last_became_peered":"2024-09-18T01:25:06.695735+0000","last_unstale":"2024-09-18T01:25:43.844121+0000","last_undegraded":"2024-09-18T01:25:43.844121+0000","last_fullsized":"2024-09-18T01:25:43.844121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:24.579150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:49.871200+0000","last_change":"2024-09-18T01:25:43.852539+0000","last_active":"2024-09-18T01:25:49.871200+0000","last_peered":"2024-09-18T01:25:49.871200+0000","last_clean":"2024-09-18T01:25:49.871200+0000","last_became_active":"2024-09-18T01:25:43.849600+0000","last_became_peered":"2024-09-18T01:25:43.849600+0000","last_unstale":"2024-09-18T01:25:49.871200+0000","last_undegraded":"2024-09-18T01:25:49.871200+0000","last_fullsized":"2024-09-18T01:25:49.871200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:43.134170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904800+0000","last_change":"2024-09-18T01:25:06.695026+0000","last_active":"2024-09-18T01:25:43.904800+0000","last_peered":"2024-09-18T01:25:43.904800+0000","last_clean":"2024-09-18T01:25:43.904800+0000","last_became_active":"2024-09-18T01:25:06.688967+0000","last_became_peered":"2024-09-18T01:25:06.688967+0000","last_unstale":"2024-09-18T01:25:43.904800+0000","last_undegraded":"2024-09-18T01:25:43.904800+0000","last_fullsized":"2024-09-18T01:25:43.904800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:05.206190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'10","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176674+0000","last_change":"2024-09-18T01:25:08.684071+0000","last_active":"2024-09-18T01:28:17.176674+0000","last_peered":"2024-09-18T01:28:17.176674+0000","last_clean":"2024-09-18T01:28:17.176674+0000","last_became_active":"2024-09-18T01:25:08.683590+0000","last_became_peered":"2024-09-18T01:25:08.683590+0000","last_unstale":"2024-09-18T01:28:17.176674+0000","last_undegraded":"2024-09-18T01:28:17.176674+0000","last_fullsized":"2024-09-18T01:28:17.176674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:43:55.523212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'5","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798517+0000","last_change":"2024-09-18T01:25:06.686285+0000","last_active":"2024-09-18T01:27:24.798517+0000","last_peered":"2024-09-18T01:27:24.798517+0000","last_clean":"2024-09-18T01:27:24.798517+0000","last_became_active":"2024-09-18T01:25:06.685814+0000","last_became_peered":"2024-09-18T01:25:06.685814+0000","last_unstale":"2024-09-18T01:27:24.798517+0000","last_undegraded":"2024-09-18T01:27:24.798517+0000","last_fullsized":"2024-09-18T01:27:24.798517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:53.580899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954264+0000","last_change":"2024-09-18T01:25:08.686910+0000","last_active":"2024-09-18T01:28:16.954264+0000","last_peered":"2024-09-18T01:28:16.954264+0000","last_clean":"2024-09-18T01:28:16.954264+0000","last_became_active":"2024-09-18T01:25:08.686703+0000","last_became_peered":"2024-09-18T01:25:08.686703+0000","last_unstale":"2024-09-18T01:28:16.954264+0000","last_undegraded":"2024-09-18T01:28:16.954264+0000","last_fullsized":"2024-09-18T01:28:16.954264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:41.660195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.929092+0000","last_change":"2024-09-18T01:25:06.691078+0000","last_active":"2024-09-18T01:26:32.929092+0000","last_peered":"2024-09-18T01:26:32.929092+0000","last_clean":"2024-09-18T01:26:32.929092+0000","last_became_active":"2024-09-18T01:25:06.685120+0000","last_became_peered":"2024-09-18T01:25:06.685120+0000","last_unstale":"2024-09-18T01:26:32.929092+0000","last_undegraded":"2024-09-18T01:26:32.929092+0000","last_fullsized":"2024-09-18T01:26:32.929092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:11:04.031882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'7","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183513+0000","last_change":"2024-09-18T01:25:08.685436+0000","last_active":"2024-09-18T01:28:17.183513+0000","last_peered":"2024-09-18T01:28:17.183513+0000","last_clean":"2024-09-18T01:28:17.183513+0000","last_became_active":"2024-09-18T01:25:08.685158+0000","last_became_peered":"2024-09-18T01:25:08.685158+0000","last_unstale":"2024-09-18T01:28:17.183513+0000","last_undegraded":"2024-09-18T01:28:17.183513+0000","last_fullsized":"2024-09-18T01:28:17.183513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:07.788671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851842+0000","last_change":"2024-09-18T01:25:06.687424+0000","last_active":"2024-09-18T01:25:43.851842+0000","last_peered":"2024-09-18T01:25:43.851842+0000","last_clean":"2024-09-18T01:25:43.851842+0000","last_became_active":"2024-09-18T01:25:06.684845+0000","last_became_peered":"2024-09-18T01:25:06.684845+0000","last_unstale":"2024-09-18T01:25:43.851842+0000","last_undegraded":"2024-09-18T01:25:43.851842+0000","last_fullsized":"2024-09-18T01:25:43.851842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:33.279586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954367+0000","last_change":"2024-09-18T01:25:08.688327+0000","last_active":"2024-09-18T01:28:16.954367+0000","last_peered":"2024-09-18T01:28:16.954367+0000","last_clean":"2024-09-18T01:28:16.954367+0000","last_became_active":"2024-09-18T01:25:08.687840+0000","last_became_peered":"2024-09-18T01:25:08.687840+0000","last_unstale":"2024-09-18T01:28:16.954367+0000","last_undegraded":"2024-09-18T01:28:16.954367+0000","last_fullsized":"2024-09-18T01:28:16.954367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:24:41.518231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.089186+0000","last_change":"2024-09-18T01:25:06.704602+0000","last_active":"2024-09-18T01:28:17.089186+0000","last_peered":"2024-09-18T01:28:17.089186+0000","last_clean":"2024-09-18T01:28:17.089186+0000","last_became_active":"2024-09-18T01:25:06.704247+0000","last_became_peered":"2024-09-18T01:25:06.704247+0000","last_unstale":"2024-09-18T01:28:17.089186+0000","last_undegraded":"2024-09-18T01:28:17.089186+0000","last_fullsized":"2024-09-18T01:28:17.089186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:53.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'12","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.393720+0000","last_change":"2024-09-18T01:25:08.681230+0000","last_active":"2024-09-18T01:27:13.393720+0000","last_peered":"2024-09-18T01:27:13.393720+0000","last_clean":"2024-09-18T01:27:13.393720+0000","last_became_active":"2024-09-18T01:25:08.680916+0000","last_became_peered":"2024-09-18T01:25:08.680916+0000","last_unstale":"2024-09-18T01:27:13.393720+0000","last_undegraded":"2024-09-18T01:27:13.393720+0000","last_fullsized":"2024-09-18T01:27:13.393720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:09:03.211587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851720+0000","last_change":"2024-09-18T01:25:06.694171+0000","last_active":"2024-09-18T01:25:43.851720+0000","last_peered":"2024-09-18T01:25:43.851720+0000","last_clean":"2024-09-18T01:25:43.851720+0000","last_became_active":"2024-09-18T01:25:06.693000+0000","last_became_peered":"2024-09-18T01:25:06.693000+0000","last_unstale":"2024-09-18T01:25:43.851720+0000","last_undegraded":"2024-09-18T01:25:43.851720+0000","last_fullsized":"2024-09-18T01:25:43.851720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:50:30.604573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:49.302585+0000","last_change":"2024-09-18T01:25:06.694282+0000","last_active":"2024-09-18T01:25:49.302585+0000","last_peered":"2024-09-18T01:25:49.302585+0000","last_clean":"2024-09-18T01:25:49.302585+0000","last_became_active":"2024-09-18T01:25:06.691141+0000","last_became_peered":"2024-09-18T01:25:06.691141+0000","last_unstale":"2024-09-18T01:25:49.302585+0000","last_undegraded":"2024-09-18T01:25:49.302585+0000","last_fullsized":"2024-09-18T01:25:49.302585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:04.323530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'12","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.870361+0000","last_change":"2024-09-18T01:25:08.681504+0000","last_active":"2024-09-18T01:28:16.870361+0000","last_peered":"2024-09-18T01:28:16.870361+0000","last_clean":"2024-09-18T01:28:16.870361+0000","last_became_active":"2024-09-18T01:25:08.681053+0000","last_became_peered":"2024-09-18T01:25:08.681053+0000","last_unstale":"2024-09-18T01:28:16.870361+0000","last_undegraded":"2024-09-18T01:28:16.870361+0000","last_fullsized":"2024-09-18T01:28:16.870361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:34:57.289152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844207+0000","last_change":"2024-09-18T01:25:06.696528+0000","last_active":"2024-09-18T01:25:43.844207+0000","last_peered":"2024-09-18T01:25:43.844207+0000","last_clean":"2024-09-18T01:25:43.844207+0000","last_became_active":"2024-09-18T01:25:06.695875+0000","last_became_peered":"2024-09-18T01:25:06.695875+0000","last_unstale":"2024-09-18T01:25:43.844207+0000","last_undegraded":"2024-09-18T01:25:43.844207+0000","last_fullsized":"2024-09-18T01:25:43.844207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:22.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097034+0000","last_change":"2024-09-18T01:25:08.688042+0000","last_active":"2024-09-18T01:28:17.097034+0000","last_peered":"2024-09-18T01:28:17.097034+0000","last_clean":"2024-09-18T01:28:17.097034+0000","last_became_active":"2024-09-18T01:25:08.687583+0000","last_became_peered":"2024-09-18T01:25:08.687583+0000","last_unstale":"2024-09-18T01:28:17.097034+0000","last_undegraded":"2024-09-18T01:28:17.097034+0000","last_fullsized":"2024-09-18T01:28:17.097034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:55:06.296443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1467,"ondisk_log_size":1467,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48388,"kb_used_data":8884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323452,"statfs":{"total":96636764160,"available":96587214848,"internally_reserved":0,"allocated":9097216,"data_stored":8762447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673006,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44744,"kb_used_data":9400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327096,"statfs":{"total":96636764160,"available":96590946304,"internally_reserved":0,"allocated":9625600,"data_stored":9350220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673007,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44772,"kb_used_data":9428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327068,"statfs":{"total":96636764160,"available":96590917632,"internally_reserved":0,"allocated":9654272,"data_stored":9352298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48360,"kb_used_data":8856,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323480,"statfs":{"total":96636764160,"available":96587243520,"internally_reserved":0,"allocated":9068544,"data_stored":8760581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:28:24.222 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:28:24.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.344+0000 7fab8f0f1640 1 Processor -- start 2024-09-18T01:28:24.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.344+0000 7fab8f0f1640 1 -- start start 2024-09-18T01:28:24.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.345+0000 7fab8f0f1640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fab8812e940 0x7fab88130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:24.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.345+0000 7fab8f0f1640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab8806eba0 con 0x7fab8806eda0 2024-09-18T01:28:24.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.345+0000 7fab8f0f1640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fab8806d2f0 con 0x7fab8812e940 2024-09-18T01:28:24.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.345+0000 7fab87fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fab8812e940 0x7fab88130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:24.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.345+0000 7fab8ce8d640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fab8806eda0 0x7fab8806f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56640/0 (socket says 172.21.15.92:56640) 2024-09-18T01:28:24.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.345+0000 7fab8ce8d640 1 -- 172.21.15.92:0/2370230868 learned_addr learned my addr 172.21.15.92:0/2370230868 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:28:24.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.345+0000 7fab87fff640 1 -- 172.21.15.92:0/2370230868 >> v1:172.21.15.92:6789/0 conn(0x7fab8806eda0 legacy=0x7fab8806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:24.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.345+0000 7fab87fff640 1 -- 172.21.15.92:0/2370230868 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab88070d50 con 0x7fab8812e940 2024-09-18T01:28:24.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.345+0000 7fab877fe640 1 -- 172.21.15.92:0/2370230868 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090515893 0 0) 0x7fab8806eba0 con 0x7fab8806eda0 2024-09-18T01:28:24.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.346+0000 7fab87fff640 1 --2- 172.21.15.92:0/2370230868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8812e940 0x7fab88130d30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009720 tx=0x7fab7c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe9ea340c77037a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:24.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.346+0000 7fab877fe640 1 -- 172.21.15.92:0/2370230868 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7c037070 con 0x7fab8812e940 2024-09-18T01:28:24.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.346+0000 7fab877fe640 1 -- 172.21.15.92:0/2370230868 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7c02ae20 con 0x7fab8812e940 2024-09-18T01:28:24.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.346+0000 7fab877fe640 1 -- 172.21.15.92:0/2370230868 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7c032590 con 0x7fab8812e940 2024-09-18T01:28:24.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.347+0000 7fab8f0f1640 1 -- 172.21.15.92:0/2370230868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8812e940 msgr2=0x7fab88130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:24.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.347+0000 7fab8f0f1640 1 --2- 172.21.15.92:0/2370230868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8812e940 0x7fab88130d30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009720 tx=0x7fab7c02a1a0 comp rx=0 tx=0).stop 2024-09-18T01:28:24.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.347+0000 7fab8f0f1640 1 -- 172.21.15.92:0/2370230868 shutdown_connections 2024-09-18T01:28:24.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.347+0000 7fab8f0f1640 1 --2- 172.21.15.92:0/2370230868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8812e940 0x7fab88130d30 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:24.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.347+0000 7fab8f0f1640 1 -- 172.21.15.92:0/2370230868 >> 172.21.15.92:0/2370230868 conn(0x7fab8809a890 msgr2=0x7fab8809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:24.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.347+0000 7fab8f0f1640 1 -- 172.21.15.92:0/2370230868 shutdown_connections 2024-09-18T01:28:24.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.347+0000 7fab8f0f1640 1 -- 172.21.15.92:0/2370230868 wait complete. 2024-09-18T01:28:24.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.347+0000 7fab8f0f1640 1 Processor -- start 2024-09-18T01:28:24.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.347+0000 7fab8f0f1640 1 -- start start 2024-09-18T01:28:24.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.348+0000 7fab8f0f1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8806eda0 0x7fab88125d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:24.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.348+0000 7fab8f0f1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fab8806fcd0 con 0x7fab8806eda0 2024-09-18T01:28:24.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.348+0000 7fab8ce8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8806eda0 0x7fab88125d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:24.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.348+0000 7fab8ce8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8806eda0 0x7fab88125d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56936/0 (socket says 172.21.15.92:56936) 2024-09-18T01:28:24.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.348+0000 7fab8ce8d640 1 -- 172.21.15.92:0/291413642 learned_addr learned my addr 172.21.15.92:0/291413642 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:24.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.348+0000 7fab8ce8d640 1 -- 172.21.15.92:0/291413642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8806db80 con 0x7fab8806eda0 2024-09-18T01:28:24.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.348+0000 7fab8ce8d640 1 --2- 172.21.15.92:0/291413642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8806eda0 0x7fab88125d80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fab7800c420 tx=0x7fab7800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:24.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.349+0000 7fab857fa640 1 -- 172.21.15.92:0/291413642 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab78018070 con 0x7fab8806eda0 2024-09-18T01:28:24.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.349+0000 7fab857fa640 1 -- 172.21.15.92:0/291413642 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab780074d0 con 0x7fab8806eda0 2024-09-18T01:28:24.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.349+0000 7fab8f0f1640 1 -- 172.21.15.92:0/291413642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab88128440 con 0x7fab8806eda0 2024-09-18T01:28:24.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.349+0000 7fab857fa640 1 -- 172.21.15.92:0/291413642 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab78004950 con 0x7fab8806eda0 2024-09-18T01:28:24.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.349+0000 7fab8f0f1640 1 -- 172.21.15.92:0/291413642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab881262c0 con 0x7fab8806eda0 2024-09-18T01:28:24.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.350+0000 7fab857fa640 1 -- 172.21.15.92:0/291413642 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab7801b070 con 0x7fab8806eda0 2024-09-18T01:28:24.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.350+0000 7fab8f0f1640 1 -- 172.21.15.92:0/291413642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8806f180 con 0x7fab8806eda0 2024-09-18T01:28:24.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.350+0000 7fab857fa640 1 --2- 172.21.15.92:0/291413642 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fab740382a0 0x7fab7403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:24.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.350+0000 7fab857fa640 1 -- 172.21.15.92:0/291413642 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fab7804b190 con 0x7fab8806eda0 2024-09-18T01:28:24.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.350+0000 7fab87fff640 1 --2- 172.21.15.92:0/291413642 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fab740382a0 0x7fab7403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:24.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.350+0000 7fab87fff640 1 --2- 172.21.15.92:0/291413642 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fab740382a0 0x7fab7403a760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fab7c034000 tx=0x7fab7c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:24.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.354+0000 7fab857fa640 1 -- 172.21.15.92:0/291413642 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab78011960 con 0x7fab8806eda0 2024-09-18T01:28:24.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.520+0000 7fab8f0f1640 1 -- 172.21.15.92:0/291413642 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab88127a20 con 0x7fab740382a0 2024-09-18T01:28:24.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.534+0000 7fab857fa640 1 -- 172.21.15.92:0/291413642 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666082 (secure 0 0 0) 0x7fab7c0093c0 con 0x7fab740382a0 2024-09-18T01:28:24.543 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:28:24.548 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-18T01:28:24.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.539+0000 7fab8f0f1640 1 -- 172.21.15.92:0/291413642 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fab740382a0 msgr2=0x7fab7403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:24.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.539+0000 7fab8f0f1640 1 --2- 172.21.15.92:0/291413642 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fab740382a0 0x7fab7403a760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fab7c034000 tx=0x7fab7c02e000 comp rx=0 tx=0).stop 2024-09-18T01:28:24.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.539+0000 7fab8f0f1640 1 -- 172.21.15.92:0/291413642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8806eda0 msgr2=0x7fab88125d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:24.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.539+0000 7fab8f0f1640 1 --2- 172.21.15.92:0/291413642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8806eda0 0x7fab88125d80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fab7800c420 tx=0x7fab7800c8e0 comp rx=0 tx=0).stop 2024-09-18T01:28:24.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.539+0000 7fab8f0f1640 1 -- 172.21.15.92:0/291413642 shutdown_connections 2024-09-18T01:28:24.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.539+0000 7fab8f0f1640 1 --2- 172.21.15.92:0/291413642 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fab740382a0 0x7fab7403a760 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:24.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.539+0000 7fab8f0f1640 1 --2- 172.21.15.92:0/291413642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8806eda0 0x7fab88125d80 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:24.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.539+0000 7fab8f0f1640 1 -- 172.21.15.92:0/291413642 >> 172.21.15.92:0/291413642 conn(0x7fab8809a890 msgr2=0x7fab88097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:24.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.539+0000 7fab8f0f1640 1 -- 172.21.15.92:0/291413642 shutdown_connections 2024-09-18T01:28:24.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.539+0000 7fab8f0f1640 1 -- 172.21.15.92:0/291413642 wait complete. 2024-09-18T01:28:24.552 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-18T01:28:22.826312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416905,"num_objects":261,"num_object_clones":0,"num_object_copies":536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5167,"num_read_kb":4712,"num_write":2298,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":993,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4671,"ondisk_log_size":4671,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186264,"kb_used_data":36568,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377301096,"statfs":{"total":386547056640,"available":386356322304,"internally_reserved":0,"allocated":37445632,"data_stored":36225546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004131"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846091+0000","last_change":"2024-09-18T01:25:06.692305+0000","last_active":"2024-09-18T01:25:43.846091+0000","last_peered":"2024-09-18T01:25:43.846091+0000","last_clean":"2024-09-18T01:25:43.846091+0000","last_became_active":"2024-09-18T01:25:06.691940+0000","last_became_peered":"2024-09-18T01:25:06.691940+0000","last_unstale":"2024-09-18T01:25:43.846091+0000","last_undegraded":"2024-09-18T01:25:43.846091+0000","last_fullsized":"2024-09-18T01:25:43.846091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:24.579150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'13","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153106+0000","last_change":"2024-09-18T01:25:08.683809+0000","last_active":"2024-09-18T01:28:17.153106+0000","last_peered":"2024-09-18T01:28:17.153106+0000","last_clean":"2024-09-18T01:28:17.153106+0000","last_became_active":"2024-09-18T01:25:08.683538+0000","last_became_peered":"2024-09-18T01:25:08.683538+0000","last_unstale":"2024-09-18T01:28:17.153106+0000","last_undegraded":"2024-09-18T01:28:17.153106+0000","last_fullsized":"2024-09-18T01:28:17.153106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:05.611732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.796081+0000","last_change":"2024-09-18T01:25:06.687454+0000","last_active":"2024-09-18T01:27:12.796081+0000","last_peered":"2024-09-18T01:27:12.796081+0000","last_clean":"2024-09-18T01:27:12.796081+0000","last_became_active":"2024-09-18T01:25:06.686950+0000","last_became_peered":"2024-09-18T01:25:06.686950+0000","last_unstale":"2024-09-18T01:27:12.796081+0000","last_undegraded":"2024-09-18T01:27:12.796081+0000","last_fullsized":"2024-09-18T01:27:12.796081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:03.894308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'20","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954431+0000","last_change":"2024-09-18T01:25:08.673859+0000","last_active":"2024-09-18T01:28:16.954431+0000","last_peered":"2024-09-18T01:28:16.954431+0000","last_clean":"2024-09-18T01:28:16.954431+0000","last_became_active":"2024-09-18T01:25:08.673552+0000","last_became_peered":"2024-09-18T01:25:08.673552+0000","last_unstale":"2024-09-18T01:28:16.954431+0000","last_undegraded":"2024-09-18T01:28:16.954431+0000","last_fullsized":"2024-09-18T01:28:16.954431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:50:57.219183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.852159+0000","last_change":"2024-09-18T01:25:06.687698+0000","last_active":"2024-09-18T01:25:43.852159+0000","last_peered":"2024-09-18T01:25:43.852159+0000","last_clean":"2024-09-18T01:25:43.852159+0000","last_became_active":"2024-09-18T01:25:06.687068+0000","last_became_peered":"2024-09-18T01:25:06.687068+0000","last_unstale":"2024-09-18T01:25:43.852159+0000","last_undegraded":"2024-09-18T01:25:43.852159+0000","last_fullsized":"2024-09-18T01:25:43.852159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:28.131866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'10","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097039+0000","last_change":"2024-09-18T01:25:08.685372+0000","last_active":"2024-09-18T01:28:17.097039+0000","last_peered":"2024-09-18T01:28:17.097039+0000","last_clean":"2024-09-18T01:28:17.097039+0000","last_became_active":"2024-09-18T01:25:08.685074+0000","last_became_peered":"2024-09-18T01:25:08.685074+0000","last_unstale":"2024-09-18T01:28:17.097039+0000","last_undegraded":"2024-09-18T01:28:17.097039+0000","last_fullsized":"2024-09-18T01:28:17.097039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:49.546714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844176+0000","last_change":"2024-09-18T01:25:06.690926+0000","last_active":"2024-09-18T01:25:43.844176+0000","last_peered":"2024-09-18T01:25:43.844176+0000","last_clean":"2024-09-18T01:25:43.844176+0000","last_became_active":"2024-09-18T01:25:06.690552+0000","last_became_peered":"2024-09-18T01:25:06.690552+0000","last_unstale":"2024-09-18T01:25:43.844176+0000","last_undegraded":"2024-09-18T01:25:43.844176+0000","last_fullsized":"2024-09-18T01:25:43.844176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:39:53.953032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'8","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.453023+0000","last_change":"2024-09-18T01:25:08.676582+0000","last_active":"2024-09-18T01:25:50.453023+0000","last_peered":"2024-09-18T01:25:50.453023+0000","last_clean":"2024-09-18T01:25:50.453023+0000","last_became_active":"2024-09-18T01:25:08.674210+0000","last_became_peered":"2024-09-18T01:25:08.674210+0000","last_unstale":"2024-09-18T01:25:50.453023+0000","last_undegraded":"2024-09-18T01:25:50.453023+0000","last_fullsized":"2024-09-18T01:25:50.453023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:19:54.471269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.435444+0000","last_change":"2024-09-18T01:25:06.689859+0000","last_active":"2024-09-18T01:27:16.435444+0000","last_peered":"2024-09-18T01:27:16.435444+0000","last_clean":"2024-09-18T01:27:16.435444+0000","last_became_active":"2024-09-18T01:25:06.687608+0000","last_became_peered":"2024-09-18T01:25:06.687608+0000","last_unstale":"2024-09-18T01:27:16.435444+0000","last_undegraded":"2024-09-18T01:27:16.435444+0000","last_fullsized":"2024-09-18T01:27:16.435444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:30:22.917213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.387179+0000","last_change":"2024-09-18T01:25:08.684086+0000","last_active":"2024-09-18T01:27:13.387179+0000","last_peered":"2024-09-18T01:27:13.387179+0000","last_clean":"2024-09-18T01:27:13.387179+0000","last_became_active":"2024-09-18T01:25:08.683812+0000","last_became_peered":"2024-09-18T01:25:08.683812+0000","last_unstale":"2024-09-18T01:27:13.387179+0000","last_undegraded":"2024-09-18T01:27:13.387179+0000","last_fullsized":"2024-09-18T01:27:13.387179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:37.287772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.092252+0000","last_change":"2024-09-18T01:25:06.702940+0000","last_active":"2024-09-18T01:28:17.092252+0000","last_peered":"2024-09-18T01:28:17.092252+0000","last_clean":"2024-09-18T01:28:17.092252+0000","last_became_active":"2024-09-18T01:25:06.702616+0000","last_became_peered":"2024-09-18T01:25:06.702616+0000","last_unstale":"2024-09-18T01:28:17.092252+0000","last_undegraded":"2024-09-18T01:28:17.092252+0000","last_fullsized":"2024-09-18T01:28:17.092252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:53.580899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'8","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.956371+0000","last_change":"2024-09-18T01:25:43.904757+0000","last_active":"2024-09-18T01:28:16.956371+0000","last_peered":"2024-09-18T01:28:16.956371+0000","last_clean":"2024-09-18T01:28:16.956371+0000","last_became_active":"2024-09-18T01:25:43.904427+0000","last_became_peered":"2024-09-18T01:25:43.904427+0000","last_unstale":"2024-09-18T01:28:16.956371+0000","last_undegraded":"2024-09-18T01:28:16.956371+0000","last_fullsized":"2024-09-18T01:28:16.956371+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:33:47.798452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848729+0000","last_change":"2024-09-18T01:25:06.683548+0000","last_active":"2024-09-18T01:25:43.848729+0000","last_peered":"2024-09-18T01:25:43.848729+0000","last_clean":"2024-09-18T01:25:43.848729+0000","last_became_active":"2024-09-18T01:25:06.683195+0000","last_became_peered":"2024-09-18T01:25:06.683195+0000","last_unstale":"2024-09-18T01:25:43.848729+0000","last_undegraded":"2024-09-18T01:25:43.848729+0000","last_fullsized":"2024-09-18T01:25:43.848729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:13.167515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.796067+0000","last_change":"2024-09-18T01:25:08.677859+0000","last_active":"2024-09-18T01:27:14.796067+0000","last_peered":"2024-09-18T01:27:14.796067+0000","last_clean":"2024-09-18T01:27:14.796067+0000","last_became_active":"2024-09-18T01:25:08.677579+0000","last_became_peered":"2024-09-18T01:25:08.677579+0000","last_unstale":"2024-09-18T01:27:14.796067+0000","last_undegraded":"2024-09-18T01:27:14.796067+0000","last_fullsized":"2024-09-18T01:27:14.796067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:39.586169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844028+0000","last_change":"2024-09-18T01:25:06.686453+0000","last_active":"2024-09-18T01:25:43.844028+0000","last_peered":"2024-09-18T01:25:43.844028+0000","last_clean":"2024-09-18T01:25:43.844028+0000","last_became_active":"2024-09-18T01:25:06.686049+0000","last_became_peered":"2024-09-18T01:25:06.686049+0000","last_unstale":"2024-09-18T01:25:43.844028+0000","last_undegraded":"2024-09-18T01:25:43.844028+0000","last_fullsized":"2024-09-18T01:25:43.844028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:53.580899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.477318+0000","last_change":"2024-09-18T01:25:08.676582+0000","last_active":"2024-09-18T01:27:16.477318+0000","last_peered":"2024-09-18T01:27:16.477318+0000","last_clean":"2024-09-18T01:27:16.477318+0000","last_became_active":"2024-09-18T01:25:08.676310+0000","last_became_peered":"2024-09-18T01:25:08.676310+0000","last_unstale":"2024-09-18T01:27:16.477318+0000","last_undegraded":"2024-09-18T01:27:16.477318+0000","last_fullsized":"2024-09-18T01:27:16.477318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:55:06.296443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'24","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.104105+0000","last_change":"2024-09-18T01:25:08.673269+0000","last_active":"2024-09-18T01:28:17.104105+0000","last_peered":"2024-09-18T01:28:17.104105+0000","last_clean":"2024-09-18T01:28:17.104105+0000","last_became_active":"2024-09-18T01:25:08.671858+0000","last_became_peered":"2024-09-18T01:25:08.671858+0000","last_unstale":"2024-09-18T01:28:17.104105+0000","last_undegraded":"2024-09-18T01:28:17.104105+0000","last_fullsized":"2024-09-18T01:28:17.104105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:50:36.347808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":55,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.907039+0000","last_change":"2024-09-18T01:25:06.691701+0000","last_active":"2024-09-18T01:25:43.907039+0000","last_peered":"2024-09-18T01:25:43.907039+0000","last_clean":"2024-09-18T01:25:43.907039+0000","last_became_active":"2024-09-18T01:25:06.691034+0000","last_became_peered":"2024-09-18T01:25:06.691034+0000","last_unstale":"2024-09-18T01:25:43.907039+0000","last_undegraded":"2024-09-18T01:25:43.907039+0000","last_fullsized":"2024-09-18T01:25:43.907039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:43.801545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'3","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799237+0000","last_change":"2024-09-18T01:25:08.685309+0000","last_active":"2024-09-18T01:27:29.799237+0000","last_peered":"2024-09-18T01:27:29.799237+0000","last_clean":"2024-09-18T01:27:29.799237+0000","last_became_active":"2024-09-18T01:25:08.685043+0000","last_became_peered":"2024-09-18T01:25:08.685043+0000","last_unstale":"2024-09-18T01:27:29.799237+0000","last_undegraded":"2024-09-18T01:27:29.799237+0000","last_fullsized":"2024-09-18T01:27:29.799237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:39.586169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846314+0000","last_change":"2024-09-18T01:25:06.704767+0000","last_active":"2024-09-18T01:25:43.846314+0000","last_peered":"2024-09-18T01:25:43.846314+0000","last_clean":"2024-09-18T01:25:43.846314+0000","last_became_active":"2024-09-18T01:25:06.704414+0000","last_became_peered":"2024-09-18T01:25:06.704414+0000","last_unstale":"2024-09-18T01:25:43.846314+0000","last_undegraded":"2024-09-18T01:25:43.846314+0000","last_fullsized":"2024-09-18T01:25:43.846314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:43.801545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097079+0000","last_change":"2024-09-18T01:25:08.685665+0000","last_active":"2024-09-18T01:28:17.097079+0000","last_peered":"2024-09-18T01:28:17.097079+0000","last_clean":"2024-09-18T01:28:17.097079+0000","last_became_active":"2024-09-18T01:25:08.684921+0000","last_became_peered":"2024-09-18T01:25:08.684921+0000","last_unstale":"2024-09-18T01:28:17.097079+0000","last_undegraded":"2024-09-18T01:28:17.097079+0000","last_fullsized":"2024-09-18T01:28:17.097079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:15:04.998223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'3","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.741010+0000","last_change":"2024-09-18T01:25:06.688208+0000","last_active":"2024-09-18T01:26:32.741010+0000","last_peered":"2024-09-18T01:26:32.741010+0000","last_clean":"2024-09-18T01:26:32.741010+0000","last_became_active":"2024-09-18T01:25:06.687737+0000","last_became_peered":"2024-09-18T01:25:06.687737+0000","last_unstale":"2024-09-18T01:26:32.741010+0000","last_undegraded":"2024-09-18T01:26:32.741010+0000","last_fullsized":"2024-09-18T01:26:32.741010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:16.022647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'16","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.394341+0000","last_change":"2024-09-18T01:25:08.671649+0000","last_active":"2024-09-18T01:27:13.394341+0000","last_peered":"2024-09-18T01:27:13.394341+0000","last_clean":"2024-09-18T01:27:13.394341+0000","last_became_active":"2024-09-18T01:25:08.671338+0000","last_became_peered":"2024-09-18T01:25:08.671338+0000","last_unstale":"2024-09-18T01:27:13.394341+0000","last_undegraded":"2024-09-18T01:27:13.394341+0000","last_fullsized":"2024-09-18T01:27:13.394341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:55:06.296443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905086+0000","last_change":"2024-09-18T01:25:06.688689+0000","last_active":"2024-09-18T01:25:43.905086+0000","last_peered":"2024-09-18T01:25:43.905086+0000","last_clean":"2024-09-18T01:25:43.905086+0000","last_became_active":"2024-09-18T01:25:06.688356+0000","last_became_peered":"2024-09-18T01:25:06.688356+0000","last_unstale":"2024-09-18T01:25:43.905086+0000","last_undegraded":"2024-09-18T01:25:43.905086+0000","last_fullsized":"2024-09-18T01:25:43.905086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:22.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941235+0000","last_change":"2024-09-18T01:25:08.674151+0000","last_active":"2024-09-18T01:26:32.941235+0000","last_peered":"2024-09-18T01:26:32.941235+0000","last_clean":"2024-09-18T01:26:32.941235+0000","last_became_active":"2024-09-18T01:25:08.673915+0000","last_became_peered":"2024-09-18T01:25:08.673915+0000","last_unstale":"2024-09-18T01:26:32.941235+0000","last_undegraded":"2024-09-18T01:26:32.941235+0000","last_fullsized":"2024-09-18T01:26:32.941235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:42:49.663850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846696+0000","last_change":"2024-09-18T01:25:06.687453+0000","last_active":"2024-09-18T01:25:43.846696+0000","last_peered":"2024-09-18T01:25:43.846696+0000","last_clean":"2024-09-18T01:25:43.846696+0000","last_became_active":"2024-09-18T01:25:06.686900+0000","last_became_peered":"2024-09-18T01:25:06.686900+0000","last_unstale":"2024-09-18T01:25:43.846696+0000","last_undegraded":"2024-09-18T01:25:43.846696+0000","last_fullsized":"2024-09-18T01:25:43.846696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:18.475907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.142353+0000","last_change":"2024-09-18T01:25:08.682513+0000","last_active":"2024-09-18T01:28:17.142353+0000","last_peered":"2024-09-18T01:28:17.142353+0000","last_clean":"2024-09-18T01:28:17.142353+0000","last_became_active":"2024-09-18T01:25:08.682225+0000","last_became_peered":"2024-09-18T01:25:08.682225+0000","last_unstale":"2024-09-18T01:28:17.142353+0000","last_undegraded":"2024-09-18T01:28:17.142353+0000","last_fullsized":"2024-09-18T01:28:17.142353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:34:57.289152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849721+0000","last_change":"2024-09-18T01:25:06.695620+0000","last_active":"2024-09-18T01:25:43.849721+0000","last_peered":"2024-09-18T01:25:43.849721+0000","last_clean":"2024-09-18T01:25:43.849721+0000","last_became_active":"2024-09-18T01:25:06.693647+0000","last_became_peered":"2024-09-18T01:25:06.693647+0000","last_unstale":"2024-09-18T01:25:43.849721+0000","last_undegraded":"2024-09-18T01:25:43.849721+0000","last_fullsized":"2024-09-18T01:25:43.849721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:00:13.013796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'35","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.121409+0000","last_change":"2024-09-18T01:25:16.712693+0000","last_active":"2024-09-18T01:28:17.121409+0000","last_peered":"2024-09-18T01:28:17.121409+0000","last_clean":"2024-09-18T01:28:17.121409+0000","last_became_active":"2024-09-18T01:25:16.712438+0000","last_became_peered":"2024-09-18T01:25:16.712438+0000","last_unstale":"2024-09-18T01:28:17.121409+0000","last_undegraded":"2024-09-18T01:28:17.121409+0000","last_fullsized":"2024-09-18T01:28:17.121409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:49.191321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.485988+0000","last_change":"2024-09-18T01:25:08.673859+0000","last_active":"2024-09-18T01:27:16.485988+0000","last_peered":"2024-09-18T01:27:16.485988+0000","last_clean":"2024-09-18T01:27:16.485988+0000","last_became_active":"2024-09-18T01:25:08.673605+0000","last_became_peered":"2024-09-18T01:25:08.673605+0000","last_unstale":"2024-09-18T01:27:16.485988+0000","last_undegraded":"2024-09-18T01:27:16.485988+0000","last_fullsized":"2024-09-18T01:27:16.485988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:55:33.999113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849855+0000","last_change":"2024-09-18T01:25:06.687788+0000","last_active":"2024-09-18T01:25:43.849855+0000","last_peered":"2024-09-18T01:25:43.849855+0000","last_clean":"2024-09-18T01:25:43.849855+0000","last_became_active":"2024-09-18T01:25:06.685173+0000","last_became_peered":"2024-09-18T01:25:06.685173+0000","last_unstale":"2024-09-18T01:25:43.849855+0000","last_undegraded":"2024-09-18T01:25:43.849855+0000","last_fullsized":"2024-09-18T01:25:43.849855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:13.192602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850787+0000","last_change":"2024-09-18T01:25:10.684730+0000","last_active":"2024-09-18T01:25:43.850787+0000","last_peered":"2024-09-18T01:25:43.850787+0000","last_clean":"2024-09-18T01:25:43.850787+0000","last_became_active":"2024-09-18T01:25:10.684454+0000","last_became_peered":"2024-09-18T01:25:10.684454+0000","last_unstale":"2024-09-18T01:25:43.850787+0000","last_undegraded":"2024-09-18T01:25:43.850787+0000","last_fullsized":"2024-09-18T01:25:43.850787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:30:35.363182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'42","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.063374+0000","last_change":"2024-09-18T01:25:12.692370+0000","last_active":"2024-09-18T01:27:15.063374+0000","last_peered":"2024-09-18T01:27:15.063374+0000","last_clean":"2024-09-18T01:27:15.063374+0000","last_became_active":"2024-09-18T01:25:12.692059+0000","last_became_peered":"2024-09-18T01:25:12.692059+0000","last_unstale":"2024-09-18T01:27:15.063374+0000","last_undegraded":"2024-09-18T01:27:15.063374+0000","last_fullsized":"2024-09-18T01:27:15.063374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:17:50.198957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906790+0000","last_change":"2024-09-18T01:25:14.710315+0000","last_active":"2024-09-18T01:25:43.906790+0000","last_peered":"2024-09-18T01:25:43.906790+0000","last_clean":"2024-09-18T01:25:43.906790+0000","last_became_active":"2024-09-18T01:25:14.709879+0000","last_became_peered":"2024-09-18T01:25:14.709879+0000","last_unstale":"2024-09-18T01:25:43.906790+0000","last_undegraded":"2024-09-18T01:25:43.906790+0000","last_fullsized":"2024-09-18T01:25:43.906790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:49.524031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.757439+0000","last_change":"2024-09-18T01:25:16.712032+0000","last_active":"2024-09-18T01:26:32.757439+0000","last_peered":"2024-09-18T01:26:32.757439+0000","last_clean":"2024-09-18T01:26:32.757439+0000","last_became_active":"2024-09-18T01:25:16.711764+0000","last_became_peered":"2024-09-18T01:25:16.711764+0000","last_unstale":"2024-09-18T01:26:32.757439+0000","last_undegraded":"2024-09-18T01:26:32.757439+0000","last_fullsized":"2024-09-18T01:26:32.757439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:53:25.033231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:44.783814+0000","last_change":"2024-09-18T01:25:43.852201+0000","last_active":"2024-09-18T01:25:44.783814+0000","last_peered":"2024-09-18T01:25:44.783814+0000","last_clean":"2024-09-18T01:25:44.783814+0000","last_became_active":"2024-09-18T01:25:43.848631+0000","last_became_peered":"2024-09-18T01:25:43.848631+0000","last_unstale":"2024-09-18T01:25:44.783814+0000","last_undegraded":"2024-09-18T01:25:44.783814+0000","last_fullsized":"2024-09-18T01:25:44.783814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:19:57.986757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:49.297524+0000","last_change":"2024-09-18T01:25:06.691194+0000","last_active":"2024-09-18T01:25:49.297524+0000","last_peered":"2024-09-18T01:25:49.297524+0000","last_clean":"2024-09-18T01:25:49.297524+0000","last_became_active":"2024-09-18T01:25:06.690813+0000","last_became_peered":"2024-09-18T01:25:06.690813+0000","last_unstale":"2024-09-18T01:25:49.297524+0000","last_undegraded":"2024-09-18T01:25:49.297524+0000","last_fullsized":"2024-09-18T01:25:49.297524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:22.518297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844623+0000","last_change":"2024-09-18T01:25:10.677775+0000","last_active":"2024-09-18T01:25:43.844623+0000","last_peered":"2024-09-18T01:25:43.844623+0000","last_clean":"2024-09-18T01:25:43.844623+0000","last_became_active":"2024-09-18T01:25:10.677226+0000","last_became_peered":"2024-09-18T01:25:10.677226+0000","last_unstale":"2024-09-18T01:25:43.844623+0000","last_undegraded":"2024-09-18T01:25:43.844623+0000","last_fullsized":"2024-09-18T01:25:43.844623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:49:15.909145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'13","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906372+0000","last_change":"2024-09-18T01:25:12.688633+0000","last_active":"2024-09-18T01:25:43.906372+0000","last_peered":"2024-09-18T01:25:43.906372+0000","last_clean":"2024-09-18T01:25:43.906372+0000","last_became_active":"2024-09-18T01:25:12.688366+0000","last_became_peered":"2024-09-18T01:25:12.688366+0000","last_unstale":"2024-09-18T01:25:43.906372+0000","last_undegraded":"2024-09-18T01:25:43.906372+0000","last_fullsized":"2024-09-18T01:25:43.906372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:39:55.232921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905614+0000","last_change":"2024-09-18T01:25:14.703217+0000","last_active":"2024-09-18T01:25:43.905614+0000","last_peered":"2024-09-18T01:25:43.905614+0000","last_clean":"2024-09-18T01:25:43.905614+0000","last_became_active":"2024-09-18T01:25:14.702918+0000","last_became_peered":"2024-09-18T01:25:14.702918+0000","last_unstale":"2024-09-18T01:25:43.905614+0000","last_undegraded":"2024-09-18T01:25:43.905614+0000","last_fullsized":"2024-09-18T01:25:43.905614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:23.103965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.232357+0000","last_change":"2024-09-18T01:25:16.714035+0000","last_active":"2024-09-18T01:28:17.232357+0000","last_peered":"2024-09-18T01:28:17.232357+0000","last_clean":"2024-09-18T01:28:17.232357+0000","last_became_active":"2024-09-18T01:25:16.713571+0000","last_became_peered":"2024-09-18T01:25:16.713571+0000","last_unstale":"2024-09-18T01:28:17.232357+0000","last_undegraded":"2024-09-18T01:28:17.232357+0000","last_fullsized":"2024-09-18T01:28:17.232357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:32:22.558708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'8","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176653+0000","last_change":"2024-09-18T01:25:08.673278+0000","last_active":"2024-09-18T01:28:17.176653+0000","last_peered":"2024-09-18T01:28:17.176653+0000","last_clean":"2024-09-18T01:28:17.176653+0000","last_became_active":"2024-09-18T01:25:08.671904+0000","last_became_peered":"2024-09-18T01:25:08.671904+0000","last_unstale":"2024-09-18T01:28:17.176653+0000","last_undegraded":"2024-09-18T01:28:17.176653+0000","last_fullsized":"2024-09-18T01:28:17.176653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:58:59.174725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848365+0000","last_change":"2024-09-18T01:25:06.681491+0000","last_active":"2024-09-18T01:25:43.848365+0000","last_peered":"2024-09-18T01:25:43.848365+0000","last_clean":"2024-09-18T01:25:43.848365+0000","last_became_active":"2024-09-18T01:25:06.681065+0000","last_became_peered":"2024-09-18T01:25:06.681065+0000","last_unstale":"2024-09-18T01:25:43.848365+0000","last_undegraded":"2024-09-18T01:25:43.848365+0000","last_fullsized":"2024-09-18T01:25:43.848365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:46:18.563504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847654+0000","last_change":"2024-09-18T01:25:10.677498+0000","last_active":"2024-09-18T01:25:43.847654+0000","last_peered":"2024-09-18T01:25:43.847654+0000","last_clean":"2024-09-18T01:25:43.847654+0000","last_became_active":"2024-09-18T01:25:10.677118+0000","last_became_peered":"2024-09-18T01:25:10.677118+0000","last_unstale":"2024-09-18T01:25:43.847654+0000","last_undegraded":"2024-09-18T01:25:43.847654+0000","last_fullsized":"2024-09-18T01:25:43.847654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:13.973263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'22","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844252+0000","last_change":"2024-09-18T01:25:12.693775+0000","last_active":"2024-09-18T01:25:43.844252+0000","last_peered":"2024-09-18T01:25:43.844252+0000","last_clean":"2024-09-18T01:25:43.844252+0000","last_became_active":"2024-09-18T01:25:12.693426+0000","last_became_peered":"2024-09-18T01:25:12.693426+0000","last_unstale":"2024-09-18T01:25:43.844252+0000","last_undegraded":"2024-09-18T01:25:43.844252+0000","last_fullsized":"2024-09-18T01:25:43.844252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:03.617713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'282","reported_seq":381,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:15.763451+0000","last_change":"2024-09-18T01:25:14.707813+0000","last_active":"2024-09-18T01:28:15.763451+0000","last_peered":"2024-09-18T01:28:15.763451+0000","last_clean":"2024-09-18T01:28:15.763451+0000","last_became_active":"2024-09-18T01:25:14.707544+0000","last_became_peered":"2024-09-18T01:25:14.707544+0000","last_unstale":"2024-09-18T01:28:15.763451+0000","last_undegraded":"2024-09-18T01:28:15.763451+0000","last_fullsized":"2024-09-18T01:28:15.763451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:19.273177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843579+0000","last_change":"2024-09-18T01:25:16.714182+0000","last_active":"2024-09-18T01:25:43.843579+0000","last_peered":"2024-09-18T01:25:43.843579+0000","last_clean":"2024-09-18T01:25:43.843579+0000","last_became_active":"2024-09-18T01:25:16.713458+0000","last_became_peered":"2024-09-18T01:25:16.713458+0000","last_unstale":"2024-09-18T01:25:43.843579+0000","last_undegraded":"2024-09-18T01:25:43.843579+0000","last_fullsized":"2024-09-18T01:25:43.843579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:25.118447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847600+0000","last_change":"2024-09-18T01:25:08.681420+0000","last_active":"2024-09-18T01:25:43.847600+0000","last_peered":"2024-09-18T01:25:43.847600+0000","last_clean":"2024-09-18T01:25:43.847600+0000","last_became_active":"2024-09-18T01:25:08.680700+0000","last_became_peered":"2024-09-18T01:25:08.680700+0000","last_unstale":"2024-09-18T01:25:43.847600+0000","last_undegraded":"2024-09-18T01:25:43.847600+0000","last_fullsized":"2024-09-18T01:25:43.847600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:15:04.998223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.442367+0000","last_change":"2024-09-18T01:25:06.691595+0000","last_active":"2024-09-18T01:25:50.442367+0000","last_peered":"2024-09-18T01:25:50.442367+0000","last_clean":"2024-09-18T01:25:50.442367+0000","last_became_active":"2024-09-18T01:25:06.691107+0000","last_became_peered":"2024-09-18T01:25:06.691107+0000","last_unstale":"2024-09-18T01:25:50.442367+0000","last_undegraded":"2024-09-18T01:25:50.442367+0000","last_fullsized":"2024-09-18T01:25:50.442367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:50.530673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850726+0000","last_change":"2024-09-18T01:25:10.681604+0000","last_active":"2024-09-18T01:25:43.850726+0000","last_peered":"2024-09-18T01:25:43.850726+0000","last_clean":"2024-09-18T01:25:43.850726+0000","last_became_active":"2024-09-18T01:25:10.681273+0000","last_became_peered":"2024-09-18T01:25:10.681273+0000","last_unstale":"2024-09-18T01:25:43.850726+0000","last_undegraded":"2024-09-18T01:25:43.850726+0000","last_fullsized":"2024-09-18T01:25:43.850726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:22.269662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'39","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.058017+0000","last_change":"2024-09-18T01:25:12.697422+0000","last_active":"2024-09-18T01:27:15.058017+0000","last_peered":"2024-09-18T01:27:15.058017+0000","last_clean":"2024-09-18T01:27:15.058017+0000","last_became_active":"2024-09-18T01:25:12.697114+0000","last_became_peered":"2024-09-18T01:25:12.697114+0000","last_unstale":"2024-09-18T01:27:15.058017+0000","last_undegraded":"2024-09-18T01:27:15.058017+0000","last_fullsized":"2024-09-18T01:27:15.058017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:43:37.538211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":52,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'282","reported_seq":405,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.288775+0000","last_change":"2024-09-18T01:25:14.699167+0000","last_active":"2024-09-18T01:28:17.288775+0000","last_peered":"2024-09-18T01:28:17.288775+0000","last_clean":"2024-09-18T01:28:17.288775+0000","last_became_active":"2024-09-18T01:25:14.698792+0000","last_became_peered":"2024-09-18T01:25:14.698792+0000","last_unstale":"2024-09-18T01:28:17.288775+0000","last_undegraded":"2024-09-18T01:28:17.288775+0000","last_fullsized":"2024-09-18T01:28:17.288775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:49.524031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.147884+0000","last_change":"2024-09-18T01:25:08.680575+0000","last_active":"2024-09-18T01:28:17.147884+0000","last_peered":"2024-09-18T01:28:17.147884+0000","last_clean":"2024-09-18T01:28:17.147884+0000","last_became_active":"2024-09-18T01:25:08.680143+0000","last_became_peered":"2024-09-18T01:25:08.680143+0000","last_unstale":"2024-09-18T01:28:17.147884+0000","last_undegraded":"2024-09-18T01:28:17.147884+0000","last_fullsized":"2024-09-18T01:28:17.147884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:30:09.036921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845910+0000","last_change":"2024-09-18T01:25:06.701050+0000","last_active":"2024-09-18T01:25:43.845910+0000","last_peered":"2024-09-18T01:25:43.845910+0000","last_clean":"2024-09-18T01:25:43.845910+0000","last_became_active":"2024-09-18T01:25:06.700650+0000","last_became_peered":"2024-09-18T01:25:06.700650+0000","last_unstale":"2024-09-18T01:25:43.845910+0000","last_undegraded":"2024-09-18T01:25:43.845910+0000","last_fullsized":"2024-09-18T01:25:43.845910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:03.343944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904327+0000","last_change":"2024-09-18T01:25:10.683497+0000","last_active":"2024-09-18T01:25:43.904327+0000","last_peered":"2024-09-18T01:25:43.904327+0000","last_clean":"2024-09-18T01:25:43.904327+0000","last_became_active":"2024-09-18T01:25:10.683195+0000","last_became_peered":"2024-09-18T01:25:10.683195+0000","last_unstale":"2024-09-18T01:25:43.904327+0000","last_undegraded":"2024-09-18T01:25:43.904327+0000","last_fullsized":"2024-09-18T01:25:43.904327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:18:42.429992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'47","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.067406+0000","last_change":"2024-09-18T01:25:12.688936+0000","last_active":"2024-09-18T01:27:15.067406+0000","last_peered":"2024-09-18T01:27:15.067406+0000","last_clean":"2024-09-18T01:27:15.067406+0000","last_became_active":"2024-09-18T01:25:12.687943+0000","last_became_peered":"2024-09-18T01:25:12.687943+0000","last_unstale":"2024-09-18T01:27:15.067406+0000","last_undegraded":"2024-09-18T01:27:15.067406+0000","last_fullsized":"2024-09-18T01:27:15.067406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:18:44.438408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846245+0000","last_change":"2024-09-18T01:25:14.699129+0000","last_active":"2024-09-18T01:25:43.846245+0000","last_peered":"2024-09-18T01:25:43.846245+0000","last_clean":"2024-09-18T01:25:43.846245+0000","last_became_active":"2024-09-18T01:25:14.698795+0000","last_became_peered":"2024-09-18T01:25:14.698795+0000","last_unstale":"2024-09-18T01:25:43.846245+0000","last_undegraded":"2024-09-18T01:25:43.846245+0000","last_fullsized":"2024-09-18T01:25:43.846245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:48.579196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'3","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.759291+0000","last_change":"2024-09-18T01:25:16.707493+0000","last_active":"2024-09-18T01:26:32.759291+0000","last_peered":"2024-09-18T01:26:32.759291+0000","last_clean":"2024-09-18T01:26:32.759291+0000","last_became_active":"2024-09-18T01:25:16.707206+0000","last_became_peered":"2024-09-18T01:25:16.707206+0000","last_unstale":"2024-09-18T01:26:32.759291+0000","last_undegraded":"2024-09-18T01:26:32.759291+0000","last_fullsized":"2024-09-18T01:26:32.759291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:51.538514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.867670+0000","last_change":"2024-09-18T01:25:08.683170+0000","last_active":"2024-09-18T01:28:16.867670+0000","last_peered":"2024-09-18T01:28:16.867670+0000","last_clean":"2024-09-18T01:28:16.867670+0000","last_became_active":"2024-09-18T01:25:08.682878+0000","last_became_peered":"2024-09-18T01:25:08.682878+0000","last_unstale":"2024-09-18T01:28:16.867670+0000","last_undegraded":"2024-09-18T01:28:16.867670+0000","last_fullsized":"2024-09-18T01:28:16.867670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:29.205884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.170801+0000","last_change":"2024-09-18T01:25:06.700753+0000","last_active":"2024-09-18T01:28:17.170801+0000","last_peered":"2024-09-18T01:28:17.170801+0000","last_clean":"2024-09-18T01:28:17.170801+0000","last_became_active":"2024-09-18T01:25:06.700357+0000","last_became_peered":"2024-09-18T01:25:06.700357+0000","last_unstale":"2024-09-18T01:28:17.170801+0000","last_undegraded":"2024-09-18T01:28:17.170801+0000","last_fullsized":"2024-09-18T01:28:17.170801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:08.432830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":218,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.133643+0000","last_change":"2024-09-18T01:25:10.680004+0000","last_active":"2024-09-18T01:27:16.133643+0000","last_peered":"2024-09-18T01:27:16.133643+0000","last_clean":"2024-09-18T01:27:16.133643+0000","last_became_active":"2024-09-18T01:25:10.679652+0000","last_became_peered":"2024-09-18T01:25:10.679652+0000","last_unstale":"2024-09-18T01:27:16.133643+0000","last_undegraded":"2024-09-18T01:27:16.133643+0000","last_fullsized":"2024-09-18T01:27:16.133643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:02.192046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'36","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.047616+0000","last_change":"2024-09-18T01:25:12.691981+0000","last_active":"2024-09-18T01:27:15.047616+0000","last_peered":"2024-09-18T01:27:15.047616+0000","last_clean":"2024-09-18T01:27:15.047616+0000","last_became_active":"2024-09-18T01:25:12.691691+0000","last_became_peered":"2024-09-18T01:25:12.691691+0000","last_unstale":"2024-09-18T01:27:15.047616+0000","last_undegraded":"2024-09-18T01:27:15.047616+0000","last_fullsized":"2024-09-18T01:27:15.047616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:40:21.738974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844437+0000","last_change":"2024-09-18T01:25:14.706870+0000","last_active":"2024-09-18T01:25:43.844437+0000","last_peered":"2024-09-18T01:25:43.844437+0000","last_clean":"2024-09-18T01:25:43.844437+0000","last_became_active":"2024-09-18T01:25:14.706505+0000","last_became_peered":"2024-09-18T01:25:14.706505+0000","last_unstale":"2024-09-18T01:25:43.844437+0000","last_undegraded":"2024-09-18T01:25:43.844437+0000","last_fullsized":"2024-09-18T01:25:43.844437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:31:17.162597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'3","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:27.222234+0000","last_change":"2024-09-18T01:25:16.713810+0000","last_active":"2024-09-18T01:26:27.222234+0000","last_peered":"2024-09-18T01:26:27.222234+0000","last_clean":"2024-09-18T01:26:27.222234+0000","last_became_active":"2024-09-18T01:25:16.713453+0000","last_became_peered":"2024-09-18T01:25:16.713453+0000","last_unstale":"2024-09-18T01:26:27.222234+0000","last_undegraded":"2024-09-18T01:26:27.222234+0000","last_fullsized":"2024-09-18T01:26:27.222234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:37.223946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'5","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.796758+0000","last_change":"2024-09-18T01:25:08.674795+0000","last_active":"2024-09-18T01:27:19.796758+0000","last_peered":"2024-09-18T01:27:19.796758+0000","last_clean":"2024-09-18T01:27:19.796758+0000","last_became_active":"2024-09-18T01:25:08.674525+0000","last_became_peered":"2024-09-18T01:25:08.674525+0000","last_unstale":"2024-09-18T01:27:19.796758+0000","last_undegraded":"2024-09-18T01:27:19.796758+0000","last_fullsized":"2024-09-18T01:27:19.796758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:55:50.100041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.083065+0000","last_change":"2024-09-18T01:25:06.696117+0000","last_active":"2024-09-18T01:28:17.083065+0000","last_peered":"2024-09-18T01:28:17.083065+0000","last_clean":"2024-09-18T01:28:17.083065+0000","last_became_active":"2024-09-18T01:25:06.694058+0000","last_became_peered":"2024-09-18T01:25:06.694058+0000","last_unstale":"2024-09-18T01:28:17.083065+0000","last_undegraded":"2024-09-18T01:28:17.083065+0000","last_fullsized":"2024-09-18T01:28:17.083065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:58:41.570989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:44.783777+0000","last_change":"2024-09-18T01:25:43.903991+0000","last_active":"2024-09-18T01:25:44.783777+0000","last_peered":"2024-09-18T01:25:44.783777+0000","last_clean":"2024-09-18T01:25:44.783777+0000","last_became_active":"2024-09-18T01:25:43.903638+0000","last_became_peered":"2024-09-18T01:25:43.903638+0000","last_unstale":"2024-09-18T01:25:44.783777+0000","last_undegraded":"2024-09-18T01:25:44.783777+0000","last_fullsized":"2024-09-18T01:25:44.783777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:53:19.003232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'48","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.069310+0000","last_change":"2024-09-18T01:25:12.694029+0000","last_active":"2024-09-18T01:27:15.069310+0000","last_peered":"2024-09-18T01:27:15.069310+0000","last_clean":"2024-09-18T01:27:15.069310+0000","last_became_active":"2024-09-18T01:25:12.693182+0000","last_became_peered":"2024-09-18T01:25:12.693182+0000","last_unstale":"2024-09-18T01:27:15.069310+0000","last_undegraded":"2024-09-18T01:27:15.069310+0000","last_fullsized":"2024-09-18T01:27:15.069310+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:08:39.434682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'282","reported_seq":348,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.298524+0000","last_change":"2024-09-18T01:25:14.706933+0000","last_active":"2024-09-18T01:28:17.298524+0000","last_peered":"2024-09-18T01:28:17.298524+0000","last_clean":"2024-09-18T01:28:17.298524+0000","last_became_active":"2024-09-18T01:25:14.706540+0000","last_became_peered":"2024-09-18T01:25:14.706540+0000","last_unstale":"2024-09-18T01:28:17.298524+0000","last_undegraded":"2024-09-18T01:28:17.298524+0000","last_fullsized":"2024-09-18T01:28:17.298524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:27.416743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.391512+0000","last_change":"2024-09-18T01:25:16.714648+0000","last_active":"2024-09-18T01:27:13.391512+0000","last_peered":"2024-09-18T01:27:13.391512+0000","last_clean":"2024-09-18T01:27:13.391512+0000","last_became_active":"2024-09-18T01:25:16.714363+0000","last_became_peered":"2024-09-18T01:25:16.714363+0000","last_unstale":"2024-09-18T01:27:13.391512+0000","last_undegraded":"2024-09-18T01:27:13.391512+0000","last_fullsized":"2024-09-18T01:27:13.391512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:59:11.881576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.866295+0000","last_change":"2024-09-18T01:25:08.670862+0000","last_active":"2024-09-18T01:28:16.866295+0000","last_peered":"2024-09-18T01:28:16.866295+0000","last_clean":"2024-09-18T01:28:16.866295+0000","last_became_active":"2024-09-18T01:25:08.670617+0000","last_became_peered":"2024-09-18T01:25:08.670617+0000","last_unstale":"2024-09-18T01:28:16.866295+0000","last_undegraded":"2024-09-18T01:28:16.866295+0000","last_fullsized":"2024-09-18T01:28:16.866295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:29.205884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849958+0000","last_change":"2024-09-18T01:25:06.693637+0000","last_active":"2024-09-18T01:25:43.849958+0000","last_peered":"2024-09-18T01:25:43.849958+0000","last_clean":"2024-09-18T01:25:43.849958+0000","last_became_active":"2024-09-18T01:25:06.689545+0000","last_became_peered":"2024-09-18T01:25:06.689545+0000","last_unstale":"2024-09-18T01:25:43.849958+0000","last_undegraded":"2024-09-18T01:25:43.849958+0000","last_fullsized":"2024-09-18T01:25:43.849958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:57.969892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:44.783756+0000","last_change":"2024-09-18T01:25:43.907490+0000","last_active":"2024-09-18T01:25:44.783756+0000","last_peered":"2024-09-18T01:25:44.783756+0000","last_clean":"2024-09-18T01:25:44.783756+0000","last_became_active":"2024-09-18T01:25:43.907094+0000","last_became_peered":"2024-09-18T01:25:43.907094+0000","last_unstale":"2024-09-18T01:25:44.783756+0000","last_undegraded":"2024-09-18T01:25:44.783756+0000","last_fullsized":"2024-09-18T01:25:44.783756+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:26:05.185230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'67","reported_seq":135,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798143+0000","last_change":"2024-09-18T01:25:12.693226+0000","last_active":"2024-09-18T01:27:24.798143+0000","last_peered":"2024-09-18T01:27:24.798143+0000","last_clean":"2024-09-18T01:27:24.798143+0000","last_became_active":"2024-09-18T01:25:12.692821+0000","last_became_peered":"2024-09-18T01:25:12.692821+0000","last_unstale":"2024-09-18T01:27:24.798143+0000","last_undegraded":"2024-09-18T01:27:24.798143+0000","last_fullsized":"2024-09-18T01:27:24.798143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:15.391395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5917,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":32,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843893+0000","last_change":"2024-09-18T01:25:14.707691+0000","last_active":"2024-09-18T01:25:43.843893+0000","last_peered":"2024-09-18T01:25:43.843893+0000","last_clean":"2024-09-18T01:25:43.843893+0000","last_became_active":"2024-09-18T01:25:14.707514+0000","last_became_peered":"2024-09-18T01:25:14.707514+0000","last_unstale":"2024-09-18T01:25:43.843893+0000","last_undegraded":"2024-09-18T01:25:43.843893+0000","last_fullsized":"2024-09-18T01:25:43.843893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:57.575198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.271704+0000","last_change":"2024-09-18T01:25:16.706301+0000","last_active":"2024-09-18T01:28:17.271704+0000","last_peered":"2024-09-18T01:28:17.271704+0000","last_clean":"2024-09-18T01:28:17.271704+0000","last_became_active":"2024-09-18T01:25:16.705938+0000","last_became_peered":"2024-09-18T01:25:16.705938+0000","last_unstale":"2024-09-18T01:28:17.271704+0000","last_undegraded":"2024-09-18T01:28:17.271704+0000","last_fullsized":"2024-09-18T01:28:17.271704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:48:53.777539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176669+0000","last_change":"2024-09-18T01:25:08.687495+0000","last_active":"2024-09-18T01:28:17.176669+0000","last_peered":"2024-09-18T01:28:17.176669+0000","last_clean":"2024-09-18T01:28:17.176669+0000","last_became_active":"2024-09-18T01:25:08.687135+0000","last_became_peered":"2024-09-18T01:25:08.687135+0000","last_unstale":"2024-09-18T01:28:17.176669+0000","last_undegraded":"2024-09-18T01:28:17.176669+0000","last_fullsized":"2024-09-18T01:28:17.176669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:15.493296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845740+0000","last_change":"2024-09-18T01:25:06.681219+0000","last_active":"2024-09-18T01:25:43.845740+0000","last_peered":"2024-09-18T01:25:43.845740+0000","last_clean":"2024-09-18T01:25:43.845740+0000","last_became_active":"2024-09-18T01:25:06.680774+0000","last_became_peered":"2024-09-18T01:25:06.680774+0000","last_unstale":"2024-09-18T01:25:43.845740+0000","last_undegraded":"2024-09-18T01:25:43.845740+0000","last_fullsized":"2024-09-18T01:25:43.845740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:33:48.652888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845831+0000","last_change":"2024-09-18T01:25:10.675268+0000","last_active":"2024-09-18T01:25:43.845831+0000","last_peered":"2024-09-18T01:25:43.845831+0000","last_clean":"2024-09-18T01:25:43.845831+0000","last_became_active":"2024-09-18T01:25:10.674983+0000","last_became_peered":"2024-09-18T01:25:10.674983+0000","last_unstale":"2024-09-18T01:25:43.845831+0000","last_undegraded":"2024-09-18T01:25:43.845831+0000","last_fullsized":"2024-09-18T01:25:43.845831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:25:15.816622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'38","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.051893+0000","last_change":"2024-09-18T01:25:12.683645+0000","last_active":"2024-09-18T01:27:15.051893+0000","last_peered":"2024-09-18T01:27:15.051893+0000","last_clean":"2024-09-18T01:27:15.051893+0000","last_became_active":"2024-09-18T01:25:12.683339+0000","last_became_peered":"2024-09-18T01:25:12.683339+0000","last_unstale":"2024-09-18T01:27:15.051893+0000","last_undegraded":"2024-09-18T01:27:15.051893+0000","last_fullsized":"2024-09-18T01:27:15.051893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:55:20.974738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851387+0000","last_change":"2024-09-18T01:25:14.708366+0000","last_active":"2024-09-18T01:25:43.851387+0000","last_peered":"2024-09-18T01:25:43.851387+0000","last_clean":"2024-09-18T01:25:43.851387+0000","last_became_active":"2024-09-18T01:25:14.707116+0000","last_became_peered":"2024-09-18T01:25:14.707116+0000","last_unstale":"2024-09-18T01:25:43.851387+0000","last_undegraded":"2024-09-18T01:25:43.851387+0000","last_fullsized":"2024-09-18T01:25:43.851387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:38.584056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797258+0000","last_change":"2024-09-18T01:25:16.708368+0000","last_active":"2024-09-18T01:27:19.797258+0000","last_peered":"2024-09-18T01:27:19.797258+0000","last_clean":"2024-09-18T01:27:19.797258+0000","last_became_active":"2024-09-18T01:25:16.708095+0000","last_became_peered":"2024-09-18T01:25:16.708095+0000","last_unstale":"2024-09-18T01:27:19.797258+0000","last_undegraded":"2024-09-18T01:27:19.797258+0000","last_fullsized":"2024-09-18T01:27:19.797258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:48.121756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.752010+0000","last_change":"2024-09-18T01:25:08.688693+0000","last_active":"2024-09-18T01:26:32.752010+0000","last_peered":"2024-09-18T01:26:32.752010+0000","last_clean":"2024-09-18T01:26:32.752010+0000","last_became_active":"2024-09-18T01:25:08.688251+0000","last_became_peered":"2024-09-18T01:25:08.688251+0000","last_unstale":"2024-09-18T01:26:32.752010+0000","last_undegraded":"2024-09-18T01:26:32.752010+0000","last_fullsized":"2024-09-18T01:26:32.752010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:56.803513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797428+0000","last_change":"2024-09-18T01:25:06.684669+0000","last_active":"2024-09-18T01:27:19.797428+0000","last_peered":"2024-09-18T01:27:19.797428+0000","last_clean":"2024-09-18T01:27:19.797428+0000","last_became_active":"2024-09-18T01:25:06.683437+0000","last_became_peered":"2024-09-18T01:25:06.683437+0000","last_unstale":"2024-09-18T01:27:19.797428+0000","last_undegraded":"2024-09-18T01:27:19.797428+0000","last_fullsized":"2024-09-18T01:27:19.797428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:23.462064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844681+0000","last_change":"2024-09-18T01:25:10.680258+0000","last_active":"2024-09-18T01:25:43.844681+0000","last_peered":"2024-09-18T01:25:43.844681+0000","last_clean":"2024-09-18T01:25:43.844681+0000","last_became_active":"2024-09-18T01:25:10.679740+0000","last_became_peered":"2024-09-18T01:25:10.679740+0000","last_unstale":"2024-09-18T01:25:43.844681+0000","last_undegraded":"2024-09-18T01:25:43.844681+0000","last_fullsized":"2024-09-18T01:25:43.844681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:40.355268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'36","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.077766+0000","last_change":"2024-09-18T01:25:12.687798+0000","last_active":"2024-09-18T01:27:15.077766+0000","last_peered":"2024-09-18T01:27:15.077766+0000","last_clean":"2024-09-18T01:27:15.077766+0000","last_became_active":"2024-09-18T01:25:12.686455+0000","last_became_peered":"2024-09-18T01:25:12.686455+0000","last_unstale":"2024-09-18T01:27:15.077766+0000","last_undegraded":"2024-09-18T01:27:15.077766+0000","last_fullsized":"2024-09-18T01:27:15.077766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:43.085499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'282","reported_seq":403,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.275706+0000","last_change":"2024-09-18T01:25:14.704198+0000","last_active":"2024-09-18T01:28:17.275706+0000","last_peered":"2024-09-18T01:28:17.275706+0000","last_clean":"2024-09-18T01:28:17.275706+0000","last_became_active":"2024-09-18T01:25:14.703877+0000","last_became_peered":"2024-09-18T01:25:14.703877+0000","last_unstale":"2024-09-18T01:28:17.275706+0000","last_undegraded":"2024-09-18T01:28:17.275706+0000","last_fullsized":"2024-09-18T01:28:17.275706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:39:57.240022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'12","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:22.797572+0000","last_change":"2024-09-18T01:25:16.714095+0000","last_active":"2024-09-18T01:27:22.797572+0000","last_peered":"2024-09-18T01:27:22.797572+0000","last_clean":"2024-09-18T01:27:22.797572+0000","last_became_active":"2024-09-18T01:25:16.713677+0000","last_became_peered":"2024-09-18T01:25:16.713677+0000","last_unstale":"2024-09-18T01:27:22.797572+0000","last_undegraded":"2024-09-18T01:27:22.797572+0000","last_fullsized":"2024-09-18T01:27:22.797572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:37.223946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954552+0000","last_change":"2024-09-18T01:25:08.673535+0000","last_active":"2024-09-18T01:28:16.954552+0000","last_peered":"2024-09-18T01:28:16.954552+0000","last_clean":"2024-09-18T01:28:16.954552+0000","last_became_active":"2024-09-18T01:25:08.673276+0000","last_became_peered":"2024-09-18T01:25:08.673276+0000","last_unstale":"2024-09-18T01:28:16.954552+0000","last_undegraded":"2024-09-18T01:28:16.954552+0000","last_fullsized":"2024-09-18T01:28:16.954552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:58.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.463022+0000","last_change":"2024-09-18T01:25:06.683319+0000","last_active":"2024-09-18T01:27:16.463022+0000","last_peered":"2024-09-18T01:27:16.463022+0000","last_clean":"2024-09-18T01:27:16.463022+0000","last_became_active":"2024-09-18T01:25:06.682841+0000","last_became_peered":"2024-09-18T01:25:06.682841+0000","last_unstale":"2024-09-18T01:27:16.463022+0000","last_undegraded":"2024-09-18T01:27:16.463022+0000","last_fullsized":"2024-09-18T01:27:16.463022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:52:44.524173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":413,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.133229+0000","last_change":"2024-09-18T01:25:10.680374+0000","last_active":"2024-09-18T01:27:16.133229+0000","last_peered":"2024-09-18T01:27:16.133229+0000","last_clean":"2024-09-18T01:27:16.133229+0000","last_became_active":"2024-09-18T01:25:10.679483+0000","last_became_peered":"2024-09-18T01:25:10.679483+0000","last_unstale":"2024-09-18T01:27:16.133229+0000","last_undegraded":"2024-09-18T01:27:16.133229+0000","last_fullsized":"2024-09-18T01:27:16.133229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:41.077084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851675+0000","last_change":"2024-09-18T01:25:12.697050+0000","last_active":"2024-09-18T01:25:43.851675+0000","last_peered":"2024-09-18T01:25:43.851675+0000","last_clean":"2024-09-18T01:25:43.851675+0000","last_became_active":"2024-09-18T01:25:12.696726+0000","last_became_peered":"2024-09-18T01:25:12.696726+0000","last_unstale":"2024-09-18T01:25:43.851675+0000","last_undegraded":"2024-09-18T01:25:43.851675+0000","last_fullsized":"2024-09-18T01:25:43.851675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:25.931338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'282","reported_seq":510,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.234675+0000","last_change":"2024-09-18T01:25:14.705212+0000","last_active":"2024-09-18T01:28:17.234675+0000","last_peered":"2024-09-18T01:28:17.234675+0000","last_clean":"2024-09-18T01:28:17.234675+0000","last_became_active":"2024-09-18T01:25:14.702900+0000","last_became_peered":"2024-09-18T01:25:14.702900+0000","last_unstale":"2024-09-18T01:28:17.234675+0000","last_undegraded":"2024-09-18T01:28:17.234675+0000","last_fullsized":"2024-09-18T01:28:17.234675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:44.393089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.267015+0000","last_change":"2024-09-18T01:25:16.712364+0000","last_active":"2024-09-18T01:27:16.267015+0000","last_peered":"2024-09-18T01:27:16.267015+0000","last_clean":"2024-09-18T01:27:16.267015+0000","last_became_active":"2024-09-18T01:25:16.712084+0000","last_became_peered":"2024-09-18T01:25:16.712084+0000","last_unstale":"2024-09-18T01:27:16.267015+0000","last_undegraded":"2024-09-18T01:27:16.267015+0000","last_fullsized":"2024-09-18T01:27:16.267015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:46.407572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'8","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.144995+0000","last_change":"2024-09-18T01:25:08.687109+0000","last_active":"2024-09-18T01:28:17.144995+0000","last_peered":"2024-09-18T01:28:17.144995+0000","last_clean":"2024-09-18T01:28:17.144995+0000","last_became_active":"2024-09-18T01:25:08.686802+0000","last_became_peered":"2024-09-18T01:25:08.686802+0000","last_unstale":"2024-09-18T01:28:17.144995+0000","last_undegraded":"2024-09-18T01:28:17.144995+0000","last_fullsized":"2024-09-18T01:28:17.144995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:13.745242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.080072+0000","last_change":"2024-09-18T01:25:06.695782+0000","last_active":"2024-09-18T01:28:17.080072+0000","last_peered":"2024-09-18T01:28:17.080072+0000","last_clean":"2024-09-18T01:28:17.080072+0000","last_became_active":"2024-09-18T01:25:06.691644+0000","last_became_peered":"2024-09-18T01:25:06.691644+0000","last_unstale":"2024-09-18T01:28:17.080072+0000","last_undegraded":"2024-09-18T01:28:17.080072+0000","last_fullsized":"2024-09-18T01:28:17.080072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:51:10.947372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851329+0000","last_change":"2024-09-18T01:25:10.682385+0000","last_active":"2024-09-18T01:25:43.851329+0000","last_peered":"2024-09-18T01:25:43.851329+0000","last_clean":"2024-09-18T01:25:43.851329+0000","last_became_active":"2024-09-18T01:25:10.682075+0000","last_became_peered":"2024-09-18T01:25:10.682075+0000","last_unstale":"2024-09-18T01:25:43.851329+0000","last_undegraded":"2024-09-18T01:25:43.851329+0000","last_fullsized":"2024-09-18T01:25:43.851329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:28.482490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'39","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.064387+0000","last_change":"2024-09-18T01:25:12.686750+0000","last_active":"2024-09-18T01:27:15.064387+0000","last_peered":"2024-09-18T01:27:15.064387+0000","last_clean":"2024-09-18T01:27:15.064387+0000","last_became_active":"2024-09-18T01:25:12.686460+0000","last_became_peered":"2024-09-18T01:25:12.686460+0000","last_unstale":"2024-09-18T01:27:15.064387+0000","last_undegraded":"2024-09-18T01:27:15.064387+0000","last_fullsized":"2024-09-18T01:27:15.064387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:56.008777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843863+0000","last_change":"2024-09-18T01:25:14.706837+0000","last_active":"2024-09-18T01:25:43.843863+0000","last_peered":"2024-09-18T01:25:43.843863+0000","last_clean":"2024-09-18T01:25:43.843863+0000","last_became_active":"2024-09-18T01:25:14.706506+0000","last_became_peered":"2024-09-18T01:25:14.706506+0000","last_unstale":"2024-09-18T01:25:43.843863+0000","last_undegraded":"2024-09-18T01:25:43.843863+0000","last_fullsized":"2024-09-18T01:25:43.843863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:31:25.019479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.209468+0000","last_change":"2024-09-18T01:25:16.709338+0000","last_active":"2024-09-18T01:28:17.209468+0000","last_peered":"2024-09-18T01:28:17.209468+0000","last_clean":"2024-09-18T01:28:17.209468+0000","last_became_active":"2024-09-18T01:25:16.709084+0000","last_became_peered":"2024-09-18T01:25:16.709084+0000","last_unstale":"2024-09-18T01:28:17.209468+0000","last_undegraded":"2024-09-18T01:28:17.209468+0000","last_fullsized":"2024-09-18T01:28:17.209468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:26:11.215230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'7","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183392+0000","last_change":"2024-09-18T01:25:08.688515+0000","last_active":"2024-09-18T01:28:17.183392+0000","last_peered":"2024-09-18T01:28:17.183392+0000","last_clean":"2024-09-18T01:28:17.183392+0000","last_became_active":"2024-09-18T01:25:08.687896+0000","last_became_peered":"2024-09-18T01:25:08.687896+0000","last_unstale":"2024-09-18T01:28:17.183392+0000","last_undegraded":"2024-09-18T01:28:17.183392+0000","last_fullsized":"2024-09-18T01:28:17.183392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:47:23.724986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":204,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903661+0000","last_change":"2024-09-18T01:24:52.297138+0000","last_active":"2024-09-18T01:25:43.903661+0000","last_peered":"2024-09-18T01:25:43.903661+0000","last_clean":"2024-09-18T01:25:43.903661+0000","last_became_active":"2024-09-18T01:24:52.296214+0000","last_became_peered":"2024-09-18T01:24:52.296214+0000","last_unstale":"2024-09-18T01:25:43.903661+0000","last_undegraded":"2024-09-18T01:25:43.903661+0000","last_fullsized":"2024-09-18T01:25:43.903661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_clean_scrub_stamp":"2024-09-18T01:24:51.161687+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:36:16.487345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850355+0000","last_change":"2024-09-18T01:24:58.197569+0000","last_active":"2024-09-18T01:25:43.850355+0000","last_peered":"2024-09-18T01:25:43.850355+0000","last_clean":"2024-09-18T01:25:43.850355+0000","last_became_active":"2024-09-18T01:24:56.194443+0000","last_became_peered":"2024-09-18T01:24:56.194443+0000","last_unstale":"2024-09-18T01:25:43.850355+0000","last_undegraded":"2024-09-18T01:25:43.850355+0000","last_fullsized":"2024-09-18T01:25:43.850355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:43:12.854702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033763700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.850186+0000","last_change":"2024-09-18T01:25:06.684714+0000","last_active":"2024-09-18T01:28:16.850186+0000","last_peered":"2024-09-18T01:28:16.850186+0000","last_clean":"2024-09-18T01:28:16.850186+0000","last_became_active":"2024-09-18T01:25:06.683975+0000","last_became_peered":"2024-09-18T01:25:06.683975+0000","last_unstale":"2024-09-18T01:28:16.850186+0000","last_undegraded":"2024-09-18T01:28:16.850186+0000","last_fullsized":"2024-09-18T01:28:16.850186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:47.187628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904635+0000","last_change":"2024-09-18T01:25:10.679847+0000","last_active":"2024-09-18T01:25:43.904635+0000","last_peered":"2024-09-18T01:25:43.904635+0000","last_clean":"2024-09-18T01:25:43.904635+0000","last_became_active":"2024-09-18T01:25:10.679572+0000","last_became_peered":"2024-09-18T01:25:10.679572+0000","last_unstale":"2024-09-18T01:25:43.904635+0000","last_undegraded":"2024-09-18T01:25:43.904635+0000","last_fullsized":"2024-09-18T01:25:43.904635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:53:26.506877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'82","reported_seq":157,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.075538+0000","last_change":"2024-09-18T01:25:12.692243+0000","last_active":"2024-09-18T01:27:15.075538+0000","last_peered":"2024-09-18T01:27:15.075538+0000","last_clean":"2024-09-18T01:27:15.075538+0000","last_became_active":"2024-09-18T01:25:12.691952+0000","last_became_peered":"2024-09-18T01:25:12.691952+0000","last_unstale":"2024-09-18T01:27:15.075538+0000","last_undegraded":"2024-09-18T01:27:15.075538+0000","last_fullsized":"2024-09-18T01:27:15.075538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:38.540516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845488+0000","last_change":"2024-09-18T01:25:14.707170+0000","last_active":"2024-09-18T01:25:43.845488+0000","last_peered":"2024-09-18T01:25:43.845488+0000","last_clean":"2024-09-18T01:25:43.845488+0000","last_became_active":"2024-09-18T01:25:14.706519+0000","last_became_peered":"2024-09-18T01:25:14.706519+0000","last_unstale":"2024-09-18T01:25:43.845488+0000","last_undegraded":"2024-09-18T01:25:43.845488+0000","last_fullsized":"2024-09-18T01:25:43.845488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:53.286034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'85","reported_seq":168,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.185765+0000","last_change":"2024-09-18T01:25:16.712377+0000","last_active":"2024-09-18T01:28:17.185765+0000","last_peered":"2024-09-18T01:28:17.185765+0000","last_clean":"2024-09-18T01:28:17.185765+0000","last_became_active":"2024-09-18T01:25:16.712102+0000","last_became_peered":"2024-09-18T01:25:16.712102+0000","last_unstale":"2024-09-18T01:28:17.185765+0000","last_undegraded":"2024-09-18T01:28:17.185765+0000","last_fullsized":"2024-09-18T01:28:17.185765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:59.589681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":221,"num_write":168,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'7","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797548+0000","last_change":"2024-09-18T01:25:08.672900+0000","last_active":"2024-09-18T01:27:19.797548+0000","last_peered":"2024-09-18T01:27:19.797548+0000","last_clean":"2024-09-18T01:27:19.797548+0000","last_became_active":"2024-09-18T01:25:08.671578+0000","last_became_peered":"2024-09-18T01:25:08.671578+0000","last_unstale":"2024-09-18T01:27:19.797548+0000","last_undegraded":"2024-09-18T01:27:19.797548+0000","last_fullsized":"2024-09-18T01:27:19.797548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:01:40.367586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847748+0000","last_change":"2024-09-18T01:24:58.197615+0000","last_active":"2024-09-18T01:25:43.847748+0000","last_peered":"2024-09-18T01:25:43.847748+0000","last_clean":"2024-09-18T01:25:43.847748+0000","last_became_active":"2024-09-18T01:24:56.191554+0000","last_became_peered":"2024-09-18T01:24:56.191554+0000","last_unstale":"2024-09-18T01:25:43.847748+0000","last_undegraded":"2024-09-18T01:25:43.847748+0000","last_fullsized":"2024-09-18T01:25:43.847748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:55.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041584599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843970+0000","last_change":"2024-09-18T01:25:06.681216+0000","last_active":"2024-09-18T01:25:43.843970+0000","last_peered":"2024-09-18T01:25:43.843970+0000","last_clean":"2024-09-18T01:25:43.843970+0000","last_became_active":"2024-09-18T01:25:06.680635+0000","last_became_peered":"2024-09-18T01:25:06.680635+0000","last_unstale":"2024-09-18T01:25:43.843970+0000","last_undegraded":"2024-09-18T01:25:43.843970+0000","last_fullsized":"2024-09-18T01:25:43.843970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:43.801545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851531+0000","last_change":"2024-09-18T01:25:10.682266+0000","last_active":"2024-09-18T01:25:43.851531+0000","last_peered":"2024-09-18T01:25:43.851531+0000","last_clean":"2024-09-18T01:25:43.851531+0000","last_became_active":"2024-09-18T01:25:10.681988+0000","last_became_peered":"2024-09-18T01:25:10.681988+0000","last_unstale":"2024-09-18T01:25:43.851531+0000","last_undegraded":"2024-09-18T01:25:43.851531+0000","last_fullsized":"2024-09-18T01:25:43.851531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:53:03.896010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'279","reported_seq":488,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:15.763669+0000","last_change":"2024-09-18T01:25:12.694263+0000","last_active":"2024-09-18T01:28:15.763669+0000","last_peered":"2024-09-18T01:28:15.763669+0000","last_clean":"2024-09-18T01:28:15.763669+0000","last_became_active":"2024-09-18T01:25:12.693664+0000","last_became_peered":"2024-09-18T01:25:12.693664+0000","last_unstale":"2024-09-18T01:28:15.763669+0000","last_undegraded":"2024-09-18T01:28:15.763669+0000","last_fullsized":"2024-09-18T01:28:15.763669+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:31:23.012378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850081+0000","last_change":"2024-09-18T01:25:14.707563+0000","last_active":"2024-09-18T01:25:43.850081+0000","last_peered":"2024-09-18T01:25:43.850081+0000","last_clean":"2024-09-18T01:25:43.850081+0000","last_became_active":"2024-09-18T01:25:14.707143+0000","last_became_peered":"2024-09-18T01:25:14.707143+0000","last_unstale":"2024-09-18T01:25:43.850081+0000","last_undegraded":"2024-09-18T01:25:43.850081+0000","last_fullsized":"2024-09-18T01:25:43.850081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:07.461296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.886187+0000","last_change":"2024-09-18T01:25:16.714554+0000","last_active":"2024-09-18T01:28:16.886187+0000","last_peered":"2024-09-18T01:28:16.886187+0000","last_clean":"2024-09-18T01:28:16.886187+0000","last_became_active":"2024-09-18T01:25:16.712931+0000","last_became_peered":"2024-09-18T01:25:16.712931+0000","last_unstale":"2024-09-18T01:28:16.886187+0000","last_undegraded":"2024-09-18T01:28:16.886187+0000","last_fullsized":"2024-09-18T01:28:16.886187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:20:06.027889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954356+0000","last_change":"2024-09-18T01:25:08.681154+0000","last_active":"2024-09-18T01:28:16.954356+0000","last_peered":"2024-09-18T01:28:16.954356+0000","last_clean":"2024-09-18T01:28:16.954356+0000","last_became_active":"2024-09-18T01:25:08.680541+0000","last_became_peered":"2024-09-18T01:25:08.680541+0000","last_unstale":"2024-09-18T01:28:16.954356+0000","last_undegraded":"2024-09-18T01:28:16.954356+0000","last_fullsized":"2024-09-18T01:28:16.954356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:15.493296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843251+0000","last_change":"2024-09-18T01:24:58.350485+0000","last_active":"2024-09-18T01:25:43.843251+0000","last_peered":"2024-09-18T01:25:43.843251+0000","last_clean":"2024-09-18T01:25:43.843251+0000","last_became_active":"2024-09-18T01:24:56.191162+0000","last_became_peered":"2024-09-18T01:24:56.191162+0000","last_unstale":"2024-09-18T01:25:43.843251+0000","last_undegraded":"2024-09-18T01:25:43.843251+0000","last_fullsized":"2024-09-18T01:25:43.843251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:38:00.033247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040921399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:07.795274+0000","last_change":"2024-09-18T01:25:06.686498+0000","last_active":"2024-09-18T01:27:07.795274+0000","last_peered":"2024-09-18T01:27:07.795274+0000","last_clean":"2024-09-18T01:27:07.795274+0000","last_became_active":"2024-09-18T01:25:06.686053+0000","last_became_peered":"2024-09-18T01:25:06.686053+0000","last_unstale":"2024-09-18T01:27:07.795274+0000","last_undegraded":"2024-09-18T01:27:07.795274+0000","last_fullsized":"2024-09-18T01:27:07.795274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:22.518297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845792+0000","last_change":"2024-09-18T01:25:10.677853+0000","last_active":"2024-09-18T01:25:43.845792+0000","last_peered":"2024-09-18T01:25:43.845792+0000","last_clean":"2024-09-18T01:25:43.845792+0000","last_became_active":"2024-09-18T01:25:10.677597+0000","last_became_peered":"2024-09-18T01:25:10.677597+0000","last_unstale":"2024-09-18T01:25:43.845792+0000","last_undegraded":"2024-09-18T01:25:43.845792+0000","last_fullsized":"2024-09-18T01:25:43.845792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:29.066415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:15.763577+0000","last_change":"2024-09-18T01:25:12.688147+0000","last_active":"2024-09-18T01:28:15.763577+0000","last_peered":"2024-09-18T01:28:15.763577+0000","last_clean":"2024-09-18T01:28:15.763577+0000","last_became_active":"2024-09-18T01:25:12.687799+0000","last_became_peered":"2024-09-18T01:25:12.687799+0000","last_unstale":"2024-09-18T01:28:15.763577+0000","last_undegraded":"2024-09-18T01:28:15.763577+0000","last_fullsized":"2024-09-18T01:28:15.763577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:03:37.628556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845029+0000","last_change":"2024-09-18T01:25:14.706976+0000","last_active":"2024-09-18T01:25:43.845029+0000","last_peered":"2024-09-18T01:25:43.845029+0000","last_clean":"2024-09-18T01:25:43.845029+0000","last_became_active":"2024-09-18T01:25:14.706611+0000","last_became_peered":"2024-09-18T01:25:14.706611+0000","last_unstale":"2024-09-18T01:25:43.845029+0000","last_undegraded":"2024-09-18T01:25:43.845029+0000","last_fullsized":"2024-09-18T01:25:43.845029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:15.483666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849369+0000","last_change":"2024-09-18T01:25:16.711670+0000","last_active":"2024-09-18T01:25:43.849369+0000","last_peered":"2024-09-18T01:25:43.849369+0000","last_clean":"2024-09-18T01:25:43.849369+0000","last_became_active":"2024-09-18T01:25:16.711404+0000","last_became_peered":"2024-09-18T01:25:16.711404+0000","last_unstale":"2024-09-18T01:25:43.849369+0000","last_undegraded":"2024-09-18T01:25:43.849369+0000","last_fullsized":"2024-09-18T01:25:43.849369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:12:32.036544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097075+0000","last_change":"2024-09-18T01:25:08.673345+0000","last_active":"2024-09-18T01:28:17.097075+0000","last_peered":"2024-09-18T01:28:17.097075+0000","last_clean":"2024-09-18T01:28:17.097075+0000","last_became_active":"2024-09-18T01:25:08.672969+0000","last_became_peered":"2024-09-18T01:25:08.672969+0000","last_unstale":"2024-09-18T01:28:17.097075+0000","last_undegraded":"2024-09-18T01:28:17.097075+0000","last_fullsized":"2024-09-18T01:28:17.097075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:37.287772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849309+0000","last_change":"2024-09-18T01:24:58.198236+0000","last_active":"2024-09-18T01:25:43.849309+0000","last_peered":"2024-09-18T01:25:43.849309+0000","last_clean":"2024-09-18T01:25:43.849309+0000","last_became_active":"2024-09-18T01:24:56.191713+0000","last_became_peered":"2024-09-18T01:24:56.191713+0000","last_unstale":"2024-09-18T01:25:43.849309+0000","last_undegraded":"2024-09-18T01:25:43.849309+0000","last_fullsized":"2024-09-18T01:25:43.849309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:55:46.520977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010043490000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844211+0000","last_change":"2024-09-18T01:25:06.700684+0000","last_active":"2024-09-18T01:25:43.844211+0000","last_peered":"2024-09-18T01:25:43.844211+0000","last_clean":"2024-09-18T01:25:43.844211+0000","last_became_active":"2024-09-18T01:25:06.700397+0000","last_became_peered":"2024-09-18T01:25:06.700397+0000","last_unstale":"2024-09-18T01:25:43.844211+0000","last_undegraded":"2024-09-18T01:25:43.844211+0000","last_fullsized":"2024-09-18T01:25:43.844211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:22.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845266+0000","last_change":"2024-09-18T01:25:10.676620+0000","last_active":"2024-09-18T01:25:43.845266+0000","last_peered":"2024-09-18T01:25:43.845266+0000","last_clean":"2024-09-18T01:25:43.845266+0000","last_became_active":"2024-09-18T01:25:10.676320+0000","last_became_peered":"2024-09-18T01:25:10.676320+0000","last_unstale":"2024-09-18T01:25:43.845266+0000","last_undegraded":"2024-09-18T01:25:43.845266+0000","last_fullsized":"2024-09-18T01:25:43.845266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:01:00.415475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'13","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.498611+0000","last_change":"2024-09-18T01:25:12.692628+0000","last_active":"2024-09-18T01:28:16.498611+0000","last_peered":"2024-09-18T01:28:16.498611+0000","last_clean":"2024-09-18T01:28:16.498611+0000","last_became_active":"2024-09-18T01:25:12.692373+0000","last_became_peered":"2024-09-18T01:25:12.692373+0000","last_unstale":"2024-09-18T01:28:16.498611+0000","last_undegraded":"2024-09-18T01:28:16.498611+0000","last_fullsized":"2024-09-18T01:28:16.498611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:48.277377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851686+0000","last_change":"2024-09-18T01:25:14.709358+0000","last_active":"2024-09-18T01:25:43.851686+0000","last_peered":"2024-09-18T01:25:43.851686+0000","last_clean":"2024-09-18T01:25:43.851686+0000","last_became_active":"2024-09-18T01:25:14.707409+0000","last_became_peered":"2024-09-18T01:25:14.707409+0000","last_unstale":"2024-09-18T01:25:43.851686+0000","last_undegraded":"2024-09-18T01:25:43.851686+0000","last_fullsized":"2024-09-18T01:25:43.851686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:44:50.425957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'6","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.246929+0000","last_change":"2024-09-18T01:25:16.711391+0000","last_active":"2024-09-18T01:27:16.246929+0000","last_peered":"2024-09-18T01:27:16.246929+0000","last_clean":"2024-09-18T01:27:16.246929+0000","last_became_active":"2024-09-18T01:25:16.711104+0000","last_became_peered":"2024-09-18T01:25:16.711104+0000","last_unstale":"2024-09-18T01:27:16.246929+0000","last_undegraded":"2024-09-18T01:27:16.246929+0000","last_fullsized":"2024-09-18T01:27:16.246929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:20.551132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.751886+0000","last_change":"2024-09-18T01:25:08.687474+0000","last_active":"2024-09-18T01:26:32.751886+0000","last_peered":"2024-09-18T01:26:32.751886+0000","last_clean":"2024-09-18T01:26:32.751886+0000","last_became_active":"2024-09-18T01:25:08.687139+0000","last_became_peered":"2024-09-18T01:25:08.687139+0000","last_unstale":"2024-09-18T01:26:32.751886+0000","last_undegraded":"2024-09-18T01:26:32.751886+0000","last_fullsized":"2024-09-18T01:26:32.751886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:17.472878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845078+0000","last_change":"2024-09-18T01:25:06.692246+0000","last_active":"2024-09-18T01:25:43.845078+0000","last_peered":"2024-09-18T01:25:43.845078+0000","last_clean":"2024-09-18T01:25:43.845078+0000","last_became_active":"2024-09-18T01:25:06.691871+0000","last_became_peered":"2024-09-18T01:25:06.691871+0000","last_unstale":"2024-09-18T01:25:43.845078+0000","last_undegraded":"2024-09-18T01:25:43.845078+0000","last_fullsized":"2024-09-18T01:25:43.845078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:18.475907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844899+0000","last_change":"2024-09-18T01:24:58.199959+0000","last_active":"2024-09-18T01:25:43.844899+0000","last_peered":"2024-09-18T01:25:43.844899+0000","last_clean":"2024-09-18T01:25:43.844899+0000","last_became_active":"2024-09-18T01:24:56.191033+0000","last_became_peered":"2024-09-18T01:24:56.191033+0000","last_unstale":"2024-09-18T01:25:43.844899+0000","last_undegraded":"2024-09-18T01:25:43.844899+0000","last_fullsized":"2024-09-18T01:25:43.844899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:45.677191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000547898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:17.796664+0000","last_change":"2024-09-18T01:25:10.676817+0000","last_active":"2024-09-18T01:27:17.796664+0000","last_peered":"2024-09-18T01:27:17.796664+0000","last_clean":"2024-09-18T01:27:17.796664+0000","last_became_active":"2024-09-18T01:25:10.676531+0000","last_became_peered":"2024-09-18T01:25:10.676531+0000","last_unstale":"2024-09-18T01:27:17.796664+0000","last_undegraded":"2024-09-18T01:27:17.796664+0000","last_fullsized":"2024-09-18T01:27:17.796664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:30:17.964806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'76","reported_seq":147,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.878002+0000","last_change":"2024-09-18T01:25:12.693490+0000","last_active":"2024-09-18T01:28:16.878002+0000","last_peered":"2024-09-18T01:28:16.878002+0000","last_clean":"2024-09-18T01:28:16.878002+0000","last_became_active":"2024-09-18T01:25:12.693127+0000","last_became_peered":"2024-09-18T01:25:12.693127+0000","last_unstale":"2024-09-18T01:28:16.878002+0000","last_undegraded":"2024-09-18T01:28:16.878002+0000","last_fullsized":"2024-09-18T01:28:16.878002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:53:39.113408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.842921+0000","last_change":"2024-09-18T01:25:14.704345+0000","last_active":"2024-09-18T01:25:43.842921+0000","last_peered":"2024-09-18T01:25:43.842921+0000","last_clean":"2024-09-18T01:25:43.842921+0000","last_became_active":"2024-09-18T01:25:14.703993+0000","last_became_peered":"2024-09-18T01:25:14.703993+0000","last_unstale":"2024-09-18T01:25:43.842921+0000","last_undegraded":"2024-09-18T01:25:43.842921+0000","last_fullsized":"2024-09-18T01:25:43.842921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:48.964473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.422802+0000","last_change":"2024-09-18T01:25:16.703557+0000","last_active":"2024-09-18T01:27:16.422802+0000","last_peered":"2024-09-18T01:27:16.422802+0000","last_clean":"2024-09-18T01:27:16.422802+0000","last_became_active":"2024-09-18T01:25:16.703278+0000","last_became_peered":"2024-09-18T01:25:16.703278+0000","last_unstale":"2024-09-18T01:27:16.422802+0000","last_undegraded":"2024-09-18T01:27:16.422802+0000","last_fullsized":"2024-09-18T01:27:16.422802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:50:43.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097370+0000","last_change":"2024-09-18T01:25:08.686341+0000","last_active":"2024-09-18T01:28:17.097370+0000","last_peered":"2024-09-18T01:28:17.097370+0000","last_clean":"2024-09-18T01:28:17.097370+0000","last_became_active":"2024-09-18T01:25:08.686087+0000","last_became_peered":"2024-09-18T01:25:08.686087+0000","last_unstale":"2024-09-18T01:28:17.097370+0000","last_undegraded":"2024-09-18T01:28:17.097370+0000","last_fullsized":"2024-09-18T01:28:17.097370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:58.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.796033+0000","last_change":"2024-09-18T01:25:06.681153+0000","last_active":"2024-09-18T01:27:12.796033+0000","last_peered":"2024-09-18T01:27:12.796033+0000","last_clean":"2024-09-18T01:27:12.796033+0000","last_became_active":"2024-09-18T01:25:06.680623+0000","last_became_peered":"2024-09-18T01:25:06.680623+0000","last_unstale":"2024-09-18T01:27:12.796033+0000","last_undegraded":"2024-09-18T01:27:12.796033+0000","last_fullsized":"2024-09-18T01:27:12.796033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:43.847905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851403+0000","last_change":"2024-09-18T01:24:58.198528+0000","last_active":"2024-09-18T01:25:43.851403+0000","last_peered":"2024-09-18T01:25:43.851403+0000","last_clean":"2024-09-18T01:25:43.851403+0000","last_became_active":"2024-09-18T01:24:56.191687+0000","last_became_peered":"2024-09-18T01:24:56.191687+0000","last_unstale":"2024-09-18T01:25:43.851403+0000","last_undegraded":"2024-09-18T01:25:43.851403+0000","last_fullsized":"2024-09-18T01:25:43.851403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:11:00.731633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012745390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848299+0000","last_change":"2024-09-18T01:25:10.681568+0000","last_active":"2024-09-18T01:25:43.848299+0000","last_peered":"2024-09-18T01:25:43.848299+0000","last_clean":"2024-09-18T01:25:43.848299+0000","last_became_active":"2024-09-18T01:25:10.681311+0000","last_became_peered":"2024-09-18T01:25:10.681311+0000","last_unstale":"2024-09-18T01:25:43.848299+0000","last_undegraded":"2024-09-18T01:25:43.848299+0000","last_fullsized":"2024-09-18T01:25:43.848299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:18:53.465821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'21","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797770+0000","last_change":"2024-09-18T01:25:12.692614+0000","last_active":"2024-09-18T01:27:19.797770+0000","last_peered":"2024-09-18T01:27:19.797770+0000","last_clean":"2024-09-18T01:27:19.797770+0000","last_became_active":"2024-09-18T01:25:12.692357+0000","last_became_peered":"2024-09-18T01:25:12.692357+0000","last_unstale":"2024-09-18T01:27:19.797770+0000","last_undegraded":"2024-09-18T01:27:19.797770+0000","last_fullsized":"2024-09-18T01:27:19.797770+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:53.053242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'282","reported_seq":386,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:15.763471+0000","last_change":"2024-09-18T01:25:14.706009+0000","last_active":"2024-09-18T01:28:15.763471+0000","last_peered":"2024-09-18T01:28:15.763471+0000","last_clean":"2024-09-18T01:28:15.763471+0000","last_became_active":"2024-09-18T01:25:14.705703+0000","last_became_peered":"2024-09-18T01:25:14.705703+0000","last_unstale":"2024-09-18T01:28:15.763471+0000","last_undegraded":"2024-09-18T01:28:15.763471+0000","last_fullsized":"2024-09-18T01:28:15.763471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:27.416743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850789+0000","last_change":"2024-09-18T01:25:16.711811+0000","last_active":"2024-09-18T01:25:43.850789+0000","last_peered":"2024-09-18T01:25:43.850789+0000","last_clean":"2024-09-18T01:25:43.850789+0000","last_became_active":"2024-09-18T01:25:16.711531+0000","last_became_peered":"2024-09-18T01:25:16.711531+0000","last_unstale":"2024-09-18T01:25:43.850789+0000","last_undegraded":"2024-09-18T01:25:43.850789+0000","last_fullsized":"2024-09-18T01:25:43.850789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:37:22.949714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'20","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.145097+0000","last_change":"2024-09-18T01:25:08.681868+0000","last_active":"2024-09-18T01:28:17.145097+0000","last_peered":"2024-09-18T01:28:17.145097+0000","last_clean":"2024-09-18T01:28:17.145097+0000","last_became_active":"2024-09-18T01:25:08.681285+0000","last_became_peered":"2024-09-18T01:25:08.681285+0000","last_unstale":"2024-09-18T01:28:17.145097+0000","last_undegraded":"2024-09-18T01:28:17.145097+0000","last_fullsized":"2024-09-18T01:28:17.145097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:17:00.419181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":56,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.852230+0000","last_change":"2024-09-18T01:25:06.684116+0000","last_active":"2024-09-18T01:25:43.852230+0000","last_peered":"2024-09-18T01:25:43.852230+0000","last_clean":"2024-09-18T01:25:43.852230+0000","last_became_active":"2024-09-18T01:25:06.683740+0000","last_became_peered":"2024-09-18T01:25:06.683740+0000","last_unstale":"2024-09-18T01:25:43.852230+0000","last_undegraded":"2024-09-18T01:25:43.852230+0000","last_fullsized":"2024-09-18T01:25:43.852230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:01.765123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846258+0000","last_change":"2024-09-18T01:24:58.199970+0000","last_active":"2024-09-18T01:25:43.846258+0000","last_peered":"2024-09-18T01:25:43.846258+0000","last_clean":"2024-09-18T01:25:43.846258+0000","last_became_active":"2024-09-18T01:24:56.192301+0000","last_became_peered":"2024-09-18T01:24:56.192301+0000","last_unstale":"2024-09-18T01:25:43.846258+0000","last_undegraded":"2024-09-18T01:25:43.846258+0000","last_fullsized":"2024-09-18T01:25:43.846258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:15.228308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056449699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848267+0000","last_change":"2024-09-18T01:25:10.682420+0000","last_active":"2024-09-18T01:25:43.848267+0000","last_peered":"2024-09-18T01:25:43.848267+0000","last_clean":"2024-09-18T01:25:43.848267+0000","last_became_active":"2024-09-18T01:25:10.682111+0000","last_became_peered":"2024-09-18T01:25:10.682111+0000","last_unstale":"2024-09-18T01:25:43.848267+0000","last_undegraded":"2024-09-18T01:25:43.848267+0000","last_fullsized":"2024-09-18T01:25:43.848267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:50.968119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'17","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797411+0000","last_change":"2024-09-18T01:25:12.692600+0000","last_active":"2024-09-18T01:27:19.797411+0000","last_peered":"2024-09-18T01:27:19.797411+0000","last_clean":"2024-09-18T01:27:19.797411+0000","last_became_active":"2024-09-18T01:25:12.692313+0000","last_became_peered":"2024-09-18T01:25:12.692313+0000","last_unstale":"2024-09-18T01:27:19.797411+0000","last_undegraded":"2024-09-18T01:27:19.797411+0000","last_fullsized":"2024-09-18T01:27:19.797411+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:07:06.091989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'282","reported_seq":398,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.272287+0000","last_change":"2024-09-18T01:25:14.699037+0000","last_active":"2024-09-18T01:28:17.272287+0000","last_peered":"2024-09-18T01:28:17.272287+0000","last_clean":"2024-09-18T01:28:17.272287+0000","last_became_active":"2024-09-18T01:25:14.698755+0000","last_became_peered":"2024-09-18T01:25:14.698755+0000","last_unstale":"2024-09-18T01:28:17.272287+0000","last_undegraded":"2024-09-18T01:28:17.272287+0000","last_fullsized":"2024-09-18T01:28:17.272287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:44.393089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.218389+0000","last_change":"2024-09-18T01:25:16.712818+0000","last_active":"2024-09-18T01:25:50.218389+0000","last_peered":"2024-09-18T01:25:50.218389+0000","last_clean":"2024-09-18T01:25:50.218389+0000","last_became_active":"2024-09-18T01:25:16.712556+0000","last_became_peered":"2024-09-18T01:25:16.712556+0000","last_unstale":"2024-09-18T01:25:50.218389+0000","last_undegraded":"2024-09-18T01:25:50.218389+0000","last_fullsized":"2024-09-18T01:25:50.218389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:33:55.839584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'13","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183683+0000","last_change":"2024-09-18T01:25:08.674848+0000","last_active":"2024-09-18T01:28:17.183683+0000","last_peered":"2024-09-18T01:28:17.183683+0000","last_clean":"2024-09-18T01:28:17.183683+0000","last_became_active":"2024-09-18T01:25:08.674560+0000","last_became_peered":"2024-09-18T01:25:08.674560+0000","last_unstale":"2024-09-18T01:28:17.183683+0000","last_undegraded":"2024-09-18T01:28:17.183683+0000","last_fullsized":"2024-09-18T01:28:17.183683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:10.873516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.389587+0000","last_change":"2024-09-18T01:25:06.693785+0000","last_active":"2024-09-18T01:27:16.389587+0000","last_peered":"2024-09-18T01:27:16.389587+0000","last_clean":"2024-09-18T01:27:16.389587+0000","last_became_active":"2024-09-18T01:25:06.686277+0000","last_became_peered":"2024-09-18T01:25:06.686277+0000","last_unstale":"2024-09-18T01:27:16.389587+0000","last_undegraded":"2024-09-18T01:27:16.389587+0000","last_fullsized":"2024-09-18T01:27:16.389587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:22.518297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851867+0000","last_change":"2024-09-18T01:24:58.198307+0000","last_active":"2024-09-18T01:25:43.851867+0000","last_peered":"2024-09-18T01:25:43.851867+0000","last_clean":"2024-09-18T01:25:43.851867+0000","last_became_active":"2024-09-18T01:24:56.602991+0000","last_became_peered":"2024-09-18T01:24:56.602991+0000","last_unstale":"2024-09-18T01:25:43.851867+0000","last_undegraded":"2024-09-18T01:25:43.851867+0000","last_fullsized":"2024-09-18T01:25:43.851867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:37:38.935073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077351,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847636+0000","last_change":"2024-09-18T01:25:10.683146+0000","last_active":"2024-09-18T01:25:43.847636+0000","last_peered":"2024-09-18T01:25:43.847636+0000","last_clean":"2024-09-18T01:25:43.847636+0000","last_became_active":"2024-09-18T01:25:10.682057+0000","last_became_peered":"2024-09-18T01:25:10.682057+0000","last_unstale":"2024-09-18T01:25:43.847636+0000","last_undegraded":"2024-09-18T01:25:43.847636+0000","last_fullsized":"2024-09-18T01:25:43.847636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:50:53.226062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'89","reported_seq":167,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.062380+0000","last_change":"2024-09-18T01:25:12.694747+0000","last_active":"2024-09-18T01:27:15.062380+0000","last_peered":"2024-09-18T01:27:15.062380+0000","last_clean":"2024-09-18T01:27:15.062380+0000","last_became_active":"2024-09-18T01:25:12.694361+0000","last_became_peered":"2024-09-18T01:25:12.694361+0000","last_unstale":"2024-09-18T01:27:15.062380+0000","last_undegraded":"2024-09-18T01:27:15.062380+0000","last_fullsized":"2024-09-18T01:27:15.062380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:01:02.423890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844037+0000","last_change":"2024-09-18T01:25:14.707331+0000","last_active":"2024-09-18T01:25:43.844037+0000","last_peered":"2024-09-18T01:25:43.844037+0000","last_clean":"2024-09-18T01:25:43.844037+0000","last_became_active":"2024-09-18T01:25:14.706960+0000","last_became_peered":"2024-09-18T01:25:14.706960+0000","last_unstale":"2024-09-18T01:25:43.844037+0000","last_undegraded":"2024-09-18T01:25:43.844037+0000","last_fullsized":"2024-09-18T01:25:43.844037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:23.103965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846489+0000","last_change":"2024-09-18T01:25:16.716922+0000","last_active":"2024-09-18T01:25:43.846489+0000","last_peered":"2024-09-18T01:25:43.846489+0000","last_clean":"2024-09-18T01:25:43.846489+0000","last_became_active":"2024-09-18T01:25:16.716607+0000","last_became_peered":"2024-09-18T01:25:16.716607+0000","last_unstale":"2024-09-18T01:25:43.846489+0000","last_undegraded":"2024-09-18T01:25:43.846489+0000","last_fullsized":"2024-09-18T01:25:43.846489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:31:19.177080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845585+0000","last_change":"2024-09-18T01:25:16.717173+0000","last_active":"2024-09-18T01:25:43.845585+0000","last_peered":"2024-09-18T01:25:43.845585+0000","last_clean":"2024-09-18T01:25:43.845585+0000","last_became_active":"2024-09-18T01:25:16.716867+0000","last_became_peered":"2024-09-18T01:25:16.716867+0000","last_unstale":"2024-09-18T01:25:43.845585+0000","last_undegraded":"2024-09-18T01:25:43.845585+0000","last_fullsized":"2024-09-18T01:25:43.845585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:29.431226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941573+0000","last_change":"2024-09-18T01:25:08.676006+0000","last_active":"2024-09-18T01:26:32.941573+0000","last_peered":"2024-09-18T01:26:32.941573+0000","last_clean":"2024-09-18T01:26:32.941573+0000","last_became_active":"2024-09-18T01:25:08.675590+0000","last_became_peered":"2024-09-18T01:25:08.675590+0000","last_unstale":"2024-09-18T01:26:32.941573+0000","last_undegraded":"2024-09-18T01:26:32.941573+0000","last_fullsized":"2024-09-18T01:26:32.941573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:41.267347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850033+0000","last_change":"2024-09-18T01:25:06.693775+0000","last_active":"2024-09-18T01:25:43.850033+0000","last_peered":"2024-09-18T01:25:43.850033+0000","last_clean":"2024-09-18T01:25:43.850033+0000","last_became_active":"2024-09-18T01:25:06.689996+0000","last_became_peered":"2024-09-18T01:25:06.689996+0000","last_unstale":"2024-09-18T01:25:43.850033+0000","last_undegraded":"2024-09-18T01:25:43.850033+0000","last_fullsized":"2024-09-18T01:25:43.850033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:08:19.802935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904820+0000","last_change":"2024-09-18T01:25:10.680563+0000","last_active":"2024-09-18T01:25:43.904820+0000","last_peered":"2024-09-18T01:25:43.904820+0000","last_clean":"2024-09-18T01:25:43.904820+0000","last_became_active":"2024-09-18T01:25:10.679704+0000","last_became_peered":"2024-09-18T01:25:10.679704+0000","last_unstale":"2024-09-18T01:25:43.904820+0000","last_undegraded":"2024-09-18T01:25:43.904820+0000","last_fullsized":"2024-09-18T01:25:43.904820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:43:35.529795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'38","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.068437+0000","last_change":"2024-09-18T01:25:12.693302+0000","last_active":"2024-09-18T01:27:15.068437+0000","last_peered":"2024-09-18T01:27:15.068437+0000","last_clean":"2024-09-18T01:27:15.068437+0000","last_became_active":"2024-09-18T01:25:12.692870+0000","last_became_peered":"2024-09-18T01:25:12.692870+0000","last_unstale":"2024-09-18T01:27:15.068437+0000","last_undegraded":"2024-09-18T01:27:15.068437+0000","last_fullsized":"2024-09-18T01:27:15.068437+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:53:57.208130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848675+0000","last_change":"2024-09-18T01:25:14.707283+0000","last_active":"2024-09-18T01:25:43.848675+0000","last_peered":"2024-09-18T01:25:43.848675+0000","last_clean":"2024-09-18T01:25:43.848675+0000","last_became_active":"2024-09-18T01:25:14.706381+0000","last_became_peered":"2024-09-18T01:25:14.706381+0000","last_unstale":"2024-09-18T01:25:43.848675+0000","last_undegraded":"2024-09-18T01:25:43.848675+0000","last_fullsized":"2024-09-18T01:25:43.848675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:43:26.455220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'17","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.580259+0000","last_change":"2024-09-18T01:25:16.703483+0000","last_active":"2024-09-18T01:28:16.580259+0000","last_peered":"2024-09-18T01:28:16.580259+0000","last_clean":"2024-09-18T01:28:16.580259+0000","last_became_active":"2024-09-18T01:25:16.703227+0000","last_became_peered":"2024-09-18T01:25:16.703227+0000","last_unstale":"2024-09-18T01:28:16.580259+0000","last_undegraded":"2024-09-18T01:28:16.580259+0000","last_fullsized":"2024-09-18T01:28:16.580259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:31.864546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904703+0000","last_change":"2024-09-18T01:25:08.687780+0000","last_active":"2024-09-18T01:25:43.904703+0000","last_peered":"2024-09-18T01:25:43.904703+0000","last_clean":"2024-09-18T01:25:43.904703+0000","last_became_active":"2024-09-18T01:25:08.687482+0000","last_became_peered":"2024-09-18T01:25:08.687482+0000","last_unstale":"2024-09-18T01:25:43.904703+0000","last_undegraded":"2024-09-18T01:25:43.904703+0000","last_fullsized":"2024-09-18T01:25:43.904703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:19.129968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845694+0000","last_change":"2024-09-18T01:25:06.705764+0000","last_active":"2024-09-18T01:25:43.845694+0000","last_peered":"2024-09-18T01:25:43.845694+0000","last_clean":"2024-09-18T01:25:43.845694+0000","last_became_active":"2024-09-18T01:25:06.705406+0000","last_became_peered":"2024-09-18T01:25:06.705406+0000","last_unstale":"2024-09-18T01:25:43.845694+0000","last_undegraded":"2024-09-18T01:25:43.845694+0000","last_fullsized":"2024-09-18T01:25:43.845694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:16.022647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849629+0000","last_change":"2024-09-18T01:25:10.682648+0000","last_active":"2024-09-18T01:25:43.849629+0000","last_peered":"2024-09-18T01:25:43.849629+0000","last_clean":"2024-09-18T01:25:43.849629+0000","last_became_active":"2024-09-18T01:25:10.682230+0000","last_became_peered":"2024-09-18T01:25:10.682230+0000","last_unstale":"2024-09-18T01:25:43.849629+0000","last_undegraded":"2024-09-18T01:25:43.849629+0000","last_fullsized":"2024-09-18T01:25:43.849629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:46:29.499833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'5","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.503052+0000","last_change":"2024-09-18T01:25:12.687325+0000","last_active":"2024-09-18T01:28:16.503052+0000","last_peered":"2024-09-18T01:28:16.503052+0000","last_clean":"2024-09-18T01:28:16.503052+0000","last_became_active":"2024-09-18T01:25:12.687018+0000","last_became_peered":"2024-09-18T01:25:12.687018+0000","last_unstale":"2024-09-18T01:28:16.503052+0000","last_undegraded":"2024-09-18T01:28:16.503052+0000","last_fullsized":"2024-09-18T01:28:16.503052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:38.338819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843144+0000","last_change":"2024-09-18T01:25:14.707285+0000","last_active":"2024-09-18T01:25:43.843144+0000","last_peered":"2024-09-18T01:25:43.843144+0000","last_clean":"2024-09-18T01:25:43.843144+0000","last_became_active":"2024-09-18T01:25:14.707008+0000","last_became_peered":"2024-09-18T01:25:14.707008+0000","last_unstale":"2024-09-18T01:25:43.843144+0000","last_undegraded":"2024-09-18T01:25:43.843144+0000","last_fullsized":"2024-09-18T01:25:43.843144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:37.834091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.131556+0000","last_change":"2024-09-18T01:25:16.714484+0000","last_active":"2024-09-18T01:28:17.131556+0000","last_peered":"2024-09-18T01:28:17.131556+0000","last_clean":"2024-09-18T01:28:17.131556+0000","last_became_active":"2024-09-18T01:25:16.714160+0000","last_became_peered":"2024-09-18T01:25:16.714160+0000","last_unstale":"2024-09-18T01:28:17.131556+0000","last_undegraded":"2024-09-18T01:28:17.131556+0000","last_fullsized":"2024-09-18T01:28:17.131556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:00:21.563802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844674+0000","last_change":"2024-09-18T01:25:08.671711+0000","last_active":"2024-09-18T01:25:43.844674+0000","last_peered":"2024-09-18T01:25:43.844674+0000","last_clean":"2024-09-18T01:25:43.844674+0000","last_became_active":"2024-09-18T01:25:08.671365+0000","last_became_peered":"2024-09-18T01:25:08.671365+0000","last_unstale":"2024-09-18T01:25:43.844674+0000","last_undegraded":"2024-09-18T01:25:43.844674+0000","last_fullsized":"2024-09-18T01:25:43.844674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:42:49.663850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799230+0000","last_change":"2024-09-18T01:25:06.703718+0000","last_active":"2024-09-18T01:27:34.799230+0000","last_peered":"2024-09-18T01:27:34.799230+0000","last_clean":"2024-09-18T01:27:34.799230+0000","last_became_active":"2024-09-18T01:25:06.703081+0000","last_became_peered":"2024-09-18T01:25:06.703081+0000","last_unstale":"2024-09-18T01:27:34.799230+0000","last_undegraded":"2024-09-18T01:27:34.799230+0000","last_fullsized":"2024-09-18T01:27:34.799230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:43.847905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843418+0000","last_change":"2024-09-18T01:25:10.680659+0000","last_active":"2024-09-18T01:25:43.843418+0000","last_peered":"2024-09-18T01:25:43.843418+0000","last_clean":"2024-09-18T01:25:43.843418+0000","last_became_active":"2024-09-18T01:25:10.680316+0000","last_became_peered":"2024-09-18T01:25:10.680316+0000","last_unstale":"2024-09-18T01:25:43.843418+0000","last_undegraded":"2024-09-18T01:25:43.843418+0000","last_fullsized":"2024-09-18T01:25:43.843418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:15.756375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'40","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.560764+0000","last_change":"2024-09-18T01:25:12.682598+0000","last_active":"2024-09-18T01:28:16.560764+0000","last_peered":"2024-09-18T01:28:16.560764+0000","last_clean":"2024-09-18T01:28:16.560764+0000","last_became_active":"2024-09-18T01:25:12.682270+0000","last_became_peered":"2024-09-18T01:25:12.682270+0000","last_unstale":"2024-09-18T01:28:16.560764+0000","last_undegraded":"2024-09-18T01:28:16.560764+0000","last_fullsized":"2024-09-18T01:28:16.560764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:44.205915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903990+0000","last_change":"2024-09-18T01:25:14.705277+0000","last_active":"2024-09-18T01:25:43.903990+0000","last_peered":"2024-09-18T01:25:43.903990+0000","last_clean":"2024-09-18T01:25:43.903990+0000","last_became_active":"2024-09-18T01:25:14.703583+0000","last_became_peered":"2024-09-18T01:25:14.703583+0000","last_unstale":"2024-09-18T01:25:43.903990+0000","last_undegraded":"2024-09-18T01:25:43.903990+0000","last_fullsized":"2024-09-18T01:25:43.903990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:01:53.638099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849566+0000","last_change":"2024-09-18T01:25:16.714459+0000","last_active":"2024-09-18T01:25:43.849566+0000","last_peered":"2024-09-18T01:25:43.849566+0000","last_clean":"2024-09-18T01:25:43.849566+0000","last_became_active":"2024-09-18T01:25:16.714061+0000","last_became_peered":"2024-09-18T01:25:16.714061+0000","last_unstale":"2024-09-18T01:25:43.849566+0000","last_undegraded":"2024-09-18T01:25:43.849566+0000","last_fullsized":"2024-09-18T01:25:43.849566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:00:46.823041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'4","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941172+0000","last_change":"2024-09-18T01:25:08.688282+0000","last_active":"2024-09-18T01:26:32.941172+0000","last_peered":"2024-09-18T01:26:32.941172+0000","last_clean":"2024-09-18T01:26:32.941172+0000","last_became_active":"2024-09-18T01:25:08.688016+0000","last_became_peered":"2024-09-18T01:25:08.688016+0000","last_unstale":"2024-09-18T01:26:32.941172+0000","last_undegraded":"2024-09-18T01:26:32.941172+0000","last_fullsized":"2024-09-18T01:26:32.941172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:37:29.581979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906628+0000","last_change":"2024-09-18T01:25:06.691298+0000","last_active":"2024-09-18T01:25:43.906628+0000","last_peered":"2024-09-18T01:25:43.906628+0000","last_clean":"2024-09-18T01:25:43.906628+0000","last_became_active":"2024-09-18T01:25:06.688747+0000","last_became_peered":"2024-09-18T01:25:06.688747+0000","last_unstale":"2024-09-18T01:25:43.906628+0000","last_undegraded":"2024-09-18T01:25:43.906628+0000","last_fullsized":"2024-09-18T01:25:43.906628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:03.343944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848182+0000","last_change":"2024-09-18T01:25:10.681110+0000","last_active":"2024-09-18T01:25:43.848182+0000","last_peered":"2024-09-18T01:25:43.848182+0000","last_clean":"2024-09-18T01:25:43.848182+0000","last_became_active":"2024-09-18T01:25:10.680831+0000","last_became_peered":"2024-09-18T01:25:10.680831+0000","last_unstale":"2024-09-18T01:25:43.848182+0000","last_undegraded":"2024-09-18T01:25:43.848182+0000","last_fullsized":"2024-09-18T01:25:43.848182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:27.094941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.053701+0000","last_change":"2024-09-18T01:25:12.687200+0000","last_active":"2024-09-18T01:27:15.053701+0000","last_peered":"2024-09-18T01:27:15.053701+0000","last_clean":"2024-09-18T01:27:15.053701+0000","last_became_active":"2024-09-18T01:25:12.686918+0000","last_became_peered":"2024-09-18T01:25:12.686918+0000","last_unstale":"2024-09-18T01:27:15.053701+0000","last_undegraded":"2024-09-18T01:27:15.053701+0000","last_fullsized":"2024-09-18T01:27:15.053701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:15.981679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843880+0000","last_change":"2024-09-18T01:25:14.695864+0000","last_active":"2024-09-18T01:25:43.843880+0000","last_peered":"2024-09-18T01:25:43.843880+0000","last_clean":"2024-09-18T01:25:43.843880+0000","last_became_active":"2024-09-18T01:25:14.695120+0000","last_became_peered":"2024-09-18T01:25:14.695120+0000","last_unstale":"2024-09-18T01:25:43.843880+0000","last_undegraded":"2024-09-18T01:25:43.843880+0000","last_fullsized":"2024-09-18T01:25:43.843880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:18.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'5","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153256+0000","last_change":"2024-09-18T01:25:08.678193+0000","last_active":"2024-09-18T01:28:17.153256+0000","last_peered":"2024-09-18T01:28:17.153256+0000","last_clean":"2024-09-18T01:28:17.153256+0000","last_became_active":"2024-09-18T01:25:08.677941+0000","last_became_peered":"2024-09-18T01:25:08.677941+0000","last_unstale":"2024-09-18T01:28:17.153256+0000","last_undegraded":"2024-09-18T01:28:17.153256+0000","last_fullsized":"2024-09-18T01:28:17.153256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:50:00.350138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.086109+0000","last_change":"2024-09-18T01:25:06.695779+0000","last_active":"2024-09-18T01:28:17.086109+0000","last_peered":"2024-09-18T01:28:17.086109+0000","last_clean":"2024-09-18T01:28:17.086109+0000","last_became_active":"2024-09-18T01:25:06.692823+0000","last_became_peered":"2024-09-18T01:25:06.692823+0000","last_unstale":"2024-09-18T01:28:17.086109+0000","last_undegraded":"2024-09-18T01:28:17.086109+0000","last_fullsized":"2024-09-18T01:28:17.086109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:25:48.076699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845675+0000","last_change":"2024-09-18T01:25:10.677782+0000","last_active":"2024-09-18T01:25:43.845675+0000","last_peered":"2024-09-18T01:25:43.845675+0000","last_clean":"2024-09-18T01:25:43.845675+0000","last_became_active":"2024-09-18T01:25:10.677481+0000","last_became_peered":"2024-09-18T01:25:10.677481+0000","last_unstale":"2024-09-18T01:25:43.845675+0000","last_undegraded":"2024-09-18T01:25:43.845675+0000","last_fullsized":"2024-09-18T01:25:43.845675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:01.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'61","reported_seq":123,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.074592+0000","last_change":"2024-09-18T01:25:12.687399+0000","last_active":"2024-09-18T01:27:15.074592+0000","last_peered":"2024-09-18T01:27:15.074592+0000","last_clean":"2024-09-18T01:27:15.074592+0000","last_became_active":"2024-09-18T01:25:12.687014+0000","last_became_peered":"2024-09-18T01:25:12.687014+0000","last_unstale":"2024-09-18T01:27:15.074592+0000","last_undegraded":"2024-09-18T01:27:15.074592+0000","last_fullsized":"2024-09-18T01:27:15.074592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:35.687671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843869+0000","last_change":"2024-09-18T01:25:14.699051+0000","last_active":"2024-09-18T01:25:43.843869+0000","last_peered":"2024-09-18T01:25:43.843869+0000","last_clean":"2024-09-18T01:25:43.843869+0000","last_became_active":"2024-09-18T01:25:14.698753+0000","last_became_peered":"2024-09-18T01:25:14.698753+0000","last_unstale":"2024-09-18T01:25:43.843869+0000","last_undegraded":"2024-09-18T01:25:43.843869+0000","last_fullsized":"2024-09-18T01:25:43.843869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:55.060343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'20","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.149094+0000","last_change":"2024-09-18T01:25:16.714340+0000","last_active":"2024-09-18T01:28:17.149094+0000","last_peered":"2024-09-18T01:28:17.149094+0000","last_clean":"2024-09-18T01:28:17.149094+0000","last_became_active":"2024-09-18T01:25:16.713750+0000","last_became_peered":"2024-09-18T01:25:16.713750+0000","last_unstale":"2024-09-18T01:28:17.149094+0000","last_undegraded":"2024-09-18T01:28:17.149094+0000","last_fullsized":"2024-09-18T01:28:17.149094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:00:32.755321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097065+0000","last_change":"2024-09-18T01:25:08.681356+0000","last_active":"2024-09-18T01:28:17.097065+0000","last_peered":"2024-09-18T01:28:17.097065+0000","last_clean":"2024-09-18T01:28:17.097065+0000","last_became_active":"2024-09-18T01:25:08.680604+0000","last_became_peered":"2024-09-18T01:25:08.680604+0000","last_unstale":"2024-09-18T01:28:17.097065+0000","last_undegraded":"2024-09-18T01:28:17.097065+0000","last_fullsized":"2024-09-18T01:28:17.097065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:58.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903568+0000","last_change":"2024-09-18T01:25:06.688269+0000","last_active":"2024-09-18T01:25:43.903568+0000","last_peered":"2024-09-18T01:25:43.903568+0000","last_clean":"2024-09-18T01:25:43.903568+0000","last_became_active":"2024-09-18T01:25:06.686125+0000","last_became_peered":"2024-09-18T01:25:06.686125+0000","last_unstale":"2024-09-18T01:25:43.903568+0000","last_undegraded":"2024-09-18T01:25:43.903568+0000","last_fullsized":"2024-09-18T01:25:43.903568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:36.036192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":235,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.114042+0000","last_change":"2024-09-18T01:25:43.912490+0000","last_active":"2024-09-18T01:27:16.114042+0000","last_peered":"2024-09-18T01:27:16.114042+0000","last_clean":"2024-09-18T01:27:16.114042+0000","last_became_active":"2024-09-18T01:25:43.908273+0000","last_became_peered":"2024-09-18T01:25:43.908273+0000","last_unstale":"2024-09-18T01:27:16.114042+0000","last_undegraded":"2024-09-18T01:27:16.114042+0000","last_fullsized":"2024-09-18T01:27:16.114042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:43.161322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'36","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.054864+0000","last_change":"2024-09-18T01:25:12.693001+0000","last_active":"2024-09-18T01:27:15.054864+0000","last_peered":"2024-09-18T01:27:15.054864+0000","last_clean":"2024-09-18T01:27:15.054864+0000","last_became_active":"2024-09-18T01:25:12.692486+0000","last_became_peered":"2024-09-18T01:25:12.692486+0000","last_unstale":"2024-09-18T01:27:15.054864+0000","last_undegraded":"2024-09-18T01:27:15.054864+0000","last_fullsized":"2024-09-18T01:27:15.054864+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:55:54.041872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904750+0000","last_change":"2024-09-18T01:25:14.710345+0000","last_active":"2024-09-18T01:25:43.904750+0000","last_peered":"2024-09-18T01:25:43.904750+0000","last_clean":"2024-09-18T01:25:43.904750+0000","last_became_active":"2024-09-18T01:25:14.709980+0000","last_became_peered":"2024-09-18T01:25:14.709980+0000","last_unstale":"2024-09-18T01:25:43.904750+0000","last_undegraded":"2024-09-18T01:25:43.904750+0000","last_fullsized":"2024-09-18T01:25:43.904750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:57.575198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848068+0000","last_change":"2024-09-18T01:25:16.709176+0000","last_active":"2024-09-18T01:25:43.848068+0000","last_peered":"2024-09-18T01:25:43.848068+0000","last_clean":"2024-09-18T01:25:43.848068+0000","last_became_active":"2024-09-18T01:25:16.708905+0000","last_became_peered":"2024-09-18T01:25:16.708905+0000","last_unstale":"2024-09-18T01:25:43.848068+0000","last_undegraded":"2024-09-18T01:25:43.848068+0000","last_fullsized":"2024-09-18T01:25:43.848068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:47:16.419410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.484946+0000","last_change":"2024-09-18T01:25:08.688875+0000","last_active":"2024-09-18T01:27:16.484946+0000","last_peered":"2024-09-18T01:27:16.484946+0000","last_clean":"2024-09-18T01:27:16.484946+0000","last_became_active":"2024-09-18T01:25:08.688610+0000","last_became_peered":"2024-09-18T01:25:08.688610+0000","last_unstale":"2024-09-18T01:27:16.484946+0000","last_undegraded":"2024-09-18T01:27:16.484946+0000","last_fullsized":"2024-09-18T01:27:16.484946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:31:14.516270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904539+0000","last_change":"2024-09-18T01:25:06.685750+0000","last_active":"2024-09-18T01:25:43.904539+0000","last_peered":"2024-09-18T01:25:43.904539+0000","last_clean":"2024-09-18T01:25:43.904539+0000","last_became_active":"2024-09-18T01:25:06.685167+0000","last_became_peered":"2024-09-18T01:25:06.685167+0000","last_unstale":"2024-09-18T01:25:43.904539+0000","last_undegraded":"2024-09-18T01:25:43.904539+0000","last_fullsized":"2024-09-18T01:25:43.904539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:39:53.953032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845066+0000","last_change":"2024-09-18T01:25:10.678850+0000","last_active":"2024-09-18T01:25:43.845066+0000","last_peered":"2024-09-18T01:25:43.845066+0000","last_clean":"2024-09-18T01:25:43.845066+0000","last_became_active":"2024-09-18T01:25:10.678586+0000","last_became_peered":"2024-09-18T01:25:10.678586+0000","last_unstale":"2024-09-18T01:25:43.845066+0000","last_undegraded":"2024-09-18T01:25:43.845066+0000","last_fullsized":"2024-09-18T01:25:43.845066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:12.616019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'38","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.072271+0000","last_change":"2024-09-18T01:25:12.688276+0000","last_active":"2024-09-18T01:27:15.072271+0000","last_peered":"2024-09-18T01:27:15.072271+0000","last_clean":"2024-09-18T01:27:15.072271+0000","last_became_active":"2024-09-18T01:25:12.687935+0000","last_became_peered":"2024-09-18T01:25:12.687935+0000","last_unstale":"2024-09-18T01:27:15.072271+0000","last_undegraded":"2024-09-18T01:27:15.072271+0000","last_fullsized":"2024-09-18T01:27:15.072271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:46.957372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845272+0000","last_change":"2024-09-18T01:25:14.701993+0000","last_active":"2024-09-18T01:25:43.845272+0000","last_peered":"2024-09-18T01:25:43.845272+0000","last_clean":"2024-09-18T01:25:43.845272+0000","last_became_active":"2024-09-18T01:25:14.701702+0000","last_became_peered":"2024-09-18T01:25:14.701702+0000","last_unstale":"2024-09-18T01:25:43.845272+0000","last_undegraded":"2024-09-18T01:25:43.845272+0000","last_fullsized":"2024-09-18T01:25:43.845272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:44:32.330079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.480417+0000","last_change":"2024-09-18T01:25:16.716015+0000","last_active":"2024-09-18T01:27:16.480417+0000","last_peered":"2024-09-18T01:27:16.480417+0000","last_clean":"2024-09-18T01:27:16.480417+0000","last_became_active":"2024-09-18T01:25:16.715669+0000","last_became_peered":"2024-09-18T01:25:16.715669+0000","last_unstale":"2024-09-18T01:27:16.480417+0000","last_undegraded":"2024-09-18T01:27:16.480417+0000","last_fullsized":"2024-09-18T01:27:16.480417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:36.833223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"35'15","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153107+0000","last_change":"2024-09-18T01:25:08.672922+0000","last_active":"2024-09-18T01:28:17.153107+0000","last_peered":"2024-09-18T01:28:17.153107+0000","last_clean":"2024-09-18T01:28:17.153107+0000","last_became_active":"2024-09-18T01:25:08.672541+0000","last_became_peered":"2024-09-18T01:25:08.672541+0000","last_unstale":"2024-09-18T01:28:17.153107+0000","last_undegraded":"2024-09-18T01:28:17.153107+0000","last_fullsized":"2024-09-18T01:28:17.153107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:39.586169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850020+0000","last_change":"2024-09-18T01:25:06.687447+0000","last_active":"2024-09-18T01:25:43.850020+0000","last_peered":"2024-09-18T01:25:43.850020+0000","last_clean":"2024-09-18T01:25:43.850020+0000","last_became_active":"2024-09-18T01:25:06.684658+0000","last_became_peered":"2024-09-18T01:25:06.684658+0000","last_unstale":"2024-09-18T01:25:43.850020+0000","last_undegraded":"2024-09-18T01:25:43.850020+0000","last_fullsized":"2024-09-18T01:25:43.850020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:33:25.718581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905255+0000","last_change":"2024-09-18T01:25:10.679752+0000","last_active":"2024-09-18T01:25:43.905255+0000","last_peered":"2024-09-18T01:25:43.905255+0000","last_clean":"2024-09-18T01:25:43.905255+0000","last_became_active":"2024-09-18T01:25:10.679369+0000","last_became_peered":"2024-09-18T01:25:10.679369+0000","last_unstale":"2024-09-18T01:25:43.905255+0000","last_undegraded":"2024-09-18T01:25:43.905255+0000","last_fullsized":"2024-09-18T01:25:43.905255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:03:35.620140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'16","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851610+0000","last_change":"2024-09-18T01:25:12.697092+0000","last_active":"2024-09-18T01:25:43.851610+0000","last_peered":"2024-09-18T01:25:43.851610+0000","last_clean":"2024-09-18T01:25:43.851610+0000","last_became_active":"2024-09-18T01:25:12.696757+0000","last_became_peered":"2024-09-18T01:25:12.696757+0000","last_unstale":"2024-09-18T01:25:43.851610+0000","last_undegraded":"2024-09-18T01:25:43.851610+0000","last_fullsized":"2024-09-18T01:25:43.851610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:43:07.633393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'282","reported_seq":372,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:15.763467+0000","last_change":"2024-09-18T01:25:14.709994+0000","last_active":"2024-09-18T01:28:15.763467+0000","last_peered":"2024-09-18T01:28:15.763467+0000","last_clean":"2024-09-18T01:28:15.763467+0000","last_became_active":"2024-09-18T01:25:14.708840+0000","last_became_peered":"2024-09-18T01:25:14.708840+0000","last_unstale":"2024-09-18T01:28:15.763467+0000","last_undegraded":"2024-09-18T01:28:15.763467+0000","last_fullsized":"2024-09-18T01:28:15.763467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:58.015878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847427+0000","last_change":"2024-09-18T01:25:16.707474+0000","last_active":"2024-09-18T01:25:43.847427+0000","last_peered":"2024-09-18T01:25:43.847427+0000","last_clean":"2024-09-18T01:25:43.847427+0000","last_became_active":"2024-09-18T01:25:16.706764+0000","last_became_peered":"2024-09-18T01:25:16.706764+0000","last_unstale":"2024-09-18T01:25:43.847427+0000","last_undegraded":"2024-09-18T01:25:43.847427+0000","last_fullsized":"2024-09-18T01:25:43.847427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:36.072052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.486245+0000","last_change":"2024-09-18T01:25:08.670258+0000","last_active":"2024-09-18T01:27:16.486245+0000","last_peered":"2024-09-18T01:27:16.486245+0000","last_clean":"2024-09-18T01:27:16.486245+0000","last_became_active":"2024-09-18T01:25:08.669920+0000","last_became_peered":"2024-09-18T01:25:08.669920+0000","last_unstale":"2024-09-18T01:27:16.486245+0000","last_undegraded":"2024-09-18T01:27:16.486245+0000","last_fullsized":"2024-09-18T01:27:16.486245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:54:53.349504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905430+0000","last_change":"2024-09-18T01:25:06.685435+0000","last_active":"2024-09-18T01:25:43.905430+0000","last_peered":"2024-09-18T01:25:43.905430+0000","last_clean":"2024-09-18T01:25:43.905430+0000","last_became_active":"2024-09-18T01:25:06.684984+0000","last_became_peered":"2024-09-18T01:25:06.684984+0000","last_unstale":"2024-09-18T01:25:43.905430+0000","last_undegraded":"2024-09-18T01:25:43.905430+0000","last_fullsized":"2024-09-18T01:25:43.905430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:18.475907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904219+0000","last_change":"2024-09-18T01:25:10.679758+0000","last_active":"2024-09-18T01:25:43.904219+0000","last_peered":"2024-09-18T01:25:43.904219+0000","last_clean":"2024-09-18T01:25:43.904219+0000","last_became_active":"2024-09-18T01:25:10.679468+0000","last_became_peered":"2024-09-18T01:25:10.679468+0000","last_unstale":"2024-09-18T01:25:43.904219+0000","last_undegraded":"2024-09-18T01:25:43.904219+0000","last_fullsized":"2024-09-18T01:25:43.904219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:13:07.466593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'60","reported_seq":129,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.045605+0000","last_change":"2024-09-18T01:25:12.689122+0000","last_active":"2024-09-18T01:27:15.045605+0000","last_peered":"2024-09-18T01:27:15.045605+0000","last_clean":"2024-09-18T01:27:15.045605+0000","last_became_active":"2024-09-18T01:25:12.688618+0000","last_became_peered":"2024-09-18T01:25:12.688618+0000","last_unstale":"2024-09-18T01:27:15.045605+0000","last_undegraded":"2024-09-18T01:27:15.045605+0000","last_fullsized":"2024-09-18T01:27:15.045605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:35.826990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843695+0000","last_change":"2024-09-18T01:25:14.707373+0000","last_active":"2024-09-18T01:25:43.843695+0000","last_peered":"2024-09-18T01:25:43.843695+0000","last_clean":"2024-09-18T01:25:43.843695+0000","last_became_active":"2024-09-18T01:25:14.706586+0000","last_became_peered":"2024-09-18T01:25:14.706586+0000","last_unstale":"2024-09-18T01:25:43.843695+0000","last_undegraded":"2024-09-18T01:25:43.843695+0000","last_fullsized":"2024-09-18T01:25:43.843695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:04:52.409201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.907198+0000","last_change":"2024-09-18T01:25:16.714536+0000","last_active":"2024-09-18T01:25:43.907198+0000","last_peered":"2024-09-18T01:25:43.907198+0000","last_clean":"2024-09-18T01:25:43.907198+0000","last_became_active":"2024-09-18T01:25:16.713789+0000","last_became_peered":"2024-09-18T01:25:16.713789+0000","last_unstale":"2024-09-18T01:25:43.907198+0000","last_undegraded":"2024-09-18T01:25:43.907198+0000","last_fullsized":"2024-09-18T01:25:43.907198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:32:22.558708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176266+0000","last_change":"2024-09-18T01:25:08.670550+0000","last_active":"2024-09-18T01:28:17.176266+0000","last_peered":"2024-09-18T01:28:17.176266+0000","last_clean":"2024-09-18T01:28:17.176266+0000","last_became_active":"2024-09-18T01:25:08.670268+0000","last_became_peered":"2024-09-18T01:25:08.670268+0000","last_unstale":"2024-09-18T01:28:17.176266+0000","last_undegraded":"2024-09-18T01:28:17.176266+0000","last_fullsized":"2024-09-18T01:28:17.176266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:41.660195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800885+0000","last_change":"2024-09-18T01:25:06.689500+0000","last_active":"2024-09-18T01:27:39.800885+0000","last_peered":"2024-09-18T01:27:39.800885+0000","last_clean":"2024-09-18T01:27:39.800885+0000","last_became_active":"2024-09-18T01:25:06.687382+0000","last_became_peered":"2024-09-18T01:25:06.687382+0000","last_unstale":"2024-09-18T01:27:39.800885+0000","last_undegraded":"2024-09-18T01:27:39.800885+0000","last_fullsized":"2024-09-18T01:27:39.800885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:30:33.161052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845025+0000","last_change":"2024-09-18T01:25:10.682652+0000","last_active":"2024-09-18T01:25:43.845025+0000","last_peered":"2024-09-18T01:25:43.845025+0000","last_clean":"2024-09-18T01:25:43.845025+0000","last_became_active":"2024-09-18T01:25:10.682337+0000","last_became_peered":"2024-09-18T01:25:10.682337+0000","last_unstale":"2024-09-18T01:25:43.845025+0000","last_undegraded":"2024-09-18T01:25:43.845025+0000","last_fullsized":"2024-09-18T01:25:43.845025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:07.622864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'36","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.046668+0000","last_change":"2024-09-18T01:25:12.693400+0000","last_active":"2024-09-18T01:27:15.046668+0000","last_peered":"2024-09-18T01:27:15.046668+0000","last_clean":"2024-09-18T01:27:15.046668+0000","last_became_active":"2024-09-18T01:25:12.693129+0000","last_became_peered":"2024-09-18T01:25:12.693129+0000","last_unstale":"2024-09-18T01:27:15.046668+0000","last_undegraded":"2024-09-18T01:27:15.046668+0000","last_fullsized":"2024-09-18T01:27:15.046668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:02:54.566116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847932+0000","last_change":"2024-09-18T01:25:14.707262+0000","last_active":"2024-09-18T01:25:43.847932+0000","last_peered":"2024-09-18T01:25:43.847932+0000","last_clean":"2024-09-18T01:25:43.847932+0000","last_became_active":"2024-09-18T01:25:14.706325+0000","last_became_peered":"2024-09-18T01:25:14.706325+0000","last_unstale":"2024-09-18T01:25:43.847932+0000","last_undegraded":"2024-09-18T01:25:43.847932+0000","last_fullsized":"2024-09-18T01:25:43.847932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:31.363572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851735+0000","last_change":"2024-09-18T01:25:16.716357+0000","last_active":"2024-09-18T01:25:43.851735+0000","last_peered":"2024-09-18T01:25:43.851735+0000","last_clean":"2024-09-18T01:25:43.851735+0000","last_became_active":"2024-09-18T01:25:16.716084+0000","last_became_peered":"2024-09-18T01:25:16.716084+0000","last_unstale":"2024-09-18T01:25:43.851735+0000","last_undegraded":"2024-09-18T01:25:43.851735+0000","last_fullsized":"2024-09-18T01:25:43.851735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:49:46.781345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848361+0000","last_change":"2024-09-18T01:25:08.678786+0000","last_active":"2024-09-18T01:25:43.848361+0000","last_peered":"2024-09-18T01:25:43.848361+0000","last_clean":"2024-09-18T01:25:43.848361+0000","last_became_active":"2024-09-18T01:25:08.678539+0000","last_became_peered":"2024-09-18T01:25:08.678539+0000","last_unstale":"2024-09-18T01:25:43.848361+0000","last_undegraded":"2024-09-18T01:25:43.848361+0000","last_fullsized":"2024-09-18T01:25:43.848361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:26:37.929696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846243+0000","last_change":"2024-09-18T01:25:06.682960+0000","last_active":"2024-09-18T01:25:43.846243+0000","last_peered":"2024-09-18T01:25:43.846243+0000","last_clean":"2024-09-18T01:25:43.846243+0000","last_became_active":"2024-09-18T01:25:06.682592+0000","last_became_peered":"2024-09-18T01:25:06.682592+0000","last_unstale":"2024-09-18T01:25:43.846243+0000","last_undegraded":"2024-09-18T01:25:43.846243+0000","last_fullsized":"2024-09-18T01:25:43.846243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:39.148193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903424+0000","last_change":"2024-09-18T01:25:10.684259+0000","last_active":"2024-09-18T01:25:43.903424+0000","last_peered":"2024-09-18T01:25:43.903424+0000","last_clean":"2024-09-18T01:25:43.903424+0000","last_became_active":"2024-09-18T01:25:10.683833+0000","last_became_peered":"2024-09-18T01:25:10.683833+0000","last_unstale":"2024-09-18T01:25:43.903424+0000","last_undegraded":"2024-09-18T01:25:43.903424+0000","last_fullsized":"2024-09-18T01:25:43.903424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:01.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'32","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.070164+0000","last_change":"2024-09-18T01:25:12.693138+0000","last_active":"2024-09-18T01:27:15.070164+0000","last_peered":"2024-09-18T01:27:15.070164+0000","last_clean":"2024-09-18T01:27:15.070164+0000","last_became_active":"2024-09-18T01:25:12.691752+0000","last_became_peered":"2024-09-18T01:25:12.691752+0000","last_unstale":"2024-09-18T01:27:15.070164+0000","last_undegraded":"2024-09-18T01:27:15.070164+0000","last_fullsized":"2024-09-18T01:27:15.070164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:47:16.533005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849229+0000","last_change":"2024-09-18T01:25:14.711982+0000","last_active":"2024-09-18T01:25:43.849229+0000","last_peered":"2024-09-18T01:25:43.849229+0000","last_clean":"2024-09-18T01:25:43.849229+0000","last_became_active":"2024-09-18T01:25:14.711635+0000","last_became_peered":"2024-09-18T01:25:14.711635+0000","last_unstale":"2024-09-18T01:25:43.849229+0000","last_undegraded":"2024-09-18T01:25:43.849229+0000","last_fullsized":"2024-09-18T01:25:43.849229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:51:20.322887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.080053+0000","last_change":"2024-09-18T01:25:16.715865+0000","last_active":"2024-09-18T01:27:15.080053+0000","last_peered":"2024-09-18T01:27:15.080053+0000","last_clean":"2024-09-18T01:27:15.080053+0000","last_became_active":"2024-09-18T01:25:16.715581+0000","last_became_peered":"2024-09-18T01:25:16.715581+0000","last_unstale":"2024-09-18T01:27:15.080053+0000","last_undegraded":"2024-09-18T01:27:15.080053+0000","last_fullsized":"2024-09-18T01:27:15.080053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:23.172601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'8","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176264+0000","last_change":"2024-09-18T01:25:08.669854+0000","last_active":"2024-09-18T01:28:17.176264+0000","last_peered":"2024-09-18T01:28:17.176264+0000","last_clean":"2024-09-18T01:28:17.176264+0000","last_became_active":"2024-09-18T01:25:08.668430+0000","last_became_peered":"2024-09-18T01:25:08.668430+0000","last_unstale":"2024-09-18T01:28:17.176264+0000","last_undegraded":"2024-09-18T01:28:17.176264+0000","last_fullsized":"2024-09-18T01:28:17.176264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:43:08.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906927+0000","last_change":"2024-09-18T01:25:06.687779+0000","last_active":"2024-09-18T01:25:43.906927+0000","last_peered":"2024-09-18T01:25:43.906927+0000","last_clean":"2024-09-18T01:25:43.906927+0000","last_became_active":"2024-09-18T01:25:06.686394+0000","last_became_peered":"2024-09-18T01:25:06.686394+0000","last_unstale":"2024-09-18T01:25:43.906927+0000","last_undegraded":"2024-09-18T01:25:43.906927+0000","last_fullsized":"2024-09-18T01:25:43.906927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:53.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.760367+0000","last_change":"2024-09-18T01:25:10.683660+0000","last_active":"2024-09-18T01:27:13.760367+0000","last_peered":"2024-09-18T01:27:13.760367+0000","last_clean":"2024-09-18T01:27:13.760367+0000","last_became_active":"2024-09-18T01:25:10.683351+0000","last_became_peered":"2024-09-18T01:25:10.683351+0000","last_unstale":"2024-09-18T01:27:13.760367+0000","last_undegraded":"2024-09-18T01:27:13.760367+0000","last_fullsized":"2024-09-18T01:27:13.760367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:13.973263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'45","reported_seq":101,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.503821+0000","last_change":"2024-09-18T01:25:12.692015+0000","last_active":"2024-09-18T01:28:16.503821+0000","last_peered":"2024-09-18T01:28:16.503821+0000","last_clean":"2024-09-18T01:28:16.503821+0000","last_became_active":"2024-09-18T01:25:12.691715+0000","last_became_peered":"2024-09-18T01:25:12.691715+0000","last_unstale":"2024-09-18T01:28:16.503821+0000","last_undegraded":"2024-09-18T01:28:16.503821+0000","last_fullsized":"2024-09-18T01:28:16.503821+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:52:06.633359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844813+0000","last_change":"2024-09-18T01:25:14.707331+0000","last_active":"2024-09-18T01:25:43.844813+0000","last_peered":"2024-09-18T01:25:43.844813+0000","last_clean":"2024-09-18T01:25:43.844813+0000","last_became_active":"2024-09-18T01:25:14.706398+0000","last_became_peered":"2024-09-18T01:25:14.706398+0000","last_unstale":"2024-09-18T01:25:43.844813+0000","last_undegraded":"2024-09-18T01:25:43.844813+0000","last_fullsized":"2024-09-18T01:25:43.844813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:01:53.638099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.082692+0000","last_change":"2024-09-18T01:25:16.714114+0000","last_active":"2024-09-18T01:27:15.082692+0000","last_peered":"2024-09-18T01:27:15.082692+0000","last_clean":"2024-09-18T01:27:15.082692+0000","last_became_active":"2024-09-18T01:25:16.713579+0000","last_became_peered":"2024-09-18T01:25:16.713579+0000","last_unstale":"2024-09-18T01:27:15.082692+0000","last_undegraded":"2024-09-18T01:27:15.082692+0000","last_fullsized":"2024-09-18T01:27:15.082692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:14.993371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'8","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176775+0000","last_change":"2024-09-18T01:25:08.686807+0000","last_active":"2024-09-18T01:28:17.176775+0000","last_peered":"2024-09-18T01:28:17.176775+0000","last_clean":"2024-09-18T01:28:17.176775+0000","last_became_active":"2024-09-18T01:25:08.686645+0000","last_became_peered":"2024-09-18T01:25:08.686645+0000","last_unstale":"2024-09-18T01:28:17.176775+0000","last_undegraded":"2024-09-18T01:28:17.176775+0000","last_fullsized":"2024-09-18T01:28:17.176775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:25:13.805489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.842839+0000","last_change":"2024-09-18T01:25:06.703432+0000","last_active":"2024-09-18T01:25:43.842839+0000","last_peered":"2024-09-18T01:25:43.842839+0000","last_clean":"2024-09-18T01:25:43.842839+0000","last_became_active":"2024-09-18T01:25:06.702991+0000","last_became_peered":"2024-09-18T01:25:06.702991+0000","last_unstale":"2024-09-18T01:25:43.842839+0000","last_undegraded":"2024-09-18T01:25:43.842839+0000","last_fullsized":"2024-09-18T01:25:43.842839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:05.206190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176373+0000","last_change":"2024-09-18T01:25:08.673285+0000","last_active":"2024-09-18T01:28:17.176373+0000","last_peered":"2024-09-18T01:28:17.176373+0000","last_clean":"2024-09-18T01:28:17.176373+0000","last_became_active":"2024-09-18T01:25:08.672983+0000","last_became_peered":"2024-09-18T01:25:08.672983+0000","last_unstale":"2024-09-18T01:28:17.176373+0000","last_undegraded":"2024-09-18T01:28:17.176373+0000","last_fullsized":"2024-09-18T01:28:17.176373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:17.472878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843899+0000","last_change":"2024-09-18T01:25:06.681343+0000","last_active":"2024-09-18T01:25:43.843899+0000","last_peered":"2024-09-18T01:25:43.843899+0000","last_clean":"2024-09-18T01:25:43.843899+0000","last_became_active":"2024-09-18T01:25:06.680853+0000","last_became_peered":"2024-09-18T01:25:06.680853+0000","last_unstale":"2024-09-18T01:25:43.843899+0000","last_undegraded":"2024-09-18T01:25:43.843899+0000","last_fullsized":"2024-09-18T01:25:43.843899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:16.022647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'8","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941003+0000","last_change":"2024-09-18T01:25:08.682876+0000","last_active":"2024-09-18T01:26:32.941003+0000","last_peered":"2024-09-18T01:26:32.941003+0000","last_clean":"2024-09-18T01:26:32.941003+0000","last_became_active":"2024-09-18T01:25:08.682254+0000","last_became_peered":"2024-09-18T01:25:08.682254+0000","last_unstale":"2024-09-18T01:26:32.941003+0000","last_undegraded":"2024-09-18T01:26:32.941003+0000","last_fullsized":"2024-09-18T01:26:32.941003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:32:31.867039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849439+0000","last_change":"2024-09-18T01:25:06.684384+0000","last_active":"2024-09-18T01:25:43.849439+0000","last_peered":"2024-09-18T01:25:43.849439+0000","last_clean":"2024-09-18T01:25:43.849439+0000","last_became_active":"2024-09-18T01:25:06.682878+0000","last_became_peered":"2024-09-18T01:25:06.682878+0000","last_unstale":"2024-09-18T01:25:43.849439+0000","last_undegraded":"2024-09-18T01:25:43.849439+0000","last_fullsized":"2024-09-18T01:25:43.849439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:16:23.251760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.144979+0000","last_change":"2024-09-18T01:25:08.673238+0000","last_active":"2024-09-18T01:28:17.144979+0000","last_peered":"2024-09-18T01:28:17.144979+0000","last_clean":"2024-09-18T01:28:17.144979+0000","last_became_active":"2024-09-18T01:25:08.672574+0000","last_became_peered":"2024-09-18T01:25:08.672574+0000","last_unstale":"2024-09-18T01:28:17.144979+0000","last_undegraded":"2024-09-18T01:28:17.144979+0000","last_fullsized":"2024-09-18T01:28:17.144979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:41.660195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846440+0000","last_change":"2024-09-18T01:25:06.681262+0000","last_active":"2024-09-18T01:25:43.846440+0000","last_peered":"2024-09-18T01:25:43.846440+0000","last_clean":"2024-09-18T01:25:43.846440+0000","last_became_active":"2024-09-18T01:25:06.680712+0000","last_became_peered":"2024-09-18T01:25:06.680712+0000","last_unstale":"2024-09-18T01:25:43.846440+0000","last_undegraded":"2024-09-18T01:25:43.846440+0000","last_fullsized":"2024-09-18T01:25:43.846440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:03.343944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'5","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.394294+0000","last_change":"2024-09-18T01:25:08.671686+0000","last_active":"2024-09-18T01:27:13.394294+0000","last_peered":"2024-09-18T01:27:13.394294+0000","last_clean":"2024-09-18T01:27:13.394294+0000","last_became_active":"2024-09-18T01:25:08.671408+0000","last_became_peered":"2024-09-18T01:25:08.671408+0000","last_unstale":"2024-09-18T01:27:13.394294+0000","last_undegraded":"2024-09-18T01:27:13.394294+0000","last_fullsized":"2024-09-18T01:27:13.394294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:19.129968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845199+0000","last_change":"2024-09-18T01:25:06.683019+0000","last_active":"2024-09-18T01:25:43.845199+0000","last_peered":"2024-09-18T01:25:43.845199+0000","last_clean":"2024-09-18T01:25:43.845199+0000","last_became_active":"2024-09-18T01:25:06.682577+0000","last_became_peered":"2024-09-18T01:25:06.682577+0000","last_unstale":"2024-09-18T01:25:43.845199+0000","last_undegraded":"2024-09-18T01:25:43.845199+0000","last_fullsized":"2024-09-18T01:25:43.845199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:53.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'8","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954296+0000","last_change":"2024-09-18T01:25:08.688824+0000","last_active":"2024-09-18T01:28:16.954296+0000","last_peered":"2024-09-18T01:28:16.954296+0000","last_clean":"2024-09-18T01:28:16.954296+0000","last_became_active":"2024-09-18T01:25:08.687797+0000","last_became_peered":"2024-09-18T01:25:08.687797+0000","last_unstale":"2024-09-18T01:28:16.954296+0000","last_undegraded":"2024-09-18T01:28:16.954296+0000","last_fullsized":"2024-09-18T01:28:16.954296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:43:40.299678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905421+0000","last_change":"2024-09-18T01:25:06.687325+0000","last_active":"2024-09-18T01:25:43.905421+0000","last_peered":"2024-09-18T01:25:43.905421+0000","last_clean":"2024-09-18T01:25:43.905421+0000","last_became_active":"2024-09-18T01:25:06.686154+0000","last_became_peered":"2024-09-18T01:25:06.686154+0000","last_unstale":"2024-09-18T01:25:43.905421+0000","last_undegraded":"2024-09-18T01:25:43.905421+0000","last_fullsized":"2024-09-18T01:25:43.905421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:24.579150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176363+0000","last_change":"2024-09-18T01:25:08.681610+0000","last_active":"2024-09-18T01:28:17.176363+0000","last_peered":"2024-09-18T01:28:17.176363+0000","last_clean":"2024-09-18T01:28:17.176363+0000","last_became_active":"2024-09-18T01:25:08.680947+0000","last_became_peered":"2024-09-18T01:25:08.680947+0000","last_unstale":"2024-09-18T01:28:17.176363+0000","last_undegraded":"2024-09-18T01:28:17.176363+0000","last_fullsized":"2024-09-18T01:28:17.176363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:41.267347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845952+0000","last_change":"2024-09-18T01:25:06.704000+0000","last_active":"2024-09-18T01:25:43.845952+0000","last_peered":"2024-09-18T01:25:43.845952+0000","last_clean":"2024-09-18T01:25:43.845952+0000","last_became_active":"2024-09-18T01:25:06.703622+0000","last_became_peered":"2024-09-18T01:25:06.703622+0000","last_unstale":"2024-09-18T01:25:43.845952+0000","last_undegraded":"2024-09-18T01:25:43.845952+0000","last_fullsized":"2024-09-18T01:25:43.845952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:33:48.652888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'6","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.142304+0000","last_change":"2024-09-18T01:25:08.682682+0000","last_active":"2024-09-18T01:28:17.142304+0000","last_peered":"2024-09-18T01:28:17.142304+0000","last_clean":"2024-09-18T01:28:17.142304+0000","last_became_active":"2024-09-18T01:25:08.682143+0000","last_became_peered":"2024-09-18T01:25:08.682143+0000","last_unstale":"2024-09-18T01:28:17.142304+0000","last_undegraded":"2024-09-18T01:28:17.142304+0000","last_fullsized":"2024-09-18T01:28:17.142304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:10.604887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.435644+0000","last_change":"2024-09-18T01:25:06.687744+0000","last_active":"2024-09-18T01:25:50.435644+0000","last_peered":"2024-09-18T01:25:50.435644+0000","last_clean":"2024-09-18T01:25:50.435644+0000","last_became_active":"2024-09-18T01:25:06.687436+0000","last_became_peered":"2024-09-18T01:25:06.687436+0000","last_unstale":"2024-09-18T01:25:50.435644+0000","last_undegraded":"2024-09-18T01:25:50.435644+0000","last_fullsized":"2024-09-18T01:25:50.435644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:08.432830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'14","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097381+0000","last_change":"2024-09-18T01:25:08.676069+0000","last_active":"2024-09-18T01:28:17.097381+0000","last_peered":"2024-09-18T01:28:17.097381+0000","last_clean":"2024-09-18T01:28:17.097381+0000","last_became_active":"2024-09-18T01:25:08.675801+0000","last_became_peered":"2024-09-18T01:25:08.675801+0000","last_unstale":"2024-09-18T01:28:17.097381+0000","last_undegraded":"2024-09-18T01:28:17.097381+0000","last_fullsized":"2024-09-18T01:28:17.097381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:27.055282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.439101+0000","last_change":"2024-09-18T01:25:06.693564+0000","last_active":"2024-09-18T01:25:50.439101+0000","last_peered":"2024-09-18T01:25:50.439101+0000","last_clean":"2024-09-18T01:25:50.439101+0000","last_became_active":"2024-09-18T01:25:06.691345+0000","last_became_peered":"2024-09-18T01:25:06.691345+0000","last_unstale":"2024-09-18T01:25:50.439101+0000","last_undegraded":"2024-09-18T01:25:50.439101+0000","last_fullsized":"2024-09-18T01:25:50.439101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:23:21.828422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'16","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097074+0000","last_change":"2024-09-18T01:25:08.685632+0000","last_active":"2024-09-18T01:28:17.097074+0000","last_peered":"2024-09-18T01:28:17.097074+0000","last_clean":"2024-09-18T01:28:17.097074+0000","last_became_active":"2024-09-18T01:25:08.685358+0000","last_became_peered":"2024-09-18T01:25:08.685358+0000","last_unstale":"2024-09-18T01:28:17.097074+0000","last_undegraded":"2024-09-18T01:28:17.097074+0000","last_fullsized":"2024-09-18T01:28:17.097074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:56:00.059201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844121+0000","last_change":"2024-09-18T01:25:06.696372+0000","last_active":"2024-09-18T01:25:43.844121+0000","last_peered":"2024-09-18T01:25:43.844121+0000","last_clean":"2024-09-18T01:25:43.844121+0000","last_became_active":"2024-09-18T01:25:06.695735+0000","last_became_peered":"2024-09-18T01:25:06.695735+0000","last_unstale":"2024-09-18T01:25:43.844121+0000","last_undegraded":"2024-09-18T01:25:43.844121+0000","last_fullsized":"2024-09-18T01:25:43.844121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:24.579150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:49.871200+0000","last_change":"2024-09-18T01:25:43.852539+0000","last_active":"2024-09-18T01:25:49.871200+0000","last_peered":"2024-09-18T01:25:49.871200+0000","last_clean":"2024-09-18T01:25:49.871200+0000","last_became_active":"2024-09-18T01:25:43.849600+0000","last_became_peered":"2024-09-18T01:25:43.849600+0000","last_unstale":"2024-09-18T01:25:49.871200+0000","last_undegraded":"2024-09-18T01:25:49.871200+0000","last_fullsized":"2024-09-18T01:25:49.871200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:43.134170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904800+0000","last_change":"2024-09-18T01:25:06.695026+0000","last_active":"2024-09-18T01:25:43.904800+0000","last_peered":"2024-09-18T01:25:43.904800+0000","last_clean":"2024-09-18T01:25:43.904800+0000","last_became_active":"2024-09-18T01:25:06.688967+0000","last_became_peered":"2024-09-18T01:25:06.688967+0000","last_unstale":"2024-09-18T01:25:43.904800+0000","last_undegraded":"2024-09-18T01:25:43.904800+0000","last_fullsized":"2024-09-18T01:25:43.904800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:05.206190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'10","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176674+0000","last_change":"2024-09-18T01:25:08.684071+0000","last_active":"2024-09-18T01:28:17.176674+0000","last_peered":"2024-09-18T01:28:17.176674+0000","last_clean":"2024-09-18T01:28:17.176674+0000","last_became_active":"2024-09-18T01:25:08.683590+0000","last_became_peered":"2024-09-18T01:25:08.683590+0000","last_unstale":"2024-09-18T01:28:17.176674+0000","last_undegraded":"2024-09-18T01:28:17.176674+0000","last_fullsized":"2024-09-18T01:28:17.176674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:43:55.523212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'5","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798517+0000","last_change":"2024-09-18T01:25:06.686285+0000","last_active":"2024-09-18T01:27:24.798517+0000","last_peered":"2024-09-18T01:27:24.798517+0000","last_clean":"2024-09-18T01:27:24.798517+0000","last_became_active":"2024-09-18T01:25:06.685814+0000","last_became_peered":"2024-09-18T01:25:06.685814+0000","last_unstale":"2024-09-18T01:27:24.798517+0000","last_undegraded":"2024-09-18T01:27:24.798517+0000","last_fullsized":"2024-09-18T01:27:24.798517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:53.580899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954264+0000","last_change":"2024-09-18T01:25:08.686910+0000","last_active":"2024-09-18T01:28:16.954264+0000","last_peered":"2024-09-18T01:28:16.954264+0000","last_clean":"2024-09-18T01:28:16.954264+0000","last_became_active":"2024-09-18T01:25:08.686703+0000","last_became_peered":"2024-09-18T01:25:08.686703+0000","last_unstale":"2024-09-18T01:28:16.954264+0000","last_undegraded":"2024-09-18T01:28:16.954264+0000","last_fullsized":"2024-09-18T01:28:16.954264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:41.660195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.929092+0000","last_change":"2024-09-18T01:25:06.691078+0000","last_active":"2024-09-18T01:26:32.929092+0000","last_peered":"2024-09-18T01:26:32.929092+0000","last_clean":"2024-09-18T01:26:32.929092+0000","last_became_active":"2024-09-18T01:25:06.685120+0000","last_became_peered":"2024-09-18T01:25:06.685120+0000","last_unstale":"2024-09-18T01:26:32.929092+0000","last_undegraded":"2024-09-18T01:26:32.929092+0000","last_fullsized":"2024-09-18T01:26:32.929092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:11:04.031882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'7","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183513+0000","last_change":"2024-09-18T01:25:08.685436+0000","last_active":"2024-09-18T01:28:17.183513+0000","last_peered":"2024-09-18T01:28:17.183513+0000","last_clean":"2024-09-18T01:28:17.183513+0000","last_became_active":"2024-09-18T01:25:08.685158+0000","last_became_peered":"2024-09-18T01:25:08.685158+0000","last_unstale":"2024-09-18T01:28:17.183513+0000","last_undegraded":"2024-09-18T01:28:17.183513+0000","last_fullsized":"2024-09-18T01:28:17.183513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:07.788671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851842+0000","last_change":"2024-09-18T01:25:06.687424+0000","last_active":"2024-09-18T01:25:43.851842+0000","last_peered":"2024-09-18T01:25:43.851842+0000","last_clean":"2024-09-18T01:25:43.851842+0000","last_became_active":"2024-09-18T01:25:06.684845+0000","last_became_peered":"2024-09-18T01:25:06.684845+0000","last_unstale":"2024-09-18T01:25:43.851842+0000","last_undegraded":"2024-09-18T01:25:43.851842+0000","last_fullsized":"2024-09-18T01:25:43.851842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:33.279586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954367+0000","last_change":"2024-09-18T01:25:08.688327+0000","last_active":"2024-09-18T01:28:16.954367+0000","last_peered":"2024-09-18T01:28:16.954367+0000","last_clean":"2024-09-18T01:28:16.954367+0000","last_became_active":"2024-09-18T01:25:08.687840+0000","last_became_peered":"2024-09-18T01:25:08.687840+0000","last_unstale":"2024-09-18T01:28:16.954367+0000","last_undegraded":"2024-09-18T01:28:16.954367+0000","last_fullsized":"2024-09-18T01:28:16.954367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:24:41.518231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.089186+0000","last_change":"2024-09-18T01:25:06.704602+0000","last_active":"2024-09-18T01:28:17.089186+0000","last_peered":"2024-09-18T01:28:17.089186+0000","last_clean":"2024-09-18T01:28:17.089186+0000","last_became_active":"2024-09-18T01:25:06.704247+0000","last_became_peered":"2024-09-18T01:25:06.704247+0000","last_unstale":"2024-09-18T01:28:17.089186+0000","last_undegraded":"2024-09-18T01:28:17.089186+0000","last_fullsized":"2024-09-18T01:28:17.089186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:53.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'12","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.393720+0000","last_change":"2024-09-18T01:25:08.681230+0000","last_active":"2024-09-18T01:27:13.393720+0000","last_peered":"2024-09-18T01:27:13.393720+0000","last_clean":"2024-09-18T01:27:13.393720+0000","last_became_active":"2024-09-18T01:25:08.680916+0000","last_became_peered":"2024-09-18T01:25:08.680916+0000","last_unstale":"2024-09-18T01:27:13.393720+0000","last_undegraded":"2024-09-18T01:27:13.393720+0000","last_fullsized":"2024-09-18T01:27:13.393720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:09:03.211587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851720+0000","last_change":"2024-09-18T01:25:06.694171+0000","last_active":"2024-09-18T01:25:43.851720+0000","last_peered":"2024-09-18T01:25:43.851720+0000","last_clean":"2024-09-18T01:25:43.851720+0000","last_became_active":"2024-09-18T01:25:06.693000+0000","last_became_peered":"2024-09-18T01:25:06.693000+0000","last_unstale":"2024-09-18T01:25:43.851720+0000","last_undegraded":"2024-09-18T01:25:43.851720+0000","last_fullsized":"2024-09-18T01:25:43.851720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:50:30.604573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:49.302585+0000","last_change":"2024-09-18T01:25:06.694282+0000","last_active":"2024-09-18T01:25:49.302585+0000","last_peered":"2024-09-18T01:25:49.302585+0000","last_clean":"2024-09-18T01:25:49.302585+0000","last_became_active":"2024-09-18T01:25:06.691141+0000","last_became_peered":"2024-09-18T01:25:06.691141+0000","last_unstale":"2024-09-18T01:25:49.302585+0000","last_undegraded":"2024-09-18T01:25:49.302585+0000","last_fullsized":"2024-09-18T01:25:49.302585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:04.323530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'12","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.870361+0000","last_change":"2024-09-18T01:25:08.681504+0000","last_active":"2024-09-18T01:28:16.870361+0000","last_peered":"2024-09-18T01:28:16.870361+0000","last_clean":"2024-09-18T01:28:16.870361+0000","last_became_active":"2024-09-18T01:25:08.681053+0000","last_became_peered":"2024-09-18T01:25:08.681053+0000","last_unstale":"2024-09-18T01:28:16.870361+0000","last_undegraded":"2024-09-18T01:28:16.870361+0000","last_fullsized":"2024-09-18T01:28:16.870361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:34:57.289152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844207+0000","last_change":"2024-09-18T01:25:06.696528+0000","last_active":"2024-09-18T01:25:43.844207+0000","last_peered":"2024-09-18T01:25:43.844207+0000","last_clean":"2024-09-18T01:25:43.844207+0000","last_became_active":"2024-09-18T01:25:06.695875+0000","last_became_peered":"2024-09-18T01:25:06.695875+0000","last_unstale":"2024-09-18T01:25:43.844207+0000","last_undegraded":"2024-09-18T01:25:43.844207+0000","last_fullsized":"2024-09-18T01:25:43.844207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:22.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097034+0000","last_change":"2024-09-18T01:25:08.688042+0000","last_active":"2024-09-18T01:28:17.097034+0000","last_peered":"2024-09-18T01:28:17.097034+0000","last_clean":"2024-09-18T01:28:17.097034+0000","last_became_active":"2024-09-18T01:25:08.687583+0000","last_became_peered":"2024-09-18T01:25:08.687583+0000","last_unstale":"2024-09-18T01:28:17.097034+0000","last_undegraded":"2024-09-18T01:28:17.097034+0000","last_fullsized":"2024-09-18T01:28:17.097034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:55:06.296443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1467,"ondisk_log_size":1467,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48388,"kb_used_data":8884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323452,"statfs":{"total":96636764160,"available":96587214848,"internally_reserved":0,"allocated":9097216,"data_stored":8762447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673006,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44744,"kb_used_data":9400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327096,"statfs":{"total":96636764160,"available":96590946304,"internally_reserved":0,"allocated":9625600,"data_stored":9350220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673007,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44772,"kb_used_data":9428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327068,"statfs":{"total":96636764160,"available":96590917632,"internally_reserved":0,"allocated":9654272,"data_stored":9352298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48360,"kb_used_data":8856,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323480,"statfs":{"total":96636764160,"available":96587243520,"internally_reserved":0,"allocated":9068544,"data_stored":8760581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:28:24.561 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T01:28:24.561 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:28:24.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.687+0000 7f1fdd0e4640 1 Processor -- start 2024-09-18T01:28:24.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.687+0000 7f1fdd0e4640 1 -- start start 2024-09-18T01:28:24.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.688+0000 7f1fdd0e4640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1fd809a100 0x7f1fd8133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:24.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.688+0000 7f1fdd0e4640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fd809d3b0 con 0x7f1fd809bd50 2024-09-18T01:28:24.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.688+0000 7f1fdd0e4640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f1fd809c840 con 0x7f1fd809a100 2024-09-18T01:28:24.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.688+0000 7f1fd659c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1fd809a100 0x7f1fd8133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:24.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.688+0000 7f1fd6d9d640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f1fd809bd50 0x7f1fd809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56646/0 (socket says 172.21.15.92:56646) 2024-09-18T01:28:24.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.688+0000 7f1fd6d9d640 1 -- 172.21.15.92:0/3768764968 learned_addr learned my addr 172.21.15.92:0/3768764968 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:28:24.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.688+0000 7f1fd659c640 1 -- 172.21.15.92:0/3768764968 >> v1:172.21.15.92:6789/0 conn(0x7f1fd809bd50 legacy=0x7f1fd809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:24.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.688+0000 7f1fd5d9b640 1 -- 172.21.15.92:0/3768764968 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1202878309 0 0) 0x7f1fc8001110 con 0x7f1fd809bd50 2024-09-18T01:28:24.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.688+0000 7f1fd659c640 1 -- 172.21.15.92:0/3768764968 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd8098230 con 0x7f1fd809a100 2024-09-18T01:28:24.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.689+0000 7f1fd659c640 1 --2- 172.21.15.92:0/3768764968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd809a100 0x7f1fd8133da0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009720 tx=0x7f1fcc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8aa8f9c68ce0779 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:24.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.689+0000 7f1fd5d9b640 1 -- 172.21.15.92:0/3768764968 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fcc037070 con 0x7f1fd809a100 2024-09-18T01:28:24.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.689+0000 7f1fd5d9b640 1 -- 172.21.15.92:0/3768764968 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc02ad90 con 0x7f1fd809a100 2024-09-18T01:28:24.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.689+0000 7f1fd5d9b640 1 -- 172.21.15.92:0/3768764968 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fcc032590 con 0x7f1fd809a100 2024-09-18T01:28:24.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.690+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/3768764968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd809a100 msgr2=0x7f1fd8133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:24.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.690+0000 7f1fdd0e4640 1 --2- 172.21.15.92:0/3768764968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd809a100 0x7f1fd8133da0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009720 tx=0x7f1fcc02a110 comp rx=0 tx=0).stop 2024-09-18T01:28:24.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.690+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/3768764968 shutdown_connections 2024-09-18T01:28:24.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.690+0000 7f1fdd0e4640 1 --2- 172.21.15.92:0/3768764968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd809a100 0x7f1fd8133da0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:24.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.690+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/3768764968 >> 172.21.15.92:0/3768764968 conn(0x7f1fd806d4a0 msgr2=0x7f1fd806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:24.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.690+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/3768764968 shutdown_connections 2024-09-18T01:28:24.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.690+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/3768764968 wait complete. 2024-09-18T01:28:24.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.691+0000 7f1fdd0e4640 1 Processor -- start 2024-09-18T01:28:24.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.691+0000 7f1fdd0e4640 1 -- start start 2024-09-18T01:28:24.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.691+0000 7f1fdd0e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd809a100 0x7f1fd81c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:24.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.691+0000 7f1fdd0e4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd8134670 con 0x7f1fd809a100 2024-09-18T01:28:24.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.691+0000 7f1fd6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd809a100 0x7f1fd81c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:24.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.691+0000 7f1fd6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd809a100 0x7f1fd81c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56954/0 (socket says 172.21.15.92:56954) 2024-09-18T01:28:24.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.691+0000 7f1fd6d9d640 1 -- 172.21.15.92:0/1409131805 learned_addr learned my addr 172.21.15.92:0/1409131805 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:24.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.692+0000 7f1fd6d9d640 1 -- 172.21.15.92:0/1409131805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd8095e90 con 0x7f1fd809a100 2024-09-18T01:28:24.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.692+0000 7f1fd6d9d640 1 --2- 172.21.15.92:0/1409131805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd809a100 0x7f1fd81c3990 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800c700 tx=0x7f1fc800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:24.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.692+0000 7f1fbf7fe640 1 -- 172.21.15.92:0/1409131805 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc8018070 con 0x7f1fd809a100 2024-09-18T01:28:24.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.692+0000 7f1fbf7fe640 1 -- 172.21.15.92:0/1409131805 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc80070d0 con 0x7f1fd809a100 2024-09-18T01:28:24.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.692+0000 7f1fbf7fe640 1 -- 172.21.15.92:0/1409131805 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc80073f0 con 0x7f1fd809a100 2024-09-18T01:28:24.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.692+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/1409131805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fd8096d60 con 0x7f1fd809a100 2024-09-18T01:28:24.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.692+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/1409131805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fd81c40b0 con 0x7f1fd809a100 2024-09-18T01:28:24.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.693+0000 7f1fbf7fe640 1 -- 172.21.15.92:0/1409131805 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1fc801b070 con 0x7f1fd809a100 2024-09-18T01:28:24.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.693+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/1409131805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fd809d020 con 0x7f1fd809a100 2024-09-18T01:28:24.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.693+0000 7f1fbf7fe640 1 --2- 172.21.15.92:0/1409131805 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1fc40382a0 0x7f1fc403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:24.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.693+0000 7f1fbf7fe640 1 -- 172.21.15.92:0/1409131805 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f1fc804b0d0 con 0x7f1fd809a100 2024-09-18T01:28:24.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.693+0000 7f1fd659c640 1 --2- 172.21.15.92:0/1409131805 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1fc40382a0 0x7f1fc403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:24.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.694+0000 7f1fd659c640 1 --2- 172.21.15.92:0/1409131805 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1fc40382a0 0x7f1fc403a760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc034000 tx=0x7f1fcc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:24.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.698+0000 7f1fbf7fe640 1 -- 172.21.15.92:0/1409131805 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1fd809d3b0 con 0x7f1fd809a100 2024-09-18T01:28:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.858+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/1409131805 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1fd8096a50 con 0x7f1fc40382a0 2024-09-18T01:28:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.873+0000 7f1fbf7fe640 1 -- 172.21.15.92:0/1409131805 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666015 (secure 0 0 0) 0x7f1fd8096a50 con 0x7f1fc40382a0 2024-09-18T01:28:24.880 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:28:24.886 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-18T01:28:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.877+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/1409131805 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1fc40382a0 msgr2=0x7f1fc403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.877+0000 7f1fdd0e4640 1 --2- 172.21.15.92:0/1409131805 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1fc40382a0 0x7f1fc403a760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc034000 tx=0x7f1fcc02e000 comp rx=0 tx=0).stop 2024-09-18T01:28:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.877+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/1409131805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd809a100 msgr2=0x7f1fd81c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.877+0000 7f1fdd0e4640 1 --2- 172.21.15.92:0/1409131805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd809a100 0x7f1fd81c3990 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800c700 tx=0x7f1fc800cbc0 comp rx=0 tx=0).stop 2024-09-18T01:28:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.877+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/1409131805 shutdown_connections 2024-09-18T01:28:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.877+0000 7f1fdd0e4640 1 --2- 172.21.15.92:0/1409131805 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f1fc40382a0 0x7f1fc403a760 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.877+0000 7f1fdd0e4640 1 --2- 172.21.15.92:0/1409131805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd809a100 0x7f1fd81c3990 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.877+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/1409131805 >> 172.21.15.92:0/1409131805 conn(0x7f1fd806d4a0 msgr2=0x7f1fd809f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:24.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.877+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/1409131805 shutdown_connections 2024-09-18T01:28:24.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:24.877+0000 7f1fdd0e4640 1 -- 172.21.15.92:0/1409131805 wait complete. 2024-09-18T01:28:24.889 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-18T01:28:24.826810+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13176026,"num_objects":257,"num_object_clones":0,"num_object_copies":520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":5334,"num_read_kb":4886,"num_write":2354,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":993,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4768,"ondisk_log_size":4768,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":161052,"kb_used_data":11348,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377326308,"statfs":{"total":386547056640,"available":386382139392,"internally_reserved":0,"allocated":11620352,"data_stored":10405036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12574905,"num_objects":5,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":664,"num_read_kb":626,"num_write":440,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003740"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846091+0000","last_change":"2024-09-18T01:25:06.692305+0000","last_active":"2024-09-18T01:25:43.846091+0000","last_peered":"2024-09-18T01:25:43.846091+0000","last_clean":"2024-09-18T01:25:43.846091+0000","last_became_active":"2024-09-18T01:25:06.691940+0000","last_became_peered":"2024-09-18T01:25:06.691940+0000","last_unstale":"2024-09-18T01:25:43.846091+0000","last_undegraded":"2024-09-18T01:25:43.846091+0000","last_fullsized":"2024-09-18T01:25:43.846091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:24.579150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'13","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153106+0000","last_change":"2024-09-18T01:25:08.683809+0000","last_active":"2024-09-18T01:28:17.153106+0000","last_peered":"2024-09-18T01:28:17.153106+0000","last_clean":"2024-09-18T01:28:17.153106+0000","last_became_active":"2024-09-18T01:25:08.683538+0000","last_became_peered":"2024-09-18T01:25:08.683538+0000","last_unstale":"2024-09-18T01:28:17.153106+0000","last_undegraded":"2024-09-18T01:28:17.153106+0000","last_fullsized":"2024-09-18T01:28:17.153106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:05.611732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.796081+0000","last_change":"2024-09-18T01:25:06.687454+0000","last_active":"2024-09-18T01:27:12.796081+0000","last_peered":"2024-09-18T01:27:12.796081+0000","last_clean":"2024-09-18T01:27:12.796081+0000","last_became_active":"2024-09-18T01:25:06.686950+0000","last_became_peered":"2024-09-18T01:25:06.686950+0000","last_unstale":"2024-09-18T01:27:12.796081+0000","last_undegraded":"2024-09-18T01:27:12.796081+0000","last_fullsized":"2024-09-18T01:27:12.796081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:03.894308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'20","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954431+0000","last_change":"2024-09-18T01:25:08.673859+0000","last_active":"2024-09-18T01:28:16.954431+0000","last_peered":"2024-09-18T01:28:16.954431+0000","last_clean":"2024-09-18T01:28:16.954431+0000","last_became_active":"2024-09-18T01:25:08.673552+0000","last_became_peered":"2024-09-18T01:25:08.673552+0000","last_unstale":"2024-09-18T01:28:16.954431+0000","last_undegraded":"2024-09-18T01:28:16.954431+0000","last_fullsized":"2024-09-18T01:28:16.954431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:50:57.219183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.852159+0000","last_change":"2024-09-18T01:25:06.687698+0000","last_active":"2024-09-18T01:25:43.852159+0000","last_peered":"2024-09-18T01:25:43.852159+0000","last_clean":"2024-09-18T01:25:43.852159+0000","last_became_active":"2024-09-18T01:25:06.687068+0000","last_became_peered":"2024-09-18T01:25:06.687068+0000","last_unstale":"2024-09-18T01:25:43.852159+0000","last_undegraded":"2024-09-18T01:25:43.852159+0000","last_fullsized":"2024-09-18T01:25:43.852159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:28.131866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'10","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097039+0000","last_change":"2024-09-18T01:25:08.685372+0000","last_active":"2024-09-18T01:28:17.097039+0000","last_peered":"2024-09-18T01:28:17.097039+0000","last_clean":"2024-09-18T01:28:17.097039+0000","last_became_active":"2024-09-18T01:25:08.685074+0000","last_became_peered":"2024-09-18T01:25:08.685074+0000","last_unstale":"2024-09-18T01:28:17.097039+0000","last_undegraded":"2024-09-18T01:28:17.097039+0000","last_fullsized":"2024-09-18T01:28:17.097039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:49.546714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844176+0000","last_change":"2024-09-18T01:25:06.690926+0000","last_active":"2024-09-18T01:25:43.844176+0000","last_peered":"2024-09-18T01:25:43.844176+0000","last_clean":"2024-09-18T01:25:43.844176+0000","last_became_active":"2024-09-18T01:25:06.690552+0000","last_became_peered":"2024-09-18T01:25:06.690552+0000","last_unstale":"2024-09-18T01:25:43.844176+0000","last_undegraded":"2024-09-18T01:25:43.844176+0000","last_fullsized":"2024-09-18T01:25:43.844176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:39:53.953032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'8","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.453023+0000","last_change":"2024-09-18T01:25:08.676582+0000","last_active":"2024-09-18T01:25:50.453023+0000","last_peered":"2024-09-18T01:25:50.453023+0000","last_clean":"2024-09-18T01:25:50.453023+0000","last_became_active":"2024-09-18T01:25:08.674210+0000","last_became_peered":"2024-09-18T01:25:08.674210+0000","last_unstale":"2024-09-18T01:25:50.453023+0000","last_undegraded":"2024-09-18T01:25:50.453023+0000","last_fullsized":"2024-09-18T01:25:50.453023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:19:54.471269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.435444+0000","last_change":"2024-09-18T01:25:06.689859+0000","last_active":"2024-09-18T01:27:16.435444+0000","last_peered":"2024-09-18T01:27:16.435444+0000","last_clean":"2024-09-18T01:27:16.435444+0000","last_became_active":"2024-09-18T01:25:06.687608+0000","last_became_peered":"2024-09-18T01:25:06.687608+0000","last_unstale":"2024-09-18T01:27:16.435444+0000","last_undegraded":"2024-09-18T01:27:16.435444+0000","last_fullsized":"2024-09-18T01:27:16.435444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:30:22.917213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.387179+0000","last_change":"2024-09-18T01:25:08.684086+0000","last_active":"2024-09-18T01:27:13.387179+0000","last_peered":"2024-09-18T01:27:13.387179+0000","last_clean":"2024-09-18T01:27:13.387179+0000","last_became_active":"2024-09-18T01:25:08.683812+0000","last_became_peered":"2024-09-18T01:25:08.683812+0000","last_unstale":"2024-09-18T01:27:13.387179+0000","last_undegraded":"2024-09-18T01:27:13.387179+0000","last_fullsized":"2024-09-18T01:27:13.387179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:37.287772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.092252+0000","last_change":"2024-09-18T01:25:06.702940+0000","last_active":"2024-09-18T01:28:17.092252+0000","last_peered":"2024-09-18T01:28:17.092252+0000","last_clean":"2024-09-18T01:28:17.092252+0000","last_became_active":"2024-09-18T01:25:06.702616+0000","last_became_peered":"2024-09-18T01:25:06.702616+0000","last_unstale":"2024-09-18T01:28:17.092252+0000","last_undegraded":"2024-09-18T01:28:17.092252+0000","last_fullsized":"2024-09-18T01:28:17.092252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:53.580899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'8","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.956371+0000","last_change":"2024-09-18T01:25:43.904757+0000","last_active":"2024-09-18T01:28:16.956371+0000","last_peered":"2024-09-18T01:28:16.956371+0000","last_clean":"2024-09-18T01:28:16.956371+0000","last_became_active":"2024-09-18T01:25:43.904427+0000","last_became_peered":"2024-09-18T01:25:43.904427+0000","last_unstale":"2024-09-18T01:28:16.956371+0000","last_undegraded":"2024-09-18T01:28:16.956371+0000","last_fullsized":"2024-09-18T01:28:16.956371+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:33:47.798452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848729+0000","last_change":"2024-09-18T01:25:06.683548+0000","last_active":"2024-09-18T01:25:43.848729+0000","last_peered":"2024-09-18T01:25:43.848729+0000","last_clean":"2024-09-18T01:25:43.848729+0000","last_became_active":"2024-09-18T01:25:06.683195+0000","last_became_peered":"2024-09-18T01:25:06.683195+0000","last_unstale":"2024-09-18T01:25:43.848729+0000","last_undegraded":"2024-09-18T01:25:43.848729+0000","last_fullsized":"2024-09-18T01:25:43.848729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:13.167515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.796067+0000","last_change":"2024-09-18T01:25:08.677859+0000","last_active":"2024-09-18T01:27:14.796067+0000","last_peered":"2024-09-18T01:27:14.796067+0000","last_clean":"2024-09-18T01:27:14.796067+0000","last_became_active":"2024-09-18T01:25:08.677579+0000","last_became_peered":"2024-09-18T01:25:08.677579+0000","last_unstale":"2024-09-18T01:27:14.796067+0000","last_undegraded":"2024-09-18T01:27:14.796067+0000","last_fullsized":"2024-09-18T01:27:14.796067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:39.586169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844028+0000","last_change":"2024-09-18T01:25:06.686453+0000","last_active":"2024-09-18T01:25:43.844028+0000","last_peered":"2024-09-18T01:25:43.844028+0000","last_clean":"2024-09-18T01:25:43.844028+0000","last_became_active":"2024-09-18T01:25:06.686049+0000","last_became_peered":"2024-09-18T01:25:06.686049+0000","last_unstale":"2024-09-18T01:25:43.844028+0000","last_undegraded":"2024-09-18T01:25:43.844028+0000","last_fullsized":"2024-09-18T01:25:43.844028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:53.580899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.477318+0000","last_change":"2024-09-18T01:25:08.676582+0000","last_active":"2024-09-18T01:27:16.477318+0000","last_peered":"2024-09-18T01:27:16.477318+0000","last_clean":"2024-09-18T01:27:16.477318+0000","last_became_active":"2024-09-18T01:25:08.676310+0000","last_became_peered":"2024-09-18T01:25:08.676310+0000","last_unstale":"2024-09-18T01:27:16.477318+0000","last_undegraded":"2024-09-18T01:27:16.477318+0000","last_fullsized":"2024-09-18T01:27:16.477318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:55:06.296443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'24","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.104105+0000","last_change":"2024-09-18T01:25:08.673269+0000","last_active":"2024-09-18T01:28:17.104105+0000","last_peered":"2024-09-18T01:28:17.104105+0000","last_clean":"2024-09-18T01:28:17.104105+0000","last_became_active":"2024-09-18T01:25:08.671858+0000","last_became_peered":"2024-09-18T01:25:08.671858+0000","last_unstale":"2024-09-18T01:28:17.104105+0000","last_undegraded":"2024-09-18T01:28:17.104105+0000","last_fullsized":"2024-09-18T01:28:17.104105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:50:36.347808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":55,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.907039+0000","last_change":"2024-09-18T01:25:06.691701+0000","last_active":"2024-09-18T01:25:43.907039+0000","last_peered":"2024-09-18T01:25:43.907039+0000","last_clean":"2024-09-18T01:25:43.907039+0000","last_became_active":"2024-09-18T01:25:06.691034+0000","last_became_peered":"2024-09-18T01:25:06.691034+0000","last_unstale":"2024-09-18T01:25:43.907039+0000","last_undegraded":"2024-09-18T01:25:43.907039+0000","last_fullsized":"2024-09-18T01:25:43.907039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:43.801545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'3","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799237+0000","last_change":"2024-09-18T01:25:08.685309+0000","last_active":"2024-09-18T01:27:29.799237+0000","last_peered":"2024-09-18T01:27:29.799237+0000","last_clean":"2024-09-18T01:27:29.799237+0000","last_became_active":"2024-09-18T01:25:08.685043+0000","last_became_peered":"2024-09-18T01:25:08.685043+0000","last_unstale":"2024-09-18T01:27:29.799237+0000","last_undegraded":"2024-09-18T01:27:29.799237+0000","last_fullsized":"2024-09-18T01:27:29.799237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:39.586169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846314+0000","last_change":"2024-09-18T01:25:06.704767+0000","last_active":"2024-09-18T01:25:43.846314+0000","last_peered":"2024-09-18T01:25:43.846314+0000","last_clean":"2024-09-18T01:25:43.846314+0000","last_became_active":"2024-09-18T01:25:06.704414+0000","last_became_peered":"2024-09-18T01:25:06.704414+0000","last_unstale":"2024-09-18T01:25:43.846314+0000","last_undegraded":"2024-09-18T01:25:43.846314+0000","last_fullsized":"2024-09-18T01:25:43.846314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:43.801545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097079+0000","last_change":"2024-09-18T01:25:08.685665+0000","last_active":"2024-09-18T01:28:17.097079+0000","last_peered":"2024-09-18T01:28:17.097079+0000","last_clean":"2024-09-18T01:28:17.097079+0000","last_became_active":"2024-09-18T01:25:08.684921+0000","last_became_peered":"2024-09-18T01:25:08.684921+0000","last_unstale":"2024-09-18T01:28:17.097079+0000","last_undegraded":"2024-09-18T01:28:17.097079+0000","last_fullsized":"2024-09-18T01:28:17.097079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:15:04.998223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'3","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.741010+0000","last_change":"2024-09-18T01:25:06.688208+0000","last_active":"2024-09-18T01:26:32.741010+0000","last_peered":"2024-09-18T01:26:32.741010+0000","last_clean":"2024-09-18T01:26:32.741010+0000","last_became_active":"2024-09-18T01:25:06.687737+0000","last_became_peered":"2024-09-18T01:25:06.687737+0000","last_unstale":"2024-09-18T01:26:32.741010+0000","last_undegraded":"2024-09-18T01:26:32.741010+0000","last_fullsized":"2024-09-18T01:26:32.741010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:16.022647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'16","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.394341+0000","last_change":"2024-09-18T01:25:08.671649+0000","last_active":"2024-09-18T01:27:13.394341+0000","last_peered":"2024-09-18T01:27:13.394341+0000","last_clean":"2024-09-18T01:27:13.394341+0000","last_became_active":"2024-09-18T01:25:08.671338+0000","last_became_peered":"2024-09-18T01:25:08.671338+0000","last_unstale":"2024-09-18T01:27:13.394341+0000","last_undegraded":"2024-09-18T01:27:13.394341+0000","last_fullsized":"2024-09-18T01:27:13.394341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:55:06.296443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905086+0000","last_change":"2024-09-18T01:25:06.688689+0000","last_active":"2024-09-18T01:25:43.905086+0000","last_peered":"2024-09-18T01:25:43.905086+0000","last_clean":"2024-09-18T01:25:43.905086+0000","last_became_active":"2024-09-18T01:25:06.688356+0000","last_became_peered":"2024-09-18T01:25:06.688356+0000","last_unstale":"2024-09-18T01:25:43.905086+0000","last_undegraded":"2024-09-18T01:25:43.905086+0000","last_fullsized":"2024-09-18T01:25:43.905086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:22.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941235+0000","last_change":"2024-09-18T01:25:08.674151+0000","last_active":"2024-09-18T01:26:32.941235+0000","last_peered":"2024-09-18T01:26:32.941235+0000","last_clean":"2024-09-18T01:26:32.941235+0000","last_became_active":"2024-09-18T01:25:08.673915+0000","last_became_peered":"2024-09-18T01:25:08.673915+0000","last_unstale":"2024-09-18T01:26:32.941235+0000","last_undegraded":"2024-09-18T01:26:32.941235+0000","last_fullsized":"2024-09-18T01:26:32.941235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:42:49.663850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846696+0000","last_change":"2024-09-18T01:25:06.687453+0000","last_active":"2024-09-18T01:25:43.846696+0000","last_peered":"2024-09-18T01:25:43.846696+0000","last_clean":"2024-09-18T01:25:43.846696+0000","last_became_active":"2024-09-18T01:25:06.686900+0000","last_became_peered":"2024-09-18T01:25:06.686900+0000","last_unstale":"2024-09-18T01:25:43.846696+0000","last_undegraded":"2024-09-18T01:25:43.846696+0000","last_fullsized":"2024-09-18T01:25:43.846696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:18.475907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.142353+0000","last_change":"2024-09-18T01:25:08.682513+0000","last_active":"2024-09-18T01:28:17.142353+0000","last_peered":"2024-09-18T01:28:17.142353+0000","last_clean":"2024-09-18T01:28:17.142353+0000","last_became_active":"2024-09-18T01:25:08.682225+0000","last_became_peered":"2024-09-18T01:25:08.682225+0000","last_unstale":"2024-09-18T01:28:17.142353+0000","last_undegraded":"2024-09-18T01:28:17.142353+0000","last_fullsized":"2024-09-18T01:28:17.142353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:34:57.289152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849721+0000","last_change":"2024-09-18T01:25:06.695620+0000","last_active":"2024-09-18T01:25:43.849721+0000","last_peered":"2024-09-18T01:25:43.849721+0000","last_clean":"2024-09-18T01:25:43.849721+0000","last_became_active":"2024-09-18T01:25:06.693647+0000","last_became_peered":"2024-09-18T01:25:06.693647+0000","last_unstale":"2024-09-18T01:25:43.849721+0000","last_undegraded":"2024-09-18T01:25:43.849721+0000","last_fullsized":"2024-09-18T01:25:43.849721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:00:13.013796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'35","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.121409+0000","last_change":"2024-09-18T01:25:16.712693+0000","last_active":"2024-09-18T01:28:17.121409+0000","last_peered":"2024-09-18T01:28:17.121409+0000","last_clean":"2024-09-18T01:28:17.121409+0000","last_became_active":"2024-09-18T01:25:16.712438+0000","last_became_peered":"2024-09-18T01:25:16.712438+0000","last_unstale":"2024-09-18T01:28:17.121409+0000","last_undegraded":"2024-09-18T01:28:17.121409+0000","last_fullsized":"2024-09-18T01:28:17.121409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:49.191321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.485988+0000","last_change":"2024-09-18T01:25:08.673859+0000","last_active":"2024-09-18T01:27:16.485988+0000","last_peered":"2024-09-18T01:27:16.485988+0000","last_clean":"2024-09-18T01:27:16.485988+0000","last_became_active":"2024-09-18T01:25:08.673605+0000","last_became_peered":"2024-09-18T01:25:08.673605+0000","last_unstale":"2024-09-18T01:27:16.485988+0000","last_undegraded":"2024-09-18T01:27:16.485988+0000","last_fullsized":"2024-09-18T01:27:16.485988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:55:33.999113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849855+0000","last_change":"2024-09-18T01:25:06.687788+0000","last_active":"2024-09-18T01:25:43.849855+0000","last_peered":"2024-09-18T01:25:43.849855+0000","last_clean":"2024-09-18T01:25:43.849855+0000","last_became_active":"2024-09-18T01:25:06.685173+0000","last_became_peered":"2024-09-18T01:25:06.685173+0000","last_unstale":"2024-09-18T01:25:43.849855+0000","last_undegraded":"2024-09-18T01:25:43.849855+0000","last_fullsized":"2024-09-18T01:25:43.849855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:13.192602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850787+0000","last_change":"2024-09-18T01:25:10.684730+0000","last_active":"2024-09-18T01:25:43.850787+0000","last_peered":"2024-09-18T01:25:43.850787+0000","last_clean":"2024-09-18T01:25:43.850787+0000","last_became_active":"2024-09-18T01:25:10.684454+0000","last_became_peered":"2024-09-18T01:25:10.684454+0000","last_unstale":"2024-09-18T01:25:43.850787+0000","last_undegraded":"2024-09-18T01:25:43.850787+0000","last_fullsized":"2024-09-18T01:25:43.850787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:30:35.363182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'45","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.827159+0000","last_change":"2024-09-18T01:25:12.692370+0000","last_active":"2024-09-18T01:28:23.827159+0000","last_peered":"2024-09-18T01:28:23.827159+0000","last_clean":"2024-09-18T01:28:23.827159+0000","last_became_active":"2024-09-18T01:25:12.692059+0000","last_became_peered":"2024-09-18T01:25:12.692059+0000","last_unstale":"2024-09-18T01:28:23.827159+0000","last_undegraded":"2024-09-18T01:28:23.827159+0000","last_fullsized":"2024-09-18T01:28:23.827159+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:17:50.198957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906790+0000","last_change":"2024-09-18T01:25:14.710315+0000","last_active":"2024-09-18T01:25:43.906790+0000","last_peered":"2024-09-18T01:25:43.906790+0000","last_clean":"2024-09-18T01:25:43.906790+0000","last_became_active":"2024-09-18T01:25:14.709879+0000","last_became_peered":"2024-09-18T01:25:14.709879+0000","last_unstale":"2024-09-18T01:25:43.906790+0000","last_undegraded":"2024-09-18T01:25:43.906790+0000","last_fullsized":"2024-09-18T01:25:43.906790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:49.524031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.757439+0000","last_change":"2024-09-18T01:25:16.712032+0000","last_active":"2024-09-18T01:26:32.757439+0000","last_peered":"2024-09-18T01:26:32.757439+0000","last_clean":"2024-09-18T01:26:32.757439+0000","last_became_active":"2024-09-18T01:25:16.711764+0000","last_became_peered":"2024-09-18T01:25:16.711764+0000","last_unstale":"2024-09-18T01:26:32.757439+0000","last_undegraded":"2024-09-18T01:26:32.757439+0000","last_fullsized":"2024-09-18T01:26:32.757439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:53:25.033231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:44.783814+0000","last_change":"2024-09-18T01:25:43.852201+0000","last_active":"2024-09-18T01:25:44.783814+0000","last_peered":"2024-09-18T01:25:44.783814+0000","last_clean":"2024-09-18T01:25:44.783814+0000","last_became_active":"2024-09-18T01:25:43.848631+0000","last_became_peered":"2024-09-18T01:25:43.848631+0000","last_unstale":"2024-09-18T01:25:44.783814+0000","last_undegraded":"2024-09-18T01:25:44.783814+0000","last_fullsized":"2024-09-18T01:25:44.783814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:19:57.986757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:49.297524+0000","last_change":"2024-09-18T01:25:06.691194+0000","last_active":"2024-09-18T01:25:49.297524+0000","last_peered":"2024-09-18T01:25:49.297524+0000","last_clean":"2024-09-18T01:25:49.297524+0000","last_became_active":"2024-09-18T01:25:06.690813+0000","last_became_peered":"2024-09-18T01:25:06.690813+0000","last_unstale":"2024-09-18T01:25:49.297524+0000","last_undegraded":"2024-09-18T01:25:49.297524+0000","last_fullsized":"2024-09-18T01:25:49.297524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:22.518297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844623+0000","last_change":"2024-09-18T01:25:10.677775+0000","last_active":"2024-09-18T01:25:43.844623+0000","last_peered":"2024-09-18T01:25:43.844623+0000","last_clean":"2024-09-18T01:25:43.844623+0000","last_became_active":"2024-09-18T01:25:10.677226+0000","last_became_peered":"2024-09-18T01:25:10.677226+0000","last_unstale":"2024-09-18T01:25:43.844623+0000","last_undegraded":"2024-09-18T01:25:43.844623+0000","last_fullsized":"2024-09-18T01:25:43.844623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:49:15.909145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'13","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906372+0000","last_change":"2024-09-18T01:25:12.688633+0000","last_active":"2024-09-18T01:25:43.906372+0000","last_peered":"2024-09-18T01:25:43.906372+0000","last_clean":"2024-09-18T01:25:43.906372+0000","last_became_active":"2024-09-18T01:25:12.688366+0000","last_became_peered":"2024-09-18T01:25:12.688366+0000","last_unstale":"2024-09-18T01:25:43.906372+0000","last_undegraded":"2024-09-18T01:25:43.906372+0000","last_fullsized":"2024-09-18T01:25:43.906372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:39:55.232921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905614+0000","last_change":"2024-09-18T01:25:14.703217+0000","last_active":"2024-09-18T01:25:43.905614+0000","last_peered":"2024-09-18T01:25:43.905614+0000","last_clean":"2024-09-18T01:25:43.905614+0000","last_became_active":"2024-09-18T01:25:14.702918+0000","last_became_peered":"2024-09-18T01:25:14.702918+0000","last_unstale":"2024-09-18T01:25:43.905614+0000","last_undegraded":"2024-09-18T01:25:43.905614+0000","last_fullsized":"2024-09-18T01:25:43.905614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:23.103965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.232357+0000","last_change":"2024-09-18T01:25:16.714035+0000","last_active":"2024-09-18T01:28:17.232357+0000","last_peered":"2024-09-18T01:28:17.232357+0000","last_clean":"2024-09-18T01:28:17.232357+0000","last_became_active":"2024-09-18T01:25:16.713571+0000","last_became_peered":"2024-09-18T01:25:16.713571+0000","last_unstale":"2024-09-18T01:28:17.232357+0000","last_undegraded":"2024-09-18T01:28:17.232357+0000","last_fullsized":"2024-09-18T01:28:17.232357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:32:22.558708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'8","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176653+0000","last_change":"2024-09-18T01:25:08.673278+0000","last_active":"2024-09-18T01:28:17.176653+0000","last_peered":"2024-09-18T01:28:17.176653+0000","last_clean":"2024-09-18T01:28:17.176653+0000","last_became_active":"2024-09-18T01:25:08.671904+0000","last_became_peered":"2024-09-18T01:25:08.671904+0000","last_unstale":"2024-09-18T01:28:17.176653+0000","last_undegraded":"2024-09-18T01:28:17.176653+0000","last_fullsized":"2024-09-18T01:28:17.176653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:58:59.174725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848365+0000","last_change":"2024-09-18T01:25:06.681491+0000","last_active":"2024-09-18T01:25:43.848365+0000","last_peered":"2024-09-18T01:25:43.848365+0000","last_clean":"2024-09-18T01:25:43.848365+0000","last_became_active":"2024-09-18T01:25:06.681065+0000","last_became_peered":"2024-09-18T01:25:06.681065+0000","last_unstale":"2024-09-18T01:25:43.848365+0000","last_undegraded":"2024-09-18T01:25:43.848365+0000","last_fullsized":"2024-09-18T01:25:43.848365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:46:18.563504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847654+0000","last_change":"2024-09-18T01:25:10.677498+0000","last_active":"2024-09-18T01:25:43.847654+0000","last_peered":"2024-09-18T01:25:43.847654+0000","last_clean":"2024-09-18T01:25:43.847654+0000","last_became_active":"2024-09-18T01:25:10.677118+0000","last_became_peered":"2024-09-18T01:25:10.677118+0000","last_unstale":"2024-09-18T01:25:43.847654+0000","last_undegraded":"2024-09-18T01:25:43.847654+0000","last_fullsized":"2024-09-18T01:25:43.847654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:13.973263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'22","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844252+0000","last_change":"2024-09-18T01:25:12.693775+0000","last_active":"2024-09-18T01:25:43.844252+0000","last_peered":"2024-09-18T01:25:43.844252+0000","last_clean":"2024-09-18T01:25:43.844252+0000","last_became_active":"2024-09-18T01:25:12.693426+0000","last_became_peered":"2024-09-18T01:25:12.693426+0000","last_unstale":"2024-09-18T01:25:43.844252+0000","last_undegraded":"2024-09-18T01:25:43.844252+0000","last_fullsized":"2024-09-18T01:25:43.844252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:03.617713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'285","reported_seq":384,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.712169+0000","last_change":"2024-09-18T01:25:14.707813+0000","last_active":"2024-09-18T01:28:23.712169+0000","last_peered":"2024-09-18T01:28:23.712169+0000","last_clean":"2024-09-18T01:28:23.712169+0000","last_became_active":"2024-09-18T01:25:14.707544+0000","last_became_peered":"2024-09-18T01:25:14.707544+0000","last_unstale":"2024-09-18T01:28:23.712169+0000","last_undegraded":"2024-09-18T01:28:23.712169+0000","last_fullsized":"2024-09-18T01:28:23.712169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:19.273177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843579+0000","last_change":"2024-09-18T01:25:16.714182+0000","last_active":"2024-09-18T01:25:43.843579+0000","last_peered":"2024-09-18T01:25:43.843579+0000","last_clean":"2024-09-18T01:25:43.843579+0000","last_became_active":"2024-09-18T01:25:16.713458+0000","last_became_peered":"2024-09-18T01:25:16.713458+0000","last_unstale":"2024-09-18T01:25:43.843579+0000","last_undegraded":"2024-09-18T01:25:43.843579+0000","last_fullsized":"2024-09-18T01:25:43.843579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:25.118447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847600+0000","last_change":"2024-09-18T01:25:08.681420+0000","last_active":"2024-09-18T01:25:43.847600+0000","last_peered":"2024-09-18T01:25:43.847600+0000","last_clean":"2024-09-18T01:25:43.847600+0000","last_became_active":"2024-09-18T01:25:08.680700+0000","last_became_peered":"2024-09-18T01:25:08.680700+0000","last_unstale":"2024-09-18T01:25:43.847600+0000","last_undegraded":"2024-09-18T01:25:43.847600+0000","last_fullsized":"2024-09-18T01:25:43.847600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:15:04.998223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.442367+0000","last_change":"2024-09-18T01:25:06.691595+0000","last_active":"2024-09-18T01:25:50.442367+0000","last_peered":"2024-09-18T01:25:50.442367+0000","last_clean":"2024-09-18T01:25:50.442367+0000","last_became_active":"2024-09-18T01:25:06.691107+0000","last_became_peered":"2024-09-18T01:25:06.691107+0000","last_unstale":"2024-09-18T01:25:50.442367+0000","last_undegraded":"2024-09-18T01:25:50.442367+0000","last_fullsized":"2024-09-18T01:25:50.442367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:50.530673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850726+0000","last_change":"2024-09-18T01:25:10.681604+0000","last_active":"2024-09-18T01:25:43.850726+0000","last_peered":"2024-09-18T01:25:43.850726+0000","last_clean":"2024-09-18T01:25:43.850726+0000","last_became_active":"2024-09-18T01:25:10.681273+0000","last_became_peered":"2024-09-18T01:25:10.681273+0000","last_unstale":"2024-09-18T01:25:43.850726+0000","last_undegraded":"2024-09-18T01:25:43.850726+0000","last_fullsized":"2024-09-18T01:25:43.850726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:22.269662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'42","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.810629+0000","last_change":"2024-09-18T01:25:12.697422+0000","last_active":"2024-09-18T01:28:23.810629+0000","last_peered":"2024-09-18T01:28:23.810629+0000","last_clean":"2024-09-18T01:28:23.810629+0000","last_became_active":"2024-09-18T01:25:12.697114+0000","last_became_peered":"2024-09-18T01:25:12.697114+0000","last_unstale":"2024-09-18T01:28:23.810629+0000","last_undegraded":"2024-09-18T01:28:23.810629+0000","last_fullsized":"2024-09-18T01:28:23.810629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:43:37.538211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":61,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'282","reported_seq":405,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.288775+0000","last_change":"2024-09-18T01:25:14.699167+0000","last_active":"2024-09-18T01:28:17.288775+0000","last_peered":"2024-09-18T01:28:17.288775+0000","last_clean":"2024-09-18T01:28:17.288775+0000","last_became_active":"2024-09-18T01:25:14.698792+0000","last_became_peered":"2024-09-18T01:25:14.698792+0000","last_unstale":"2024-09-18T01:28:17.288775+0000","last_undegraded":"2024-09-18T01:28:17.288775+0000","last_fullsized":"2024-09-18T01:28:17.288775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:49.524031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.147884+0000","last_change":"2024-09-18T01:25:08.680575+0000","last_active":"2024-09-18T01:28:17.147884+0000","last_peered":"2024-09-18T01:28:17.147884+0000","last_clean":"2024-09-18T01:28:17.147884+0000","last_became_active":"2024-09-18T01:25:08.680143+0000","last_became_peered":"2024-09-18T01:25:08.680143+0000","last_unstale":"2024-09-18T01:28:17.147884+0000","last_undegraded":"2024-09-18T01:28:17.147884+0000","last_fullsized":"2024-09-18T01:28:17.147884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:30:09.036921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845910+0000","last_change":"2024-09-18T01:25:06.701050+0000","last_active":"2024-09-18T01:25:43.845910+0000","last_peered":"2024-09-18T01:25:43.845910+0000","last_clean":"2024-09-18T01:25:43.845910+0000","last_became_active":"2024-09-18T01:25:06.700650+0000","last_became_peered":"2024-09-18T01:25:06.700650+0000","last_unstale":"2024-09-18T01:25:43.845910+0000","last_undegraded":"2024-09-18T01:25:43.845910+0000","last_fullsized":"2024-09-18T01:25:43.845910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:03.343944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904327+0000","last_change":"2024-09-18T01:25:10.683497+0000","last_active":"2024-09-18T01:25:43.904327+0000","last_peered":"2024-09-18T01:25:43.904327+0000","last_clean":"2024-09-18T01:25:43.904327+0000","last_became_active":"2024-09-18T01:25:10.683195+0000","last_became_peered":"2024-09-18T01:25:10.683195+0000","last_unstale":"2024-09-18T01:25:43.904327+0000","last_undegraded":"2024-09-18T01:25:43.904327+0000","last_fullsized":"2024-09-18T01:25:43.904327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:18:42.429992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'50","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.839869+0000","last_change":"2024-09-18T01:25:12.688936+0000","last_active":"2024-09-18T01:28:23.839869+0000","last_peered":"2024-09-18T01:28:23.839869+0000","last_clean":"2024-09-18T01:28:23.839869+0000","last_became_active":"2024-09-18T01:25:12.687943+0000","last_became_peered":"2024-09-18T01:25:12.687943+0000","last_unstale":"2024-09-18T01:28:23.839869+0000","last_undegraded":"2024-09-18T01:28:23.839869+0000","last_fullsized":"2024-09-18T01:28:23.839869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:18:44.438408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846245+0000","last_change":"2024-09-18T01:25:14.699129+0000","last_active":"2024-09-18T01:25:43.846245+0000","last_peered":"2024-09-18T01:25:43.846245+0000","last_clean":"2024-09-18T01:25:43.846245+0000","last_became_active":"2024-09-18T01:25:14.698795+0000","last_became_peered":"2024-09-18T01:25:14.698795+0000","last_unstale":"2024-09-18T01:25:43.846245+0000","last_undegraded":"2024-09-18T01:25:43.846245+0000","last_fullsized":"2024-09-18T01:25:43.846245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:48.579196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'3","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.759291+0000","last_change":"2024-09-18T01:25:16.707493+0000","last_active":"2024-09-18T01:26:32.759291+0000","last_peered":"2024-09-18T01:26:32.759291+0000","last_clean":"2024-09-18T01:26:32.759291+0000","last_became_active":"2024-09-18T01:25:16.707206+0000","last_became_peered":"2024-09-18T01:25:16.707206+0000","last_unstale":"2024-09-18T01:26:32.759291+0000","last_undegraded":"2024-09-18T01:26:32.759291+0000","last_fullsized":"2024-09-18T01:26:32.759291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:51.538514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.867670+0000","last_change":"2024-09-18T01:25:08.683170+0000","last_active":"2024-09-18T01:28:16.867670+0000","last_peered":"2024-09-18T01:28:16.867670+0000","last_clean":"2024-09-18T01:28:16.867670+0000","last_became_active":"2024-09-18T01:25:08.682878+0000","last_became_peered":"2024-09-18T01:25:08.682878+0000","last_unstale":"2024-09-18T01:28:16.867670+0000","last_undegraded":"2024-09-18T01:28:16.867670+0000","last_fullsized":"2024-09-18T01:28:16.867670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:29.205884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.170801+0000","last_change":"2024-09-18T01:25:06.700753+0000","last_active":"2024-09-18T01:28:17.170801+0000","last_peered":"2024-09-18T01:28:17.170801+0000","last_clean":"2024-09-18T01:28:17.170801+0000","last_became_active":"2024-09-18T01:25:06.700357+0000","last_became_peered":"2024-09-18T01:25:06.700357+0000","last_unstale":"2024-09-18T01:28:17.170801+0000","last_undegraded":"2024-09-18T01:28:17.170801+0000","last_fullsized":"2024-09-18T01:28:17.170801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:08.432830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":218,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.133643+0000","last_change":"2024-09-18T01:25:10.680004+0000","last_active":"2024-09-18T01:27:16.133643+0000","last_peered":"2024-09-18T01:27:16.133643+0000","last_clean":"2024-09-18T01:27:16.133643+0000","last_became_active":"2024-09-18T01:25:10.679652+0000","last_became_peered":"2024-09-18T01:25:10.679652+0000","last_unstale":"2024-09-18T01:27:16.133643+0000","last_undegraded":"2024-09-18T01:27:16.133643+0000","last_fullsized":"2024-09-18T01:27:16.133643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:02.192046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'39","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.779646+0000","last_change":"2024-09-18T01:25:12.691981+0000","last_active":"2024-09-18T01:28:23.779646+0000","last_peered":"2024-09-18T01:28:23.779646+0000","last_clean":"2024-09-18T01:28:23.779646+0000","last_became_active":"2024-09-18T01:25:12.691691+0000","last_became_peered":"2024-09-18T01:25:12.691691+0000","last_unstale":"2024-09-18T01:28:23.779646+0000","last_undegraded":"2024-09-18T01:28:23.779646+0000","last_fullsized":"2024-09-18T01:28:23.779646+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:40:21.738974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844437+0000","last_change":"2024-09-18T01:25:14.706870+0000","last_active":"2024-09-18T01:25:43.844437+0000","last_peered":"2024-09-18T01:25:43.844437+0000","last_clean":"2024-09-18T01:25:43.844437+0000","last_became_active":"2024-09-18T01:25:14.706505+0000","last_became_peered":"2024-09-18T01:25:14.706505+0000","last_unstale":"2024-09-18T01:25:43.844437+0000","last_undegraded":"2024-09-18T01:25:43.844437+0000","last_fullsized":"2024-09-18T01:25:43.844437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:31:17.162597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'3","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:27.222234+0000","last_change":"2024-09-18T01:25:16.713810+0000","last_active":"2024-09-18T01:26:27.222234+0000","last_peered":"2024-09-18T01:26:27.222234+0000","last_clean":"2024-09-18T01:26:27.222234+0000","last_became_active":"2024-09-18T01:25:16.713453+0000","last_became_peered":"2024-09-18T01:25:16.713453+0000","last_unstale":"2024-09-18T01:26:27.222234+0000","last_undegraded":"2024-09-18T01:26:27.222234+0000","last_fullsized":"2024-09-18T01:26:27.222234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:37.223946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'5","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.796758+0000","last_change":"2024-09-18T01:25:08.674795+0000","last_active":"2024-09-18T01:27:19.796758+0000","last_peered":"2024-09-18T01:27:19.796758+0000","last_clean":"2024-09-18T01:27:19.796758+0000","last_became_active":"2024-09-18T01:25:08.674525+0000","last_became_peered":"2024-09-18T01:25:08.674525+0000","last_unstale":"2024-09-18T01:27:19.796758+0000","last_undegraded":"2024-09-18T01:27:19.796758+0000","last_fullsized":"2024-09-18T01:27:19.796758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:55:50.100041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.083065+0000","last_change":"2024-09-18T01:25:06.696117+0000","last_active":"2024-09-18T01:28:17.083065+0000","last_peered":"2024-09-18T01:28:17.083065+0000","last_clean":"2024-09-18T01:28:17.083065+0000","last_became_active":"2024-09-18T01:25:06.694058+0000","last_became_peered":"2024-09-18T01:25:06.694058+0000","last_unstale":"2024-09-18T01:28:17.083065+0000","last_undegraded":"2024-09-18T01:28:17.083065+0000","last_fullsized":"2024-09-18T01:28:17.083065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:58:41.570989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:44.783777+0000","last_change":"2024-09-18T01:25:43.903991+0000","last_active":"2024-09-18T01:25:44.783777+0000","last_peered":"2024-09-18T01:25:44.783777+0000","last_clean":"2024-09-18T01:25:44.783777+0000","last_became_active":"2024-09-18T01:25:43.903638+0000","last_became_peered":"2024-09-18T01:25:43.903638+0000","last_unstale":"2024-09-18T01:25:44.783777+0000","last_undegraded":"2024-09-18T01:25:44.783777+0000","last_fullsized":"2024-09-18T01:25:44.783777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:53:19.003232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'51","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.846291+0000","last_change":"2024-09-18T01:25:12.694029+0000","last_active":"2024-09-18T01:28:23.846291+0000","last_peered":"2024-09-18T01:28:23.846291+0000","last_clean":"2024-09-18T01:28:23.846291+0000","last_became_active":"2024-09-18T01:25:12.693182+0000","last_became_peered":"2024-09-18T01:25:12.693182+0000","last_unstale":"2024-09-18T01:28:23.846291+0000","last_undegraded":"2024-09-18T01:28:23.846291+0000","last_fullsized":"2024-09-18T01:28:23.846291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:08:39.434682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'282","reported_seq":348,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.298524+0000","last_change":"2024-09-18T01:25:14.706933+0000","last_active":"2024-09-18T01:28:17.298524+0000","last_peered":"2024-09-18T01:28:17.298524+0000","last_clean":"2024-09-18T01:28:17.298524+0000","last_became_active":"2024-09-18T01:25:14.706540+0000","last_became_peered":"2024-09-18T01:25:14.706540+0000","last_unstale":"2024-09-18T01:28:17.298524+0000","last_undegraded":"2024-09-18T01:28:17.298524+0000","last_fullsized":"2024-09-18T01:28:17.298524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:27.416743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.391512+0000","last_change":"2024-09-18T01:25:16.714648+0000","last_active":"2024-09-18T01:27:13.391512+0000","last_peered":"2024-09-18T01:27:13.391512+0000","last_clean":"2024-09-18T01:27:13.391512+0000","last_became_active":"2024-09-18T01:25:16.714363+0000","last_became_peered":"2024-09-18T01:25:16.714363+0000","last_unstale":"2024-09-18T01:27:13.391512+0000","last_undegraded":"2024-09-18T01:27:13.391512+0000","last_fullsized":"2024-09-18T01:27:13.391512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:59:11.881576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.866295+0000","last_change":"2024-09-18T01:25:08.670862+0000","last_active":"2024-09-18T01:28:16.866295+0000","last_peered":"2024-09-18T01:28:16.866295+0000","last_clean":"2024-09-18T01:28:16.866295+0000","last_became_active":"2024-09-18T01:25:08.670617+0000","last_became_peered":"2024-09-18T01:25:08.670617+0000","last_unstale":"2024-09-18T01:28:16.866295+0000","last_undegraded":"2024-09-18T01:28:16.866295+0000","last_fullsized":"2024-09-18T01:28:16.866295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:29.205884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849958+0000","last_change":"2024-09-18T01:25:06.693637+0000","last_active":"2024-09-18T01:25:43.849958+0000","last_peered":"2024-09-18T01:25:43.849958+0000","last_clean":"2024-09-18T01:25:43.849958+0000","last_became_active":"2024-09-18T01:25:06.689545+0000","last_became_peered":"2024-09-18T01:25:06.689545+0000","last_unstale":"2024-09-18T01:25:43.849958+0000","last_undegraded":"2024-09-18T01:25:43.849958+0000","last_fullsized":"2024-09-18T01:25:43.849958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:57.969892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:44.783756+0000","last_change":"2024-09-18T01:25:43.907490+0000","last_active":"2024-09-18T01:25:44.783756+0000","last_peered":"2024-09-18T01:25:44.783756+0000","last_clean":"2024-09-18T01:25:44.783756+0000","last_became_active":"2024-09-18T01:25:43.907094+0000","last_became_peered":"2024-09-18T01:25:43.907094+0000","last_unstale":"2024-09-18T01:25:44.783756+0000","last_undegraded":"2024-09-18T01:25:44.783756+0000","last_fullsized":"2024-09-18T01:25:44.783756+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:26:05.185230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'74","reported_seq":150,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.859497+0000","last_change":"2024-09-18T01:25:12.693226+0000","last_active":"2024-09-18T01:28:23.859497+0000","last_peered":"2024-09-18T01:28:23.859497+0000","last_clean":"2024-09-18T01:28:23.859497+0000","last_became_active":"2024-09-18T01:25:12.692821+0000","last_became_peered":"2024-09-18T01:25:12.692821+0000","last_unstale":"2024-09-18T01:28:23.859497+0000","last_undegraded":"2024-09-18T01:28:23.859497+0000","last_fullsized":"2024-09-18T01:28:23.859497+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:15.391395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":84,"num_read_kb":81,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843893+0000","last_change":"2024-09-18T01:25:14.707691+0000","last_active":"2024-09-18T01:25:43.843893+0000","last_peered":"2024-09-18T01:25:43.843893+0000","last_clean":"2024-09-18T01:25:43.843893+0000","last_became_active":"2024-09-18T01:25:14.707514+0000","last_became_peered":"2024-09-18T01:25:14.707514+0000","last_unstale":"2024-09-18T01:25:43.843893+0000","last_undegraded":"2024-09-18T01:25:43.843893+0000","last_fullsized":"2024-09-18T01:25:43.843893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:57.575198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.271704+0000","last_change":"2024-09-18T01:25:16.706301+0000","last_active":"2024-09-18T01:28:17.271704+0000","last_peered":"2024-09-18T01:28:17.271704+0000","last_clean":"2024-09-18T01:28:17.271704+0000","last_became_active":"2024-09-18T01:25:16.705938+0000","last_became_peered":"2024-09-18T01:25:16.705938+0000","last_unstale":"2024-09-18T01:28:17.271704+0000","last_undegraded":"2024-09-18T01:28:17.271704+0000","last_fullsized":"2024-09-18T01:28:17.271704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:48:53.777539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176669+0000","last_change":"2024-09-18T01:25:08.687495+0000","last_active":"2024-09-18T01:28:17.176669+0000","last_peered":"2024-09-18T01:28:17.176669+0000","last_clean":"2024-09-18T01:28:17.176669+0000","last_became_active":"2024-09-18T01:25:08.687135+0000","last_became_peered":"2024-09-18T01:25:08.687135+0000","last_unstale":"2024-09-18T01:28:17.176669+0000","last_undegraded":"2024-09-18T01:28:17.176669+0000","last_fullsized":"2024-09-18T01:28:17.176669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:15.493296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845740+0000","last_change":"2024-09-18T01:25:06.681219+0000","last_active":"2024-09-18T01:25:43.845740+0000","last_peered":"2024-09-18T01:25:43.845740+0000","last_clean":"2024-09-18T01:25:43.845740+0000","last_became_active":"2024-09-18T01:25:06.680774+0000","last_became_peered":"2024-09-18T01:25:06.680774+0000","last_unstale":"2024-09-18T01:25:43.845740+0000","last_undegraded":"2024-09-18T01:25:43.845740+0000","last_fullsized":"2024-09-18T01:25:43.845740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:33:48.652888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845831+0000","last_change":"2024-09-18T01:25:10.675268+0000","last_active":"2024-09-18T01:25:43.845831+0000","last_peered":"2024-09-18T01:25:43.845831+0000","last_clean":"2024-09-18T01:25:43.845831+0000","last_became_active":"2024-09-18T01:25:10.674983+0000","last_became_peered":"2024-09-18T01:25:10.674983+0000","last_unstale":"2024-09-18T01:25:43.845831+0000","last_undegraded":"2024-09-18T01:25:43.845831+0000","last_fullsized":"2024-09-18T01:25:43.845831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:25:15.816622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'41","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.791281+0000","last_change":"2024-09-18T01:25:12.683645+0000","last_active":"2024-09-18T01:28:23.791281+0000","last_peered":"2024-09-18T01:28:23.791281+0000","last_clean":"2024-09-18T01:28:23.791281+0000","last_became_active":"2024-09-18T01:25:12.683339+0000","last_became_peered":"2024-09-18T01:25:12.683339+0000","last_unstale":"2024-09-18T01:28:23.791281+0000","last_undegraded":"2024-09-18T01:28:23.791281+0000","last_fullsized":"2024-09-18T01:28:23.791281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:55:20.974738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851387+0000","last_change":"2024-09-18T01:25:14.708366+0000","last_active":"2024-09-18T01:25:43.851387+0000","last_peered":"2024-09-18T01:25:43.851387+0000","last_clean":"2024-09-18T01:25:43.851387+0000","last_became_active":"2024-09-18T01:25:14.707116+0000","last_became_peered":"2024-09-18T01:25:14.707116+0000","last_unstale":"2024-09-18T01:25:43.851387+0000","last_undegraded":"2024-09-18T01:25:43.851387+0000","last_fullsized":"2024-09-18T01:25:43.851387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:38.584056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797258+0000","last_change":"2024-09-18T01:25:16.708368+0000","last_active":"2024-09-18T01:27:19.797258+0000","last_peered":"2024-09-18T01:27:19.797258+0000","last_clean":"2024-09-18T01:27:19.797258+0000","last_became_active":"2024-09-18T01:25:16.708095+0000","last_became_peered":"2024-09-18T01:25:16.708095+0000","last_unstale":"2024-09-18T01:27:19.797258+0000","last_undegraded":"2024-09-18T01:27:19.797258+0000","last_fullsized":"2024-09-18T01:27:19.797258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:48.121756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.752010+0000","last_change":"2024-09-18T01:25:08.688693+0000","last_active":"2024-09-18T01:26:32.752010+0000","last_peered":"2024-09-18T01:26:32.752010+0000","last_clean":"2024-09-18T01:26:32.752010+0000","last_became_active":"2024-09-18T01:25:08.688251+0000","last_became_peered":"2024-09-18T01:25:08.688251+0000","last_unstale":"2024-09-18T01:26:32.752010+0000","last_undegraded":"2024-09-18T01:26:32.752010+0000","last_fullsized":"2024-09-18T01:26:32.752010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:56.803513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.757447+0000","last_change":"2024-09-18T01:25:06.684669+0000","last_active":"2024-09-18T01:28:16.757447+0000","last_peered":"2024-09-18T01:28:16.757447+0000","last_clean":"2024-09-18T01:28:16.757447+0000","last_became_active":"2024-09-18T01:25:06.683437+0000","last_became_peered":"2024-09-18T01:25:06.683437+0000","last_unstale":"2024-09-18T01:28:16.757447+0000","last_undegraded":"2024-09-18T01:28:16.757447+0000","last_fullsized":"2024-09-18T01:28:16.757447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:23.462064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844681+0000","last_change":"2024-09-18T01:25:10.680258+0000","last_active":"2024-09-18T01:25:43.844681+0000","last_peered":"2024-09-18T01:25:43.844681+0000","last_clean":"2024-09-18T01:25:43.844681+0000","last_became_active":"2024-09-18T01:25:10.679740+0000","last_became_peered":"2024-09-18T01:25:10.679740+0000","last_unstale":"2024-09-18T01:25:43.844681+0000","last_undegraded":"2024-09-18T01:25:43.844681+0000","last_fullsized":"2024-09-18T01:25:43.844681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:40.355268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'39","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.769267+0000","last_change":"2024-09-18T01:25:12.687798+0000","last_active":"2024-09-18T01:28:23.769267+0000","last_peered":"2024-09-18T01:28:23.769267+0000","last_clean":"2024-09-18T01:28:23.769267+0000","last_became_active":"2024-09-18T01:25:12.686455+0000","last_became_peered":"2024-09-18T01:25:12.686455+0000","last_unstale":"2024-09-18T01:28:23.769267+0000","last_undegraded":"2024-09-18T01:28:23.769267+0000","last_fullsized":"2024-09-18T01:28:23.769267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:43.085499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":406,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.713197+0000","last_change":"2024-09-18T01:25:14.704198+0000","last_active":"2024-09-18T01:28:23.713197+0000","last_peered":"2024-09-18T01:28:23.713197+0000","last_clean":"2024-09-18T01:28:23.713197+0000","last_became_active":"2024-09-18T01:25:14.703877+0000","last_became_peered":"2024-09-18T01:25:14.703877+0000","last_unstale":"2024-09-18T01:28:23.713197+0000","last_undegraded":"2024-09-18T01:28:23.713197+0000","last_fullsized":"2024-09-18T01:28:23.713197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:39:57.240022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'12","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:22.797572+0000","last_change":"2024-09-18T01:25:16.714095+0000","last_active":"2024-09-18T01:27:22.797572+0000","last_peered":"2024-09-18T01:27:22.797572+0000","last_clean":"2024-09-18T01:27:22.797572+0000","last_became_active":"2024-09-18T01:25:16.713677+0000","last_became_peered":"2024-09-18T01:25:16.713677+0000","last_unstale":"2024-09-18T01:27:22.797572+0000","last_undegraded":"2024-09-18T01:27:22.797572+0000","last_fullsized":"2024-09-18T01:27:22.797572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:37.223946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954552+0000","last_change":"2024-09-18T01:25:08.673535+0000","last_active":"2024-09-18T01:28:16.954552+0000","last_peered":"2024-09-18T01:28:16.954552+0000","last_clean":"2024-09-18T01:28:16.954552+0000","last_became_active":"2024-09-18T01:25:08.673276+0000","last_became_peered":"2024-09-18T01:25:08.673276+0000","last_unstale":"2024-09-18T01:28:16.954552+0000","last_undegraded":"2024-09-18T01:28:16.954552+0000","last_fullsized":"2024-09-18T01:28:16.954552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:58.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.463022+0000","last_change":"2024-09-18T01:25:06.683319+0000","last_active":"2024-09-18T01:27:16.463022+0000","last_peered":"2024-09-18T01:27:16.463022+0000","last_clean":"2024-09-18T01:27:16.463022+0000","last_became_active":"2024-09-18T01:25:06.682841+0000","last_became_peered":"2024-09-18T01:25:06.682841+0000","last_unstale":"2024-09-18T01:27:16.463022+0000","last_undegraded":"2024-09-18T01:27:16.463022+0000","last_fullsized":"2024-09-18T01:27:16.463022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:52:44.524173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":417,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.694247+0000","last_change":"2024-09-18T01:25:10.680374+0000","last_active":"2024-09-18T01:28:23.694247+0000","last_peered":"2024-09-18T01:28:23.694247+0000","last_clean":"2024-09-18T01:28:23.694247+0000","last_became_active":"2024-09-18T01:25:10.679483+0000","last_became_peered":"2024-09-18T01:25:10.679483+0000","last_unstale":"2024-09-18T01:28:23.694247+0000","last_undegraded":"2024-09-18T01:28:23.694247+0000","last_fullsized":"2024-09-18T01:28:23.694247+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:41.077084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851675+0000","last_change":"2024-09-18T01:25:12.697050+0000","last_active":"2024-09-18T01:25:43.851675+0000","last_peered":"2024-09-18T01:25:43.851675+0000","last_clean":"2024-09-18T01:25:43.851675+0000","last_became_active":"2024-09-18T01:25:12.696726+0000","last_became_peered":"2024-09-18T01:25:12.696726+0000","last_unstale":"2024-09-18T01:25:43.851675+0000","last_undegraded":"2024-09-18T01:25:43.851675+0000","last_fullsized":"2024-09-18T01:25:43.851675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:25.931338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":513,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.714525+0000","last_change":"2024-09-18T01:25:14.705212+0000","last_active":"2024-09-18T01:28:23.714525+0000","last_peered":"2024-09-18T01:28:23.714525+0000","last_clean":"2024-09-18T01:28:23.714525+0000","last_became_active":"2024-09-18T01:25:14.702900+0000","last_became_peered":"2024-09-18T01:25:14.702900+0000","last_unstale":"2024-09-18T01:28:23.714525+0000","last_undegraded":"2024-09-18T01:28:23.714525+0000","last_fullsized":"2024-09-18T01:28:23.714525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:44.393089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.267015+0000","last_change":"2024-09-18T01:25:16.712364+0000","last_active":"2024-09-18T01:27:16.267015+0000","last_peered":"2024-09-18T01:27:16.267015+0000","last_clean":"2024-09-18T01:27:16.267015+0000","last_became_active":"2024-09-18T01:25:16.712084+0000","last_became_peered":"2024-09-18T01:25:16.712084+0000","last_unstale":"2024-09-18T01:27:16.267015+0000","last_undegraded":"2024-09-18T01:27:16.267015+0000","last_fullsized":"2024-09-18T01:27:16.267015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:46.407572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'8","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.144995+0000","last_change":"2024-09-18T01:25:08.687109+0000","last_active":"2024-09-18T01:28:17.144995+0000","last_peered":"2024-09-18T01:28:17.144995+0000","last_clean":"2024-09-18T01:28:17.144995+0000","last_became_active":"2024-09-18T01:25:08.686802+0000","last_became_peered":"2024-09-18T01:25:08.686802+0000","last_unstale":"2024-09-18T01:28:17.144995+0000","last_undegraded":"2024-09-18T01:28:17.144995+0000","last_fullsized":"2024-09-18T01:28:17.144995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:13.745242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.080072+0000","last_change":"2024-09-18T01:25:06.695782+0000","last_active":"2024-09-18T01:28:17.080072+0000","last_peered":"2024-09-18T01:28:17.080072+0000","last_clean":"2024-09-18T01:28:17.080072+0000","last_became_active":"2024-09-18T01:25:06.691644+0000","last_became_peered":"2024-09-18T01:25:06.691644+0000","last_unstale":"2024-09-18T01:28:17.080072+0000","last_undegraded":"2024-09-18T01:28:17.080072+0000","last_fullsized":"2024-09-18T01:28:17.080072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:51:10.947372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851329+0000","last_change":"2024-09-18T01:25:10.682385+0000","last_active":"2024-09-18T01:25:43.851329+0000","last_peered":"2024-09-18T01:25:43.851329+0000","last_clean":"2024-09-18T01:25:43.851329+0000","last_became_active":"2024-09-18T01:25:10.682075+0000","last_became_peered":"2024-09-18T01:25:10.682075+0000","last_unstale":"2024-09-18T01:25:43.851329+0000","last_undegraded":"2024-09-18T01:25:43.851329+0000","last_fullsized":"2024-09-18T01:25:43.851329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:28.482490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'42","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.830450+0000","last_change":"2024-09-18T01:25:12.686750+0000","last_active":"2024-09-18T01:28:23.830450+0000","last_peered":"2024-09-18T01:28:23.830450+0000","last_clean":"2024-09-18T01:28:23.830450+0000","last_became_active":"2024-09-18T01:25:12.686460+0000","last_became_peered":"2024-09-18T01:25:12.686460+0000","last_unstale":"2024-09-18T01:28:23.830450+0000","last_undegraded":"2024-09-18T01:28:23.830450+0000","last_fullsized":"2024-09-18T01:28:23.830450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:56.008777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843863+0000","last_change":"2024-09-18T01:25:14.706837+0000","last_active":"2024-09-18T01:25:43.843863+0000","last_peered":"2024-09-18T01:25:43.843863+0000","last_clean":"2024-09-18T01:25:43.843863+0000","last_became_active":"2024-09-18T01:25:14.706506+0000","last_became_peered":"2024-09-18T01:25:14.706506+0000","last_unstale":"2024-09-18T01:25:43.843863+0000","last_undegraded":"2024-09-18T01:25:43.843863+0000","last_fullsized":"2024-09-18T01:25:43.843863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:31:25.019479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.209468+0000","last_change":"2024-09-18T01:25:16.709338+0000","last_active":"2024-09-18T01:28:17.209468+0000","last_peered":"2024-09-18T01:28:17.209468+0000","last_clean":"2024-09-18T01:28:17.209468+0000","last_became_active":"2024-09-18T01:25:16.709084+0000","last_became_peered":"2024-09-18T01:25:16.709084+0000","last_unstale":"2024-09-18T01:28:17.209468+0000","last_undegraded":"2024-09-18T01:28:17.209468+0000","last_fullsized":"2024-09-18T01:28:17.209468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:26:11.215230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'7","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183392+0000","last_change":"2024-09-18T01:25:08.688515+0000","last_active":"2024-09-18T01:28:17.183392+0000","last_peered":"2024-09-18T01:28:17.183392+0000","last_clean":"2024-09-18T01:28:17.183392+0000","last_became_active":"2024-09-18T01:25:08.687896+0000","last_became_peered":"2024-09-18T01:25:08.687896+0000","last_unstale":"2024-09-18T01:28:17.183392+0000","last_undegraded":"2024-09-18T01:28:17.183392+0000","last_fullsized":"2024-09-18T01:28:17.183392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:47:23.724986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":204,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903661+0000","last_change":"2024-09-18T01:24:52.297138+0000","last_active":"2024-09-18T01:25:43.903661+0000","last_peered":"2024-09-18T01:25:43.903661+0000","last_clean":"2024-09-18T01:25:43.903661+0000","last_became_active":"2024-09-18T01:24:52.296214+0000","last_became_peered":"2024-09-18T01:24:52.296214+0000","last_unstale":"2024-09-18T01:25:43.903661+0000","last_undegraded":"2024-09-18T01:25:43.903661+0000","last_fullsized":"2024-09-18T01:25:43.903661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_clean_scrub_stamp":"2024-09-18T01:24:51.161687+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:36:16.487345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850355+0000","last_change":"2024-09-18T01:24:58.197569+0000","last_active":"2024-09-18T01:25:43.850355+0000","last_peered":"2024-09-18T01:25:43.850355+0000","last_clean":"2024-09-18T01:25:43.850355+0000","last_became_active":"2024-09-18T01:24:56.194443+0000","last_became_peered":"2024-09-18T01:24:56.194443+0000","last_unstale":"2024-09-18T01:25:43.850355+0000","last_undegraded":"2024-09-18T01:25:43.850355+0000","last_fullsized":"2024-09-18T01:25:43.850355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:43:12.854702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033763700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.850186+0000","last_change":"2024-09-18T01:25:06.684714+0000","last_active":"2024-09-18T01:28:16.850186+0000","last_peered":"2024-09-18T01:28:16.850186+0000","last_clean":"2024-09-18T01:28:16.850186+0000","last_became_active":"2024-09-18T01:25:06.683975+0000","last_became_peered":"2024-09-18T01:25:06.683975+0000","last_unstale":"2024-09-18T01:28:16.850186+0000","last_undegraded":"2024-09-18T01:28:16.850186+0000","last_fullsized":"2024-09-18T01:28:16.850186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:47.187628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904635+0000","last_change":"2024-09-18T01:25:10.679847+0000","last_active":"2024-09-18T01:25:43.904635+0000","last_peered":"2024-09-18T01:25:43.904635+0000","last_clean":"2024-09-18T01:25:43.904635+0000","last_became_active":"2024-09-18T01:25:10.679572+0000","last_became_peered":"2024-09-18T01:25:10.679572+0000","last_unstale":"2024-09-18T01:25:43.904635+0000","last_undegraded":"2024-09-18T01:25:43.904635+0000","last_fullsized":"2024-09-18T01:25:43.904635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:53:26.506877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'91","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.836668+0000","last_change":"2024-09-18T01:25:12.692243+0000","last_active":"2024-09-18T01:28:23.836668+0000","last_peered":"2024-09-18T01:28:23.836668+0000","last_clean":"2024-09-18T01:28:23.836668+0000","last_became_active":"2024-09-18T01:25:12.691952+0000","last_became_peered":"2024-09-18T01:25:12.691952+0000","last_unstale":"2024-09-18T01:28:23.836668+0000","last_undegraded":"2024-09-18T01:28:23.836668+0000","last_fullsized":"2024-09-18T01:28:23.836668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:38.540516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845488+0000","last_change":"2024-09-18T01:25:14.707170+0000","last_active":"2024-09-18T01:25:43.845488+0000","last_peered":"2024-09-18T01:25:43.845488+0000","last_clean":"2024-09-18T01:25:43.845488+0000","last_became_active":"2024-09-18T01:25:14.706519+0000","last_became_peered":"2024-09-18T01:25:14.706519+0000","last_unstale":"2024-09-18T01:25:43.845488+0000","last_undegraded":"2024-09-18T01:25:43.845488+0000","last_fullsized":"2024-09-18T01:25:43.845488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:53.286034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'85","reported_seq":168,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.185765+0000","last_change":"2024-09-18T01:25:16.712377+0000","last_active":"2024-09-18T01:28:17.185765+0000","last_peered":"2024-09-18T01:28:17.185765+0000","last_clean":"2024-09-18T01:28:17.185765+0000","last_became_active":"2024-09-18T01:25:16.712102+0000","last_became_peered":"2024-09-18T01:25:16.712102+0000","last_unstale":"2024-09-18T01:28:17.185765+0000","last_undegraded":"2024-09-18T01:28:17.185765+0000","last_fullsized":"2024-09-18T01:28:17.185765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:59.589681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":221,"num_write":168,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'7","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797548+0000","last_change":"2024-09-18T01:25:08.672900+0000","last_active":"2024-09-18T01:27:19.797548+0000","last_peered":"2024-09-18T01:27:19.797548+0000","last_clean":"2024-09-18T01:27:19.797548+0000","last_became_active":"2024-09-18T01:25:08.671578+0000","last_became_peered":"2024-09-18T01:25:08.671578+0000","last_unstale":"2024-09-18T01:27:19.797548+0000","last_undegraded":"2024-09-18T01:27:19.797548+0000","last_fullsized":"2024-09-18T01:27:19.797548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:01:40.367586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847748+0000","last_change":"2024-09-18T01:24:58.197615+0000","last_active":"2024-09-18T01:25:43.847748+0000","last_peered":"2024-09-18T01:25:43.847748+0000","last_clean":"2024-09-18T01:25:43.847748+0000","last_became_active":"2024-09-18T01:24:56.191554+0000","last_became_peered":"2024-09-18T01:24:56.191554+0000","last_unstale":"2024-09-18T01:25:43.847748+0000","last_undegraded":"2024-09-18T01:25:43.847748+0000","last_fullsized":"2024-09-18T01:25:43.847748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:55.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041584599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843970+0000","last_change":"2024-09-18T01:25:06.681216+0000","last_active":"2024-09-18T01:25:43.843970+0000","last_peered":"2024-09-18T01:25:43.843970+0000","last_clean":"2024-09-18T01:25:43.843970+0000","last_became_active":"2024-09-18T01:25:06.680635+0000","last_became_peered":"2024-09-18T01:25:06.680635+0000","last_unstale":"2024-09-18T01:25:43.843970+0000","last_undegraded":"2024-09-18T01:25:43.843970+0000","last_fullsized":"2024-09-18T01:25:43.843970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:43.801545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851531+0000","last_change":"2024-09-18T01:25:10.682266+0000","last_active":"2024-09-18T01:25:43.851531+0000","last_peered":"2024-09-18T01:25:43.851531+0000","last_clean":"2024-09-18T01:25:43.851531+0000","last_became_active":"2024-09-18T01:25:10.681988+0000","last_became_peered":"2024-09-18T01:25:10.681988+0000","last_unstale":"2024-09-18T01:25:43.851531+0000","last_undegraded":"2024-09-18T01:25:43.851531+0000","last_fullsized":"2024-09-18T01:25:43.851531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:53:03.896010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'290","reported_seq":512,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.834412+0000","last_change":"2024-09-18T01:25:12.694263+0000","last_active":"2024-09-18T01:28:23.834412+0000","last_peered":"2024-09-18T01:28:23.834412+0000","last_clean":"2024-09-18T01:28:23.834412+0000","last_became_active":"2024-09-18T01:25:12.693664+0000","last_became_peered":"2024-09-18T01:25:12.693664+0000","last_unstale":"2024-09-18T01:28:23.834412+0000","last_undegraded":"2024-09-18T01:28:23.834412+0000","last_fullsized":"2024-09-18T01:28:23.834412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:31:23.012378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850081+0000","last_change":"2024-09-18T01:25:14.707563+0000","last_active":"2024-09-18T01:25:43.850081+0000","last_peered":"2024-09-18T01:25:43.850081+0000","last_clean":"2024-09-18T01:25:43.850081+0000","last_became_active":"2024-09-18T01:25:14.707143+0000","last_became_peered":"2024-09-18T01:25:14.707143+0000","last_unstale":"2024-09-18T01:25:43.850081+0000","last_undegraded":"2024-09-18T01:25:43.850081+0000","last_fullsized":"2024-09-18T01:25:43.850081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:07.461296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.886187+0000","last_change":"2024-09-18T01:25:16.714554+0000","last_active":"2024-09-18T01:28:16.886187+0000","last_peered":"2024-09-18T01:28:16.886187+0000","last_clean":"2024-09-18T01:28:16.886187+0000","last_became_active":"2024-09-18T01:25:16.712931+0000","last_became_peered":"2024-09-18T01:25:16.712931+0000","last_unstale":"2024-09-18T01:28:16.886187+0000","last_undegraded":"2024-09-18T01:28:16.886187+0000","last_fullsized":"2024-09-18T01:28:16.886187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:20:06.027889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954356+0000","last_change":"2024-09-18T01:25:08.681154+0000","last_active":"2024-09-18T01:28:16.954356+0000","last_peered":"2024-09-18T01:28:16.954356+0000","last_clean":"2024-09-18T01:28:16.954356+0000","last_became_active":"2024-09-18T01:25:08.680541+0000","last_became_peered":"2024-09-18T01:25:08.680541+0000","last_unstale":"2024-09-18T01:28:16.954356+0000","last_undegraded":"2024-09-18T01:28:16.954356+0000","last_fullsized":"2024-09-18T01:28:16.954356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:15.493296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843251+0000","last_change":"2024-09-18T01:24:58.350485+0000","last_active":"2024-09-18T01:25:43.843251+0000","last_peered":"2024-09-18T01:25:43.843251+0000","last_clean":"2024-09-18T01:25:43.843251+0000","last_became_active":"2024-09-18T01:24:56.191162+0000","last_became_peered":"2024-09-18T01:24:56.191162+0000","last_unstale":"2024-09-18T01:25:43.843251+0000","last_undegraded":"2024-09-18T01:25:43.843251+0000","last_fullsized":"2024-09-18T01:25:43.843251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:38:00.033247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040921399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:07.795274+0000","last_change":"2024-09-18T01:25:06.686498+0000","last_active":"2024-09-18T01:27:07.795274+0000","last_peered":"2024-09-18T01:27:07.795274+0000","last_clean":"2024-09-18T01:27:07.795274+0000","last_became_active":"2024-09-18T01:25:06.686053+0000","last_became_peered":"2024-09-18T01:25:06.686053+0000","last_unstale":"2024-09-18T01:27:07.795274+0000","last_undegraded":"2024-09-18T01:27:07.795274+0000","last_fullsized":"2024-09-18T01:27:07.795274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:22.518297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845792+0000","last_change":"2024-09-18T01:25:10.677853+0000","last_active":"2024-09-18T01:25:43.845792+0000","last_peered":"2024-09-18T01:25:43.845792+0000","last_clean":"2024-09-18T01:25:43.845792+0000","last_became_active":"2024-09-18T01:25:10.677597+0000","last_became_peered":"2024-09-18T01:25:10.677597+0000","last_unstale":"2024-09-18T01:25:43.845792+0000","last_undegraded":"2024-09-18T01:25:43.845792+0000","last_fullsized":"2024-09-18T01:25:43.845792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:29.066415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:15.763577+0000","last_change":"2024-09-18T01:25:12.688147+0000","last_active":"2024-09-18T01:28:15.763577+0000","last_peered":"2024-09-18T01:28:15.763577+0000","last_clean":"2024-09-18T01:28:15.763577+0000","last_became_active":"2024-09-18T01:25:12.687799+0000","last_became_peered":"2024-09-18T01:25:12.687799+0000","last_unstale":"2024-09-18T01:28:15.763577+0000","last_undegraded":"2024-09-18T01:28:15.763577+0000","last_fullsized":"2024-09-18T01:28:15.763577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:03:37.628556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845029+0000","last_change":"2024-09-18T01:25:14.706976+0000","last_active":"2024-09-18T01:25:43.845029+0000","last_peered":"2024-09-18T01:25:43.845029+0000","last_clean":"2024-09-18T01:25:43.845029+0000","last_became_active":"2024-09-18T01:25:14.706611+0000","last_became_peered":"2024-09-18T01:25:14.706611+0000","last_unstale":"2024-09-18T01:25:43.845029+0000","last_undegraded":"2024-09-18T01:25:43.845029+0000","last_fullsized":"2024-09-18T01:25:43.845029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:15.483666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849369+0000","last_change":"2024-09-18T01:25:16.711670+0000","last_active":"2024-09-18T01:25:43.849369+0000","last_peered":"2024-09-18T01:25:43.849369+0000","last_clean":"2024-09-18T01:25:43.849369+0000","last_became_active":"2024-09-18T01:25:16.711404+0000","last_became_peered":"2024-09-18T01:25:16.711404+0000","last_unstale":"2024-09-18T01:25:43.849369+0000","last_undegraded":"2024-09-18T01:25:43.849369+0000","last_fullsized":"2024-09-18T01:25:43.849369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:12:32.036544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097075+0000","last_change":"2024-09-18T01:25:08.673345+0000","last_active":"2024-09-18T01:28:17.097075+0000","last_peered":"2024-09-18T01:28:17.097075+0000","last_clean":"2024-09-18T01:28:17.097075+0000","last_became_active":"2024-09-18T01:25:08.672969+0000","last_became_peered":"2024-09-18T01:25:08.672969+0000","last_unstale":"2024-09-18T01:28:17.097075+0000","last_undegraded":"2024-09-18T01:28:17.097075+0000","last_fullsized":"2024-09-18T01:28:17.097075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:37.287772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849309+0000","last_change":"2024-09-18T01:24:58.198236+0000","last_active":"2024-09-18T01:25:43.849309+0000","last_peered":"2024-09-18T01:25:43.849309+0000","last_clean":"2024-09-18T01:25:43.849309+0000","last_became_active":"2024-09-18T01:24:56.191713+0000","last_became_peered":"2024-09-18T01:24:56.191713+0000","last_unstale":"2024-09-18T01:25:43.849309+0000","last_undegraded":"2024-09-18T01:25:43.849309+0000","last_fullsized":"2024-09-18T01:25:43.849309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:55:46.520977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010043490000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844211+0000","last_change":"2024-09-18T01:25:06.700684+0000","last_active":"2024-09-18T01:25:43.844211+0000","last_peered":"2024-09-18T01:25:43.844211+0000","last_clean":"2024-09-18T01:25:43.844211+0000","last_became_active":"2024-09-18T01:25:06.700397+0000","last_became_peered":"2024-09-18T01:25:06.700397+0000","last_unstale":"2024-09-18T01:25:43.844211+0000","last_undegraded":"2024-09-18T01:25:43.844211+0000","last_fullsized":"2024-09-18T01:25:43.844211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:22.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845266+0000","last_change":"2024-09-18T01:25:10.676620+0000","last_active":"2024-09-18T01:25:43.845266+0000","last_peered":"2024-09-18T01:25:43.845266+0000","last_clean":"2024-09-18T01:25:43.845266+0000","last_became_active":"2024-09-18T01:25:10.676320+0000","last_became_peered":"2024-09-18T01:25:10.676320+0000","last_unstale":"2024-09-18T01:25:43.845266+0000","last_undegraded":"2024-09-18T01:25:43.845266+0000","last_fullsized":"2024-09-18T01:25:43.845266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:01:00.415475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'13","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.498611+0000","last_change":"2024-09-18T01:25:12.692628+0000","last_active":"2024-09-18T01:28:16.498611+0000","last_peered":"2024-09-18T01:28:16.498611+0000","last_clean":"2024-09-18T01:28:16.498611+0000","last_became_active":"2024-09-18T01:25:12.692373+0000","last_became_peered":"2024-09-18T01:25:12.692373+0000","last_unstale":"2024-09-18T01:28:16.498611+0000","last_undegraded":"2024-09-18T01:28:16.498611+0000","last_fullsized":"2024-09-18T01:28:16.498611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:48.277377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851686+0000","last_change":"2024-09-18T01:25:14.709358+0000","last_active":"2024-09-18T01:25:43.851686+0000","last_peered":"2024-09-18T01:25:43.851686+0000","last_clean":"2024-09-18T01:25:43.851686+0000","last_became_active":"2024-09-18T01:25:14.707409+0000","last_became_peered":"2024-09-18T01:25:14.707409+0000","last_unstale":"2024-09-18T01:25:43.851686+0000","last_undegraded":"2024-09-18T01:25:43.851686+0000","last_fullsized":"2024-09-18T01:25:43.851686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:44:50.425957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'6","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.246929+0000","last_change":"2024-09-18T01:25:16.711391+0000","last_active":"2024-09-18T01:27:16.246929+0000","last_peered":"2024-09-18T01:27:16.246929+0000","last_clean":"2024-09-18T01:27:16.246929+0000","last_became_active":"2024-09-18T01:25:16.711104+0000","last_became_peered":"2024-09-18T01:25:16.711104+0000","last_unstale":"2024-09-18T01:27:16.246929+0000","last_undegraded":"2024-09-18T01:27:16.246929+0000","last_fullsized":"2024-09-18T01:27:16.246929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:20.551132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.751886+0000","last_change":"2024-09-18T01:25:08.687474+0000","last_active":"2024-09-18T01:26:32.751886+0000","last_peered":"2024-09-18T01:26:32.751886+0000","last_clean":"2024-09-18T01:26:32.751886+0000","last_became_active":"2024-09-18T01:25:08.687139+0000","last_became_peered":"2024-09-18T01:25:08.687139+0000","last_unstale":"2024-09-18T01:26:32.751886+0000","last_undegraded":"2024-09-18T01:26:32.751886+0000","last_fullsized":"2024-09-18T01:26:32.751886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:17.472878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845078+0000","last_change":"2024-09-18T01:25:06.692246+0000","last_active":"2024-09-18T01:25:43.845078+0000","last_peered":"2024-09-18T01:25:43.845078+0000","last_clean":"2024-09-18T01:25:43.845078+0000","last_became_active":"2024-09-18T01:25:06.691871+0000","last_became_peered":"2024-09-18T01:25:06.691871+0000","last_unstale":"2024-09-18T01:25:43.845078+0000","last_undegraded":"2024-09-18T01:25:43.845078+0000","last_fullsized":"2024-09-18T01:25:43.845078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:18.475907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844899+0000","last_change":"2024-09-18T01:24:58.199959+0000","last_active":"2024-09-18T01:25:43.844899+0000","last_peered":"2024-09-18T01:25:43.844899+0000","last_clean":"2024-09-18T01:25:43.844899+0000","last_became_active":"2024-09-18T01:24:56.191033+0000","last_became_peered":"2024-09-18T01:24:56.191033+0000","last_unstale":"2024-09-18T01:25:43.844899+0000","last_undegraded":"2024-09-18T01:25:43.844899+0000","last_fullsized":"2024-09-18T01:25:43.844899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:45.677191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000547898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:17.796664+0000","last_change":"2024-09-18T01:25:10.676817+0000","last_active":"2024-09-18T01:27:17.796664+0000","last_peered":"2024-09-18T01:27:17.796664+0000","last_clean":"2024-09-18T01:27:17.796664+0000","last_became_active":"2024-09-18T01:25:10.676531+0000","last_became_peered":"2024-09-18T01:25:10.676531+0000","last_unstale":"2024-09-18T01:27:17.796664+0000","last_undegraded":"2024-09-18T01:27:17.796664+0000","last_fullsized":"2024-09-18T01:27:17.796664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:30:17.964806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'76","reported_seq":147,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.878002+0000","last_change":"2024-09-18T01:25:12.693490+0000","last_active":"2024-09-18T01:28:16.878002+0000","last_peered":"2024-09-18T01:28:16.878002+0000","last_clean":"2024-09-18T01:28:16.878002+0000","last_became_active":"2024-09-18T01:25:12.693127+0000","last_became_peered":"2024-09-18T01:25:12.693127+0000","last_unstale":"2024-09-18T01:28:16.878002+0000","last_undegraded":"2024-09-18T01:28:16.878002+0000","last_fullsized":"2024-09-18T01:28:16.878002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:53:39.113408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.842921+0000","last_change":"2024-09-18T01:25:14.704345+0000","last_active":"2024-09-18T01:25:43.842921+0000","last_peered":"2024-09-18T01:25:43.842921+0000","last_clean":"2024-09-18T01:25:43.842921+0000","last_became_active":"2024-09-18T01:25:14.703993+0000","last_became_peered":"2024-09-18T01:25:14.703993+0000","last_unstale":"2024-09-18T01:25:43.842921+0000","last_undegraded":"2024-09-18T01:25:43.842921+0000","last_fullsized":"2024-09-18T01:25:43.842921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:48.964473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.422802+0000","last_change":"2024-09-18T01:25:16.703557+0000","last_active":"2024-09-18T01:27:16.422802+0000","last_peered":"2024-09-18T01:27:16.422802+0000","last_clean":"2024-09-18T01:27:16.422802+0000","last_became_active":"2024-09-18T01:25:16.703278+0000","last_became_peered":"2024-09-18T01:25:16.703278+0000","last_unstale":"2024-09-18T01:27:16.422802+0000","last_undegraded":"2024-09-18T01:27:16.422802+0000","last_fullsized":"2024-09-18T01:27:16.422802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:50:43.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097370+0000","last_change":"2024-09-18T01:25:08.686341+0000","last_active":"2024-09-18T01:28:17.097370+0000","last_peered":"2024-09-18T01:28:17.097370+0000","last_clean":"2024-09-18T01:28:17.097370+0000","last_became_active":"2024-09-18T01:25:08.686087+0000","last_became_peered":"2024-09-18T01:25:08.686087+0000","last_unstale":"2024-09-18T01:28:17.097370+0000","last_undegraded":"2024-09-18T01:28:17.097370+0000","last_fullsized":"2024-09-18T01:28:17.097370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:58.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.796033+0000","last_change":"2024-09-18T01:25:06.681153+0000","last_active":"2024-09-18T01:27:12.796033+0000","last_peered":"2024-09-18T01:27:12.796033+0000","last_clean":"2024-09-18T01:27:12.796033+0000","last_became_active":"2024-09-18T01:25:06.680623+0000","last_became_peered":"2024-09-18T01:25:06.680623+0000","last_unstale":"2024-09-18T01:27:12.796033+0000","last_undegraded":"2024-09-18T01:27:12.796033+0000","last_fullsized":"2024-09-18T01:27:12.796033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:43.847905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851403+0000","last_change":"2024-09-18T01:24:58.198528+0000","last_active":"2024-09-18T01:25:43.851403+0000","last_peered":"2024-09-18T01:25:43.851403+0000","last_clean":"2024-09-18T01:25:43.851403+0000","last_became_active":"2024-09-18T01:24:56.191687+0000","last_became_peered":"2024-09-18T01:24:56.191687+0000","last_unstale":"2024-09-18T01:25:43.851403+0000","last_undegraded":"2024-09-18T01:25:43.851403+0000","last_fullsized":"2024-09-18T01:25:43.851403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:11:00.731633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012745390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848299+0000","last_change":"2024-09-18T01:25:10.681568+0000","last_active":"2024-09-18T01:25:43.848299+0000","last_peered":"2024-09-18T01:25:43.848299+0000","last_clean":"2024-09-18T01:25:43.848299+0000","last_became_active":"2024-09-18T01:25:10.681311+0000","last_became_peered":"2024-09-18T01:25:10.681311+0000","last_unstale":"2024-09-18T01:25:43.848299+0000","last_undegraded":"2024-09-18T01:25:43.848299+0000","last_fullsized":"2024-09-18T01:25:43.848299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:18:53.465821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'21","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797770+0000","last_change":"2024-09-18T01:25:12.692614+0000","last_active":"2024-09-18T01:27:19.797770+0000","last_peered":"2024-09-18T01:27:19.797770+0000","last_clean":"2024-09-18T01:27:19.797770+0000","last_became_active":"2024-09-18T01:25:12.692357+0000","last_became_peered":"2024-09-18T01:25:12.692357+0000","last_unstale":"2024-09-18T01:27:19.797770+0000","last_undegraded":"2024-09-18T01:27:19.797770+0000","last_fullsized":"2024-09-18T01:27:19.797770+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:53.053242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":389,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.711133+0000","last_change":"2024-09-18T01:25:14.706009+0000","last_active":"2024-09-18T01:28:23.711133+0000","last_peered":"2024-09-18T01:28:23.711133+0000","last_clean":"2024-09-18T01:28:23.711133+0000","last_became_active":"2024-09-18T01:25:14.705703+0000","last_became_peered":"2024-09-18T01:25:14.705703+0000","last_unstale":"2024-09-18T01:28:23.711133+0000","last_undegraded":"2024-09-18T01:28:23.711133+0000","last_fullsized":"2024-09-18T01:28:23.711133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:27.416743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850789+0000","last_change":"2024-09-18T01:25:16.711811+0000","last_active":"2024-09-18T01:25:43.850789+0000","last_peered":"2024-09-18T01:25:43.850789+0000","last_clean":"2024-09-18T01:25:43.850789+0000","last_became_active":"2024-09-18T01:25:16.711531+0000","last_became_peered":"2024-09-18T01:25:16.711531+0000","last_unstale":"2024-09-18T01:25:43.850789+0000","last_undegraded":"2024-09-18T01:25:43.850789+0000","last_fullsized":"2024-09-18T01:25:43.850789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:37:22.949714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'20","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.145097+0000","last_change":"2024-09-18T01:25:08.681868+0000","last_active":"2024-09-18T01:28:17.145097+0000","last_peered":"2024-09-18T01:28:17.145097+0000","last_clean":"2024-09-18T01:28:17.145097+0000","last_became_active":"2024-09-18T01:25:08.681285+0000","last_became_peered":"2024-09-18T01:25:08.681285+0000","last_unstale":"2024-09-18T01:28:17.145097+0000","last_undegraded":"2024-09-18T01:28:17.145097+0000","last_fullsized":"2024-09-18T01:28:17.145097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:17:00.419181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":56,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.852230+0000","last_change":"2024-09-18T01:25:06.684116+0000","last_active":"2024-09-18T01:25:43.852230+0000","last_peered":"2024-09-18T01:25:43.852230+0000","last_clean":"2024-09-18T01:25:43.852230+0000","last_became_active":"2024-09-18T01:25:06.683740+0000","last_became_peered":"2024-09-18T01:25:06.683740+0000","last_unstale":"2024-09-18T01:25:43.852230+0000","last_undegraded":"2024-09-18T01:25:43.852230+0000","last_fullsized":"2024-09-18T01:25:43.852230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:01.765123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846258+0000","last_change":"2024-09-18T01:24:58.199970+0000","last_active":"2024-09-18T01:25:43.846258+0000","last_peered":"2024-09-18T01:25:43.846258+0000","last_clean":"2024-09-18T01:25:43.846258+0000","last_became_active":"2024-09-18T01:24:56.192301+0000","last_became_peered":"2024-09-18T01:24:56.192301+0000","last_unstale":"2024-09-18T01:25:43.846258+0000","last_undegraded":"2024-09-18T01:25:43.846258+0000","last_fullsized":"2024-09-18T01:25:43.846258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:15.228308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056449699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848267+0000","last_change":"2024-09-18T01:25:10.682420+0000","last_active":"2024-09-18T01:25:43.848267+0000","last_peered":"2024-09-18T01:25:43.848267+0000","last_clean":"2024-09-18T01:25:43.848267+0000","last_became_active":"2024-09-18T01:25:10.682111+0000","last_became_peered":"2024-09-18T01:25:10.682111+0000","last_unstale":"2024-09-18T01:25:43.848267+0000","last_undegraded":"2024-09-18T01:25:43.848267+0000","last_fullsized":"2024-09-18T01:25:43.848267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:50.968119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'17","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797411+0000","last_change":"2024-09-18T01:25:12.692600+0000","last_active":"2024-09-18T01:27:19.797411+0000","last_peered":"2024-09-18T01:27:19.797411+0000","last_clean":"2024-09-18T01:27:19.797411+0000","last_became_active":"2024-09-18T01:25:12.692313+0000","last_became_peered":"2024-09-18T01:25:12.692313+0000","last_unstale":"2024-09-18T01:27:19.797411+0000","last_undegraded":"2024-09-18T01:27:19.797411+0000","last_fullsized":"2024-09-18T01:27:19.797411+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:07:06.091989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'282","reported_seq":398,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.272287+0000","last_change":"2024-09-18T01:25:14.699037+0000","last_active":"2024-09-18T01:28:17.272287+0000","last_peered":"2024-09-18T01:28:17.272287+0000","last_clean":"2024-09-18T01:28:17.272287+0000","last_became_active":"2024-09-18T01:25:14.698755+0000","last_became_peered":"2024-09-18T01:25:14.698755+0000","last_unstale":"2024-09-18T01:28:17.272287+0000","last_undegraded":"2024-09-18T01:28:17.272287+0000","last_fullsized":"2024-09-18T01:28:17.272287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:44.393089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.218389+0000","last_change":"2024-09-18T01:25:16.712818+0000","last_active":"2024-09-18T01:25:50.218389+0000","last_peered":"2024-09-18T01:25:50.218389+0000","last_clean":"2024-09-18T01:25:50.218389+0000","last_became_active":"2024-09-18T01:25:16.712556+0000","last_became_peered":"2024-09-18T01:25:16.712556+0000","last_unstale":"2024-09-18T01:25:50.218389+0000","last_undegraded":"2024-09-18T01:25:50.218389+0000","last_fullsized":"2024-09-18T01:25:50.218389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:33:55.839584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'13","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183683+0000","last_change":"2024-09-18T01:25:08.674848+0000","last_active":"2024-09-18T01:28:17.183683+0000","last_peered":"2024-09-18T01:28:17.183683+0000","last_clean":"2024-09-18T01:28:17.183683+0000","last_became_active":"2024-09-18T01:25:08.674560+0000","last_became_peered":"2024-09-18T01:25:08.674560+0000","last_unstale":"2024-09-18T01:28:17.183683+0000","last_undegraded":"2024-09-18T01:28:17.183683+0000","last_fullsized":"2024-09-18T01:28:17.183683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:10.873516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.389587+0000","last_change":"2024-09-18T01:25:06.693785+0000","last_active":"2024-09-18T01:27:16.389587+0000","last_peered":"2024-09-18T01:27:16.389587+0000","last_clean":"2024-09-18T01:27:16.389587+0000","last_became_active":"2024-09-18T01:25:06.686277+0000","last_became_peered":"2024-09-18T01:25:06.686277+0000","last_unstale":"2024-09-18T01:27:16.389587+0000","last_undegraded":"2024-09-18T01:27:16.389587+0000","last_fullsized":"2024-09-18T01:27:16.389587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:22.518297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851867+0000","last_change":"2024-09-18T01:24:58.198307+0000","last_active":"2024-09-18T01:25:43.851867+0000","last_peered":"2024-09-18T01:25:43.851867+0000","last_clean":"2024-09-18T01:25:43.851867+0000","last_became_active":"2024-09-18T01:24:56.602991+0000","last_became_peered":"2024-09-18T01:24:56.602991+0000","last_unstale":"2024-09-18T01:25:43.851867+0000","last_undegraded":"2024-09-18T01:25:43.851867+0000","last_fullsized":"2024-09-18T01:25:43.851867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:37:38.935073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077351,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847636+0000","last_change":"2024-09-18T01:25:10.683146+0000","last_active":"2024-09-18T01:25:43.847636+0000","last_peered":"2024-09-18T01:25:43.847636+0000","last_clean":"2024-09-18T01:25:43.847636+0000","last_became_active":"2024-09-18T01:25:10.682057+0000","last_became_peered":"2024-09-18T01:25:10.682057+0000","last_unstale":"2024-09-18T01:25:43.847636+0000","last_undegraded":"2024-09-18T01:25:43.847636+0000","last_fullsized":"2024-09-18T01:25:43.847636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:50:53.226062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'98","reported_seq":188,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.823959+0000","last_change":"2024-09-18T01:25:12.694747+0000","last_active":"2024-09-18T01:28:23.823959+0000","last_peered":"2024-09-18T01:28:23.823959+0000","last_clean":"2024-09-18T01:28:23.823959+0000","last_became_active":"2024-09-18T01:25:12.694361+0000","last_became_peered":"2024-09-18T01:25:12.694361+0000","last_unstale":"2024-09-18T01:28:23.823959+0000","last_undegraded":"2024-09-18T01:28:23.823959+0000","last_fullsized":"2024-09-18T01:28:23.823959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:01:02.423890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844037+0000","last_change":"2024-09-18T01:25:14.707331+0000","last_active":"2024-09-18T01:25:43.844037+0000","last_peered":"2024-09-18T01:25:43.844037+0000","last_clean":"2024-09-18T01:25:43.844037+0000","last_became_active":"2024-09-18T01:25:14.706960+0000","last_became_peered":"2024-09-18T01:25:14.706960+0000","last_unstale":"2024-09-18T01:25:43.844037+0000","last_undegraded":"2024-09-18T01:25:43.844037+0000","last_fullsized":"2024-09-18T01:25:43.844037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:23.103965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846489+0000","last_change":"2024-09-18T01:25:16.716922+0000","last_active":"2024-09-18T01:25:43.846489+0000","last_peered":"2024-09-18T01:25:43.846489+0000","last_clean":"2024-09-18T01:25:43.846489+0000","last_became_active":"2024-09-18T01:25:16.716607+0000","last_became_peered":"2024-09-18T01:25:16.716607+0000","last_unstale":"2024-09-18T01:25:43.846489+0000","last_undegraded":"2024-09-18T01:25:43.846489+0000","last_fullsized":"2024-09-18T01:25:43.846489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:31:19.177080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845585+0000","last_change":"2024-09-18T01:25:16.717173+0000","last_active":"2024-09-18T01:25:43.845585+0000","last_peered":"2024-09-18T01:25:43.845585+0000","last_clean":"2024-09-18T01:25:43.845585+0000","last_became_active":"2024-09-18T01:25:16.716867+0000","last_became_peered":"2024-09-18T01:25:16.716867+0000","last_unstale":"2024-09-18T01:25:43.845585+0000","last_undegraded":"2024-09-18T01:25:43.845585+0000","last_fullsized":"2024-09-18T01:25:43.845585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:29.431226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941573+0000","last_change":"2024-09-18T01:25:08.676006+0000","last_active":"2024-09-18T01:26:32.941573+0000","last_peered":"2024-09-18T01:26:32.941573+0000","last_clean":"2024-09-18T01:26:32.941573+0000","last_became_active":"2024-09-18T01:25:08.675590+0000","last_became_peered":"2024-09-18T01:25:08.675590+0000","last_unstale":"2024-09-18T01:26:32.941573+0000","last_undegraded":"2024-09-18T01:26:32.941573+0000","last_fullsized":"2024-09-18T01:26:32.941573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:41.267347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850033+0000","last_change":"2024-09-18T01:25:06.693775+0000","last_active":"2024-09-18T01:25:43.850033+0000","last_peered":"2024-09-18T01:25:43.850033+0000","last_clean":"2024-09-18T01:25:43.850033+0000","last_became_active":"2024-09-18T01:25:06.689996+0000","last_became_peered":"2024-09-18T01:25:06.689996+0000","last_unstale":"2024-09-18T01:25:43.850033+0000","last_undegraded":"2024-09-18T01:25:43.850033+0000","last_fullsized":"2024-09-18T01:25:43.850033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:08:19.802935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904820+0000","last_change":"2024-09-18T01:25:10.680563+0000","last_active":"2024-09-18T01:25:43.904820+0000","last_peered":"2024-09-18T01:25:43.904820+0000","last_clean":"2024-09-18T01:25:43.904820+0000","last_became_active":"2024-09-18T01:25:10.679704+0000","last_became_peered":"2024-09-18T01:25:10.679704+0000","last_unstale":"2024-09-18T01:25:43.904820+0000","last_undegraded":"2024-09-18T01:25:43.904820+0000","last_fullsized":"2024-09-18T01:25:43.904820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:43:35.529795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'41","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.843100+0000","last_change":"2024-09-18T01:25:12.693302+0000","last_active":"2024-09-18T01:28:23.843100+0000","last_peered":"2024-09-18T01:28:23.843100+0000","last_clean":"2024-09-18T01:28:23.843100+0000","last_became_active":"2024-09-18T01:25:12.692870+0000","last_became_peered":"2024-09-18T01:25:12.692870+0000","last_unstale":"2024-09-18T01:28:23.843100+0000","last_undegraded":"2024-09-18T01:28:23.843100+0000","last_fullsized":"2024-09-18T01:28:23.843100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:53:57.208130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848675+0000","last_change":"2024-09-18T01:25:14.707283+0000","last_active":"2024-09-18T01:25:43.848675+0000","last_peered":"2024-09-18T01:25:43.848675+0000","last_clean":"2024-09-18T01:25:43.848675+0000","last_became_active":"2024-09-18T01:25:14.706381+0000","last_became_peered":"2024-09-18T01:25:14.706381+0000","last_unstale":"2024-09-18T01:25:43.848675+0000","last_undegraded":"2024-09-18T01:25:43.848675+0000","last_fullsized":"2024-09-18T01:25:43.848675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:43:26.455220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'17","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.580259+0000","last_change":"2024-09-18T01:25:16.703483+0000","last_active":"2024-09-18T01:28:16.580259+0000","last_peered":"2024-09-18T01:28:16.580259+0000","last_clean":"2024-09-18T01:28:16.580259+0000","last_became_active":"2024-09-18T01:25:16.703227+0000","last_became_peered":"2024-09-18T01:25:16.703227+0000","last_unstale":"2024-09-18T01:28:16.580259+0000","last_undegraded":"2024-09-18T01:28:16.580259+0000","last_fullsized":"2024-09-18T01:28:16.580259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:31.864546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904703+0000","last_change":"2024-09-18T01:25:08.687780+0000","last_active":"2024-09-18T01:25:43.904703+0000","last_peered":"2024-09-18T01:25:43.904703+0000","last_clean":"2024-09-18T01:25:43.904703+0000","last_became_active":"2024-09-18T01:25:08.687482+0000","last_became_peered":"2024-09-18T01:25:08.687482+0000","last_unstale":"2024-09-18T01:25:43.904703+0000","last_undegraded":"2024-09-18T01:25:43.904703+0000","last_fullsized":"2024-09-18T01:25:43.904703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:19.129968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845694+0000","last_change":"2024-09-18T01:25:06.705764+0000","last_active":"2024-09-18T01:25:43.845694+0000","last_peered":"2024-09-18T01:25:43.845694+0000","last_clean":"2024-09-18T01:25:43.845694+0000","last_became_active":"2024-09-18T01:25:06.705406+0000","last_became_peered":"2024-09-18T01:25:06.705406+0000","last_unstale":"2024-09-18T01:25:43.845694+0000","last_undegraded":"2024-09-18T01:25:43.845694+0000","last_fullsized":"2024-09-18T01:25:43.845694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:16.022647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849629+0000","last_change":"2024-09-18T01:25:10.682648+0000","last_active":"2024-09-18T01:25:43.849629+0000","last_peered":"2024-09-18T01:25:43.849629+0000","last_clean":"2024-09-18T01:25:43.849629+0000","last_became_active":"2024-09-18T01:25:10.682230+0000","last_became_peered":"2024-09-18T01:25:10.682230+0000","last_unstale":"2024-09-18T01:25:43.849629+0000","last_undegraded":"2024-09-18T01:25:43.849629+0000","last_fullsized":"2024-09-18T01:25:43.849629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:46:29.499833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'5","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.503052+0000","last_change":"2024-09-18T01:25:12.687325+0000","last_active":"2024-09-18T01:28:16.503052+0000","last_peered":"2024-09-18T01:28:16.503052+0000","last_clean":"2024-09-18T01:28:16.503052+0000","last_became_active":"2024-09-18T01:25:12.687018+0000","last_became_peered":"2024-09-18T01:25:12.687018+0000","last_unstale":"2024-09-18T01:28:16.503052+0000","last_undegraded":"2024-09-18T01:28:16.503052+0000","last_fullsized":"2024-09-18T01:28:16.503052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:38.338819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843144+0000","last_change":"2024-09-18T01:25:14.707285+0000","last_active":"2024-09-18T01:25:43.843144+0000","last_peered":"2024-09-18T01:25:43.843144+0000","last_clean":"2024-09-18T01:25:43.843144+0000","last_became_active":"2024-09-18T01:25:14.707008+0000","last_became_peered":"2024-09-18T01:25:14.707008+0000","last_unstale":"2024-09-18T01:25:43.843144+0000","last_undegraded":"2024-09-18T01:25:43.843144+0000","last_fullsized":"2024-09-18T01:25:43.843144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:37.834091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.131556+0000","last_change":"2024-09-18T01:25:16.714484+0000","last_active":"2024-09-18T01:28:17.131556+0000","last_peered":"2024-09-18T01:28:17.131556+0000","last_clean":"2024-09-18T01:28:17.131556+0000","last_became_active":"2024-09-18T01:25:16.714160+0000","last_became_peered":"2024-09-18T01:25:16.714160+0000","last_unstale":"2024-09-18T01:28:17.131556+0000","last_undegraded":"2024-09-18T01:28:17.131556+0000","last_fullsized":"2024-09-18T01:28:17.131556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:00:21.563802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844674+0000","last_change":"2024-09-18T01:25:08.671711+0000","last_active":"2024-09-18T01:25:43.844674+0000","last_peered":"2024-09-18T01:25:43.844674+0000","last_clean":"2024-09-18T01:25:43.844674+0000","last_became_active":"2024-09-18T01:25:08.671365+0000","last_became_peered":"2024-09-18T01:25:08.671365+0000","last_unstale":"2024-09-18T01:25:43.844674+0000","last_undegraded":"2024-09-18T01:25:43.844674+0000","last_fullsized":"2024-09-18T01:25:43.844674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:42:49.663850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.808647+0000","last_change":"2024-09-18T01:25:06.703718+0000","last_active":"2024-09-18T01:28:16.808647+0000","last_peered":"2024-09-18T01:28:16.808647+0000","last_clean":"2024-09-18T01:28:16.808647+0000","last_became_active":"2024-09-18T01:25:06.703081+0000","last_became_peered":"2024-09-18T01:25:06.703081+0000","last_unstale":"2024-09-18T01:28:16.808647+0000","last_undegraded":"2024-09-18T01:28:16.808647+0000","last_fullsized":"2024-09-18T01:28:16.808647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:43.847905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843418+0000","last_change":"2024-09-18T01:25:10.680659+0000","last_active":"2024-09-18T01:25:43.843418+0000","last_peered":"2024-09-18T01:25:43.843418+0000","last_clean":"2024-09-18T01:25:43.843418+0000","last_became_active":"2024-09-18T01:25:10.680316+0000","last_became_peered":"2024-09-18T01:25:10.680316+0000","last_unstale":"2024-09-18T01:25:43.843418+0000","last_undegraded":"2024-09-18T01:25:43.843418+0000","last_fullsized":"2024-09-18T01:25:43.843418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:15.756375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'40","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.560764+0000","last_change":"2024-09-18T01:25:12.682598+0000","last_active":"2024-09-18T01:28:16.560764+0000","last_peered":"2024-09-18T01:28:16.560764+0000","last_clean":"2024-09-18T01:28:16.560764+0000","last_became_active":"2024-09-18T01:25:12.682270+0000","last_became_peered":"2024-09-18T01:25:12.682270+0000","last_unstale":"2024-09-18T01:28:16.560764+0000","last_undegraded":"2024-09-18T01:28:16.560764+0000","last_fullsized":"2024-09-18T01:28:16.560764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:44.205915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903990+0000","last_change":"2024-09-18T01:25:14.705277+0000","last_active":"2024-09-18T01:25:43.903990+0000","last_peered":"2024-09-18T01:25:43.903990+0000","last_clean":"2024-09-18T01:25:43.903990+0000","last_became_active":"2024-09-18T01:25:14.703583+0000","last_became_peered":"2024-09-18T01:25:14.703583+0000","last_unstale":"2024-09-18T01:25:43.903990+0000","last_undegraded":"2024-09-18T01:25:43.903990+0000","last_fullsized":"2024-09-18T01:25:43.903990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:01:53.638099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849566+0000","last_change":"2024-09-18T01:25:16.714459+0000","last_active":"2024-09-18T01:25:43.849566+0000","last_peered":"2024-09-18T01:25:43.849566+0000","last_clean":"2024-09-18T01:25:43.849566+0000","last_became_active":"2024-09-18T01:25:16.714061+0000","last_became_peered":"2024-09-18T01:25:16.714061+0000","last_unstale":"2024-09-18T01:25:43.849566+0000","last_undegraded":"2024-09-18T01:25:43.849566+0000","last_fullsized":"2024-09-18T01:25:43.849566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:00:46.823041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'4","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941172+0000","last_change":"2024-09-18T01:25:08.688282+0000","last_active":"2024-09-18T01:26:32.941172+0000","last_peered":"2024-09-18T01:26:32.941172+0000","last_clean":"2024-09-18T01:26:32.941172+0000","last_became_active":"2024-09-18T01:25:08.688016+0000","last_became_peered":"2024-09-18T01:25:08.688016+0000","last_unstale":"2024-09-18T01:26:32.941172+0000","last_undegraded":"2024-09-18T01:26:32.941172+0000","last_fullsized":"2024-09-18T01:26:32.941172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:37:29.581979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906628+0000","last_change":"2024-09-18T01:25:06.691298+0000","last_active":"2024-09-18T01:25:43.906628+0000","last_peered":"2024-09-18T01:25:43.906628+0000","last_clean":"2024-09-18T01:25:43.906628+0000","last_became_active":"2024-09-18T01:25:06.688747+0000","last_became_peered":"2024-09-18T01:25:06.688747+0000","last_unstale":"2024-09-18T01:25:43.906628+0000","last_undegraded":"2024-09-18T01:25:43.906628+0000","last_fullsized":"2024-09-18T01:25:43.906628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:03.343944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848182+0000","last_change":"2024-09-18T01:25:10.681110+0000","last_active":"2024-09-18T01:25:43.848182+0000","last_peered":"2024-09-18T01:25:43.848182+0000","last_clean":"2024-09-18T01:25:43.848182+0000","last_became_active":"2024-09-18T01:25:10.680831+0000","last_became_peered":"2024-09-18T01:25:10.680831+0000","last_unstale":"2024-09-18T01:25:43.848182+0000","last_undegraded":"2024-09-18T01:25:43.848182+0000","last_fullsized":"2024-09-18T01:25:43.848182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:27.094941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'33","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.798174+0000","last_change":"2024-09-18T01:25:12.687200+0000","last_active":"2024-09-18T01:28:23.798174+0000","last_peered":"2024-09-18T01:28:23.798174+0000","last_clean":"2024-09-18T01:28:23.798174+0000","last_became_active":"2024-09-18T01:25:12.686918+0000","last_became_peered":"2024-09-18T01:25:12.686918+0000","last_unstale":"2024-09-18T01:28:23.798174+0000","last_undegraded":"2024-09-18T01:28:23.798174+0000","last_fullsized":"2024-09-18T01:28:23.798174+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:15.981679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843880+0000","last_change":"2024-09-18T01:25:14.695864+0000","last_active":"2024-09-18T01:25:43.843880+0000","last_peered":"2024-09-18T01:25:43.843880+0000","last_clean":"2024-09-18T01:25:43.843880+0000","last_became_active":"2024-09-18T01:25:14.695120+0000","last_became_peered":"2024-09-18T01:25:14.695120+0000","last_unstale":"2024-09-18T01:25:43.843880+0000","last_undegraded":"2024-09-18T01:25:43.843880+0000","last_fullsized":"2024-09-18T01:25:43.843880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:18.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'5","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153256+0000","last_change":"2024-09-18T01:25:08.678193+0000","last_active":"2024-09-18T01:28:17.153256+0000","last_peered":"2024-09-18T01:28:17.153256+0000","last_clean":"2024-09-18T01:28:17.153256+0000","last_became_active":"2024-09-18T01:25:08.677941+0000","last_became_peered":"2024-09-18T01:25:08.677941+0000","last_unstale":"2024-09-18T01:28:17.153256+0000","last_undegraded":"2024-09-18T01:28:17.153256+0000","last_fullsized":"2024-09-18T01:28:17.153256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:50:00.350138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.086109+0000","last_change":"2024-09-18T01:25:06.695779+0000","last_active":"2024-09-18T01:28:17.086109+0000","last_peered":"2024-09-18T01:28:17.086109+0000","last_clean":"2024-09-18T01:28:17.086109+0000","last_became_active":"2024-09-18T01:25:06.692823+0000","last_became_peered":"2024-09-18T01:25:06.692823+0000","last_unstale":"2024-09-18T01:28:17.086109+0000","last_undegraded":"2024-09-18T01:28:17.086109+0000","last_fullsized":"2024-09-18T01:28:17.086109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:25:48.076699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845675+0000","last_change":"2024-09-18T01:25:10.677782+0000","last_active":"2024-09-18T01:25:43.845675+0000","last_peered":"2024-09-18T01:25:43.845675+0000","last_clean":"2024-09-18T01:25:43.845675+0000","last_became_active":"2024-09-18T01:25:10.677481+0000","last_became_peered":"2024-09-18T01:25:10.677481+0000","last_unstale":"2024-09-18T01:25:43.845675+0000","last_undegraded":"2024-09-18T01:25:43.845675+0000","last_fullsized":"2024-09-18T01:25:43.845675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:01.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'61","reported_seq":123,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.074592+0000","last_change":"2024-09-18T01:25:12.687399+0000","last_active":"2024-09-18T01:27:15.074592+0000","last_peered":"2024-09-18T01:27:15.074592+0000","last_clean":"2024-09-18T01:27:15.074592+0000","last_became_active":"2024-09-18T01:25:12.687014+0000","last_became_peered":"2024-09-18T01:25:12.687014+0000","last_unstale":"2024-09-18T01:27:15.074592+0000","last_undegraded":"2024-09-18T01:27:15.074592+0000","last_fullsized":"2024-09-18T01:27:15.074592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:35.687671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843869+0000","last_change":"2024-09-18T01:25:14.699051+0000","last_active":"2024-09-18T01:25:43.843869+0000","last_peered":"2024-09-18T01:25:43.843869+0000","last_clean":"2024-09-18T01:25:43.843869+0000","last_became_active":"2024-09-18T01:25:14.698753+0000","last_became_peered":"2024-09-18T01:25:14.698753+0000","last_unstale":"2024-09-18T01:25:43.843869+0000","last_undegraded":"2024-09-18T01:25:43.843869+0000","last_fullsized":"2024-09-18T01:25:43.843869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:55.060343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'20","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.149094+0000","last_change":"2024-09-18T01:25:16.714340+0000","last_active":"2024-09-18T01:28:17.149094+0000","last_peered":"2024-09-18T01:28:17.149094+0000","last_clean":"2024-09-18T01:28:17.149094+0000","last_became_active":"2024-09-18T01:25:16.713750+0000","last_became_peered":"2024-09-18T01:25:16.713750+0000","last_unstale":"2024-09-18T01:28:17.149094+0000","last_undegraded":"2024-09-18T01:28:17.149094+0000","last_fullsized":"2024-09-18T01:28:17.149094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:00:32.755321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097065+0000","last_change":"2024-09-18T01:25:08.681356+0000","last_active":"2024-09-18T01:28:17.097065+0000","last_peered":"2024-09-18T01:28:17.097065+0000","last_clean":"2024-09-18T01:28:17.097065+0000","last_became_active":"2024-09-18T01:25:08.680604+0000","last_became_peered":"2024-09-18T01:25:08.680604+0000","last_unstale":"2024-09-18T01:28:17.097065+0000","last_undegraded":"2024-09-18T01:28:17.097065+0000","last_fullsized":"2024-09-18T01:28:17.097065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:58.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903568+0000","last_change":"2024-09-18T01:25:06.688269+0000","last_active":"2024-09-18T01:25:43.903568+0000","last_peered":"2024-09-18T01:25:43.903568+0000","last_clean":"2024-09-18T01:25:43.903568+0000","last_became_active":"2024-09-18T01:25:06.686125+0000","last_became_peered":"2024-09-18T01:25:06.686125+0000","last_unstale":"2024-09-18T01:25:43.903568+0000","last_undegraded":"2024-09-18T01:25:43.903568+0000","last_fullsized":"2024-09-18T01:25:43.903568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:36.036192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":237,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.683880+0000","last_change":"2024-09-18T01:25:43.912490+0000","last_active":"2024-09-18T01:28:23.683880+0000","last_peered":"2024-09-18T01:28:23.683880+0000","last_clean":"2024-09-18T01:28:23.683880+0000","last_became_active":"2024-09-18T01:25:43.908273+0000","last_became_peered":"2024-09-18T01:25:43.908273+0000","last_unstale":"2024-09-18T01:28:23.683880+0000","last_undegraded":"2024-09-18T01:28:23.683880+0000","last_fullsized":"2024-09-18T01:28:23.683880+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:43.161322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'39","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.801265+0000","last_change":"2024-09-18T01:25:12.693001+0000","last_active":"2024-09-18T01:28:23.801265+0000","last_peered":"2024-09-18T01:28:23.801265+0000","last_clean":"2024-09-18T01:28:23.801265+0000","last_became_active":"2024-09-18T01:25:12.692486+0000","last_became_peered":"2024-09-18T01:25:12.692486+0000","last_unstale":"2024-09-18T01:28:23.801265+0000","last_undegraded":"2024-09-18T01:28:23.801265+0000","last_fullsized":"2024-09-18T01:28:23.801265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:55:54.041872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904750+0000","last_change":"2024-09-18T01:25:14.710345+0000","last_active":"2024-09-18T01:25:43.904750+0000","last_peered":"2024-09-18T01:25:43.904750+0000","last_clean":"2024-09-18T01:25:43.904750+0000","last_became_active":"2024-09-18T01:25:14.709980+0000","last_became_peered":"2024-09-18T01:25:14.709980+0000","last_unstale":"2024-09-18T01:25:43.904750+0000","last_undegraded":"2024-09-18T01:25:43.904750+0000","last_fullsized":"2024-09-18T01:25:43.904750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:57.575198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848068+0000","last_change":"2024-09-18T01:25:16.709176+0000","last_active":"2024-09-18T01:25:43.848068+0000","last_peered":"2024-09-18T01:25:43.848068+0000","last_clean":"2024-09-18T01:25:43.848068+0000","last_became_active":"2024-09-18T01:25:16.708905+0000","last_became_peered":"2024-09-18T01:25:16.708905+0000","last_unstale":"2024-09-18T01:25:43.848068+0000","last_undegraded":"2024-09-18T01:25:43.848068+0000","last_fullsized":"2024-09-18T01:25:43.848068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:47:16.419410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.484946+0000","last_change":"2024-09-18T01:25:08.688875+0000","last_active":"2024-09-18T01:27:16.484946+0000","last_peered":"2024-09-18T01:27:16.484946+0000","last_clean":"2024-09-18T01:27:16.484946+0000","last_became_active":"2024-09-18T01:25:08.688610+0000","last_became_peered":"2024-09-18T01:25:08.688610+0000","last_unstale":"2024-09-18T01:27:16.484946+0000","last_undegraded":"2024-09-18T01:27:16.484946+0000","last_fullsized":"2024-09-18T01:27:16.484946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:31:14.516270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904539+0000","last_change":"2024-09-18T01:25:06.685750+0000","last_active":"2024-09-18T01:25:43.904539+0000","last_peered":"2024-09-18T01:25:43.904539+0000","last_clean":"2024-09-18T01:25:43.904539+0000","last_became_active":"2024-09-18T01:25:06.685167+0000","last_became_peered":"2024-09-18T01:25:06.685167+0000","last_unstale":"2024-09-18T01:25:43.904539+0000","last_undegraded":"2024-09-18T01:25:43.904539+0000","last_fullsized":"2024-09-18T01:25:43.904539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:39:53.953032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845066+0000","last_change":"2024-09-18T01:25:10.678850+0000","last_active":"2024-09-18T01:25:43.845066+0000","last_peered":"2024-09-18T01:25:43.845066+0000","last_clean":"2024-09-18T01:25:43.845066+0000","last_became_active":"2024-09-18T01:25:10.678586+0000","last_became_peered":"2024-09-18T01:25:10.678586+0000","last_unstale":"2024-09-18T01:25:43.845066+0000","last_undegraded":"2024-09-18T01:25:43.845066+0000","last_fullsized":"2024-09-18T01:25:43.845066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:12.616019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'38","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.072271+0000","last_change":"2024-09-18T01:25:12.688276+0000","last_active":"2024-09-18T01:27:15.072271+0000","last_peered":"2024-09-18T01:27:15.072271+0000","last_clean":"2024-09-18T01:27:15.072271+0000","last_became_active":"2024-09-18T01:25:12.687935+0000","last_became_peered":"2024-09-18T01:25:12.687935+0000","last_unstale":"2024-09-18T01:27:15.072271+0000","last_undegraded":"2024-09-18T01:27:15.072271+0000","last_fullsized":"2024-09-18T01:27:15.072271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:46.957372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845272+0000","last_change":"2024-09-18T01:25:14.701993+0000","last_active":"2024-09-18T01:25:43.845272+0000","last_peered":"2024-09-18T01:25:43.845272+0000","last_clean":"2024-09-18T01:25:43.845272+0000","last_became_active":"2024-09-18T01:25:14.701702+0000","last_became_peered":"2024-09-18T01:25:14.701702+0000","last_unstale":"2024-09-18T01:25:43.845272+0000","last_undegraded":"2024-09-18T01:25:43.845272+0000","last_fullsized":"2024-09-18T01:25:43.845272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:44:32.330079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.480417+0000","last_change":"2024-09-18T01:25:16.716015+0000","last_active":"2024-09-18T01:27:16.480417+0000","last_peered":"2024-09-18T01:27:16.480417+0000","last_clean":"2024-09-18T01:27:16.480417+0000","last_became_active":"2024-09-18T01:25:16.715669+0000","last_became_peered":"2024-09-18T01:25:16.715669+0000","last_unstale":"2024-09-18T01:27:16.480417+0000","last_undegraded":"2024-09-18T01:27:16.480417+0000","last_fullsized":"2024-09-18T01:27:16.480417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:36.833223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"35'15","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153107+0000","last_change":"2024-09-18T01:25:08.672922+0000","last_active":"2024-09-18T01:28:17.153107+0000","last_peered":"2024-09-18T01:28:17.153107+0000","last_clean":"2024-09-18T01:28:17.153107+0000","last_became_active":"2024-09-18T01:25:08.672541+0000","last_became_peered":"2024-09-18T01:25:08.672541+0000","last_unstale":"2024-09-18T01:28:17.153107+0000","last_undegraded":"2024-09-18T01:28:17.153107+0000","last_fullsized":"2024-09-18T01:28:17.153107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:39.586169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850020+0000","last_change":"2024-09-18T01:25:06.687447+0000","last_active":"2024-09-18T01:25:43.850020+0000","last_peered":"2024-09-18T01:25:43.850020+0000","last_clean":"2024-09-18T01:25:43.850020+0000","last_became_active":"2024-09-18T01:25:06.684658+0000","last_became_peered":"2024-09-18T01:25:06.684658+0000","last_unstale":"2024-09-18T01:25:43.850020+0000","last_undegraded":"2024-09-18T01:25:43.850020+0000","last_fullsized":"2024-09-18T01:25:43.850020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:33:25.718581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905255+0000","last_change":"2024-09-18T01:25:10.679752+0000","last_active":"2024-09-18T01:25:43.905255+0000","last_peered":"2024-09-18T01:25:43.905255+0000","last_clean":"2024-09-18T01:25:43.905255+0000","last_became_active":"2024-09-18T01:25:10.679369+0000","last_became_peered":"2024-09-18T01:25:10.679369+0000","last_unstale":"2024-09-18T01:25:43.905255+0000","last_undegraded":"2024-09-18T01:25:43.905255+0000","last_fullsized":"2024-09-18T01:25:43.905255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:03:35.620140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'16","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851610+0000","last_change":"2024-09-18T01:25:12.697092+0000","last_active":"2024-09-18T01:25:43.851610+0000","last_peered":"2024-09-18T01:25:43.851610+0000","last_clean":"2024-09-18T01:25:43.851610+0000","last_became_active":"2024-09-18T01:25:12.696757+0000","last_became_peered":"2024-09-18T01:25:12.696757+0000","last_unstale":"2024-09-18T01:25:43.851610+0000","last_undegraded":"2024-09-18T01:25:43.851610+0000","last_fullsized":"2024-09-18T01:25:43.851610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:43:07.633393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":375,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.709278+0000","last_change":"2024-09-18T01:25:14.709994+0000","last_active":"2024-09-18T01:28:23.709278+0000","last_peered":"2024-09-18T01:28:23.709278+0000","last_clean":"2024-09-18T01:28:23.709278+0000","last_became_active":"2024-09-18T01:25:14.708840+0000","last_became_peered":"2024-09-18T01:25:14.708840+0000","last_unstale":"2024-09-18T01:28:23.709278+0000","last_undegraded":"2024-09-18T01:28:23.709278+0000","last_fullsized":"2024-09-18T01:28:23.709278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:58.015878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847427+0000","last_change":"2024-09-18T01:25:16.707474+0000","last_active":"2024-09-18T01:25:43.847427+0000","last_peered":"2024-09-18T01:25:43.847427+0000","last_clean":"2024-09-18T01:25:43.847427+0000","last_became_active":"2024-09-18T01:25:16.706764+0000","last_became_peered":"2024-09-18T01:25:16.706764+0000","last_unstale":"2024-09-18T01:25:43.847427+0000","last_undegraded":"2024-09-18T01:25:43.847427+0000","last_fullsized":"2024-09-18T01:25:43.847427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:36.072052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.486245+0000","last_change":"2024-09-18T01:25:08.670258+0000","last_active":"2024-09-18T01:27:16.486245+0000","last_peered":"2024-09-18T01:27:16.486245+0000","last_clean":"2024-09-18T01:27:16.486245+0000","last_became_active":"2024-09-18T01:25:08.669920+0000","last_became_peered":"2024-09-18T01:25:08.669920+0000","last_unstale":"2024-09-18T01:27:16.486245+0000","last_undegraded":"2024-09-18T01:27:16.486245+0000","last_fullsized":"2024-09-18T01:27:16.486245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:54:53.349504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905430+0000","last_change":"2024-09-18T01:25:06.685435+0000","last_active":"2024-09-18T01:25:43.905430+0000","last_peered":"2024-09-18T01:25:43.905430+0000","last_clean":"2024-09-18T01:25:43.905430+0000","last_became_active":"2024-09-18T01:25:06.684984+0000","last_became_peered":"2024-09-18T01:25:06.684984+0000","last_unstale":"2024-09-18T01:25:43.905430+0000","last_undegraded":"2024-09-18T01:25:43.905430+0000","last_fullsized":"2024-09-18T01:25:43.905430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:18.475907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904219+0000","last_change":"2024-09-18T01:25:10.679758+0000","last_active":"2024-09-18T01:25:43.904219+0000","last_peered":"2024-09-18T01:25:43.904219+0000","last_clean":"2024-09-18T01:25:43.904219+0000","last_became_active":"2024-09-18T01:25:10.679468+0000","last_became_peered":"2024-09-18T01:25:10.679468+0000","last_unstale":"2024-09-18T01:25:43.904219+0000","last_undegraded":"2024-09-18T01:25:43.904219+0000","last_fullsized":"2024-09-18T01:25:43.904219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:13:07.466593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'63","reported_seq":136,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.772742+0000","last_change":"2024-09-18T01:25:12.689122+0000","last_active":"2024-09-18T01:28:23.772742+0000","last_peered":"2024-09-18T01:28:23.772742+0000","last_clean":"2024-09-18T01:28:23.772742+0000","last_became_active":"2024-09-18T01:25:12.688618+0000","last_became_peered":"2024-09-18T01:25:12.688618+0000","last_unstale":"2024-09-18T01:28:23.772742+0000","last_undegraded":"2024-09-18T01:28:23.772742+0000","last_fullsized":"2024-09-18T01:28:23.772742+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:35.826990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843695+0000","last_change":"2024-09-18T01:25:14.707373+0000","last_active":"2024-09-18T01:25:43.843695+0000","last_peered":"2024-09-18T01:25:43.843695+0000","last_clean":"2024-09-18T01:25:43.843695+0000","last_became_active":"2024-09-18T01:25:14.706586+0000","last_became_peered":"2024-09-18T01:25:14.706586+0000","last_unstale":"2024-09-18T01:25:43.843695+0000","last_undegraded":"2024-09-18T01:25:43.843695+0000","last_fullsized":"2024-09-18T01:25:43.843695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:04:52.409201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.907198+0000","last_change":"2024-09-18T01:25:16.714536+0000","last_active":"2024-09-18T01:25:43.907198+0000","last_peered":"2024-09-18T01:25:43.907198+0000","last_clean":"2024-09-18T01:25:43.907198+0000","last_became_active":"2024-09-18T01:25:16.713789+0000","last_became_peered":"2024-09-18T01:25:16.713789+0000","last_unstale":"2024-09-18T01:25:43.907198+0000","last_undegraded":"2024-09-18T01:25:43.907198+0000","last_fullsized":"2024-09-18T01:25:43.907198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:32:22.558708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176266+0000","last_change":"2024-09-18T01:25:08.670550+0000","last_active":"2024-09-18T01:28:17.176266+0000","last_peered":"2024-09-18T01:28:17.176266+0000","last_clean":"2024-09-18T01:28:17.176266+0000","last_became_active":"2024-09-18T01:25:08.670268+0000","last_became_peered":"2024-09-18T01:25:08.670268+0000","last_unstale":"2024-09-18T01:28:17.176266+0000","last_undegraded":"2024-09-18T01:28:17.176266+0000","last_fullsized":"2024-09-18T01:28:17.176266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:41.660195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.802270+0000","last_change":"2024-09-18T01:25:06.689500+0000","last_active":"2024-09-18T01:28:16.802270+0000","last_peered":"2024-09-18T01:28:16.802270+0000","last_clean":"2024-09-18T01:28:16.802270+0000","last_became_active":"2024-09-18T01:25:06.687382+0000","last_became_peered":"2024-09-18T01:25:06.687382+0000","last_unstale":"2024-09-18T01:28:16.802270+0000","last_undegraded":"2024-09-18T01:28:16.802270+0000","last_fullsized":"2024-09-18T01:28:16.802270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:30:33.161052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845025+0000","last_change":"2024-09-18T01:25:10.682652+0000","last_active":"2024-09-18T01:25:43.845025+0000","last_peered":"2024-09-18T01:25:43.845025+0000","last_clean":"2024-09-18T01:25:43.845025+0000","last_became_active":"2024-09-18T01:25:10.682337+0000","last_became_peered":"2024-09-18T01:25:10.682337+0000","last_unstale":"2024-09-18T01:25:43.845025+0000","last_undegraded":"2024-09-18T01:25:43.845025+0000","last_fullsized":"2024-09-18T01:25:43.845025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:07.622864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'36","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.046668+0000","last_change":"2024-09-18T01:25:12.693400+0000","last_active":"2024-09-18T01:27:15.046668+0000","last_peered":"2024-09-18T01:27:15.046668+0000","last_clean":"2024-09-18T01:27:15.046668+0000","last_became_active":"2024-09-18T01:25:12.693129+0000","last_became_peered":"2024-09-18T01:25:12.693129+0000","last_unstale":"2024-09-18T01:27:15.046668+0000","last_undegraded":"2024-09-18T01:27:15.046668+0000","last_fullsized":"2024-09-18T01:27:15.046668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:02:54.566116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847932+0000","last_change":"2024-09-18T01:25:14.707262+0000","last_active":"2024-09-18T01:25:43.847932+0000","last_peered":"2024-09-18T01:25:43.847932+0000","last_clean":"2024-09-18T01:25:43.847932+0000","last_became_active":"2024-09-18T01:25:14.706325+0000","last_became_peered":"2024-09-18T01:25:14.706325+0000","last_unstale":"2024-09-18T01:25:43.847932+0000","last_undegraded":"2024-09-18T01:25:43.847932+0000","last_fullsized":"2024-09-18T01:25:43.847932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:31.363572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851735+0000","last_change":"2024-09-18T01:25:16.716357+0000","last_active":"2024-09-18T01:25:43.851735+0000","last_peered":"2024-09-18T01:25:43.851735+0000","last_clean":"2024-09-18T01:25:43.851735+0000","last_became_active":"2024-09-18T01:25:16.716084+0000","last_became_peered":"2024-09-18T01:25:16.716084+0000","last_unstale":"2024-09-18T01:25:43.851735+0000","last_undegraded":"2024-09-18T01:25:43.851735+0000","last_fullsized":"2024-09-18T01:25:43.851735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:49:46.781345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848361+0000","last_change":"2024-09-18T01:25:08.678786+0000","last_active":"2024-09-18T01:25:43.848361+0000","last_peered":"2024-09-18T01:25:43.848361+0000","last_clean":"2024-09-18T01:25:43.848361+0000","last_became_active":"2024-09-18T01:25:08.678539+0000","last_became_peered":"2024-09-18T01:25:08.678539+0000","last_unstale":"2024-09-18T01:25:43.848361+0000","last_undegraded":"2024-09-18T01:25:43.848361+0000","last_fullsized":"2024-09-18T01:25:43.848361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:26:37.929696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846243+0000","last_change":"2024-09-18T01:25:06.682960+0000","last_active":"2024-09-18T01:25:43.846243+0000","last_peered":"2024-09-18T01:25:43.846243+0000","last_clean":"2024-09-18T01:25:43.846243+0000","last_became_active":"2024-09-18T01:25:06.682592+0000","last_became_peered":"2024-09-18T01:25:06.682592+0000","last_unstale":"2024-09-18T01:25:43.846243+0000","last_undegraded":"2024-09-18T01:25:43.846243+0000","last_fullsized":"2024-09-18T01:25:43.846243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:39.148193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903424+0000","last_change":"2024-09-18T01:25:10.684259+0000","last_active":"2024-09-18T01:25:43.903424+0000","last_peered":"2024-09-18T01:25:43.903424+0000","last_clean":"2024-09-18T01:25:43.903424+0000","last_became_active":"2024-09-18T01:25:10.683833+0000","last_became_peered":"2024-09-18T01:25:10.683833+0000","last_unstale":"2024-09-18T01:25:43.903424+0000","last_undegraded":"2024-09-18T01:25:43.903424+0000","last_fullsized":"2024-09-18T01:25:43.903424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:01.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'35","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.849092+0000","last_change":"2024-09-18T01:25:12.693138+0000","last_active":"2024-09-18T01:28:23.849092+0000","last_peered":"2024-09-18T01:28:23.849092+0000","last_clean":"2024-09-18T01:28:23.849092+0000","last_became_active":"2024-09-18T01:25:12.691752+0000","last_became_peered":"2024-09-18T01:25:12.691752+0000","last_unstale":"2024-09-18T01:28:23.849092+0000","last_undegraded":"2024-09-18T01:28:23.849092+0000","last_fullsized":"2024-09-18T01:28:23.849092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:47:16.533005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849229+0000","last_change":"2024-09-18T01:25:14.711982+0000","last_active":"2024-09-18T01:25:43.849229+0000","last_peered":"2024-09-18T01:25:43.849229+0000","last_clean":"2024-09-18T01:25:43.849229+0000","last_became_active":"2024-09-18T01:25:14.711635+0000","last_became_peered":"2024-09-18T01:25:14.711635+0000","last_unstale":"2024-09-18T01:25:43.849229+0000","last_undegraded":"2024-09-18T01:25:43.849229+0000","last_fullsized":"2024-09-18T01:25:43.849229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:51:20.322887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.080053+0000","last_change":"2024-09-18T01:25:16.715865+0000","last_active":"2024-09-18T01:27:15.080053+0000","last_peered":"2024-09-18T01:27:15.080053+0000","last_clean":"2024-09-18T01:27:15.080053+0000","last_became_active":"2024-09-18T01:25:16.715581+0000","last_became_peered":"2024-09-18T01:25:16.715581+0000","last_unstale":"2024-09-18T01:27:15.080053+0000","last_undegraded":"2024-09-18T01:27:15.080053+0000","last_fullsized":"2024-09-18T01:27:15.080053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:23.172601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'8","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176264+0000","last_change":"2024-09-18T01:25:08.669854+0000","last_active":"2024-09-18T01:28:17.176264+0000","last_peered":"2024-09-18T01:28:17.176264+0000","last_clean":"2024-09-18T01:28:17.176264+0000","last_became_active":"2024-09-18T01:25:08.668430+0000","last_became_peered":"2024-09-18T01:25:08.668430+0000","last_unstale":"2024-09-18T01:28:17.176264+0000","last_undegraded":"2024-09-18T01:28:17.176264+0000","last_fullsized":"2024-09-18T01:28:17.176264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:43:08.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906927+0000","last_change":"2024-09-18T01:25:06.687779+0000","last_active":"2024-09-18T01:25:43.906927+0000","last_peered":"2024-09-18T01:25:43.906927+0000","last_clean":"2024-09-18T01:25:43.906927+0000","last_became_active":"2024-09-18T01:25:06.686394+0000","last_became_peered":"2024-09-18T01:25:06.686394+0000","last_unstale":"2024-09-18T01:25:43.906927+0000","last_undegraded":"2024-09-18T01:25:43.906927+0000","last_fullsized":"2024-09-18T01:25:43.906927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:53.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.760367+0000","last_change":"2024-09-18T01:25:10.683660+0000","last_active":"2024-09-18T01:27:13.760367+0000","last_peered":"2024-09-18T01:27:13.760367+0000","last_clean":"2024-09-18T01:27:13.760367+0000","last_became_active":"2024-09-18T01:25:10.683351+0000","last_became_peered":"2024-09-18T01:25:10.683351+0000","last_unstale":"2024-09-18T01:27:13.760367+0000","last_undegraded":"2024-09-18T01:27:13.760367+0000","last_fullsized":"2024-09-18T01:27:13.760367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:13.973263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'48","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.865856+0000","last_change":"2024-09-18T01:25:12.692015+0000","last_active":"2024-09-18T01:28:23.865856+0000","last_peered":"2024-09-18T01:28:23.865856+0000","last_clean":"2024-09-18T01:28:23.865856+0000","last_became_active":"2024-09-18T01:25:12.691715+0000","last_became_peered":"2024-09-18T01:25:12.691715+0000","last_unstale":"2024-09-18T01:28:23.865856+0000","last_undegraded":"2024-09-18T01:28:23.865856+0000","last_fullsized":"2024-09-18T01:28:23.865856+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:52:06.633359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844813+0000","last_change":"2024-09-18T01:25:14.707331+0000","last_active":"2024-09-18T01:25:43.844813+0000","last_peered":"2024-09-18T01:25:43.844813+0000","last_clean":"2024-09-18T01:25:43.844813+0000","last_became_active":"2024-09-18T01:25:14.706398+0000","last_became_peered":"2024-09-18T01:25:14.706398+0000","last_unstale":"2024-09-18T01:25:43.844813+0000","last_undegraded":"2024-09-18T01:25:43.844813+0000","last_fullsized":"2024-09-18T01:25:43.844813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:01:53.638099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.082692+0000","last_change":"2024-09-18T01:25:16.714114+0000","last_active":"2024-09-18T01:27:15.082692+0000","last_peered":"2024-09-18T01:27:15.082692+0000","last_clean":"2024-09-18T01:27:15.082692+0000","last_became_active":"2024-09-18T01:25:16.713579+0000","last_became_peered":"2024-09-18T01:25:16.713579+0000","last_unstale":"2024-09-18T01:27:15.082692+0000","last_undegraded":"2024-09-18T01:27:15.082692+0000","last_fullsized":"2024-09-18T01:27:15.082692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:14.993371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'8","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176775+0000","last_change":"2024-09-18T01:25:08.686807+0000","last_active":"2024-09-18T01:28:17.176775+0000","last_peered":"2024-09-18T01:28:17.176775+0000","last_clean":"2024-09-18T01:28:17.176775+0000","last_became_active":"2024-09-18T01:25:08.686645+0000","last_became_peered":"2024-09-18T01:25:08.686645+0000","last_unstale":"2024-09-18T01:28:17.176775+0000","last_undegraded":"2024-09-18T01:28:17.176775+0000","last_fullsized":"2024-09-18T01:28:17.176775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:25:13.805489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.842839+0000","last_change":"2024-09-18T01:25:06.703432+0000","last_active":"2024-09-18T01:25:43.842839+0000","last_peered":"2024-09-18T01:25:43.842839+0000","last_clean":"2024-09-18T01:25:43.842839+0000","last_became_active":"2024-09-18T01:25:06.702991+0000","last_became_peered":"2024-09-18T01:25:06.702991+0000","last_unstale":"2024-09-18T01:25:43.842839+0000","last_undegraded":"2024-09-18T01:25:43.842839+0000","last_fullsized":"2024-09-18T01:25:43.842839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:05.206190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176373+0000","last_change":"2024-09-18T01:25:08.673285+0000","last_active":"2024-09-18T01:28:17.176373+0000","last_peered":"2024-09-18T01:28:17.176373+0000","last_clean":"2024-09-18T01:28:17.176373+0000","last_became_active":"2024-09-18T01:25:08.672983+0000","last_became_peered":"2024-09-18T01:25:08.672983+0000","last_unstale":"2024-09-18T01:28:17.176373+0000","last_undegraded":"2024-09-18T01:28:17.176373+0000","last_fullsized":"2024-09-18T01:28:17.176373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:17.472878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843899+0000","last_change":"2024-09-18T01:25:06.681343+0000","last_active":"2024-09-18T01:25:43.843899+0000","last_peered":"2024-09-18T01:25:43.843899+0000","last_clean":"2024-09-18T01:25:43.843899+0000","last_became_active":"2024-09-18T01:25:06.680853+0000","last_became_peered":"2024-09-18T01:25:06.680853+0000","last_unstale":"2024-09-18T01:25:43.843899+0000","last_undegraded":"2024-09-18T01:25:43.843899+0000","last_fullsized":"2024-09-18T01:25:43.843899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:16.022647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'8","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941003+0000","last_change":"2024-09-18T01:25:08.682876+0000","last_active":"2024-09-18T01:26:32.941003+0000","last_peered":"2024-09-18T01:26:32.941003+0000","last_clean":"2024-09-18T01:26:32.941003+0000","last_became_active":"2024-09-18T01:25:08.682254+0000","last_became_peered":"2024-09-18T01:25:08.682254+0000","last_unstale":"2024-09-18T01:26:32.941003+0000","last_undegraded":"2024-09-18T01:26:32.941003+0000","last_fullsized":"2024-09-18T01:26:32.941003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:32:31.867039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849439+0000","last_change":"2024-09-18T01:25:06.684384+0000","last_active":"2024-09-18T01:25:43.849439+0000","last_peered":"2024-09-18T01:25:43.849439+0000","last_clean":"2024-09-18T01:25:43.849439+0000","last_became_active":"2024-09-18T01:25:06.682878+0000","last_became_peered":"2024-09-18T01:25:06.682878+0000","last_unstale":"2024-09-18T01:25:43.849439+0000","last_undegraded":"2024-09-18T01:25:43.849439+0000","last_fullsized":"2024-09-18T01:25:43.849439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:16:23.251760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.144979+0000","last_change":"2024-09-18T01:25:08.673238+0000","last_active":"2024-09-18T01:28:17.144979+0000","last_peered":"2024-09-18T01:28:17.144979+0000","last_clean":"2024-09-18T01:28:17.144979+0000","last_became_active":"2024-09-18T01:25:08.672574+0000","last_became_peered":"2024-09-18T01:25:08.672574+0000","last_unstale":"2024-09-18T01:28:17.144979+0000","last_undegraded":"2024-09-18T01:28:17.144979+0000","last_fullsized":"2024-09-18T01:28:17.144979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:41.660195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846440+0000","last_change":"2024-09-18T01:25:06.681262+0000","last_active":"2024-09-18T01:25:43.846440+0000","last_peered":"2024-09-18T01:25:43.846440+0000","last_clean":"2024-09-18T01:25:43.846440+0000","last_became_active":"2024-09-18T01:25:06.680712+0000","last_became_peered":"2024-09-18T01:25:06.680712+0000","last_unstale":"2024-09-18T01:25:43.846440+0000","last_undegraded":"2024-09-18T01:25:43.846440+0000","last_fullsized":"2024-09-18T01:25:43.846440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:03.343944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'5","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.394294+0000","last_change":"2024-09-18T01:25:08.671686+0000","last_active":"2024-09-18T01:27:13.394294+0000","last_peered":"2024-09-18T01:27:13.394294+0000","last_clean":"2024-09-18T01:27:13.394294+0000","last_became_active":"2024-09-18T01:25:08.671408+0000","last_became_peered":"2024-09-18T01:25:08.671408+0000","last_unstale":"2024-09-18T01:27:13.394294+0000","last_undegraded":"2024-09-18T01:27:13.394294+0000","last_fullsized":"2024-09-18T01:27:13.394294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:19.129968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845199+0000","last_change":"2024-09-18T01:25:06.683019+0000","last_active":"2024-09-18T01:25:43.845199+0000","last_peered":"2024-09-18T01:25:43.845199+0000","last_clean":"2024-09-18T01:25:43.845199+0000","last_became_active":"2024-09-18T01:25:06.682577+0000","last_became_peered":"2024-09-18T01:25:06.682577+0000","last_unstale":"2024-09-18T01:25:43.845199+0000","last_undegraded":"2024-09-18T01:25:43.845199+0000","last_fullsized":"2024-09-18T01:25:43.845199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:53.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'8","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954296+0000","last_change":"2024-09-18T01:25:08.688824+0000","last_active":"2024-09-18T01:28:16.954296+0000","last_peered":"2024-09-18T01:28:16.954296+0000","last_clean":"2024-09-18T01:28:16.954296+0000","last_became_active":"2024-09-18T01:25:08.687797+0000","last_became_peered":"2024-09-18T01:25:08.687797+0000","last_unstale":"2024-09-18T01:28:16.954296+0000","last_undegraded":"2024-09-18T01:28:16.954296+0000","last_fullsized":"2024-09-18T01:28:16.954296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:43:40.299678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905421+0000","last_change":"2024-09-18T01:25:06.687325+0000","last_active":"2024-09-18T01:25:43.905421+0000","last_peered":"2024-09-18T01:25:43.905421+0000","last_clean":"2024-09-18T01:25:43.905421+0000","last_became_active":"2024-09-18T01:25:06.686154+0000","last_became_peered":"2024-09-18T01:25:06.686154+0000","last_unstale":"2024-09-18T01:25:43.905421+0000","last_undegraded":"2024-09-18T01:25:43.905421+0000","last_fullsized":"2024-09-18T01:25:43.905421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:24.579150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176363+0000","last_change":"2024-09-18T01:25:08.681610+0000","last_active":"2024-09-18T01:28:17.176363+0000","last_peered":"2024-09-18T01:28:17.176363+0000","last_clean":"2024-09-18T01:28:17.176363+0000","last_became_active":"2024-09-18T01:25:08.680947+0000","last_became_peered":"2024-09-18T01:25:08.680947+0000","last_unstale":"2024-09-18T01:28:17.176363+0000","last_undegraded":"2024-09-18T01:28:17.176363+0000","last_fullsized":"2024-09-18T01:28:17.176363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:41.267347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845952+0000","last_change":"2024-09-18T01:25:06.704000+0000","last_active":"2024-09-18T01:25:43.845952+0000","last_peered":"2024-09-18T01:25:43.845952+0000","last_clean":"2024-09-18T01:25:43.845952+0000","last_became_active":"2024-09-18T01:25:06.703622+0000","last_became_peered":"2024-09-18T01:25:06.703622+0000","last_unstale":"2024-09-18T01:25:43.845952+0000","last_undegraded":"2024-09-18T01:25:43.845952+0000","last_fullsized":"2024-09-18T01:25:43.845952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:33:48.652888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'6","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.142304+0000","last_change":"2024-09-18T01:25:08.682682+0000","last_active":"2024-09-18T01:28:17.142304+0000","last_peered":"2024-09-18T01:28:17.142304+0000","last_clean":"2024-09-18T01:28:17.142304+0000","last_became_active":"2024-09-18T01:25:08.682143+0000","last_became_peered":"2024-09-18T01:25:08.682143+0000","last_unstale":"2024-09-18T01:28:17.142304+0000","last_undegraded":"2024-09-18T01:28:17.142304+0000","last_fullsized":"2024-09-18T01:28:17.142304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:10.604887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.435644+0000","last_change":"2024-09-18T01:25:06.687744+0000","last_active":"2024-09-18T01:25:50.435644+0000","last_peered":"2024-09-18T01:25:50.435644+0000","last_clean":"2024-09-18T01:25:50.435644+0000","last_became_active":"2024-09-18T01:25:06.687436+0000","last_became_peered":"2024-09-18T01:25:06.687436+0000","last_unstale":"2024-09-18T01:25:50.435644+0000","last_undegraded":"2024-09-18T01:25:50.435644+0000","last_fullsized":"2024-09-18T01:25:50.435644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:08.432830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'14","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097381+0000","last_change":"2024-09-18T01:25:08.676069+0000","last_active":"2024-09-18T01:28:17.097381+0000","last_peered":"2024-09-18T01:28:17.097381+0000","last_clean":"2024-09-18T01:28:17.097381+0000","last_became_active":"2024-09-18T01:25:08.675801+0000","last_became_peered":"2024-09-18T01:25:08.675801+0000","last_unstale":"2024-09-18T01:28:17.097381+0000","last_undegraded":"2024-09-18T01:28:17.097381+0000","last_fullsized":"2024-09-18T01:28:17.097381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:27.055282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.439101+0000","last_change":"2024-09-18T01:25:06.693564+0000","last_active":"2024-09-18T01:25:50.439101+0000","last_peered":"2024-09-18T01:25:50.439101+0000","last_clean":"2024-09-18T01:25:50.439101+0000","last_became_active":"2024-09-18T01:25:06.691345+0000","last_became_peered":"2024-09-18T01:25:06.691345+0000","last_unstale":"2024-09-18T01:25:50.439101+0000","last_undegraded":"2024-09-18T01:25:50.439101+0000","last_fullsized":"2024-09-18T01:25:50.439101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:23:21.828422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'16","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097074+0000","last_change":"2024-09-18T01:25:08.685632+0000","last_active":"2024-09-18T01:28:17.097074+0000","last_peered":"2024-09-18T01:28:17.097074+0000","last_clean":"2024-09-18T01:28:17.097074+0000","last_became_active":"2024-09-18T01:25:08.685358+0000","last_became_peered":"2024-09-18T01:25:08.685358+0000","last_unstale":"2024-09-18T01:28:17.097074+0000","last_undegraded":"2024-09-18T01:28:17.097074+0000","last_fullsized":"2024-09-18T01:28:17.097074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:56:00.059201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844121+0000","last_change":"2024-09-18T01:25:06.696372+0000","last_active":"2024-09-18T01:25:43.844121+0000","last_peered":"2024-09-18T01:25:43.844121+0000","last_clean":"2024-09-18T01:25:43.844121+0000","last_became_active":"2024-09-18T01:25:06.695735+0000","last_became_peered":"2024-09-18T01:25:06.695735+0000","last_unstale":"2024-09-18T01:25:43.844121+0000","last_undegraded":"2024-09-18T01:25:43.844121+0000","last_fullsized":"2024-09-18T01:25:43.844121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:24.579150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:49.871200+0000","last_change":"2024-09-18T01:25:43.852539+0000","last_active":"2024-09-18T01:25:49.871200+0000","last_peered":"2024-09-18T01:25:49.871200+0000","last_clean":"2024-09-18T01:25:49.871200+0000","last_became_active":"2024-09-18T01:25:43.849600+0000","last_became_peered":"2024-09-18T01:25:43.849600+0000","last_unstale":"2024-09-18T01:25:49.871200+0000","last_undegraded":"2024-09-18T01:25:49.871200+0000","last_fullsized":"2024-09-18T01:25:49.871200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:43.134170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904800+0000","last_change":"2024-09-18T01:25:06.695026+0000","last_active":"2024-09-18T01:25:43.904800+0000","last_peered":"2024-09-18T01:25:43.904800+0000","last_clean":"2024-09-18T01:25:43.904800+0000","last_became_active":"2024-09-18T01:25:06.688967+0000","last_became_peered":"2024-09-18T01:25:06.688967+0000","last_unstale":"2024-09-18T01:25:43.904800+0000","last_undegraded":"2024-09-18T01:25:43.904800+0000","last_fullsized":"2024-09-18T01:25:43.904800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:05.206190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'10","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176674+0000","last_change":"2024-09-18T01:25:08.684071+0000","last_active":"2024-09-18T01:28:17.176674+0000","last_peered":"2024-09-18T01:28:17.176674+0000","last_clean":"2024-09-18T01:28:17.176674+0000","last_became_active":"2024-09-18T01:25:08.683590+0000","last_became_peered":"2024-09-18T01:25:08.683590+0000","last_unstale":"2024-09-18T01:28:17.176674+0000","last_undegraded":"2024-09-18T01:28:17.176674+0000","last_fullsized":"2024-09-18T01:28:17.176674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:43:55.523212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'6","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.792718+0000","last_change":"2024-09-18T01:25:06.686285+0000","last_active":"2024-09-18T01:28:16.792718+0000","last_peered":"2024-09-18T01:28:16.792718+0000","last_clean":"2024-09-18T01:28:16.792718+0000","last_became_active":"2024-09-18T01:25:06.685814+0000","last_became_peered":"2024-09-18T01:25:06.685814+0000","last_unstale":"2024-09-18T01:28:16.792718+0000","last_undegraded":"2024-09-18T01:28:16.792718+0000","last_fullsized":"2024-09-18T01:28:16.792718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:53.580899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954264+0000","last_change":"2024-09-18T01:25:08.686910+0000","last_active":"2024-09-18T01:28:16.954264+0000","last_peered":"2024-09-18T01:28:16.954264+0000","last_clean":"2024-09-18T01:28:16.954264+0000","last_became_active":"2024-09-18T01:25:08.686703+0000","last_became_peered":"2024-09-18T01:25:08.686703+0000","last_unstale":"2024-09-18T01:28:16.954264+0000","last_undegraded":"2024-09-18T01:28:16.954264+0000","last_fullsized":"2024-09-18T01:28:16.954264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:41.660195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.929092+0000","last_change":"2024-09-18T01:25:06.691078+0000","last_active":"2024-09-18T01:26:32.929092+0000","last_peered":"2024-09-18T01:26:32.929092+0000","last_clean":"2024-09-18T01:26:32.929092+0000","last_became_active":"2024-09-18T01:25:06.685120+0000","last_became_peered":"2024-09-18T01:25:06.685120+0000","last_unstale":"2024-09-18T01:26:32.929092+0000","last_undegraded":"2024-09-18T01:26:32.929092+0000","last_fullsized":"2024-09-18T01:26:32.929092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:11:04.031882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'7","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183513+0000","last_change":"2024-09-18T01:25:08.685436+0000","last_active":"2024-09-18T01:28:17.183513+0000","last_peered":"2024-09-18T01:28:17.183513+0000","last_clean":"2024-09-18T01:28:17.183513+0000","last_became_active":"2024-09-18T01:25:08.685158+0000","last_became_peered":"2024-09-18T01:25:08.685158+0000","last_unstale":"2024-09-18T01:28:17.183513+0000","last_undegraded":"2024-09-18T01:28:17.183513+0000","last_fullsized":"2024-09-18T01:28:17.183513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:07.788671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851842+0000","last_change":"2024-09-18T01:25:06.687424+0000","last_active":"2024-09-18T01:25:43.851842+0000","last_peered":"2024-09-18T01:25:43.851842+0000","last_clean":"2024-09-18T01:25:43.851842+0000","last_became_active":"2024-09-18T01:25:06.684845+0000","last_became_peered":"2024-09-18T01:25:06.684845+0000","last_unstale":"2024-09-18T01:25:43.851842+0000","last_undegraded":"2024-09-18T01:25:43.851842+0000","last_fullsized":"2024-09-18T01:25:43.851842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:33.279586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954367+0000","last_change":"2024-09-18T01:25:08.688327+0000","last_active":"2024-09-18T01:28:16.954367+0000","last_peered":"2024-09-18T01:28:16.954367+0000","last_clean":"2024-09-18T01:28:16.954367+0000","last_became_active":"2024-09-18T01:25:08.687840+0000","last_became_peered":"2024-09-18T01:25:08.687840+0000","last_unstale":"2024-09-18T01:28:16.954367+0000","last_undegraded":"2024-09-18T01:28:16.954367+0000","last_fullsized":"2024-09-18T01:28:16.954367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:24:41.518231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.089186+0000","last_change":"2024-09-18T01:25:06.704602+0000","last_active":"2024-09-18T01:28:17.089186+0000","last_peered":"2024-09-18T01:28:17.089186+0000","last_clean":"2024-09-18T01:28:17.089186+0000","last_became_active":"2024-09-18T01:25:06.704247+0000","last_became_peered":"2024-09-18T01:25:06.704247+0000","last_unstale":"2024-09-18T01:28:17.089186+0000","last_undegraded":"2024-09-18T01:28:17.089186+0000","last_fullsized":"2024-09-18T01:28:17.089186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:53.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'12","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.393720+0000","last_change":"2024-09-18T01:25:08.681230+0000","last_active":"2024-09-18T01:27:13.393720+0000","last_peered":"2024-09-18T01:27:13.393720+0000","last_clean":"2024-09-18T01:27:13.393720+0000","last_became_active":"2024-09-18T01:25:08.680916+0000","last_became_peered":"2024-09-18T01:25:08.680916+0000","last_unstale":"2024-09-18T01:27:13.393720+0000","last_undegraded":"2024-09-18T01:27:13.393720+0000","last_fullsized":"2024-09-18T01:27:13.393720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:09:03.211587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851720+0000","last_change":"2024-09-18T01:25:06.694171+0000","last_active":"2024-09-18T01:25:43.851720+0000","last_peered":"2024-09-18T01:25:43.851720+0000","last_clean":"2024-09-18T01:25:43.851720+0000","last_became_active":"2024-09-18T01:25:06.693000+0000","last_became_peered":"2024-09-18T01:25:06.693000+0000","last_unstale":"2024-09-18T01:25:43.851720+0000","last_undegraded":"2024-09-18T01:25:43.851720+0000","last_fullsized":"2024-09-18T01:25:43.851720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:50:30.604573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:49.302585+0000","last_change":"2024-09-18T01:25:06.694282+0000","last_active":"2024-09-18T01:25:49.302585+0000","last_peered":"2024-09-18T01:25:49.302585+0000","last_clean":"2024-09-18T01:25:49.302585+0000","last_became_active":"2024-09-18T01:25:06.691141+0000","last_became_peered":"2024-09-18T01:25:06.691141+0000","last_unstale":"2024-09-18T01:25:49.302585+0000","last_undegraded":"2024-09-18T01:25:49.302585+0000","last_fullsized":"2024-09-18T01:25:49.302585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:04.323530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'12","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.870361+0000","last_change":"2024-09-18T01:25:08.681504+0000","last_active":"2024-09-18T01:28:16.870361+0000","last_peered":"2024-09-18T01:28:16.870361+0000","last_clean":"2024-09-18T01:28:16.870361+0000","last_became_active":"2024-09-18T01:25:08.681053+0000","last_became_peered":"2024-09-18T01:25:08.681053+0000","last_unstale":"2024-09-18T01:28:16.870361+0000","last_undegraded":"2024-09-18T01:28:16.870361+0000","last_fullsized":"2024-09-18T01:28:16.870361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:34:57.289152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844207+0000","last_change":"2024-09-18T01:25:06.696528+0000","last_active":"2024-09-18T01:25:43.844207+0000","last_peered":"2024-09-18T01:25:43.844207+0000","last_clean":"2024-09-18T01:25:43.844207+0000","last_became_active":"2024-09-18T01:25:06.695875+0000","last_became_peered":"2024-09-18T01:25:06.695875+0000","last_unstale":"2024-09-18T01:25:43.844207+0000","last_undegraded":"2024-09-18T01:25:43.844207+0000","last_fullsized":"2024-09-18T01:25:43.844207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:22.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097034+0000","last_change":"2024-09-18T01:25:08.688042+0000","last_active":"2024-09-18T01:28:17.097034+0000","last_peered":"2024-09-18T01:28:17.097034+0000","last_clean":"2024-09-18T01:28:17.097034+0000","last_became_active":"2024-09-18T01:25:08.687583+0000","last_became_peered":"2024-09-18T01:25:08.687583+0000","last_unstale":"2024-09-18T01:28:17.097034+0000","last_undegraded":"2024-09-18T01:28:17.097034+0000","last_fullsized":"2024-09-18T01:28:17.097034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:55:06.296443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2271,"ondisk_log_size":2271,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1846,"num_read_kb":1611,"num_write":775,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1545,"ondisk_log_size":1545,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":968,"num_read_kb":968,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":12570624,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":142,"num_read_kb":87,"num_write":313,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673007,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":487424,"data_stored":155040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673007,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":744524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673008,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36368,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335472,"statfs":{"total":96636764160,"available":96599523328,"internally_reserved":0,"allocated":1044480,"data_stored":744891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48360,"kb_used_data":8856,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323480,"statfs":{"total":96636764160,"available":96587243520,"internally_reserved":0,"allocated":9068544,"data_stored":8760581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:28:24.952 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T01:28:25.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.048+0000 7fd3cbd0a640 1 Processor -- start 2024-09-18T01:28:25.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.048+0000 7fd3cbd0a640 1 -- start start 2024-09-18T01:28:25.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.048+0000 7fd3cbd0a640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd3c406eda0 0x7fd3c406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:25.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.048+0000 7fd3cbd0a640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3c406eba0 con 0x7fd3c406f6c0 2024-09-18T01:28:25.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.048+0000 7fd3cbd0a640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c406d2f0 con 0x7fd3c406eda0 2024-09-18T01:28:25.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.048+0000 7fd3c9aa6640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd3c406eda0 0x7fd3c406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:25.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.048+0000 7fd3c9aa6640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd3c406eda0 0x7fd3c406f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56970/0 (socket says 172.21.15.92:56970) 2024-09-18T01:28:25.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.048+0000 7fd3c92a5640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fd3c406f6c0 0x7fd3c4121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56662/0 (socket says 172.21.15.92:56662) 2024-09-18T01:28:25.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.048+0000 7fd3c9aa6640 1 -- 172.21.15.92:0/3693118755 learned_addr learned my addr 172.21.15.92:0/3693118755 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:25.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.049+0000 7fd3c9aa6640 1 -- 172.21.15.92:0/3693118755 >> v1:172.21.15.92:6789/0 conn(0x7fd3c406f6c0 legacy=0x7fd3c4121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:25.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.049+0000 7fd3c9aa6640 1 -- 172.21.15.92:0/3693118755 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c4070d50 con 0x7fd3c406eda0 2024-09-18T01:28:25.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.049+0000 7fd3c8aa4640 1 -- 172.21.15.92:0/3693118755 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 141295977 0 0) 0x7fd3c406eba0 con 0x7fd3c406f6c0 2024-09-18T01:28:25.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.049+0000 7fd3c9aa6640 1 --2- 172.21.15.92:0/3693118755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3c406eda0 0x7fd3c406f180 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000ba90 tx=0x7fd3c002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9031cf1cab63d330 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:25.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.049+0000 7fd3c8aa4640 1 -- 172.21.15.92:0/3693118755 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c0036020 con 0x7fd3c406eda0 2024-09-18T01:28:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.049+0000 7fd3c8aa4640 1 -- 172.21.15.92:0/3693118755 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c0032770 con 0x7fd3c406eda0 2024-09-18T01:28:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.049+0000 7fd3c8aa4640 1 -- 172.21.15.92:0/3693118755 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c0032a70 con 0x7fd3c406eda0 2024-09-18T01:28:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.050+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/3693118755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3c406eda0 msgr2=0x7fd3c406f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.050+0000 7fd3cbd0a640 1 --2- 172.21.15.92:0/3693118755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3c406eda0 0x7fd3c406f180 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000ba90 tx=0x7fd3c002c940 comp rx=0 tx=0).stop 2024-09-18T01:28:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.050+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/3693118755 shutdown_connections 2024-09-18T01:28:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.050+0000 7fd3cbd0a640 1 --2- 172.21.15.92:0/3693118755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3c406eda0 0x7fd3c406f180 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.050+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/3693118755 >> 172.21.15.92:0/3693118755 conn(0x7fd3c409a890 msgr2=0x7fd3c409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.050+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/3693118755 shutdown_connections 2024-09-18T01:28:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.050+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/3693118755 wait complete. 2024-09-18T01:28:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.051+0000 7fd3cbd0a640 1 Processor -- start 2024-09-18T01:28:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.051+0000 7fd3cbd0a640 1 -- start start 2024-09-18T01:28:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.051+0000 7fd3cbd0a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3c406eda0 0x7fd3c4127a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.051+0000 7fd3cbd0a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c4122160 con 0x7fd3c406eda0 2024-09-18T01:28:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.051+0000 7fd3c9aa6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3c406eda0 0x7fd3c4127a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.051+0000 7fd3c9aa6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3c406eda0 0x7fd3c4127a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56974/0 (socket says 172.21.15.92:56974) 2024-09-18T01:28:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.051+0000 7fd3c9aa6640 1 -- 172.21.15.92:0/4162076936 learned_addr learned my addr 172.21.15.92:0/4162076936 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.052+0000 7fd3c9aa6640 1 -- 172.21.15.92:0/4162076936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c408b6a0 con 0x7fd3c406eda0 2024-09-18T01:28:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.052+0000 7fd3c9aa6640 1 --2- 172.21.15.92:0/4162076936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3c406eda0 0x7fd3c4127a60 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000b2c0 tx=0x7fd3c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.052+0000 7fd3ba7fc640 1 -- 172.21.15.92:0/4162076936 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c0032920 con 0x7fd3c406eda0 2024-09-18T01:28:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.052+0000 7fd3ba7fc640 1 -- 172.21.15.92:0/4162076936 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c0032c60 con 0x7fd3c406eda0 2024-09-18T01:28:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.052+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/4162076936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c4125d80 con 0x7fd3c406eda0 2024-09-18T01:28:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.052+0000 7fd3ba7fc640 1 -- 172.21.15.92:0/4162076936 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c0004030 con 0x7fd3c406eda0 2024-09-18T01:28:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.052+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/4162076936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c408c510 con 0x7fd3c406eda0 2024-09-18T01:28:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.053+0000 7fd3ba7fc640 1 -- 172.21.15.92:0/4162076936 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd3c004d060 con 0x7fd3c406eda0 2024-09-18T01:28:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.053+0000 7fd3ba7fc640 1 --2- 172.21.15.92:0/4162076936 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3a80382a0 0x7fd3a803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.053+0000 7fd3ba7fc640 1 -- 172.21.15.92:0/4162076936 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd3c0041030 con 0x7fd3c406eda0 2024-09-18T01:28:25.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.053+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/4162076936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c4122670 con 0x7fd3c406eda0 2024-09-18T01:28:25.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.053+0000 7fd3c92a5640 1 --2- 172.21.15.92:0/4162076936 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3a80382a0 0x7fd3a803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:25.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.054+0000 7fd3c92a5640 1 --2- 172.21.15.92:0/4162076936 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3a80382a0 0x7fd3a803a760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4000c00 tx=0x7fd3b4007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:25.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.057+0000 7fd3ba7fc640 1 -- 172.21.15.92:0/4162076936 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3c0003610 con 0x7fd3c406eda0 2024-09-18T01:28:25.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.223+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/4162076936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3c408be70 con 0x7fd3c406eda0 2024-09-18T01:28:25.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.225+0000 7fd3ba7fc640 1 -- 172.21.15.92:0/4162076936 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+21140 (secure 0 0 0) 0x7fd3c00041d0 con 0x7fd3c406eda0 2024-09-18T01:28:25.226 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:28:25.227 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":35,"fsid":"b78e7965-b05a-4410-91d0-045de6d3262c","created":"2024-09-18T01:24:38.657876+0000","modified":"2024-09-18T01:25:43.837330+0000","last_up_change":"2024-09-18T01:24:49.159870+0000","last_in_change":"2024-09-18T01:24:39.801526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T01:24:50.794525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T01:24:54.289682+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-18T01:25:04.661688+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-18T01:25:06.989274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-18T01:25:08.992901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-18T01:25:10.763637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-18T01:25:12.712372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-18T01:25:14.792395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682fe679-c400-4f69-a149-b79e2378d5c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6801","nonce":2777570747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6803","nonce":2777570747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6807","nonce":2777570747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2777570747},{"type":"v1","addr":"172.21.15.92:6805","nonce":2777570747}]},"public_addr":"172.21.15.92:6801/2777570747","cluster_addr":"172.21.15.92:6803/2777570747","heartbeat_back_addr":"172.21.15.92:6807/2777570747","heartbeat_front_addr":"172.21.15.92:6805/2777570747","state":["exists","up"]},{"osd":1,"uuid":"ac9e21ba-ed5c-42f9-95ee-a96375bb9d1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6801","nonce":170575980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6803","nonce":170575980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6807","nonce":170575980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":170575980},{"type":"v1","addr":"172.21.15.100:6805","nonce":170575980}]},"public_addr":"172.21.15.100:6801/170575980","cluster_addr":"172.21.15.100:6803/170575980","heartbeat_back_addr":"172.21.15.100:6807/170575980","heartbeat_front_addr":"172.21.15.100:6805/170575980","state":["exists","up"]},{"osd":2,"uuid":"007ace6b-0046-48e4-9135-506e415b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6809","nonce":3104327688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6811","nonce":3104327688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6815","nonce":3104327688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3104327688},{"type":"v1","addr":"172.21.15.100:6813","nonce":3104327688}]},"public_addr":"172.21.15.100:6809/3104327688","cluster_addr":"172.21.15.100:6811/3104327688","heartbeat_back_addr":"172.21.15.100:6815/3104327688","heartbeat_front_addr":"172.21.15.100:6813/3104327688","state":["exists","up"]},{"osd":3,"uuid":"be610877-3846-4095-9cf3-30d6ee8d0f31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6817","nonce":595195757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6819","nonce":595195757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6823","nonce":595195757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":595195757},{"type":"v1","addr":"172.21.15.100:6821","nonce":595195757}]},"public_addr":"172.21.15.100:6817/595195757","cluster_addr":"172.21.15.100:6819/595195757","heartbeat_back_addr":"172.21.15.100:6823/595195757","heartbeat_front_addr":"172.21.15.100:6821/595195757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:46.705981+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:46.602358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:46.419325+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:24:47.136084+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.2d","mappings":[{"from":3,"to":2}]},{"pgid":"4.3d","mappings":[{"from":3,"to":2}]},{"pgid":"5.a","mappings":[{"from":0,"to":2}]},{"pgid":"5.b","mappings":[{"from":0,"to":2}]},{"pgid":"5.1f","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T01:28:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.227+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/4162076936 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3a80382a0 msgr2=0x7fd3a803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.227+0000 7fd3cbd0a640 1 --2- 172.21.15.92:0/4162076936 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3a80382a0 0x7fd3a803a760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4000c00 tx=0x7fd3b4007910 comp rx=0 tx=0).stop 2024-09-18T01:28:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.227+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/4162076936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3c406eda0 msgr2=0x7fd3c4127a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.227+0000 7fd3cbd0a640 1 --2- 172.21.15.92:0/4162076936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3c406eda0 0x7fd3c4127a60 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000b2c0 tx=0x7fd3c00046c0 comp rx=0 tx=0).stop 2024-09-18T01:28:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.227+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/4162076936 shutdown_connections 2024-09-18T01:28:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.227+0000 7fd3cbd0a640 1 --2- 172.21.15.92:0/4162076936 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd3a80382a0 0x7fd3a803a760 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.227+0000 7fd3cbd0a640 1 --2- 172.21.15.92:0/4162076936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3c406eda0 0x7fd3c4127a60 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.227+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/4162076936 >> 172.21.15.92:0/4162076936 conn(0x7fd3c409a890 msgr2=0x7fd3c4097dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.227+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/4162076936 shutdown_connections 2024-09-18T01:28:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:25.227+0000 7fd3cbd0a640 1 -- 172.21.15.92:0/4162076936 wait complete. 2024-09-18T01:28:26.240 INFO:tasks.ceph:Scrubbing osd.0 2024-09-18T01:28:26.240 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-18T01:28:26.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.359+0000 7f2798053640 1 Processor -- start 2024-09-18T01:28:26.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.359+0000 7f2798053640 1 -- start start 2024-09-18T01:28:26.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.359+0000 7f2798053640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f279006eeb0 0x7f2790137f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:26.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.359+0000 7f2798053640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f279012f720 con 0x7f279012fb70 2024-09-18T01:28:26.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.359+0000 7f2798053640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f279006e5f0 con 0x7f279006eeb0 2024-09-18T01:28:26.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.360+0000 7f27955ee640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f279006eeb0 0x7f2790137f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:26.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.360+0000 7f2795def640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f279012fb70 0x7f279012ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56664/0 (socket says 172.21.15.92:56664) 2024-09-18T01:28:26.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.360+0000 7f2795def640 1 -- 172.21.15.92:0/913279215 learned_addr learned my addr 172.21.15.92:0/913279215 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:28:26.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.360+0000 7f27955ee640 1 --2- 172.21.15.92:0/913279215 >> v2:172.21.15.92:3300/0 conn(0x7f279006eeb0 0x7f2790137f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56986/0 (socket says 172.21.15.92:56986) 2024-09-18T01:28:26.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.360+0000 7f27955ee640 1 -- 172.21.15.92:0/913279215 >> v1:172.21.15.92:6789/0 conn(0x7f279012fb70 legacy=0x7f279012ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.360+0000 7f2794ded640 1 -- 172.21.15.92:0/913279215 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1698520967 0 0) 0x7f279012f720 con 0x7f279012fb70 2024-09-18T01:28:26.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.360+0000 7f27955ee640 1 -- 172.21.15.92:0/913279215 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27900989a0 con 0x7f279006eeb0 2024-09-18T01:28:26.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.361+0000 7f27955ee640 1 --2- 172.21.15.92:0/913279215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f279006eeb0 0x7f2790137f40 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2784009720 tx=0x7f278402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918db4e7968b2243 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:26.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.361+0000 7f2794ded640 1 -- 172.21.15.92:0/913279215 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2784037070 con 0x7f279006eeb0 2024-09-18T01:28:26.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.361+0000 7f2794ded640 1 -- 172.21.15.92:0/913279215 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f278402ad90 con 0x7f279006eeb0 2024-09-18T01:28:26.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.361+0000 7f2794ded640 1 -- 172.21.15.92:0/913279215 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2784032590 con 0x7f279006eeb0 2024-09-18T01:28:26.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.361+0000 7f2798053640 1 -- 172.21.15.92:0/913279215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f279006eeb0 msgr2=0x7f2790137f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.361+0000 7f2798053640 1 --2- 172.21.15.92:0/913279215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f279006eeb0 0x7f2790137f40 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2784009720 tx=0x7f278402a110 comp rx=0 tx=0).stop 2024-09-18T01:28:26.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.362+0000 7f2798053640 1 -- 172.21.15.92:0/913279215 shutdown_connections 2024-09-18T01:28:26.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.362+0000 7f2798053640 1 --2- 172.21.15.92:0/913279215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f279006eeb0 0x7f2790137f40 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.362+0000 7f2798053640 1 -- 172.21.15.92:0/913279215 >> 172.21.15.92:0/913279215 conn(0x7f27900998b0 msgr2=0x7f2790099cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:26.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.362+0000 7f2798053640 1 -- 172.21.15.92:0/913279215 shutdown_connections 2024-09-18T01:28:26.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.362+0000 7f2798053640 1 -- 172.21.15.92:0/913279215 wait complete. 2024-09-18T01:28:26.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.363+0000 7f2798053640 1 Processor -- start 2024-09-18T01:28:26.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.363+0000 7f2798053640 1 -- start start 2024-09-18T01:28:26.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.363+0000 7f2798053640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f279006eeb0 0x7f2790132890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:26.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.363+0000 7f2798053640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2790138600 con 0x7f279006eeb0 2024-09-18T01:28:26.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.363+0000 7f2795def640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f279006eeb0 0x7f2790132890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:26.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.363+0000 7f2795def640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f279006eeb0 0x7f2790132890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56996/0 (socket says 172.21.15.92:56996) 2024-09-18T01:28:26.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.363+0000 7f2795def640 1 -- 172.21.15.92:0/4135253595 learned_addr learned my addr 172.21.15.92:0/4135253595 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:26.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.363+0000 7f2795def640 1 -- 172.21.15.92:0/4135253595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27901352d0 con 0x7f279006eeb0 2024-09-18T01:28:26.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.363+0000 7f2795def640 1 --2- 172.21.15.92:0/4135253595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f279006eeb0 0x7f2790132890 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f278c00c420 tx=0x7f278c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:26.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.364+0000 7f27827fc640 1 -- 172.21.15.92:0/4135253595 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f278c018070 con 0x7f279006eeb0 2024-09-18T01:28:26.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.364+0000 7f27827fc640 1 -- 172.21.15.92:0/4135253595 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f278c0074d0 con 0x7f279006eeb0 2024-09-18T01:28:26.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.364+0000 7f2798053640 1 -- 172.21.15.92:0/4135253595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2790135500 con 0x7f279006eeb0 2024-09-18T01:28:26.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.364+0000 7f27827fc640 1 -- 172.21.15.92:0/4135253595 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f278c004950 con 0x7f279006eeb0 2024-09-18T01:28:26.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.364+0000 7f2798053640 1 -- 172.21.15.92:0/4135253595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2790132fb0 con 0x7f279006eeb0 2024-09-18T01:28:26.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.365+0000 7f2798053640 1 -- 172.21.15.92:0/4135253595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2790074990 con 0x7f279006eeb0 2024-09-18T01:28:26.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.365+0000 7f27827fc640 1 -- 172.21.15.92:0/4135253595 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f278c01b070 con 0x7f279006eeb0 2024-09-18T01:28:26.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.365+0000 7f27827fc640 1 --2- 172.21.15.92:0/4135253595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f27740382a0 0x7f277403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:26.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.365+0000 7f27827fc640 1 -- 172.21.15.92:0/4135253595 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f278c04b0a0 con 0x7f279006eeb0 2024-09-18T01:28:26.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.365+0000 7f27827fc640 1 --2- 172.21.15.92:0/4135253595 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2774044690 0x7f2774046b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:26.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.365+0000 7f27827fc640 1 -- 172.21.15.92:0/4135253595 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f278c006e50 con 0x7f2774044690 2024-09-18T01:28:26.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.365+0000 7f27827fc640 1 -- 172.21.15.92:0/4135253595 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f278c052050 con 0x7f279006eeb0 2024-09-18T01:28:26.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.365+0000 7f27955ee640 1 --2- 172.21.15.92:0/4135253595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f27740382a0 0x7f277403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:26.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.365+0000 7f27965f0640 1 --2- 172.21.15.92:0/4135253595 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2774044690 0x7f2774046b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:26.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.366+0000 7f27965f0640 1 --2- 172.21.15.92:0/4135253595 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2774044690 0x7f2774046b30 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:26.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.366+0000 7f27955ee640 1 --2- 172.21.15.92:0/4135253595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f27740382a0 0x7f277403a760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2784009720 tx=0x7f278402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:26.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.366+0000 7f27827fc640 1 -- 172.21.15.92:0/4135253595 <== osd.0 v2:172.21.15.92:6800/2777570747 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f278c006e50 con 0x7f2774044690 2024-09-18T01:28:26.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.379+0000 7f2798053640 1 -- 172.21.15.92:0/4135253595 --> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f279012d370 con 0x7f2774044690 2024-09-18T01:28:26.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.379+0000 7f27827fc640 1 -- 172.21.15.92:0/4135253595 <== osd.0 v2:172.21.15.92:6800/2777570747 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f279012d370 con 0x7f2774044690 2024-09-18T01:28:26.381 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-18T01:28:26.381 INFO:teuthology.orchestra.run.smithi092.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T01:28:26.381 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-18T01:28:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.380+0000 7f2798053640 1 -- 172.21.15.92:0/4135253595 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2774044690 msgr2=0x7f2774046b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.380+0000 7f2798053640 1 --2- 172.21.15.92:0/4135253595 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2774044690 0x7f2774046b30 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.380+0000 7f2798053640 1 -- 172.21.15.92:0/4135253595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f27740382a0 msgr2=0x7f277403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.380+0000 7f2798053640 1 --2- 172.21.15.92:0/4135253595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f27740382a0 0x7f277403a760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2784009720 tx=0x7f278402e000 comp rx=0 tx=0).stop 2024-09-18T01:28:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.380+0000 7f2798053640 1 -- 172.21.15.92:0/4135253595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f279006eeb0 msgr2=0x7f2790132890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.380+0000 7f2798053640 1 --2- 172.21.15.92:0/4135253595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f279006eeb0 0x7f2790132890 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f278c00c420 tx=0x7f278c00c8e0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.380+0000 7f2798053640 1 -- 172.21.15.92:0/4135253595 shutdown_connections 2024-09-18T01:28:26.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.380+0000 7f2798053640 1 --2- 172.21.15.92:0/4135253595 >> [v2:172.21.15.92:6800/2777570747,v1:172.21.15.92:6801/2777570747] conn(0x7f2774044690 0x7f2774046b30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.380+0000 7f2798053640 1 --2- 172.21.15.92:0/4135253595 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f27740382a0 0x7f277403a760 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.380+0000 7f2798053640 1 --2- 172.21.15.92:0/4135253595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f279006eeb0 0x7f2790132890 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.380+0000 7f2798053640 1 -- 172.21.15.92:0/4135253595 >> 172.21.15.92:0/4135253595 conn(0x7f27900998b0 msgr2=0x7f2790071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:26.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.380+0000 7f2798053640 1 -- 172.21.15.92:0/4135253595 shutdown_connections 2024-09-18T01:28:26.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.380+0000 7f2798053640 1 -- 172.21.15.92:0/4135253595 wait complete. 2024-09-18T01:28:26.392 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-18T01:28:26.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.491+0000 7ff2d4a5c640 1 Processor -- start 2024-09-18T01:28:26.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.491+0000 7ff2d4a5c640 1 -- start start 2024-09-18T01:28:26.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.492+0000 7ff2d4a5c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff2d009a100 0x7ff2d0133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:26.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.492+0000 7ff2d4a5c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2d009d3b0 con 0x7ff2d009bd50 2024-09-18T01:28:26.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.492+0000 7ff2d4a5c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff2d009c840 con 0x7ff2d009a100 2024-09-18T01:28:26.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.492+0000 7ff2c5d9b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff2d009a100 0x7ff2d0133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:26.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.492+0000 7ff2ce59c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff2d009bd50 0x7ff2d009c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56672/0 (socket says 172.21.15.92:56672) 2024-09-18T01:28:26.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.492+0000 7ff2ce59c640 1 -- 172.21.15.92:0/1071064670 learned_addr learned my addr 172.21.15.92:0/1071064670 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:28:26.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.492+0000 7ff2c5d9b640 1 -- 172.21.15.92:0/1071064670 >> v1:172.21.15.92:6789/0 conn(0x7ff2d009bd50 legacy=0x7ff2d009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.492+0000 7ff2c5d9b640 1 -- 172.21.15.92:0/1071064670 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d0098230 con 0x7ff2d009a100 2024-09-18T01:28:26.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.492+0000 7ff2cdd9b640 1 -- 172.21.15.92:0/1071064670 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920572030 0 0) 0x7ff2c0001110 con 0x7ff2d009bd50 2024-09-18T01:28:26.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.493+0000 7ff2c5d9b640 1 --2- 172.21.15.92:0/1071064670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d009a100 0x7ff2d0133da0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009720 tx=0x7ff2b802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492dc65993bc7408 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:26.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.493+0000 7ff2cdd9b640 1 -- 172.21.15.92:0/1071064670 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b8037070 con 0x7ff2d009a100 2024-09-18T01:28:26.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.493+0000 7ff2cdd9b640 1 -- 172.21.15.92:0/1071064670 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b802ad90 con 0x7ff2d009a100 2024-09-18T01:28:26.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.493+0000 7ff2cdd9b640 1 -- 172.21.15.92:0/1071064670 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b8032590 con 0x7ff2d009a100 2024-09-18T01:28:26.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.493+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/1071064670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d009a100 msgr2=0x7ff2d0133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.493+0000 7ff2d4a5c640 1 --2- 172.21.15.92:0/1071064670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d009a100 0x7ff2d0133da0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009720 tx=0x7ff2b802a110 comp rx=0 tx=0).stop 2024-09-18T01:28:26.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.493+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/1071064670 shutdown_connections 2024-09-18T01:28:26.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.493+0000 7ff2d4a5c640 1 --2- 172.21.15.92:0/1071064670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d009a100 0x7ff2d0133da0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.493+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/1071064670 >> 172.21.15.92:0/1071064670 conn(0x7ff2d006d4a0 msgr2=0x7ff2d006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:26.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.493+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/1071064670 shutdown_connections 2024-09-18T01:28:26.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.493+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/1071064670 wait complete. 2024-09-18T01:28:26.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.494+0000 7ff2d4a5c640 1 Processor -- start 2024-09-18T01:28:26.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.495+0000 7ff2d4a5c640 1 -- start start 2024-09-18T01:28:26.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.495+0000 7ff2d4a5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d009a100 0x7ff2d01c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:26.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.495+0000 7ff2d4a5c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d0134670 con 0x7ff2d009a100 2024-09-18T01:28:26.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.495+0000 7ff2ce59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d009a100 0x7ff2d01c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:26.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.495+0000 7ff2ce59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d009a100 0x7ff2d01c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57014/0 (socket says 172.21.15.92:57014) 2024-09-18T01:28:26.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.495+0000 7ff2ce59c640 1 -- 172.21.15.92:0/2720043684 learned_addr learned my addr 172.21.15.92:0/2720043684 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:26.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.495+0000 7ff2ce59c640 1 -- 172.21.15.92:0/2720043684 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d0095e90 con 0x7ff2d009a100 2024-09-18T01:28:26.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.495+0000 7ff2ce59c640 1 --2- 172.21.15.92:0/2720043684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d009a100 0x7ff2d01c3990 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000c700 tx=0x7ff2c000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:26.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.495+0000 7ff2c77fe640 1 -- 172.21.15.92:0/2720043684 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2c0018070 con 0x7ff2d009a100 2024-09-18T01:28:26.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.495+0000 7ff2c77fe640 1 -- 172.21.15.92:0/2720043684 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c00070d0 con 0x7ff2d009a100 2024-09-18T01:28:26.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.495+0000 7ff2c77fe640 1 -- 172.21.15.92:0/2720043684 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2c00073f0 con 0x7ff2d009a100 2024-09-18T01:28:26.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.495+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/2720043684 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d0096d60 con 0x7ff2d009a100 2024-09-18T01:28:26.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.496+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/2720043684 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d01c40b0 con 0x7ff2d009a100 2024-09-18T01:28:26.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.496+0000 7ff2c77fe640 1 -- 172.21.15.92:0/2720043684 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff2c001b070 con 0x7ff2d009a100 2024-09-18T01:28:26.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.496+0000 7ff2c77fe640 1 --2- 172.21.15.92:0/2720043684 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff2b00382a0 0x7ff2b003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:26.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.496+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/2720043684 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d009d020 con 0x7ff2d009a100 2024-09-18T01:28:26.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.497+0000 7ff2c77fe640 1 -- 172.21.15.92:0/2720043684 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff2c004b0d0 con 0x7ff2d009a100 2024-09-18T01:28:26.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.497+0000 7ff2c5d9b640 1 --2- 172.21.15.92:0/2720043684 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff2b00382a0 0x7ff2b003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:26.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.497+0000 7ff2c5d9b640 1 --2- 172.21.15.92:0/2720043684 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff2b00382a0 0x7ff2b003a760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8034000 tx=0x7ff2b802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:26.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.501+0000 7ff2c77fe640 1 -- 172.21.15.92:0/2720043684 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2d009d3b0 con 0x7ff2d009a100 2024-09-18T01:28:26.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.666+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/2720043684 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ff2d0096a50 con 0x7ff2b00382a0 2024-09-18T01:28:26.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.668+0000 7ff2c77fe640 1 -- 172.21.15.92:0/2720043684 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff2d0096a50 con 0x7ff2b00382a0 2024-09-18T01:28:26.669 INFO:teuthology.orchestra.run.smithi092.stderr:instructed osd(s) 0 to deep-scrub 2024-09-18T01:28:26.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.670+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/2720043684 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff2b00382a0 msgr2=0x7ff2b003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.670+0000 7ff2d4a5c640 1 --2- 172.21.15.92:0/2720043684 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff2b00382a0 0x7ff2b003a760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8034000 tx=0x7ff2b802e000 comp rx=0 tx=0).stop 2024-09-18T01:28:26.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.670+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/2720043684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d009a100 msgr2=0x7ff2d01c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.670+0000 7ff2d4a5c640 1 --2- 172.21.15.92:0/2720043684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d009a100 0x7ff2d01c3990 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000c700 tx=0x7ff2c000cbc0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.670+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/2720043684 shutdown_connections 2024-09-18T01:28:26.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.670+0000 7ff2d4a5c640 1 --2- 172.21.15.92:0/2720043684 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7ff2b00382a0 0x7ff2b003a760 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.670+0000 7ff2d4a5c640 1 --2- 172.21.15.92:0/2720043684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d009a100 0x7ff2d01c3990 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.670+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/2720043684 >> 172.21.15.92:0/2720043684 conn(0x7ff2d006d4a0 msgr2=0x7ff2d009f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:26.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.670+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/2720043684 shutdown_connections 2024-09-18T01:28:26.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.670+0000 7ff2d4a5c640 1 -- 172.21.15.92:0/2720043684 wait complete. 2024-09-18T01:28:26.682 INFO:tasks.ceph:Scrubbing osd.1 2024-09-18T01:28:26.682 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-18T01:28:26.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.783+0000 7f488bd52640 1 Processor -- start 2024-09-18T01:28:26.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.783+0000 7f488bd52640 1 -- start start 2024-09-18T01:28:26.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.784+0000 7f488bd52640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f488406d2a0 0x7f488406d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:26.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.784+0000 7f488bd52640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f488406e420 con 0x7f488406f690 2024-09-18T01:28:26.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.784+0000 7f488bd52640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f4884070240 con 0x7f488406d2a0 2024-09-18T01:28:26.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.784+0000 7f4889aee640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f488406d2a0 0x7f488406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:26.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.784+0000 7f48892ed640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f488406f690 0x7f488412ad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56686/0 (socket says 172.21.15.92:56686) 2024-09-18T01:28:26.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.784+0000 7f48892ed640 1 -- 172.21.15.92:0/2566886294 learned_addr learned my addr 172.21.15.92:0/2566886294 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:28:26.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.784+0000 7f4889aee640 1 -- 172.21.15.92:0/2566886294 >> v1:172.21.15.92:6789/0 conn(0x7f488406f690 legacy=0x7f488412ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.784+0000 7f4889aee640 1 -- 172.21.15.92:0/2566886294 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488406eb40 con 0x7f488406d2a0 2024-09-18T01:28:26.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.784+0000 7f4888aec640 1 -- 172.21.15.92:0/2566886294 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 983196323 0 0) 0x7f488406e420 con 0x7f488406f690 2024-09-18T01:28:26.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.785+0000 7f4889aee640 1 --2- 172.21.15.92:0/2566886294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f488406d2a0 0x7f488406d680 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f488000a8c0 tx=0x7f488002b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c76e2487042f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:26.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.785+0000 7f4888aec640 1 -- 172.21.15.92:0/2566886294 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f488000b040 con 0x7f488406d2a0 2024-09-18T01:28:26.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.785+0000 7f4888aec640 1 -- 172.21.15.92:0/2566886294 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4880030640 con 0x7f488406d2a0 2024-09-18T01:28:26.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.785+0000 7f4888aec640 1 -- 172.21.15.92:0/2566886294 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4880030940 con 0x7f488406d2a0 2024-09-18T01:28:26.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.785+0000 7f488bd52640 1 -- 172.21.15.92:0/2566886294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f488406d2a0 msgr2=0x7f488406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.785+0000 7f488bd52640 1 --2- 172.21.15.92:0/2566886294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f488406d2a0 0x7f488406d680 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f488000a8c0 tx=0x7f488002b4d0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.785+0000 7f488bd52640 1 -- 172.21.15.92:0/2566886294 shutdown_connections 2024-09-18T01:28:26.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.785+0000 7f488bd52640 1 --2- 172.21.15.92:0/2566886294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f488406d2a0 0x7f488406d680 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.785+0000 7f488bd52640 1 -- 172.21.15.92:0/2566886294 >> 172.21.15.92:0/2566886294 conn(0x7f48840998b0 msgr2=0x7f4884099cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:26.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.785+0000 7f488bd52640 1 -- 172.21.15.92:0/2566886294 shutdown_connections 2024-09-18T01:28:26.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.785+0000 7f488bd52640 1 -- 172.21.15.92:0/2566886294 wait complete. 2024-09-18T01:28:26.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.786+0000 7f488bd52640 1 Processor -- start 2024-09-18T01:28:26.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.786+0000 7f488bd52640 1 -- start start 2024-09-18T01:28:26.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.787+0000 7f488bd52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f488406d2a0 0x7f4884125f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:26.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.787+0000 7f488bd52640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f488406df50 con 0x7f488406d2a0 2024-09-18T01:28:26.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.787+0000 7f4889aee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f488406d2a0 0x7f4884125f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:26.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.787+0000 7f4889aee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f488406d2a0 0x7f4884125f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57032/0 (socket says 172.21.15.92:57032) 2024-09-18T01:28:26.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.787+0000 7f4889aee640 1 -- 172.21.15.92:0/4041145367 learned_addr learned my addr 172.21.15.92:0/4041145367 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:26.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.787+0000 7f4889aee640 1 -- 172.21.15.92:0/4041145367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4884072ae0 con 0x7f488406d2a0 2024-09-18T01:28:26.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.787+0000 7f4889aee640 1 --2- 172.21.15.92:0/4041145367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f488406d2a0 0x7f4884125f20 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f488000a8c0 tx=0x7f4880004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:26.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.787+0000 7f487a7fc640 1 -- 172.21.15.92:0/4041145367 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f488003bb90 con 0x7f488406d2a0 2024-09-18T01:28:26.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.787+0000 7f487a7fc640 1 -- 172.21.15.92:0/4041145367 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f488003bd30 con 0x7f488406d2a0 2024-09-18T01:28:26.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.787+0000 7f488bd52640 1 -- 172.21.15.92:0/4041145367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488408b510 con 0x7f488406d2a0 2024-09-18T01:28:26.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.787+0000 7f487a7fc640 1 -- 172.21.15.92:0/4041145367 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48800445b0 con 0x7f488406d2a0 2024-09-18T01:28:26.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.787+0000 7f488bd52640 1 -- 172.21.15.92:0/4041145367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4884126460 con 0x7f488406d2a0 2024-09-18T01:28:26.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.788+0000 7f488bd52640 1 -- 172.21.15.92:0/4041145367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4884098bc0 con 0x7f488406d2a0 2024-09-18T01:28:26.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.788+0000 7f487a7fc640 1 -- 172.21.15.92:0/4041145367 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f488004d440 con 0x7f488406d2a0 2024-09-18T01:28:26.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.788+0000 7f487a7fc640 1 --2- 172.21.15.92:0/4041145367 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f48680382a0 0x7f486803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:26.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.788+0000 7f487a7fc640 1 -- 172.21.15.92:0/4041145367 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f488006ea00 con 0x7f488406d2a0 2024-09-18T01:28:26.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.788+0000 7f487a7fc640 1 --2- 172.21.15.92:0/4041145367 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x7f4868044690 0x7f4868046b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:26.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.788+0000 7f487a7fc640 1 -- 172.21.15.92:0/4041145367 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f488003de50 con 0x7f4868044690 2024-09-18T01:28:26.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.788+0000 7f487a7fc640 1 -- 172.21.15.92:0/4041145367 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f48800732a0 con 0x7f488406d2a0 2024-09-18T01:28:26.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.789+0000 7f48892ed640 1 --2- 172.21.15.92:0/4041145367 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f48680382a0 0x7f486803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:26.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.789+0000 7f488a2ef640 1 --2- 172.21.15.92:0/4041145367 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x7f4868044690 0x7f4868046b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:26.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.789+0000 7f488a2ef640 1 --2- 172.21.15.92:0/4041145367 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x7f4868044690 0x7f4868046b30 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:26.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.789+0000 7f48892ed640 1 --2- 172.21.15.92:0/4041145367 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f48680382a0 0x7f486803a760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4874000c00 tx=0x7f4874007970 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:26.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.790+0000 7f487a7fc640 1 -- 172.21.15.92:0/4041145367 <== osd.1 v2:172.21.15.100:6800/170575980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f488003de50 con 0x7f4868044690 2024-09-18T01:28:26.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.802+0000 7f488bd52640 1 -- 172.21.15.92:0/4041145367 --> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f488406f690 con 0x7f4868044690 2024-09-18T01:28:26.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.802+0000 7f487a7fc640 1 -- 172.21.15.92:0/4041145367 <== osd.1 v2:172.21.15.100:6800/170575980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f488406f690 con 0x7f4868044690 2024-09-18T01:28:26.804 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-18T01:28:26.804 INFO:teuthology.orchestra.run.smithi092.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T01:28:26.804 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-18T01:28:26.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.803+0000 7f488bd52640 1 -- 172.21.15.92:0/4041145367 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x7f4868044690 msgr2=0x7f4868046b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.803+0000 7f488bd52640 1 --2- 172.21.15.92:0/4041145367 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x7f4868044690 0x7f4868046b30 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.803+0000 7f488bd52640 1 -- 172.21.15.92:0/4041145367 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f48680382a0 msgr2=0x7f486803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.803+0000 7f488bd52640 1 --2- 172.21.15.92:0/4041145367 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f48680382a0 0x7f486803a760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4874000c00 tx=0x7f4874007970 comp rx=0 tx=0).stop 2024-09-18T01:28:26.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.803+0000 7f488bd52640 1 -- 172.21.15.92:0/4041145367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f488406d2a0 msgr2=0x7f4884125f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.803+0000 7f488bd52640 1 --2- 172.21.15.92:0/4041145367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f488406d2a0 0x7f4884125f20 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f488000a8c0 tx=0x7f4880004730 comp rx=0 tx=0).stop 2024-09-18T01:28:26.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.803+0000 7f488bd52640 1 -- 172.21.15.92:0/4041145367 shutdown_connections 2024-09-18T01:28:26.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.803+0000 7f488bd52640 1 --2- 172.21.15.92:0/4041145367 >> [v2:172.21.15.100:6800/170575980,v1:172.21.15.100:6801/170575980] conn(0x7f4868044690 0x7f4868046b30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.803+0000 7f488bd52640 1 --2- 172.21.15.92:0/4041145367 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f48680382a0 0x7f486803a760 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.803+0000 7f488bd52640 1 --2- 172.21.15.92:0/4041145367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f488406d2a0 0x7f4884125f20 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.803+0000 7f488bd52640 1 -- 172.21.15.92:0/4041145367 >> 172.21.15.92:0/4041145367 conn(0x7f48840998b0 msgr2=0x7f48840708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:26.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.803+0000 7f488bd52640 1 -- 172.21.15.92:0/4041145367 shutdown_connections 2024-09-18T01:28:26.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.803+0000 7f488bd52640 1 -- 172.21.15.92:0/4041145367 wait complete. 2024-09-18T01:28:26.814 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-18T01:28:26.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.911+0000 7f48aca5e640 1 Processor -- start 2024-09-18T01:28:26.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.911+0000 7f48aca5e640 1 -- start start 2024-09-18T01:28:26.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.911+0000 7f48aca5e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f48a806eda0 0x7f48a806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:26.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.911+0000 7f48aca5e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48a806eba0 con 0x7f48a806f6c0 2024-09-18T01:28:26.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.911+0000 7f48aca5e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f48a806d2f0 con 0x7f48a806eda0 2024-09-18T01:28:26.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.911+0000 7f48a659c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f48a806eda0 0x7f48a806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:26.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.911+0000 7f489dd9b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f48a806f6c0 0x7f48a8121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56692/0 (socket says 172.21.15.92:56692) 2024-09-18T01:28:26.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.911+0000 7f489dd9b640 1 -- 172.21.15.92:0/1782262253 learned_addr learned my addr 172.21.15.92:0/1782262253 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:28:26.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.912+0000 7f48a659c640 1 -- 172.21.15.92:0/1782262253 >> v1:172.21.15.92:6789/0 conn(0x7f48a806f6c0 legacy=0x7f48a8121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.912+0000 7f48a5d9b640 1 -- 172.21.15.92:0/1782262253 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468215695 0 0) 0x7f48a806eba0 con 0x7f48a806f6c0 2024-09-18T01:28:26.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.912+0000 7f48a659c640 1 -- 172.21.15.92:0/1782262253 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a8070d50 con 0x7f48a806eda0 2024-09-18T01:28:26.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.912+0000 7f48a659c640 1 --2- 172.21.15.92:0/1782262253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a806eda0 0x7f48a806f180 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4898009720 tx=0x7f489802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a5329e96aa0fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:26.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.912+0000 7f48a5d9b640 1 -- 172.21.15.92:0/1782262253 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4898037070 con 0x7f48a806eda0 2024-09-18T01:28:26.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.912+0000 7f48a5d9b640 1 -- 172.21.15.92:0/1782262253 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489802ae20 con 0x7f48a806eda0 2024-09-18T01:28:26.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.912+0000 7f48a5d9b640 1 -- 172.21.15.92:0/1782262253 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4898032590 con 0x7f48a806eda0 2024-09-18T01:28:26.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.913+0000 7f48aca5e640 1 -- 172.21.15.92:0/1782262253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a806eda0 msgr2=0x7f48a806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:26.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.913+0000 7f48aca5e640 1 --2- 172.21.15.92:0/1782262253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a806eda0 0x7f48a806f180 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4898009720 tx=0x7f489802a1a0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.913+0000 7f48aca5e640 1 -- 172.21.15.92:0/1782262253 shutdown_connections 2024-09-18T01:28:26.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.913+0000 7f48aca5e640 1 --2- 172.21.15.92:0/1782262253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a806eda0 0x7f48a806f180 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:26.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.913+0000 7f48aca5e640 1 -- 172.21.15.92:0/1782262253 >> 172.21.15.92:0/1782262253 conn(0x7f48a809a890 msgr2=0x7f48a809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:26.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.913+0000 7f48aca5e640 1 -- 172.21.15.92:0/1782262253 shutdown_connections 2024-09-18T01:28:26.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.913+0000 7f48aca5e640 1 -- 172.21.15.92:0/1782262253 wait complete. 2024-09-18T01:28:26.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.914+0000 7f48aca5e640 1 Processor -- start 2024-09-18T01:28:26.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.914+0000 7f48aca5e640 1 -- start start 2024-09-18T01:28:26.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.914+0000 7f48aca5e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a806eda0 0x7f48a806d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:26.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.914+0000 7f48aca5e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f48a8122160 con 0x7f48a806eda0 2024-09-18T01:28:26.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.915+0000 7f48a659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a806eda0 0x7f48a806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:26.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.915+0000 7f48a659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a806eda0 0x7f48a806d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57054/0 (socket says 172.21.15.92:57054) 2024-09-18T01:28:26.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.915+0000 7f48a659c640 1 -- 172.21.15.92:0/720773502 learned_addr learned my addr 172.21.15.92:0/720773502 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:26.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.915+0000 7f48a659c640 1 -- 172.21.15.92:0/720773502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a8128c30 con 0x7f48a806eda0 2024-09-18T01:28:26.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.915+0000 7f48a659c640 1 --2- 172.21.15.92:0/720773502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a806eda0 0x7f48a806d910 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f489802a1e0 tx=0x7f48980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:26.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.915+0000 7f489f7fe640 1 -- 172.21.15.92:0/720773502 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4898042070 con 0x7f48a806eda0 2024-09-18T01:28:26.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.915+0000 7f489f7fe640 1 -- 172.21.15.92:0/720773502 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489803e590 con 0x7f48a806eda0 2024-09-18T01:28:26.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.915+0000 7f48aca5e640 1 -- 172.21.15.92:0/720773502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a8125d80 con 0x7f48a806eda0 2024-09-18T01:28:26.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.915+0000 7f489f7fe640 1 -- 172.21.15.92:0/720773502 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4898037040 con 0x7f48a806eda0 2024-09-18T01:28:26.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.915+0000 7f48aca5e640 1 -- 172.21.15.92:0/720773502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a808c440 con 0x7f48a806eda0 2024-09-18T01:28:26.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.916+0000 7f489f7fe640 1 -- 172.21.15.92:0/720773502 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4898045070 con 0x7f48a806eda0 2024-09-18T01:28:26.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.916+0000 7f489f7fe640 1 --2- 172.21.15.92:0/720773502 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4888038250 0x7f488803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:26.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.916+0000 7f48aca5e640 1 -- 172.21.15.92:0/720773502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48a808b1f0 con 0x7f48a806eda0 2024-09-18T01:28:26.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.916+0000 7f489f7fe640 1 -- 172.21.15.92:0/720773502 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f489806c810 con 0x7f48a806eda0 2024-09-18T01:28:26.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.916+0000 7f489dd9b640 1 --2- 172.21.15.92:0/720773502 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4888038250 0x7f488803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:26.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.917+0000 7f489dd9b640 1 --2- 172.21.15.92:0/720773502 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4888038250 0x7f488803a710 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4890000c00 tx=0x7f4890007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:26.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:26.921+0000 7f489f7fe640 1 -- 172.21.15.92:0/720773502 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f489804f750 con 0x7f48a806eda0 2024-09-18T01:28:27.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.085+0000 7f48aca5e640 1 -- 172.21.15.92:0/720773502 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f48a8122670 con 0x7f4888038250 2024-09-18T01:28:27.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.086+0000 7f489f7fe640 1 -- 172.21.15.92:0/720773502 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f48a8122670 con 0x7f4888038250 2024-09-18T01:28:27.087 INFO:teuthology.orchestra.run.smithi092.stderr:instructed osd(s) 1 to deep-scrub 2024-09-18T01:28:27.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.088+0000 7f48aca5e640 1 -- 172.21.15.92:0/720773502 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4888038250 msgr2=0x7f488803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.088+0000 7f48aca5e640 1 --2- 172.21.15.92:0/720773502 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4888038250 0x7f488803a710 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4890000c00 tx=0x7f4890007910 comp rx=0 tx=0).stop 2024-09-18T01:28:27.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.088+0000 7f48aca5e640 1 -- 172.21.15.92:0/720773502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a806eda0 msgr2=0x7f48a806d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.088+0000 7f48aca5e640 1 --2- 172.21.15.92:0/720773502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a806eda0 0x7f48a806d910 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f489802a1e0 tx=0x7f48980046c0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.088+0000 7f48aca5e640 1 -- 172.21.15.92:0/720773502 shutdown_connections 2024-09-18T01:28:27.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.088+0000 7f48aca5e640 1 --2- 172.21.15.92:0/720773502 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4888038250 0x7f488803a710 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.088+0000 7f48aca5e640 1 --2- 172.21.15.92:0/720773502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a806eda0 0x7f48a806d910 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.088+0000 7f48aca5e640 1 -- 172.21.15.92:0/720773502 >> 172.21.15.92:0/720773502 conn(0x7f48a809a890 msgr2=0x7f48a8098210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:27.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.088+0000 7f48aca5e640 1 -- 172.21.15.92:0/720773502 shutdown_connections 2024-09-18T01:28:27.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.088+0000 7f48aca5e640 1 -- 172.21.15.92:0/720773502 wait complete. 2024-09-18T01:28:27.100 INFO:tasks.ceph:Scrubbing osd.2 2024-09-18T01:28:27.100 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-18T01:28:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.200+0000 7efd4f176640 1 Processor -- start 2024-09-18T01:28:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.200+0000 7efd4f176640 1 -- start start 2024-09-18T01:28:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.201+0000 7efd4f176640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7efd4806f690 0x7efd48130080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.201+0000 7efd4f176640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd4806e420 con 0x7efd4806d2a0 2024-09-18T01:28:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.201+0000 7efd4f176640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7efd48070240 con 0x7efd4806f690 2024-09-18T01:28:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.201+0000 7efd47fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7efd4806f690 0x7efd48130080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.201+0000 7efd4cf12640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7efd4806d2a0 0x7efd4806d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56708/0 (socket says 172.21.15.92:56708) 2024-09-18T01:28:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.201+0000 7efd4cf12640 1 -- 172.21.15.92:0/458576663 learned_addr learned my addr 172.21.15.92:0/458576663 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:28:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.201+0000 7efd47fff640 1 -- 172.21.15.92:0/458576663 >> v1:172.21.15.92:6789/0 conn(0x7efd4806d2a0 legacy=0x7efd4806d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.201+0000 7efd47fff640 1 -- 172.21.15.92:0/458576663 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4806eb40 con 0x7efd4806f690 2024-09-18T01:28:27.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.202+0000 7efd47fff640 1 --2- 172.21.15.92:0/458576663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4806f690 0x7efd48130080 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009720 tx=0x7efd3c02b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c80cdaf46a2e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:27.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.202+0000 7efd477fe640 1 -- 172.21.15.92:0/458576663 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd3c038070 con 0x7efd4806f690 2024-09-18T01:28:27.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.202+0000 7efd477fe640 1 -- 172.21.15.92:0/458576663 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd3c033440 con 0x7efd4806f690 2024-09-18T01:28:27.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.202+0000 7efd477fe640 1 -- 172.21.15.92:0/458576663 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd3c033740 con 0x7efd4806f690 2024-09-18T01:28:27.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.202+0000 7efd4f176640 1 -- 172.21.15.92:0/458576663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4806f690 msgr2=0x7efd48130080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.202+0000 7efd4f176640 1 --2- 172.21.15.92:0/458576663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4806f690 0x7efd48130080 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009720 tx=0x7efd3c02b220 comp rx=0 tx=0).stop 2024-09-18T01:28:27.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.202+0000 7efd4f176640 1 -- 172.21.15.92:0/458576663 shutdown_connections 2024-09-18T01:28:27.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.202+0000 7efd4f176640 1 --2- 172.21.15.92:0/458576663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4806f690 0x7efd48130080 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.202+0000 7efd4f176640 1 -- 172.21.15.92:0/458576663 >> 172.21.15.92:0/458576663 conn(0x7efd480998b0 msgr2=0x7efd48099cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:27.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.202+0000 7efd4f176640 1 -- 172.21.15.92:0/458576663 shutdown_connections 2024-09-18T01:28:27.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.202+0000 7efd4f176640 1 -- 172.21.15.92:0/458576663 wait complete. 2024-09-18T01:28:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.203+0000 7efd4f176640 1 Processor -- start 2024-09-18T01:28:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.203+0000 7efd4f176640 1 -- start start 2024-09-18T01:28:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.204+0000 7efd4f176640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4806d2a0 0x7efd4808afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.204+0000 7efd4f176640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efd48098940 con 0x7efd4806d2a0 2024-09-18T01:28:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.204+0000 7efd4cf12640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4806d2a0 0x7efd4808afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.204+0000 7efd4cf12640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4806d2a0 0x7efd4808afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57070/0 (socket says 172.21.15.92:57070) 2024-09-18T01:28:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.204+0000 7efd4cf12640 1 -- 172.21.15.92:0/803951286 learned_addr learned my addr 172.21.15.92:0/803951286 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.204+0000 7efd4cf12640 1 -- 172.21.15.92:0/803951286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4808c060 con 0x7efd4806d2a0 2024-09-18T01:28:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.204+0000 7efd4cf12640 1 --2- 172.21.15.92:0/803951286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4806d2a0 0x7efd4808afc0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efd3800c4a0 tx=0x7efd3800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.204+0000 7efd457fa640 1 -- 172.21.15.92:0/803951286 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd38017070 con 0x7efd4806d2a0 2024-09-18T01:28:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.204+0000 7efd457fa640 1 -- 172.21.15.92:0/803951286 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd38005c10 con 0x7efd4806d2a0 2024-09-18T01:28:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.204+0000 7efd4f176640 1 -- 172.21.15.92:0/803951286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4808dd20 con 0x7efd4806d2a0 2024-09-18T01:28:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.204+0000 7efd457fa640 1 -- 172.21.15.92:0/803951286 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd38007070 con 0x7efd4806d2a0 2024-09-18T01:28:27.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.204+0000 7efd4f176640 1 -- 172.21.15.92:0/803951286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd481282f0 con 0x7efd4806d2a0 2024-09-18T01:28:27.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.205+0000 7efd4f176640 1 -- 172.21.15.92:0/803951286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd4808c520 con 0x7efd4806d2a0 2024-09-18T01:28:27.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.205+0000 7efd457fa640 1 -- 172.21.15.92:0/803951286 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efd3801a070 con 0x7efd4806d2a0 2024-09-18T01:28:27.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.205+0000 7efd457fa640 1 --2- 172.21.15.92:0/803951286 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7efd340382a0 0x7efd3403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:27.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.205+0000 7efd457fa640 1 -- 172.21.15.92:0/803951286 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7efd3804b000 con 0x7efd4806d2a0 2024-09-18T01:28:27.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.206+0000 7efd457fa640 1 --2- 172.21.15.92:0/803951286 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x7efd340446f0 0x7efd34046b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:27.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.206+0000 7efd457fa640 1 -- 172.21.15.92:0/803951286 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd38013e50 con 0x7efd340446f0 2024-09-18T01:28:27.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.206+0000 7efd457fa640 1 -- 172.21.15.92:0/803951286 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7efd38052050 con 0x7efd4806d2a0 2024-09-18T01:28:27.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.206+0000 7efd47fff640 1 --2- 172.21.15.92:0/803951286 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7efd340382a0 0x7efd3403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:27.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.206+0000 7efd4d713640 1 --2- 172.21.15.92:0/803951286 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x7efd340446f0 0x7efd34046b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:27.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.206+0000 7efd4d713640 1 --2- 172.21.15.92:0/803951286 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x7efd340446f0 0x7efd34046b90 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:27.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.206+0000 7efd47fff640 1 --2- 172.21.15.92:0/803951286 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7efd340382a0 0x7efd3403a760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efd3c035000 tx=0x7efd3c02f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:27.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.207+0000 7efd457fa640 1 -- 172.21.15.92:0/803951286 <== osd.2 v2:172.21.15.100:6808/3104327688 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd38013e50 con 0x7efd340446f0 2024-09-18T01:28:27.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.219+0000 7efd4f176640 1 -- 172.21.15.92:0/803951286 --> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efd48072ae0 con 0x7efd340446f0 2024-09-18T01:28:27.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.220+0000 7efd457fa640 1 -- 172.21.15.92:0/803951286 <== osd.2 v2:172.21.15.100:6808/3104327688 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efd4000ad10 con 0x7efd340446f0 2024-09-18T01:28:27.221 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-18T01:28:27.221 INFO:teuthology.orchestra.run.smithi092.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T01:28:27.221 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-18T01:28:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.220+0000 7efd4f176640 1 -- 172.21.15.92:0/803951286 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x7efd340446f0 msgr2=0x7efd34046b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.220+0000 7efd4f176640 1 --2- 172.21.15.92:0/803951286 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x7efd340446f0 0x7efd34046b90 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.220+0000 7efd4f176640 1 -- 172.21.15.92:0/803951286 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7efd340382a0 msgr2=0x7efd3403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.220+0000 7efd4f176640 1 --2- 172.21.15.92:0/803951286 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7efd340382a0 0x7efd3403a760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efd3c035000 tx=0x7efd3c02f000 comp rx=0 tx=0).stop 2024-09-18T01:28:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.220+0000 7efd4f176640 1 -- 172.21.15.92:0/803951286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4806d2a0 msgr2=0x7efd4808afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.220+0000 7efd4f176640 1 --2- 172.21.15.92:0/803951286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4806d2a0 0x7efd4808afc0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efd3800c4a0 tx=0x7efd3800c960 comp rx=0 tx=0).stop 2024-09-18T01:28:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.220+0000 7efd4f176640 1 -- 172.21.15.92:0/803951286 shutdown_connections 2024-09-18T01:28:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.220+0000 7efd4f176640 1 --2- 172.21.15.92:0/803951286 >> [v2:172.21.15.100:6808/3104327688,v1:172.21.15.100:6809/3104327688] conn(0x7efd340446f0 0x7efd34046b90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.220+0000 7efd4f176640 1 --2- 172.21.15.92:0/803951286 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7efd340382a0 0x7efd3403a760 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.220+0000 7efd4f176640 1 --2- 172.21.15.92:0/803951286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4806d2a0 0x7efd4808afc0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.220+0000 7efd4f176640 1 -- 172.21.15.92:0/803951286 >> 172.21.15.92:0/803951286 conn(0x7efd480998b0 msgr2=0x7efd48128cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.220+0000 7efd4f176640 1 -- 172.21.15.92:0/803951286 shutdown_connections 2024-09-18T01:28:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.220+0000 7efd4f176640 1 -- 172.21.15.92:0/803951286 wait complete. 2024-09-18T01:28:27.232 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-18T01:28:27.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.329+0000 7fd057a37640 1 Processor -- start 2024-09-18T01:28:27.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.329+0000 7fd057a37640 1 -- start start 2024-09-18T01:28:27.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.330+0000 7fd057a37640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd05006eda0 0x7fd05006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:27.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.330+0000 7fd057a37640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05006eba0 con 0x7fd05006f6c0 2024-09-18T01:28:27.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.330+0000 7fd057a37640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fd05006d2f0 con 0x7fd05006eda0 2024-09-18T01:28:27.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.330+0000 7fd0557d3640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd05006eda0 0x7fd05006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:27.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.330+0000 7fd054fd2640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fd05006f6c0 0x7fd050121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56718/0 (socket says 172.21.15.92:56718) 2024-09-18T01:28:27.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.330+0000 7fd054fd2640 1 -- 172.21.15.92:0/541867188 learned_addr learned my addr 172.21.15.92:0/541867188 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:28:27.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.330+0000 7fd0557d3640 1 -- 172.21.15.92:0/541867188 >> v1:172.21.15.92:6789/0 conn(0x7fd05006f6c0 legacy=0x7fd050121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.330+0000 7fd047fff640 1 -- 172.21.15.92:0/541867188 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3205095239 0 0) 0x7fd05006eba0 con 0x7fd05006f6c0 2024-09-18T01:28:27.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.330+0000 7fd0557d3640 1 -- 172.21.15.92:0/541867188 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd050070d50 con 0x7fd05006eda0 2024-09-18T01:28:27.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.331+0000 7fd0557d3640 1 --2- 172.21.15.92:0/541867188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd05006eda0 0x7fd05006f180 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009720 tx=0x7fd04c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d9bb7a3de0ea6f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:27.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.331+0000 7fd047fff640 1 -- 172.21.15.92:0/541867188 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd04c037070 con 0x7fd05006eda0 2024-09-18T01:28:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.331+0000 7fd047fff640 1 -- 172.21.15.92:0/541867188 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c02ae20 con 0x7fd05006eda0 2024-09-18T01:28:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.331+0000 7fd047fff640 1 -- 172.21.15.92:0/541867188 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd04c032590 con 0x7fd05006eda0 2024-09-18T01:28:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.331+0000 7fd057a37640 1 -- 172.21.15.92:0/541867188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd05006eda0 msgr2=0x7fd05006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.331+0000 7fd057a37640 1 --2- 172.21.15.92:0/541867188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd05006eda0 0x7fd05006f180 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009720 tx=0x7fd04c02a1a0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.331+0000 7fd057a37640 1 -- 172.21.15.92:0/541867188 shutdown_connections 2024-09-18T01:28:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.331+0000 7fd057a37640 1 --2- 172.21.15.92:0/541867188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd05006eda0 0x7fd05006f180 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.331+0000 7fd057a37640 1 -- 172.21.15.92:0/541867188 >> 172.21.15.92:0/541867188 conn(0x7fd05009a890 msgr2=0x7fd05009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.332+0000 7fd057a37640 1 -- 172.21.15.92:0/541867188 shutdown_connections 2024-09-18T01:28:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.332+0000 7fd057a37640 1 -- 172.21.15.92:0/541867188 wait complete. 2024-09-18T01:28:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.332+0000 7fd057a37640 1 Processor -- start 2024-09-18T01:28:27.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.332+0000 7fd057a37640 1 -- start start 2024-09-18T01:28:27.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.333+0000 7fd057a37640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd05006eda0 0x7fd05006d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:27.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.333+0000 7fd057a37640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd050122160 con 0x7fd05006eda0 2024-09-18T01:28:27.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.333+0000 7fd0557d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd05006eda0 0x7fd05006d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.333+0000 7fd0557d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd05006eda0 0x7fd05006d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57092/0 (socket says 172.21.15.92:57092) 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.333+0000 7fd0557d3640 1 -- 172.21.15.92:0/757605303 learned_addr learned my addr 172.21.15.92:0/757605303 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.333+0000 7fd0557d3640 1 -- 172.21.15.92:0/757605303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05008b1d0 con 0x7fd05006eda0 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.333+0000 7fd0557d3640 1 --2- 172.21.15.92:0/757605303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd05006eda0 0x7fd05006d910 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd04c035040 tx=0x7fd04c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.333+0000 7fd045ffb640 1 -- 172.21.15.92:0/757605303 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd04c037040 con 0x7fd05006eda0 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.333+0000 7fd045ffb640 1 -- 172.21.15.92:0/757605303 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c032e30 con 0x7fd05006eda0 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.333+0000 7fd057a37640 1 -- 172.21.15.92:0/757605303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd050128b40 con 0x7fd05006eda0 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.333+0000 7fd045ffb640 1 -- 172.21.15.92:0/757605303 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd04c004160 con 0x7fd05006eda0 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.334+0000 7fd057a37640 1 -- 172.21.15.92:0/757605303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05008c500 con 0x7fd05006eda0 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.334+0000 7fd045ffb640 1 -- 172.21.15.92:0/757605303 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd04c03a040 con 0x7fd05006eda0 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.334+0000 7fd045ffb640 1 --2- 172.21.15.92:0/757605303 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd034038250 0x7fd03403a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.334+0000 7fd045ffb640 1 -- 172.21.15.92:0/757605303 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd04c06c6d0 con 0x7fd05006eda0 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.335+0000 7fd057a37640 1 -- 172.21.15.92:0/757605303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd050122670 con 0x7fd05006eda0 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.335+0000 7fd054fd2640 1 --2- 172.21.15.92:0/757605303 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd034038250 0x7fd03403a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:27.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.335+0000 7fd054fd2640 1 --2- 172.21.15.92:0/757605303 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd034038250 0x7fd03403a710 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd040000c00 tx=0x7fd040007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:27.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.339+0000 7fd045ffb640 1 -- 172.21.15.92:0/757605303 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd04c042020 con 0x7fd05006eda0 2024-09-18T01:28:27.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.503+0000 7fd057a37640 1 -- 172.21.15.92:0/757605303 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fd050125d80 con 0x7fd034038250 2024-09-18T01:28:27.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.504+0000 7fd045ffb640 1 -- 172.21.15.92:0/757605303 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd0400070d0 con 0x7fd034038250 2024-09-18T01:28:27.506 INFO:teuthology.orchestra.run.smithi092.stderr:instructed osd(s) 2 to deep-scrub 2024-09-18T01:28:27.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.506+0000 7fd057a37640 1 -- 172.21.15.92:0/757605303 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd034038250 msgr2=0x7fd03403a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.506+0000 7fd057a37640 1 --2- 172.21.15.92:0/757605303 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd034038250 0x7fd03403a710 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd040000c00 tx=0x7fd040007910 comp rx=0 tx=0).stop 2024-09-18T01:28:27.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.506+0000 7fd057a37640 1 -- 172.21.15.92:0/757605303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd05006eda0 msgr2=0x7fd05006d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.506+0000 7fd057a37640 1 --2- 172.21.15.92:0/757605303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd05006eda0 0x7fd05006d910 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd04c035040 tx=0x7fd04c0046c0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.506+0000 7fd057a37640 1 -- 172.21.15.92:0/757605303 shutdown_connections 2024-09-18T01:28:27.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.506+0000 7fd057a37640 1 --2- 172.21.15.92:0/757605303 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd034038250 0x7fd03403a710 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.506+0000 7fd057a37640 1 --2- 172.21.15.92:0/757605303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd05006eda0 0x7fd05006d910 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.506+0000 7fd057a37640 1 -- 172.21.15.92:0/757605303 >> 172.21.15.92:0/757605303 conn(0x7fd05009a890 msgr2=0x7fd050098260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:27.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.506+0000 7fd057a37640 1 -- 172.21.15.92:0/757605303 shutdown_connections 2024-09-18T01:28:27.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.506+0000 7fd057a37640 1 -- 172.21.15.92:0/757605303 wait complete. 2024-09-18T01:28:27.518 INFO:tasks.ceph:Scrubbing osd.3 2024-09-18T01:28:27.518 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-18T01:28:27.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.618+0000 7fed4ea47640 1 Processor -- start 2024-09-18T01:28:27.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.618+0000 7fed4ea47640 1 -- start start 2024-09-18T01:28:27.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.619+0000 7fed4ea47640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fed4809a390 0x7fed48134090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:27.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.619+0000 7fed4ea47640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed48098a60 con 0x7fed480995d0 2024-09-18T01:28:27.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.619+0000 7fed4ea47640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fed480992c0 con 0x7fed4809a390 2024-09-18T01:28:27.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.619+0000 7fed3ffff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fed4809a390 0x7fed48134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:27.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.619+0000 7fed3ffff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fed4809a390 0x7fed48134090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57100/0 (socket says 172.21.15.92:57100) 2024-09-18T01:28:27.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.619+0000 7fed47fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fed480995d0 0x7fed48099c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56732/0 (socket says 172.21.15.92:56732) 2024-09-18T01:28:27.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.619+0000 7fed3ffff640 1 -- 172.21.15.92:0/2818295001 learned_addr learned my addr 172.21.15.92:0/2818295001 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:27.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.619+0000 7fed3ffff640 1 -- 172.21.15.92:0/2818295001 >> v1:172.21.15.92:6789/0 conn(0x7fed480995d0 legacy=0x7fed48099c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.619+0000 7fed3ffff640 1 -- 172.21.15.92:0/2818295001 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4809a7a0 con 0x7fed4809a390 2024-09-18T01:28:27.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.620+0000 7fed3ffff640 1 --2- 172.21.15.92:0/2818295001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4809a390 0x7fed48134090 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fed300097f0 tx=0x7fed3002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15acb7bea5f3f073 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:27.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.620+0000 7fed477fe640 1 -- 172.21.15.92:0/2818295001 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed30037070 con 0x7fed4809a390 2024-09-18T01:28:27.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.620+0000 7fed477fe640 1 -- 172.21.15.92:0/2818295001 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed30032440 con 0x7fed4809a390 2024-09-18T01:28:27.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.620+0000 7fed477fe640 1 -- 172.21.15.92:0/2818295001 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed3002ae60 con 0x7fed4809a390 2024-09-18T01:28:27.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.621+0000 7fed4ea47640 1 -- 172.21.15.92:0/2818295001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4809a390 msgr2=0x7fed48134090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.621+0000 7fed4ea47640 1 --2- 172.21.15.92:0/2818295001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4809a390 0x7fed48134090 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fed300097f0 tx=0x7fed3002a1e0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.621+0000 7fed4ea47640 1 -- 172.21.15.92:0/2818295001 shutdown_connections 2024-09-18T01:28:27.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.621+0000 7fed4ea47640 1 --2- 172.21.15.92:0/2818295001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4809a390 0x7fed48134090 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.621+0000 7fed4ea47640 1 -- 172.21.15.92:0/2818295001 >> 172.21.15.92:0/2818295001 conn(0x7fed4806d4b0 msgr2=0x7fed4806d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:27.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.621+0000 7fed4ea47640 1 -- 172.21.15.92:0/2818295001 shutdown_connections 2024-09-18T01:28:27.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.621+0000 7fed4ea47640 1 -- 172.21.15.92:0/2818295001 wait complete. 2024-09-18T01:28:27.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.622+0000 7fed4ea47640 1 Processor -- start 2024-09-18T01:28:27.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.622+0000 7fed4ea47640 1 -- start start 2024-09-18T01:28:27.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.622+0000 7fed4ea47640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed480995d0 0x7fed48132d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:27.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.622+0000 7fed4ea47640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fed48134960 con 0x7fed480995d0 2024-09-18T01:28:27.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.622+0000 7fed47fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed480995d0 0x7fed48132d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:27.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.622+0000 7fed47fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed480995d0 0x7fed48132d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57104/0 (socket says 172.21.15.92:57104) 2024-09-18T01:28:27.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.622+0000 7fed47fff640 1 -- 172.21.15.92:0/2108870256 learned_addr learned my addr 172.21.15.92:0/2108870256 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:27.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.622+0000 7fed47fff640 1 -- 172.21.15.92:0/2108870256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed48096e40 con 0x7fed480995d0 2024-09-18T01:28:27.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.622+0000 7fed47fff640 1 --2- 172.21.15.92:0/2108870256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed480995d0 0x7fed48132d30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fed3800c450 tx=0x7fed3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:27.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.623+0000 7fed457fa640 1 -- 172.21.15.92:0/2108870256 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed38007410 con 0x7fed480995d0 2024-09-18T01:28:27.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.623+0000 7fed457fa640 1 -- 172.21.15.92:0/2108870256 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed380075b0 con 0x7fed480995d0 2024-09-18T01:28:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.623+0000 7fed4ea47640 1 -- 172.21.15.92:0/2108870256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed48096c00 con 0x7fed480995d0 2024-09-18T01:28:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.623+0000 7fed457fa640 1 -- 172.21.15.92:0/2108870256 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed38004910 con 0x7fed480995d0 2024-09-18T01:28:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.623+0000 7fed4ea47640 1 -- 172.21.15.92:0/2108870256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed48133270 con 0x7fed480995d0 2024-09-18T01:28:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.623+0000 7fed4ea47640 1 -- 172.21.15.92:0/2108870256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed48096760 con 0x7fed480995d0 2024-09-18T01:28:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.623+0000 7fed457fa640 1 -- 172.21.15.92:0/2108870256 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fed3801a020 con 0x7fed480995d0 2024-09-18T01:28:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.624+0000 7fed457fa640 1 --2- 172.21.15.92:0/2108870256 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fed280382a0 0x7fed2803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.624+0000 7fed457fa640 1 -- 172.21.15.92:0/2108870256 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fed3804b560 con 0x7fed480995d0 2024-09-18T01:28:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.624+0000 7fed457fa640 1 --2- 172.21.15.92:0/2108870256 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x7fed280446f0 0x7fed28046b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.624+0000 7fed457fa640 1 -- 172.21.15.92:0/2108870256 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed3801ee50 con 0x7fed280446f0 2024-09-18T01:28:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.624+0000 7fed457fa640 1 -- 172.21.15.92:0/2108870256 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fed38052050 con 0x7fed480995d0 2024-09-18T01:28:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.624+0000 7fed3ffff640 1 --2- 172.21.15.92:0/2108870256 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fed280382a0 0x7fed2803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.624+0000 7fed4cfe4640 1 --2- 172.21.15.92:0/2108870256 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x7fed280446f0 0x7fed28046b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:27.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.625+0000 7fed4cfe4640 1 --2- 172.21.15.92:0/2108870256 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x7fed280446f0 0x7fed28046b90 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:27.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.625+0000 7fed3ffff640 1 --2- 172.21.15.92:0/2108870256 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fed280382a0 0x7fed2803a760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fed30034000 tx=0x7fed3002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:27.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.625+0000 7fed457fa640 1 -- 172.21.15.92:0/2108870256 <== osd.3 v2:172.21.15.100:6816/595195757 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed3801ee50 con 0x7fed280446f0 2024-09-18T01:28:27.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.637+0000 7fed4ea47640 1 -- 172.21.15.92:0/2108870256 --> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fed480976a0 con 0x7fed280446f0 2024-09-18T01:28:27.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.638+0000 7fed457fa640 1 -- 172.21.15.92:0/2108870256 <== osd.3 v2:172.21.15.100:6816/595195757 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fed480976a0 con 0x7fed280446f0 2024-09-18T01:28:27.640 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-18T01:28:27.640 INFO:teuthology.orchestra.run.smithi092.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T01:28:27.640 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-18T01:28:27.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.638+0000 7fed4ea47640 1 -- 172.21.15.92:0/2108870256 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x7fed280446f0 msgr2=0x7fed28046b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.638+0000 7fed4ea47640 1 --2- 172.21.15.92:0/2108870256 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x7fed280446f0 0x7fed28046b90 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.639+0000 7fed4ea47640 1 -- 172.21.15.92:0/2108870256 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fed280382a0 msgr2=0x7fed2803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.639+0000 7fed4ea47640 1 --2- 172.21.15.92:0/2108870256 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fed280382a0 0x7fed2803a760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fed30034000 tx=0x7fed3002e000 comp rx=0 tx=0).stop 2024-09-18T01:28:27.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.639+0000 7fed4ea47640 1 -- 172.21.15.92:0/2108870256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed480995d0 msgr2=0x7fed48132d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.639+0000 7fed4ea47640 1 --2- 172.21.15.92:0/2108870256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed480995d0 0x7fed48132d30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fed3800c450 tx=0x7fed3800c910 comp rx=0 tx=0).stop 2024-09-18T01:28:27.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.639+0000 7fed4ea47640 1 -- 172.21.15.92:0/2108870256 shutdown_connections 2024-09-18T01:28:27.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.639+0000 7fed4ea47640 1 --2- 172.21.15.92:0/2108870256 >> [v2:172.21.15.100:6816/595195757,v1:172.21.15.100:6817/595195757] conn(0x7fed280446f0 0x7fed28046b90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.639+0000 7fed4ea47640 1 --2- 172.21.15.92:0/2108870256 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fed280382a0 0x7fed2803a760 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.639+0000 7fed4ea47640 1 --2- 172.21.15.92:0/2108870256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed480995d0 0x7fed48132d30 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.639+0000 7fed4ea47640 1 -- 172.21.15.92:0/2108870256 >> 172.21.15.92:0/2108870256 conn(0x7fed4806d4b0 msgr2=0x7fed4808d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:27.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.639+0000 7fed4ea47640 1 -- 172.21.15.92:0/2108870256 shutdown_connections 2024-09-18T01:28:27.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.639+0000 7fed4ea47640 1 -- 172.21.15.92:0/2108870256 wait complete. 2024-09-18T01:28:27.650 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-18T01:28:27.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.747+0000 7f74fe8af640 1 Processor -- start 2024-09-18T01:28:27.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.747+0000 7f74fe8af640 1 -- start start 2024-09-18T01:28:27.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.748+0000 7f74fe8af640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f74f812f9d0 0x7f74f8131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:27.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.748+0000 7f74fe8af640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f8071f70 con 0x7f74f812cca0 2024-09-18T01:28:27.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.748+0000 7f74fe8af640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f74f806e350 con 0x7f74f812f9d0 2024-09-18T01:28:27.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.748+0000 7f74f77fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f74f812f9d0 0x7f74f8131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:27.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.748+0000 7f74f7fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f74f812cca0 0x7f74f812d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56738/0 (socket says 172.21.15.92:56738) 2024-09-18T01:28:27.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.748+0000 7f74f7fff640 1 -- 172.21.15.92:0/4086166742 learned_addr learned my addr 172.21.15.92:0/4086166742 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:28:27.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.748+0000 7f74f77fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f74f812f9d0 0x7f74f8131dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57120/0 (socket says 172.21.15.92:57120) 2024-09-18T01:28:27.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.748+0000 7f74f77fe640 1 -- 172.21.15.92:0/4086166742 >> v1:172.21.15.92:6789/0 conn(0x7f74f812cca0 legacy=0x7f74f812d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.748+0000 7f74f77fe640 1 -- 172.21.15.92:0/4086166742 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f80715c0 con 0x7f74f812f9d0 2024-09-18T01:28:27.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.748+0000 7f74f6ffd640 1 -- 172.21.15.92:0/4086166742 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837469085 0 0) 0x7f74f8071f70 con 0x7f74f812cca0 2024-09-18T01:28:27.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.749+0000 7f74f77fe640 1 --2- 172.21.15.92:0/4086166742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f812f9d0 0x7f74f8131dc0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009720 tx=0x7f74ec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155b090341edbd12 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:27.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.749+0000 7f74f6ffd640 1 -- 172.21.15.92:0/4086166742 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74ec037070 con 0x7f74f812f9d0 2024-09-18T01:28:27.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.749+0000 7f74f6ffd640 1 -- 172.21.15.92:0/4086166742 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74ec02ad90 con 0x7f74f812f9d0 2024-09-18T01:28:27.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.749+0000 7f74f6ffd640 1 -- 172.21.15.92:0/4086166742 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74ec032590 con 0x7f74f812f9d0 2024-09-18T01:28:27.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.749+0000 7f74fe8af640 1 -- 172.21.15.92:0/4086166742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f812f9d0 msgr2=0x7f74f8131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.749+0000 7f74fe8af640 1 --2- 172.21.15.92:0/4086166742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f812f9d0 0x7f74f8131dc0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009720 tx=0x7f74ec02a110 comp rx=0 tx=0).stop 2024-09-18T01:28:27.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.749+0000 7f74fe8af640 1 -- 172.21.15.92:0/4086166742 shutdown_connections 2024-09-18T01:28:27.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.749+0000 7f74fe8af640 1 --2- 172.21.15.92:0/4086166742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f812f9d0 0x7f74f8131dc0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.749+0000 7f74fe8af640 1 -- 172.21.15.92:0/4086166742 >> 172.21.15.92:0/4086166742 conn(0x7f74f809a890 msgr2=0x7f74f809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:27.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.749+0000 7f74fe8af640 1 -- 172.21.15.92:0/4086166742 shutdown_connections 2024-09-18T01:28:27.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.749+0000 7f74fe8af640 1 -- 172.21.15.92:0/4086166742 wait complete. 2024-09-18T01:28:27.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.750+0000 7f74fe8af640 1 Processor -- start 2024-09-18T01:28:27.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.750+0000 7f74fe8af640 1 -- start start 2024-09-18T01:28:27.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.751+0000 7f74fe8af640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f812cca0 0x7f74f8122110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:27.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.751+0000 7f74fe8af640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f74f812ca50 con 0x7f74f812cca0 2024-09-18T01:28:27.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.751+0000 7f74f7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f812cca0 0x7f74f8122110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:27.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.751+0000 7f74f7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f812cca0 0x7f74f8122110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57132/0 (socket says 172.21.15.92:57132) 2024-09-18T01:28:27.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.751+0000 7f74f7fff640 1 -- 172.21.15.92:0/686938511 learned_addr learned my addr 172.21.15.92:0/686938511 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:27.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.751+0000 7f74f7fff640 1 -- 172.21.15.92:0/686938511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f8129b50 con 0x7f74f812cca0 2024-09-18T01:28:27.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.751+0000 7f74f7fff640 1 --2- 172.21.15.92:0/686938511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f812cca0 0x7f74f8122110 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f74e800c370 tx=0x7f74e800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:27.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.751+0000 7f74f4ff9640 1 -- 172.21.15.92:0/686938511 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e8007410 con 0x7f74f812cca0 2024-09-18T01:28:27.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.751+0000 7f74f4ff9640 1 -- 172.21.15.92:0/686938511 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e80075d0 con 0x7f74f812cca0 2024-09-18T01:28:27.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.751+0000 7f74fe8af640 1 -- 172.21.15.92:0/686938511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f8126db0 con 0x7f74f812cca0 2024-09-18T01:28:27.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.751+0000 7f74f4ff9640 1 -- 172.21.15.92:0/686938511 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e8004950 con 0x7f74f812cca0 2024-09-18T01:28:27.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.751+0000 7f74fe8af640 1 -- 172.21.15.92:0/686938511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f8123ff0 con 0x7f74f812cca0 2024-09-18T01:28:27.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.752+0000 7f74f4ff9640 1 -- 172.21.15.92:0/686938511 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f74e8011070 con 0x7f74f812cca0 2024-09-18T01:28:27.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.752+0000 7f74fe8af640 1 -- 172.21.15.92:0/686938511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f812e200 con 0x7f74f812cca0 2024-09-18T01:28:27.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.752+0000 7f74f4ff9640 1 --2- 172.21.15.92:0/686938511 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74e40382a0 0x7f74e403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:27.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.752+0000 7f74f4ff9640 1 -- 172.21.15.92:0/686938511 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f74e804b8f0 con 0x7f74f812cca0 2024-09-18T01:28:27.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.753+0000 7f74f77fe640 1 --2- 172.21.15.92:0/686938511 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74e40382a0 0x7f74e403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:27.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.753+0000 7f74f77fe640 1 --2- 172.21.15.92:0/686938511 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74e40382a0 0x7f74e403a760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009720 tx=0x7f74ec02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:27.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.757+0000 7f74f4ff9640 1 -- 172.21.15.92:0/686938511 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74e801cbd0 con 0x7f74f812cca0 2024-09-18T01:28:27.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.923+0000 7f74fe8af640 1 -- 172.21.15.92:0/686938511 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f74f8124410 con 0x7f74e40382a0 2024-09-18T01:28:27.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.924+0000 7f74f4ff9640 1 -- 172.21.15.92:0/686938511 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f74f8124410 con 0x7f74e40382a0 2024-09-18T01:28:27.925 INFO:teuthology.orchestra.run.smithi092.stderr:instructed osd(s) 3 to deep-scrub 2024-09-18T01:28:27.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.926+0000 7f74fe8af640 1 -- 172.21.15.92:0/686938511 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74e40382a0 msgr2=0x7f74e403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.926+0000 7f74fe8af640 1 --2- 172.21.15.92:0/686938511 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74e40382a0 0x7f74e403a760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009720 tx=0x7f74ec02e000 comp rx=0 tx=0).stop 2024-09-18T01:28:27.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.926+0000 7f74fe8af640 1 -- 172.21.15.92:0/686938511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f812cca0 msgr2=0x7f74f8122110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:27.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.926+0000 7f74fe8af640 1 --2- 172.21.15.92:0/686938511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f812cca0 0x7f74f8122110 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f74e800c370 tx=0x7f74e800c830 comp rx=0 tx=0).stop 2024-09-18T01:28:27.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.926+0000 7f74fe8af640 1 -- 172.21.15.92:0/686938511 shutdown_connections 2024-09-18T01:28:27.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.926+0000 7f74fe8af640 1 --2- 172.21.15.92:0/686938511 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f74e40382a0 0x7f74e403a760 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.926+0000 7f74fe8af640 1 --2- 172.21.15.92:0/686938511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f812cca0 0x7f74f8122110 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:27.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.926+0000 7f74fe8af640 1 -- 172.21.15.92:0/686938511 >> 172.21.15.92:0/686938511 conn(0x7f74f809a890 msgr2=0x7f74f812a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:27.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.926+0000 7f74fe8af640 1 -- 172.21.15.92:0/686938511 shutdown_connections 2024-09-18T01:28:27.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:27.926+0000 7f74fe8af640 1 -- 172.21.15.92:0/686938511 wait complete. 2024-09-18T01:28:27.938 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:28:28.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.033+0000 7fc691386640 1 Processor -- start 2024-09-18T01:28:28.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.033+0000 7fc691386640 1 -- start start 2024-09-18T01:28:28.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.033+0000 7fc691386640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc68c096630 0x7fc68c096a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:28.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.033+0000 7fc691386640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc68c0702f0 con 0x7fc68c06d910 2024-09-18T01:28:28.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.033+0000 7fc691386640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fc68c06f1f0 con 0x7fc68c096630 2024-09-18T01:28:28.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.034+0000 7fc68affd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc68c096630 0x7fc68c096a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:28.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.034+0000 7fc68a7fc640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc68c06d910 0x7fc68c06dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56742/0 (socket says 172.21.15.92:56742) 2024-09-18T01:28:28.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.034+0000 7fc68a7fc640 1 -- 172.21.15.92:0/1542978658 learned_addr learned my addr 172.21.15.92:0/1542978658 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:28:28.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.034+0000 7fc68affd640 1 -- 172.21.15.92:0/1542978658 >> v1:172.21.15.92:6789/0 conn(0x7fc68c06d910 legacy=0x7fc68c06dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:28.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.034+0000 7fc68affd640 1 -- 172.21.15.92:0/1542978658 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68c06fb80 con 0x7fc68c096630 2024-09-18T01:28:28.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.035+0000 7fc68affd640 1 --2- 172.21.15.92:0/1542978658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c096630 0x7fc68c096a10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009720 tx=0x7fc67c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9bda04e59dbe19e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:28.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.035+0000 7fc689ffb640 1 -- 172.21.15.92:0/1542978658 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc67c037070 con 0x7fc68c096630 2024-09-18T01:28:28.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.035+0000 7fc689ffb640 1 -- 172.21.15.92:0/1542978658 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67c02ad90 con 0x7fc68c096630 2024-09-18T01:28:28.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.035+0000 7fc689ffb640 1 -- 172.21.15.92:0/1542978658 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc67c032590 con 0x7fc68c096630 2024-09-18T01:28:28.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.035+0000 7fc691386640 1 -- 172.21.15.92:0/1542978658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c096630 msgr2=0x7fc68c096a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:28.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.035+0000 7fc691386640 1 --2- 172.21.15.92:0/1542978658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c096630 0x7fc68c096a10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009720 tx=0x7fc67c02a110 comp rx=0 tx=0).stop 2024-09-18T01:28:28.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.035+0000 7fc691386640 1 -- 172.21.15.92:0/1542978658 shutdown_connections 2024-09-18T01:28:28.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.035+0000 7fc691386640 1 --2- 172.21.15.92:0/1542978658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c096630 0x7fc68c096a10 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:28.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.035+0000 7fc691386640 1 -- 172.21.15.92:0/1542978658 >> 172.21.15.92:0/1542978658 conn(0x7fc68c09a890 msgr2=0x7fc68c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:28.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.035+0000 7fc691386640 1 -- 172.21.15.92:0/1542978658 shutdown_connections 2024-09-18T01:28:28.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.035+0000 7fc691386640 1 -- 172.21.15.92:0/1542978658 wait complete. 2024-09-18T01:28:28.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.036+0000 7fc691386640 1 Processor -- start 2024-09-18T01:28:28.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.036+0000 7fc691386640 1 -- start start 2024-09-18T01:28:28.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.037+0000 7fc691386640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c06d910 0x7fc68c126c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:28.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.037+0000 7fc691386640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c06d410 con 0x7fc68c06d910 2024-09-18T01:28:28.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.037+0000 7fc68affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c06d910 0x7fc68c126c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:28.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.037+0000 7fc68affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c06d910 0x7fc68c126c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57148/0 (socket says 172.21.15.92:57148) 2024-09-18T01:28:28.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.037+0000 7fc68affd640 1 -- 172.21.15.92:0/467511674 learned_addr learned my addr 172.21.15.92:0/467511674 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:28.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.037+0000 7fc68affd640 1 -- 172.21.15.92:0/467511674 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68c12d4a0 con 0x7fc68c06d910 2024-09-18T01:28:28.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.037+0000 7fc68affd640 1 --2- 172.21.15.92:0/467511674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c06d910 0x7fc68c126c00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc67c02a150 tx=0x7fc67c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:28.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.037+0000 7fc6737fe640 1 -- 172.21.15.92:0/467511674 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc67c041070 con 0x7fc68c06d910 2024-09-18T01:28:28.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.037+0000 7fc6737fe640 1 -- 172.21.15.92:0/467511674 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67c032e30 con 0x7fc68c06d910 2024-09-18T01:28:28.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.037+0000 7fc691386640 1 -- 172.21.15.92:0/467511674 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc68c072ea0 con 0x7fc68c06d910 2024-09-18T01:28:28.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.037+0000 7fc6737fe640 1 -- 172.21.15.92:0/467511674 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc67c037040 con 0x7fc68c06d910 2024-09-18T01:28:28.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.037+0000 7fc691386640 1 -- 172.21.15.92:0/467511674 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc68c12cdd0 con 0x7fc68c06d910 2024-09-18T01:28:28.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.038+0000 7fc6737fe640 1 -- 172.21.15.92:0/467511674 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc67c044070 con 0x7fc68c06d910 2024-09-18T01:28:28.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.038+0000 7fc691386640 1 -- 172.21.15.92:0/467511674 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc68c12d250 con 0x7fc68c06d910 2024-09-18T01:28:28.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.038+0000 7fc6737fe640 1 --2- 172.21.15.92:0/467511674 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc6780382a0 0x7fc67803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:28.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.038+0000 7fc6737fe640 1 -- 172.21.15.92:0/467511674 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fc67c06c880 con 0x7fc68c06d910 2024-09-18T01:28:28.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.039+0000 7fc68a7fc640 1 --2- 172.21.15.92:0/467511674 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc6780382a0 0x7fc67803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:28.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.039+0000 7fc68a7fc640 1 --2- 172.21.15.92:0/467511674 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc6780382a0 0x7fc67803a760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc680000f60 tx=0x7fc680007a80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:28.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.043+0000 7fc6737fe640 1 -- 172.21.15.92:0/467511674 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc68c12d4a0 con 0x7fc68c06d910 2024-09-18T01:28:28.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.206+0000 7fc691386640 1 -- 172.21.15.92:0/467511674 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc68c06eda0 con 0x7fc6780382a0 2024-09-18T01:28:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.221+0000 7fc6737fe640 1 -- 172.21.15.92:0/467511674 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666015 (secure 0 0 0) 0x7fc68c06eda0 con 0x7fc6780382a0 2024-09-18T01:28:28.230 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:28:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-18T01:28:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.225+0000 7fc691386640 1 -- 172.21.15.92:0/467511674 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc6780382a0 msgr2=0x7fc67803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.225+0000 7fc691386640 1 --2- 172.21.15.92:0/467511674 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc6780382a0 0x7fc67803a760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc680000f60 tx=0x7fc680007a80 comp rx=0 tx=0).stop 2024-09-18T01:28:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.225+0000 7fc691386640 1 -- 172.21.15.92:0/467511674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c06d910 msgr2=0x7fc68c126c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.225+0000 7fc691386640 1 --2- 172.21.15.92:0/467511674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c06d910 0x7fc68c126c00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc67c02a150 tx=0x7fc67c0046c0 comp rx=0 tx=0).stop 2024-09-18T01:28:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.225+0000 7fc691386640 1 -- 172.21.15.92:0/467511674 shutdown_connections 2024-09-18T01:28:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.225+0000 7fc691386640 1 --2- 172.21.15.92:0/467511674 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fc6780382a0 0x7fc67803a760 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.225+0000 7fc691386640 1 --2- 172.21.15.92:0/467511674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c06d910 0x7fc68c126c00 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.225+0000 7fc691386640 1 -- 172.21.15.92:0/467511674 >> 172.21.15.92:0/467511674 conn(0x7fc68c09a890 msgr2=0x7fc68c070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.225+0000 7fc691386640 1 -- 172.21.15.92:0/467511674 shutdown_connections 2024-09-18T01:28:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:28.225+0000 7fc691386640 1 -- 172.21.15.92:0/467511674 wait complete. 2024-09-18T01:28:28.239 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-18T01:28:26.827555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13176026,"num_objects":257,"num_object_clones":0,"num_object_copies":520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":5334,"num_read_kb":4886,"num_write":2354,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":993,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4768,"ondisk_log_size":4768,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":161052,"kb_used_data":11348,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377326308,"statfs":{"total":386547056640,"available":386382139392,"internally_reserved":0,"allocated":11620352,"data_stored":10405036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12574905,"num_objects":5,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":664,"num_read_kb":626,"num_write":440,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003970"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846091+0000","last_change":"2024-09-18T01:25:06.692305+0000","last_active":"2024-09-18T01:25:43.846091+0000","last_peered":"2024-09-18T01:25:43.846091+0000","last_clean":"2024-09-18T01:25:43.846091+0000","last_became_active":"2024-09-18T01:25:06.691940+0000","last_became_peered":"2024-09-18T01:25:06.691940+0000","last_unstale":"2024-09-18T01:25:43.846091+0000","last_undegraded":"2024-09-18T01:25:43.846091+0000","last_fullsized":"2024-09-18T01:25:43.846091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:24.579150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'13","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153106+0000","last_change":"2024-09-18T01:25:08.683809+0000","last_active":"2024-09-18T01:28:17.153106+0000","last_peered":"2024-09-18T01:28:17.153106+0000","last_clean":"2024-09-18T01:28:17.153106+0000","last_became_active":"2024-09-18T01:25:08.683538+0000","last_became_peered":"2024-09-18T01:25:08.683538+0000","last_unstale":"2024-09-18T01:28:17.153106+0000","last_undegraded":"2024-09-18T01:28:17.153106+0000","last_fullsized":"2024-09-18T01:28:17.153106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:05.611732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.796081+0000","last_change":"2024-09-18T01:25:06.687454+0000","last_active":"2024-09-18T01:27:12.796081+0000","last_peered":"2024-09-18T01:27:12.796081+0000","last_clean":"2024-09-18T01:27:12.796081+0000","last_became_active":"2024-09-18T01:25:06.686950+0000","last_became_peered":"2024-09-18T01:25:06.686950+0000","last_unstale":"2024-09-18T01:27:12.796081+0000","last_undegraded":"2024-09-18T01:27:12.796081+0000","last_fullsized":"2024-09-18T01:27:12.796081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:03.894308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'20","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954431+0000","last_change":"2024-09-18T01:25:08.673859+0000","last_active":"2024-09-18T01:28:16.954431+0000","last_peered":"2024-09-18T01:28:16.954431+0000","last_clean":"2024-09-18T01:28:16.954431+0000","last_became_active":"2024-09-18T01:25:08.673552+0000","last_became_peered":"2024-09-18T01:25:08.673552+0000","last_unstale":"2024-09-18T01:28:16.954431+0000","last_undegraded":"2024-09-18T01:28:16.954431+0000","last_fullsized":"2024-09-18T01:28:16.954431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:50:57.219183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.852159+0000","last_change":"2024-09-18T01:25:06.687698+0000","last_active":"2024-09-18T01:25:43.852159+0000","last_peered":"2024-09-18T01:25:43.852159+0000","last_clean":"2024-09-18T01:25:43.852159+0000","last_became_active":"2024-09-18T01:25:06.687068+0000","last_became_peered":"2024-09-18T01:25:06.687068+0000","last_unstale":"2024-09-18T01:25:43.852159+0000","last_undegraded":"2024-09-18T01:25:43.852159+0000","last_fullsized":"2024-09-18T01:25:43.852159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:28.131866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'10","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097039+0000","last_change":"2024-09-18T01:25:08.685372+0000","last_active":"2024-09-18T01:28:17.097039+0000","last_peered":"2024-09-18T01:28:17.097039+0000","last_clean":"2024-09-18T01:28:17.097039+0000","last_became_active":"2024-09-18T01:25:08.685074+0000","last_became_peered":"2024-09-18T01:25:08.685074+0000","last_unstale":"2024-09-18T01:28:17.097039+0000","last_undegraded":"2024-09-18T01:28:17.097039+0000","last_fullsized":"2024-09-18T01:28:17.097039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:49.546714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844176+0000","last_change":"2024-09-18T01:25:06.690926+0000","last_active":"2024-09-18T01:25:43.844176+0000","last_peered":"2024-09-18T01:25:43.844176+0000","last_clean":"2024-09-18T01:25:43.844176+0000","last_became_active":"2024-09-18T01:25:06.690552+0000","last_became_peered":"2024-09-18T01:25:06.690552+0000","last_unstale":"2024-09-18T01:25:43.844176+0000","last_undegraded":"2024-09-18T01:25:43.844176+0000","last_fullsized":"2024-09-18T01:25:43.844176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:39:53.953032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'8","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.453023+0000","last_change":"2024-09-18T01:25:08.676582+0000","last_active":"2024-09-18T01:25:50.453023+0000","last_peered":"2024-09-18T01:25:50.453023+0000","last_clean":"2024-09-18T01:25:50.453023+0000","last_became_active":"2024-09-18T01:25:08.674210+0000","last_became_peered":"2024-09-18T01:25:08.674210+0000","last_unstale":"2024-09-18T01:25:50.453023+0000","last_undegraded":"2024-09-18T01:25:50.453023+0000","last_fullsized":"2024-09-18T01:25:50.453023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:19:54.471269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.435444+0000","last_change":"2024-09-18T01:25:06.689859+0000","last_active":"2024-09-18T01:27:16.435444+0000","last_peered":"2024-09-18T01:27:16.435444+0000","last_clean":"2024-09-18T01:27:16.435444+0000","last_became_active":"2024-09-18T01:25:06.687608+0000","last_became_peered":"2024-09-18T01:25:06.687608+0000","last_unstale":"2024-09-18T01:27:16.435444+0000","last_undegraded":"2024-09-18T01:27:16.435444+0000","last_fullsized":"2024-09-18T01:27:16.435444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:30:22.917213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.387179+0000","last_change":"2024-09-18T01:25:08.684086+0000","last_active":"2024-09-18T01:27:13.387179+0000","last_peered":"2024-09-18T01:27:13.387179+0000","last_clean":"2024-09-18T01:27:13.387179+0000","last_became_active":"2024-09-18T01:25:08.683812+0000","last_became_peered":"2024-09-18T01:25:08.683812+0000","last_unstale":"2024-09-18T01:27:13.387179+0000","last_undegraded":"2024-09-18T01:27:13.387179+0000","last_fullsized":"2024-09-18T01:27:13.387179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:37.287772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.092252+0000","last_change":"2024-09-18T01:25:06.702940+0000","last_active":"2024-09-18T01:28:17.092252+0000","last_peered":"2024-09-18T01:28:17.092252+0000","last_clean":"2024-09-18T01:28:17.092252+0000","last_became_active":"2024-09-18T01:25:06.702616+0000","last_became_peered":"2024-09-18T01:25:06.702616+0000","last_unstale":"2024-09-18T01:28:17.092252+0000","last_undegraded":"2024-09-18T01:28:17.092252+0000","last_fullsized":"2024-09-18T01:28:17.092252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:53.580899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'8","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.956371+0000","last_change":"2024-09-18T01:25:43.904757+0000","last_active":"2024-09-18T01:28:16.956371+0000","last_peered":"2024-09-18T01:28:16.956371+0000","last_clean":"2024-09-18T01:28:16.956371+0000","last_became_active":"2024-09-18T01:25:43.904427+0000","last_became_peered":"2024-09-18T01:25:43.904427+0000","last_unstale":"2024-09-18T01:28:16.956371+0000","last_undegraded":"2024-09-18T01:28:16.956371+0000","last_fullsized":"2024-09-18T01:28:16.956371+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:33:47.798452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848729+0000","last_change":"2024-09-18T01:25:06.683548+0000","last_active":"2024-09-18T01:25:43.848729+0000","last_peered":"2024-09-18T01:25:43.848729+0000","last_clean":"2024-09-18T01:25:43.848729+0000","last_became_active":"2024-09-18T01:25:06.683195+0000","last_became_peered":"2024-09-18T01:25:06.683195+0000","last_unstale":"2024-09-18T01:25:43.848729+0000","last_undegraded":"2024-09-18T01:25:43.848729+0000","last_fullsized":"2024-09-18T01:25:43.848729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:13.167515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.796067+0000","last_change":"2024-09-18T01:25:08.677859+0000","last_active":"2024-09-18T01:27:14.796067+0000","last_peered":"2024-09-18T01:27:14.796067+0000","last_clean":"2024-09-18T01:27:14.796067+0000","last_became_active":"2024-09-18T01:25:08.677579+0000","last_became_peered":"2024-09-18T01:25:08.677579+0000","last_unstale":"2024-09-18T01:27:14.796067+0000","last_undegraded":"2024-09-18T01:27:14.796067+0000","last_fullsized":"2024-09-18T01:27:14.796067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:39.586169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844028+0000","last_change":"2024-09-18T01:25:06.686453+0000","last_active":"2024-09-18T01:25:43.844028+0000","last_peered":"2024-09-18T01:25:43.844028+0000","last_clean":"2024-09-18T01:25:43.844028+0000","last_became_active":"2024-09-18T01:25:06.686049+0000","last_became_peered":"2024-09-18T01:25:06.686049+0000","last_unstale":"2024-09-18T01:25:43.844028+0000","last_undegraded":"2024-09-18T01:25:43.844028+0000","last_fullsized":"2024-09-18T01:25:43.844028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:53.580899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.477318+0000","last_change":"2024-09-18T01:25:08.676582+0000","last_active":"2024-09-18T01:27:16.477318+0000","last_peered":"2024-09-18T01:27:16.477318+0000","last_clean":"2024-09-18T01:27:16.477318+0000","last_became_active":"2024-09-18T01:25:08.676310+0000","last_became_peered":"2024-09-18T01:25:08.676310+0000","last_unstale":"2024-09-18T01:27:16.477318+0000","last_undegraded":"2024-09-18T01:27:16.477318+0000","last_fullsized":"2024-09-18T01:27:16.477318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:55:06.296443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'24","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.104105+0000","last_change":"2024-09-18T01:25:08.673269+0000","last_active":"2024-09-18T01:28:17.104105+0000","last_peered":"2024-09-18T01:28:17.104105+0000","last_clean":"2024-09-18T01:28:17.104105+0000","last_became_active":"2024-09-18T01:25:08.671858+0000","last_became_peered":"2024-09-18T01:25:08.671858+0000","last_unstale":"2024-09-18T01:28:17.104105+0000","last_undegraded":"2024-09-18T01:28:17.104105+0000","last_fullsized":"2024-09-18T01:28:17.104105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:50:36.347808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":55,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.907039+0000","last_change":"2024-09-18T01:25:06.691701+0000","last_active":"2024-09-18T01:25:43.907039+0000","last_peered":"2024-09-18T01:25:43.907039+0000","last_clean":"2024-09-18T01:25:43.907039+0000","last_became_active":"2024-09-18T01:25:06.691034+0000","last_became_peered":"2024-09-18T01:25:06.691034+0000","last_unstale":"2024-09-18T01:25:43.907039+0000","last_undegraded":"2024-09-18T01:25:43.907039+0000","last_fullsized":"2024-09-18T01:25:43.907039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:43.801545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'3","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799237+0000","last_change":"2024-09-18T01:25:08.685309+0000","last_active":"2024-09-18T01:27:29.799237+0000","last_peered":"2024-09-18T01:27:29.799237+0000","last_clean":"2024-09-18T01:27:29.799237+0000","last_became_active":"2024-09-18T01:25:08.685043+0000","last_became_peered":"2024-09-18T01:25:08.685043+0000","last_unstale":"2024-09-18T01:27:29.799237+0000","last_undegraded":"2024-09-18T01:27:29.799237+0000","last_fullsized":"2024-09-18T01:27:29.799237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:39.586169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846314+0000","last_change":"2024-09-18T01:25:06.704767+0000","last_active":"2024-09-18T01:25:43.846314+0000","last_peered":"2024-09-18T01:25:43.846314+0000","last_clean":"2024-09-18T01:25:43.846314+0000","last_became_active":"2024-09-18T01:25:06.704414+0000","last_became_peered":"2024-09-18T01:25:06.704414+0000","last_unstale":"2024-09-18T01:25:43.846314+0000","last_undegraded":"2024-09-18T01:25:43.846314+0000","last_fullsized":"2024-09-18T01:25:43.846314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:43.801545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097079+0000","last_change":"2024-09-18T01:25:08.685665+0000","last_active":"2024-09-18T01:28:17.097079+0000","last_peered":"2024-09-18T01:28:17.097079+0000","last_clean":"2024-09-18T01:28:17.097079+0000","last_became_active":"2024-09-18T01:25:08.684921+0000","last_became_peered":"2024-09-18T01:25:08.684921+0000","last_unstale":"2024-09-18T01:28:17.097079+0000","last_undegraded":"2024-09-18T01:28:17.097079+0000","last_fullsized":"2024-09-18T01:28:17.097079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:15:04.998223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'3","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.741010+0000","last_change":"2024-09-18T01:25:06.688208+0000","last_active":"2024-09-18T01:26:32.741010+0000","last_peered":"2024-09-18T01:26:32.741010+0000","last_clean":"2024-09-18T01:26:32.741010+0000","last_became_active":"2024-09-18T01:25:06.687737+0000","last_became_peered":"2024-09-18T01:25:06.687737+0000","last_unstale":"2024-09-18T01:26:32.741010+0000","last_undegraded":"2024-09-18T01:26:32.741010+0000","last_fullsized":"2024-09-18T01:26:32.741010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:16.022647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'16","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.394341+0000","last_change":"2024-09-18T01:25:08.671649+0000","last_active":"2024-09-18T01:27:13.394341+0000","last_peered":"2024-09-18T01:27:13.394341+0000","last_clean":"2024-09-18T01:27:13.394341+0000","last_became_active":"2024-09-18T01:25:08.671338+0000","last_became_peered":"2024-09-18T01:25:08.671338+0000","last_unstale":"2024-09-18T01:27:13.394341+0000","last_undegraded":"2024-09-18T01:27:13.394341+0000","last_fullsized":"2024-09-18T01:27:13.394341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:55:06.296443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905086+0000","last_change":"2024-09-18T01:25:06.688689+0000","last_active":"2024-09-18T01:25:43.905086+0000","last_peered":"2024-09-18T01:25:43.905086+0000","last_clean":"2024-09-18T01:25:43.905086+0000","last_became_active":"2024-09-18T01:25:06.688356+0000","last_became_peered":"2024-09-18T01:25:06.688356+0000","last_unstale":"2024-09-18T01:25:43.905086+0000","last_undegraded":"2024-09-18T01:25:43.905086+0000","last_fullsized":"2024-09-18T01:25:43.905086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:22.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941235+0000","last_change":"2024-09-18T01:25:08.674151+0000","last_active":"2024-09-18T01:26:32.941235+0000","last_peered":"2024-09-18T01:26:32.941235+0000","last_clean":"2024-09-18T01:26:32.941235+0000","last_became_active":"2024-09-18T01:25:08.673915+0000","last_became_peered":"2024-09-18T01:25:08.673915+0000","last_unstale":"2024-09-18T01:26:32.941235+0000","last_undegraded":"2024-09-18T01:26:32.941235+0000","last_fullsized":"2024-09-18T01:26:32.941235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:42:49.663850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846696+0000","last_change":"2024-09-18T01:25:06.687453+0000","last_active":"2024-09-18T01:25:43.846696+0000","last_peered":"2024-09-18T01:25:43.846696+0000","last_clean":"2024-09-18T01:25:43.846696+0000","last_became_active":"2024-09-18T01:25:06.686900+0000","last_became_peered":"2024-09-18T01:25:06.686900+0000","last_unstale":"2024-09-18T01:25:43.846696+0000","last_undegraded":"2024-09-18T01:25:43.846696+0000","last_fullsized":"2024-09-18T01:25:43.846696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:18.475907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.142353+0000","last_change":"2024-09-18T01:25:08.682513+0000","last_active":"2024-09-18T01:28:17.142353+0000","last_peered":"2024-09-18T01:28:17.142353+0000","last_clean":"2024-09-18T01:28:17.142353+0000","last_became_active":"2024-09-18T01:25:08.682225+0000","last_became_peered":"2024-09-18T01:25:08.682225+0000","last_unstale":"2024-09-18T01:28:17.142353+0000","last_undegraded":"2024-09-18T01:28:17.142353+0000","last_fullsized":"2024-09-18T01:28:17.142353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:34:57.289152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849721+0000","last_change":"2024-09-18T01:25:06.695620+0000","last_active":"2024-09-18T01:25:43.849721+0000","last_peered":"2024-09-18T01:25:43.849721+0000","last_clean":"2024-09-18T01:25:43.849721+0000","last_became_active":"2024-09-18T01:25:06.693647+0000","last_became_peered":"2024-09-18T01:25:06.693647+0000","last_unstale":"2024-09-18T01:25:43.849721+0000","last_undegraded":"2024-09-18T01:25:43.849721+0000","last_fullsized":"2024-09-18T01:25:43.849721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:00:13.013796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'35","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.121409+0000","last_change":"2024-09-18T01:25:16.712693+0000","last_active":"2024-09-18T01:28:17.121409+0000","last_peered":"2024-09-18T01:28:17.121409+0000","last_clean":"2024-09-18T01:28:17.121409+0000","last_became_active":"2024-09-18T01:25:16.712438+0000","last_became_peered":"2024-09-18T01:25:16.712438+0000","last_unstale":"2024-09-18T01:28:17.121409+0000","last_undegraded":"2024-09-18T01:28:17.121409+0000","last_fullsized":"2024-09-18T01:28:17.121409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:49.191321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.485988+0000","last_change":"2024-09-18T01:25:08.673859+0000","last_active":"2024-09-18T01:27:16.485988+0000","last_peered":"2024-09-18T01:27:16.485988+0000","last_clean":"2024-09-18T01:27:16.485988+0000","last_became_active":"2024-09-18T01:25:08.673605+0000","last_became_peered":"2024-09-18T01:25:08.673605+0000","last_unstale":"2024-09-18T01:27:16.485988+0000","last_undegraded":"2024-09-18T01:27:16.485988+0000","last_fullsized":"2024-09-18T01:27:16.485988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:55:33.999113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849855+0000","last_change":"2024-09-18T01:25:06.687788+0000","last_active":"2024-09-18T01:25:43.849855+0000","last_peered":"2024-09-18T01:25:43.849855+0000","last_clean":"2024-09-18T01:25:43.849855+0000","last_became_active":"2024-09-18T01:25:06.685173+0000","last_became_peered":"2024-09-18T01:25:06.685173+0000","last_unstale":"2024-09-18T01:25:43.849855+0000","last_undegraded":"2024-09-18T01:25:43.849855+0000","last_fullsized":"2024-09-18T01:25:43.849855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:13.192602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850787+0000","last_change":"2024-09-18T01:25:10.684730+0000","last_active":"2024-09-18T01:25:43.850787+0000","last_peered":"2024-09-18T01:25:43.850787+0000","last_clean":"2024-09-18T01:25:43.850787+0000","last_became_active":"2024-09-18T01:25:10.684454+0000","last_became_peered":"2024-09-18T01:25:10.684454+0000","last_unstale":"2024-09-18T01:25:43.850787+0000","last_undegraded":"2024-09-18T01:25:43.850787+0000","last_fullsized":"2024-09-18T01:25:43.850787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:30:35.363182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'45","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.827159+0000","last_change":"2024-09-18T01:25:12.692370+0000","last_active":"2024-09-18T01:28:23.827159+0000","last_peered":"2024-09-18T01:28:23.827159+0000","last_clean":"2024-09-18T01:28:23.827159+0000","last_became_active":"2024-09-18T01:25:12.692059+0000","last_became_peered":"2024-09-18T01:25:12.692059+0000","last_unstale":"2024-09-18T01:28:23.827159+0000","last_undegraded":"2024-09-18T01:28:23.827159+0000","last_fullsized":"2024-09-18T01:28:23.827159+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:17:50.198957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906790+0000","last_change":"2024-09-18T01:25:14.710315+0000","last_active":"2024-09-18T01:25:43.906790+0000","last_peered":"2024-09-18T01:25:43.906790+0000","last_clean":"2024-09-18T01:25:43.906790+0000","last_became_active":"2024-09-18T01:25:14.709879+0000","last_became_peered":"2024-09-18T01:25:14.709879+0000","last_unstale":"2024-09-18T01:25:43.906790+0000","last_undegraded":"2024-09-18T01:25:43.906790+0000","last_fullsized":"2024-09-18T01:25:43.906790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:49.524031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.757439+0000","last_change":"2024-09-18T01:25:16.712032+0000","last_active":"2024-09-18T01:26:32.757439+0000","last_peered":"2024-09-18T01:26:32.757439+0000","last_clean":"2024-09-18T01:26:32.757439+0000","last_became_active":"2024-09-18T01:25:16.711764+0000","last_became_peered":"2024-09-18T01:25:16.711764+0000","last_unstale":"2024-09-18T01:26:32.757439+0000","last_undegraded":"2024-09-18T01:26:32.757439+0000","last_fullsized":"2024-09-18T01:26:32.757439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:53:25.033231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:44.783814+0000","last_change":"2024-09-18T01:25:43.852201+0000","last_active":"2024-09-18T01:25:44.783814+0000","last_peered":"2024-09-18T01:25:44.783814+0000","last_clean":"2024-09-18T01:25:44.783814+0000","last_became_active":"2024-09-18T01:25:43.848631+0000","last_became_peered":"2024-09-18T01:25:43.848631+0000","last_unstale":"2024-09-18T01:25:44.783814+0000","last_undegraded":"2024-09-18T01:25:44.783814+0000","last_fullsized":"2024-09-18T01:25:44.783814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:19:57.986757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:49.297524+0000","last_change":"2024-09-18T01:25:06.691194+0000","last_active":"2024-09-18T01:25:49.297524+0000","last_peered":"2024-09-18T01:25:49.297524+0000","last_clean":"2024-09-18T01:25:49.297524+0000","last_became_active":"2024-09-18T01:25:06.690813+0000","last_became_peered":"2024-09-18T01:25:06.690813+0000","last_unstale":"2024-09-18T01:25:49.297524+0000","last_undegraded":"2024-09-18T01:25:49.297524+0000","last_fullsized":"2024-09-18T01:25:49.297524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:22.518297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844623+0000","last_change":"2024-09-18T01:25:10.677775+0000","last_active":"2024-09-18T01:25:43.844623+0000","last_peered":"2024-09-18T01:25:43.844623+0000","last_clean":"2024-09-18T01:25:43.844623+0000","last_became_active":"2024-09-18T01:25:10.677226+0000","last_became_peered":"2024-09-18T01:25:10.677226+0000","last_unstale":"2024-09-18T01:25:43.844623+0000","last_undegraded":"2024-09-18T01:25:43.844623+0000","last_fullsized":"2024-09-18T01:25:43.844623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:49:15.909145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'13","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906372+0000","last_change":"2024-09-18T01:25:12.688633+0000","last_active":"2024-09-18T01:25:43.906372+0000","last_peered":"2024-09-18T01:25:43.906372+0000","last_clean":"2024-09-18T01:25:43.906372+0000","last_became_active":"2024-09-18T01:25:12.688366+0000","last_became_peered":"2024-09-18T01:25:12.688366+0000","last_unstale":"2024-09-18T01:25:43.906372+0000","last_undegraded":"2024-09-18T01:25:43.906372+0000","last_fullsized":"2024-09-18T01:25:43.906372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:39:55.232921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905614+0000","last_change":"2024-09-18T01:25:14.703217+0000","last_active":"2024-09-18T01:25:43.905614+0000","last_peered":"2024-09-18T01:25:43.905614+0000","last_clean":"2024-09-18T01:25:43.905614+0000","last_became_active":"2024-09-18T01:25:14.702918+0000","last_became_peered":"2024-09-18T01:25:14.702918+0000","last_unstale":"2024-09-18T01:25:43.905614+0000","last_undegraded":"2024-09-18T01:25:43.905614+0000","last_fullsized":"2024-09-18T01:25:43.905614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:23.103965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.232357+0000","last_change":"2024-09-18T01:25:16.714035+0000","last_active":"2024-09-18T01:28:17.232357+0000","last_peered":"2024-09-18T01:28:17.232357+0000","last_clean":"2024-09-18T01:28:17.232357+0000","last_became_active":"2024-09-18T01:25:16.713571+0000","last_became_peered":"2024-09-18T01:25:16.713571+0000","last_unstale":"2024-09-18T01:28:17.232357+0000","last_undegraded":"2024-09-18T01:28:17.232357+0000","last_fullsized":"2024-09-18T01:28:17.232357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:32:22.558708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'8","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176653+0000","last_change":"2024-09-18T01:25:08.673278+0000","last_active":"2024-09-18T01:28:17.176653+0000","last_peered":"2024-09-18T01:28:17.176653+0000","last_clean":"2024-09-18T01:28:17.176653+0000","last_became_active":"2024-09-18T01:25:08.671904+0000","last_became_peered":"2024-09-18T01:25:08.671904+0000","last_unstale":"2024-09-18T01:28:17.176653+0000","last_undegraded":"2024-09-18T01:28:17.176653+0000","last_fullsized":"2024-09-18T01:28:17.176653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:58:59.174725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848365+0000","last_change":"2024-09-18T01:25:06.681491+0000","last_active":"2024-09-18T01:25:43.848365+0000","last_peered":"2024-09-18T01:25:43.848365+0000","last_clean":"2024-09-18T01:25:43.848365+0000","last_became_active":"2024-09-18T01:25:06.681065+0000","last_became_peered":"2024-09-18T01:25:06.681065+0000","last_unstale":"2024-09-18T01:25:43.848365+0000","last_undegraded":"2024-09-18T01:25:43.848365+0000","last_fullsized":"2024-09-18T01:25:43.848365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:46:18.563504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847654+0000","last_change":"2024-09-18T01:25:10.677498+0000","last_active":"2024-09-18T01:25:43.847654+0000","last_peered":"2024-09-18T01:25:43.847654+0000","last_clean":"2024-09-18T01:25:43.847654+0000","last_became_active":"2024-09-18T01:25:10.677118+0000","last_became_peered":"2024-09-18T01:25:10.677118+0000","last_unstale":"2024-09-18T01:25:43.847654+0000","last_undegraded":"2024-09-18T01:25:43.847654+0000","last_fullsized":"2024-09-18T01:25:43.847654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:13.973263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'22","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844252+0000","last_change":"2024-09-18T01:25:12.693775+0000","last_active":"2024-09-18T01:25:43.844252+0000","last_peered":"2024-09-18T01:25:43.844252+0000","last_clean":"2024-09-18T01:25:43.844252+0000","last_became_active":"2024-09-18T01:25:12.693426+0000","last_became_peered":"2024-09-18T01:25:12.693426+0000","last_unstale":"2024-09-18T01:25:43.844252+0000","last_undegraded":"2024-09-18T01:25:43.844252+0000","last_fullsized":"2024-09-18T01:25:43.844252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:03.617713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'285","reported_seq":384,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.712169+0000","last_change":"2024-09-18T01:25:14.707813+0000","last_active":"2024-09-18T01:28:23.712169+0000","last_peered":"2024-09-18T01:28:23.712169+0000","last_clean":"2024-09-18T01:28:23.712169+0000","last_became_active":"2024-09-18T01:25:14.707544+0000","last_became_peered":"2024-09-18T01:25:14.707544+0000","last_unstale":"2024-09-18T01:28:23.712169+0000","last_undegraded":"2024-09-18T01:28:23.712169+0000","last_fullsized":"2024-09-18T01:28:23.712169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:19.273177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843579+0000","last_change":"2024-09-18T01:25:16.714182+0000","last_active":"2024-09-18T01:25:43.843579+0000","last_peered":"2024-09-18T01:25:43.843579+0000","last_clean":"2024-09-18T01:25:43.843579+0000","last_became_active":"2024-09-18T01:25:16.713458+0000","last_became_peered":"2024-09-18T01:25:16.713458+0000","last_unstale":"2024-09-18T01:25:43.843579+0000","last_undegraded":"2024-09-18T01:25:43.843579+0000","last_fullsized":"2024-09-18T01:25:43.843579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:25.118447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847600+0000","last_change":"2024-09-18T01:25:08.681420+0000","last_active":"2024-09-18T01:25:43.847600+0000","last_peered":"2024-09-18T01:25:43.847600+0000","last_clean":"2024-09-18T01:25:43.847600+0000","last_became_active":"2024-09-18T01:25:08.680700+0000","last_became_peered":"2024-09-18T01:25:08.680700+0000","last_unstale":"2024-09-18T01:25:43.847600+0000","last_undegraded":"2024-09-18T01:25:43.847600+0000","last_fullsized":"2024-09-18T01:25:43.847600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:15:04.998223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.442367+0000","last_change":"2024-09-18T01:25:06.691595+0000","last_active":"2024-09-18T01:25:50.442367+0000","last_peered":"2024-09-18T01:25:50.442367+0000","last_clean":"2024-09-18T01:25:50.442367+0000","last_became_active":"2024-09-18T01:25:06.691107+0000","last_became_peered":"2024-09-18T01:25:06.691107+0000","last_unstale":"2024-09-18T01:25:50.442367+0000","last_undegraded":"2024-09-18T01:25:50.442367+0000","last_fullsized":"2024-09-18T01:25:50.442367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:50.530673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850726+0000","last_change":"2024-09-18T01:25:10.681604+0000","last_active":"2024-09-18T01:25:43.850726+0000","last_peered":"2024-09-18T01:25:43.850726+0000","last_clean":"2024-09-18T01:25:43.850726+0000","last_became_active":"2024-09-18T01:25:10.681273+0000","last_became_peered":"2024-09-18T01:25:10.681273+0000","last_unstale":"2024-09-18T01:25:43.850726+0000","last_undegraded":"2024-09-18T01:25:43.850726+0000","last_fullsized":"2024-09-18T01:25:43.850726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:22.269662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'42","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.810629+0000","last_change":"2024-09-18T01:25:12.697422+0000","last_active":"2024-09-18T01:28:23.810629+0000","last_peered":"2024-09-18T01:28:23.810629+0000","last_clean":"2024-09-18T01:28:23.810629+0000","last_became_active":"2024-09-18T01:25:12.697114+0000","last_became_peered":"2024-09-18T01:25:12.697114+0000","last_unstale":"2024-09-18T01:28:23.810629+0000","last_undegraded":"2024-09-18T01:28:23.810629+0000","last_fullsized":"2024-09-18T01:28:23.810629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:43:37.538211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":61,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'282","reported_seq":405,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.288775+0000","last_change":"2024-09-18T01:25:14.699167+0000","last_active":"2024-09-18T01:28:17.288775+0000","last_peered":"2024-09-18T01:28:17.288775+0000","last_clean":"2024-09-18T01:28:17.288775+0000","last_became_active":"2024-09-18T01:25:14.698792+0000","last_became_peered":"2024-09-18T01:25:14.698792+0000","last_unstale":"2024-09-18T01:28:17.288775+0000","last_undegraded":"2024-09-18T01:28:17.288775+0000","last_fullsized":"2024-09-18T01:28:17.288775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:49.524031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.147884+0000","last_change":"2024-09-18T01:25:08.680575+0000","last_active":"2024-09-18T01:28:17.147884+0000","last_peered":"2024-09-18T01:28:17.147884+0000","last_clean":"2024-09-18T01:28:17.147884+0000","last_became_active":"2024-09-18T01:25:08.680143+0000","last_became_peered":"2024-09-18T01:25:08.680143+0000","last_unstale":"2024-09-18T01:28:17.147884+0000","last_undegraded":"2024-09-18T01:28:17.147884+0000","last_fullsized":"2024-09-18T01:28:17.147884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:30:09.036921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845910+0000","last_change":"2024-09-18T01:25:06.701050+0000","last_active":"2024-09-18T01:25:43.845910+0000","last_peered":"2024-09-18T01:25:43.845910+0000","last_clean":"2024-09-18T01:25:43.845910+0000","last_became_active":"2024-09-18T01:25:06.700650+0000","last_became_peered":"2024-09-18T01:25:06.700650+0000","last_unstale":"2024-09-18T01:25:43.845910+0000","last_undegraded":"2024-09-18T01:25:43.845910+0000","last_fullsized":"2024-09-18T01:25:43.845910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:03.343944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904327+0000","last_change":"2024-09-18T01:25:10.683497+0000","last_active":"2024-09-18T01:25:43.904327+0000","last_peered":"2024-09-18T01:25:43.904327+0000","last_clean":"2024-09-18T01:25:43.904327+0000","last_became_active":"2024-09-18T01:25:10.683195+0000","last_became_peered":"2024-09-18T01:25:10.683195+0000","last_unstale":"2024-09-18T01:25:43.904327+0000","last_undegraded":"2024-09-18T01:25:43.904327+0000","last_fullsized":"2024-09-18T01:25:43.904327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:18:42.429992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'50","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.839869+0000","last_change":"2024-09-18T01:25:12.688936+0000","last_active":"2024-09-18T01:28:23.839869+0000","last_peered":"2024-09-18T01:28:23.839869+0000","last_clean":"2024-09-18T01:28:23.839869+0000","last_became_active":"2024-09-18T01:25:12.687943+0000","last_became_peered":"2024-09-18T01:25:12.687943+0000","last_unstale":"2024-09-18T01:28:23.839869+0000","last_undegraded":"2024-09-18T01:28:23.839869+0000","last_fullsized":"2024-09-18T01:28:23.839869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:18:44.438408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846245+0000","last_change":"2024-09-18T01:25:14.699129+0000","last_active":"2024-09-18T01:25:43.846245+0000","last_peered":"2024-09-18T01:25:43.846245+0000","last_clean":"2024-09-18T01:25:43.846245+0000","last_became_active":"2024-09-18T01:25:14.698795+0000","last_became_peered":"2024-09-18T01:25:14.698795+0000","last_unstale":"2024-09-18T01:25:43.846245+0000","last_undegraded":"2024-09-18T01:25:43.846245+0000","last_fullsized":"2024-09-18T01:25:43.846245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:48.579196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'3","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.759291+0000","last_change":"2024-09-18T01:25:16.707493+0000","last_active":"2024-09-18T01:26:32.759291+0000","last_peered":"2024-09-18T01:26:32.759291+0000","last_clean":"2024-09-18T01:26:32.759291+0000","last_became_active":"2024-09-18T01:25:16.707206+0000","last_became_peered":"2024-09-18T01:25:16.707206+0000","last_unstale":"2024-09-18T01:26:32.759291+0000","last_undegraded":"2024-09-18T01:26:32.759291+0000","last_fullsized":"2024-09-18T01:26:32.759291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:51.538514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.867670+0000","last_change":"2024-09-18T01:25:08.683170+0000","last_active":"2024-09-18T01:28:16.867670+0000","last_peered":"2024-09-18T01:28:16.867670+0000","last_clean":"2024-09-18T01:28:16.867670+0000","last_became_active":"2024-09-18T01:25:08.682878+0000","last_became_peered":"2024-09-18T01:25:08.682878+0000","last_unstale":"2024-09-18T01:28:16.867670+0000","last_undegraded":"2024-09-18T01:28:16.867670+0000","last_fullsized":"2024-09-18T01:28:16.867670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:29.205884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.170801+0000","last_change":"2024-09-18T01:25:06.700753+0000","last_active":"2024-09-18T01:28:17.170801+0000","last_peered":"2024-09-18T01:28:17.170801+0000","last_clean":"2024-09-18T01:28:17.170801+0000","last_became_active":"2024-09-18T01:25:06.700357+0000","last_became_peered":"2024-09-18T01:25:06.700357+0000","last_unstale":"2024-09-18T01:28:17.170801+0000","last_undegraded":"2024-09-18T01:28:17.170801+0000","last_fullsized":"2024-09-18T01:28:17.170801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:08.432830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":218,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.133643+0000","last_change":"2024-09-18T01:25:10.680004+0000","last_active":"2024-09-18T01:27:16.133643+0000","last_peered":"2024-09-18T01:27:16.133643+0000","last_clean":"2024-09-18T01:27:16.133643+0000","last_became_active":"2024-09-18T01:25:10.679652+0000","last_became_peered":"2024-09-18T01:25:10.679652+0000","last_unstale":"2024-09-18T01:27:16.133643+0000","last_undegraded":"2024-09-18T01:27:16.133643+0000","last_fullsized":"2024-09-18T01:27:16.133643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:02.192046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'39","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.779646+0000","last_change":"2024-09-18T01:25:12.691981+0000","last_active":"2024-09-18T01:28:23.779646+0000","last_peered":"2024-09-18T01:28:23.779646+0000","last_clean":"2024-09-18T01:28:23.779646+0000","last_became_active":"2024-09-18T01:25:12.691691+0000","last_became_peered":"2024-09-18T01:25:12.691691+0000","last_unstale":"2024-09-18T01:28:23.779646+0000","last_undegraded":"2024-09-18T01:28:23.779646+0000","last_fullsized":"2024-09-18T01:28:23.779646+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:40:21.738974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844437+0000","last_change":"2024-09-18T01:25:14.706870+0000","last_active":"2024-09-18T01:25:43.844437+0000","last_peered":"2024-09-18T01:25:43.844437+0000","last_clean":"2024-09-18T01:25:43.844437+0000","last_became_active":"2024-09-18T01:25:14.706505+0000","last_became_peered":"2024-09-18T01:25:14.706505+0000","last_unstale":"2024-09-18T01:25:43.844437+0000","last_undegraded":"2024-09-18T01:25:43.844437+0000","last_fullsized":"2024-09-18T01:25:43.844437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:31:17.162597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'3","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:27.222234+0000","last_change":"2024-09-18T01:25:16.713810+0000","last_active":"2024-09-18T01:26:27.222234+0000","last_peered":"2024-09-18T01:26:27.222234+0000","last_clean":"2024-09-18T01:26:27.222234+0000","last_became_active":"2024-09-18T01:25:16.713453+0000","last_became_peered":"2024-09-18T01:25:16.713453+0000","last_unstale":"2024-09-18T01:26:27.222234+0000","last_undegraded":"2024-09-18T01:26:27.222234+0000","last_fullsized":"2024-09-18T01:26:27.222234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:37.223946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'5","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.796758+0000","last_change":"2024-09-18T01:25:08.674795+0000","last_active":"2024-09-18T01:27:19.796758+0000","last_peered":"2024-09-18T01:27:19.796758+0000","last_clean":"2024-09-18T01:27:19.796758+0000","last_became_active":"2024-09-18T01:25:08.674525+0000","last_became_peered":"2024-09-18T01:25:08.674525+0000","last_unstale":"2024-09-18T01:27:19.796758+0000","last_undegraded":"2024-09-18T01:27:19.796758+0000","last_fullsized":"2024-09-18T01:27:19.796758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:55:50.100041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.083065+0000","last_change":"2024-09-18T01:25:06.696117+0000","last_active":"2024-09-18T01:28:17.083065+0000","last_peered":"2024-09-18T01:28:17.083065+0000","last_clean":"2024-09-18T01:28:17.083065+0000","last_became_active":"2024-09-18T01:25:06.694058+0000","last_became_peered":"2024-09-18T01:25:06.694058+0000","last_unstale":"2024-09-18T01:28:17.083065+0000","last_undegraded":"2024-09-18T01:28:17.083065+0000","last_fullsized":"2024-09-18T01:28:17.083065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:58:41.570989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:44.783777+0000","last_change":"2024-09-18T01:25:43.903991+0000","last_active":"2024-09-18T01:25:44.783777+0000","last_peered":"2024-09-18T01:25:44.783777+0000","last_clean":"2024-09-18T01:25:44.783777+0000","last_became_active":"2024-09-18T01:25:43.903638+0000","last_became_peered":"2024-09-18T01:25:43.903638+0000","last_unstale":"2024-09-18T01:25:44.783777+0000","last_undegraded":"2024-09-18T01:25:44.783777+0000","last_fullsized":"2024-09-18T01:25:44.783777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:53:19.003232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'51","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.846291+0000","last_change":"2024-09-18T01:25:12.694029+0000","last_active":"2024-09-18T01:28:23.846291+0000","last_peered":"2024-09-18T01:28:23.846291+0000","last_clean":"2024-09-18T01:28:23.846291+0000","last_became_active":"2024-09-18T01:25:12.693182+0000","last_became_peered":"2024-09-18T01:25:12.693182+0000","last_unstale":"2024-09-18T01:28:23.846291+0000","last_undegraded":"2024-09-18T01:28:23.846291+0000","last_fullsized":"2024-09-18T01:28:23.846291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:08:39.434682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'282","reported_seq":348,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.298524+0000","last_change":"2024-09-18T01:25:14.706933+0000","last_active":"2024-09-18T01:28:17.298524+0000","last_peered":"2024-09-18T01:28:17.298524+0000","last_clean":"2024-09-18T01:28:17.298524+0000","last_became_active":"2024-09-18T01:25:14.706540+0000","last_became_peered":"2024-09-18T01:25:14.706540+0000","last_unstale":"2024-09-18T01:28:17.298524+0000","last_undegraded":"2024-09-18T01:28:17.298524+0000","last_fullsized":"2024-09-18T01:28:17.298524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:27.416743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.391512+0000","last_change":"2024-09-18T01:25:16.714648+0000","last_active":"2024-09-18T01:27:13.391512+0000","last_peered":"2024-09-18T01:27:13.391512+0000","last_clean":"2024-09-18T01:27:13.391512+0000","last_became_active":"2024-09-18T01:25:16.714363+0000","last_became_peered":"2024-09-18T01:25:16.714363+0000","last_unstale":"2024-09-18T01:27:13.391512+0000","last_undegraded":"2024-09-18T01:27:13.391512+0000","last_fullsized":"2024-09-18T01:27:13.391512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:59:11.881576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.866295+0000","last_change":"2024-09-18T01:25:08.670862+0000","last_active":"2024-09-18T01:28:16.866295+0000","last_peered":"2024-09-18T01:28:16.866295+0000","last_clean":"2024-09-18T01:28:16.866295+0000","last_became_active":"2024-09-18T01:25:08.670617+0000","last_became_peered":"2024-09-18T01:25:08.670617+0000","last_unstale":"2024-09-18T01:28:16.866295+0000","last_undegraded":"2024-09-18T01:28:16.866295+0000","last_fullsized":"2024-09-18T01:28:16.866295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:29.205884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849958+0000","last_change":"2024-09-18T01:25:06.693637+0000","last_active":"2024-09-18T01:25:43.849958+0000","last_peered":"2024-09-18T01:25:43.849958+0000","last_clean":"2024-09-18T01:25:43.849958+0000","last_became_active":"2024-09-18T01:25:06.689545+0000","last_became_peered":"2024-09-18T01:25:06.689545+0000","last_unstale":"2024-09-18T01:25:43.849958+0000","last_undegraded":"2024-09-18T01:25:43.849958+0000","last_fullsized":"2024-09-18T01:25:43.849958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:57.969892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:44.783756+0000","last_change":"2024-09-18T01:25:43.907490+0000","last_active":"2024-09-18T01:25:44.783756+0000","last_peered":"2024-09-18T01:25:44.783756+0000","last_clean":"2024-09-18T01:25:44.783756+0000","last_became_active":"2024-09-18T01:25:43.907094+0000","last_became_peered":"2024-09-18T01:25:43.907094+0000","last_unstale":"2024-09-18T01:25:44.783756+0000","last_undegraded":"2024-09-18T01:25:44.783756+0000","last_fullsized":"2024-09-18T01:25:44.783756+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:26:05.185230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'74","reported_seq":150,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.859497+0000","last_change":"2024-09-18T01:25:12.693226+0000","last_active":"2024-09-18T01:28:23.859497+0000","last_peered":"2024-09-18T01:28:23.859497+0000","last_clean":"2024-09-18T01:28:23.859497+0000","last_became_active":"2024-09-18T01:25:12.692821+0000","last_became_peered":"2024-09-18T01:25:12.692821+0000","last_unstale":"2024-09-18T01:28:23.859497+0000","last_undegraded":"2024-09-18T01:28:23.859497+0000","last_fullsized":"2024-09-18T01:28:23.859497+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:15.391395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":84,"num_read_kb":81,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843893+0000","last_change":"2024-09-18T01:25:14.707691+0000","last_active":"2024-09-18T01:25:43.843893+0000","last_peered":"2024-09-18T01:25:43.843893+0000","last_clean":"2024-09-18T01:25:43.843893+0000","last_became_active":"2024-09-18T01:25:14.707514+0000","last_became_peered":"2024-09-18T01:25:14.707514+0000","last_unstale":"2024-09-18T01:25:43.843893+0000","last_undegraded":"2024-09-18T01:25:43.843893+0000","last_fullsized":"2024-09-18T01:25:43.843893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:57.575198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.271704+0000","last_change":"2024-09-18T01:25:16.706301+0000","last_active":"2024-09-18T01:28:17.271704+0000","last_peered":"2024-09-18T01:28:17.271704+0000","last_clean":"2024-09-18T01:28:17.271704+0000","last_became_active":"2024-09-18T01:25:16.705938+0000","last_became_peered":"2024-09-18T01:25:16.705938+0000","last_unstale":"2024-09-18T01:28:17.271704+0000","last_undegraded":"2024-09-18T01:28:17.271704+0000","last_fullsized":"2024-09-18T01:28:17.271704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:48:53.777539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176669+0000","last_change":"2024-09-18T01:25:08.687495+0000","last_active":"2024-09-18T01:28:17.176669+0000","last_peered":"2024-09-18T01:28:17.176669+0000","last_clean":"2024-09-18T01:28:17.176669+0000","last_became_active":"2024-09-18T01:25:08.687135+0000","last_became_peered":"2024-09-18T01:25:08.687135+0000","last_unstale":"2024-09-18T01:28:17.176669+0000","last_undegraded":"2024-09-18T01:28:17.176669+0000","last_fullsized":"2024-09-18T01:28:17.176669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:15.493296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845740+0000","last_change":"2024-09-18T01:25:06.681219+0000","last_active":"2024-09-18T01:25:43.845740+0000","last_peered":"2024-09-18T01:25:43.845740+0000","last_clean":"2024-09-18T01:25:43.845740+0000","last_became_active":"2024-09-18T01:25:06.680774+0000","last_became_peered":"2024-09-18T01:25:06.680774+0000","last_unstale":"2024-09-18T01:25:43.845740+0000","last_undegraded":"2024-09-18T01:25:43.845740+0000","last_fullsized":"2024-09-18T01:25:43.845740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:33:48.652888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845831+0000","last_change":"2024-09-18T01:25:10.675268+0000","last_active":"2024-09-18T01:25:43.845831+0000","last_peered":"2024-09-18T01:25:43.845831+0000","last_clean":"2024-09-18T01:25:43.845831+0000","last_became_active":"2024-09-18T01:25:10.674983+0000","last_became_peered":"2024-09-18T01:25:10.674983+0000","last_unstale":"2024-09-18T01:25:43.845831+0000","last_undegraded":"2024-09-18T01:25:43.845831+0000","last_fullsized":"2024-09-18T01:25:43.845831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:25:15.816622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'41","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.791281+0000","last_change":"2024-09-18T01:25:12.683645+0000","last_active":"2024-09-18T01:28:23.791281+0000","last_peered":"2024-09-18T01:28:23.791281+0000","last_clean":"2024-09-18T01:28:23.791281+0000","last_became_active":"2024-09-18T01:25:12.683339+0000","last_became_peered":"2024-09-18T01:25:12.683339+0000","last_unstale":"2024-09-18T01:28:23.791281+0000","last_undegraded":"2024-09-18T01:28:23.791281+0000","last_fullsized":"2024-09-18T01:28:23.791281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:55:20.974738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851387+0000","last_change":"2024-09-18T01:25:14.708366+0000","last_active":"2024-09-18T01:25:43.851387+0000","last_peered":"2024-09-18T01:25:43.851387+0000","last_clean":"2024-09-18T01:25:43.851387+0000","last_became_active":"2024-09-18T01:25:14.707116+0000","last_became_peered":"2024-09-18T01:25:14.707116+0000","last_unstale":"2024-09-18T01:25:43.851387+0000","last_undegraded":"2024-09-18T01:25:43.851387+0000","last_fullsized":"2024-09-18T01:25:43.851387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:38.584056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797258+0000","last_change":"2024-09-18T01:25:16.708368+0000","last_active":"2024-09-18T01:27:19.797258+0000","last_peered":"2024-09-18T01:27:19.797258+0000","last_clean":"2024-09-18T01:27:19.797258+0000","last_became_active":"2024-09-18T01:25:16.708095+0000","last_became_peered":"2024-09-18T01:25:16.708095+0000","last_unstale":"2024-09-18T01:27:19.797258+0000","last_undegraded":"2024-09-18T01:27:19.797258+0000","last_fullsized":"2024-09-18T01:27:19.797258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:48.121756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.752010+0000","last_change":"2024-09-18T01:25:08.688693+0000","last_active":"2024-09-18T01:26:32.752010+0000","last_peered":"2024-09-18T01:26:32.752010+0000","last_clean":"2024-09-18T01:26:32.752010+0000","last_became_active":"2024-09-18T01:25:08.688251+0000","last_became_peered":"2024-09-18T01:25:08.688251+0000","last_unstale":"2024-09-18T01:26:32.752010+0000","last_undegraded":"2024-09-18T01:26:32.752010+0000","last_fullsized":"2024-09-18T01:26:32.752010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:56.803513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.757447+0000","last_change":"2024-09-18T01:25:06.684669+0000","last_active":"2024-09-18T01:28:16.757447+0000","last_peered":"2024-09-18T01:28:16.757447+0000","last_clean":"2024-09-18T01:28:16.757447+0000","last_became_active":"2024-09-18T01:25:06.683437+0000","last_became_peered":"2024-09-18T01:25:06.683437+0000","last_unstale":"2024-09-18T01:28:16.757447+0000","last_undegraded":"2024-09-18T01:28:16.757447+0000","last_fullsized":"2024-09-18T01:28:16.757447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:23.462064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844681+0000","last_change":"2024-09-18T01:25:10.680258+0000","last_active":"2024-09-18T01:25:43.844681+0000","last_peered":"2024-09-18T01:25:43.844681+0000","last_clean":"2024-09-18T01:25:43.844681+0000","last_became_active":"2024-09-18T01:25:10.679740+0000","last_became_peered":"2024-09-18T01:25:10.679740+0000","last_unstale":"2024-09-18T01:25:43.844681+0000","last_undegraded":"2024-09-18T01:25:43.844681+0000","last_fullsized":"2024-09-18T01:25:43.844681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:40.355268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'39","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.769267+0000","last_change":"2024-09-18T01:25:12.687798+0000","last_active":"2024-09-18T01:28:23.769267+0000","last_peered":"2024-09-18T01:28:23.769267+0000","last_clean":"2024-09-18T01:28:23.769267+0000","last_became_active":"2024-09-18T01:25:12.686455+0000","last_became_peered":"2024-09-18T01:25:12.686455+0000","last_unstale":"2024-09-18T01:28:23.769267+0000","last_undegraded":"2024-09-18T01:28:23.769267+0000","last_fullsized":"2024-09-18T01:28:23.769267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:43.085499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":406,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.713197+0000","last_change":"2024-09-18T01:25:14.704198+0000","last_active":"2024-09-18T01:28:23.713197+0000","last_peered":"2024-09-18T01:28:23.713197+0000","last_clean":"2024-09-18T01:28:23.713197+0000","last_became_active":"2024-09-18T01:25:14.703877+0000","last_became_peered":"2024-09-18T01:25:14.703877+0000","last_unstale":"2024-09-18T01:28:23.713197+0000","last_undegraded":"2024-09-18T01:28:23.713197+0000","last_fullsized":"2024-09-18T01:28:23.713197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:39:57.240022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'12","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:22.797572+0000","last_change":"2024-09-18T01:25:16.714095+0000","last_active":"2024-09-18T01:27:22.797572+0000","last_peered":"2024-09-18T01:27:22.797572+0000","last_clean":"2024-09-18T01:27:22.797572+0000","last_became_active":"2024-09-18T01:25:16.713677+0000","last_became_peered":"2024-09-18T01:25:16.713677+0000","last_unstale":"2024-09-18T01:27:22.797572+0000","last_undegraded":"2024-09-18T01:27:22.797572+0000","last_fullsized":"2024-09-18T01:27:22.797572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:37.223946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954552+0000","last_change":"2024-09-18T01:25:08.673535+0000","last_active":"2024-09-18T01:28:16.954552+0000","last_peered":"2024-09-18T01:28:16.954552+0000","last_clean":"2024-09-18T01:28:16.954552+0000","last_became_active":"2024-09-18T01:25:08.673276+0000","last_became_peered":"2024-09-18T01:25:08.673276+0000","last_unstale":"2024-09-18T01:28:16.954552+0000","last_undegraded":"2024-09-18T01:28:16.954552+0000","last_fullsized":"2024-09-18T01:28:16.954552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:58.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.463022+0000","last_change":"2024-09-18T01:25:06.683319+0000","last_active":"2024-09-18T01:27:16.463022+0000","last_peered":"2024-09-18T01:27:16.463022+0000","last_clean":"2024-09-18T01:27:16.463022+0000","last_became_active":"2024-09-18T01:25:06.682841+0000","last_became_peered":"2024-09-18T01:25:06.682841+0000","last_unstale":"2024-09-18T01:27:16.463022+0000","last_undegraded":"2024-09-18T01:27:16.463022+0000","last_fullsized":"2024-09-18T01:27:16.463022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:52:44.524173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":417,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.694247+0000","last_change":"2024-09-18T01:25:10.680374+0000","last_active":"2024-09-18T01:28:23.694247+0000","last_peered":"2024-09-18T01:28:23.694247+0000","last_clean":"2024-09-18T01:28:23.694247+0000","last_became_active":"2024-09-18T01:25:10.679483+0000","last_became_peered":"2024-09-18T01:25:10.679483+0000","last_unstale":"2024-09-18T01:28:23.694247+0000","last_undegraded":"2024-09-18T01:28:23.694247+0000","last_fullsized":"2024-09-18T01:28:23.694247+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:41.077084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851675+0000","last_change":"2024-09-18T01:25:12.697050+0000","last_active":"2024-09-18T01:25:43.851675+0000","last_peered":"2024-09-18T01:25:43.851675+0000","last_clean":"2024-09-18T01:25:43.851675+0000","last_became_active":"2024-09-18T01:25:12.696726+0000","last_became_peered":"2024-09-18T01:25:12.696726+0000","last_unstale":"2024-09-18T01:25:43.851675+0000","last_undegraded":"2024-09-18T01:25:43.851675+0000","last_fullsized":"2024-09-18T01:25:43.851675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:25.931338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":513,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.714525+0000","last_change":"2024-09-18T01:25:14.705212+0000","last_active":"2024-09-18T01:28:23.714525+0000","last_peered":"2024-09-18T01:28:23.714525+0000","last_clean":"2024-09-18T01:28:23.714525+0000","last_became_active":"2024-09-18T01:25:14.702900+0000","last_became_peered":"2024-09-18T01:25:14.702900+0000","last_unstale":"2024-09-18T01:28:23.714525+0000","last_undegraded":"2024-09-18T01:28:23.714525+0000","last_fullsized":"2024-09-18T01:28:23.714525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:44.393089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.267015+0000","last_change":"2024-09-18T01:25:16.712364+0000","last_active":"2024-09-18T01:27:16.267015+0000","last_peered":"2024-09-18T01:27:16.267015+0000","last_clean":"2024-09-18T01:27:16.267015+0000","last_became_active":"2024-09-18T01:25:16.712084+0000","last_became_peered":"2024-09-18T01:25:16.712084+0000","last_unstale":"2024-09-18T01:27:16.267015+0000","last_undegraded":"2024-09-18T01:27:16.267015+0000","last_fullsized":"2024-09-18T01:27:16.267015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:46.407572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'8","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.144995+0000","last_change":"2024-09-18T01:25:08.687109+0000","last_active":"2024-09-18T01:28:17.144995+0000","last_peered":"2024-09-18T01:28:17.144995+0000","last_clean":"2024-09-18T01:28:17.144995+0000","last_became_active":"2024-09-18T01:25:08.686802+0000","last_became_peered":"2024-09-18T01:25:08.686802+0000","last_unstale":"2024-09-18T01:28:17.144995+0000","last_undegraded":"2024-09-18T01:28:17.144995+0000","last_fullsized":"2024-09-18T01:28:17.144995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:13.745242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.080072+0000","last_change":"2024-09-18T01:25:06.695782+0000","last_active":"2024-09-18T01:28:17.080072+0000","last_peered":"2024-09-18T01:28:17.080072+0000","last_clean":"2024-09-18T01:28:17.080072+0000","last_became_active":"2024-09-18T01:25:06.691644+0000","last_became_peered":"2024-09-18T01:25:06.691644+0000","last_unstale":"2024-09-18T01:28:17.080072+0000","last_undegraded":"2024-09-18T01:28:17.080072+0000","last_fullsized":"2024-09-18T01:28:17.080072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:51:10.947372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851329+0000","last_change":"2024-09-18T01:25:10.682385+0000","last_active":"2024-09-18T01:25:43.851329+0000","last_peered":"2024-09-18T01:25:43.851329+0000","last_clean":"2024-09-18T01:25:43.851329+0000","last_became_active":"2024-09-18T01:25:10.682075+0000","last_became_peered":"2024-09-18T01:25:10.682075+0000","last_unstale":"2024-09-18T01:25:43.851329+0000","last_undegraded":"2024-09-18T01:25:43.851329+0000","last_fullsized":"2024-09-18T01:25:43.851329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:28.482490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'42","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.830450+0000","last_change":"2024-09-18T01:25:12.686750+0000","last_active":"2024-09-18T01:28:23.830450+0000","last_peered":"2024-09-18T01:28:23.830450+0000","last_clean":"2024-09-18T01:28:23.830450+0000","last_became_active":"2024-09-18T01:25:12.686460+0000","last_became_peered":"2024-09-18T01:25:12.686460+0000","last_unstale":"2024-09-18T01:28:23.830450+0000","last_undegraded":"2024-09-18T01:28:23.830450+0000","last_fullsized":"2024-09-18T01:28:23.830450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:56.008777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843863+0000","last_change":"2024-09-18T01:25:14.706837+0000","last_active":"2024-09-18T01:25:43.843863+0000","last_peered":"2024-09-18T01:25:43.843863+0000","last_clean":"2024-09-18T01:25:43.843863+0000","last_became_active":"2024-09-18T01:25:14.706506+0000","last_became_peered":"2024-09-18T01:25:14.706506+0000","last_unstale":"2024-09-18T01:25:43.843863+0000","last_undegraded":"2024-09-18T01:25:43.843863+0000","last_fullsized":"2024-09-18T01:25:43.843863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:31:25.019479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.209468+0000","last_change":"2024-09-18T01:25:16.709338+0000","last_active":"2024-09-18T01:28:17.209468+0000","last_peered":"2024-09-18T01:28:17.209468+0000","last_clean":"2024-09-18T01:28:17.209468+0000","last_became_active":"2024-09-18T01:25:16.709084+0000","last_became_peered":"2024-09-18T01:25:16.709084+0000","last_unstale":"2024-09-18T01:28:17.209468+0000","last_undegraded":"2024-09-18T01:28:17.209468+0000","last_fullsized":"2024-09-18T01:28:17.209468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:26:11.215230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'7","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183392+0000","last_change":"2024-09-18T01:25:08.688515+0000","last_active":"2024-09-18T01:28:17.183392+0000","last_peered":"2024-09-18T01:28:17.183392+0000","last_clean":"2024-09-18T01:28:17.183392+0000","last_became_active":"2024-09-18T01:25:08.687896+0000","last_became_peered":"2024-09-18T01:25:08.687896+0000","last_unstale":"2024-09-18T01:28:17.183392+0000","last_undegraded":"2024-09-18T01:28:17.183392+0000","last_fullsized":"2024-09-18T01:28:17.183392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:47:23.724986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":204,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903661+0000","last_change":"2024-09-18T01:24:52.297138+0000","last_active":"2024-09-18T01:25:43.903661+0000","last_peered":"2024-09-18T01:25:43.903661+0000","last_clean":"2024-09-18T01:25:43.903661+0000","last_became_active":"2024-09-18T01:24:52.296214+0000","last_became_peered":"2024-09-18T01:24:52.296214+0000","last_unstale":"2024-09-18T01:25:43.903661+0000","last_undegraded":"2024-09-18T01:25:43.903661+0000","last_fullsized":"2024-09-18T01:25:43.903661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_clean_scrub_stamp":"2024-09-18T01:24:51.161687+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:36:16.487345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850355+0000","last_change":"2024-09-18T01:24:58.197569+0000","last_active":"2024-09-18T01:25:43.850355+0000","last_peered":"2024-09-18T01:25:43.850355+0000","last_clean":"2024-09-18T01:25:43.850355+0000","last_became_active":"2024-09-18T01:24:56.194443+0000","last_became_peered":"2024-09-18T01:24:56.194443+0000","last_unstale":"2024-09-18T01:25:43.850355+0000","last_undegraded":"2024-09-18T01:25:43.850355+0000","last_fullsized":"2024-09-18T01:25:43.850355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:43:12.854702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033763700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.850186+0000","last_change":"2024-09-18T01:25:06.684714+0000","last_active":"2024-09-18T01:28:16.850186+0000","last_peered":"2024-09-18T01:28:16.850186+0000","last_clean":"2024-09-18T01:28:16.850186+0000","last_became_active":"2024-09-18T01:25:06.683975+0000","last_became_peered":"2024-09-18T01:25:06.683975+0000","last_unstale":"2024-09-18T01:28:16.850186+0000","last_undegraded":"2024-09-18T01:28:16.850186+0000","last_fullsized":"2024-09-18T01:28:16.850186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:47.187628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904635+0000","last_change":"2024-09-18T01:25:10.679847+0000","last_active":"2024-09-18T01:25:43.904635+0000","last_peered":"2024-09-18T01:25:43.904635+0000","last_clean":"2024-09-18T01:25:43.904635+0000","last_became_active":"2024-09-18T01:25:10.679572+0000","last_became_peered":"2024-09-18T01:25:10.679572+0000","last_unstale":"2024-09-18T01:25:43.904635+0000","last_undegraded":"2024-09-18T01:25:43.904635+0000","last_fullsized":"2024-09-18T01:25:43.904635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:53:26.506877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'91","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.836668+0000","last_change":"2024-09-18T01:25:12.692243+0000","last_active":"2024-09-18T01:28:23.836668+0000","last_peered":"2024-09-18T01:28:23.836668+0000","last_clean":"2024-09-18T01:28:23.836668+0000","last_became_active":"2024-09-18T01:25:12.691952+0000","last_became_peered":"2024-09-18T01:25:12.691952+0000","last_unstale":"2024-09-18T01:28:23.836668+0000","last_undegraded":"2024-09-18T01:28:23.836668+0000","last_fullsized":"2024-09-18T01:28:23.836668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:38.540516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845488+0000","last_change":"2024-09-18T01:25:14.707170+0000","last_active":"2024-09-18T01:25:43.845488+0000","last_peered":"2024-09-18T01:25:43.845488+0000","last_clean":"2024-09-18T01:25:43.845488+0000","last_became_active":"2024-09-18T01:25:14.706519+0000","last_became_peered":"2024-09-18T01:25:14.706519+0000","last_unstale":"2024-09-18T01:25:43.845488+0000","last_undegraded":"2024-09-18T01:25:43.845488+0000","last_fullsized":"2024-09-18T01:25:43.845488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:53.286034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'85","reported_seq":168,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.185765+0000","last_change":"2024-09-18T01:25:16.712377+0000","last_active":"2024-09-18T01:28:17.185765+0000","last_peered":"2024-09-18T01:28:17.185765+0000","last_clean":"2024-09-18T01:28:17.185765+0000","last_became_active":"2024-09-18T01:25:16.712102+0000","last_became_peered":"2024-09-18T01:25:16.712102+0000","last_unstale":"2024-09-18T01:28:17.185765+0000","last_undegraded":"2024-09-18T01:28:17.185765+0000","last_fullsized":"2024-09-18T01:28:17.185765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:59.589681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":221,"num_write":168,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'7","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797548+0000","last_change":"2024-09-18T01:25:08.672900+0000","last_active":"2024-09-18T01:27:19.797548+0000","last_peered":"2024-09-18T01:27:19.797548+0000","last_clean":"2024-09-18T01:27:19.797548+0000","last_became_active":"2024-09-18T01:25:08.671578+0000","last_became_peered":"2024-09-18T01:25:08.671578+0000","last_unstale":"2024-09-18T01:27:19.797548+0000","last_undegraded":"2024-09-18T01:27:19.797548+0000","last_fullsized":"2024-09-18T01:27:19.797548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:01:40.367586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847748+0000","last_change":"2024-09-18T01:24:58.197615+0000","last_active":"2024-09-18T01:25:43.847748+0000","last_peered":"2024-09-18T01:25:43.847748+0000","last_clean":"2024-09-18T01:25:43.847748+0000","last_became_active":"2024-09-18T01:24:56.191554+0000","last_became_peered":"2024-09-18T01:24:56.191554+0000","last_unstale":"2024-09-18T01:25:43.847748+0000","last_undegraded":"2024-09-18T01:25:43.847748+0000","last_fullsized":"2024-09-18T01:25:43.847748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:55.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041584599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843970+0000","last_change":"2024-09-18T01:25:06.681216+0000","last_active":"2024-09-18T01:25:43.843970+0000","last_peered":"2024-09-18T01:25:43.843970+0000","last_clean":"2024-09-18T01:25:43.843970+0000","last_became_active":"2024-09-18T01:25:06.680635+0000","last_became_peered":"2024-09-18T01:25:06.680635+0000","last_unstale":"2024-09-18T01:25:43.843970+0000","last_undegraded":"2024-09-18T01:25:43.843970+0000","last_fullsized":"2024-09-18T01:25:43.843970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:43.801545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851531+0000","last_change":"2024-09-18T01:25:10.682266+0000","last_active":"2024-09-18T01:25:43.851531+0000","last_peered":"2024-09-18T01:25:43.851531+0000","last_clean":"2024-09-18T01:25:43.851531+0000","last_became_active":"2024-09-18T01:25:10.681988+0000","last_became_peered":"2024-09-18T01:25:10.681988+0000","last_unstale":"2024-09-18T01:25:43.851531+0000","last_undegraded":"2024-09-18T01:25:43.851531+0000","last_fullsized":"2024-09-18T01:25:43.851531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:53:03.896010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'290","reported_seq":512,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.834412+0000","last_change":"2024-09-18T01:25:12.694263+0000","last_active":"2024-09-18T01:28:23.834412+0000","last_peered":"2024-09-18T01:28:23.834412+0000","last_clean":"2024-09-18T01:28:23.834412+0000","last_became_active":"2024-09-18T01:25:12.693664+0000","last_became_peered":"2024-09-18T01:25:12.693664+0000","last_unstale":"2024-09-18T01:28:23.834412+0000","last_undegraded":"2024-09-18T01:28:23.834412+0000","last_fullsized":"2024-09-18T01:28:23.834412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:31:23.012378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850081+0000","last_change":"2024-09-18T01:25:14.707563+0000","last_active":"2024-09-18T01:25:43.850081+0000","last_peered":"2024-09-18T01:25:43.850081+0000","last_clean":"2024-09-18T01:25:43.850081+0000","last_became_active":"2024-09-18T01:25:14.707143+0000","last_became_peered":"2024-09-18T01:25:14.707143+0000","last_unstale":"2024-09-18T01:25:43.850081+0000","last_undegraded":"2024-09-18T01:25:43.850081+0000","last_fullsized":"2024-09-18T01:25:43.850081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:07.461296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.886187+0000","last_change":"2024-09-18T01:25:16.714554+0000","last_active":"2024-09-18T01:28:16.886187+0000","last_peered":"2024-09-18T01:28:16.886187+0000","last_clean":"2024-09-18T01:28:16.886187+0000","last_became_active":"2024-09-18T01:25:16.712931+0000","last_became_peered":"2024-09-18T01:25:16.712931+0000","last_unstale":"2024-09-18T01:28:16.886187+0000","last_undegraded":"2024-09-18T01:28:16.886187+0000","last_fullsized":"2024-09-18T01:28:16.886187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:20:06.027889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954356+0000","last_change":"2024-09-18T01:25:08.681154+0000","last_active":"2024-09-18T01:28:16.954356+0000","last_peered":"2024-09-18T01:28:16.954356+0000","last_clean":"2024-09-18T01:28:16.954356+0000","last_became_active":"2024-09-18T01:25:08.680541+0000","last_became_peered":"2024-09-18T01:25:08.680541+0000","last_unstale":"2024-09-18T01:28:16.954356+0000","last_undegraded":"2024-09-18T01:28:16.954356+0000","last_fullsized":"2024-09-18T01:28:16.954356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:15.493296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843251+0000","last_change":"2024-09-18T01:24:58.350485+0000","last_active":"2024-09-18T01:25:43.843251+0000","last_peered":"2024-09-18T01:25:43.843251+0000","last_clean":"2024-09-18T01:25:43.843251+0000","last_became_active":"2024-09-18T01:24:56.191162+0000","last_became_peered":"2024-09-18T01:24:56.191162+0000","last_unstale":"2024-09-18T01:25:43.843251+0000","last_undegraded":"2024-09-18T01:25:43.843251+0000","last_fullsized":"2024-09-18T01:25:43.843251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:38:00.033247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040921399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:07.795274+0000","last_change":"2024-09-18T01:25:06.686498+0000","last_active":"2024-09-18T01:27:07.795274+0000","last_peered":"2024-09-18T01:27:07.795274+0000","last_clean":"2024-09-18T01:27:07.795274+0000","last_became_active":"2024-09-18T01:25:06.686053+0000","last_became_peered":"2024-09-18T01:25:06.686053+0000","last_unstale":"2024-09-18T01:27:07.795274+0000","last_undegraded":"2024-09-18T01:27:07.795274+0000","last_fullsized":"2024-09-18T01:27:07.795274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:22.518297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845792+0000","last_change":"2024-09-18T01:25:10.677853+0000","last_active":"2024-09-18T01:25:43.845792+0000","last_peered":"2024-09-18T01:25:43.845792+0000","last_clean":"2024-09-18T01:25:43.845792+0000","last_became_active":"2024-09-18T01:25:10.677597+0000","last_became_peered":"2024-09-18T01:25:10.677597+0000","last_unstale":"2024-09-18T01:25:43.845792+0000","last_undegraded":"2024-09-18T01:25:43.845792+0000","last_fullsized":"2024-09-18T01:25:43.845792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:29.066415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:15.763577+0000","last_change":"2024-09-18T01:25:12.688147+0000","last_active":"2024-09-18T01:28:15.763577+0000","last_peered":"2024-09-18T01:28:15.763577+0000","last_clean":"2024-09-18T01:28:15.763577+0000","last_became_active":"2024-09-18T01:25:12.687799+0000","last_became_peered":"2024-09-18T01:25:12.687799+0000","last_unstale":"2024-09-18T01:28:15.763577+0000","last_undegraded":"2024-09-18T01:28:15.763577+0000","last_fullsized":"2024-09-18T01:28:15.763577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:03:37.628556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845029+0000","last_change":"2024-09-18T01:25:14.706976+0000","last_active":"2024-09-18T01:25:43.845029+0000","last_peered":"2024-09-18T01:25:43.845029+0000","last_clean":"2024-09-18T01:25:43.845029+0000","last_became_active":"2024-09-18T01:25:14.706611+0000","last_became_peered":"2024-09-18T01:25:14.706611+0000","last_unstale":"2024-09-18T01:25:43.845029+0000","last_undegraded":"2024-09-18T01:25:43.845029+0000","last_fullsized":"2024-09-18T01:25:43.845029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:15.483666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849369+0000","last_change":"2024-09-18T01:25:16.711670+0000","last_active":"2024-09-18T01:25:43.849369+0000","last_peered":"2024-09-18T01:25:43.849369+0000","last_clean":"2024-09-18T01:25:43.849369+0000","last_became_active":"2024-09-18T01:25:16.711404+0000","last_became_peered":"2024-09-18T01:25:16.711404+0000","last_unstale":"2024-09-18T01:25:43.849369+0000","last_undegraded":"2024-09-18T01:25:43.849369+0000","last_fullsized":"2024-09-18T01:25:43.849369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:12:32.036544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097075+0000","last_change":"2024-09-18T01:25:08.673345+0000","last_active":"2024-09-18T01:28:17.097075+0000","last_peered":"2024-09-18T01:28:17.097075+0000","last_clean":"2024-09-18T01:28:17.097075+0000","last_became_active":"2024-09-18T01:25:08.672969+0000","last_became_peered":"2024-09-18T01:25:08.672969+0000","last_unstale":"2024-09-18T01:28:17.097075+0000","last_undegraded":"2024-09-18T01:28:17.097075+0000","last_fullsized":"2024-09-18T01:28:17.097075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:37.287772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849309+0000","last_change":"2024-09-18T01:24:58.198236+0000","last_active":"2024-09-18T01:25:43.849309+0000","last_peered":"2024-09-18T01:25:43.849309+0000","last_clean":"2024-09-18T01:25:43.849309+0000","last_became_active":"2024-09-18T01:24:56.191713+0000","last_became_peered":"2024-09-18T01:24:56.191713+0000","last_unstale":"2024-09-18T01:25:43.849309+0000","last_undegraded":"2024-09-18T01:25:43.849309+0000","last_fullsized":"2024-09-18T01:25:43.849309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:55:46.520977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010043490000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844211+0000","last_change":"2024-09-18T01:25:06.700684+0000","last_active":"2024-09-18T01:25:43.844211+0000","last_peered":"2024-09-18T01:25:43.844211+0000","last_clean":"2024-09-18T01:25:43.844211+0000","last_became_active":"2024-09-18T01:25:06.700397+0000","last_became_peered":"2024-09-18T01:25:06.700397+0000","last_unstale":"2024-09-18T01:25:43.844211+0000","last_undegraded":"2024-09-18T01:25:43.844211+0000","last_fullsized":"2024-09-18T01:25:43.844211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:22.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845266+0000","last_change":"2024-09-18T01:25:10.676620+0000","last_active":"2024-09-18T01:25:43.845266+0000","last_peered":"2024-09-18T01:25:43.845266+0000","last_clean":"2024-09-18T01:25:43.845266+0000","last_became_active":"2024-09-18T01:25:10.676320+0000","last_became_peered":"2024-09-18T01:25:10.676320+0000","last_unstale":"2024-09-18T01:25:43.845266+0000","last_undegraded":"2024-09-18T01:25:43.845266+0000","last_fullsized":"2024-09-18T01:25:43.845266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:01:00.415475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'13","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.498611+0000","last_change":"2024-09-18T01:25:12.692628+0000","last_active":"2024-09-18T01:28:16.498611+0000","last_peered":"2024-09-18T01:28:16.498611+0000","last_clean":"2024-09-18T01:28:16.498611+0000","last_became_active":"2024-09-18T01:25:12.692373+0000","last_became_peered":"2024-09-18T01:25:12.692373+0000","last_unstale":"2024-09-18T01:28:16.498611+0000","last_undegraded":"2024-09-18T01:28:16.498611+0000","last_fullsized":"2024-09-18T01:28:16.498611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:48.277377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851686+0000","last_change":"2024-09-18T01:25:14.709358+0000","last_active":"2024-09-18T01:25:43.851686+0000","last_peered":"2024-09-18T01:25:43.851686+0000","last_clean":"2024-09-18T01:25:43.851686+0000","last_became_active":"2024-09-18T01:25:14.707409+0000","last_became_peered":"2024-09-18T01:25:14.707409+0000","last_unstale":"2024-09-18T01:25:43.851686+0000","last_undegraded":"2024-09-18T01:25:43.851686+0000","last_fullsized":"2024-09-18T01:25:43.851686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:44:50.425957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'6","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.246929+0000","last_change":"2024-09-18T01:25:16.711391+0000","last_active":"2024-09-18T01:27:16.246929+0000","last_peered":"2024-09-18T01:27:16.246929+0000","last_clean":"2024-09-18T01:27:16.246929+0000","last_became_active":"2024-09-18T01:25:16.711104+0000","last_became_peered":"2024-09-18T01:25:16.711104+0000","last_unstale":"2024-09-18T01:27:16.246929+0000","last_undegraded":"2024-09-18T01:27:16.246929+0000","last_fullsized":"2024-09-18T01:27:16.246929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:20.551132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.751886+0000","last_change":"2024-09-18T01:25:08.687474+0000","last_active":"2024-09-18T01:26:32.751886+0000","last_peered":"2024-09-18T01:26:32.751886+0000","last_clean":"2024-09-18T01:26:32.751886+0000","last_became_active":"2024-09-18T01:25:08.687139+0000","last_became_peered":"2024-09-18T01:25:08.687139+0000","last_unstale":"2024-09-18T01:26:32.751886+0000","last_undegraded":"2024-09-18T01:26:32.751886+0000","last_fullsized":"2024-09-18T01:26:32.751886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:17.472878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845078+0000","last_change":"2024-09-18T01:25:06.692246+0000","last_active":"2024-09-18T01:25:43.845078+0000","last_peered":"2024-09-18T01:25:43.845078+0000","last_clean":"2024-09-18T01:25:43.845078+0000","last_became_active":"2024-09-18T01:25:06.691871+0000","last_became_peered":"2024-09-18T01:25:06.691871+0000","last_unstale":"2024-09-18T01:25:43.845078+0000","last_undegraded":"2024-09-18T01:25:43.845078+0000","last_fullsized":"2024-09-18T01:25:43.845078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:18.475907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844899+0000","last_change":"2024-09-18T01:24:58.199959+0000","last_active":"2024-09-18T01:25:43.844899+0000","last_peered":"2024-09-18T01:25:43.844899+0000","last_clean":"2024-09-18T01:25:43.844899+0000","last_became_active":"2024-09-18T01:24:56.191033+0000","last_became_peered":"2024-09-18T01:24:56.191033+0000","last_unstale":"2024-09-18T01:25:43.844899+0000","last_undegraded":"2024-09-18T01:25:43.844899+0000","last_fullsized":"2024-09-18T01:25:43.844899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:45.677191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000547898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:17.796664+0000","last_change":"2024-09-18T01:25:10.676817+0000","last_active":"2024-09-18T01:27:17.796664+0000","last_peered":"2024-09-18T01:27:17.796664+0000","last_clean":"2024-09-18T01:27:17.796664+0000","last_became_active":"2024-09-18T01:25:10.676531+0000","last_became_peered":"2024-09-18T01:25:10.676531+0000","last_unstale":"2024-09-18T01:27:17.796664+0000","last_undegraded":"2024-09-18T01:27:17.796664+0000","last_fullsized":"2024-09-18T01:27:17.796664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:30:17.964806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'76","reported_seq":147,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.878002+0000","last_change":"2024-09-18T01:25:12.693490+0000","last_active":"2024-09-18T01:28:16.878002+0000","last_peered":"2024-09-18T01:28:16.878002+0000","last_clean":"2024-09-18T01:28:16.878002+0000","last_became_active":"2024-09-18T01:25:12.693127+0000","last_became_peered":"2024-09-18T01:25:12.693127+0000","last_unstale":"2024-09-18T01:28:16.878002+0000","last_undegraded":"2024-09-18T01:28:16.878002+0000","last_fullsized":"2024-09-18T01:28:16.878002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:53:39.113408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.842921+0000","last_change":"2024-09-18T01:25:14.704345+0000","last_active":"2024-09-18T01:25:43.842921+0000","last_peered":"2024-09-18T01:25:43.842921+0000","last_clean":"2024-09-18T01:25:43.842921+0000","last_became_active":"2024-09-18T01:25:14.703993+0000","last_became_peered":"2024-09-18T01:25:14.703993+0000","last_unstale":"2024-09-18T01:25:43.842921+0000","last_undegraded":"2024-09-18T01:25:43.842921+0000","last_fullsized":"2024-09-18T01:25:43.842921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:48.964473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.422802+0000","last_change":"2024-09-18T01:25:16.703557+0000","last_active":"2024-09-18T01:27:16.422802+0000","last_peered":"2024-09-18T01:27:16.422802+0000","last_clean":"2024-09-18T01:27:16.422802+0000","last_became_active":"2024-09-18T01:25:16.703278+0000","last_became_peered":"2024-09-18T01:25:16.703278+0000","last_unstale":"2024-09-18T01:27:16.422802+0000","last_undegraded":"2024-09-18T01:27:16.422802+0000","last_fullsized":"2024-09-18T01:27:16.422802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:50:43.127125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097370+0000","last_change":"2024-09-18T01:25:08.686341+0000","last_active":"2024-09-18T01:28:17.097370+0000","last_peered":"2024-09-18T01:28:17.097370+0000","last_clean":"2024-09-18T01:28:17.097370+0000","last_became_active":"2024-09-18T01:25:08.686087+0000","last_became_peered":"2024-09-18T01:25:08.686087+0000","last_unstale":"2024-09-18T01:28:17.097370+0000","last_undegraded":"2024-09-18T01:28:17.097370+0000","last_fullsized":"2024-09-18T01:28:17.097370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:58.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.796033+0000","last_change":"2024-09-18T01:25:06.681153+0000","last_active":"2024-09-18T01:27:12.796033+0000","last_peered":"2024-09-18T01:27:12.796033+0000","last_clean":"2024-09-18T01:27:12.796033+0000","last_became_active":"2024-09-18T01:25:06.680623+0000","last_became_peered":"2024-09-18T01:25:06.680623+0000","last_unstale":"2024-09-18T01:27:12.796033+0000","last_undegraded":"2024-09-18T01:27:12.796033+0000","last_fullsized":"2024-09-18T01:27:12.796033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:43.847905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851403+0000","last_change":"2024-09-18T01:24:58.198528+0000","last_active":"2024-09-18T01:25:43.851403+0000","last_peered":"2024-09-18T01:25:43.851403+0000","last_clean":"2024-09-18T01:25:43.851403+0000","last_became_active":"2024-09-18T01:24:56.191687+0000","last_became_peered":"2024-09-18T01:24:56.191687+0000","last_unstale":"2024-09-18T01:25:43.851403+0000","last_undegraded":"2024-09-18T01:25:43.851403+0000","last_fullsized":"2024-09-18T01:25:43.851403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:11:00.731633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012745390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848299+0000","last_change":"2024-09-18T01:25:10.681568+0000","last_active":"2024-09-18T01:25:43.848299+0000","last_peered":"2024-09-18T01:25:43.848299+0000","last_clean":"2024-09-18T01:25:43.848299+0000","last_became_active":"2024-09-18T01:25:10.681311+0000","last_became_peered":"2024-09-18T01:25:10.681311+0000","last_unstale":"2024-09-18T01:25:43.848299+0000","last_undegraded":"2024-09-18T01:25:43.848299+0000","last_fullsized":"2024-09-18T01:25:43.848299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:18:53.465821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'21","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797770+0000","last_change":"2024-09-18T01:25:12.692614+0000","last_active":"2024-09-18T01:27:19.797770+0000","last_peered":"2024-09-18T01:27:19.797770+0000","last_clean":"2024-09-18T01:27:19.797770+0000","last_became_active":"2024-09-18T01:25:12.692357+0000","last_became_peered":"2024-09-18T01:25:12.692357+0000","last_unstale":"2024-09-18T01:27:19.797770+0000","last_undegraded":"2024-09-18T01:27:19.797770+0000","last_fullsized":"2024-09-18T01:27:19.797770+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:53.053242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":389,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.711133+0000","last_change":"2024-09-18T01:25:14.706009+0000","last_active":"2024-09-18T01:28:23.711133+0000","last_peered":"2024-09-18T01:28:23.711133+0000","last_clean":"2024-09-18T01:28:23.711133+0000","last_became_active":"2024-09-18T01:25:14.705703+0000","last_became_peered":"2024-09-18T01:25:14.705703+0000","last_unstale":"2024-09-18T01:28:23.711133+0000","last_undegraded":"2024-09-18T01:28:23.711133+0000","last_fullsized":"2024-09-18T01:28:23.711133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:27.416743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850789+0000","last_change":"2024-09-18T01:25:16.711811+0000","last_active":"2024-09-18T01:25:43.850789+0000","last_peered":"2024-09-18T01:25:43.850789+0000","last_clean":"2024-09-18T01:25:43.850789+0000","last_became_active":"2024-09-18T01:25:16.711531+0000","last_became_peered":"2024-09-18T01:25:16.711531+0000","last_unstale":"2024-09-18T01:25:43.850789+0000","last_undegraded":"2024-09-18T01:25:43.850789+0000","last_fullsized":"2024-09-18T01:25:43.850789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:37:22.949714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'20","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.145097+0000","last_change":"2024-09-18T01:25:08.681868+0000","last_active":"2024-09-18T01:28:17.145097+0000","last_peered":"2024-09-18T01:28:17.145097+0000","last_clean":"2024-09-18T01:28:17.145097+0000","last_became_active":"2024-09-18T01:25:08.681285+0000","last_became_peered":"2024-09-18T01:25:08.681285+0000","last_unstale":"2024-09-18T01:28:17.145097+0000","last_undegraded":"2024-09-18T01:28:17.145097+0000","last_fullsized":"2024-09-18T01:28:17.145097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:17:00.419181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":56,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.852230+0000","last_change":"2024-09-18T01:25:06.684116+0000","last_active":"2024-09-18T01:25:43.852230+0000","last_peered":"2024-09-18T01:25:43.852230+0000","last_clean":"2024-09-18T01:25:43.852230+0000","last_became_active":"2024-09-18T01:25:06.683740+0000","last_became_peered":"2024-09-18T01:25:06.683740+0000","last_unstale":"2024-09-18T01:25:43.852230+0000","last_undegraded":"2024-09-18T01:25:43.852230+0000","last_fullsized":"2024-09-18T01:25:43.852230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:01.765123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846258+0000","last_change":"2024-09-18T01:24:58.199970+0000","last_active":"2024-09-18T01:25:43.846258+0000","last_peered":"2024-09-18T01:25:43.846258+0000","last_clean":"2024-09-18T01:25:43.846258+0000","last_became_active":"2024-09-18T01:24:56.192301+0000","last_became_peered":"2024-09-18T01:24:56.192301+0000","last_unstale":"2024-09-18T01:25:43.846258+0000","last_undegraded":"2024-09-18T01:25:43.846258+0000","last_fullsized":"2024-09-18T01:25:43.846258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:15.228308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056449699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848267+0000","last_change":"2024-09-18T01:25:10.682420+0000","last_active":"2024-09-18T01:25:43.848267+0000","last_peered":"2024-09-18T01:25:43.848267+0000","last_clean":"2024-09-18T01:25:43.848267+0000","last_became_active":"2024-09-18T01:25:10.682111+0000","last_became_peered":"2024-09-18T01:25:10.682111+0000","last_unstale":"2024-09-18T01:25:43.848267+0000","last_undegraded":"2024-09-18T01:25:43.848267+0000","last_fullsized":"2024-09-18T01:25:43.848267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:50.968119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'17","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797411+0000","last_change":"2024-09-18T01:25:12.692600+0000","last_active":"2024-09-18T01:27:19.797411+0000","last_peered":"2024-09-18T01:27:19.797411+0000","last_clean":"2024-09-18T01:27:19.797411+0000","last_became_active":"2024-09-18T01:25:12.692313+0000","last_became_peered":"2024-09-18T01:25:12.692313+0000","last_unstale":"2024-09-18T01:27:19.797411+0000","last_undegraded":"2024-09-18T01:27:19.797411+0000","last_fullsized":"2024-09-18T01:27:19.797411+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:07:06.091989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'282","reported_seq":398,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.272287+0000","last_change":"2024-09-18T01:25:14.699037+0000","last_active":"2024-09-18T01:28:17.272287+0000","last_peered":"2024-09-18T01:28:17.272287+0000","last_clean":"2024-09-18T01:28:17.272287+0000","last_became_active":"2024-09-18T01:25:14.698755+0000","last_became_peered":"2024-09-18T01:25:14.698755+0000","last_unstale":"2024-09-18T01:28:17.272287+0000","last_undegraded":"2024-09-18T01:28:17.272287+0000","last_fullsized":"2024-09-18T01:28:17.272287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:44.393089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.218389+0000","last_change":"2024-09-18T01:25:16.712818+0000","last_active":"2024-09-18T01:25:50.218389+0000","last_peered":"2024-09-18T01:25:50.218389+0000","last_clean":"2024-09-18T01:25:50.218389+0000","last_became_active":"2024-09-18T01:25:16.712556+0000","last_became_peered":"2024-09-18T01:25:16.712556+0000","last_unstale":"2024-09-18T01:25:50.218389+0000","last_undegraded":"2024-09-18T01:25:50.218389+0000","last_fullsized":"2024-09-18T01:25:50.218389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:33:55.839584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'13","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183683+0000","last_change":"2024-09-18T01:25:08.674848+0000","last_active":"2024-09-18T01:28:17.183683+0000","last_peered":"2024-09-18T01:28:17.183683+0000","last_clean":"2024-09-18T01:28:17.183683+0000","last_became_active":"2024-09-18T01:25:08.674560+0000","last_became_peered":"2024-09-18T01:25:08.674560+0000","last_unstale":"2024-09-18T01:28:17.183683+0000","last_undegraded":"2024-09-18T01:28:17.183683+0000","last_fullsized":"2024-09-18T01:28:17.183683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:10.873516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.389587+0000","last_change":"2024-09-18T01:25:06.693785+0000","last_active":"2024-09-18T01:27:16.389587+0000","last_peered":"2024-09-18T01:27:16.389587+0000","last_clean":"2024-09-18T01:27:16.389587+0000","last_became_active":"2024-09-18T01:25:06.686277+0000","last_became_peered":"2024-09-18T01:25:06.686277+0000","last_unstale":"2024-09-18T01:27:16.389587+0000","last_undegraded":"2024-09-18T01:27:16.389587+0000","last_fullsized":"2024-09-18T01:27:16.389587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:22.518297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851867+0000","last_change":"2024-09-18T01:24:58.198307+0000","last_active":"2024-09-18T01:25:43.851867+0000","last_peered":"2024-09-18T01:25:43.851867+0000","last_clean":"2024-09-18T01:25:43.851867+0000","last_became_active":"2024-09-18T01:24:56.602991+0000","last_became_peered":"2024-09-18T01:24:56.602991+0000","last_unstale":"2024-09-18T01:25:43.851867+0000","last_undegraded":"2024-09-18T01:25:43.851867+0000","last_fullsized":"2024-09-18T01:25:43.851867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:37:38.935073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077351,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847636+0000","last_change":"2024-09-18T01:25:10.683146+0000","last_active":"2024-09-18T01:25:43.847636+0000","last_peered":"2024-09-18T01:25:43.847636+0000","last_clean":"2024-09-18T01:25:43.847636+0000","last_became_active":"2024-09-18T01:25:10.682057+0000","last_became_peered":"2024-09-18T01:25:10.682057+0000","last_unstale":"2024-09-18T01:25:43.847636+0000","last_undegraded":"2024-09-18T01:25:43.847636+0000","last_fullsized":"2024-09-18T01:25:43.847636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:50:53.226062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'98","reported_seq":188,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.823959+0000","last_change":"2024-09-18T01:25:12.694747+0000","last_active":"2024-09-18T01:28:23.823959+0000","last_peered":"2024-09-18T01:28:23.823959+0000","last_clean":"2024-09-18T01:28:23.823959+0000","last_became_active":"2024-09-18T01:25:12.694361+0000","last_became_peered":"2024-09-18T01:25:12.694361+0000","last_unstale":"2024-09-18T01:28:23.823959+0000","last_undegraded":"2024-09-18T01:28:23.823959+0000","last_fullsized":"2024-09-18T01:28:23.823959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:01:02.423890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844037+0000","last_change":"2024-09-18T01:25:14.707331+0000","last_active":"2024-09-18T01:25:43.844037+0000","last_peered":"2024-09-18T01:25:43.844037+0000","last_clean":"2024-09-18T01:25:43.844037+0000","last_became_active":"2024-09-18T01:25:14.706960+0000","last_became_peered":"2024-09-18T01:25:14.706960+0000","last_unstale":"2024-09-18T01:25:43.844037+0000","last_undegraded":"2024-09-18T01:25:43.844037+0000","last_fullsized":"2024-09-18T01:25:43.844037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:41:23.103965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846489+0000","last_change":"2024-09-18T01:25:16.716922+0000","last_active":"2024-09-18T01:25:43.846489+0000","last_peered":"2024-09-18T01:25:43.846489+0000","last_clean":"2024-09-18T01:25:43.846489+0000","last_became_active":"2024-09-18T01:25:16.716607+0000","last_became_peered":"2024-09-18T01:25:16.716607+0000","last_unstale":"2024-09-18T01:25:43.846489+0000","last_undegraded":"2024-09-18T01:25:43.846489+0000","last_fullsized":"2024-09-18T01:25:43.846489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:31:19.177080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845585+0000","last_change":"2024-09-18T01:25:16.717173+0000","last_active":"2024-09-18T01:25:43.845585+0000","last_peered":"2024-09-18T01:25:43.845585+0000","last_clean":"2024-09-18T01:25:43.845585+0000","last_became_active":"2024-09-18T01:25:16.716867+0000","last_became_peered":"2024-09-18T01:25:16.716867+0000","last_unstale":"2024-09-18T01:25:43.845585+0000","last_undegraded":"2024-09-18T01:25:43.845585+0000","last_fullsized":"2024-09-18T01:25:43.845585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:29.431226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941573+0000","last_change":"2024-09-18T01:25:08.676006+0000","last_active":"2024-09-18T01:26:32.941573+0000","last_peered":"2024-09-18T01:26:32.941573+0000","last_clean":"2024-09-18T01:26:32.941573+0000","last_became_active":"2024-09-18T01:25:08.675590+0000","last_became_peered":"2024-09-18T01:25:08.675590+0000","last_unstale":"2024-09-18T01:26:32.941573+0000","last_undegraded":"2024-09-18T01:26:32.941573+0000","last_fullsized":"2024-09-18T01:26:32.941573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:41.267347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850033+0000","last_change":"2024-09-18T01:25:06.693775+0000","last_active":"2024-09-18T01:25:43.850033+0000","last_peered":"2024-09-18T01:25:43.850033+0000","last_clean":"2024-09-18T01:25:43.850033+0000","last_became_active":"2024-09-18T01:25:06.689996+0000","last_became_peered":"2024-09-18T01:25:06.689996+0000","last_unstale":"2024-09-18T01:25:43.850033+0000","last_undegraded":"2024-09-18T01:25:43.850033+0000","last_fullsized":"2024-09-18T01:25:43.850033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:08:19.802935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904820+0000","last_change":"2024-09-18T01:25:10.680563+0000","last_active":"2024-09-18T01:25:43.904820+0000","last_peered":"2024-09-18T01:25:43.904820+0000","last_clean":"2024-09-18T01:25:43.904820+0000","last_became_active":"2024-09-18T01:25:10.679704+0000","last_became_peered":"2024-09-18T01:25:10.679704+0000","last_unstale":"2024-09-18T01:25:43.904820+0000","last_undegraded":"2024-09-18T01:25:43.904820+0000","last_fullsized":"2024-09-18T01:25:43.904820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:43:35.529795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'41","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.843100+0000","last_change":"2024-09-18T01:25:12.693302+0000","last_active":"2024-09-18T01:28:23.843100+0000","last_peered":"2024-09-18T01:28:23.843100+0000","last_clean":"2024-09-18T01:28:23.843100+0000","last_became_active":"2024-09-18T01:25:12.692870+0000","last_became_peered":"2024-09-18T01:25:12.692870+0000","last_unstale":"2024-09-18T01:28:23.843100+0000","last_undegraded":"2024-09-18T01:28:23.843100+0000","last_fullsized":"2024-09-18T01:28:23.843100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:53:57.208130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848675+0000","last_change":"2024-09-18T01:25:14.707283+0000","last_active":"2024-09-18T01:25:43.848675+0000","last_peered":"2024-09-18T01:25:43.848675+0000","last_clean":"2024-09-18T01:25:43.848675+0000","last_became_active":"2024-09-18T01:25:14.706381+0000","last_became_peered":"2024-09-18T01:25:14.706381+0000","last_unstale":"2024-09-18T01:25:43.848675+0000","last_undegraded":"2024-09-18T01:25:43.848675+0000","last_fullsized":"2024-09-18T01:25:43.848675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:43:26.455220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'17","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.580259+0000","last_change":"2024-09-18T01:25:16.703483+0000","last_active":"2024-09-18T01:28:16.580259+0000","last_peered":"2024-09-18T01:28:16.580259+0000","last_clean":"2024-09-18T01:28:16.580259+0000","last_became_active":"2024-09-18T01:25:16.703227+0000","last_became_peered":"2024-09-18T01:25:16.703227+0000","last_unstale":"2024-09-18T01:28:16.580259+0000","last_undegraded":"2024-09-18T01:28:16.580259+0000","last_fullsized":"2024-09-18T01:28:16.580259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:31.864546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904703+0000","last_change":"2024-09-18T01:25:08.687780+0000","last_active":"2024-09-18T01:25:43.904703+0000","last_peered":"2024-09-18T01:25:43.904703+0000","last_clean":"2024-09-18T01:25:43.904703+0000","last_became_active":"2024-09-18T01:25:08.687482+0000","last_became_peered":"2024-09-18T01:25:08.687482+0000","last_unstale":"2024-09-18T01:25:43.904703+0000","last_undegraded":"2024-09-18T01:25:43.904703+0000","last_fullsized":"2024-09-18T01:25:43.904703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:19.129968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845694+0000","last_change":"2024-09-18T01:25:06.705764+0000","last_active":"2024-09-18T01:25:43.845694+0000","last_peered":"2024-09-18T01:25:43.845694+0000","last_clean":"2024-09-18T01:25:43.845694+0000","last_became_active":"2024-09-18T01:25:06.705406+0000","last_became_peered":"2024-09-18T01:25:06.705406+0000","last_unstale":"2024-09-18T01:25:43.845694+0000","last_undegraded":"2024-09-18T01:25:43.845694+0000","last_fullsized":"2024-09-18T01:25:43.845694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:16.022647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849629+0000","last_change":"2024-09-18T01:25:10.682648+0000","last_active":"2024-09-18T01:25:43.849629+0000","last_peered":"2024-09-18T01:25:43.849629+0000","last_clean":"2024-09-18T01:25:43.849629+0000","last_became_active":"2024-09-18T01:25:10.682230+0000","last_became_peered":"2024-09-18T01:25:10.682230+0000","last_unstale":"2024-09-18T01:25:43.849629+0000","last_undegraded":"2024-09-18T01:25:43.849629+0000","last_fullsized":"2024-09-18T01:25:43.849629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:46:29.499833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'5","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.503052+0000","last_change":"2024-09-18T01:25:12.687325+0000","last_active":"2024-09-18T01:28:16.503052+0000","last_peered":"2024-09-18T01:28:16.503052+0000","last_clean":"2024-09-18T01:28:16.503052+0000","last_became_active":"2024-09-18T01:25:12.687018+0000","last_became_peered":"2024-09-18T01:25:12.687018+0000","last_unstale":"2024-09-18T01:28:16.503052+0000","last_undegraded":"2024-09-18T01:28:16.503052+0000","last_fullsized":"2024-09-18T01:28:16.503052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:38.338819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843144+0000","last_change":"2024-09-18T01:25:14.707285+0000","last_active":"2024-09-18T01:25:43.843144+0000","last_peered":"2024-09-18T01:25:43.843144+0000","last_clean":"2024-09-18T01:25:43.843144+0000","last_became_active":"2024-09-18T01:25:14.707008+0000","last_became_peered":"2024-09-18T01:25:14.707008+0000","last_unstale":"2024-09-18T01:25:43.843144+0000","last_undegraded":"2024-09-18T01:25:43.843144+0000","last_fullsized":"2024-09-18T01:25:43.843144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:37.834091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.131556+0000","last_change":"2024-09-18T01:25:16.714484+0000","last_active":"2024-09-18T01:28:17.131556+0000","last_peered":"2024-09-18T01:28:17.131556+0000","last_clean":"2024-09-18T01:28:17.131556+0000","last_became_active":"2024-09-18T01:25:16.714160+0000","last_became_peered":"2024-09-18T01:25:16.714160+0000","last_unstale":"2024-09-18T01:28:17.131556+0000","last_undegraded":"2024-09-18T01:28:17.131556+0000","last_fullsized":"2024-09-18T01:28:17.131556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:00:21.563802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844674+0000","last_change":"2024-09-18T01:25:08.671711+0000","last_active":"2024-09-18T01:25:43.844674+0000","last_peered":"2024-09-18T01:25:43.844674+0000","last_clean":"2024-09-18T01:25:43.844674+0000","last_became_active":"2024-09-18T01:25:08.671365+0000","last_became_peered":"2024-09-18T01:25:08.671365+0000","last_unstale":"2024-09-18T01:25:43.844674+0000","last_undegraded":"2024-09-18T01:25:43.844674+0000","last_fullsized":"2024-09-18T01:25:43.844674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:42:49.663850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.808647+0000","last_change":"2024-09-18T01:25:06.703718+0000","last_active":"2024-09-18T01:28:16.808647+0000","last_peered":"2024-09-18T01:28:16.808647+0000","last_clean":"2024-09-18T01:28:16.808647+0000","last_became_active":"2024-09-18T01:25:06.703081+0000","last_became_peered":"2024-09-18T01:25:06.703081+0000","last_unstale":"2024-09-18T01:28:16.808647+0000","last_undegraded":"2024-09-18T01:28:16.808647+0000","last_fullsized":"2024-09-18T01:28:16.808647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:43.847905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843418+0000","last_change":"2024-09-18T01:25:10.680659+0000","last_active":"2024-09-18T01:25:43.843418+0000","last_peered":"2024-09-18T01:25:43.843418+0000","last_clean":"2024-09-18T01:25:43.843418+0000","last_became_active":"2024-09-18T01:25:10.680316+0000","last_became_peered":"2024-09-18T01:25:10.680316+0000","last_unstale":"2024-09-18T01:25:43.843418+0000","last_undegraded":"2024-09-18T01:25:43.843418+0000","last_fullsized":"2024-09-18T01:25:43.843418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:15.756375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'40","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.560764+0000","last_change":"2024-09-18T01:25:12.682598+0000","last_active":"2024-09-18T01:28:16.560764+0000","last_peered":"2024-09-18T01:28:16.560764+0000","last_clean":"2024-09-18T01:28:16.560764+0000","last_became_active":"2024-09-18T01:25:12.682270+0000","last_became_peered":"2024-09-18T01:25:12.682270+0000","last_unstale":"2024-09-18T01:28:16.560764+0000","last_undegraded":"2024-09-18T01:28:16.560764+0000","last_fullsized":"2024-09-18T01:28:16.560764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:44.205915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903990+0000","last_change":"2024-09-18T01:25:14.705277+0000","last_active":"2024-09-18T01:25:43.903990+0000","last_peered":"2024-09-18T01:25:43.903990+0000","last_clean":"2024-09-18T01:25:43.903990+0000","last_became_active":"2024-09-18T01:25:14.703583+0000","last_became_peered":"2024-09-18T01:25:14.703583+0000","last_unstale":"2024-09-18T01:25:43.903990+0000","last_undegraded":"2024-09-18T01:25:43.903990+0000","last_fullsized":"2024-09-18T01:25:43.903990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:01:53.638099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849566+0000","last_change":"2024-09-18T01:25:16.714459+0000","last_active":"2024-09-18T01:25:43.849566+0000","last_peered":"2024-09-18T01:25:43.849566+0000","last_clean":"2024-09-18T01:25:43.849566+0000","last_became_active":"2024-09-18T01:25:16.714061+0000","last_became_peered":"2024-09-18T01:25:16.714061+0000","last_unstale":"2024-09-18T01:25:43.849566+0000","last_undegraded":"2024-09-18T01:25:43.849566+0000","last_fullsized":"2024-09-18T01:25:43.849566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:00:46.823041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'4","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941172+0000","last_change":"2024-09-18T01:25:08.688282+0000","last_active":"2024-09-18T01:26:32.941172+0000","last_peered":"2024-09-18T01:26:32.941172+0000","last_clean":"2024-09-18T01:26:32.941172+0000","last_became_active":"2024-09-18T01:25:08.688016+0000","last_became_peered":"2024-09-18T01:25:08.688016+0000","last_unstale":"2024-09-18T01:26:32.941172+0000","last_undegraded":"2024-09-18T01:26:32.941172+0000","last_fullsized":"2024-09-18T01:26:32.941172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:37:29.581979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906628+0000","last_change":"2024-09-18T01:25:06.691298+0000","last_active":"2024-09-18T01:25:43.906628+0000","last_peered":"2024-09-18T01:25:43.906628+0000","last_clean":"2024-09-18T01:25:43.906628+0000","last_became_active":"2024-09-18T01:25:06.688747+0000","last_became_peered":"2024-09-18T01:25:06.688747+0000","last_unstale":"2024-09-18T01:25:43.906628+0000","last_undegraded":"2024-09-18T01:25:43.906628+0000","last_fullsized":"2024-09-18T01:25:43.906628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:03.343944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848182+0000","last_change":"2024-09-18T01:25:10.681110+0000","last_active":"2024-09-18T01:25:43.848182+0000","last_peered":"2024-09-18T01:25:43.848182+0000","last_clean":"2024-09-18T01:25:43.848182+0000","last_became_active":"2024-09-18T01:25:10.680831+0000","last_became_peered":"2024-09-18T01:25:10.680831+0000","last_unstale":"2024-09-18T01:25:43.848182+0000","last_undegraded":"2024-09-18T01:25:43.848182+0000","last_fullsized":"2024-09-18T01:25:43.848182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:27.094941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'33","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.798174+0000","last_change":"2024-09-18T01:25:12.687200+0000","last_active":"2024-09-18T01:28:23.798174+0000","last_peered":"2024-09-18T01:28:23.798174+0000","last_clean":"2024-09-18T01:28:23.798174+0000","last_became_active":"2024-09-18T01:25:12.686918+0000","last_became_peered":"2024-09-18T01:25:12.686918+0000","last_unstale":"2024-09-18T01:28:23.798174+0000","last_undegraded":"2024-09-18T01:28:23.798174+0000","last_fullsized":"2024-09-18T01:28:23.798174+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:15.981679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843880+0000","last_change":"2024-09-18T01:25:14.695864+0000","last_active":"2024-09-18T01:25:43.843880+0000","last_peered":"2024-09-18T01:25:43.843880+0000","last_clean":"2024-09-18T01:25:43.843880+0000","last_became_active":"2024-09-18T01:25:14.695120+0000","last_became_peered":"2024-09-18T01:25:14.695120+0000","last_unstale":"2024-09-18T01:25:43.843880+0000","last_undegraded":"2024-09-18T01:25:43.843880+0000","last_fullsized":"2024-09-18T01:25:43.843880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:18.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'5","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153256+0000","last_change":"2024-09-18T01:25:08.678193+0000","last_active":"2024-09-18T01:28:17.153256+0000","last_peered":"2024-09-18T01:28:17.153256+0000","last_clean":"2024-09-18T01:28:17.153256+0000","last_became_active":"2024-09-18T01:25:08.677941+0000","last_became_peered":"2024-09-18T01:25:08.677941+0000","last_unstale":"2024-09-18T01:28:17.153256+0000","last_undegraded":"2024-09-18T01:28:17.153256+0000","last_fullsized":"2024-09-18T01:28:17.153256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:50:00.350138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.086109+0000","last_change":"2024-09-18T01:25:06.695779+0000","last_active":"2024-09-18T01:28:17.086109+0000","last_peered":"2024-09-18T01:28:17.086109+0000","last_clean":"2024-09-18T01:28:17.086109+0000","last_became_active":"2024-09-18T01:25:06.692823+0000","last_became_peered":"2024-09-18T01:25:06.692823+0000","last_unstale":"2024-09-18T01:28:17.086109+0000","last_undegraded":"2024-09-18T01:28:17.086109+0000","last_fullsized":"2024-09-18T01:28:17.086109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:25:48.076699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845675+0000","last_change":"2024-09-18T01:25:10.677782+0000","last_active":"2024-09-18T01:25:43.845675+0000","last_peered":"2024-09-18T01:25:43.845675+0000","last_clean":"2024-09-18T01:25:43.845675+0000","last_became_active":"2024-09-18T01:25:10.677481+0000","last_became_peered":"2024-09-18T01:25:10.677481+0000","last_unstale":"2024-09-18T01:25:43.845675+0000","last_undegraded":"2024-09-18T01:25:43.845675+0000","last_fullsized":"2024-09-18T01:25:43.845675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:01.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'61","reported_seq":123,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.074592+0000","last_change":"2024-09-18T01:25:12.687399+0000","last_active":"2024-09-18T01:27:15.074592+0000","last_peered":"2024-09-18T01:27:15.074592+0000","last_clean":"2024-09-18T01:27:15.074592+0000","last_became_active":"2024-09-18T01:25:12.687014+0000","last_became_peered":"2024-09-18T01:25:12.687014+0000","last_unstale":"2024-09-18T01:27:15.074592+0000","last_undegraded":"2024-09-18T01:27:15.074592+0000","last_fullsized":"2024-09-18T01:27:15.074592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:35.687671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843869+0000","last_change":"2024-09-18T01:25:14.699051+0000","last_active":"2024-09-18T01:25:43.843869+0000","last_peered":"2024-09-18T01:25:43.843869+0000","last_clean":"2024-09-18T01:25:43.843869+0000","last_became_active":"2024-09-18T01:25:14.698753+0000","last_became_peered":"2024-09-18T01:25:14.698753+0000","last_unstale":"2024-09-18T01:25:43.843869+0000","last_undegraded":"2024-09-18T01:25:43.843869+0000","last_fullsized":"2024-09-18T01:25:43.843869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:55.060343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'20","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.149094+0000","last_change":"2024-09-18T01:25:16.714340+0000","last_active":"2024-09-18T01:28:17.149094+0000","last_peered":"2024-09-18T01:28:17.149094+0000","last_clean":"2024-09-18T01:28:17.149094+0000","last_became_active":"2024-09-18T01:25:16.713750+0000","last_became_peered":"2024-09-18T01:25:16.713750+0000","last_unstale":"2024-09-18T01:28:17.149094+0000","last_undegraded":"2024-09-18T01:28:17.149094+0000","last_fullsized":"2024-09-18T01:28:17.149094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:00:32.755321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097065+0000","last_change":"2024-09-18T01:25:08.681356+0000","last_active":"2024-09-18T01:28:17.097065+0000","last_peered":"2024-09-18T01:28:17.097065+0000","last_clean":"2024-09-18T01:28:17.097065+0000","last_became_active":"2024-09-18T01:25:08.680604+0000","last_became_peered":"2024-09-18T01:25:08.680604+0000","last_unstale":"2024-09-18T01:28:17.097065+0000","last_undegraded":"2024-09-18T01:28:17.097065+0000","last_fullsized":"2024-09-18T01:28:17.097065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:58.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903568+0000","last_change":"2024-09-18T01:25:06.688269+0000","last_active":"2024-09-18T01:25:43.903568+0000","last_peered":"2024-09-18T01:25:43.903568+0000","last_clean":"2024-09-18T01:25:43.903568+0000","last_became_active":"2024-09-18T01:25:06.686125+0000","last_became_peered":"2024-09-18T01:25:06.686125+0000","last_unstale":"2024-09-18T01:25:43.903568+0000","last_undegraded":"2024-09-18T01:25:43.903568+0000","last_fullsized":"2024-09-18T01:25:43.903568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:36.036192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":237,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.683880+0000","last_change":"2024-09-18T01:25:43.912490+0000","last_active":"2024-09-18T01:28:23.683880+0000","last_peered":"2024-09-18T01:28:23.683880+0000","last_clean":"2024-09-18T01:28:23.683880+0000","last_became_active":"2024-09-18T01:25:43.908273+0000","last_became_peered":"2024-09-18T01:25:43.908273+0000","last_unstale":"2024-09-18T01:28:23.683880+0000","last_undegraded":"2024-09-18T01:28:23.683880+0000","last_fullsized":"2024-09-18T01:28:23.683880+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:43.161322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'39","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.801265+0000","last_change":"2024-09-18T01:25:12.693001+0000","last_active":"2024-09-18T01:28:23.801265+0000","last_peered":"2024-09-18T01:28:23.801265+0000","last_clean":"2024-09-18T01:28:23.801265+0000","last_became_active":"2024-09-18T01:25:12.692486+0000","last_became_peered":"2024-09-18T01:25:12.692486+0000","last_unstale":"2024-09-18T01:28:23.801265+0000","last_undegraded":"2024-09-18T01:28:23.801265+0000","last_fullsized":"2024-09-18T01:28:23.801265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:55:54.041872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904750+0000","last_change":"2024-09-18T01:25:14.710345+0000","last_active":"2024-09-18T01:25:43.904750+0000","last_peered":"2024-09-18T01:25:43.904750+0000","last_clean":"2024-09-18T01:25:43.904750+0000","last_became_active":"2024-09-18T01:25:14.709980+0000","last_became_peered":"2024-09-18T01:25:14.709980+0000","last_unstale":"2024-09-18T01:25:43.904750+0000","last_undegraded":"2024-09-18T01:25:43.904750+0000","last_fullsized":"2024-09-18T01:25:43.904750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:57.575198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848068+0000","last_change":"2024-09-18T01:25:16.709176+0000","last_active":"2024-09-18T01:25:43.848068+0000","last_peered":"2024-09-18T01:25:43.848068+0000","last_clean":"2024-09-18T01:25:43.848068+0000","last_became_active":"2024-09-18T01:25:16.708905+0000","last_became_peered":"2024-09-18T01:25:16.708905+0000","last_unstale":"2024-09-18T01:25:43.848068+0000","last_undegraded":"2024-09-18T01:25:43.848068+0000","last_fullsized":"2024-09-18T01:25:43.848068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:47:16.419410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.484946+0000","last_change":"2024-09-18T01:25:08.688875+0000","last_active":"2024-09-18T01:27:16.484946+0000","last_peered":"2024-09-18T01:27:16.484946+0000","last_clean":"2024-09-18T01:27:16.484946+0000","last_became_active":"2024-09-18T01:25:08.688610+0000","last_became_peered":"2024-09-18T01:25:08.688610+0000","last_unstale":"2024-09-18T01:27:16.484946+0000","last_undegraded":"2024-09-18T01:27:16.484946+0000","last_fullsized":"2024-09-18T01:27:16.484946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:31:14.516270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904539+0000","last_change":"2024-09-18T01:25:06.685750+0000","last_active":"2024-09-18T01:25:43.904539+0000","last_peered":"2024-09-18T01:25:43.904539+0000","last_clean":"2024-09-18T01:25:43.904539+0000","last_became_active":"2024-09-18T01:25:06.685167+0000","last_became_peered":"2024-09-18T01:25:06.685167+0000","last_unstale":"2024-09-18T01:25:43.904539+0000","last_undegraded":"2024-09-18T01:25:43.904539+0000","last_fullsized":"2024-09-18T01:25:43.904539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:39:53.953032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845066+0000","last_change":"2024-09-18T01:25:10.678850+0000","last_active":"2024-09-18T01:25:43.845066+0000","last_peered":"2024-09-18T01:25:43.845066+0000","last_clean":"2024-09-18T01:25:43.845066+0000","last_became_active":"2024-09-18T01:25:10.678586+0000","last_became_peered":"2024-09-18T01:25:10.678586+0000","last_unstale":"2024-09-18T01:25:43.845066+0000","last_undegraded":"2024-09-18T01:25:43.845066+0000","last_fullsized":"2024-09-18T01:25:43.845066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:12.616019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'38","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.072271+0000","last_change":"2024-09-18T01:25:12.688276+0000","last_active":"2024-09-18T01:27:15.072271+0000","last_peered":"2024-09-18T01:27:15.072271+0000","last_clean":"2024-09-18T01:27:15.072271+0000","last_became_active":"2024-09-18T01:25:12.687935+0000","last_became_peered":"2024-09-18T01:25:12.687935+0000","last_unstale":"2024-09-18T01:27:15.072271+0000","last_undegraded":"2024-09-18T01:27:15.072271+0000","last_fullsized":"2024-09-18T01:27:15.072271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:46.957372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845272+0000","last_change":"2024-09-18T01:25:14.701993+0000","last_active":"2024-09-18T01:25:43.845272+0000","last_peered":"2024-09-18T01:25:43.845272+0000","last_clean":"2024-09-18T01:25:43.845272+0000","last_became_active":"2024-09-18T01:25:14.701702+0000","last_became_peered":"2024-09-18T01:25:14.701702+0000","last_unstale":"2024-09-18T01:25:43.845272+0000","last_undegraded":"2024-09-18T01:25:43.845272+0000","last_fullsized":"2024-09-18T01:25:43.845272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:44:32.330079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.480417+0000","last_change":"2024-09-18T01:25:16.716015+0000","last_active":"2024-09-18T01:27:16.480417+0000","last_peered":"2024-09-18T01:27:16.480417+0000","last_clean":"2024-09-18T01:27:16.480417+0000","last_became_active":"2024-09-18T01:25:16.715669+0000","last_became_peered":"2024-09-18T01:25:16.715669+0000","last_unstale":"2024-09-18T01:27:16.480417+0000","last_undegraded":"2024-09-18T01:27:16.480417+0000","last_fullsized":"2024-09-18T01:27:16.480417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:36.833223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"35'15","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153107+0000","last_change":"2024-09-18T01:25:08.672922+0000","last_active":"2024-09-18T01:28:17.153107+0000","last_peered":"2024-09-18T01:28:17.153107+0000","last_clean":"2024-09-18T01:28:17.153107+0000","last_became_active":"2024-09-18T01:25:08.672541+0000","last_became_peered":"2024-09-18T01:25:08.672541+0000","last_unstale":"2024-09-18T01:28:17.153107+0000","last_undegraded":"2024-09-18T01:28:17.153107+0000","last_fullsized":"2024-09-18T01:28:17.153107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:39.586169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.850020+0000","last_change":"2024-09-18T01:25:06.687447+0000","last_active":"2024-09-18T01:25:43.850020+0000","last_peered":"2024-09-18T01:25:43.850020+0000","last_clean":"2024-09-18T01:25:43.850020+0000","last_became_active":"2024-09-18T01:25:06.684658+0000","last_became_peered":"2024-09-18T01:25:06.684658+0000","last_unstale":"2024-09-18T01:25:43.850020+0000","last_undegraded":"2024-09-18T01:25:43.850020+0000","last_fullsized":"2024-09-18T01:25:43.850020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:33:25.718581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905255+0000","last_change":"2024-09-18T01:25:10.679752+0000","last_active":"2024-09-18T01:25:43.905255+0000","last_peered":"2024-09-18T01:25:43.905255+0000","last_clean":"2024-09-18T01:25:43.905255+0000","last_became_active":"2024-09-18T01:25:10.679369+0000","last_became_peered":"2024-09-18T01:25:10.679369+0000","last_unstale":"2024-09-18T01:25:43.905255+0000","last_undegraded":"2024-09-18T01:25:43.905255+0000","last_fullsized":"2024-09-18T01:25:43.905255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:03:35.620140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'16","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851610+0000","last_change":"2024-09-18T01:25:12.697092+0000","last_active":"2024-09-18T01:25:43.851610+0000","last_peered":"2024-09-18T01:25:43.851610+0000","last_clean":"2024-09-18T01:25:43.851610+0000","last_became_active":"2024-09-18T01:25:12.696757+0000","last_became_peered":"2024-09-18T01:25:12.696757+0000","last_unstale":"2024-09-18T01:25:43.851610+0000","last_undegraded":"2024-09-18T01:25:43.851610+0000","last_fullsized":"2024-09-18T01:25:43.851610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:43:07.633393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":375,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.709278+0000","last_change":"2024-09-18T01:25:14.709994+0000","last_active":"2024-09-18T01:28:23.709278+0000","last_peered":"2024-09-18T01:28:23.709278+0000","last_clean":"2024-09-18T01:28:23.709278+0000","last_became_active":"2024-09-18T01:25:14.708840+0000","last_became_peered":"2024-09-18T01:25:14.708840+0000","last_unstale":"2024-09-18T01:28:23.709278+0000","last_undegraded":"2024-09-18T01:28:23.709278+0000","last_fullsized":"2024-09-18T01:28:23.709278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:58.015878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847427+0000","last_change":"2024-09-18T01:25:16.707474+0000","last_active":"2024-09-18T01:25:43.847427+0000","last_peered":"2024-09-18T01:25:43.847427+0000","last_clean":"2024-09-18T01:25:43.847427+0000","last_became_active":"2024-09-18T01:25:16.706764+0000","last_became_peered":"2024-09-18T01:25:16.706764+0000","last_unstale":"2024-09-18T01:25:43.847427+0000","last_undegraded":"2024-09-18T01:25:43.847427+0000","last_fullsized":"2024-09-18T01:25:43.847427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:36.072052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.486245+0000","last_change":"2024-09-18T01:25:08.670258+0000","last_active":"2024-09-18T01:27:16.486245+0000","last_peered":"2024-09-18T01:27:16.486245+0000","last_clean":"2024-09-18T01:27:16.486245+0000","last_became_active":"2024-09-18T01:25:08.669920+0000","last_became_peered":"2024-09-18T01:25:08.669920+0000","last_unstale":"2024-09-18T01:27:16.486245+0000","last_undegraded":"2024-09-18T01:27:16.486245+0000","last_fullsized":"2024-09-18T01:27:16.486245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:54:53.349504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905430+0000","last_change":"2024-09-18T01:25:06.685435+0000","last_active":"2024-09-18T01:25:43.905430+0000","last_peered":"2024-09-18T01:25:43.905430+0000","last_clean":"2024-09-18T01:25:43.905430+0000","last_became_active":"2024-09-18T01:25:06.684984+0000","last_became_peered":"2024-09-18T01:25:06.684984+0000","last_unstale":"2024-09-18T01:25:43.905430+0000","last_undegraded":"2024-09-18T01:25:43.905430+0000","last_fullsized":"2024-09-18T01:25:43.905430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:18.475907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904219+0000","last_change":"2024-09-18T01:25:10.679758+0000","last_active":"2024-09-18T01:25:43.904219+0000","last_peered":"2024-09-18T01:25:43.904219+0000","last_clean":"2024-09-18T01:25:43.904219+0000","last_became_active":"2024-09-18T01:25:10.679468+0000","last_became_peered":"2024-09-18T01:25:10.679468+0000","last_unstale":"2024-09-18T01:25:43.904219+0000","last_undegraded":"2024-09-18T01:25:43.904219+0000","last_fullsized":"2024-09-18T01:25:43.904219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:13:07.466593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'63","reported_seq":136,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.772742+0000","last_change":"2024-09-18T01:25:12.689122+0000","last_active":"2024-09-18T01:28:23.772742+0000","last_peered":"2024-09-18T01:28:23.772742+0000","last_clean":"2024-09-18T01:28:23.772742+0000","last_became_active":"2024-09-18T01:25:12.688618+0000","last_became_peered":"2024-09-18T01:25:12.688618+0000","last_unstale":"2024-09-18T01:28:23.772742+0000","last_undegraded":"2024-09-18T01:28:23.772742+0000","last_fullsized":"2024-09-18T01:28:23.772742+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:35.826990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843695+0000","last_change":"2024-09-18T01:25:14.707373+0000","last_active":"2024-09-18T01:25:43.843695+0000","last_peered":"2024-09-18T01:25:43.843695+0000","last_clean":"2024-09-18T01:25:43.843695+0000","last_became_active":"2024-09-18T01:25:14.706586+0000","last_became_peered":"2024-09-18T01:25:14.706586+0000","last_unstale":"2024-09-18T01:25:43.843695+0000","last_undegraded":"2024-09-18T01:25:43.843695+0000","last_fullsized":"2024-09-18T01:25:43.843695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:04:52.409201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.907198+0000","last_change":"2024-09-18T01:25:16.714536+0000","last_active":"2024-09-18T01:25:43.907198+0000","last_peered":"2024-09-18T01:25:43.907198+0000","last_clean":"2024-09-18T01:25:43.907198+0000","last_became_active":"2024-09-18T01:25:16.713789+0000","last_became_peered":"2024-09-18T01:25:16.713789+0000","last_unstale":"2024-09-18T01:25:43.907198+0000","last_undegraded":"2024-09-18T01:25:43.907198+0000","last_fullsized":"2024-09-18T01:25:43.907198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:32:22.558708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176266+0000","last_change":"2024-09-18T01:25:08.670550+0000","last_active":"2024-09-18T01:28:17.176266+0000","last_peered":"2024-09-18T01:28:17.176266+0000","last_clean":"2024-09-18T01:28:17.176266+0000","last_became_active":"2024-09-18T01:25:08.670268+0000","last_became_peered":"2024-09-18T01:25:08.670268+0000","last_unstale":"2024-09-18T01:28:17.176266+0000","last_undegraded":"2024-09-18T01:28:17.176266+0000","last_fullsized":"2024-09-18T01:28:17.176266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:41.660195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.802270+0000","last_change":"2024-09-18T01:25:06.689500+0000","last_active":"2024-09-18T01:28:16.802270+0000","last_peered":"2024-09-18T01:28:16.802270+0000","last_clean":"2024-09-18T01:28:16.802270+0000","last_became_active":"2024-09-18T01:25:06.687382+0000","last_became_peered":"2024-09-18T01:25:06.687382+0000","last_unstale":"2024-09-18T01:28:16.802270+0000","last_undegraded":"2024-09-18T01:28:16.802270+0000","last_fullsized":"2024-09-18T01:28:16.802270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:30:33.161052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845025+0000","last_change":"2024-09-18T01:25:10.682652+0000","last_active":"2024-09-18T01:25:43.845025+0000","last_peered":"2024-09-18T01:25:43.845025+0000","last_clean":"2024-09-18T01:25:43.845025+0000","last_became_active":"2024-09-18T01:25:10.682337+0000","last_became_peered":"2024-09-18T01:25:10.682337+0000","last_unstale":"2024-09-18T01:25:43.845025+0000","last_undegraded":"2024-09-18T01:25:43.845025+0000","last_fullsized":"2024-09-18T01:25:43.845025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:07.622864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'36","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.046668+0000","last_change":"2024-09-18T01:25:12.693400+0000","last_active":"2024-09-18T01:27:15.046668+0000","last_peered":"2024-09-18T01:27:15.046668+0000","last_clean":"2024-09-18T01:27:15.046668+0000","last_became_active":"2024-09-18T01:25:12.693129+0000","last_became_peered":"2024-09-18T01:25:12.693129+0000","last_unstale":"2024-09-18T01:27:15.046668+0000","last_undegraded":"2024-09-18T01:27:15.046668+0000","last_fullsized":"2024-09-18T01:27:15.046668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:02:54.566116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.847932+0000","last_change":"2024-09-18T01:25:14.707262+0000","last_active":"2024-09-18T01:25:43.847932+0000","last_peered":"2024-09-18T01:25:43.847932+0000","last_clean":"2024-09-18T01:25:43.847932+0000","last_became_active":"2024-09-18T01:25:14.706325+0000","last_became_peered":"2024-09-18T01:25:14.706325+0000","last_unstale":"2024-09-18T01:25:43.847932+0000","last_undegraded":"2024-09-18T01:25:43.847932+0000","last_fullsized":"2024-09-18T01:25:43.847932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:31.363572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851735+0000","last_change":"2024-09-18T01:25:16.716357+0000","last_active":"2024-09-18T01:25:43.851735+0000","last_peered":"2024-09-18T01:25:43.851735+0000","last_clean":"2024-09-18T01:25:43.851735+0000","last_became_active":"2024-09-18T01:25:16.716084+0000","last_became_peered":"2024-09-18T01:25:16.716084+0000","last_unstale":"2024-09-18T01:25:43.851735+0000","last_undegraded":"2024-09-18T01:25:43.851735+0000","last_fullsized":"2024-09-18T01:25:43.851735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:49:46.781345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.848361+0000","last_change":"2024-09-18T01:25:08.678786+0000","last_active":"2024-09-18T01:25:43.848361+0000","last_peered":"2024-09-18T01:25:43.848361+0000","last_clean":"2024-09-18T01:25:43.848361+0000","last_became_active":"2024-09-18T01:25:08.678539+0000","last_became_peered":"2024-09-18T01:25:08.678539+0000","last_unstale":"2024-09-18T01:25:43.848361+0000","last_undegraded":"2024-09-18T01:25:43.848361+0000","last_fullsized":"2024-09-18T01:25:43.848361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:26:37.929696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846243+0000","last_change":"2024-09-18T01:25:06.682960+0000","last_active":"2024-09-18T01:25:43.846243+0000","last_peered":"2024-09-18T01:25:43.846243+0000","last_clean":"2024-09-18T01:25:43.846243+0000","last_became_active":"2024-09-18T01:25:06.682592+0000","last_became_peered":"2024-09-18T01:25:06.682592+0000","last_unstale":"2024-09-18T01:25:43.846243+0000","last_undegraded":"2024-09-18T01:25:43.846243+0000","last_fullsized":"2024-09-18T01:25:43.846243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:39.148193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.903424+0000","last_change":"2024-09-18T01:25:10.684259+0000","last_active":"2024-09-18T01:25:43.903424+0000","last_peered":"2024-09-18T01:25:43.903424+0000","last_clean":"2024-09-18T01:25:43.903424+0000","last_became_active":"2024-09-18T01:25:10.683833+0000","last_became_peered":"2024-09-18T01:25:10.683833+0000","last_unstale":"2024-09-18T01:25:43.903424+0000","last_undegraded":"2024-09-18T01:25:43.903424+0000","last_fullsized":"2024-09-18T01:25:43.903424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:01.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'35","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.849092+0000","last_change":"2024-09-18T01:25:12.693138+0000","last_active":"2024-09-18T01:28:23.849092+0000","last_peered":"2024-09-18T01:28:23.849092+0000","last_clean":"2024-09-18T01:28:23.849092+0000","last_became_active":"2024-09-18T01:25:12.691752+0000","last_became_peered":"2024-09-18T01:25:12.691752+0000","last_unstale":"2024-09-18T01:28:23.849092+0000","last_undegraded":"2024-09-18T01:28:23.849092+0000","last_fullsized":"2024-09-18T01:28:23.849092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:47:16.533005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849229+0000","last_change":"2024-09-18T01:25:14.711982+0000","last_active":"2024-09-18T01:25:43.849229+0000","last_peered":"2024-09-18T01:25:43.849229+0000","last_clean":"2024-09-18T01:25:43.849229+0000","last_became_active":"2024-09-18T01:25:14.711635+0000","last_became_peered":"2024-09-18T01:25:14.711635+0000","last_unstale":"2024-09-18T01:25:43.849229+0000","last_undegraded":"2024-09-18T01:25:43.849229+0000","last_fullsized":"2024-09-18T01:25:43.849229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:51:20.322887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.080053+0000","last_change":"2024-09-18T01:25:16.715865+0000","last_active":"2024-09-18T01:27:15.080053+0000","last_peered":"2024-09-18T01:27:15.080053+0000","last_clean":"2024-09-18T01:27:15.080053+0000","last_became_active":"2024-09-18T01:25:16.715581+0000","last_became_peered":"2024-09-18T01:25:16.715581+0000","last_unstale":"2024-09-18T01:27:15.080053+0000","last_undegraded":"2024-09-18T01:27:15.080053+0000","last_fullsized":"2024-09-18T01:27:15.080053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:23.172601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'8","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176264+0000","last_change":"2024-09-18T01:25:08.669854+0000","last_active":"2024-09-18T01:28:17.176264+0000","last_peered":"2024-09-18T01:28:17.176264+0000","last_clean":"2024-09-18T01:28:17.176264+0000","last_became_active":"2024-09-18T01:25:08.668430+0000","last_became_peered":"2024-09-18T01:25:08.668430+0000","last_unstale":"2024-09-18T01:28:17.176264+0000","last_undegraded":"2024-09-18T01:28:17.176264+0000","last_fullsized":"2024-09-18T01:28:17.176264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:43:08.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.906927+0000","last_change":"2024-09-18T01:25:06.687779+0000","last_active":"2024-09-18T01:25:43.906927+0000","last_peered":"2024-09-18T01:25:43.906927+0000","last_clean":"2024-09-18T01:25:43.906927+0000","last_became_active":"2024-09-18T01:25:06.686394+0000","last_became_peered":"2024-09-18T01:25:06.686394+0000","last_unstale":"2024-09-18T01:25:43.906927+0000","last_undegraded":"2024-09-18T01:25:43.906927+0000","last_fullsized":"2024-09-18T01:25:43.906927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:53.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.760367+0000","last_change":"2024-09-18T01:25:10.683660+0000","last_active":"2024-09-18T01:27:13.760367+0000","last_peered":"2024-09-18T01:27:13.760367+0000","last_clean":"2024-09-18T01:27:13.760367+0000","last_became_active":"2024-09-18T01:25:10.683351+0000","last_became_peered":"2024-09-18T01:25:10.683351+0000","last_unstale":"2024-09-18T01:27:13.760367+0000","last_undegraded":"2024-09-18T01:27:13.760367+0000","last_fullsized":"2024-09-18T01:27:13.760367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:13.973263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'48","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.865856+0000","last_change":"2024-09-18T01:25:12.692015+0000","last_active":"2024-09-18T01:28:23.865856+0000","last_peered":"2024-09-18T01:28:23.865856+0000","last_clean":"2024-09-18T01:28:23.865856+0000","last_became_active":"2024-09-18T01:25:12.691715+0000","last_became_peered":"2024-09-18T01:25:12.691715+0000","last_unstale":"2024-09-18T01:28:23.865856+0000","last_undegraded":"2024-09-18T01:28:23.865856+0000","last_fullsized":"2024-09-18T01:28:23.865856+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:52:06.633359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844813+0000","last_change":"2024-09-18T01:25:14.707331+0000","last_active":"2024-09-18T01:25:43.844813+0000","last_peered":"2024-09-18T01:25:43.844813+0000","last_clean":"2024-09-18T01:25:43.844813+0000","last_became_active":"2024-09-18T01:25:14.706398+0000","last_became_peered":"2024-09-18T01:25:14.706398+0000","last_unstale":"2024-09-18T01:25:43.844813+0000","last_undegraded":"2024-09-18T01:25:43.844813+0000","last_fullsized":"2024-09-18T01:25:43.844813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:01:53.638099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:15.082692+0000","last_change":"2024-09-18T01:25:16.714114+0000","last_active":"2024-09-18T01:27:15.082692+0000","last_peered":"2024-09-18T01:27:15.082692+0000","last_clean":"2024-09-18T01:27:15.082692+0000","last_became_active":"2024-09-18T01:25:16.713579+0000","last_became_peered":"2024-09-18T01:25:16.713579+0000","last_unstale":"2024-09-18T01:27:15.082692+0000","last_undegraded":"2024-09-18T01:27:15.082692+0000","last_fullsized":"2024-09-18T01:27:15.082692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:14.993371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'8","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176775+0000","last_change":"2024-09-18T01:25:08.686807+0000","last_active":"2024-09-18T01:28:17.176775+0000","last_peered":"2024-09-18T01:28:17.176775+0000","last_clean":"2024-09-18T01:28:17.176775+0000","last_became_active":"2024-09-18T01:25:08.686645+0000","last_became_peered":"2024-09-18T01:25:08.686645+0000","last_unstale":"2024-09-18T01:28:17.176775+0000","last_undegraded":"2024-09-18T01:28:17.176775+0000","last_fullsized":"2024-09-18T01:28:17.176775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:25:13.805489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.842839+0000","last_change":"2024-09-18T01:25:06.703432+0000","last_active":"2024-09-18T01:25:43.842839+0000","last_peered":"2024-09-18T01:25:43.842839+0000","last_clean":"2024-09-18T01:25:43.842839+0000","last_became_active":"2024-09-18T01:25:06.702991+0000","last_became_peered":"2024-09-18T01:25:06.702991+0000","last_unstale":"2024-09-18T01:25:43.842839+0000","last_undegraded":"2024-09-18T01:25:43.842839+0000","last_fullsized":"2024-09-18T01:25:43.842839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:05.206190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176373+0000","last_change":"2024-09-18T01:25:08.673285+0000","last_active":"2024-09-18T01:28:17.176373+0000","last_peered":"2024-09-18T01:28:17.176373+0000","last_clean":"2024-09-18T01:28:17.176373+0000","last_became_active":"2024-09-18T01:25:08.672983+0000","last_became_peered":"2024-09-18T01:25:08.672983+0000","last_unstale":"2024-09-18T01:28:17.176373+0000","last_undegraded":"2024-09-18T01:28:17.176373+0000","last_fullsized":"2024-09-18T01:28:17.176373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:17.472878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.843899+0000","last_change":"2024-09-18T01:25:06.681343+0000","last_active":"2024-09-18T01:25:43.843899+0000","last_peered":"2024-09-18T01:25:43.843899+0000","last_clean":"2024-09-18T01:25:43.843899+0000","last_became_active":"2024-09-18T01:25:06.680853+0000","last_became_peered":"2024-09-18T01:25:06.680853+0000","last_unstale":"2024-09-18T01:25:43.843899+0000","last_undegraded":"2024-09-18T01:25:43.843899+0000","last_fullsized":"2024-09-18T01:25:43.843899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:16.022647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'8","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.941003+0000","last_change":"2024-09-18T01:25:08.682876+0000","last_active":"2024-09-18T01:26:32.941003+0000","last_peered":"2024-09-18T01:26:32.941003+0000","last_clean":"2024-09-18T01:26:32.941003+0000","last_became_active":"2024-09-18T01:25:08.682254+0000","last_became_peered":"2024-09-18T01:25:08.682254+0000","last_unstale":"2024-09-18T01:26:32.941003+0000","last_undegraded":"2024-09-18T01:26:32.941003+0000","last_fullsized":"2024-09-18T01:26:32.941003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:32:31.867039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.849439+0000","last_change":"2024-09-18T01:25:06.684384+0000","last_active":"2024-09-18T01:25:43.849439+0000","last_peered":"2024-09-18T01:25:43.849439+0000","last_clean":"2024-09-18T01:25:43.849439+0000","last_became_active":"2024-09-18T01:25:06.682878+0000","last_became_peered":"2024-09-18T01:25:06.682878+0000","last_unstale":"2024-09-18T01:25:43.849439+0000","last_undegraded":"2024-09-18T01:25:43.849439+0000","last_fullsized":"2024-09-18T01:25:43.849439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:16:23.251760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.144979+0000","last_change":"2024-09-18T01:25:08.673238+0000","last_active":"2024-09-18T01:28:17.144979+0000","last_peered":"2024-09-18T01:28:17.144979+0000","last_clean":"2024-09-18T01:28:17.144979+0000","last_became_active":"2024-09-18T01:25:08.672574+0000","last_became_peered":"2024-09-18T01:25:08.672574+0000","last_unstale":"2024-09-18T01:28:17.144979+0000","last_undegraded":"2024-09-18T01:28:17.144979+0000","last_fullsized":"2024-09-18T01:28:17.144979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:41.660195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.846440+0000","last_change":"2024-09-18T01:25:06.681262+0000","last_active":"2024-09-18T01:25:43.846440+0000","last_peered":"2024-09-18T01:25:43.846440+0000","last_clean":"2024-09-18T01:25:43.846440+0000","last_became_active":"2024-09-18T01:25:06.680712+0000","last_became_peered":"2024-09-18T01:25:06.680712+0000","last_unstale":"2024-09-18T01:25:43.846440+0000","last_undegraded":"2024-09-18T01:25:43.846440+0000","last_fullsized":"2024-09-18T01:25:43.846440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:36:03.343944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'5","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.394294+0000","last_change":"2024-09-18T01:25:08.671686+0000","last_active":"2024-09-18T01:27:13.394294+0000","last_peered":"2024-09-18T01:27:13.394294+0000","last_clean":"2024-09-18T01:27:13.394294+0000","last_became_active":"2024-09-18T01:25:08.671408+0000","last_became_peered":"2024-09-18T01:25:08.671408+0000","last_unstale":"2024-09-18T01:27:13.394294+0000","last_undegraded":"2024-09-18T01:27:13.394294+0000","last_fullsized":"2024-09-18T01:27:13.394294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:19.129968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845199+0000","last_change":"2024-09-18T01:25:06.683019+0000","last_active":"2024-09-18T01:25:43.845199+0000","last_peered":"2024-09-18T01:25:43.845199+0000","last_clean":"2024-09-18T01:25:43.845199+0000","last_became_active":"2024-09-18T01:25:06.682577+0000","last_became_peered":"2024-09-18T01:25:06.682577+0000","last_unstale":"2024-09-18T01:25:43.845199+0000","last_undegraded":"2024-09-18T01:25:43.845199+0000","last_fullsized":"2024-09-18T01:25:43.845199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:53.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'8","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954296+0000","last_change":"2024-09-18T01:25:08.688824+0000","last_active":"2024-09-18T01:28:16.954296+0000","last_peered":"2024-09-18T01:28:16.954296+0000","last_clean":"2024-09-18T01:28:16.954296+0000","last_became_active":"2024-09-18T01:25:08.687797+0000","last_became_peered":"2024-09-18T01:25:08.687797+0000","last_unstale":"2024-09-18T01:28:16.954296+0000","last_undegraded":"2024-09-18T01:28:16.954296+0000","last_fullsized":"2024-09-18T01:28:16.954296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:43:40.299678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.905421+0000","last_change":"2024-09-18T01:25:06.687325+0000","last_active":"2024-09-18T01:25:43.905421+0000","last_peered":"2024-09-18T01:25:43.905421+0000","last_clean":"2024-09-18T01:25:43.905421+0000","last_became_active":"2024-09-18T01:25:06.686154+0000","last_became_peered":"2024-09-18T01:25:06.686154+0000","last_unstale":"2024-09-18T01:25:43.905421+0000","last_undegraded":"2024-09-18T01:25:43.905421+0000","last_fullsized":"2024-09-18T01:25:43.905421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:24.579150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176363+0000","last_change":"2024-09-18T01:25:08.681610+0000","last_active":"2024-09-18T01:28:17.176363+0000","last_peered":"2024-09-18T01:28:17.176363+0000","last_clean":"2024-09-18T01:28:17.176363+0000","last_became_active":"2024-09-18T01:25:08.680947+0000","last_became_peered":"2024-09-18T01:25:08.680947+0000","last_unstale":"2024-09-18T01:28:17.176363+0000","last_undegraded":"2024-09-18T01:28:17.176363+0000","last_fullsized":"2024-09-18T01:28:17.176363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:41.267347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.845952+0000","last_change":"2024-09-18T01:25:06.704000+0000","last_active":"2024-09-18T01:25:43.845952+0000","last_peered":"2024-09-18T01:25:43.845952+0000","last_clean":"2024-09-18T01:25:43.845952+0000","last_became_active":"2024-09-18T01:25:06.703622+0000","last_became_peered":"2024-09-18T01:25:06.703622+0000","last_unstale":"2024-09-18T01:25:43.845952+0000","last_undegraded":"2024-09-18T01:25:43.845952+0000","last_fullsized":"2024-09-18T01:25:43.845952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:33:48.652888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'6","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.142304+0000","last_change":"2024-09-18T01:25:08.682682+0000","last_active":"2024-09-18T01:28:17.142304+0000","last_peered":"2024-09-18T01:28:17.142304+0000","last_clean":"2024-09-18T01:28:17.142304+0000","last_became_active":"2024-09-18T01:25:08.682143+0000","last_became_peered":"2024-09-18T01:25:08.682143+0000","last_unstale":"2024-09-18T01:28:17.142304+0000","last_undegraded":"2024-09-18T01:28:17.142304+0000","last_fullsized":"2024-09-18T01:28:17.142304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:10.604887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.435644+0000","last_change":"2024-09-18T01:25:06.687744+0000","last_active":"2024-09-18T01:25:50.435644+0000","last_peered":"2024-09-18T01:25:50.435644+0000","last_clean":"2024-09-18T01:25:50.435644+0000","last_became_active":"2024-09-18T01:25:06.687436+0000","last_became_peered":"2024-09-18T01:25:06.687436+0000","last_unstale":"2024-09-18T01:25:50.435644+0000","last_undegraded":"2024-09-18T01:25:50.435644+0000","last_fullsized":"2024-09-18T01:25:50.435644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:08.432830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'14","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097381+0000","last_change":"2024-09-18T01:25:08.676069+0000","last_active":"2024-09-18T01:28:17.097381+0000","last_peered":"2024-09-18T01:28:17.097381+0000","last_clean":"2024-09-18T01:28:17.097381+0000","last_became_active":"2024-09-18T01:25:08.675801+0000","last_became_peered":"2024-09-18T01:25:08.675801+0000","last_unstale":"2024-09-18T01:28:17.097381+0000","last_undegraded":"2024-09-18T01:28:17.097381+0000","last_fullsized":"2024-09-18T01:28:17.097381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:27.055282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:50.439101+0000","last_change":"2024-09-18T01:25:06.693564+0000","last_active":"2024-09-18T01:25:50.439101+0000","last_peered":"2024-09-18T01:25:50.439101+0000","last_clean":"2024-09-18T01:25:50.439101+0000","last_became_active":"2024-09-18T01:25:06.691345+0000","last_became_peered":"2024-09-18T01:25:06.691345+0000","last_unstale":"2024-09-18T01:25:50.439101+0000","last_undegraded":"2024-09-18T01:25:50.439101+0000","last_fullsized":"2024-09-18T01:25:50.439101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:23:21.828422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'16","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097074+0000","last_change":"2024-09-18T01:25:08.685632+0000","last_active":"2024-09-18T01:28:17.097074+0000","last_peered":"2024-09-18T01:28:17.097074+0000","last_clean":"2024-09-18T01:28:17.097074+0000","last_became_active":"2024-09-18T01:25:08.685358+0000","last_became_peered":"2024-09-18T01:25:08.685358+0000","last_unstale":"2024-09-18T01:28:17.097074+0000","last_undegraded":"2024-09-18T01:28:17.097074+0000","last_fullsized":"2024-09-18T01:28:17.097074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:56:00.059201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844121+0000","last_change":"2024-09-18T01:25:06.696372+0000","last_active":"2024-09-18T01:25:43.844121+0000","last_peered":"2024-09-18T01:25:43.844121+0000","last_clean":"2024-09-18T01:25:43.844121+0000","last_became_active":"2024-09-18T01:25:06.695735+0000","last_became_peered":"2024-09-18T01:25:06.695735+0000","last_unstale":"2024-09-18T01:25:43.844121+0000","last_undegraded":"2024-09-18T01:25:43.844121+0000","last_fullsized":"2024-09-18T01:25:43.844121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:24.579150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:49.871200+0000","last_change":"2024-09-18T01:25:43.852539+0000","last_active":"2024-09-18T01:25:49.871200+0000","last_peered":"2024-09-18T01:25:49.871200+0000","last_clean":"2024-09-18T01:25:49.871200+0000","last_became_active":"2024-09-18T01:25:43.849600+0000","last_became_peered":"2024-09-18T01:25:43.849600+0000","last_unstale":"2024-09-18T01:25:49.871200+0000","last_undegraded":"2024-09-18T01:25:49.871200+0000","last_fullsized":"2024-09-18T01:25:49.871200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:43.134170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.904800+0000","last_change":"2024-09-18T01:25:06.695026+0000","last_active":"2024-09-18T01:25:43.904800+0000","last_peered":"2024-09-18T01:25:43.904800+0000","last_clean":"2024-09-18T01:25:43.904800+0000","last_became_active":"2024-09-18T01:25:06.688967+0000","last_became_peered":"2024-09-18T01:25:06.688967+0000","last_unstale":"2024-09-18T01:25:43.904800+0000","last_undegraded":"2024-09-18T01:25:43.904800+0000","last_fullsized":"2024-09-18T01:25:43.904800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:05.206190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'10","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.176674+0000","last_change":"2024-09-18T01:25:08.684071+0000","last_active":"2024-09-18T01:28:17.176674+0000","last_peered":"2024-09-18T01:28:17.176674+0000","last_clean":"2024-09-18T01:28:17.176674+0000","last_became_active":"2024-09-18T01:25:08.683590+0000","last_became_peered":"2024-09-18T01:25:08.683590+0000","last_unstale":"2024-09-18T01:28:17.176674+0000","last_undegraded":"2024-09-18T01:28:17.176674+0000","last_fullsized":"2024-09-18T01:28:17.176674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:43:55.523212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'6","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.792718+0000","last_change":"2024-09-18T01:25:06.686285+0000","last_active":"2024-09-18T01:28:16.792718+0000","last_peered":"2024-09-18T01:28:16.792718+0000","last_clean":"2024-09-18T01:28:16.792718+0000","last_became_active":"2024-09-18T01:25:06.685814+0000","last_became_peered":"2024-09-18T01:25:06.685814+0000","last_unstale":"2024-09-18T01:28:16.792718+0000","last_undegraded":"2024-09-18T01:28:16.792718+0000","last_fullsized":"2024-09-18T01:28:16.792718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:53.580899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954264+0000","last_change":"2024-09-18T01:25:08.686910+0000","last_active":"2024-09-18T01:28:16.954264+0000","last_peered":"2024-09-18T01:28:16.954264+0000","last_clean":"2024-09-18T01:28:16.954264+0000","last_became_active":"2024-09-18T01:25:08.686703+0000","last_became_peered":"2024-09-18T01:25:08.686703+0000","last_unstale":"2024-09-18T01:28:16.954264+0000","last_undegraded":"2024-09-18T01:28:16.954264+0000","last_fullsized":"2024-09-18T01:28:16.954264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:41.660195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:32.929092+0000","last_change":"2024-09-18T01:25:06.691078+0000","last_active":"2024-09-18T01:26:32.929092+0000","last_peered":"2024-09-18T01:26:32.929092+0000","last_clean":"2024-09-18T01:26:32.929092+0000","last_became_active":"2024-09-18T01:25:06.685120+0000","last_became_peered":"2024-09-18T01:25:06.685120+0000","last_unstale":"2024-09-18T01:26:32.929092+0000","last_undegraded":"2024-09-18T01:26:32.929092+0000","last_fullsized":"2024-09-18T01:26:32.929092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:11:04.031882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'7","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183513+0000","last_change":"2024-09-18T01:25:08.685436+0000","last_active":"2024-09-18T01:28:17.183513+0000","last_peered":"2024-09-18T01:28:17.183513+0000","last_clean":"2024-09-18T01:28:17.183513+0000","last_became_active":"2024-09-18T01:25:08.685158+0000","last_became_peered":"2024-09-18T01:25:08.685158+0000","last_unstale":"2024-09-18T01:28:17.183513+0000","last_undegraded":"2024-09-18T01:28:17.183513+0000","last_fullsized":"2024-09-18T01:28:17.183513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:07.788671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851842+0000","last_change":"2024-09-18T01:25:06.687424+0000","last_active":"2024-09-18T01:25:43.851842+0000","last_peered":"2024-09-18T01:25:43.851842+0000","last_clean":"2024-09-18T01:25:43.851842+0000","last_became_active":"2024-09-18T01:25:06.684845+0000","last_became_peered":"2024-09-18T01:25:06.684845+0000","last_unstale":"2024-09-18T01:25:43.851842+0000","last_undegraded":"2024-09-18T01:25:43.851842+0000","last_fullsized":"2024-09-18T01:25:43.851842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:33.279586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.954367+0000","last_change":"2024-09-18T01:25:08.688327+0000","last_active":"2024-09-18T01:28:16.954367+0000","last_peered":"2024-09-18T01:28:16.954367+0000","last_clean":"2024-09-18T01:28:16.954367+0000","last_became_active":"2024-09-18T01:25:08.687840+0000","last_became_peered":"2024-09-18T01:25:08.687840+0000","last_unstale":"2024-09-18T01:28:16.954367+0000","last_undegraded":"2024-09-18T01:28:16.954367+0000","last_fullsized":"2024-09-18T01:28:16.954367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:24:41.518231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.089186+0000","last_change":"2024-09-18T01:25:06.704602+0000","last_active":"2024-09-18T01:28:17.089186+0000","last_peered":"2024-09-18T01:28:17.089186+0000","last_clean":"2024-09-18T01:28:17.089186+0000","last_became_active":"2024-09-18T01:25:06.704247+0000","last_became_peered":"2024-09-18T01:25:06.704247+0000","last_unstale":"2024-09-18T01:28:17.089186+0000","last_undegraded":"2024-09-18T01:28:17.089186+0000","last_fullsized":"2024-09-18T01:28:17.089186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:53.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'12","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.393720+0000","last_change":"2024-09-18T01:25:08.681230+0000","last_active":"2024-09-18T01:27:13.393720+0000","last_peered":"2024-09-18T01:27:13.393720+0000","last_clean":"2024-09-18T01:27:13.393720+0000","last_became_active":"2024-09-18T01:25:08.680916+0000","last_became_peered":"2024-09-18T01:25:08.680916+0000","last_unstale":"2024-09-18T01:27:13.393720+0000","last_undegraded":"2024-09-18T01:27:13.393720+0000","last_fullsized":"2024-09-18T01:27:13.393720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:09:03.211587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.851720+0000","last_change":"2024-09-18T01:25:06.694171+0000","last_active":"2024-09-18T01:25:43.851720+0000","last_peered":"2024-09-18T01:25:43.851720+0000","last_clean":"2024-09-18T01:25:43.851720+0000","last_became_active":"2024-09-18T01:25:06.693000+0000","last_became_peered":"2024-09-18T01:25:06.693000+0000","last_unstale":"2024-09-18T01:25:43.851720+0000","last_undegraded":"2024-09-18T01:25:43.851720+0000","last_fullsized":"2024-09-18T01:25:43.851720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:50:30.604573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:49.302585+0000","last_change":"2024-09-18T01:25:06.694282+0000","last_active":"2024-09-18T01:25:49.302585+0000","last_peered":"2024-09-18T01:25:49.302585+0000","last_clean":"2024-09-18T01:25:49.302585+0000","last_became_active":"2024-09-18T01:25:06.691141+0000","last_became_peered":"2024-09-18T01:25:06.691141+0000","last_unstale":"2024-09-18T01:25:49.302585+0000","last_undegraded":"2024-09-18T01:25:49.302585+0000","last_fullsized":"2024-09-18T01:25:49.302585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:04.323530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'12","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.870361+0000","last_change":"2024-09-18T01:25:08.681504+0000","last_active":"2024-09-18T01:28:16.870361+0000","last_peered":"2024-09-18T01:28:16.870361+0000","last_clean":"2024-09-18T01:28:16.870361+0000","last_became_active":"2024-09-18T01:25:08.681053+0000","last_became_peered":"2024-09-18T01:25:08.681053+0000","last_unstale":"2024-09-18T01:28:16.870361+0000","last_undegraded":"2024-09-18T01:28:16.870361+0000","last_fullsized":"2024-09-18T01:28:16.870361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:34:57.289152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:25:43.844207+0000","last_change":"2024-09-18T01:25:06.696528+0000","last_active":"2024-09-18T01:25:43.844207+0000","last_peered":"2024-09-18T01:25:43.844207+0000","last_clean":"2024-09-18T01:25:43.844207+0000","last_became_active":"2024-09-18T01:25:06.695875+0000","last_became_peered":"2024-09-18T01:25:06.695875+0000","last_unstale":"2024-09-18T01:25:43.844207+0000","last_undegraded":"2024-09-18T01:25:43.844207+0000","last_fullsized":"2024-09-18T01:25:43.844207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:22.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.097034+0000","last_change":"2024-09-18T01:25:08.688042+0000","last_active":"2024-09-18T01:28:17.097034+0000","last_peered":"2024-09-18T01:28:17.097034+0000","last_clean":"2024-09-18T01:28:17.097034+0000","last_became_active":"2024-09-18T01:25:08.687583+0000","last_became_peered":"2024-09-18T01:25:08.687583+0000","last_unstale":"2024-09-18T01:28:17.097034+0000","last_undegraded":"2024-09-18T01:28:17.097034+0000","last_fullsized":"2024-09-18T01:28:17.097034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:55:06.296443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2271,"ondisk_log_size":2271,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1846,"num_read_kb":1611,"num_write":775,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1545,"ondisk_log_size":1545,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":968,"num_read_kb":968,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":12570624,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":142,"num_read_kb":87,"num_write":313,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673007,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":487424,"data_stored":155040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673007,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":744524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673008,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36368,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335472,"statfs":{"total":96636764160,"available":96599523328,"internally_reserved":0,"allocated":1044480,"data_stored":744891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48360,"kb_used_data":8856,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323480,"statfs":{"total":96636764160,"available":96587243520,"internally_reserved":0,"allocated":9068544,"data_stored":8760581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:28:28.249 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.250 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.250 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.250 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.250 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.250 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.250 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.250 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.250 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.250 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.251 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.251 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.251 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.251 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.251 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.251 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.251 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.251 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.252 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.252 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.252 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.252 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.252 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.252 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.252 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.252 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.253 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.253 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.253 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.253 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.253 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.253 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.253 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.253 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.254 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.254 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.254 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.254 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.254 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.254 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.254 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.254 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.254 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.255 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.255 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.255 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.255 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.255 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.255 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.255 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.255 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.256 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.256 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.256 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.256 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.256 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.256 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.256 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.256 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.256 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.257 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.257 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.257 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.257 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.257 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.257 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.257 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.257 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.257 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.258 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.258 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.258 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.258 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.258 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.258 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.258 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.258 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.259 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.259 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.259 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.259 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.259 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.259 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.259 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.259 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.260 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.260 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.260 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.260 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.260 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.260 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.260 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.260 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.261 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.261 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.261 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.261 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.261 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.261 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.261 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.262 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.262 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T01:24:51.161687+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=51, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.262 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.262 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.262 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.262 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.262 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.262 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.262 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.263 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.263 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.263 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.263 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.263 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.263 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.264 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.264 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.264 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.264 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.264 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.264 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.264 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.264 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.264 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.265 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.265 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.265 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.265 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.265 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.265 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.265 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.266 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.266 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.266 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.266 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.266 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.266 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.266 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.267 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.267 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.267 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.267 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.267 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.267 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.267 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.267 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.267 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.268 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.268 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.268 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.268 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.268 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.268 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.268 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.268 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.269 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.269 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.269 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.269 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.269 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.269 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.269 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.269 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.269 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.270 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.270 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.270 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.270 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.270 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.270 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.270 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.271 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.271 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.271 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.271 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.271 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.271 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.271 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.271 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.272 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.272 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.272 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.272 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.272 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.272 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.272 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.272 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.273 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.273 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.273 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.273 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.273 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.273 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.273 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.273 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.273 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.274 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.274 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.274 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.274 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.274 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.274 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.274 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.274 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.274 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.275 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.275 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.275 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.275 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.275 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.275 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.275 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.275 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.275 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.276 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.276 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.276 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.276 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.276 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.276 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.276 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.276 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.276 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.277 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.277 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.277 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.277 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.277 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.277 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.277 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.277 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.277 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.277 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.278 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.278 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.278 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.278 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.278 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.278 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.278 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.278 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.279 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.279 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.279 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.279 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.279 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.279 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.279 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.279 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.280 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.280 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.280 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.280 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.280 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.280 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.280 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.280 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.280 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.280 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.281 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.281 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.281 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.281 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.281 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.281 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:28.281 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T01:28:48.282 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:28:48.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.390+0000 7f2f54d6d640 1 Processor -- start 2024-09-18T01:28:48.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.390+0000 7f2f54d6d640 1 -- start start 2024-09-18T01:28:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.391+0000 7f2f54d6d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2f5009bd50 0x7f2f5009c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.391+0000 7f2f54d6d640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5009d3b0 con 0x7f2f5009c670 2024-09-18T01:28:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.391+0000 7f2f54d6d640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f2f50098230 con 0x7f2f5009bd50 2024-09-18T01:28:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.391+0000 7f2f4e59c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2f5009bd50 0x7f2f5009c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.391+0000 7f2f4dd9b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f2f5009c670 0x7f2f500990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39512/0 (socket says 172.21.15.92:39512) 2024-09-18T01:28:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.391+0000 7f2f4dd9b640 1 -- 172.21.15.92:0/2173716449 learned_addr learned my addr 172.21.15.92:0/2173716449 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:28:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.391+0000 7f2f4e59c640 1 -- 172.21.15.92:0/2173716449 >> v1:172.21.15.92:6789/0 conn(0x7f2f5009c670 legacy=0x7f2f500990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.391+0000 7f2f4e59c640 1 -- 172.21.15.92:0/2173716449 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f500983e0 con 0x7f2f5009bd50 2024-09-18T01:28:48.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.392+0000 7f2f4e59c640 1 --2- 172.21.15.92:0/2173716449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f5009bd50 0x7f2f5009c130 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009720 tx=0x7f2f4002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435a1f47960fecda server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:48.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.392+0000 7f2f4d59a640 1 -- 172.21.15.92:0/2173716449 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f40037070 con 0x7f2f5009bd50 2024-09-18T01:28:48.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.392+0000 7f2f4d59a640 1 -- 172.21.15.92:0/2173716449 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f4002ad90 con 0x7f2f5009bd50 2024-09-18T01:28:48.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.392+0000 7f2f4d59a640 1 -- 172.21.15.92:0/2173716449 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f40032590 con 0x7f2f5009bd50 2024-09-18T01:28:48.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.393+0000 7f2f54d6d640 1 -- 172.21.15.92:0/2173716449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f5009bd50 msgr2=0x7f2f5009c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:48.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.393+0000 7f2f54d6d640 1 --2- 172.21.15.92:0/2173716449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f5009bd50 0x7f2f5009c130 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009720 tx=0x7f2f4002a110 comp rx=0 tx=0).stop 2024-09-18T01:28:48.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.393+0000 7f2f54d6d640 1 -- 172.21.15.92:0/2173716449 shutdown_connections 2024-09-18T01:28:48.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.393+0000 7f2f54d6d640 1 --2- 172.21.15.92:0/2173716449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f5009bd50 0x7f2f5009c130 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:48.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.393+0000 7f2f54d6d640 1 -- 172.21.15.92:0/2173716449 >> 172.21.15.92:0/2173716449 conn(0x7f2f5006d4a0 msgr2=0x7f2f5006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:48.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.393+0000 7f2f54d6d640 1 -- 172.21.15.92:0/2173716449 shutdown_connections 2024-09-18T01:28:48.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.393+0000 7f2f54d6d640 1 -- 172.21.15.92:0/2173716449 wait complete. 2024-09-18T01:28:48.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.394+0000 7f2f54d6d640 1 Processor -- start 2024-09-18T01:28:48.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.394+0000 7f2f54d6d640 1 -- start start 2024-09-18T01:28:48.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.394+0000 7f2f54d6d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f5009bd50 0x7f2f50093570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:48.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.394+0000 7f2f54d6d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2f50099b90 con 0x7f2f5009bd50 2024-09-18T01:28:48.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.395+0000 7f2f4e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f5009bd50 0x7f2f50093570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:48.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.395+0000 7f2f4e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f5009bd50 0x7f2f50093570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58452/0 (socket says 172.21.15.92:58452) 2024-09-18T01:28:48.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.395+0000 7f2f4e59c640 1 -- 172.21.15.92:0/1160655967 learned_addr learned my addr 172.21.15.92:0/1160655967 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:28:48.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.395+0000 7f2f4e59c640 1 -- 172.21.15.92:0/1160655967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f50094eb0 con 0x7f2f5009bd50 2024-09-18T01:28:48.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.395+0000 7f2f4e59c640 1 --2- 172.21.15.92:0/1160655967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f5009bd50 0x7f2f50093570 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009840 tx=0x7f2f400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:48.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.395+0000 7f2f46ffd640 1 -- 172.21.15.92:0/1160655967 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f40041070 con 0x7f2f5009bd50 2024-09-18T01:28:48.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.395+0000 7f2f46ffd640 1 -- 172.21.15.92:0/1160655967 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f4003c460 con 0x7f2f5009bd50 2024-09-18T01:28:48.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.395+0000 7f2f54d6d640 1 -- 172.21.15.92:0/1160655967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f50095590 con 0x7f2f5009bd50 2024-09-18T01:28:48.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.395+0000 7f2f46ffd640 1 -- 172.21.15.92:0/1160655967 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f40037040 con 0x7f2f5009bd50 2024-09-18T01:28:48.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.395+0000 7f2f54d6d640 1 -- 172.21.15.92:0/1160655967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f500961c0 con 0x7f2f5009bd50 2024-09-18T01:28:48.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.396+0000 7f2f46ffd640 1 -- 172.21.15.92:0/1160655967 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2f40044070 con 0x7f2f5009bd50 2024-09-18T01:28:48.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.396+0000 7f2f54d6d640 1 -- 172.21.15.92:0/1160655967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5009a130 con 0x7f2f5009bd50 2024-09-18T01:28:48.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.396+0000 7f2f46ffd640 1 --2- 172.21.15.92:0/1160655967 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2f300382a0 0x7f2f3003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:28:48.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.396+0000 7f2f46ffd640 1 -- 172.21.15.92:0/1160655967 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f2f4006c810 con 0x7f2f5009bd50 2024-09-18T01:28:48.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.397+0000 7f2f4dd9b640 1 --2- 172.21.15.92:0/1160655967 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2f300382a0 0x7f2f3003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:28:48.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.397+0000 7f2f4dd9b640 1 --2- 172.21.15.92:0/1160655967 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2f300382a0 0x7f2f3003a760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2f38007fd0 tx=0x7f2f38007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:28:48.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.401+0000 7f2f46ffd640 1 -- 172.21.15.92:0/1160655967 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f500961c0 con 0x7f2f5009bd50 2024-09-18T01:28:48.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.564+0000 7f2f54d6d640 1 -- 172.21.15.92:0/1160655967 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f5009d020 con 0x7f2f300382a0 2024-09-18T01:28:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.580+0000 7f2f46ffd640 1 -- 172.21.15.92:0/1160655967 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658881 (secure 0 0 0) 0x7f2f5009d020 con 0x7f2f300382a0 2024-09-18T01:28:48.588 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:28:48.594 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-18T01:28:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.584+0000 7f2f54d6d640 1 -- 172.21.15.92:0/1160655967 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2f300382a0 msgr2=0x7f2f3003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.584+0000 7f2f54d6d640 1 --2- 172.21.15.92:0/1160655967 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2f300382a0 0x7f2f3003a760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2f38007fd0 tx=0x7f2f38007ac0 comp rx=0 tx=0).stop 2024-09-18T01:28:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.584+0000 7f2f54d6d640 1 -- 172.21.15.92:0/1160655967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f5009bd50 msgr2=0x7f2f50093570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:28:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.584+0000 7f2f54d6d640 1 --2- 172.21.15.92:0/1160655967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f5009bd50 0x7f2f50093570 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009840 tx=0x7f2f400046c0 comp rx=0 tx=0).stop 2024-09-18T01:28:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.584+0000 7f2f54d6d640 1 -- 172.21.15.92:0/1160655967 shutdown_connections 2024-09-18T01:28:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.584+0000 7f2f54d6d640 1 --2- 172.21.15.92:0/1160655967 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f2f300382a0 0x7f2f3003a760 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:48.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.584+0000 7f2f54d6d640 1 --2- 172.21.15.92:0/1160655967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f5009bd50 0x7f2f50093570 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:28:48.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.584+0000 7f2f54d6d640 1 -- 172.21.15.92:0/1160655967 >> 172.21.15.92:0/1160655967 conn(0x7f2f5006d4a0 msgr2=0x7f2f5009eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:28:48.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.584+0000 7f2f54d6d640 1 -- 172.21.15.92:0/1160655967 shutdown_connections 2024-09-18T01:28:48.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:28:48.584+0000 7f2f54d6d640 1 -- 172.21.15.92:0/1160655967 wait complete. 2024-09-18T01:28:48.597 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-18T01:28:46.833939+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5383,"num_read_kb":4932,"num_write":2371,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":993,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4941,"ondisk_log_size":4941,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152640,"kb_used_data":2944,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334720,"statfs":{"total":386547056640,"available":386390753280,"internally_reserved":0,"allocated":3014656,"data_stored":1799340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003994"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.796081+0000","last_change":"2024-09-18T01:25:06.692305+0000","last_active":"2024-09-18T01:27:14.796081+0000","last_peered":"2024-09-18T01:27:14.796081+0000","last_clean":"2024-09-18T01:27:14.796081+0000","last_became_active":"2024-09-18T01:25:06.691940+0000","last_became_peered":"2024-09-18T01:25:06.691940+0000","last_unstale":"2024-09-18T01:27:14.796081+0000","last_undegraded":"2024-09-18T01:27:14.796081+0000","last_fullsized":"2024-09-18T01:27:14.796081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'13","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.231201+0000","last_change":"2024-09-18T01:25:08.683809+0000","last_active":"2024-09-18T01:28:17.231201+0000","last_peered":"2024-09-18T01:28:17.231201+0000","last_clean":"2024-09-18T01:28:17.231201+0000","last_became_active":"2024-09-18T01:25:08.683538+0000","last_became_peered":"2024-09-18T01:25:08.683538+0000","last_unstale":"2024-09-18T01:28:17.231201+0000","last_undegraded":"2024-09-18T01:28:17.231201+0000","last_fullsized":"2024-09-18T01:28:17.231201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.855435+0000","last_change":"2024-09-18T01:25:06.687454+0000","last_active":"2024-09-18T01:28:23.855435+0000","last_peered":"2024-09-18T01:28:23.855435+0000","last_clean":"2024-09-18T01:28:23.855435+0000","last_became_active":"2024-09-18T01:25:06.686950+0000","last_became_peered":"2024-09-18T01:25:06.686950+0000","last_unstale":"2024-09-18T01:28:23.855435+0000","last_undegraded":"2024-09-18T01:28:23.855435+0000","last_fullsized":"2024-09-18T01:28:23.855435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'20","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.965869+0000","last_change":"2024-09-18T01:25:08.673859+0000","last_active":"2024-09-18T01:28:16.965869+0000","last_peered":"2024-09-18T01:28:16.965869+0000","last_clean":"2024-09-18T01:28:16.965869+0000","last_became_active":"2024-09-18T01:25:08.673552+0000","last_became_peered":"2024-09-18T01:25:08.673552+0000","last_unstale":"2024-09-18T01:28:16.965869+0000","last_undegraded":"2024-09-18T01:28:16.965869+0000","last_fullsized":"2024-09-18T01:28:16.965869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.796672+0000","last_change":"2024-09-18T01:25:06.687698+0000","last_active":"2024-09-18T01:27:14.796672+0000","last_peered":"2024-09-18T01:27:14.796672+0000","last_clean":"2024-09-18T01:27:14.796672+0000","last_became_active":"2024-09-18T01:25:06.687068+0000","last_became_peered":"2024-09-18T01:25:06.687068+0000","last_unstale":"2024-09-18T01:27:14.796672+0000","last_undegraded":"2024-09-18T01:27:14.796672+0000","last_fullsized":"2024-09-18T01:27:14.796672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'10","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.103862+0000","last_change":"2024-09-18T01:25:08.685372+0000","last_active":"2024-09-18T01:28:17.103862+0000","last_peered":"2024-09-18T01:28:17.103862+0000","last_clean":"2024-09-18T01:28:17.103862+0000","last_became_active":"2024-09-18T01:25:08.685074+0000","last_became_peered":"2024-09-18T01:25:08.685074+0000","last_unstale":"2024-09-18T01:28:17.103862+0000","last_undegraded":"2024-09-18T01:28:17.103862+0000","last_fullsized":"2024-09-18T01:28:17.103862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:09.795307+0000","last_change":"2024-09-18T01:25:06.690926+0000","last_active":"2024-09-18T01:27:09.795307+0000","last_peered":"2024-09-18T01:27:09.795307+0000","last_clean":"2024-09-18T01:27:09.795307+0000","last_became_active":"2024-09-18T01:25:06.690552+0000","last_became_peered":"2024-09-18T01:25:06.690552+0000","last_unstale":"2024-09-18T01:27:09.795307+0000","last_undegraded":"2024-09-18T01:27:09.795307+0000","last_fullsized":"2024-09-18T01:27:09.795307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'8","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800831+0000","last_change":"2024-09-18T01:25:08.676582+0000","last_active":"2024-09-18T01:27:39.800831+0000","last_peered":"2024-09-18T01:27:39.800831+0000","last_clean":"2024-09-18T01:27:39.800831+0000","last_became_active":"2024-09-18T01:25:08.674210+0000","last_became_peered":"2024-09-18T01:25:08.674210+0000","last_unstale":"2024-09-18T01:27:39.800831+0000","last_undegraded":"2024-09-18T01:27:39.800831+0000","last_fullsized":"2024-09-18T01:27:39.800831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800810+0000","last_change":"2024-09-18T01:25:06.689859+0000","last_active":"2024-09-18T01:27:39.800810+0000","last_peered":"2024-09-18T01:27:39.800810+0000","last_clean":"2024-09-18T01:27:39.800810+0000","last_became_active":"2024-09-18T01:25:06.687608+0000","last_became_peered":"2024-09-18T01:25:06.687608+0000","last_unstale":"2024-09-18T01:27:39.800810+0000","last_undegraded":"2024-09-18T01:27:39.800810+0000","last_fullsized":"2024-09-18T01:27:39.800810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.394177+0000","last_change":"2024-09-18T01:25:08.684086+0000","last_active":"2024-09-18T01:27:13.394177+0000","last_peered":"2024-09-18T01:27:13.394177+0000","last_clean":"2024-09-18T01:27:13.394177+0000","last_became_active":"2024-09-18T01:25:08.683812+0000","last_became_peered":"2024-09-18T01:25:08.683812+0000","last_unstale":"2024-09-18T01:27:13.394177+0000","last_undegraded":"2024-09-18T01:27:13.394177+0000","last_fullsized":"2024-09-18T01:27:13.394177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.094725+0000","last_change":"2024-09-18T01:25:06.702940+0000","last_active":"2024-09-18T01:28:17.094725+0000","last_peered":"2024-09-18T01:28:17.094725+0000","last_clean":"2024-09-18T01:28:17.094725+0000","last_became_active":"2024-09-18T01:25:06.702616+0000","last_became_peered":"2024-09-18T01:25:06.702616+0000","last_unstale":"2024-09-18T01:28:17.094725+0000","last_undegraded":"2024-09-18T01:28:17.094725+0000","last_fullsized":"2024-09-18T01:28:17.094725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'8","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.963332+0000","last_change":"2024-09-18T01:25:43.904757+0000","last_active":"2024-09-18T01:28:16.963332+0000","last_peered":"2024-09-18T01:28:16.963332+0000","last_clean":"2024-09-18T01:28:16.963332+0000","last_became_active":"2024-09-18T01:25:43.904427+0000","last_became_peered":"2024-09-18T01:25:43.904427+0000","last_unstale":"2024-09-18T01:28:16.963332+0000","last_undegraded":"2024-09-18T01:28:16.963332+0000","last_fullsized":"2024-09-18T01:28:16.963332+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800683+0000","last_change":"2024-09-18T01:25:06.683548+0000","last_active":"2024-09-18T01:27:39.800683+0000","last_peered":"2024-09-18T01:27:39.800683+0000","last_clean":"2024-09-18T01:27:39.800683+0000","last_became_active":"2024-09-18T01:25:06.683195+0000","last_became_peered":"2024-09-18T01:25:06.683195+0000","last_unstale":"2024-09-18T01:27:39.800683+0000","last_undegraded":"2024-09-18T01:27:39.800683+0000","last_fullsized":"2024-09-18T01:27:39.800683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'3","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.230765+0000","last_change":"2024-09-18T01:25:08.677859+0000","last_active":"2024-09-18T01:28:17.230765+0000","last_peered":"2024-09-18T01:28:17.230765+0000","last_clean":"2024-09-18T01:28:17.230765+0000","last_became_active":"2024-09-18T01:25:08.677579+0000","last_became_peered":"2024-09-18T01:25:08.677579+0000","last_unstale":"2024-09-18T01:28:17.230765+0000","last_undegraded":"2024-09-18T01:28:17.230765+0000","last_fullsized":"2024-09-18T01:28:17.230765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:37.799971+0000","last_change":"2024-09-18T01:25:06.686453+0000","last_active":"2024-09-18T01:27:37.799971+0000","last_peered":"2024-09-18T01:27:37.799971+0000","last_clean":"2024-09-18T01:27:37.799971+0000","last_became_active":"2024-09-18T01:25:06.686049+0000","last_became_peered":"2024-09-18T01:25:06.686049+0000","last_unstale":"2024-09-18T01:27:37.799971+0000","last_undegraded":"2024-09-18T01:27:37.799971+0000","last_fullsized":"2024-09-18T01:27:37.799971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.484906+0000","last_change":"2024-09-18T01:25:08.676582+0000","last_active":"2024-09-18T01:27:16.484906+0000","last_peered":"2024-09-18T01:27:16.484906+0000","last_clean":"2024-09-18T01:27:16.484906+0000","last_became_active":"2024-09-18T01:25:08.676310+0000","last_became_peered":"2024-09-18T01:25:08.676310+0000","last_unstale":"2024-09-18T01:27:16.484906+0000","last_undegraded":"2024-09-18T01:27:16.484906+0000","last_fullsized":"2024-09-18T01:27:16.484906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'24","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.107040+0000","last_change":"2024-09-18T01:25:08.673269+0000","last_active":"2024-09-18T01:28:17.107040+0000","last_peered":"2024-09-18T01:28:17.107040+0000","last_clean":"2024-09-18T01:28:17.107040+0000","last_became_active":"2024-09-18T01:25:08.671858+0000","last_became_peered":"2024-09-18T01:25:08.671858+0000","last_unstale":"2024-09-18T01:28:17.107040+0000","last_undegraded":"2024-09-18T01:28:17.107040+0000","last_fullsized":"2024-09-18T01:28:17.107040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":55,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800138+0000","last_change":"2024-09-18T01:25:06.691701+0000","last_active":"2024-09-18T01:27:34.800138+0000","last_peered":"2024-09-18T01:27:34.800138+0000","last_clean":"2024-09-18T01:27:34.800138+0000","last_became_active":"2024-09-18T01:25:06.691034+0000","last_became_peered":"2024-09-18T01:25:06.691034+0000","last_unstale":"2024-09-18T01:27:34.800138+0000","last_undegraded":"2024-09-18T01:27:34.800138+0000","last_fullsized":"2024-09-18T01:27:34.800138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'3","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.231199+0000","last_change":"2024-09-18T01:25:08.685309+0000","last_active":"2024-09-18T01:28:17.231199+0000","last_peered":"2024-09-18T01:28:17.231199+0000","last_clean":"2024-09-18T01:28:17.231199+0000","last_became_active":"2024-09-18T01:25:08.685043+0000","last_became_peered":"2024-09-18T01:25:08.685043+0000","last_unstale":"2024-09-18T01:28:17.231199+0000","last_undegraded":"2024-09-18T01:28:17.231199+0000","last_fullsized":"2024-09-18T01:28:17.231199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799246+0000","last_change":"2024-09-18T01:25:06.704767+0000","last_active":"2024-09-18T01:27:34.799246+0000","last_peered":"2024-09-18T01:27:34.799246+0000","last_clean":"2024-09-18T01:27:34.799246+0000","last_became_active":"2024-09-18T01:25:06.704414+0000","last_became_peered":"2024-09-18T01:25:06.704414+0000","last_unstale":"2024-09-18T01:27:34.799246+0000","last_undegraded":"2024-09-18T01:27:34.799246+0000","last_fullsized":"2024-09-18T01:27:34.799246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.103602+0000","last_change":"2024-09-18T01:25:08.685665+0000","last_active":"2024-09-18T01:28:17.103602+0000","last_peered":"2024-09-18T01:28:17.103602+0000","last_clean":"2024-09-18T01:28:17.103602+0000","last_became_active":"2024-09-18T01:25:08.684921+0000","last_became_peered":"2024-09-18T01:25:08.684921+0000","last_unstale":"2024-09-18T01:28:17.103602+0000","last_undegraded":"2024-09-18T01:28:17.103602+0000","last_fullsized":"2024-09-18T01:28:17.103602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'3","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800079+0000","last_change":"2024-09-18T01:25:06.688208+0000","last_active":"2024-09-18T01:27:34.800079+0000","last_peered":"2024-09-18T01:27:34.800079+0000","last_clean":"2024-09-18T01:27:34.800079+0000","last_became_active":"2024-09-18T01:25:06.687737+0000","last_became_peered":"2024-09-18T01:25:06.687737+0000","last_unstale":"2024-09-18T01:27:34.800079+0000","last_undegraded":"2024-09-18T01:27:34.800079+0000","last_fullsized":"2024-09-18T01:27:34.800079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'16","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:32.799206+0000","last_change":"2024-09-18T01:25:08.671649+0000","last_active":"2024-09-18T01:27:32.799206+0000","last_peered":"2024-09-18T01:27:32.799206+0000","last_clean":"2024-09-18T01:27:32.799206+0000","last_became_active":"2024-09-18T01:25:08.671338+0000","last_became_peered":"2024-09-18T01:25:08.671338+0000","last_unstale":"2024-09-18T01:27:32.799206+0000","last_undegraded":"2024-09-18T01:27:32.799206+0000","last_fullsized":"2024-09-18T01:27:32.799206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800052+0000","last_change":"2024-09-18T01:25:06.688689+0000","last_active":"2024-09-18T01:27:34.800052+0000","last_peered":"2024-09-18T01:27:34.800052+0000","last_clean":"2024-09-18T01:27:34.800052+0000","last_became_active":"2024-09-18T01:25:06.688356+0000","last_became_peered":"2024-09-18T01:25:06.688356+0000","last_unstale":"2024-09-18T01:27:34.800052+0000","last_undegraded":"2024-09-18T01:27:34.800052+0000","last_fullsized":"2024-09-18T01:27:34.800052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799182+0000","last_change":"2024-09-18T01:25:08.674151+0000","last_active":"2024-09-18T01:27:34.799182+0000","last_peered":"2024-09-18T01:27:34.799182+0000","last_clean":"2024-09-18T01:27:34.799182+0000","last_became_active":"2024-09-18T01:25:08.673915+0000","last_became_peered":"2024-09-18T01:25:08.673915+0000","last_unstale":"2024-09-18T01:27:34.799182+0000","last_undegraded":"2024-09-18T01:27:34.799182+0000","last_fullsized":"2024-09-18T01:27:34.799182+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:32.799197+0000","last_change":"2024-09-18T01:25:06.687453+0000","last_active":"2024-09-18T01:27:32.799197+0000","last_peered":"2024-09-18T01:27:32.799197+0000","last_clean":"2024-09-18T01:27:32.799197+0000","last_became_active":"2024-09-18T01:25:06.686900+0000","last_became_peered":"2024-09-18T01:25:06.686900+0000","last_unstale":"2024-09-18T01:27:32.799197+0000","last_undegraded":"2024-09-18T01:27:32.799197+0000","last_fullsized":"2024-09-18T01:27:32.799197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'6","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.152793+0000","last_change":"2024-09-18T01:25:08.682513+0000","last_active":"2024-09-18T01:28:17.152793+0000","last_peered":"2024-09-18T01:28:17.152793+0000","last_clean":"2024-09-18T01:28:17.152793+0000","last_became_active":"2024-09-18T01:25:08.682225+0000","last_became_peered":"2024-09-18T01:25:08.682225+0000","last_unstale":"2024-09-18T01:28:17.152793+0000","last_undegraded":"2024-09-18T01:28:17.152793+0000","last_fullsized":"2024-09-18T01:28:17.152793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799058+0000","last_change":"2024-09-18T01:25:06.695620+0000","last_active":"2024-09-18T01:27:29.799058+0000","last_peered":"2024-09-18T01:27:29.799058+0000","last_clean":"2024-09-18T01:27:29.799058+0000","last_became_active":"2024-09-18T01:25:06.693647+0000","last_became_peered":"2024-09-18T01:25:06.693647+0000","last_unstale":"2024-09-18T01:27:29.799058+0000","last_undegraded":"2024-09-18T01:27:29.799058+0000","last_fullsized":"2024-09-18T01:27:29.799058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'35","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.191609+0000","last_change":"2024-09-18T01:25:16.712693+0000","last_active":"2024-09-18T01:28:17.191609+0000","last_peered":"2024-09-18T01:28:17.191609+0000","last_clean":"2024-09-18T01:28:17.191609+0000","last_became_active":"2024-09-18T01:25:16.712438+0000","last_became_peered":"2024-09-18T01:25:16.712438+0000","last_unstale":"2024-09-18T01:28:17.191609+0000","last_undegraded":"2024-09-18T01:28:17.191609+0000","last_fullsized":"2024-09-18T01:28:17.191609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799161+0000","last_change":"2024-09-18T01:25:08.673859+0000","last_active":"2024-09-18T01:27:29.799161+0000","last_peered":"2024-09-18T01:27:29.799161+0000","last_clean":"2024-09-18T01:27:29.799161+0000","last_became_active":"2024-09-18T01:25:08.673605+0000","last_became_peered":"2024-09-18T01:25:08.673605+0000","last_unstale":"2024-09-18T01:27:29.799161+0000","last_undegraded":"2024-09-18T01:27:29.799161+0000","last_fullsized":"2024-09-18T01:27:29.799161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799122+0000","last_change":"2024-09-18T01:25:06.687788+0000","last_active":"2024-09-18T01:27:29.799122+0000","last_peered":"2024-09-18T01:27:29.799122+0000","last_clean":"2024-09-18T01:27:29.799122+0000","last_became_active":"2024-09-18T01:25:06.685173+0000","last_became_peered":"2024-09-18T01:25:06.685173+0000","last_unstale":"2024-09-18T01:27:29.799122+0000","last_undegraded":"2024-09-18T01:27:29.799122+0000","last_fullsized":"2024-09-18T01:27:29.799122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.112958+0000","last_change":"2024-09-18T01:28:31.112996+0000","last_active":"2024-09-18T01:28:31.112958+0000","last_peered":"2024-09-18T01:28:31.112958+0000","last_clean":"2024-09-18T01:28:31.112958+0000","last_became_active":"2024-09-18T01:25:10.684454+0000","last_became_peered":"2024-09-18T01:25:10.684454+0000","last_unstale":"2024-09-18T01:28:31.112958+0000","last_undegraded":"2024-09-18T01:28:31.112958+0000","last_fullsized":"2024-09-18T01:28:31.112958+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.112838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.112838+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.112838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:47:30.069158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'45","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.828062+0000","last_change":"2024-09-18T01:25:12.692370+0000","last_active":"2024-09-18T01:28:23.828062+0000","last_peered":"2024-09-18T01:28:23.828062+0000","last_clean":"2024-09-18T01:28:23.828062+0000","last_became_active":"2024-09-18T01:25:12.692059+0000","last_became_peered":"2024-09-18T01:25:12.692059+0000","last_unstale":"2024-09-18T01:28:23.828062+0000","last_undegraded":"2024-09-18T01:28:23.828062+0000","last_fullsized":"2024-09-18T01:28:23.828062+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800861+0000","last_change":"2024-09-18T01:25:14.710315+0000","last_active":"2024-09-18T01:27:39.800861+0000","last_peered":"2024-09-18T01:27:39.800861+0000","last_clean":"2024-09-18T01:27:39.800861+0000","last_became_active":"2024-09-18T01:25:14.709879+0000","last_became_peered":"2024-09-18T01:25:14.709879+0000","last_unstale":"2024-09-18T01:27:39.800861+0000","last_undegraded":"2024-09-18T01:27:39.800861+0000","last_fullsized":"2024-09-18T01:27:39.800861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801517+0000","last_change":"2024-09-18T01:25:16.712032+0000","last_active":"2024-09-18T01:27:44.801517+0000","last_peered":"2024-09-18T01:27:44.801517+0000","last_clean":"2024-09-18T01:27:44.801517+0000","last_became_active":"2024-09-18T01:25:16.711764+0000","last_became_peered":"2024-09-18T01:25:16.711764+0000","last_unstale":"2024-09-18T01:27:44.801517+0000","last_undegraded":"2024-09-18T01:27:44.801517+0000","last_fullsized":"2024-09-18T01:27:44.801517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:09.804191+0000","last_change":"2024-09-18T01:25:43.852201+0000","last_active":"2024-09-18T01:28:09.804191+0000","last_peered":"2024-09-18T01:28:09.804191+0000","last_clean":"2024-09-18T01:28:09.804191+0000","last_became_active":"2024-09-18T01:25:43.848631+0000","last_became_peered":"2024-09-18T01:25:43.848631+0000","last_unstale":"2024-09-18T01:28:09.804191+0000","last_undegraded":"2024-09-18T01:28:09.804191+0000","last_fullsized":"2024-09-18T01:28:09.804191+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.798392+0000","last_change":"2024-09-18T01:25:06.691194+0000","last_active":"2024-09-18T01:27:29.798392+0000","last_peered":"2024-09-18T01:27:29.798392+0000","last_clean":"2024-09-18T01:27:29.798392+0000","last_became_active":"2024-09-18T01:25:06.690813+0000","last_became_peered":"2024-09-18T01:25:06.690813+0000","last_unstale":"2024-09-18T01:27:29.798392+0000","last_undegraded":"2024-09-18T01:27:29.798392+0000","last_fullsized":"2024-09-18T01:27:29.798392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:32.799216+0000","last_change":"2024-09-18T01:25:10.677775+0000","last_active":"2024-09-18T01:27:32.799216+0000","last_peered":"2024-09-18T01:27:32.799216+0000","last_clean":"2024-09-18T01:27:32.799216+0000","last_became_active":"2024-09-18T01:25:10.677226+0000","last_became_peered":"2024-09-18T01:25:10.677226+0000","last_unstale":"2024-09-18T01:27:32.799216+0000","last_undegraded":"2024-09-18T01:27:32.799216+0000","last_fullsized":"2024-09-18T01:27:32.799216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'17","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.394431+0000","last_change":"2024-09-18T01:28:30.394506+0000","last_active":"2024-09-18T01:28:30.394431+0000","last_peered":"2024-09-18T01:28:30.394431+0000","last_clean":"2024-09-18T01:28:30.394431+0000","last_became_active":"2024-09-18T01:25:12.688366+0000","last_became_peered":"2024-09-18T01:25:12.688366+0000","last_unstale":"2024-09-18T01:28:30.394431+0000","last_undegraded":"2024-09-18T01:28:30.394431+0000","last_fullsized":"2024-09-18T01:28:30.394431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-18T01:28:30.394314+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-18T01:28:30.394314+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.394314+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:51.126406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.435350+0000","last_change":"2024-09-18T01:28:31.435372+0000","last_active":"2024-09-18T01:28:31.435350+0000","last_peered":"2024-09-18T01:28:31.435350+0000","last_clean":"2024-09-18T01:28:31.435350+0000","last_became_active":"2024-09-18T01:25:14.702918+0000","last_became_peered":"2024-09-18T01:25:14.702918+0000","last_unstale":"2024-09-18T01:28:31.435350+0000","last_undegraded":"2024-09-18T01:28:31.435350+0000","last_fullsized":"2024-09-18T01:28:31.435350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.435257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.435257+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.435257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:21.639639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.288121+0000","last_change":"2024-09-18T01:25:16.714035+0000","last_active":"2024-09-18T01:28:17.288121+0000","last_peered":"2024-09-18T01:28:17.288121+0000","last_clean":"2024-09-18T01:28:17.288121+0000","last_became_active":"2024-09-18T01:25:16.713571+0000","last_became_peered":"2024-09-18T01:25:16.713571+0000","last_unstale":"2024-09-18T01:28:17.288121+0000","last_undegraded":"2024-09-18T01:28:17.288121+0000","last_fullsized":"2024-09-18T01:28:17.288121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'8","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.182973+0000","last_change":"2024-09-18T01:25:08.673278+0000","last_active":"2024-09-18T01:28:17.182973+0000","last_peered":"2024-09-18T01:28:17.182973+0000","last_clean":"2024-09-18T01:28:17.182973+0000","last_became_active":"2024-09-18T01:25:08.671904+0000","last_became_peered":"2024-09-18T01:25:08.671904+0000","last_unstale":"2024-09-18T01:28:17.182973+0000","last_undegraded":"2024-09-18T01:28:17.182973+0000","last_fullsized":"2024-09-18T01:28:17.182973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799005+0000","last_change":"2024-09-18T01:25:06.681491+0000","last_active":"2024-09-18T01:27:29.799005+0000","last_peered":"2024-09-18T01:27:29.799005+0000","last_clean":"2024-09-18T01:27:29.799005+0000","last_became_active":"2024-09-18T01:25:06.681065+0000","last_became_peered":"2024-09-18T01:25:06.681065+0000","last_unstale":"2024-09-18T01:27:29.799005+0000","last_undegraded":"2024-09-18T01:27:29.799005+0000","last_fullsized":"2024-09-18T01:27:29.799005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:37.800101+0000","last_change":"2024-09-18T01:25:10.677498+0000","last_active":"2024-09-18T01:27:37.800101+0000","last_peered":"2024-09-18T01:27:37.800101+0000","last_clean":"2024-09-18T01:27:37.800101+0000","last_became_active":"2024-09-18T01:25:10.677118+0000","last_became_peered":"2024-09-18T01:25:10.677118+0000","last_unstale":"2024-09-18T01:27:37.800101+0000","last_undegraded":"2024-09-18T01:27:37.800101+0000","last_fullsized":"2024-09-18T01:27:37.800101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'29","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.676629+0000","last_change":"2024-09-18T01:28:36.676691+0000","last_active":"2024-09-18T01:28:36.676629+0000","last_peered":"2024-09-18T01:28:36.676629+0000","last_clean":"2024-09-18T01:28:36.676629+0000","last_became_active":"2024-09-18T01:25:12.693426+0000","last_became_peered":"2024-09-18T01:25:12.693426+0000","last_unstale":"2024-09-18T01:28:36.676629+0000","last_undegraded":"2024-09-18T01:28:36.676629+0000","last_fullsized":"2024-09-18T01:28:36.676629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'29","last_scrub_stamp":"2024-09-18T01:28:36.676525+0000","last_deep_scrub":"35'29","last_deep_scrub_stamp":"2024-09-18T01:28:36.676525+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.676525+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:10.438462+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'285","reported_seq":385,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.872699+0000","last_change":"2024-09-18T01:25:14.707813+0000","last_active":"2024-09-18T01:28:23.872699+0000","last_peered":"2024-09-18T01:28:23.872699+0000","last_clean":"2024-09-18T01:28:23.872699+0000","last_became_active":"2024-09-18T01:25:14.707544+0000","last_became_peered":"2024-09-18T01:25:14.707544+0000","last_unstale":"2024-09-18T01:28:23.872699+0000","last_undegraded":"2024-09-18T01:28:23.872699+0000","last_fullsized":"2024-09-18T01:28:23.872699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:49.801346+0000","last_change":"2024-09-18T01:25:16.714182+0000","last_active":"2024-09-18T01:27:49.801346+0000","last_peered":"2024-09-18T01:27:49.801346+0000","last_clean":"2024-09-18T01:27:49.801346+0000","last_became_active":"2024-09-18T01:25:16.713458+0000","last_became_peered":"2024-09-18T01:25:16.713458+0000","last_unstale":"2024-09-18T01:27:49.801346+0000","last_undegraded":"2024-09-18T01:27:49.801346+0000","last_fullsized":"2024-09-18T01:27:49.801346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:32.799280+0000","last_change":"2024-09-18T01:25:08.681420+0000","last_active":"2024-09-18T01:27:32.799280+0000","last_peered":"2024-09-18T01:27:32.799280+0000","last_clean":"2024-09-18T01:27:32.799280+0000","last_became_active":"2024-09-18T01:25:08.680700+0000","last_became_peered":"2024-09-18T01:25:08.680700+0000","last_unstale":"2024-09-18T01:27:32.799280+0000","last_undegraded":"2024-09-18T01:27:32.799280+0000","last_fullsized":"2024-09-18T01:27:32.799280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'6","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799189+0000","last_change":"2024-09-18T01:25:06.691595+0000","last_active":"2024-09-18T01:27:29.799189+0000","last_peered":"2024-09-18T01:27:29.799189+0000","last_clean":"2024-09-18T01:27:29.799189+0000","last_became_active":"2024-09-18T01:25:06.691107+0000","last_became_peered":"2024-09-18T01:25:06.691107+0000","last_unstale":"2024-09-18T01:27:29.799189+0000","last_undegraded":"2024-09-18T01:27:29.799189+0000","last_fullsized":"2024-09-18T01:27:29.799189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.093957+0000","last_change":"2024-09-18T01:28:36.094004+0000","last_active":"2024-09-18T01:28:36.093957+0000","last_peered":"2024-09-18T01:28:36.093957+0000","last_clean":"2024-09-18T01:28:36.093957+0000","last_became_active":"2024-09-18T01:25:10.681273+0000","last_became_peered":"2024-09-18T01:25:10.681273+0000","last_unstale":"2024-09-18T01:28:36.093957+0000","last_undegraded":"2024-09-18T01:28:36.093957+0000","last_fullsized":"2024-09-18T01:28:36.093957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:36.093832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:36.093832+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.093832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:01.927384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'46","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.714556+0000","last_change":"2024-09-18T01:28:34.714630+0000","last_active":"2024-09-18T01:28:34.714556+0000","last_peered":"2024-09-18T01:28:34.714556+0000","last_clean":"2024-09-18T01:28:34.714556+0000","last_became_active":"2024-09-18T01:25:12.697114+0000","last_became_peered":"2024-09-18T01:25:12.697114+0000","last_unstale":"2024-09-18T01:28:34.714556+0000","last_undegraded":"2024-09-18T01:28:34.714556+0000","last_fullsized":"2024-09-18T01:28:34.714556+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:34.714456+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:34.714456+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.714456+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:50.227668+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":61,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":417,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.646306+0000","last_change":"2024-09-18T01:28:32.646333+0000","last_active":"2024-09-18T01:28:32.646306+0000","last_peered":"2024-09-18T01:28:32.646306+0000","last_clean":"2024-09-18T01:28:32.646306+0000","last_became_active":"2024-09-18T01:25:14.698792+0000","last_became_peered":"2024-09-18T01:25:14.698792+0000","last_unstale":"2024-09-18T01:28:32.646306+0000","last_undegraded":"2024-09-18T01:28:32.646306+0000","last_fullsized":"2024-09-18T01:28:32.646306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:32.646216+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:32.646216+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.646216+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:58:39.844651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153487+0000","last_change":"2024-09-18T01:25:08.680575+0000","last_active":"2024-09-18T01:28:17.153487+0000","last_peered":"2024-09-18T01:28:17.153487+0000","last_clean":"2024-09-18T01:28:17.153487+0000","last_became_active":"2024-09-18T01:25:08.680143+0000","last_became_peered":"2024-09-18T01:25:08.680143+0000","last_unstale":"2024-09-18T01:28:17.153487+0000","last_undegraded":"2024-09-18T01:28:17.153487+0000","last_fullsized":"2024-09-18T01:28:17.153487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.797634+0000","last_change":"2024-09-18T01:25:06.701050+0000","last_active":"2024-09-18T01:27:24.797634+0000","last_peered":"2024-09-18T01:27:24.797634+0000","last_clean":"2024-09-18T01:27:24.797634+0000","last_became_active":"2024-09-18T01:25:06.700650+0000","last_became_peered":"2024-09-18T01:25:06.700650+0000","last_unstale":"2024-09-18T01:27:24.797634+0000","last_undegraded":"2024-09-18T01:27:24.797634+0000","last_fullsized":"2024-09-18T01:27:24.797634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.335233+0000","last_change":"2024-09-18T01:28:37.335266+0000","last_active":"2024-09-18T01:28:37.335233+0000","last_peered":"2024-09-18T01:28:37.335233+0000","last_clean":"2024-09-18T01:28:37.335233+0000","last_became_active":"2024-09-18T01:25:10.683195+0000","last_became_peered":"2024-09-18T01:25:10.683195+0000","last_unstale":"2024-09-18T01:28:37.335233+0000","last_undegraded":"2024-09-18T01:28:37.335233+0000","last_fullsized":"2024-09-18T01:28:37.335233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:37.335139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:37.335139+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.335139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:26.770573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'59","reported_seq":125,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.709604+0000","last_change":"2024-09-18T01:28:38.709650+0000","last_active":"2024-09-18T01:28:38.709604+0000","last_peered":"2024-09-18T01:28:38.709604+0000","last_clean":"2024-09-18T01:28:38.709604+0000","last_became_active":"2024-09-18T01:25:12.687943+0000","last_became_peered":"2024-09-18T01:25:12.687943+0000","last_unstale":"2024-09-18T01:28:38.709604+0000","last_undegraded":"2024-09-18T01:28:38.709604+0000","last_fullsized":"2024-09-18T01:28:38.709604+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'59","last_scrub_stamp":"2024-09-18T01:28:38.709506+0000","last_deep_scrub":"35'59","last_deep_scrub_stamp":"2024-09-18T01:28:38.709506+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.709506+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:03.906269+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.615166+0000","last_change":"2024-09-18T01:28:33.615199+0000","last_active":"2024-09-18T01:28:33.615166+0000","last_peered":"2024-09-18T01:28:33.615166+0000","last_clean":"2024-09-18T01:28:33.615166+0000","last_became_active":"2024-09-18T01:25:14.698795+0000","last_became_peered":"2024-09-18T01:25:14.698795+0000","last_unstale":"2024-09-18T01:28:33.615166+0000","last_undegraded":"2024-09-18T01:28:33.615166+0000","last_fullsized":"2024-09-18T01:28:33.615166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:33.615076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:33.615076+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.615076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:23.050510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'3","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.709518+0000","last_change":"2024-09-18T01:28:37.709545+0000","last_active":"2024-09-18T01:28:37.709518+0000","last_peered":"2024-09-18T01:28:37.709518+0000","last_clean":"2024-09-18T01:28:37.709518+0000","last_became_active":"2024-09-18T01:25:16.707206+0000","last_became_peered":"2024-09-18T01:25:16.707206+0000","last_unstale":"2024-09-18T01:28:37.709518+0000","last_undegraded":"2024-09-18T01:28:37.709518+0000","last_fullsized":"2024-09-18T01:28:37.709518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:28:37.709423+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:28:37.709423+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.709423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:50:03.029261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.876193+0000","last_change":"2024-09-18T01:25:08.683170+0000","last_active":"2024-09-18T01:28:16.876193+0000","last_peered":"2024-09-18T01:28:16.876193+0000","last_clean":"2024-09-18T01:28:16.876193+0000","last_became_active":"2024-09-18T01:25:08.682878+0000","last_became_peered":"2024-09-18T01:25:08.682878+0000","last_unstale":"2024-09-18T01:28:16.876193+0000","last_undegraded":"2024-09-18T01:28:16.876193+0000","last_fullsized":"2024-09-18T01:28:16.876193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.173116+0000","last_change":"2024-09-18T01:25:06.700753+0000","last_active":"2024-09-18T01:28:17.173116+0000","last_peered":"2024-09-18T01:28:17.173116+0000","last_clean":"2024-09-18T01:28:17.173116+0000","last_became_active":"2024-09-18T01:25:06.700357+0000","last_became_peered":"2024-09-18T01:25:06.700357+0000","last_unstale":"2024-09-18T01:28:17.173116+0000","last_undegraded":"2024-09-18T01:28:17.173116+0000","last_fullsized":"2024-09-18T01:28:17.173116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":221,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.705806+0000","last_change":"2024-09-18T01:25:10.680004+0000","last_active":"2024-09-18T01:28:23.705806+0000","last_peered":"2024-09-18T01:28:23.705806+0000","last_clean":"2024-09-18T01:28:23.705806+0000","last_became_active":"2024-09-18T01:25:10.679652+0000","last_became_peered":"2024-09-18T01:25:10.679652+0000","last_unstale":"2024-09-18T01:28:23.705806+0000","last_undegraded":"2024-09-18T01:28:23.705806+0000","last_fullsized":"2024-09-18T01:28:23.705806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'43","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.069418+0000","last_change":"2024-09-18T01:28:33.069454+0000","last_active":"2024-09-18T01:28:33.069418+0000","last_peered":"2024-09-18T01:28:33.069418+0000","last_clean":"2024-09-18T01:28:33.069418+0000","last_became_active":"2024-09-18T01:25:12.691691+0000","last_became_peered":"2024-09-18T01:25:12.691691+0000","last_unstale":"2024-09-18T01:28:33.069418+0000","last_undegraded":"2024-09-18T01:28:33.069418+0000","last_fullsized":"2024-09-18T01:28:33.069418+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'43","last_scrub_stamp":"2024-09-18T01:28:33.069322+0000","last_deep_scrub":"35'43","last_deep_scrub_stamp":"2024-09-18T01:28:33.069322+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.069322+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:48.566800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.665588+0000","last_change":"2024-09-18T01:28:29.665641+0000","last_active":"2024-09-18T01:28:29.665588+0000","last_peered":"2024-09-18T01:28:29.665588+0000","last_clean":"2024-09-18T01:28:29.665588+0000","last_became_active":"2024-09-18T01:25:14.706505+0000","last_became_peered":"2024-09-18T01:25:14.706505+0000","last_unstale":"2024-09-18T01:28:29.665588+0000","last_undegraded":"2024-09-18T01:28:29.665588+0000","last_fullsized":"2024-09-18T01:28:29.665588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.665468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.665468+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.665468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:49:54.985306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'3","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798573+0000","last_change":"2024-09-18T01:25:16.713810+0000","last_active":"2024-09-18T01:27:24.798573+0000","last_peered":"2024-09-18T01:27:24.798573+0000","last_clean":"2024-09-18T01:27:24.798573+0000","last_became_active":"2024-09-18T01:25:16.713453+0000","last_became_peered":"2024-09-18T01:25:16.713453+0000","last_unstale":"2024-09-18T01:27:24.798573+0000","last_undegraded":"2024-09-18T01:27:24.798573+0000","last_fullsized":"2024-09-18T01:27:24.798573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'5","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.230735+0000","last_change":"2024-09-18T01:25:08.674795+0000","last_active":"2024-09-18T01:28:17.230735+0000","last_peered":"2024-09-18T01:28:17.230735+0000","last_clean":"2024-09-18T01:28:17.230735+0000","last_became_active":"2024-09-18T01:25:08.674525+0000","last_became_peered":"2024-09-18T01:25:08.674525+0000","last_unstale":"2024-09-18T01:28:17.230735+0000","last_undegraded":"2024-09-18T01:28:17.230735+0000","last_fullsized":"2024-09-18T01:28:17.230735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.085667+0000","last_change":"2024-09-18T01:25:06.696117+0000","last_active":"2024-09-18T01:28:17.085667+0000","last_peered":"2024-09-18T01:28:17.085667+0000","last_clean":"2024-09-18T01:28:17.085667+0000","last_became_active":"2024-09-18T01:25:06.694058+0000","last_became_peered":"2024-09-18T01:25:06.694058+0000","last_unstale":"2024-09-18T01:28:17.085667+0000","last_undegraded":"2024-09-18T01:28:17.085667+0000","last_fullsized":"2024-09-18T01:28:17.085667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:59.802731+0000","last_change":"2024-09-18T01:25:43.903991+0000","last_active":"2024-09-18T01:27:59.802731+0000","last_peered":"2024-09-18T01:27:59.802731+0000","last_clean":"2024-09-18T01:27:59.802731+0000","last_became_active":"2024-09-18T01:25:43.903638+0000","last_became_peered":"2024-09-18T01:25:43.903638+0000","last_unstale":"2024-09-18T01:27:59.802731+0000","last_undegraded":"2024-09-18T01:27:59.802731+0000","last_fullsized":"2024-09-18T01:27:59.802731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'51","reported_seq":113,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.847177+0000","last_change":"2024-09-18T01:25:12.694029+0000","last_active":"2024-09-18T01:28:23.847177+0000","last_peered":"2024-09-18T01:28:23.847177+0000","last_clean":"2024-09-18T01:28:23.847177+0000","last_became_active":"2024-09-18T01:25:12.693182+0000","last_became_peered":"2024-09-18T01:25:12.693182+0000","last_unstale":"2024-09-18T01:28:23.847177+0000","last_undegraded":"2024-09-18T01:28:23.847177+0000","last_fullsized":"2024-09-18T01:28:23.847177+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":360,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.671836+0000","last_change":"2024-09-18T01:28:28.671899+0000","last_active":"2024-09-18T01:28:28.671836+0000","last_peered":"2024-09-18T01:28:28.671836+0000","last_clean":"2024-09-18T01:28:28.671836+0000","last_became_active":"2024-09-18T01:25:14.706540+0000","last_became_peered":"2024-09-18T01:25:14.706540+0000","last_unstale":"2024-09-18T01:28:28.671836+0000","last_undegraded":"2024-09-18T01:28:28.671836+0000","last_fullsized":"2024-09-18T01:28:28.671836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:28.671739+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:28.671739+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.671739+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:02.156270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:27.798366+0000","last_change":"2024-09-18T01:25:16.714648+0000","last_active":"2024-09-18T01:27:27.798366+0000","last_peered":"2024-09-18T01:27:27.798366+0000","last_clean":"2024-09-18T01:27:27.798366+0000","last_became_active":"2024-09-18T01:25:16.714363+0000","last_became_peered":"2024-09-18T01:25:16.714363+0000","last_unstale":"2024-09-18T01:27:27.798366+0000","last_undegraded":"2024-09-18T01:27:27.798366+0000","last_fullsized":"2024-09-18T01:27:27.798366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.876103+0000","last_change":"2024-09-18T01:25:08.670862+0000","last_active":"2024-09-18T01:28:16.876103+0000","last_peered":"2024-09-18T01:28:16.876103+0000","last_clean":"2024-09-18T01:28:16.876103+0000","last_became_active":"2024-09-18T01:25:08.670617+0000","last_became_peered":"2024-09-18T01:25:08.670617+0000","last_unstale":"2024-09-18T01:28:16.876103+0000","last_undegraded":"2024-09-18T01:28:16.876103+0000","last_fullsized":"2024-09-18T01:28:16.876103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798228+0000","last_change":"2024-09-18T01:25:06.693637+0000","last_active":"2024-09-18T01:27:24.798228+0000","last_peered":"2024-09-18T01:27:24.798228+0000","last_clean":"2024-09-18T01:27:24.798228+0000","last_became_active":"2024-09-18T01:25:06.689545+0000","last_became_peered":"2024-09-18T01:25:06.689545+0000","last_unstale":"2024-09-18T01:27:24.798228+0000","last_undegraded":"2024-09-18T01:27:24.798228+0000","last_fullsized":"2024-09-18T01:27:24.798228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:54.802027+0000","last_change":"2024-09-18T01:25:43.907490+0000","last_active":"2024-09-18T01:27:54.802027+0000","last_peered":"2024-09-18T01:27:54.802027+0000","last_clean":"2024-09-18T01:27:54.802027+0000","last_became_active":"2024-09-18T01:25:43.907094+0000","last_became_peered":"2024-09-18T01:25:43.907094+0000","last_unstale":"2024-09-18T01:27:54.802027+0000","last_undegraded":"2024-09-18T01:27:54.802027+0000","last_fullsized":"2024-09-18T01:27:54.802027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'74","reported_seq":151,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.860389+0000","last_change":"2024-09-18T01:25:12.693226+0000","last_active":"2024-09-18T01:28:23.860389+0000","last_peered":"2024-09-18T01:28:23.860389+0000","last_clean":"2024-09-18T01:28:23.860389+0000","last_became_active":"2024-09-18T01:25:12.692821+0000","last_became_peered":"2024-09-18T01:25:12.692821+0000","last_unstale":"2024-09-18T01:28:23.860389+0000","last_undegraded":"2024-09-18T01:28:23.860389+0000","last_fullsized":"2024-09-18T01:28:23.860389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":84,"num_read_kb":81,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:27.798236+0000","last_change":"2024-09-18T01:25:14.707691+0000","last_active":"2024-09-18T01:27:27.798236+0000","last_peered":"2024-09-18T01:27:27.798236+0000","last_clean":"2024-09-18T01:27:27.798236+0000","last_became_active":"2024-09-18T01:25:14.707514+0000","last_became_peered":"2024-09-18T01:25:14.707514+0000","last_unstale":"2024-09-18T01:27:27.798236+0000","last_undegraded":"2024-09-18T01:27:27.798236+0000","last_fullsized":"2024-09-18T01:27:27.798236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.275086+0000","last_change":"2024-09-18T01:25:16.706301+0000","last_active":"2024-09-18T01:28:17.275086+0000","last_peered":"2024-09-18T01:28:17.275086+0000","last_clean":"2024-09-18T01:28:17.275086+0000","last_became_active":"2024-09-18T01:25:16.705938+0000","last_became_peered":"2024-09-18T01:25:16.705938+0000","last_unstale":"2024-09-18T01:28:17.275086+0000","last_undegraded":"2024-09-18T01:28:17.275086+0000","last_fullsized":"2024-09-18T01:28:17.275086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183497+0000","last_change":"2024-09-18T01:25:08.687495+0000","last_active":"2024-09-18T01:28:17.183497+0000","last_peered":"2024-09-18T01:28:17.183497+0000","last_clean":"2024-09-18T01:28:17.183497+0000","last_became_active":"2024-09-18T01:25:08.687135+0000","last_became_peered":"2024-09-18T01:25:08.687135+0000","last_unstale":"2024-09-18T01:28:17.183497+0000","last_undegraded":"2024-09-18T01:28:17.183497+0000","last_fullsized":"2024-09-18T01:28:17.183497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:22.797633+0000","last_change":"2024-09-18T01:25:06.681219+0000","last_active":"2024-09-18T01:27:22.797633+0000","last_peered":"2024-09-18T01:27:22.797633+0000","last_clean":"2024-09-18T01:27:22.797633+0000","last_became_active":"2024-09-18T01:25:06.680774+0000","last_became_peered":"2024-09-18T01:25:06.680774+0000","last_unstale":"2024-09-18T01:27:22.797633+0000","last_undegraded":"2024-09-18T01:27:22.797633+0000","last_fullsized":"2024-09-18T01:27:22.797633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.797579+0000","last_change":"2024-09-18T01:25:10.675268+0000","last_active":"2024-09-18T01:27:24.797579+0000","last_peered":"2024-09-18T01:27:24.797579+0000","last_clean":"2024-09-18T01:27:24.797579+0000","last_became_active":"2024-09-18T01:25:10.674983+0000","last_became_peered":"2024-09-18T01:25:10.674983+0000","last_unstale":"2024-09-18T01:27:24.797579+0000","last_undegraded":"2024-09-18T01:27:24.797579+0000","last_fullsized":"2024-09-18T01:27:24.797579+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'46","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.373357+0000","last_change":"2024-09-18T01:28:33.373391+0000","last_active":"2024-09-18T01:28:33.373357+0000","last_peered":"2024-09-18T01:28:33.373357+0000","last_clean":"2024-09-18T01:28:33.373357+0000","last_became_active":"2024-09-18T01:25:12.683339+0000","last_became_peered":"2024-09-18T01:25:12.683339+0000","last_unstale":"2024-09-18T01:28:33.373357+0000","last_undegraded":"2024-09-18T01:28:33.373357+0000","last_fullsized":"2024-09-18T01:28:33.373357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:33.373272+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:33.373272+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.373272+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:10:34.585302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799233+0000","last_change":"2024-09-18T01:25:14.708366+0000","last_active":"2024-09-18T01:27:29.799233+0000","last_peered":"2024-09-18T01:27:29.799233+0000","last_clean":"2024-09-18T01:27:29.799233+0000","last_became_active":"2024-09-18T01:25:14.707116+0000","last_became_peered":"2024-09-18T01:25:14.707116+0000","last_unstale":"2024-09-18T01:27:29.799233+0000","last_undegraded":"2024-09-18T01:27:29.799233+0000","last_fullsized":"2024-09-18T01:27:29.799233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.234156+0000","last_change":"2024-09-18T01:25:16.708368+0000","last_active":"2024-09-18T01:28:17.234156+0000","last_peered":"2024-09-18T01:28:17.234156+0000","last_clean":"2024-09-18T01:28:17.234156+0000","last_became_active":"2024-09-18T01:25:16.708095+0000","last_became_peered":"2024-09-18T01:25:16.708095+0000","last_unstale":"2024-09-18T01:28:17.234156+0000","last_undegraded":"2024-09-18T01:28:17.234156+0000","last_fullsized":"2024-09-18T01:28:17.234156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.038065+0000","last_change":"2024-09-18T01:28:42.038123+0000","last_active":"2024-09-18T01:28:42.038065+0000","last_peered":"2024-09-18T01:28:42.038065+0000","last_clean":"2024-09-18T01:28:42.038065+0000","last_became_active":"2024-09-18T01:25:08.688251+0000","last_became_peered":"2024-09-18T01:25:08.688251+0000","last_unstale":"2024-09-18T01:28:42.038065+0000","last_undegraded":"2024-09-18T01:28:42.038065+0000","last_fullsized":"2024-09-18T01:28:42.038065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:42.037965+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:42.037965+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.037965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:21:09.764214+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.854553+0000","last_change":"2024-09-18T01:25:06.684669+0000","last_active":"2024-09-18T01:28:23.854553+0000","last_peered":"2024-09-18T01:28:23.854553+0000","last_clean":"2024-09-18T01:28:23.854553+0000","last_became_active":"2024-09-18T01:25:06.683437+0000","last_became_peered":"2024-09-18T01:25:06.683437+0000","last_unstale":"2024-09-18T01:28:23.854553+0000","last_undegraded":"2024-09-18T01:28:23.854553+0000","last_fullsized":"2024-09-18T01:28:23.854553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:27.798336+0000","last_change":"2024-09-18T01:25:10.680258+0000","last_active":"2024-09-18T01:27:27.798336+0000","last_peered":"2024-09-18T01:27:27.798336+0000","last_clean":"2024-09-18T01:27:27.798336+0000","last_became_active":"2024-09-18T01:25:10.679740+0000","last_became_peered":"2024-09-18T01:25:10.679740+0000","last_unstale":"2024-09-18T01:27:27.798336+0000","last_undegraded":"2024-09-18T01:27:27.798336+0000","last_fullsized":"2024-09-18T01:27:27.798336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'45","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.694703+0000","last_change":"2024-09-18T01:28:40.694748+0000","last_active":"2024-09-18T01:28:40.694703+0000","last_peered":"2024-09-18T01:28:40.694703+0000","last_clean":"2024-09-18T01:28:40.694703+0000","last_became_active":"2024-09-18T01:25:12.686455+0000","last_became_peered":"2024-09-18T01:25:12.686455+0000","last_unstale":"2024-09-18T01:28:40.694703+0000","last_undegraded":"2024-09-18T01:28:40.694703+0000","last_fullsized":"2024-09-18T01:28:40.694703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-18T01:28:40.694620+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-18T01:28:40.694620+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.694620+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:30.077444+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":415,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.649222+0000","last_change":"2024-09-18T01:28:30.649256+0000","last_active":"2024-09-18T01:28:30.649222+0000","last_peered":"2024-09-18T01:28:30.649222+0000","last_clean":"2024-09-18T01:28:30.649222+0000","last_became_active":"2024-09-18T01:25:14.703877+0000","last_became_peered":"2024-09-18T01:25:14.703877+0000","last_unstale":"2024-09-18T01:28:30.649222+0000","last_undegraded":"2024-09-18T01:28:30.649222+0000","last_fullsized":"2024-09-18T01:28:30.649222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:30.649113+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:30.649113+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.649113+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:03.499336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'12","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.235860+0000","last_change":"2024-09-18T01:25:16.714095+0000","last_active":"2024-09-18T01:28:17.235860+0000","last_peered":"2024-09-18T01:28:17.235860+0000","last_clean":"2024-09-18T01:28:17.235860+0000","last_became_active":"2024-09-18T01:25:16.713677+0000","last_became_peered":"2024-09-18T01:25:16.713677+0000","last_unstale":"2024-09-18T01:28:17.235860+0000","last_undegraded":"2024-09-18T01:28:17.235860+0000","last_fullsized":"2024-09-18T01:28:17.235860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.963324+0000","last_change":"2024-09-18T01:25:08.673535+0000","last_active":"2024-09-18T01:28:16.963324+0000","last_peered":"2024-09-18T01:28:16.963324+0000","last_clean":"2024-09-18T01:28:16.963324+0000","last_became_active":"2024-09-18T01:25:08.673276+0000","last_became_peered":"2024-09-18T01:25:08.673276+0000","last_unstale":"2024-09-18T01:28:16.963324+0000","last_undegraded":"2024-09-18T01:28:16.963324+0000","last_fullsized":"2024-09-18T01:28:16.963324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797377+0000","last_change":"2024-09-18T01:25:06.683319+0000","last_active":"2024-09-18T01:27:19.797377+0000","last_peered":"2024-09-18T01:27:19.797377+0000","last_clean":"2024-09-18T01:27:19.797377+0000","last_became_active":"2024-09-18T01:25:06.682841+0000","last_became_peered":"2024-09-18T01:25:06.682841+0000","last_unstale":"2024-09-18T01:27:19.797377+0000","last_undegraded":"2024-09-18T01:27:19.797377+0000","last_fullsized":"2024-09-18T01:27:19.797377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":428,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.267239+0000","last_change":"2024-09-18T01:28:40.267271+0000","last_active":"2024-09-18T01:28:40.267239+0000","last_peered":"2024-09-18T01:28:40.267239+0000","last_clean":"2024-09-18T01:28:40.267239+0000","last_became_active":"2024-09-18T01:25:10.679483+0000","last_became_peered":"2024-09-18T01:25:10.679483+0000","last_unstale":"2024-09-18T01:28:40.267239+0000","last_undegraded":"2024-09-18T01:28:40.267239+0000","last_fullsized":"2024-09-18T01:28:40.267239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-18T01:28:40.267152+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-18T01:28:40.267152+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.267152+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:35.825702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799171+0000","last_change":"2024-09-18T01:25:12.697050+0000","last_active":"2024-09-18T01:27:29.799171+0000","last_peered":"2024-09-18T01:27:29.799171+0000","last_clean":"2024-09-18T01:27:29.799171+0000","last_became_active":"2024-09-18T01:25:12.696726+0000","last_became_peered":"2024-09-18T01:25:12.696726+0000","last_unstale":"2024-09-18T01:27:29.799171+0000","last_undegraded":"2024-09-18T01:27:29.799171+0000","last_fullsized":"2024-09-18T01:27:29.799171+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":522,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.350851+0000","last_change":"2024-09-18T01:28:35.350881+0000","last_active":"2024-09-18T01:28:35.350851+0000","last_peered":"2024-09-18T01:28:35.350851+0000","last_clean":"2024-09-18T01:28:35.350851+0000","last_became_active":"2024-09-18T01:25:14.702900+0000","last_became_peered":"2024-09-18T01:25:14.702900+0000","last_unstale":"2024-09-18T01:28:35.350851+0000","last_undegraded":"2024-09-18T01:28:35.350851+0000","last_fullsized":"2024-09-18T01:28:35.350851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:35.350746+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:35.350746+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.350746+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:24.733569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.703207+0000","last_change":"2024-09-18T01:28:41.703271+0000","last_active":"2024-09-18T01:28:41.703207+0000","last_peered":"2024-09-18T01:28:41.703207+0000","last_clean":"2024-09-18T01:28:41.703207+0000","last_became_active":"2024-09-18T01:25:16.712084+0000","last_became_peered":"2024-09-18T01:25:16.712084+0000","last_unstale":"2024-09-18T01:28:41.703207+0000","last_undegraded":"2024-09-18T01:28:41.703207+0000","last_fullsized":"2024-09-18T01:28:41.703207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:41.703089+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:41.703089+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.703089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:26:56.294603+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153486+0000","last_change":"2024-09-18T01:25:08.687109+0000","last_active":"2024-09-18T01:28:17.153486+0000","last_peered":"2024-09-18T01:28:17.153486+0000","last_clean":"2024-09-18T01:28:17.153486+0000","last_became_active":"2024-09-18T01:25:08.686802+0000","last_became_peered":"2024-09-18T01:25:08.686802+0000","last_unstale":"2024-09-18T01:28:17.153486+0000","last_undegraded":"2024-09-18T01:28:17.153486+0000","last_fullsized":"2024-09-18T01:28:17.153486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.082427+0000","last_change":"2024-09-18T01:25:06.695782+0000","last_active":"2024-09-18T01:28:17.082427+0000","last_peered":"2024-09-18T01:28:17.082427+0000","last_clean":"2024-09-18T01:28:17.082427+0000","last_became_active":"2024-09-18T01:25:06.691644+0000","last_became_peered":"2024-09-18T01:25:06.691644+0000","last_unstale":"2024-09-18T01:28:17.082427+0000","last_undegraded":"2024-09-18T01:28:17.082427+0000","last_fullsized":"2024-09-18T01:28:17.082427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.109354+0000","last_change":"2024-09-18T01:28:32.109380+0000","last_active":"2024-09-18T01:28:32.109354+0000","last_peered":"2024-09-18T01:28:32.109354+0000","last_clean":"2024-09-18T01:28:32.109354+0000","last_became_active":"2024-09-18T01:25:10.682075+0000","last_became_peered":"2024-09-18T01:25:10.682075+0000","last_unstale":"2024-09-18T01:28:32.109354+0000","last_undegraded":"2024-09-18T01:28:32.109354+0000","last_fullsized":"2024-09-18T01:28:32.109354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:32.109232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:32.109232+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.109232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:37.084368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'49","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.423913+0000","last_change":"2024-09-18T01:28:32.423980+0000","last_active":"2024-09-18T01:28:32.423913+0000","last_peered":"2024-09-18T01:28:32.423913+0000","last_clean":"2024-09-18T01:28:32.423913+0000","last_became_active":"2024-09-18T01:25:12.686460+0000","last_became_peered":"2024-09-18T01:25:12.686460+0000","last_unstale":"2024-09-18T01:28:32.423913+0000","last_undegraded":"2024-09-18T01:28:32.423913+0000","last_fullsized":"2024-09-18T01:28:32.423913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-09-18T01:28:32.423801+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-09-18T01:28:32.423801+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.423801+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:00:55.455121+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.575274+0000","last_change":"2024-09-18T01:28:27.575318+0000","last_active":"2024-09-18T01:28:27.575274+0000","last_peered":"2024-09-18T01:28:27.575274+0000","last_clean":"2024-09-18T01:28:27.575274+0000","last_became_active":"2024-09-18T01:25:14.706506+0000","last_became_peered":"2024-09-18T01:25:14.706506+0000","last_unstale":"2024-09-18T01:28:27.575274+0000","last_undegraded":"2024-09-18T01:28:27.575274+0000","last_fullsized":"2024-09-18T01:28:27.575274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:27.575151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:27.575151+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.575151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:28.541634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'6","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.273407+0000","last_change":"2024-09-18T01:25:16.709338+0000","last_active":"2024-09-18T01:28:17.273407+0000","last_peered":"2024-09-18T01:28:17.273407+0000","last_clean":"2024-09-18T01:28:17.273407+0000","last_became_active":"2024-09-18T01:25:16.709084+0000","last_became_peered":"2024-09-18T01:25:16.709084+0000","last_unstale":"2024-09-18T01:28:17.273407+0000","last_undegraded":"2024-09-18T01:28:17.273407+0000","last_fullsized":"2024-09-18T01:28:17.273407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'7","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.022778+0000","last_change":"2024-09-18T01:28:44.022803+0000","last_active":"2024-09-18T01:28:44.022778+0000","last_peered":"2024-09-18T01:28:44.022778+0000","last_clean":"2024-09-18T01:28:44.022778+0000","last_became_active":"2024-09-18T01:25:08.687896+0000","last_became_peered":"2024-09-18T01:25:08.687896+0000","last_unstale":"2024-09-18T01:28:44.022778+0000","last_undegraded":"2024-09-18T01:28:44.022778+0000","last_fullsized":"2024-09-18T01:28:44.022778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:28:44.022693+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:28:44.022693+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.022693+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:27.889066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":205,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:54.794605+0000","last_change":"2024-09-18T01:24:52.297138+0000","last_active":"2024-09-18T01:26:54.794605+0000","last_peered":"2024-09-18T01:26:54.794605+0000","last_clean":"2024-09-18T01:26:54.794605+0000","last_became_active":"2024-09-18T01:24:52.296214+0000","last_became_peered":"2024-09-18T01:24:52.296214+0000","last_unstale":"2024-09-18T01:26:54.794605+0000","last_undegraded":"2024-09-18T01:26:54.794605+0000","last_fullsized":"2024-09-18T01:26:54.794605+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_clean_scrub_stamp":"2024-09-18T01:24:51.161687+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:04.795123+0000","last_change":"2024-09-18T01:24:58.197569+0000","last_active":"2024-09-18T01:27:04.795123+0000","last_peered":"2024-09-18T01:27:04.795123+0000","last_clean":"2024-09-18T01:27:04.795123+0000","last_became_active":"2024-09-18T01:24:56.194443+0000","last_became_peered":"2024-09-18T01:24:56.194443+0000","last_unstale":"2024-09-18T01:27:04.795123+0000","last_undegraded":"2024-09-18T01:27:04.795123+0000","last_fullsized":"2024-09-18T01:27:04.795123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033763700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.853099+0000","last_change":"2024-09-18T01:25:06.684714+0000","last_active":"2024-09-18T01:28:16.853099+0000","last_peered":"2024-09-18T01:28:16.853099+0000","last_clean":"2024-09-18T01:28:16.853099+0000","last_became_active":"2024-09-18T01:25:06.683975+0000","last_became_peered":"2024-09-18T01:25:06.683975+0000","last_unstale":"2024-09-18T01:28:16.853099+0000","last_undegraded":"2024-09-18T01:28:16.853099+0000","last_fullsized":"2024-09-18T01:28:16.853099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.273056+0000","last_change":"2024-09-18T01:28:41.273084+0000","last_active":"2024-09-18T01:28:41.273056+0000","last_peered":"2024-09-18T01:28:41.273056+0000","last_clean":"2024-09-18T01:28:41.273056+0000","last_became_active":"2024-09-18T01:25:10.679572+0000","last_became_peered":"2024-09-18T01:25:10.679572+0000","last_unstale":"2024-09-18T01:28:41.273056+0000","last_undegraded":"2024-09-18T01:28:41.273056+0000","last_fullsized":"2024-09-18T01:28:41.273056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:41.272968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:41.272968+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.272968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:18:48.599189+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'94","reported_seq":190,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.133511+0000","last_change":"2024-09-18T01:28:39.133548+0000","last_active":"2024-09-18T01:28:39.133511+0000","last_peered":"2024-09-18T01:28:39.133511+0000","last_clean":"2024-09-18T01:28:39.133511+0000","last_became_active":"2024-09-18T01:25:12.691952+0000","last_became_peered":"2024-09-18T01:25:12.691952+0000","last_unstale":"2024-09-18T01:28:39.133511+0000","last_undegraded":"2024-09-18T01:28:39.133511+0000","last_fullsized":"2024-09-18T01:28:39.133511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'94","last_scrub_stamp":"2024-09-18T01:28:39.133419+0000","last_deep_scrub":"35'94","last_deep_scrub_stamp":"2024-09-18T01:28:39.133419+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.133419+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:11:05.713633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.670335+0000","last_change":"2024-09-18T01:28:31.670355+0000","last_active":"2024-09-18T01:28:31.670335+0000","last_peered":"2024-09-18T01:28:31.670335+0000","last_clean":"2024-09-18T01:28:31.670335+0000","last_became_active":"2024-09-18T01:25:14.706519+0000","last_became_peered":"2024-09-18T01:25:14.706519+0000","last_unstale":"2024-09-18T01:28:31.670335+0000","last_undegraded":"2024-09-18T01:28:31.670335+0000","last_fullsized":"2024-09-18T01:28:31.670335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.670230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.670230+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.670230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:37.902202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'85","reported_seq":169,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.190141+0000","last_change":"2024-09-18T01:25:16.712377+0000","last_active":"2024-09-18T01:28:17.190141+0000","last_peered":"2024-09-18T01:28:17.190141+0000","last_clean":"2024-09-18T01:28:17.190141+0000","last_became_active":"2024-09-18T01:25:16.712102+0000","last_became_peered":"2024-09-18T01:25:16.712102+0000","last_unstale":"2024-09-18T01:28:17.190141+0000","last_undegraded":"2024-09-18T01:28:17.190141+0000","last_fullsized":"2024-09-18T01:28:17.190141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":221,"num_write":168,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'7","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.228113+0000","last_change":"2024-09-18T01:25:08.672900+0000","last_active":"2024-09-18T01:28:17.228113+0000","last_peered":"2024-09-18T01:28:17.228113+0000","last_clean":"2024-09-18T01:28:17.228113+0000","last_became_active":"2024-09-18T01:25:08.671578+0000","last_became_peered":"2024-09-18T01:25:08.671578+0000","last_unstale":"2024-09-18T01:28:17.228113+0000","last_undegraded":"2024-09-18T01:28:17.228113+0000","last_fullsized":"2024-09-18T01:28:17.228113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:26:59.794321+0000","last_change":"2024-09-18T01:24:58.197615+0000","last_active":"2024-09-18T01:26:59.794321+0000","last_peered":"2024-09-18T01:26:59.794321+0000","last_clean":"2024-09-18T01:26:59.794321+0000","last_became_active":"2024-09-18T01:24:56.191554+0000","last_became_peered":"2024-09-18T01:24:56.191554+0000","last_unstale":"2024-09-18T01:26:59.794321+0000","last_undegraded":"2024-09-18T01:26:59.794321+0000","last_fullsized":"2024-09-18T01:26:59.794321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041584599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.795950+0000","last_change":"2024-09-18T01:25:06.681216+0000","last_active":"2024-09-18T01:27:12.795950+0000","last_peered":"2024-09-18T01:27:12.795950+0000","last_clean":"2024-09-18T01:27:12.795950+0000","last_became_active":"2024-09-18T01:25:06.680635+0000","last_became_peered":"2024-09-18T01:25:06.680635+0000","last_unstale":"2024-09-18T01:27:12.795950+0000","last_undegraded":"2024-09-18T01:27:12.795950+0000","last_fullsized":"2024-09-18T01:27:12.795950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.041908+0000","last_change":"2024-09-18T01:28:34.041935+0000","last_active":"2024-09-18T01:28:34.041908+0000","last_peered":"2024-09-18T01:28:34.041908+0000","last_clean":"2024-09-18T01:28:34.041908+0000","last_became_active":"2024-09-18T01:25:10.681988+0000","last_became_peered":"2024-09-18T01:25:10.681988+0000","last_unstale":"2024-09-18T01:28:34.041908+0000","last_undegraded":"2024-09-18T01:28:34.041908+0000","last_fullsized":"2024-09-18T01:28:34.041908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:34.041811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:34.041811+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.041811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:05:37.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'297","reported_seq":528,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.359366+0000","last_change":"2024-09-18T01:28:27.359441+0000","last_active":"2024-09-18T01:28:27.359366+0000","last_peered":"2024-09-18T01:28:27.359366+0000","last_clean":"2024-09-18T01:28:27.359366+0000","last_became_active":"2024-09-18T01:25:12.693664+0000","last_became_peered":"2024-09-18T01:25:12.693664+0000","last_unstale":"2024-09-18T01:28:27.359366+0000","last_undegraded":"2024-09-18T01:28:27.359366+0000","last_fullsized":"2024-09-18T01:28:27.359366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'297","last_scrub_stamp":"2024-09-18T01:28:27.359261+0000","last_deep_scrub":"35'297","last_deep_scrub_stamp":"2024-09-18T01:28:27.359261+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.359261+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:28:05.502483+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797480+0000","last_change":"2024-09-18T01:25:14.707563+0000","last_active":"2024-09-18T01:27:19.797480+0000","last_peered":"2024-09-18T01:27:19.797480+0000","last_clean":"2024-09-18T01:27:19.797480+0000","last_became_active":"2024-09-18T01:25:14.707143+0000","last_became_peered":"2024-09-18T01:25:14.707143+0000","last_unstale":"2024-09-18T01:27:19.797480+0000","last_undegraded":"2024-09-18T01:27:19.797480+0000","last_fullsized":"2024-09-18T01:27:19.797480+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.101097+0000","last_change":"2024-09-18T01:25:16.714554+0000","last_active":"2024-09-18T01:28:17.101097+0000","last_peered":"2024-09-18T01:28:17.101097+0000","last_clean":"2024-09-18T01:28:17.101097+0000","last_became_active":"2024-09-18T01:25:16.712931+0000","last_became_peered":"2024-09-18T01:25:16.712931+0000","last_unstale":"2024-09-18T01:28:17.101097+0000","last_undegraded":"2024-09-18T01:28:17.101097+0000","last_fullsized":"2024-09-18T01:28:17.101097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.962705+0000","last_change":"2024-09-18T01:25:08.681154+0000","last_active":"2024-09-18T01:28:16.962705+0000","last_peered":"2024-09-18T01:28:16.962705+0000","last_clean":"2024-09-18T01:28:16.962705+0000","last_became_active":"2024-09-18T01:25:08.680541+0000","last_became_peered":"2024-09-18T01:25:08.680541+0000","last_unstale":"2024-09-18T01:28:16.962705+0000","last_undegraded":"2024-09-18T01:28:16.962705+0000","last_fullsized":"2024-09-18T01:28:16.962705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:04.794550+0000","last_change":"2024-09-18T01:24:58.350485+0000","last_active":"2024-09-18T01:27:04.794550+0000","last_peered":"2024-09-18T01:27:04.794550+0000","last_clean":"2024-09-18T01:27:04.794550+0000","last_became_active":"2024-09-18T01:24:56.191162+0000","last_became_peered":"2024-09-18T01:24:56.191162+0000","last_unstale":"2024-09-18T01:27:04.794550+0000","last_undegraded":"2024-09-18T01:27:04.794550+0000","last_fullsized":"2024-09-18T01:27:04.794550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040921399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.855438+0000","last_change":"2024-09-18T01:25:06.686498+0000","last_active":"2024-09-18T01:28:23.855438+0000","last_peered":"2024-09-18T01:28:23.855438+0000","last_clean":"2024-09-18T01:28:23.855438+0000","last_became_active":"2024-09-18T01:25:06.686053+0000","last_became_peered":"2024-09-18T01:25:06.686053+0000","last_unstale":"2024-09-18T01:28:23.855438+0000","last_undegraded":"2024-09-18T01:28:23.855438+0000","last_fullsized":"2024-09-18T01:28:23.855438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.796884+0000","last_change":"2024-09-18T01:25:10.677853+0000","last_active":"2024-09-18T01:27:19.796884+0000","last_peered":"2024-09-18T01:27:19.796884+0000","last_clean":"2024-09-18T01:27:19.796884+0000","last_became_active":"2024-09-18T01:25:10.677597+0000","last_became_peered":"2024-09-18T01:25:10.677597+0000","last_unstale":"2024-09-18T01:27:19.796884+0000","last_undegraded":"2024-09-18T01:27:19.796884+0000","last_fullsized":"2024-09-18T01:27:19.796884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'23","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.678836+0000","last_change":"2024-09-18T01:28:39.678878+0000","last_active":"2024-09-18T01:28:39.678836+0000","last_peered":"2024-09-18T01:28:39.678836+0000","last_clean":"2024-09-18T01:28:39.678836+0000","last_became_active":"2024-09-18T01:25:12.687799+0000","last_became_peered":"2024-09-18T01:25:12.687799+0000","last_unstale":"2024-09-18T01:28:39.678836+0000","last_undegraded":"2024-09-18T01:28:39.678836+0000","last_fullsized":"2024-09-18T01:28:39.678836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-09-18T01:28:39.678752+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-09-18T01:28:39.678752+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.678752+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:45.910724+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.698381+0000","last_change":"2024-09-18T01:28:27.698401+0000","last_active":"2024-09-18T01:28:27.698381+0000","last_peered":"2024-09-18T01:28:27.698381+0000","last_clean":"2024-09-18T01:28:27.698381+0000","last_became_active":"2024-09-18T01:25:14.706611+0000","last_became_peered":"2024-09-18T01:25:14.706611+0000","last_unstale":"2024-09-18T01:28:27.698381+0000","last_undegraded":"2024-09-18T01:28:27.698381+0000","last_fullsized":"2024-09-18T01:28:27.698381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:27.698307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:27.698307+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.698307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:17.902689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799910+0000","last_change":"2024-09-18T01:25:16.711670+0000","last_active":"2024-09-18T01:27:34.799910+0000","last_peered":"2024-09-18T01:27:34.799910+0000","last_clean":"2024-09-18T01:27:34.799910+0000","last_became_active":"2024-09-18T01:25:16.711404+0000","last_became_peered":"2024-09-18T01:25:16.711404+0000","last_unstale":"2024-09-18T01:27:34.799910+0000","last_undegraded":"2024-09-18T01:27:34.799910+0000","last_fullsized":"2024-09-18T01:27:34.799910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.103574+0000","last_change":"2024-09-18T01:25:08.673345+0000","last_active":"2024-09-18T01:28:17.103574+0000","last_peered":"2024-09-18T01:28:17.103574+0000","last_clean":"2024-09-18T01:28:17.103574+0000","last_became_active":"2024-09-18T01:25:08.672969+0000","last_became_peered":"2024-09-18T01:25:08.672969+0000","last_unstale":"2024-09-18T01:28:17.103574+0000","last_undegraded":"2024-09-18T01:28:17.103574+0000","last_fullsized":"2024-09-18T01:28:17.103574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:04.795077+0000","last_change":"2024-09-18T01:24:58.198236+0000","last_active":"2024-09-18T01:27:04.795077+0000","last_peered":"2024-09-18T01:27:04.795077+0000","last_clean":"2024-09-18T01:27:04.795077+0000","last_became_active":"2024-09-18T01:24:56.191713+0000","last_became_peered":"2024-09-18T01:24:56.191713+0000","last_unstale":"2024-09-18T01:27:04.795077+0000","last_undegraded":"2024-09-18T01:27:04.795077+0000","last_fullsized":"2024-09-18T01:27:04.795077+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010043490000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.795992+0000","last_change":"2024-09-18T01:25:06.700684+0000","last_active":"2024-09-18T01:27:14.795992+0000","last_peered":"2024-09-18T01:27:14.795992+0000","last_clean":"2024-09-18T01:27:14.795992+0000","last_became_active":"2024-09-18T01:25:06.700397+0000","last_became_peered":"2024-09-18T01:25:06.700397+0000","last_unstale":"2024-09-18T01:27:14.795992+0000","last_undegraded":"2024-09-18T01:27:14.795992+0000","last_fullsized":"2024-09-18T01:27:14.795992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:17.796734+0000","last_change":"2024-09-18T01:25:10.676620+0000","last_active":"2024-09-18T01:27:17.796734+0000","last_peered":"2024-09-18T01:27:17.796734+0000","last_clean":"2024-09-18T01:27:17.796734+0000","last_became_active":"2024-09-18T01:25:10.676320+0000","last_became_peered":"2024-09-18T01:25:10.676320+0000","last_unstale":"2024-09-18T01:27:17.796734+0000","last_undegraded":"2024-09-18T01:27:17.796734+0000","last_fullsized":"2024-09-18T01:27:17.796734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'20","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.994925+0000","last_change":"2024-09-18T01:28:42.995001+0000","last_active":"2024-09-18T01:28:42.994925+0000","last_peered":"2024-09-18T01:28:42.994925+0000","last_clean":"2024-09-18T01:28:42.994925+0000","last_became_active":"2024-09-18T01:25:12.692373+0000","last_became_peered":"2024-09-18T01:25:12.692373+0000","last_unstale":"2024-09-18T01:28:42.994925+0000","last_undegraded":"2024-09-18T01:28:42.994925+0000","last_fullsized":"2024-09-18T01:28:42.994925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:28:42.994815+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:28:42.994815+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.994815+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:43.271590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798375+0000","last_change":"2024-09-18T01:25:14.709358+0000","last_active":"2024-09-18T01:27:24.798375+0000","last_peered":"2024-09-18T01:27:24.798375+0000","last_clean":"2024-09-18T01:27:24.798375+0000","last_became_active":"2024-09-18T01:25:14.707409+0000","last_became_peered":"2024-09-18T01:25:14.707409+0000","last_unstale":"2024-09-18T01:27:24.798375+0000","last_undegraded":"2024-09-18T01:27:24.798375+0000","last_fullsized":"2024-09-18T01:27:24.798375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'6","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799160+0000","last_change":"2024-09-18T01:25:16.711391+0000","last_active":"2024-09-18T01:27:29.799160+0000","last_peered":"2024-09-18T01:27:29.799160+0000","last_clean":"2024-09-18T01:27:29.799160+0000","last_became_active":"2024-09-18T01:25:16.711104+0000","last_became_peered":"2024-09-18T01:25:16.711104+0000","last_unstale":"2024-09-18T01:27:29.799160+0000","last_undegraded":"2024-09-18T01:27:29.799160+0000","last_fullsized":"2024-09-18T01:27:29.799160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.797163+0000","last_change":"2024-09-18T01:25:08.687474+0000","last_active":"2024-09-18T01:27:14.797163+0000","last_peered":"2024-09-18T01:27:14.797163+0000","last_clean":"2024-09-18T01:27:14.797163+0000","last_became_active":"2024-09-18T01:25:08.687139+0000","last_became_peered":"2024-09-18T01:25:08.687139+0000","last_unstale":"2024-09-18T01:27:14.797163+0000","last_undegraded":"2024-09-18T01:27:14.797163+0000","last_fullsized":"2024-09-18T01:27:14.797163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.796027+0000","last_change":"2024-09-18T01:25:06.692246+0000","last_active":"2024-09-18T01:27:14.796027+0000","last_peered":"2024-09-18T01:27:14.796027+0000","last_clean":"2024-09-18T01:27:14.796027+0000","last_became_active":"2024-09-18T01:25:06.691871+0000","last_became_peered":"2024-09-18T01:25:06.691871+0000","last_unstale":"2024-09-18T01:27:14.796027+0000","last_undegraded":"2024-09-18T01:27:14.796027+0000","last_fullsized":"2024-09-18T01:27:14.796027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:02.794649+0000","last_change":"2024-09-18T01:24:58.199959+0000","last_active":"2024-09-18T01:27:02.794649+0000","last_peered":"2024-09-18T01:27:02.794649+0000","last_clean":"2024-09-18T01:27:02.794649+0000","last_became_active":"2024-09-18T01:24:56.191033+0000","last_became_peered":"2024-09-18T01:24:56.191033+0000","last_unstale":"2024-09-18T01:27:02.794649+0000","last_undegraded":"2024-09-18T01:27:02.794649+0000","last_fullsized":"2024-09-18T01:27:02.794649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000547898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.706344+0000","last_change":"2024-09-18T01:25:10.676817+0000","last_active":"2024-09-18T01:28:23.706344+0000","last_peered":"2024-09-18T01:28:23.706344+0000","last_clean":"2024-09-18T01:28:23.706344+0000","last_became_active":"2024-09-18T01:25:10.676531+0000","last_became_peered":"2024-09-18T01:25:10.676531+0000","last_unstale":"2024-09-18T01:28:23.706344+0000","last_undegraded":"2024-09-18T01:28:23.706344+0000","last_fullsized":"2024-09-18T01:28:23.706344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'90","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.549813+0000","last_change":"2024-09-18T01:28:36.549893+0000","last_active":"2024-09-18T01:28:36.549813+0000","last_peered":"2024-09-18T01:28:36.549813+0000","last_clean":"2024-09-18T01:28:36.549813+0000","last_became_active":"2024-09-18T01:25:12.693127+0000","last_became_peered":"2024-09-18T01:25:12.693127+0000","last_unstale":"2024-09-18T01:28:36.549813+0000","last_undegraded":"2024-09-18T01:28:36.549813+0000","last_fullsized":"2024-09-18T01:28:36.549813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'90","last_scrub_stamp":"2024-09-18T01:28:36.549705+0000","last_deep_scrub":"35'90","last_deep_scrub_stamp":"2024-09-18T01:28:36.549705+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.549705+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:32.108255+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.622599+0000","last_change":"2024-09-18T01:28:28.622620+0000","last_active":"2024-09-18T01:28:28.622599+0000","last_peered":"2024-09-18T01:28:28.622599+0000","last_clean":"2024-09-18T01:28:28.622599+0000","last_became_active":"2024-09-18T01:25:14.703993+0000","last_became_peered":"2024-09-18T01:25:14.703993+0000","last_unstale":"2024-09-18T01:28:28.622599+0000","last_undegraded":"2024-09-18T01:28:28.622599+0000","last_fullsized":"2024-09-18T01:28:28.622599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:28.622514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:28.622514+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.622514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:15:53.831184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:32.799259+0000","last_change":"2024-09-18T01:25:16.703557+0000","last_active":"2024-09-18T01:27:32.799259+0000","last_peered":"2024-09-18T01:27:32.799259+0000","last_clean":"2024-09-18T01:27:32.799259+0000","last_became_active":"2024-09-18T01:25:16.703278+0000","last_became_peered":"2024-09-18T01:25:16.703278+0000","last_unstale":"2024-09-18T01:27:32.799259+0000","last_undegraded":"2024-09-18T01:27:32.799259+0000","last_fullsized":"2024-09-18T01:27:32.799259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'4","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.106946+0000","last_change":"2024-09-18T01:25:08.686341+0000","last_active":"2024-09-18T01:28:17.106946+0000","last_peered":"2024-09-18T01:28:17.106946+0000","last_clean":"2024-09-18T01:28:17.106946+0000","last_became_active":"2024-09-18T01:25:08.686087+0000","last_became_peered":"2024-09-18T01:25:08.686087+0000","last_unstale":"2024-09-18T01:28:17.106946+0000","last_undegraded":"2024-09-18T01:28:17.106946+0000","last_fullsized":"2024-09-18T01:28:17.106946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.857090+0000","last_change":"2024-09-18T01:25:06.681153+0000","last_active":"2024-09-18T01:28:23.857090+0000","last_peered":"2024-09-18T01:28:23.857090+0000","last_clean":"2024-09-18T01:28:23.857090+0000","last_became_active":"2024-09-18T01:25:06.680623+0000","last_became_peered":"2024-09-18T01:25:06.680623+0000","last_unstale":"2024-09-18T01:28:23.857090+0000","last_undegraded":"2024-09-18T01:28:23.857090+0000","last_fullsized":"2024-09-18T01:28:23.857090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:04.795159+0000","last_change":"2024-09-18T01:24:58.198528+0000","last_active":"2024-09-18T01:27:04.795159+0000","last_peered":"2024-09-18T01:27:04.795159+0000","last_clean":"2024-09-18T01:27:04.795159+0000","last_became_active":"2024-09-18T01:24:56.191687+0000","last_became_peered":"2024-09-18T01:24:56.191687+0000","last_unstale":"2024-09-18T01:27:04.795159+0000","last_undegraded":"2024-09-18T01:27:04.795159+0000","last_fullsized":"2024-09-18T01:27:04.795159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012745390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.087154+0000","last_change":"2024-09-18T01:28:37.087179+0000","last_active":"2024-09-18T01:28:37.087154+0000","last_peered":"2024-09-18T01:28:37.087154+0000","last_clean":"2024-09-18T01:28:37.087154+0000","last_became_active":"2024-09-18T01:25:10.681311+0000","last_became_peered":"2024-09-18T01:25:10.681311+0000","last_unstale":"2024-09-18T01:28:37.087154+0000","last_undegraded":"2024-09-18T01:28:37.087154+0000","last_fullsized":"2024-09-18T01:28:37.087154+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:37.087060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:37.087060+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.087060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:59:56.318845+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'29","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.395365+0000","last_change":"2024-09-18T01:28:28.395402+0000","last_active":"2024-09-18T01:28:28.395365+0000","last_peered":"2024-09-18T01:28:28.395365+0000","last_clean":"2024-09-18T01:28:28.395365+0000","last_became_active":"2024-09-18T01:25:12.692357+0000","last_became_peered":"2024-09-18T01:25:12.692357+0000","last_unstale":"2024-09-18T01:28:28.395365+0000","last_undegraded":"2024-09-18T01:28:28.395365+0000","last_fullsized":"2024-09-18T01:28:28.395365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'29","last_scrub_stamp":"2024-09-18T01:28:28.395277+0000","last_deep_scrub":"35'29","last_deep_scrub_stamp":"2024-09-18T01:28:28.395277+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.395277+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:50.311253+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":398,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:43.280228+0000","last_change":"2024-09-18T01:28:43.280257+0000","last_active":"2024-09-18T01:28:43.280228+0000","last_peered":"2024-09-18T01:28:43.280228+0000","last_clean":"2024-09-18T01:28:43.280228+0000","last_became_active":"2024-09-18T01:25:14.705703+0000","last_became_peered":"2024-09-18T01:25:14.705703+0000","last_unstale":"2024-09-18T01:28:43.280228+0000","last_undegraded":"2024-09-18T01:28:43.280228+0000","last_fullsized":"2024-09-18T01:28:43.280228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:43.280138+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:43.280138+0000","last_clean_scrub_stamp":"2024-09-18T01:28:43.280138+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:32.165248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800057+0000","last_change":"2024-09-18T01:25:16.711811+0000","last_active":"2024-09-18T01:27:34.800057+0000","last_peered":"2024-09-18T01:27:34.800057+0000","last_clean":"2024-09-18T01:27:34.800057+0000","last_became_active":"2024-09-18T01:25:16.711531+0000","last_became_peered":"2024-09-18T01:25:16.711531+0000","last_unstale":"2024-09-18T01:27:34.800057+0000","last_undegraded":"2024-09-18T01:27:34.800057+0000","last_fullsized":"2024-09-18T01:27:34.800057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'20","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153478+0000","last_change":"2024-09-18T01:25:08.681868+0000","last_active":"2024-09-18T01:28:17.153478+0000","last_peered":"2024-09-18T01:28:17.153478+0000","last_clean":"2024-09-18T01:28:17.153478+0000","last_became_active":"2024-09-18T01:25:08.681285+0000","last_became_peered":"2024-09-18T01:25:08.681285+0000","last_unstale":"2024-09-18T01:28:17.153478+0000","last_undegraded":"2024-09-18T01:28:17.153478+0000","last_fullsized":"2024-09-18T01:28:17.153478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":56,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797594+0000","last_change":"2024-09-18T01:25:06.684116+0000","last_active":"2024-09-18T01:27:19.797594+0000","last_peered":"2024-09-18T01:27:19.797594+0000","last_clean":"2024-09-18T01:27:19.797594+0000","last_became_active":"2024-09-18T01:25:06.683740+0000","last_became_peered":"2024-09-18T01:25:06.683740+0000","last_unstale":"2024-09-18T01:27:19.797594+0000","last_undegraded":"2024-09-18T01:27:19.797594+0000","last_fullsized":"2024-09-18T01:27:19.797594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:07.795391+0000","last_change":"2024-09-18T01:24:58.199970+0000","last_active":"2024-09-18T01:27:07.795391+0000","last_peered":"2024-09-18T01:27:07.795391+0000","last_clean":"2024-09-18T01:27:07.795391+0000","last_became_active":"2024-09-18T01:24:56.192301+0000","last_became_peered":"2024-09-18T01:24:56.192301+0000","last_unstale":"2024-09-18T01:27:07.795391+0000","last_undegraded":"2024-09-18T01:27:07.795391+0000","last_fullsized":"2024-09-18T01:27:07.795391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056449699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.070036+0000","last_change":"2024-09-18T01:28:30.070061+0000","last_active":"2024-09-18T01:28:30.070036+0000","last_peered":"2024-09-18T01:28:30.070036+0000","last_clean":"2024-09-18T01:28:30.070036+0000","last_became_active":"2024-09-18T01:25:10.682111+0000","last_became_peered":"2024-09-18T01:25:10.682111+0000","last_unstale":"2024-09-18T01:28:30.070036+0000","last_undegraded":"2024-09-18T01:28:30.070036+0000","last_fullsized":"2024-09-18T01:28:30.070036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:30.069896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:30.069896+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.069896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:14.982005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'23","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.044518+0000","last_change":"2024-09-18T01:28:41.044578+0000","last_active":"2024-09-18T01:28:41.044518+0000","last_peered":"2024-09-18T01:28:41.044518+0000","last_clean":"2024-09-18T01:28:41.044518+0000","last_became_active":"2024-09-18T01:25:12.692313+0000","last_became_peered":"2024-09-18T01:25:12.692313+0000","last_unstale":"2024-09-18T01:28:41.044518+0000","last_undegraded":"2024-09-18T01:28:41.044518+0000","last_fullsized":"2024-09-18T01:28:41.044518+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-09-18T01:28:41.044429+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-09-18T01:28:41.044429+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.044429+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:56.982066+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":410,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.567197+0000","last_change":"2024-09-18T01:28:34.567260+0000","last_active":"2024-09-18T01:28:34.567197+0000","last_peered":"2024-09-18T01:28:34.567197+0000","last_clean":"2024-09-18T01:28:34.567197+0000","last_became_active":"2024-09-18T01:25:14.698755+0000","last_became_peered":"2024-09-18T01:25:14.698755+0000","last_unstale":"2024-09-18T01:28:34.567197+0000","last_undegraded":"2024-09-18T01:28:34.567197+0000","last_fullsized":"2024-09-18T01:28:34.567197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:34.567070+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:34.567070+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.567070+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:46:39.422894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800041+0000","last_change":"2024-09-18T01:25:16.712818+0000","last_active":"2024-09-18T01:27:34.800041+0000","last_peered":"2024-09-18T01:27:34.800041+0000","last_clean":"2024-09-18T01:27:34.800041+0000","last_became_active":"2024-09-18T01:25:16.712556+0000","last_became_peered":"2024-09-18T01:25:16.712556+0000","last_unstale":"2024-09-18T01:27:34.800041+0000","last_undegraded":"2024-09-18T01:27:34.800041+0000","last_fullsized":"2024-09-18T01:27:34.800041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'13","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.231050+0000","last_change":"2024-09-18T01:25:08.674848+0000","last_active":"2024-09-18T01:28:17.231050+0000","last_peered":"2024-09-18T01:28:17.231050+0000","last_clean":"2024-09-18T01:28:17.231050+0000","last_became_active":"2024-09-18T01:25:08.674560+0000","last_became_peered":"2024-09-18T01:25:08.674560+0000","last_unstale":"2024-09-18T01:28:17.231050+0000","last_undegraded":"2024-09-18T01:28:17.231050+0000","last_fullsized":"2024-09-18T01:28:17.231050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797927+0000","last_change":"2024-09-18T01:25:06.693785+0000","last_active":"2024-09-18T01:27:19.797927+0000","last_peered":"2024-09-18T01:27:19.797927+0000","last_clean":"2024-09-18T01:27:19.797927+0000","last_became_active":"2024-09-18T01:25:06.686277+0000","last_became_peered":"2024-09-18T01:25:06.686277+0000","last_unstale":"2024-09-18T01:27:19.797927+0000","last_undegraded":"2024-09-18T01:27:19.797927+0000","last_fullsized":"2024-09-18T01:27:19.797927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:09.795925+0000","last_change":"2024-09-18T01:24:58.198307+0000","last_active":"2024-09-18T01:27:09.795925+0000","last_peered":"2024-09-18T01:27:09.795925+0000","last_clean":"2024-09-18T01:27:09.795925+0000","last_became_active":"2024-09-18T01:24:56.602991+0000","last_became_peered":"2024-09-18T01:24:56.602991+0000","last_unstale":"2024-09-18T01:27:09.795925+0000","last_undegraded":"2024-09-18T01:27:09.795925+0000","last_fullsized":"2024-09-18T01:27:09.795925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077351,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.105445+0000","last_change":"2024-09-18T01:28:28.105468+0000","last_active":"2024-09-18T01:28:28.105445+0000","last_peered":"2024-09-18T01:28:28.105445+0000","last_clean":"2024-09-18T01:28:28.105445+0000","last_became_active":"2024-09-18T01:25:10.682057+0000","last_became_peered":"2024-09-18T01:25:10.682057+0000","last_unstale":"2024-09-18T01:28:28.105445+0000","last_undegraded":"2024-09-18T01:28:28.105445+0000","last_fullsized":"2024-09-18T01:28:28.105445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:28.105351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:28.105351+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.105351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:52:34.334975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'104","reported_seq":203,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.726830+0000","last_change":"2024-09-18T01:28:35.726873+0000","last_active":"2024-09-18T01:28:35.726830+0000","last_peered":"2024-09-18T01:28:35.726830+0000","last_clean":"2024-09-18T01:28:35.726830+0000","last_became_active":"2024-09-18T01:25:12.694361+0000","last_became_peered":"2024-09-18T01:25:12.694361+0000","last_unstale":"2024-09-18T01:28:35.726830+0000","last_undegraded":"2024-09-18T01:28:35.726830+0000","last_fullsized":"2024-09-18T01:28:35.726830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'104","last_scrub_stamp":"2024-09-18T01:28:35.726737+0000","last_deep_scrub":"35'104","last_deep_scrub_stamp":"2024-09-18T01:28:35.726737+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.726737+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:56.458829+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.552717+0000","last_change":"2024-09-18T01:28:39.552741+0000","last_active":"2024-09-18T01:28:39.552717+0000","last_peered":"2024-09-18T01:28:39.552717+0000","last_clean":"2024-09-18T01:28:39.552717+0000","last_became_active":"2024-09-18T01:25:14.706960+0000","last_became_peered":"2024-09-18T01:25:14.706960+0000","last_unstale":"2024-09-18T01:28:39.552717+0000","last_undegraded":"2024-09-18T01:28:39.552717+0000","last_fullsized":"2024-09-18T01:28:39.552717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:39.552625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:39.552625+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.552625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:28.437734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799216+0000","last_change":"2024-09-18T01:25:16.716922+0000","last_active":"2024-09-18T01:27:34.799216+0000","last_peered":"2024-09-18T01:27:34.799216+0000","last_clean":"2024-09-18T01:27:34.799216+0000","last_became_active":"2024-09-18T01:25:16.716607+0000","last_became_peered":"2024-09-18T01:25:16.716607+0000","last_unstale":"2024-09-18T01:27:34.799216+0000","last_undegraded":"2024-09-18T01:27:34.799216+0000","last_fullsized":"2024-09-18T01:27:34.799216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.797626+0000","last_change":"2024-09-18T01:25:16.717173+0000","last_active":"2024-09-18T01:27:24.797626+0000","last_peered":"2024-09-18T01:27:24.797626+0000","last_clean":"2024-09-18T01:27:24.797626+0000","last_became_active":"2024-09-18T01:25:16.716867+0000","last_became_peered":"2024-09-18T01:25:16.716867+0000","last_unstale":"2024-09-18T01:27:24.797626+0000","last_undegraded":"2024-09-18T01:27:24.797626+0000","last_fullsized":"2024-09-18T01:27:24.797626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.798425+0000","last_change":"2024-09-18T01:25:08.676006+0000","last_active":"2024-09-18T01:27:29.798425+0000","last_peered":"2024-09-18T01:27:29.798425+0000","last_clean":"2024-09-18T01:27:29.798425+0000","last_became_active":"2024-09-18T01:25:08.675590+0000","last_became_peered":"2024-09-18T01:25:08.675590+0000","last_unstale":"2024-09-18T01:27:29.798425+0000","last_undegraded":"2024-09-18T01:27:29.798425+0000","last_fullsized":"2024-09-18T01:27:29.798425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799147+0000","last_change":"2024-09-18T01:25:06.693775+0000","last_active":"2024-09-18T01:27:29.799147+0000","last_peered":"2024-09-18T01:27:29.799147+0000","last_clean":"2024-09-18T01:27:29.799147+0000","last_became_active":"2024-09-18T01:25:06.689996+0000","last_became_peered":"2024-09-18T01:25:06.689996+0000","last_unstale":"2024-09-18T01:27:29.799147+0000","last_undegraded":"2024-09-18T01:27:29.799147+0000","last_fullsized":"2024-09-18T01:27:29.799147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.304703+0000","last_change":"2024-09-18T01:28:38.304730+0000","last_active":"2024-09-18T01:28:38.304703+0000","last_peered":"2024-09-18T01:28:38.304703+0000","last_clean":"2024-09-18T01:28:38.304703+0000","last_became_active":"2024-09-18T01:25:10.679704+0000","last_became_peered":"2024-09-18T01:25:10.679704+0000","last_unstale":"2024-09-18T01:28:38.304703+0000","last_undegraded":"2024-09-18T01:28:38.304703+0000","last_fullsized":"2024-09-18T01:28:38.304703+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:38.304607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:38.304607+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.304607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:00.590243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'41","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.844151+0000","last_change":"2024-09-18T01:25:12.693302+0000","last_active":"2024-09-18T01:28:23.844151+0000","last_peered":"2024-09-18T01:28:23.844151+0000","last_clean":"2024-09-18T01:28:23.844151+0000","last_became_active":"2024-09-18T01:25:12.692870+0000","last_became_peered":"2024-09-18T01:25:12.692870+0000","last_unstale":"2024-09-18T01:28:23.844151+0000","last_undegraded":"2024-09-18T01:28:23.844151+0000","last_fullsized":"2024-09-18T01:28:23.844151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799798+0000","last_change":"2024-09-18T01:25:14.707283+0000","last_active":"2024-09-18T01:27:34.799798+0000","last_peered":"2024-09-18T01:27:34.799798+0000","last_clean":"2024-09-18T01:27:34.799798+0000","last_became_active":"2024-09-18T01:25:14.706381+0000","last_became_peered":"2024-09-18T01:25:14.706381+0000","last_unstale":"2024-09-18T01:27:34.799798+0000","last_undegraded":"2024-09-18T01:27:34.799798+0000","last_fullsized":"2024-09-18T01:27:34.799798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'17","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.873826+0000","last_change":"2024-09-18T01:25:16.703483+0000","last_active":"2024-09-18T01:28:16.873826+0000","last_peered":"2024-09-18T01:28:16.873826+0000","last_clean":"2024-09-18T01:28:16.873826+0000","last_became_active":"2024-09-18T01:25:16.703227+0000","last_became_peered":"2024-09-18T01:25:16.703227+0000","last_unstale":"2024-09-18T01:28:16.873826+0000","last_undegraded":"2024-09-18T01:28:16.873826+0000","last_fullsized":"2024-09-18T01:28:16.873826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799293+0000","last_change":"2024-09-18T01:25:08.687780+0000","last_active":"2024-09-18T01:27:29.799293+0000","last_peered":"2024-09-18T01:27:29.799293+0000","last_clean":"2024-09-18T01:27:29.799293+0000","last_became_active":"2024-09-18T01:25:08.687482+0000","last_became_peered":"2024-09-18T01:25:08.687482+0000","last_unstale":"2024-09-18T01:27:29.799293+0000","last_undegraded":"2024-09-18T01:27:29.799293+0000","last_fullsized":"2024-09-18T01:27:29.799293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799198+0000","last_change":"2024-09-18T01:25:06.705764+0000","last_active":"2024-09-18T01:27:34.799198+0000","last_peered":"2024-09-18T01:27:34.799198+0000","last_clean":"2024-09-18T01:27:34.799198+0000","last_became_active":"2024-09-18T01:25:06.705406+0000","last_became_peered":"2024-09-18T01:25:06.705406+0000","last_unstale":"2024-09-18T01:27:34.799198+0000","last_undegraded":"2024-09-18T01:27:34.799198+0000","last_fullsized":"2024-09-18T01:27:34.799198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.114679+0000","last_change":"2024-09-18T01:28:29.114710+0000","last_active":"2024-09-18T01:28:29.114679+0000","last_peered":"2024-09-18T01:28:29.114679+0000","last_clean":"2024-09-18T01:28:29.114679+0000","last_became_active":"2024-09-18T01:25:10.682230+0000","last_became_peered":"2024-09-18T01:25:10.682230+0000","last_unstale":"2024-09-18T01:28:29.114679+0000","last_undegraded":"2024-09-18T01:28:29.114679+0000","last_fullsized":"2024-09-18T01:28:29.114679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.114588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.114588+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.114588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:42:02.700134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.620008+0000","last_change":"2024-09-18T01:28:41.620043+0000","last_active":"2024-09-18T01:28:41.620008+0000","last_peered":"2024-09-18T01:28:41.620008+0000","last_clean":"2024-09-18T01:28:41.620008+0000","last_became_active":"2024-09-18T01:25:12.687018+0000","last_became_peered":"2024-09-18T01:25:12.687018+0000","last_unstale":"2024-09-18T01:28:41.620008+0000","last_undegraded":"2024-09-18T01:28:41.620008+0000","last_fullsized":"2024-09-18T01:28:41.620008+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:41.619916+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:41.619916+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.619916+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:43.740728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.669948+0000","last_change":"2024-09-18T01:28:29.669975+0000","last_active":"2024-09-18T01:28:29.669948+0000","last_peered":"2024-09-18T01:28:29.669948+0000","last_clean":"2024-09-18T01:28:29.669948+0000","last_became_active":"2024-09-18T01:25:14.707008+0000","last_became_peered":"2024-09-18T01:25:14.707008+0000","last_unstale":"2024-09-18T01:28:29.669948+0000","last_undegraded":"2024-09-18T01:28:29.669948+0000","last_fullsized":"2024-09-18T01:28:29.669948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.669852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.669852+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.669852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:18.373919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.180740+0000","last_change":"2024-09-18T01:25:16.714484+0000","last_active":"2024-09-18T01:28:17.180740+0000","last_peered":"2024-09-18T01:28:17.180740+0000","last_clean":"2024-09-18T01:28:17.180740+0000","last_became_active":"2024-09-18T01:25:16.714160+0000","last_became_peered":"2024-09-18T01:25:16.714160+0000","last_unstale":"2024-09-18T01:28:17.180740+0000","last_undegraded":"2024-09-18T01:28:17.180740+0000","last_fullsized":"2024-09-18T01:28:17.180740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:27.798287+0000","last_change":"2024-09-18T01:25:08.671711+0000","last_active":"2024-09-18T01:27:27.798287+0000","last_peered":"2024-09-18T01:27:27.798287+0000","last_clean":"2024-09-18T01:27:27.798287+0000","last_became_active":"2024-09-18T01:25:08.671365+0000","last_became_peered":"2024-09-18T01:25:08.671365+0000","last_unstale":"2024-09-18T01:27:27.798287+0000","last_undegraded":"2024-09-18T01:27:27.798287+0000","last_fullsized":"2024-09-18T01:27:27.798287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.854975+0000","last_change":"2024-09-18T01:25:06.703718+0000","last_active":"2024-09-18T01:28:23.854975+0000","last_peered":"2024-09-18T01:28:23.854975+0000","last_clean":"2024-09-18T01:28:23.854975+0000","last_became_active":"2024-09-18T01:25:06.703081+0000","last_became_peered":"2024-09-18T01:25:06.703081+0000","last_unstale":"2024-09-18T01:28:23.854975+0000","last_undegraded":"2024-09-18T01:28:23.854975+0000","last_fullsized":"2024-09-18T01:28:23.854975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.718726+0000","last_change":"2024-09-18T01:28:44.718746+0000","last_active":"2024-09-18T01:28:44.718726+0000","last_peered":"2024-09-18T01:28:44.718726+0000","last_clean":"2024-09-18T01:28:44.718726+0000","last_became_active":"2024-09-18T01:25:10.680316+0000","last_became_peered":"2024-09-18T01:25:10.680316+0000","last_unstale":"2024-09-18T01:28:44.718726+0000","last_undegraded":"2024-09-18T01:28:44.718726+0000","last_fullsized":"2024-09-18T01:28:44.718726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:44.718622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:44.718622+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.718622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:03.968563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'47","reported_seq":119,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.607584+0000","last_change":"2024-09-18T01:28:42.607643+0000","last_active":"2024-09-18T01:28:42.607584+0000","last_peered":"2024-09-18T01:28:42.607584+0000","last_clean":"2024-09-18T01:28:42.607584+0000","last_became_active":"2024-09-18T01:25:12.682270+0000","last_became_peered":"2024-09-18T01:25:12.682270+0000","last_unstale":"2024-09-18T01:28:42.607584+0000","last_undegraded":"2024-09-18T01:28:42.607584+0000","last_fullsized":"2024-09-18T01:28:42.607584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-09-18T01:28:42.607487+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-09-18T01:28:42.607487+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.607487+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:54.508090+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.271313+0000","last_change":"2024-09-18T01:28:39.271337+0000","last_active":"2024-09-18T01:28:39.271313+0000","last_peered":"2024-09-18T01:28:39.271313+0000","last_clean":"2024-09-18T01:28:39.271313+0000","last_became_active":"2024-09-18T01:25:14.703583+0000","last_became_peered":"2024-09-18T01:25:14.703583+0000","last_unstale":"2024-09-18T01:28:39.271313+0000","last_undegraded":"2024-09-18T01:28:39.271313+0000","last_fullsized":"2024-09-18T01:28:39.271313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:39.271224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:39.271224+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.271224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:54.971763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:49.802344+0000","last_change":"2024-09-18T01:25:16.714459+0000","last_active":"2024-09-18T01:27:49.802344+0000","last_peered":"2024-09-18T01:27:49.802344+0000","last_clean":"2024-09-18T01:27:49.802344+0000","last_became_active":"2024-09-18T01:25:16.714061+0000","last_became_peered":"2024-09-18T01:25:16.714061+0000","last_unstale":"2024-09-18T01:27:49.802344+0000","last_undegraded":"2024-09-18T01:27:49.802344+0000","last_fullsized":"2024-09-18T01:27:49.802344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'4","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.798904+0000","last_change":"2024-09-18T01:25:08.688282+0000","last_active":"2024-09-18T01:27:29.798904+0000","last_peered":"2024-09-18T01:27:29.798904+0000","last_clean":"2024-09-18T01:27:29.798904+0000","last_became_active":"2024-09-18T01:25:08.688016+0000","last_became_peered":"2024-09-18T01:25:08.688016+0000","last_unstale":"2024-09-18T01:27:29.798904+0000","last_undegraded":"2024-09-18T01:27:29.798904+0000","last_fullsized":"2024-09-18T01:27:29.798904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800124+0000","last_change":"2024-09-18T01:25:06.691298+0000","last_active":"2024-09-18T01:27:34.800124+0000","last_peered":"2024-09-18T01:27:34.800124+0000","last_clean":"2024-09-18T01:27:34.800124+0000","last_became_active":"2024-09-18T01:25:06.688747+0000","last_became_peered":"2024-09-18T01:25:06.688747+0000","last_unstale":"2024-09-18T01:27:34.800124+0000","last_undegraded":"2024-09-18T01:27:34.800124+0000","last_fullsized":"2024-09-18T01:27:34.800124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.109559+0000","last_change":"2024-09-18T01:28:38.109581+0000","last_active":"2024-09-18T01:28:38.109559+0000","last_peered":"2024-09-18T01:28:38.109559+0000","last_clean":"2024-09-18T01:28:38.109559+0000","last_became_active":"2024-09-18T01:25:10.680831+0000","last_became_peered":"2024-09-18T01:25:10.680831+0000","last_unstale":"2024-09-18T01:28:38.109559+0000","last_undegraded":"2024-09-18T01:28:38.109559+0000","last_fullsized":"2024-09-18T01:28:38.109559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:38.109472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:38.109472+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.109472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:44.941883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.715067+0000","last_change":"2024-09-18T01:28:42.715108+0000","last_active":"2024-09-18T01:28:42.715067+0000","last_peered":"2024-09-18T01:28:42.715067+0000","last_clean":"2024-09-18T01:28:42.715067+0000","last_became_active":"2024-09-18T01:25:12.686918+0000","last_became_peered":"2024-09-18T01:25:12.686918+0000","last_unstale":"2024-09-18T01:28:42.715067+0000","last_undegraded":"2024-09-18T01:28:42.715067+0000","last_fullsized":"2024-09-18T01:28:42.715067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-18T01:28:42.714970+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-18T01:28:42.714970+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.714970+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:01:05.208541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.654223+0000","last_change":"2024-09-18T01:28:32.654249+0000","last_active":"2024-09-18T01:28:32.654223+0000","last_peered":"2024-09-18T01:28:32.654223+0000","last_clean":"2024-09-18T01:28:32.654223+0000","last_became_active":"2024-09-18T01:25:14.695120+0000","last_became_peered":"2024-09-18T01:25:14.695120+0000","last_unstale":"2024-09-18T01:28:32.654223+0000","last_undegraded":"2024-09-18T01:28:32.654223+0000","last_fullsized":"2024-09-18T01:28:32.654223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:32.654135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:32.654135+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.654135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:02:10.947460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'5","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.227940+0000","last_change":"2024-09-18T01:25:08.678193+0000","last_active":"2024-09-18T01:28:17.227940+0000","last_peered":"2024-09-18T01:28:17.227940+0000","last_clean":"2024-09-18T01:28:17.227940+0000","last_became_active":"2024-09-18T01:25:08.677941+0000","last_became_peered":"2024-09-18T01:25:08.677941+0000","last_unstale":"2024-09-18T01:28:17.227940+0000","last_undegraded":"2024-09-18T01:28:17.227940+0000","last_fullsized":"2024-09-18T01:28:17.227940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.088733+0000","last_change":"2024-09-18T01:25:06.695779+0000","last_active":"2024-09-18T01:28:17.088733+0000","last_peered":"2024-09-18T01:28:17.088733+0000","last_clean":"2024-09-18T01:28:17.088733+0000","last_became_active":"2024-09-18T01:25:06.692823+0000","last_became_peered":"2024-09-18T01:25:06.692823+0000","last_unstale":"2024-09-18T01:28:17.088733+0000","last_undegraded":"2024-09-18T01:28:17.088733+0000","last_fullsized":"2024-09-18T01:28:17.088733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.796068+0000","last_change":"2024-09-18T01:25:10.677782+0000","last_active":"2024-09-18T01:27:12.796068+0000","last_peered":"2024-09-18T01:27:12.796068+0000","last_clean":"2024-09-18T01:27:12.796068+0000","last_became_active":"2024-09-18T01:25:10.677481+0000","last_became_peered":"2024-09-18T01:25:10.677481+0000","last_unstale":"2024-09-18T01:27:12.796068+0000","last_undegraded":"2024-09-18T01:27:12.796068+0000","last_fullsized":"2024-09-18T01:27:12.796068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'71","reported_seq":150,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.576795+0000","last_change":"2024-09-18T01:28:40.576840+0000","last_active":"2024-09-18T01:28:40.576795+0000","last_peered":"2024-09-18T01:28:40.576795+0000","last_clean":"2024-09-18T01:28:40.576795+0000","last_became_active":"2024-09-18T01:25:12.687014+0000","last_became_peered":"2024-09-18T01:25:12.687014+0000","last_unstale":"2024-09-18T01:28:40.576795+0000","last_undegraded":"2024-09-18T01:28:40.576795+0000","last_fullsized":"2024-09-18T01:28:40.576795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'71","last_scrub_stamp":"2024-09-18T01:28:40.576711+0000","last_deep_scrub":"35'71","last_deep_scrub_stamp":"2024-09-18T01:28:40.576711+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.576711+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:02:19.666203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.637762+0000","last_change":"2024-09-18T01:28:31.637788+0000","last_active":"2024-09-18T01:28:31.637762+0000","last_peered":"2024-09-18T01:28:31.637762+0000","last_clean":"2024-09-18T01:28:31.637762+0000","last_became_active":"2024-09-18T01:25:14.698753+0000","last_became_peered":"2024-09-18T01:25:14.698753+0000","last_unstale":"2024-09-18T01:28:31.637762+0000","last_undegraded":"2024-09-18T01:28:31.637762+0000","last_fullsized":"2024-09-18T01:28:31.637762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.637674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.637674+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.637674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:05:28.601978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'20","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.155923+0000","last_change":"2024-09-18T01:25:16.714340+0000","last_active":"2024-09-18T01:28:17.155923+0000","last_peered":"2024-09-18T01:28:17.155923+0000","last_clean":"2024-09-18T01:28:17.155923+0000","last_became_active":"2024-09-18T01:25:16.713750+0000","last_became_peered":"2024-09-18T01:25:16.713750+0000","last_unstale":"2024-09-18T01:28:17.155923+0000","last_undegraded":"2024-09-18T01:28:17.155923+0000","last_fullsized":"2024-09-18T01:28:17.155923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.103325+0000","last_change":"2024-09-18T01:25:08.681356+0000","last_active":"2024-09-18T01:28:17.103325+0000","last_peered":"2024-09-18T01:28:17.103325+0000","last_clean":"2024-09-18T01:28:17.103325+0000","last_became_active":"2024-09-18T01:25:08.680604+0000","last_became_peered":"2024-09-18T01:25:08.680604+0000","last_unstale":"2024-09-18T01:28:17.103325+0000","last_undegraded":"2024-09-18T01:28:17.103325+0000","last_fullsized":"2024-09-18T01:28:17.103325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799976+0000","last_change":"2024-09-18T01:25:06.688269+0000","last_active":"2024-09-18T01:27:34.799976+0000","last_peered":"2024-09-18T01:27:34.799976+0000","last_clean":"2024-09-18T01:27:34.799976+0000","last_became_active":"2024-09-18T01:25:06.686125+0000","last_became_peered":"2024-09-18T01:25:06.686125+0000","last_unstale":"2024-09-18T01:27:34.799976+0000","last_undegraded":"2024-09-18T01:27:34.799976+0000","last_fullsized":"2024-09-18T01:27:34.799976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":238,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.694878+0000","last_change":"2024-09-18T01:25:43.912490+0000","last_active":"2024-09-18T01:28:23.694878+0000","last_peered":"2024-09-18T01:28:23.694878+0000","last_clean":"2024-09-18T01:28:23.694878+0000","last_became_active":"2024-09-18T01:25:43.908273+0000","last_became_peered":"2024-09-18T01:25:43.908273+0000","last_unstale":"2024-09-18T01:28:23.694878+0000","last_undegraded":"2024-09-18T01:28:23.694878+0000","last_fullsized":"2024-09-18T01:28:23.694878+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'39","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.802149+0000","last_change":"2024-09-18T01:25:12.693001+0000","last_active":"2024-09-18T01:28:23.802149+0000","last_peered":"2024-09-18T01:28:23.802149+0000","last_clean":"2024-09-18T01:28:23.802149+0000","last_became_active":"2024-09-18T01:25:12.692486+0000","last_became_peered":"2024-09-18T01:25:12.692486+0000","last_unstale":"2024-09-18T01:28:23.802149+0000","last_undegraded":"2024-09-18T01:28:23.802149+0000","last_fullsized":"2024-09-18T01:28:23.802149+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801604+0000","last_change":"2024-09-18T01:25:14.710345+0000","last_active":"2024-09-18T01:27:44.801604+0000","last_peered":"2024-09-18T01:27:44.801604+0000","last_clean":"2024-09-18T01:27:44.801604+0000","last_became_active":"2024-09-18T01:25:14.709980+0000","last_became_peered":"2024-09-18T01:25:14.709980+0000","last_unstale":"2024-09-18T01:27:44.801604+0000","last_undegraded":"2024-09-18T01:27:44.801604+0000","last_fullsized":"2024-09-18T01:27:44.801604+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800735+0000","last_change":"2024-09-18T01:25:16.709176+0000","last_active":"2024-09-18T01:27:39.800735+0000","last_peered":"2024-09-18T01:27:39.800735+0000","last_clean":"2024-09-18T01:27:39.800735+0000","last_became_active":"2024-09-18T01:25:16.708905+0000","last_became_peered":"2024-09-18T01:25:16.708905+0000","last_unstale":"2024-09-18T01:27:39.800735+0000","last_undegraded":"2024-09-18T01:27:39.800735+0000","last_fullsized":"2024-09-18T01:27:39.800735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'6","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.081418+0000","last_change":"2024-09-18T01:28:40.081446+0000","last_active":"2024-09-18T01:28:40.081418+0000","last_peered":"2024-09-18T01:28:40.081418+0000","last_clean":"2024-09-18T01:28:40.081418+0000","last_became_active":"2024-09-18T01:25:08.688610+0000","last_became_peered":"2024-09-18T01:25:08.688610+0000","last_unstale":"2024-09-18T01:28:40.081418+0000","last_undegraded":"2024-09-18T01:28:40.081418+0000","last_fullsized":"2024-09-18T01:28:40.081418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:40.081320+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:40.081320+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.081320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:49.789353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800700+0000","last_change":"2024-09-18T01:25:06.685750+0000","last_active":"2024-09-18T01:27:39.800700+0000","last_peered":"2024-09-18T01:27:39.800700+0000","last_clean":"2024-09-18T01:27:39.800700+0000","last_became_active":"2024-09-18T01:25:06.685167+0000","last_became_peered":"2024-09-18T01:25:06.685167+0000","last_unstale":"2024-09-18T01:27:39.800700+0000","last_undegraded":"2024-09-18T01:27:39.800700+0000","last_fullsized":"2024-09-18T01:27:39.800700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800043+0000","last_change":"2024-09-18T01:25:10.678850+0000","last_active":"2024-09-18T01:27:39.800043+0000","last_peered":"2024-09-18T01:27:39.800043+0000","last_clean":"2024-09-18T01:27:39.800043+0000","last_became_active":"2024-09-18T01:25:10.678586+0000","last_became_peered":"2024-09-18T01:25:10.678586+0000","last_unstale":"2024-09-18T01:27:39.800043+0000","last_undegraded":"2024-09-18T01:27:39.800043+0000","last_fullsized":"2024-09-18T01:27:39.800043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'46","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.589579+0000","last_change":"2024-09-18T01:28:38.589617+0000","last_active":"2024-09-18T01:28:38.589579+0000","last_peered":"2024-09-18T01:28:38.589579+0000","last_clean":"2024-09-18T01:28:38.589579+0000","last_became_active":"2024-09-18T01:25:12.687935+0000","last_became_peered":"2024-09-18T01:25:12.687935+0000","last_unstale":"2024-09-18T01:28:38.589579+0000","last_undegraded":"2024-09-18T01:28:38.589579+0000","last_fullsized":"2024-09-18T01:28:38.589579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:38.589489+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:38.589489+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.589489+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:04:54.499330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.683081+0000","last_change":"2024-09-18T01:28:30.683121+0000","last_active":"2024-09-18T01:28:30.683081+0000","last_peered":"2024-09-18T01:28:30.683081+0000","last_clean":"2024-09-18T01:28:30.683081+0000","last_became_active":"2024-09-18T01:25:14.701702+0000","last_became_peered":"2024-09-18T01:25:14.701702+0000","last_unstale":"2024-09-18T01:28:30.683081+0000","last_undegraded":"2024-09-18T01:28:30.683081+0000","last_fullsized":"2024-09-18T01:28:30.683081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:30.682992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:30.682992+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.682992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:55.879755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800702+0000","last_change":"2024-09-18T01:25:16.716015+0000","last_active":"2024-09-18T01:27:39.800702+0000","last_peered":"2024-09-18T01:27:39.800702+0000","last_clean":"2024-09-18T01:27:39.800702+0000","last_became_active":"2024-09-18T01:25:16.715669+0000","last_became_peered":"2024-09-18T01:25:16.715669+0000","last_unstale":"2024-09-18T01:27:39.800702+0000","last_undegraded":"2024-09-18T01:27:39.800702+0000","last_fullsized":"2024-09-18T01:27:39.800702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"35'15","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.231252+0000","last_change":"2024-09-18T01:25:08.672922+0000","last_active":"2024-09-18T01:28:17.231252+0000","last_peered":"2024-09-18T01:28:17.231252+0000","last_clean":"2024-09-18T01:28:17.231252+0000","last_became_active":"2024-09-18T01:25:08.672541+0000","last_became_peered":"2024-09-18T01:25:08.672541+0000","last_unstale":"2024-09-18T01:28:17.231252+0000","last_undegraded":"2024-09-18T01:28:17.231252+0000","last_fullsized":"2024-09-18T01:28:17.231252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800796+0000","last_change":"2024-09-18T01:25:06.687447+0000","last_active":"2024-09-18T01:27:39.800796+0000","last_peered":"2024-09-18T01:27:39.800796+0000","last_clean":"2024-09-18T01:27:39.800796+0000","last_became_active":"2024-09-18T01:25:06.684658+0000","last_became_peered":"2024-09-18T01:25:06.684658+0000","last_unstale":"2024-09-18T01:27:39.800796+0000","last_undegraded":"2024-09-18T01:27:39.800796+0000","last_fullsized":"2024-09-18T01:27:39.800796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.324781+0000","last_change":"2024-09-18T01:28:44.324803+0000","last_active":"2024-09-18T01:28:44.324781+0000","last_peered":"2024-09-18T01:28:44.324781+0000","last_clean":"2024-09-18T01:28:44.324781+0000","last_became_active":"2024-09-18T01:25:10.679369+0000","last_became_peered":"2024-09-18T01:25:10.679369+0000","last_unstale":"2024-09-18T01:28:44.324781+0000","last_undegraded":"2024-09-18T01:28:44.324781+0000","last_fullsized":"2024-09-18T01:28:44.324781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:44.324660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:44.324660+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.324660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:21.528723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'16","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.796704+0000","last_change":"2024-09-18T01:25:12.697092+0000","last_active":"2024-09-18T01:27:14.796704+0000","last_peered":"2024-09-18T01:27:14.796704+0000","last_clean":"2024-09-18T01:27:14.796704+0000","last_became_active":"2024-09-18T01:25:12.696757+0000","last_became_peered":"2024-09-18T01:25:12.696757+0000","last_unstale":"2024-09-18T01:27:14.796704+0000","last_undegraded":"2024-09-18T01:27:14.796704+0000","last_fullsized":"2024-09-18T01:27:14.796704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":384,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.663286+0000","last_change":"2024-09-18T01:28:33.663311+0000","last_active":"2024-09-18T01:28:33.663286+0000","last_peered":"2024-09-18T01:28:33.663286+0000","last_clean":"2024-09-18T01:28:33.663286+0000","last_became_active":"2024-09-18T01:25:14.708840+0000","last_became_peered":"2024-09-18T01:25:14.708840+0000","last_unstale":"2024-09-18T01:28:33.663286+0000","last_undegraded":"2024-09-18T01:28:33.663286+0000","last_fullsized":"2024-09-18T01:28:33.663286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:33.663217+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:33.663217+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.663217+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:17:45.430908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800590+0000","last_change":"2024-09-18T01:25:16.707474+0000","last_active":"2024-09-18T01:27:39.800590+0000","last_peered":"2024-09-18T01:27:39.800590+0000","last_clean":"2024-09-18T01:27:39.800590+0000","last_became_active":"2024-09-18T01:25:16.706764+0000","last_became_peered":"2024-09-18T01:25:16.706764+0000","last_unstale":"2024-09-18T01:27:39.800590+0000","last_undegraded":"2024-09-18T01:27:39.800590+0000","last_fullsized":"2024-09-18T01:27:39.800590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800001+0000","last_change":"2024-09-18T01:25:08.670258+0000","last_active":"2024-09-18T01:27:39.800001+0000","last_peered":"2024-09-18T01:27:39.800001+0000","last_clean":"2024-09-18T01:27:39.800001+0000","last_became_active":"2024-09-18T01:25:08.669920+0000","last_became_peered":"2024-09-18T01:25:08.669920+0000","last_unstale":"2024-09-18T01:27:39.800001+0000","last_undegraded":"2024-09-18T01:27:39.800001+0000","last_fullsized":"2024-09-18T01:27:39.800001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800761+0000","last_change":"2024-09-18T01:25:06.685435+0000","last_active":"2024-09-18T01:27:39.800761+0000","last_peered":"2024-09-18T01:27:39.800761+0000","last_clean":"2024-09-18T01:27:39.800761+0000","last_became_active":"2024-09-18T01:25:06.684984+0000","last_became_peered":"2024-09-18T01:25:06.684984+0000","last_unstale":"2024-09-18T01:27:39.800761+0000","last_undegraded":"2024-09-18T01:27:39.800761+0000","last_fullsized":"2024-09-18T01:27:39.800761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.258238+0000","last_change":"2024-09-18T01:28:42.258260+0000","last_active":"2024-09-18T01:28:42.258238+0000","last_peered":"2024-09-18T01:28:42.258238+0000","last_clean":"2024-09-18T01:28:42.258238+0000","last_became_active":"2024-09-18T01:25:10.679468+0000","last_became_peered":"2024-09-18T01:25:10.679468+0000","last_unstale":"2024-09-18T01:28:42.258238+0000","last_undegraded":"2024-09-18T01:28:42.258238+0000","last_fullsized":"2024-09-18T01:28:42.258238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:42.258155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:42.258155+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.258155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:43:55.164530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'73","reported_seq":155,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.399904+0000","last_change":"2024-09-18T01:28:29.399990+0000","last_active":"2024-09-18T01:28:29.399904+0000","last_peered":"2024-09-18T01:28:29.399904+0000","last_clean":"2024-09-18T01:28:29.399904+0000","last_became_active":"2024-09-18T01:25:12.688618+0000","last_became_peered":"2024-09-18T01:25:12.688618+0000","last_unstale":"2024-09-18T01:28:29.399904+0000","last_undegraded":"2024-09-18T01:28:29.399904+0000","last_fullsized":"2024-09-18T01:28:29.399904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'73","last_scrub_stamp":"2024-09-18T01:28:29.399801+0000","last_deep_scrub":"35'73","last_deep_scrub_stamp":"2024-09-18T01:28:29.399801+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.399801+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:16:18.035775+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:42.800618+0000","last_change":"2024-09-18T01:25:14.707373+0000","last_active":"2024-09-18T01:27:42.800618+0000","last_peered":"2024-09-18T01:27:42.800618+0000","last_clean":"2024-09-18T01:27:42.800618+0000","last_became_active":"2024-09-18T01:25:14.706586+0000","last_became_peered":"2024-09-18T01:25:14.706586+0000","last_unstale":"2024-09-18T01:27:42.800618+0000","last_undegraded":"2024-09-18T01:27:42.800618+0000","last_fullsized":"2024-09-18T01:27:42.800618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801668+0000","last_change":"2024-09-18T01:25:16.714536+0000","last_active":"2024-09-18T01:27:44.801668+0000","last_peered":"2024-09-18T01:27:44.801668+0000","last_clean":"2024-09-18T01:27:44.801668+0000","last_became_active":"2024-09-18T01:25:16.713789+0000","last_became_peered":"2024-09-18T01:25:16.713789+0000","last_unstale":"2024-09-18T01:27:44.801668+0000","last_undegraded":"2024-09-18T01:27:44.801668+0000","last_fullsized":"2024-09-18T01:27:44.801668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183106+0000","last_change":"2024-09-18T01:25:08.670550+0000","last_active":"2024-09-18T01:28:17.183106+0000","last_peered":"2024-09-18T01:28:17.183106+0000","last_clean":"2024-09-18T01:28:17.183106+0000","last_became_active":"2024-09-18T01:25:08.670268+0000","last_became_peered":"2024-09-18T01:25:08.670268+0000","last_unstale":"2024-09-18T01:28:17.183106+0000","last_undegraded":"2024-09-18T01:28:17.183106+0000","last_fullsized":"2024-09-18T01:28:17.183106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.854804+0000","last_change":"2024-09-18T01:25:06.689500+0000","last_active":"2024-09-18T01:28:23.854804+0000","last_peered":"2024-09-18T01:28:23.854804+0000","last_clean":"2024-09-18T01:28:23.854804+0000","last_became_active":"2024-09-18T01:25:06.687382+0000","last_became_peered":"2024-09-18T01:25:06.687382+0000","last_unstale":"2024-09-18T01:28:23.854804+0000","last_undegraded":"2024-09-18T01:28:23.854804+0000","last_fullsized":"2024-09-18T01:28:23.854804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:43.756227+0000","last_change":"2024-09-18T01:28:43.756254+0000","last_active":"2024-09-18T01:28:43.756227+0000","last_peered":"2024-09-18T01:28:43.756227+0000","last_clean":"2024-09-18T01:28:43.756227+0000","last_became_active":"2024-09-18T01:25:10.682337+0000","last_became_peered":"2024-09-18T01:25:10.682337+0000","last_unstale":"2024-09-18T01:28:43.756227+0000","last_undegraded":"2024-09-18T01:28:43.756227+0000","last_fullsized":"2024-09-18T01:28:43.756227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:43.756140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:43.756140+0000","last_clean_scrub_stamp":"2024-09-18T01:28:43.756140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:26.328226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'43","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.556548+0000","last_change":"2024-09-18T01:28:37.556582+0000","last_active":"2024-09-18T01:28:37.556548+0000","last_peered":"2024-09-18T01:28:37.556548+0000","last_clean":"2024-09-18T01:28:37.556548+0000","last_became_active":"2024-09-18T01:25:12.693129+0000","last_became_peered":"2024-09-18T01:25:12.693129+0000","last_unstale":"2024-09-18T01:28:37.556548+0000","last_undegraded":"2024-09-18T01:28:37.556548+0000","last_fullsized":"2024-09-18T01:28:37.556548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'43","last_scrub_stamp":"2024-09-18T01:28:37.556467+0000","last_deep_scrub":"35'43","last_deep_scrub_stamp":"2024-09-18T01:28:37.556467+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.556467+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:47:34.949630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800644+0000","last_change":"2024-09-18T01:25:14.707262+0000","last_active":"2024-09-18T01:27:39.800644+0000","last_peered":"2024-09-18T01:27:39.800644+0000","last_clean":"2024-09-18T01:27:39.800644+0000","last_became_active":"2024-09-18T01:25:14.706325+0000","last_became_peered":"2024-09-18T01:25:14.706325+0000","last_unstale":"2024-09-18T01:27:39.800644+0000","last_undegraded":"2024-09-18T01:27:39.800644+0000","last_fullsized":"2024-09-18T01:27:39.800644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801744+0000","last_change":"2024-09-18T01:25:16.716357+0000","last_active":"2024-09-18T01:27:44.801744+0000","last_peered":"2024-09-18T01:27:44.801744+0000","last_clean":"2024-09-18T01:27:44.801744+0000","last_became_active":"2024-09-18T01:25:16.716084+0000","last_became_peered":"2024-09-18T01:25:16.716084+0000","last_unstale":"2024-09-18T01:27:44.801744+0000","last_undegraded":"2024-09-18T01:27:44.801744+0000","last_fullsized":"2024-09-18T01:27:44.801744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799836+0000","last_change":"2024-09-18T01:25:08.678786+0000","last_active":"2024-09-18T01:27:34.799836+0000","last_peered":"2024-09-18T01:27:34.799836+0000","last_clean":"2024-09-18T01:27:34.799836+0000","last_became_active":"2024-09-18T01:25:08.678539+0000","last_became_peered":"2024-09-18T01:25:08.678539+0000","last_unstale":"2024-09-18T01:27:34.799836+0000","last_undegraded":"2024-09-18T01:27:34.799836+0000","last_fullsized":"2024-09-18T01:27:34.799836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:07.795404+0000","last_change":"2024-09-18T01:25:06.682960+0000","last_active":"2024-09-18T01:27:07.795404+0000","last_peered":"2024-09-18T01:27:07.795404+0000","last_clean":"2024-09-18T01:27:07.795404+0000","last_became_active":"2024-09-18T01:25:06.682592+0000","last_became_peered":"2024-09-18T01:25:06.682592+0000","last_unstale":"2024-09-18T01:27:07.795404+0000","last_undegraded":"2024-09-18T01:27:07.795404+0000","last_fullsized":"2024-09-18T01:27:07.795404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.341584+0000","last_change":"2024-09-18T01:28:34.341623+0000","last_active":"2024-09-18T01:28:34.341584+0000","last_peered":"2024-09-18T01:28:34.341584+0000","last_clean":"2024-09-18T01:28:34.341584+0000","last_became_active":"2024-09-18T01:25:10.683833+0000","last_became_peered":"2024-09-18T01:25:10.683833+0000","last_unstale":"2024-09-18T01:28:34.341584+0000","last_undegraded":"2024-09-18T01:28:34.341584+0000","last_fullsized":"2024-09-18T01:28:34.341584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:34.341474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:34.341474+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.341474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:33.233882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'35","reported_seq":86,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.850026+0000","last_change":"2024-09-18T01:25:12.693138+0000","last_active":"2024-09-18T01:28:23.850026+0000","last_peered":"2024-09-18T01:28:23.850026+0000","last_clean":"2024-09-18T01:28:23.850026+0000","last_became_active":"2024-09-18T01:25:12.691752+0000","last_became_peered":"2024-09-18T01:25:12.691752+0000","last_unstale":"2024-09-18T01:28:23.850026+0000","last_undegraded":"2024-09-18T01:28:23.850026+0000","last_fullsized":"2024-09-18T01:28:23.850026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:11.668900+0000","last_clean_scrub_stamp":"2024-09-18T01:25:11.668900+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801592+0000","last_change":"2024-09-18T01:25:14.711982+0000","last_active":"2024-09-18T01:27:44.801592+0000","last_peered":"2024-09-18T01:27:44.801592+0000","last_clean":"2024-09-18T01:27:44.801592+0000","last_became_active":"2024-09-18T01:25:14.711635+0000","last_became_peered":"2024-09-18T01:25:14.711635+0000","last_unstale":"2024-09-18T01:27:44.801592+0000","last_undegraded":"2024-09-18T01:27:44.801592+0000","last_fullsized":"2024-09-18T01:27:44.801592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801703+0000","last_change":"2024-09-18T01:25:16.715865+0000","last_active":"2024-09-18T01:27:44.801703+0000","last_peered":"2024-09-18T01:27:44.801703+0000","last_clean":"2024-09-18T01:27:44.801703+0000","last_became_active":"2024-09-18T01:25:16.715581+0000","last_became_peered":"2024-09-18T01:25:16.715581+0000","last_unstale":"2024-09-18T01:27:44.801703+0000","last_undegraded":"2024-09-18T01:27:44.801703+0000","last_fullsized":"2024-09-18T01:27:44.801703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'8","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183351+0000","last_change":"2024-09-18T01:25:08.669854+0000","last_active":"2024-09-18T01:28:17.183351+0000","last_peered":"2024-09-18T01:28:17.183351+0000","last_clean":"2024-09-18T01:28:17.183351+0000","last_became_active":"2024-09-18T01:25:08.668430+0000","last_became_peered":"2024-09-18T01:25:08.668430+0000","last_unstale":"2024-09-18T01:28:17.183351+0000","last_undegraded":"2024-09-18T01:28:17.183351+0000","last_fullsized":"2024-09-18T01:28:17.183351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.797240+0000","last_change":"2024-09-18T01:25:06.687779+0000","last_active":"2024-09-18T01:27:14.797240+0000","last_peered":"2024-09-18T01:27:14.797240+0000","last_clean":"2024-09-18T01:27:14.797240+0000","last_became_active":"2024-09-18T01:25:06.686394+0000","last_became_peered":"2024-09-18T01:25:06.686394+0000","last_unstale":"2024-09-18T01:27:14.797240+0000","last_undegraded":"2024-09-18T01:27:14.797240+0000","last_fullsized":"2024-09-18T01:27:14.797240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.382361+0000","last_change":"2024-09-18T01:28:36.382417+0000","last_active":"2024-09-18T01:28:36.382361+0000","last_peered":"2024-09-18T01:28:36.382361+0000","last_clean":"2024-09-18T01:28:36.382361+0000","last_became_active":"2024-09-18T01:25:10.683351+0000","last_became_peered":"2024-09-18T01:25:10.683351+0000","last_unstale":"2024-09-18T01:28:36.382361+0000","last_undegraded":"2024-09-18T01:28:36.382361+0000","last_fullsized":"2024-09-18T01:28:36.382361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:28:36.382253+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:28:36.382253+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.382253+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:41:10.171758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'54","reported_seq":123,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.048989+0000","last_change":"2024-09-18T01:28:35.049047+0000","last_active":"2024-09-18T01:28:35.048989+0000","last_peered":"2024-09-18T01:28:35.048989+0000","last_clean":"2024-09-18T01:28:35.048989+0000","last_became_active":"2024-09-18T01:25:12.691715+0000","last_became_peered":"2024-09-18T01:25:12.691715+0000","last_unstale":"2024-09-18T01:28:35.048989+0000","last_undegraded":"2024-09-18T01:28:35.048989+0000","last_fullsized":"2024-09-18T01:28:35.048989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'54","last_scrub_stamp":"2024-09-18T01:28:35.048876+0000","last_deep_scrub":"35'54","last_deep_scrub_stamp":"2024-09-18T01:28:35.048876+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.048876+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:53.636298+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.564860+0000","last_change":"2024-09-18T01:28:35.564885+0000","last_active":"2024-09-18T01:28:35.564860+0000","last_peered":"2024-09-18T01:28:35.564860+0000","last_clean":"2024-09-18T01:28:35.564860+0000","last_became_active":"2024-09-18T01:25:14.706398+0000","last_became_peered":"2024-09-18T01:25:14.706398+0000","last_unstale":"2024-09-18T01:28:35.564860+0000","last_undegraded":"2024-09-18T01:28:35.564860+0000","last_fullsized":"2024-09-18T01:28:35.564860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:35.564741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:35.564741+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.564741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:51.265281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800848+0000","last_change":"2024-09-18T01:25:16.714114+0000","last_active":"2024-09-18T01:27:39.800848+0000","last_peered":"2024-09-18T01:27:39.800848+0000","last_clean":"2024-09-18T01:27:39.800848+0000","last_became_active":"2024-09-18T01:25:16.713579+0000","last_became_peered":"2024-09-18T01:25:16.713579+0000","last_unstale":"2024-09-18T01:27:39.800848+0000","last_undegraded":"2024-09-18T01:27:39.800848+0000","last_fullsized":"2024-09-18T01:27:39.800848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'8","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183263+0000","last_change":"2024-09-18T01:25:08.686807+0000","last_active":"2024-09-18T01:28:17.183263+0000","last_peered":"2024-09-18T01:28:17.183263+0000","last_clean":"2024-09-18T01:28:17.183263+0000","last_became_active":"2024-09-18T01:25:08.686645+0000","last_became_peered":"2024-09-18T01:25:08.686645+0000","last_unstale":"2024-09-18T01:28:17.183263+0000","last_undegraded":"2024-09-18T01:28:17.183263+0000","last_fullsized":"2024-09-18T01:28:17.183263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.795916+0000","last_change":"2024-09-18T01:25:06.703432+0000","last_active":"2024-09-18T01:27:14.795916+0000","last_peered":"2024-09-18T01:27:14.795916+0000","last_clean":"2024-09-18T01:27:14.795916+0000","last_became_active":"2024-09-18T01:25:06.702991+0000","last_became_peered":"2024-09-18T01:25:06.702991+0000","last_unstale":"2024-09-18T01:27:14.795916+0000","last_undegraded":"2024-09-18T01:27:14.795916+0000","last_fullsized":"2024-09-18T01:27:14.795916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183141+0000","last_change":"2024-09-18T01:25:08.673285+0000","last_active":"2024-09-18T01:28:17.183141+0000","last_peered":"2024-09-18T01:28:17.183141+0000","last_clean":"2024-09-18T01:28:17.183141+0000","last_became_active":"2024-09-18T01:25:08.672983+0000","last_became_peered":"2024-09-18T01:25:08.672983+0000","last_unstale":"2024-09-18T01:28:17.183141+0000","last_undegraded":"2024-09-18T01:28:17.183141+0000","last_fullsized":"2024-09-18T01:28:17.183141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.795938+0000","last_change":"2024-09-18T01:25:06.681343+0000","last_active":"2024-09-18T01:27:12.795938+0000","last_peered":"2024-09-18T01:27:12.795938+0000","last_clean":"2024-09-18T01:27:12.795938+0000","last_became_active":"2024-09-18T01:25:06.680853+0000","last_became_peered":"2024-09-18T01:25:06.680853+0000","last_unstale":"2024-09-18T01:27:12.795938+0000","last_undegraded":"2024-09-18T01:27:12.795938+0000","last_fullsized":"2024-09-18T01:27:12.795938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'8","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797500+0000","last_change":"2024-09-18T01:25:08.682876+0000","last_active":"2024-09-18T01:27:19.797500+0000","last_peered":"2024-09-18T01:27:19.797500+0000","last_clean":"2024-09-18T01:27:19.797500+0000","last_became_active":"2024-09-18T01:25:08.682254+0000","last_became_peered":"2024-09-18T01:25:08.682254+0000","last_unstale":"2024-09-18T01:27:19.797500+0000","last_undegraded":"2024-09-18T01:27:19.797500+0000","last_fullsized":"2024-09-18T01:27:19.797500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.796562+0000","last_change":"2024-09-18T01:25:06.684384+0000","last_active":"2024-09-18T01:27:14.796562+0000","last_peered":"2024-09-18T01:27:14.796562+0000","last_clean":"2024-09-18T01:27:14.796562+0000","last_became_active":"2024-09-18T01:25:06.682878+0000","last_became_peered":"2024-09-18T01:25:06.682878+0000","last_unstale":"2024-09-18T01:27:14.796562+0000","last_undegraded":"2024-09-18T01:27:14.796562+0000","last_fullsized":"2024-09-18T01:27:14.796562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153181+0000","last_change":"2024-09-18T01:25:08.673238+0000","last_active":"2024-09-18T01:28:17.153181+0000","last_peered":"2024-09-18T01:28:17.153181+0000","last_clean":"2024-09-18T01:28:17.153181+0000","last_became_active":"2024-09-18T01:25:08.672574+0000","last_became_peered":"2024-09-18T01:25:08.672574+0000","last_unstale":"2024-09-18T01:28:17.153181+0000","last_undegraded":"2024-09-18T01:28:17.153181+0000","last_fullsized":"2024-09-18T01:28:17.153181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.796009+0000","last_change":"2024-09-18T01:25:06.681262+0000","last_active":"2024-09-18T01:27:12.796009+0000","last_peered":"2024-09-18T01:27:12.796009+0000","last_clean":"2024-09-18T01:27:12.796009+0000","last_became_active":"2024-09-18T01:25:06.680712+0000","last_became_peered":"2024-09-18T01:25:06.680712+0000","last_unstale":"2024-09-18T01:27:12.796009+0000","last_undegraded":"2024-09-18T01:27:12.796009+0000","last_fullsized":"2024-09-18T01:27:12.796009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'5","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.228486+0000","last_change":"2024-09-18T01:25:08.671686+0000","last_active":"2024-09-18T01:28:17.228486+0000","last_peered":"2024-09-18T01:28:17.228486+0000","last_clean":"2024-09-18T01:28:17.228486+0000","last_became_active":"2024-09-18T01:25:08.671408+0000","last_became_peered":"2024-09-18T01:25:08.671408+0000","last_unstale":"2024-09-18T01:28:17.228486+0000","last_undegraded":"2024-09-18T01:28:17.228486+0000","last_fullsized":"2024-09-18T01:28:17.228486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:17.796717+0000","last_change":"2024-09-18T01:25:06.683019+0000","last_active":"2024-09-18T01:27:17.796717+0000","last_peered":"2024-09-18T01:27:17.796717+0000","last_clean":"2024-09-18T01:27:17.796717+0000","last_became_active":"2024-09-18T01:25:06.682577+0000","last_became_peered":"2024-09-18T01:25:06.682577+0000","last_unstale":"2024-09-18T01:27:17.796717+0000","last_undegraded":"2024-09-18T01:27:17.796717+0000","last_fullsized":"2024-09-18T01:27:17.796717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'8","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.962966+0000","last_change":"2024-09-18T01:25:08.688824+0000","last_active":"2024-09-18T01:28:16.962966+0000","last_peered":"2024-09-18T01:28:16.962966+0000","last_clean":"2024-09-18T01:28:16.962966+0000","last_became_active":"2024-09-18T01:25:08.687797+0000","last_became_peered":"2024-09-18T01:25:08.687797+0000","last_unstale":"2024-09-18T01:28:16.962966+0000","last_undegraded":"2024-09-18T01:28:16.962966+0000","last_fullsized":"2024-09-18T01:28:16.962966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797897+0000","last_change":"2024-09-18T01:25:06.687325+0000","last_active":"2024-09-18T01:27:19.797897+0000","last_peered":"2024-09-18T01:27:19.797897+0000","last_clean":"2024-09-18T01:27:19.797897+0000","last_became_active":"2024-09-18T01:25:06.686154+0000","last_became_peered":"2024-09-18T01:25:06.686154+0000","last_unstale":"2024-09-18T01:27:19.797897+0000","last_undegraded":"2024-09-18T01:27:19.797897+0000","last_fullsized":"2024-09-18T01:27:19.797897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183149+0000","last_change":"2024-09-18T01:25:08.681610+0000","last_active":"2024-09-18T01:28:17.183149+0000","last_peered":"2024-09-18T01:28:17.183149+0000","last_clean":"2024-09-18T01:28:17.183149+0000","last_became_active":"2024-09-18T01:25:08.680947+0000","last_became_peered":"2024-09-18T01:25:08.680947+0000","last_unstale":"2024-09-18T01:28:17.183149+0000","last_undegraded":"2024-09-18T01:28:17.183149+0000","last_fullsized":"2024-09-18T01:28:17.183149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.796919+0000","last_change":"2024-09-18T01:25:06.704000+0000","last_active":"2024-09-18T01:27:19.796919+0000","last_peered":"2024-09-18T01:27:19.796919+0000","last_clean":"2024-09-18T01:27:19.796919+0000","last_became_active":"2024-09-18T01:25:06.703622+0000","last_became_peered":"2024-09-18T01:25:06.703622+0000","last_unstale":"2024-09-18T01:27:19.796919+0000","last_undegraded":"2024-09-18T01:27:19.796919+0000","last_fullsized":"2024-09-18T01:27:19.796919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'6","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.152811+0000","last_change":"2024-09-18T01:25:08.682682+0000","last_active":"2024-09-18T01:28:17.152811+0000","last_peered":"2024-09-18T01:28:17.152811+0000","last_clean":"2024-09-18T01:28:17.152811+0000","last_became_active":"2024-09-18T01:25:08.682143+0000","last_became_peered":"2024-09-18T01:25:08.682143+0000","last_unstale":"2024-09-18T01:28:17.152811+0000","last_undegraded":"2024-09-18T01:28:17.152811+0000","last_fullsized":"2024-09-18T01:28:17.152811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:17.796800+0000","last_change":"2024-09-18T01:25:06.687744+0000","last_active":"2024-09-18T01:27:17.796800+0000","last_peered":"2024-09-18T01:27:17.796800+0000","last_clean":"2024-09-18T01:27:17.796800+0000","last_became_active":"2024-09-18T01:25:06.687436+0000","last_became_peered":"2024-09-18T01:25:06.687436+0000","last_unstale":"2024-09-18T01:27:17.796800+0000","last_undegraded":"2024-09-18T01:27:17.796800+0000","last_fullsized":"2024-09-18T01:27:17.796800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'14","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.103619+0000","last_change":"2024-09-18T01:25:08.676069+0000","last_active":"2024-09-18T01:28:17.103619+0000","last_peered":"2024-09-18T01:28:17.103619+0000","last_clean":"2024-09-18T01:28:17.103619+0000","last_became_active":"2024-09-18T01:25:08.675801+0000","last_became_peered":"2024-09-18T01:25:08.675801+0000","last_unstale":"2024-09-18T01:28:17.103619+0000","last_undegraded":"2024-09-18T01:28:17.103619+0000","last_fullsized":"2024-09-18T01:28:17.103619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797295+0000","last_change":"2024-09-18T01:25:06.693564+0000","last_active":"2024-09-18T01:27:19.797295+0000","last_peered":"2024-09-18T01:27:19.797295+0000","last_clean":"2024-09-18T01:27:19.797295+0000","last_became_active":"2024-09-18T01:25:06.691345+0000","last_became_peered":"2024-09-18T01:25:06.691345+0000","last_unstale":"2024-09-18T01:27:19.797295+0000","last_undegraded":"2024-09-18T01:27:19.797295+0000","last_fullsized":"2024-09-18T01:27:19.797295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'16","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.104093+0000","last_change":"2024-09-18T01:25:08.685632+0000","last_active":"2024-09-18T01:28:17.104093+0000","last_peered":"2024-09-18T01:28:17.104093+0000","last_clean":"2024-09-18T01:28:17.104093+0000","last_became_active":"2024-09-18T01:25:08.685358+0000","last_became_peered":"2024-09-18T01:25:08.685358+0000","last_unstale":"2024-09-18T01:28:17.104093+0000","last_undegraded":"2024-09-18T01:28:17.104093+0000","last_fullsized":"2024-09-18T01:28:17.104093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:22.797586+0000","last_change":"2024-09-18T01:25:06.696372+0000","last_active":"2024-09-18T01:27:22.797586+0000","last_peered":"2024-09-18T01:27:22.797586+0000","last_clean":"2024-09-18T01:27:22.797586+0000","last_became_active":"2024-09-18T01:25:06.695735+0000","last_became_peered":"2024-09-18T01:25:06.695735+0000","last_unstale":"2024-09-18T01:27:22.797586+0000","last_undegraded":"2024-09-18T01:27:22.797586+0000","last_fullsized":"2024-09-18T01:27:22.797586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:22.797682+0000","last_change":"2024-09-18T01:25:43.852539+0000","last_active":"2024-09-18T01:27:22.797682+0000","last_peered":"2024-09-18T01:27:22.797682+0000","last_clean":"2024-09-18T01:27:22.797682+0000","last_became_active":"2024-09-18T01:25:43.849600+0000","last_became_peered":"2024-09-18T01:25:43.849600+0000","last_unstale":"2024-09-18T01:27:22.797682+0000","last_undegraded":"2024-09-18T01:27:22.797682+0000","last_fullsized":"2024-09-18T01:27:22.797682+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798471+0000","last_change":"2024-09-18T01:25:06.695026+0000","last_active":"2024-09-18T01:27:24.798471+0000","last_peered":"2024-09-18T01:27:24.798471+0000","last_clean":"2024-09-18T01:27:24.798471+0000","last_became_active":"2024-09-18T01:25:06.688967+0000","last_became_peered":"2024-09-18T01:25:06.688967+0000","last_unstale":"2024-09-18T01:27:24.798471+0000","last_undegraded":"2024-09-18T01:27:24.798471+0000","last_fullsized":"2024-09-18T01:27:24.798471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'10","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183138+0000","last_change":"2024-09-18T01:25:08.684071+0000","last_active":"2024-09-18T01:28:17.183138+0000","last_peered":"2024-09-18T01:28:17.183138+0000","last_clean":"2024-09-18T01:28:17.183138+0000","last_became_active":"2024-09-18T01:25:08.683590+0000","last_became_peered":"2024-09-18T01:25:08.683590+0000","last_unstale":"2024-09-18T01:28:17.183138+0000","last_undegraded":"2024-09-18T01:28:17.183138+0000","last_fullsized":"2024-09-18T01:28:17.183138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'6","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.855472+0000","last_change":"2024-09-18T01:25:06.686285+0000","last_active":"2024-09-18T01:28:23.855472+0000","last_peered":"2024-09-18T01:28:23.855472+0000","last_clean":"2024-09-18T01:28:23.855472+0000","last_became_active":"2024-09-18T01:25:06.685814+0000","last_became_peered":"2024-09-18T01:25:06.685814+0000","last_unstale":"2024-09-18T01:28:23.855472+0000","last_undegraded":"2024-09-18T01:28:23.855472+0000","last_fullsized":"2024-09-18T01:28:23.855472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.963294+0000","last_change":"2024-09-18T01:25:08.686910+0000","last_active":"2024-09-18T01:28:16.963294+0000","last_peered":"2024-09-18T01:28:16.963294+0000","last_clean":"2024-09-18T01:28:16.963294+0000","last_became_active":"2024-09-18T01:25:08.686703+0000","last_became_peered":"2024-09-18T01:25:08.686703+0000","last_unstale":"2024-09-18T01:28:16.963294+0000","last_undegraded":"2024-09-18T01:28:16.963294+0000","last_fullsized":"2024-09-18T01:28:16.963294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798253+0000","last_change":"2024-09-18T01:25:06.691078+0000","last_active":"2024-09-18T01:27:24.798253+0000","last_peered":"2024-09-18T01:27:24.798253+0000","last_clean":"2024-09-18T01:27:24.798253+0000","last_became_active":"2024-09-18T01:25:06.685120+0000","last_became_peered":"2024-09-18T01:25:06.685120+0000","last_unstale":"2024-09-18T01:27:24.798253+0000","last_undegraded":"2024-09-18T01:27:24.798253+0000","last_fullsized":"2024-09-18T01:27:24.798253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'7","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.231212+0000","last_change":"2024-09-18T01:25:08.685436+0000","last_active":"2024-09-18T01:28:17.231212+0000","last_peered":"2024-09-18T01:28:17.231212+0000","last_clean":"2024-09-18T01:28:17.231212+0000","last_became_active":"2024-09-18T01:25:08.685158+0000","last_became_peered":"2024-09-18T01:25:08.685158+0000","last_unstale":"2024-09-18T01:28:17.231212+0000","last_undegraded":"2024-09-18T01:28:17.231212+0000","last_fullsized":"2024-09-18T01:28:17.231212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798291+0000","last_change":"2024-09-18T01:25:06.687424+0000","last_active":"2024-09-18T01:27:24.798291+0000","last_peered":"2024-09-18T01:27:24.798291+0000","last_clean":"2024-09-18T01:27:24.798291+0000","last_became_active":"2024-09-18T01:25:06.684845+0000","last_became_peered":"2024-09-18T01:25:06.684845+0000","last_unstale":"2024-09-18T01:27:24.798291+0000","last_undegraded":"2024-09-18T01:27:24.798291+0000","last_fullsized":"2024-09-18T01:27:24.798291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.963409+0000","last_change":"2024-09-18T01:25:08.688327+0000","last_active":"2024-09-18T01:28:16.963409+0000","last_peered":"2024-09-18T01:28:16.963409+0000","last_clean":"2024-09-18T01:28:16.963409+0000","last_became_active":"2024-09-18T01:25:08.687840+0000","last_became_peered":"2024-09-18T01:25:08.687840+0000","last_unstale":"2024-09-18T01:28:16.963409+0000","last_undegraded":"2024-09-18T01:28:16.963409+0000","last_fullsized":"2024-09-18T01:28:16.963409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.091820+0000","last_change":"2024-09-18T01:25:06.704602+0000","last_active":"2024-09-18T01:28:17.091820+0000","last_peered":"2024-09-18T01:28:17.091820+0000","last_clean":"2024-09-18T01:28:17.091820+0000","last_became_active":"2024-09-18T01:25:06.704247+0000","last_became_peered":"2024-09-18T01:25:06.704247+0000","last_unstale":"2024-09-18T01:28:17.091820+0000","last_undegraded":"2024-09-18T01:28:17.091820+0000","last_fullsized":"2024-09-18T01:28:17.091820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'12","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797737+0000","last_change":"2024-09-18T01:25:08.681230+0000","last_active":"2024-09-18T01:27:19.797737+0000","last_peered":"2024-09-18T01:27:19.797737+0000","last_clean":"2024-09-18T01:27:19.797737+0000","last_became_active":"2024-09-18T01:25:08.680916+0000","last_became_peered":"2024-09-18T01:25:08.680916+0000","last_unstale":"2024-09-18T01:27:19.797737+0000","last_undegraded":"2024-09-18T01:27:19.797737+0000","last_fullsized":"2024-09-18T01:27:19.797737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799255+0000","last_change":"2024-09-18T01:25:06.694171+0000","last_active":"2024-09-18T01:27:29.799255+0000","last_peered":"2024-09-18T01:27:29.799255+0000","last_clean":"2024-09-18T01:27:29.799255+0000","last_became_active":"2024-09-18T01:25:06.693000+0000","last_became_peered":"2024-09-18T01:25:06.693000+0000","last_unstale":"2024-09-18T01:27:29.799255+0000","last_undegraded":"2024-09-18T01:27:29.799255+0000","last_fullsized":"2024-09-18T01:27:29.799255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.798940+0000","last_change":"2024-09-18T01:25:06.694282+0000","last_active":"2024-09-18T01:27:29.798940+0000","last_peered":"2024-09-18T01:27:29.798940+0000","last_clean":"2024-09-18T01:27:29.798940+0000","last_became_active":"2024-09-18T01:25:06.691141+0000","last_became_peered":"2024-09-18T01:25:06.691141+0000","last_unstale":"2024-09-18T01:27:29.798940+0000","last_undegraded":"2024-09-18T01:27:29.798940+0000","last_fullsized":"2024-09-18T01:27:29.798940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'12","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.876261+0000","last_change":"2024-09-18T01:25:08.681504+0000","last_active":"2024-09-18T01:28:16.876261+0000","last_peered":"2024-09-18T01:28:16.876261+0000","last_clean":"2024-09-18T01:28:16.876261+0000","last_became_active":"2024-09-18T01:25:08.681053+0000","last_became_peered":"2024-09-18T01:25:08.681053+0000","last_unstale":"2024-09-18T01:28:16.876261+0000","last_undegraded":"2024-09-18T01:28:16.876261+0000","last_fullsized":"2024-09-18T01:28:16.876261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:27.798266+0000","last_change":"2024-09-18T01:25:06.696528+0000","last_active":"2024-09-18T01:27:27.798266+0000","last_peered":"2024-09-18T01:27:27.798266+0000","last_clean":"2024-09-18T01:27:27.798266+0000","last_became_active":"2024-09-18T01:25:06.695875+0000","last_became_peered":"2024-09-18T01:25:06.695875+0000","last_unstale":"2024-09-18T01:27:27.798266+0000","last_undegraded":"2024-09-18T01:27:27.798266+0000","last_fullsized":"2024-09-18T01:27:27.798266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.103966+0000","last_change":"2024-09-18T01:25:08.688042+0000","last_active":"2024-09-18T01:28:17.103966+0000","last_peered":"2024-09-18T01:28:17.103966+0000","last_clean":"2024-09-18T01:28:17.103966+0000","last_became_active":"2024-09-18T01:25:08.687583+0000","last_became_peered":"2024-09-18T01:25:08.687583+0000","last_unstale":"2024-09-18T01:28:17.103966+0000","last_undegraded":"2024-09-18T01:28:17.103966+0000","last_fullsized":"2024-09-18T01:28:17.103966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1703,"ondisk_log_size":1703,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":487424,"data_stored":155040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":744524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673012,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36364,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335476,"statfs":{"total":96636764160,"available":96599527424,"internally_reserved":0,"allocated":1044480,"data_stored":744891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":154885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:28:48.610 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.610 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.610 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.610 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.610 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.610 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.611 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.611 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.611 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.611 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.611 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.611 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.611 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.611 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.611 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.611 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.612 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.612 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.612 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.612 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.612 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.612 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.612 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.612 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.612 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.613 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.613 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.613 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.613 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.613 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.613 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.613 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.613 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.613 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.614 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.614 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.614 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.614 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.614 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.614 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.614 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.614 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.614 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.615 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.615 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.615 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.615 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.615 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.615 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.615 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.615 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.616 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.616 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.616 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.616 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.616 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.616 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.616 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.616 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.616 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.616 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.617 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.617 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.617 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.617 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.617 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.617 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.617 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.617 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.618 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.618 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.618 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.618 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.618 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.618 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.618 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.618 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T01:24:51.161687+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=51, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.618 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.619 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.619 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.619 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.619 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.619 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.619 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.619 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.619 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.619 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.620 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.620 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.620 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.620 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.620 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.620 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.620 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.620 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.621 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.621 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.621 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.621 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.621 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.621 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.621 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.621 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.621 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.622 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.622 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.622 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.622 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.622 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.622 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.622 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.622 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.623 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.623 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.623 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.623 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.623 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.623 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.623 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.623 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.623 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.623 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.624 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.624 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.624 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.624 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.624 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.624 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.624 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.624 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.625 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.625 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.625 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.625 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.625 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.625 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.625 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.625 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.625 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.626 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.626 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.626 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.626 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.626 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.626 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.626 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.626 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.626 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.627 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.627 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.627 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.627 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.627 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.627 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.627 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-18T01:25:11.668900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.627 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.627 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.627 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.628 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.628 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.628 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.628 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.628 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.628 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.628 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.628 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.629 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.629 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.629 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.629 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.629 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.629 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.629 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.629 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.629 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.630 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.630 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.630 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.630 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.630 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.630 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.630 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.630 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.630 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.630 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.631 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.631 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.631 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.631 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.631 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.631 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.631 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.632 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.632 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.632 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.632 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:28:48.632 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T01:29:08.633 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:29:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.743+0000 7f4daef5f640 1 Processor -- start 2024-09-18T01:29:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.743+0000 7f4daef5f640 1 -- start start 2024-09-18T01:29:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.743+0000 7f4daef5f640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4da806eda0 0x7f4da806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:29:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.743+0000 7f4daef5f640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4da806eba0 con 0x7f4da806f6c0 2024-09-18T01:29:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.743+0000 7f4daef5f640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f4da806d2f0 con 0x7f4da806eda0 2024-09-18T01:29:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.744+0000 7f4daccfb640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4da806eda0 0x7f4da806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:29:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.744+0000 7f4da7fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f4da806f6c0 0x7f4da8121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:47776/0 (socket says 172.21.15.92:47776) 2024-09-18T01:29:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.744+0000 7f4da7fff640 1 -- 172.21.15.92:0/2840943712 learned_addr learned my addr 172.21.15.92:0/2840943712 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:29:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.744+0000 7f4daccfb640 1 -- 172.21.15.92:0/2840943712 >> v1:172.21.15.92:6789/0 conn(0x7f4da806f6c0 legacy=0x7f4da8121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:29:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.744+0000 7f4daccfb640 1 -- 172.21.15.92:0/2840943712 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da8070d50 con 0x7f4da806eda0 2024-09-18T01:29:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.745+0000 7f4daccfb640 1 --2- 172.21.15.92:0/2840943712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da806eda0 0x7f4da806f180 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009720 tx=0x7f4d9c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417c0134e2778071 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:29:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.745+0000 7f4da77fe640 1 -- 172.21.15.92:0/2840943712 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d9c037070 con 0x7f4da806eda0 2024-09-18T01:29:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.745+0000 7f4da77fe640 1 -- 172.21.15.92:0/2840943712 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9c02ae20 con 0x7f4da806eda0 2024-09-18T01:29:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.745+0000 7f4da77fe640 1 -- 172.21.15.92:0/2840943712 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d9c032590 con 0x7f4da806eda0 2024-09-18T01:29:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.745+0000 7f4daef5f640 1 -- 172.21.15.92:0/2840943712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da806eda0 msgr2=0x7f4da806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:29:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.745+0000 7f4daef5f640 1 --2- 172.21.15.92:0/2840943712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da806eda0 0x7f4da806f180 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009720 tx=0x7f4d9c02a1a0 comp rx=0 tx=0).stop 2024-09-18T01:29:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.745+0000 7f4daef5f640 1 -- 172.21.15.92:0/2840943712 shutdown_connections 2024-09-18T01:29:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.745+0000 7f4daef5f640 1 --2- 172.21.15.92:0/2840943712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da806eda0 0x7f4da806f180 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:29:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.745+0000 7f4daef5f640 1 -- 172.21.15.92:0/2840943712 >> 172.21.15.92:0/2840943712 conn(0x7f4da809a890 msgr2=0x7f4da809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:29:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.745+0000 7f4daef5f640 1 -- 172.21.15.92:0/2840943712 shutdown_connections 2024-09-18T01:29:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.745+0000 7f4daef5f640 1 -- 172.21.15.92:0/2840943712 wait complete. 2024-09-18T01:29:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.746+0000 7f4daef5f640 1 Processor -- start 2024-09-18T01:29:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.746+0000 7f4daef5f640 1 -- start start 2024-09-18T01:29:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.747+0000 7f4daef5f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da806eda0 0x7f4da806d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:29:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.747+0000 7f4daef5f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4da8122160 con 0x7f4da806eda0 2024-09-18T01:29:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.747+0000 7f4daccfb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da806eda0 0x7f4da806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:29:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.747+0000 7f4daccfb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da806eda0 0x7f4da806d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54322/0 (socket says 172.21.15.92:54322) 2024-09-18T01:29:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.747+0000 7f4daccfb640 1 -- 172.21.15.92:0/1238878426 learned_addr learned my addr 172.21.15.92:0/1238878426 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:29:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.747+0000 7f4daccfb640 1 -- 172.21.15.92:0/1238878426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da808dc30 con 0x7f4da806eda0 2024-09-18T01:29:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.747+0000 7f4daccfb640 1 --2- 172.21.15.92:0/1238878426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da806eda0 0x7f4da806d910 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c02a1e0 tx=0x7f4d9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:29:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.747+0000 7f4da57fa640 1 -- 172.21.15.92:0/1238878426 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d9c042070 con 0x7f4da806eda0 2024-09-18T01:29:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.747+0000 7f4da57fa640 1 -- 172.21.15.92:0/1238878426 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9c03e590 con 0x7f4da806eda0 2024-09-18T01:29:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.747+0000 7f4daef5f640 1 -- 172.21.15.92:0/1238878426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da808d500 con 0x7f4da806eda0 2024-09-18T01:29:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.747+0000 7f4da57fa640 1 -- 172.21.15.92:0/1238878426 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d9c037040 con 0x7f4da806eda0 2024-09-18T01:29:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.747+0000 7f4daef5f640 1 -- 172.21.15.92:0/1238878426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da808e0e0 con 0x7f4da806eda0 2024-09-18T01:29:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.748+0000 7f4da57fa640 1 -- 172.21.15.92:0/1238878426 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4d9c045070 con 0x7f4da806eda0 2024-09-18T01:29:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.748+0000 7f4da57fa640 1 --2- 172.21.15.92:0/1238878426 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4d8c0382a0 0x7f4d8c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:29:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.748+0000 7f4da57fa640 1 -- 172.21.15.92:0/1238878426 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4d9c06c5c0 con 0x7f4da806eda0 2024-09-18T01:29:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.749+0000 7f4daef5f640 1 -- 172.21.15.92:0/1238878426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da8122670 con 0x7f4da806eda0 2024-09-18T01:29:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.749+0000 7f4da7fff640 1 --2- 172.21.15.92:0/1238878426 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4d8c0382a0 0x7f4d8c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:29:08.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.749+0000 7f4da7fff640 1 --2- 172.21.15.92:0/1238878426 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4d8c0382a0 0x7f4d8c03a760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4d94007fd0 tx=0x7f4d94007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:29:08.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.754+0000 7f4da57fa640 1 -- 172.21.15.92:0/1238878426 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d9c02ae20 con 0x7f4da806eda0 2024-09-18T01:29:08.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.918+0000 7f4daef5f640 1 -- 172.21.15.92:0/1238878426 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4da808ecd0 con 0x7f4d8c0382a0 2024-09-18T01:29:08.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.934+0000 7f4da57fa640 1 -- 172.21.15.92:0/1238878426 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+662188 (secure 0 0 0) 0x7f4da808ecd0 con 0x7f4d8c0382a0 2024-09-18T01:29:08.942 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:29:08.948 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-18T01:29:08.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.938+0000 7f4daef5f640 1 -- 172.21.15.92:0/1238878426 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4d8c0382a0 msgr2=0x7f4d8c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:29:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.938+0000 7f4daef5f640 1 --2- 172.21.15.92:0/1238878426 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4d8c0382a0 0x7f4d8c03a760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4d94007fd0 tx=0x7f4d94007ac0 comp rx=0 tx=0).stop 2024-09-18T01:29:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.938+0000 7f4daef5f640 1 -- 172.21.15.92:0/1238878426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da806eda0 msgr2=0x7f4da806d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:29:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.938+0000 7f4daef5f640 1 --2- 172.21.15.92:0/1238878426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da806eda0 0x7f4da806d910 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c02a1e0 tx=0x7f4d9c0046c0 comp rx=0 tx=0).stop 2024-09-18T01:29:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.938+0000 7f4daef5f640 1 -- 172.21.15.92:0/1238878426 shutdown_connections 2024-09-18T01:29:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.938+0000 7f4daef5f640 1 --2- 172.21.15.92:0/1238878426 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f4d8c0382a0 0x7f4d8c03a760 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:29:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.938+0000 7f4daef5f640 1 --2- 172.21.15.92:0/1238878426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da806eda0 0x7f4da806d910 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:29:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.938+0000 7f4daef5f640 1 -- 172.21.15.92:0/1238878426 >> 172.21.15.92:0/1238878426 conn(0x7f4da809a890 msgr2=0x7f4da812b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:29:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.938+0000 7f4daef5f640 1 -- 172.21.15.92:0/1238878426 shutdown_connections 2024-09-18T01:29:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:08.938+0000 7f4daef5f640 1 -- 172.21.15.92:0/1238878426 wait complete. 2024-09-18T01:29:08.952 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-09-18T01:29:08.840699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5383,"num_read_kb":4932,"num_write":2371,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":993,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5000,"ondisk_log_size":5000,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156800,"kb_used_data":2944,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330560,"statfs":{"total":386547056640,"available":386386493440,"internally_reserved":0,"allocated":3014656,"data_stored":1799340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003670"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.796081+0000","last_change":"2024-09-18T01:25:06.692305+0000","last_active":"2024-09-18T01:27:14.796081+0000","last_peered":"2024-09-18T01:27:14.796081+0000","last_clean":"2024-09-18T01:27:14.796081+0000","last_became_active":"2024-09-18T01:25:06.691940+0000","last_became_peered":"2024-09-18T01:25:06.691940+0000","last_unstale":"2024-09-18T01:27:14.796081+0000","last_undegraded":"2024-09-18T01:27:14.796081+0000","last_fullsized":"2024-09-18T01:27:14.796081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'14","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.261128+0000","last_change":"2024-09-18T01:29:03.261180+0000","last_active":"2024-09-18T01:29:03.261128+0000","last_peered":"2024-09-18T01:29:03.261128+0000","last_clean":"2024-09-18T01:29:03.261128+0000","last_became_active":"2024-09-18T01:25:08.683538+0000","last_became_peered":"2024-09-18T01:25:08.683538+0000","last_unstale":"2024-09-18T01:29:03.261128+0000","last_undegraded":"2024-09-18T01:29:03.261128+0000","last_fullsized":"2024-09-18T01:29:03.261128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-18T01:29:03.261027+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-18T01:29:03.261027+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.261027+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:47.678527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:06.499984+0000","last_change":"2024-09-18T01:29:06.500013+0000","last_active":"2024-09-18T01:29:06.499984+0000","last_peered":"2024-09-18T01:29:06.499984+0000","last_clean":"2024-09-18T01:29:06.499984+0000","last_became_active":"2024-09-18T01:25:06.686950+0000","last_became_peered":"2024-09-18T01:25:06.686950+0000","last_unstale":"2024-09-18T01:29:06.499984+0000","last_undegraded":"2024-09-18T01:29:06.499984+0000","last_fullsized":"2024-09-18T01:29:06.499984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:06.499890+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:06.499890+0000","last_clean_scrub_stamp":"2024-09-18T01:29:06.499890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:52:59.744454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'20","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.965869+0000","last_change":"2024-09-18T01:25:08.673859+0000","last_active":"2024-09-18T01:28:16.965869+0000","last_peered":"2024-09-18T01:28:16.965869+0000","last_clean":"2024-09-18T01:28:16.965869+0000","last_became_active":"2024-09-18T01:25:08.673552+0000","last_became_peered":"2024-09-18T01:25:08.673552+0000","last_unstale":"2024-09-18T01:28:16.965869+0000","last_undegraded":"2024-09-18T01:28:16.965869+0000","last_fullsized":"2024-09-18T01:28:16.965869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.796672+0000","last_change":"2024-09-18T01:25:06.687698+0000","last_active":"2024-09-18T01:27:14.796672+0000","last_peered":"2024-09-18T01:27:14.796672+0000","last_clean":"2024-09-18T01:27:14.796672+0000","last_became_active":"2024-09-18T01:25:06.687068+0000","last_became_peered":"2024-09-18T01:25:06.687068+0000","last_unstale":"2024-09-18T01:27:14.796672+0000","last_undegraded":"2024-09-18T01:27:14.796672+0000","last_fullsized":"2024-09-18T01:27:14.796672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'10","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.112529+0000","last_change":"2024-09-18T01:29:01.112565+0000","last_active":"2024-09-18T01:29:01.112529+0000","last_peered":"2024-09-18T01:29:01.112529+0000","last_clean":"2024-09-18T01:29:01.112529+0000","last_became_active":"2024-09-18T01:25:08.685074+0000","last_became_peered":"2024-09-18T01:25:08.685074+0000","last_unstale":"2024-09-18T01:29:01.112529+0000","last_undegraded":"2024-09-18T01:29:01.112529+0000","last_fullsized":"2024-09-18T01:29:01.112529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-18T01:29:01.112427+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-18T01:29:01.112427+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.112427+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:56:10.526652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:09.795307+0000","last_change":"2024-09-18T01:25:06.690926+0000","last_active":"2024-09-18T01:27:09.795307+0000","last_peered":"2024-09-18T01:27:09.795307+0000","last_clean":"2024-09-18T01:27:09.795307+0000","last_became_active":"2024-09-18T01:25:06.690552+0000","last_became_peered":"2024-09-18T01:25:06.690552+0000","last_unstale":"2024-09-18T01:27:09.795307+0000","last_undegraded":"2024-09-18T01:27:09.795307+0000","last_fullsized":"2024-09-18T01:27:09.795307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'8","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800831+0000","last_change":"2024-09-18T01:25:08.676582+0000","last_active":"2024-09-18T01:27:39.800831+0000","last_peered":"2024-09-18T01:27:39.800831+0000","last_clean":"2024-09-18T01:27:39.800831+0000","last_became_active":"2024-09-18T01:25:08.674210+0000","last_became_peered":"2024-09-18T01:25:08.674210+0000","last_unstale":"2024-09-18T01:27:39.800831+0000","last_undegraded":"2024-09-18T01:27:39.800831+0000","last_fullsized":"2024-09-18T01:27:39.800831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800810+0000","last_change":"2024-09-18T01:25:06.689859+0000","last_active":"2024-09-18T01:27:39.800810+0000","last_peered":"2024-09-18T01:27:39.800810+0000","last_clean":"2024-09-18T01:27:39.800810+0000","last_became_active":"2024-09-18T01:25:06.687608+0000","last_became_peered":"2024-09-18T01:25:06.687608+0000","last_unstale":"2024-09-18T01:27:39.800810+0000","last_undegraded":"2024-09-18T01:27:39.800810+0000","last_fullsized":"2024-09-18T01:27:39.800810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:13.394177+0000","last_change":"2024-09-18T01:25:08.684086+0000","last_active":"2024-09-18T01:27:13.394177+0000","last_peered":"2024-09-18T01:27:13.394177+0000","last_clean":"2024-09-18T01:27:13.394177+0000","last_became_active":"2024-09-18T01:25:08.683812+0000","last_became_peered":"2024-09-18T01:25:08.683812+0000","last_unstale":"2024-09-18T01:27:13.394177+0000","last_undegraded":"2024-09-18T01:27:13.394177+0000","last_fullsized":"2024-09-18T01:27:13.394177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.094725+0000","last_change":"2024-09-18T01:25:06.702940+0000","last_active":"2024-09-18T01:28:17.094725+0000","last_peered":"2024-09-18T01:28:17.094725+0000","last_clean":"2024-09-18T01:28:17.094725+0000","last_became_active":"2024-09-18T01:25:06.702616+0000","last_became_peered":"2024-09-18T01:25:06.702616+0000","last_unstale":"2024-09-18T01:28:17.094725+0000","last_undegraded":"2024-09-18T01:28:17.094725+0000","last_fullsized":"2024-09-18T01:28:17.094725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'8","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.963332+0000","last_change":"2024-09-18T01:25:43.904757+0000","last_active":"2024-09-18T01:28:16.963332+0000","last_peered":"2024-09-18T01:28:16.963332+0000","last_clean":"2024-09-18T01:28:16.963332+0000","last_became_active":"2024-09-18T01:25:43.904427+0000","last_became_peered":"2024-09-18T01:25:43.904427+0000","last_unstale":"2024-09-18T01:28:16.963332+0000","last_undegraded":"2024-09-18T01:28:16.963332+0000","last_fullsized":"2024-09-18T01:28:16.963332+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800683+0000","last_change":"2024-09-18T01:25:06.683548+0000","last_active":"2024-09-18T01:27:39.800683+0000","last_peered":"2024-09-18T01:27:39.800683+0000","last_clean":"2024-09-18T01:27:39.800683+0000","last_became_active":"2024-09-18T01:25:06.683195+0000","last_became_peered":"2024-09-18T01:25:06.683195+0000","last_unstale":"2024-09-18T01:27:39.800683+0000","last_undegraded":"2024-09-18T01:27:39.800683+0000","last_fullsized":"2024-09-18T01:27:39.800683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.828578+0000","last_change":"2024-09-18T01:28:50.828610+0000","last_active":"2024-09-18T01:28:50.828578+0000","last_peered":"2024-09-18T01:28:50.828578+0000","last_clean":"2024-09-18T01:28:50.828578+0000","last_became_active":"2024-09-18T01:25:08.677579+0000","last_became_peered":"2024-09-18T01:25:08.677579+0000","last_unstale":"2024-09-18T01:28:50.828578+0000","last_undegraded":"2024-09-18T01:28:50.828578+0000","last_fullsized":"2024-09-18T01:28:50.828578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:50.828488+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:50.828488+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.828488+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:52.949299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:37.799971+0000","last_change":"2024-09-18T01:25:06.686453+0000","last_active":"2024-09-18T01:27:37.799971+0000","last_peered":"2024-09-18T01:27:37.799971+0000","last_clean":"2024-09-18T01:27:37.799971+0000","last_became_active":"2024-09-18T01:25:06.686049+0000","last_became_peered":"2024-09-18T01:25:06.686049+0000","last_unstale":"2024-09-18T01:27:37.799971+0000","last_undegraded":"2024-09-18T01:27:37.799971+0000","last_fullsized":"2024-09-18T01:27:37.799971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:16.484906+0000","last_change":"2024-09-18T01:25:08.676582+0000","last_active":"2024-09-18T01:27:16.484906+0000","last_peered":"2024-09-18T01:27:16.484906+0000","last_clean":"2024-09-18T01:27:16.484906+0000","last_became_active":"2024-09-18T01:25:08.676310+0000","last_became_peered":"2024-09-18T01:25:08.676310+0000","last_unstale":"2024-09-18T01:27:16.484906+0000","last_undegraded":"2024-09-18T01:27:16.484906+0000","last_fullsized":"2024-09-18T01:27:16.484906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'24","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.107040+0000","last_change":"2024-09-18T01:25:08.673269+0000","last_active":"2024-09-18T01:28:17.107040+0000","last_peered":"2024-09-18T01:28:17.107040+0000","last_clean":"2024-09-18T01:28:17.107040+0000","last_became_active":"2024-09-18T01:25:08.671858+0000","last_became_peered":"2024-09-18T01:25:08.671858+0000","last_unstale":"2024-09-18T01:28:17.107040+0000","last_undegraded":"2024-09-18T01:28:17.107040+0000","last_fullsized":"2024-09-18T01:28:17.107040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":55,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800138+0000","last_change":"2024-09-18T01:25:06.691701+0000","last_active":"2024-09-18T01:27:34.800138+0000","last_peered":"2024-09-18T01:27:34.800138+0000","last_clean":"2024-09-18T01:27:34.800138+0000","last_became_active":"2024-09-18T01:25:06.691034+0000","last_became_peered":"2024-09-18T01:25:06.691034+0000","last_unstale":"2024-09-18T01:27:34.800138+0000","last_undegraded":"2024-09-18T01:27:34.800138+0000","last_fullsized":"2024-09-18T01:27:34.800138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'3","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.231199+0000","last_change":"2024-09-18T01:25:08.685309+0000","last_active":"2024-09-18T01:28:17.231199+0000","last_peered":"2024-09-18T01:28:17.231199+0000","last_clean":"2024-09-18T01:28:17.231199+0000","last_became_active":"2024-09-18T01:25:08.685043+0000","last_became_peered":"2024-09-18T01:25:08.685043+0000","last_unstale":"2024-09-18T01:28:17.231199+0000","last_undegraded":"2024-09-18T01:28:17.231199+0000","last_fullsized":"2024-09-18T01:28:17.231199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.864615+0000","last_change":"2024-09-18T01:28:56.864648+0000","last_active":"2024-09-18T01:28:56.864615+0000","last_peered":"2024-09-18T01:28:56.864615+0000","last_clean":"2024-09-18T01:28:56.864615+0000","last_became_active":"2024-09-18T01:25:06.704414+0000","last_became_peered":"2024-09-18T01:25:06.704414+0000","last_unstale":"2024-09-18T01:28:56.864615+0000","last_undegraded":"2024-09-18T01:28:56.864615+0000","last_fullsized":"2024-09-18T01:28:56.864615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:56.864507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:56.864507+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.864507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:33.916587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.103602+0000","last_change":"2024-09-18T01:25:08.685665+0000","last_active":"2024-09-18T01:28:17.103602+0000","last_peered":"2024-09-18T01:28:17.103602+0000","last_clean":"2024-09-18T01:28:17.103602+0000","last_became_active":"2024-09-18T01:25:08.684921+0000","last_became_peered":"2024-09-18T01:25:08.684921+0000","last_unstale":"2024-09-18T01:28:17.103602+0000","last_undegraded":"2024-09-18T01:28:17.103602+0000","last_fullsized":"2024-09-18T01:28:17.103602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'3","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800079+0000","last_change":"2024-09-18T01:25:06.688208+0000","last_active":"2024-09-18T01:27:34.800079+0000","last_peered":"2024-09-18T01:27:34.800079+0000","last_clean":"2024-09-18T01:27:34.800079+0000","last_became_active":"2024-09-18T01:25:06.687737+0000","last_became_peered":"2024-09-18T01:25:06.687737+0000","last_unstale":"2024-09-18T01:27:34.800079+0000","last_undegraded":"2024-09-18T01:27:34.800079+0000","last_fullsized":"2024-09-18T01:27:34.800079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'16","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.461976+0000","last_change":"2024-09-18T01:28:57.462002+0000","last_active":"2024-09-18T01:28:57.461976+0000","last_peered":"2024-09-18T01:28:57.461976+0000","last_clean":"2024-09-18T01:28:57.461976+0000","last_became_active":"2024-09-18T01:25:08.671338+0000","last_became_peered":"2024-09-18T01:25:08.671338+0000","last_unstale":"2024-09-18T01:28:57.461976+0000","last_undegraded":"2024-09-18T01:28:57.461976+0000","last_fullsized":"2024-09-18T01:28:57.461976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-18T01:28:57.461821+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-18T01:28:57.461821+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.461821+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:42:49.435139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800052+0000","last_change":"2024-09-18T01:25:06.688689+0000","last_active":"2024-09-18T01:27:34.800052+0000","last_peered":"2024-09-18T01:27:34.800052+0000","last_clean":"2024-09-18T01:27:34.800052+0000","last_became_active":"2024-09-18T01:25:06.688356+0000","last_became_peered":"2024-09-18T01:25:06.688356+0000","last_unstale":"2024-09-18T01:27:34.800052+0000","last_undegraded":"2024-09-18T01:27:34.800052+0000","last_fullsized":"2024-09-18T01:27:34.800052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.810538+0000","last_change":"2024-09-18T01:28:59.810589+0000","last_active":"2024-09-18T01:28:59.810538+0000","last_peered":"2024-09-18T01:28:59.810538+0000","last_clean":"2024-09-18T01:28:59.810538+0000","last_became_active":"2024-09-18T01:25:08.673915+0000","last_became_peered":"2024-09-18T01:25:08.673915+0000","last_unstale":"2024-09-18T01:28:59.810538+0000","last_undegraded":"2024-09-18T01:28:59.810538+0000","last_fullsized":"2024-09-18T01:28:59.810538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:59.810429+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:59.810429+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.810429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:41:53.505612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.441061+0000","last_change":"2024-09-18T01:29:04.441106+0000","last_active":"2024-09-18T01:29:04.441061+0000","last_peered":"2024-09-18T01:29:04.441061+0000","last_clean":"2024-09-18T01:29:04.441061+0000","last_became_active":"2024-09-18T01:25:06.686900+0000","last_became_peered":"2024-09-18T01:25:06.686900+0000","last_unstale":"2024-09-18T01:29:04.441061+0000","last_undegraded":"2024-09-18T01:29:04.441061+0000","last_fullsized":"2024-09-18T01:29:04.441061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:04.440953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:04.440953+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.440953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:10.843955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'6","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.177086+0000","last_change":"2024-09-18T01:28:57.177149+0000","last_active":"2024-09-18T01:28:57.177086+0000","last_peered":"2024-09-18T01:28:57.177086+0000","last_clean":"2024-09-18T01:28:57.177086+0000","last_became_active":"2024-09-18T01:25:08.682225+0000","last_became_peered":"2024-09-18T01:25:08.682225+0000","last_unstale":"2024-09-18T01:28:57.177086+0000","last_undegraded":"2024-09-18T01:28:57.177086+0000","last_fullsized":"2024-09-18T01:28:57.177086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:57.176987+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:57.176987+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.176987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:15.711498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799058+0000","last_change":"2024-09-18T01:25:06.695620+0000","last_active":"2024-09-18T01:27:29.799058+0000","last_peered":"2024-09-18T01:27:29.799058+0000","last_clean":"2024-09-18T01:27:29.799058+0000","last_became_active":"2024-09-18T01:25:06.693647+0000","last_became_peered":"2024-09-18T01:25:06.693647+0000","last_unstale":"2024-09-18T01:27:29.799058+0000","last_undegraded":"2024-09-18T01:27:29.799058+0000","last_fullsized":"2024-09-18T01:27:29.799058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'35","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.191609+0000","last_change":"2024-09-18T01:25:16.712693+0000","last_active":"2024-09-18T01:28:17.191609+0000","last_peered":"2024-09-18T01:28:17.191609+0000","last_clean":"2024-09-18T01:28:17.191609+0000","last_became_active":"2024-09-18T01:25:16.712438+0000","last_became_peered":"2024-09-18T01:25:16.712438+0000","last_unstale":"2024-09-18T01:28:17.191609+0000","last_undegraded":"2024-09-18T01:28:17.191609+0000","last_fullsized":"2024-09-18T01:28:17.191609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799161+0000","last_change":"2024-09-18T01:25:08.673859+0000","last_active":"2024-09-18T01:27:29.799161+0000","last_peered":"2024-09-18T01:27:29.799161+0000","last_clean":"2024-09-18T01:27:29.799161+0000","last_became_active":"2024-09-18T01:25:08.673605+0000","last_became_peered":"2024-09-18T01:25:08.673605+0000","last_unstale":"2024-09-18T01:27:29.799161+0000","last_undegraded":"2024-09-18T01:27:29.799161+0000","last_fullsized":"2024-09-18T01:27:29.799161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799122+0000","last_change":"2024-09-18T01:25:06.687788+0000","last_active":"2024-09-18T01:27:29.799122+0000","last_peered":"2024-09-18T01:27:29.799122+0000","last_clean":"2024-09-18T01:27:29.799122+0000","last_became_active":"2024-09-18T01:25:06.685173+0000","last_became_peered":"2024-09-18T01:25:06.685173+0000","last_unstale":"2024-09-18T01:27:29.799122+0000","last_undegraded":"2024-09-18T01:27:29.799122+0000","last_fullsized":"2024-09-18T01:27:29.799122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.112958+0000","last_change":"2024-09-18T01:28:31.112996+0000","last_active":"2024-09-18T01:28:31.112958+0000","last_peered":"2024-09-18T01:28:31.112958+0000","last_clean":"2024-09-18T01:28:31.112958+0000","last_became_active":"2024-09-18T01:25:10.684454+0000","last_became_peered":"2024-09-18T01:25:10.684454+0000","last_unstale":"2024-09-18T01:28:31.112958+0000","last_undegraded":"2024-09-18T01:28:31.112958+0000","last_fullsized":"2024-09-18T01:28:31.112958+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.112838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.112838+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.112838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:47:30.069158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'50","reported_seq":117,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.035327+0000","last_change":"2024-09-18T01:28:47.035364+0000","last_active":"2024-09-18T01:28:47.035327+0000","last_peered":"2024-09-18T01:28:47.035327+0000","last_clean":"2024-09-18T01:28:47.035327+0000","last_became_active":"2024-09-18T01:25:12.692059+0000","last_became_peered":"2024-09-18T01:25:12.692059+0000","last_unstale":"2024-09-18T01:28:47.035327+0000","last_undegraded":"2024-09-18T01:28:47.035327+0000","last_fullsized":"2024-09-18T01:28:47.035327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'50","last_scrub_stamp":"2024-09-18T01:28:47.035239+0000","last_deep_scrub":"35'50","last_deep_scrub_stamp":"2024-09-18T01:28:47.035239+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.035239+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:17:16.348705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.307401+0000","last_change":"2024-09-18T01:28:47.307427+0000","last_active":"2024-09-18T01:28:47.307401+0000","last_peered":"2024-09-18T01:28:47.307401+0000","last_clean":"2024-09-18T01:28:47.307401+0000","last_became_active":"2024-09-18T01:25:14.709879+0000","last_became_peered":"2024-09-18T01:25:14.709879+0000","last_unstale":"2024-09-18T01:28:47.307401+0000","last_undegraded":"2024-09-18T01:28:47.307401+0000","last_fullsized":"2024-09-18T01:28:47.307401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:47.307314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:47.307314+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.307314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:14:14.624869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801517+0000","last_change":"2024-09-18T01:25:16.712032+0000","last_active":"2024-09-18T01:27:44.801517+0000","last_peered":"2024-09-18T01:27:44.801517+0000","last_clean":"2024-09-18T01:27:44.801517+0000","last_became_active":"2024-09-18T01:25:16.711764+0000","last_became_peered":"2024-09-18T01:25:16.711764+0000","last_unstale":"2024-09-18T01:27:44.801517+0000","last_undegraded":"2024-09-18T01:27:44.801517+0000","last_fullsized":"2024-09-18T01:27:44.801517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:09.804191+0000","last_change":"2024-09-18T01:25:43.852201+0000","last_active":"2024-09-18T01:28:09.804191+0000","last_peered":"2024-09-18T01:28:09.804191+0000","last_clean":"2024-09-18T01:28:09.804191+0000","last_became_active":"2024-09-18T01:25:43.848631+0000","last_became_peered":"2024-09-18T01:25:43.848631+0000","last_unstale":"2024-09-18T01:28:09.804191+0000","last_undegraded":"2024-09-18T01:28:09.804191+0000","last_fullsized":"2024-09-18T01:28:09.804191+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.798392+0000","last_change":"2024-09-18T01:25:06.691194+0000","last_active":"2024-09-18T01:27:29.798392+0000","last_peered":"2024-09-18T01:27:29.798392+0000","last_clean":"2024-09-18T01:27:29.798392+0000","last_became_active":"2024-09-18T01:25:06.690813+0000","last_became_peered":"2024-09-18T01:25:06.690813+0000","last_unstale":"2024-09-18T01:27:29.798392+0000","last_undegraded":"2024-09-18T01:27:29.798392+0000","last_fullsized":"2024-09-18T01:27:29.798392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.568137+0000","last_change":"2024-09-18T01:28:48.568158+0000","last_active":"2024-09-18T01:28:48.568137+0000","last_peered":"2024-09-18T01:28:48.568137+0000","last_clean":"2024-09-18T01:28:48.568137+0000","last_became_active":"2024-09-18T01:25:10.677226+0000","last_became_peered":"2024-09-18T01:25:10.677226+0000","last_unstale":"2024-09-18T01:28:48.568137+0000","last_undegraded":"2024-09-18T01:28:48.568137+0000","last_fullsized":"2024-09-18T01:28:48.568137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:48.568063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:48.568063+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.568063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:31.051544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'17","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.394431+0000","last_change":"2024-09-18T01:28:30.394506+0000","last_active":"2024-09-18T01:28:30.394431+0000","last_peered":"2024-09-18T01:28:30.394431+0000","last_clean":"2024-09-18T01:28:30.394431+0000","last_became_active":"2024-09-18T01:25:12.688366+0000","last_became_peered":"2024-09-18T01:25:12.688366+0000","last_unstale":"2024-09-18T01:28:30.394431+0000","last_undegraded":"2024-09-18T01:28:30.394431+0000","last_fullsized":"2024-09-18T01:28:30.394431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-18T01:28:30.394314+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-18T01:28:30.394314+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.394314+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:51.126406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.435350+0000","last_change":"2024-09-18T01:28:31.435372+0000","last_active":"2024-09-18T01:28:31.435350+0000","last_peered":"2024-09-18T01:28:31.435350+0000","last_clean":"2024-09-18T01:28:31.435350+0000","last_became_active":"2024-09-18T01:25:14.702918+0000","last_became_peered":"2024-09-18T01:25:14.702918+0000","last_unstale":"2024-09-18T01:28:31.435350+0000","last_undegraded":"2024-09-18T01:28:31.435350+0000","last_fullsized":"2024-09-18T01:28:31.435350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.435257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.435257+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.435257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:21.639639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.288121+0000","last_change":"2024-09-18T01:25:16.714035+0000","last_active":"2024-09-18T01:28:17.288121+0000","last_peered":"2024-09-18T01:28:17.288121+0000","last_clean":"2024-09-18T01:28:17.288121+0000","last_became_active":"2024-09-18T01:25:16.713571+0000","last_became_peered":"2024-09-18T01:25:16.713571+0000","last_unstale":"2024-09-18T01:28:17.288121+0000","last_undegraded":"2024-09-18T01:28:17.288121+0000","last_fullsized":"2024-09-18T01:28:17.288121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'8","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.182973+0000","last_change":"2024-09-18T01:25:08.673278+0000","last_active":"2024-09-18T01:28:17.182973+0000","last_peered":"2024-09-18T01:28:17.182973+0000","last_clean":"2024-09-18T01:28:17.182973+0000","last_became_active":"2024-09-18T01:25:08.671904+0000","last_became_peered":"2024-09-18T01:25:08.671904+0000","last_unstale":"2024-09-18T01:28:17.182973+0000","last_undegraded":"2024-09-18T01:28:17.182973+0000","last_fullsized":"2024-09-18T01:28:17.182973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799005+0000","last_change":"2024-09-18T01:25:06.681491+0000","last_active":"2024-09-18T01:27:29.799005+0000","last_peered":"2024-09-18T01:27:29.799005+0000","last_clean":"2024-09-18T01:27:29.799005+0000","last_became_active":"2024-09-18T01:25:06.681065+0000","last_became_peered":"2024-09-18T01:25:06.681065+0000","last_unstale":"2024-09-18T01:27:29.799005+0000","last_undegraded":"2024-09-18T01:27:29.799005+0000","last_fullsized":"2024-09-18T01:27:29.799005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.538533+0000","last_change":"2024-09-18T01:28:49.538567+0000","last_active":"2024-09-18T01:28:49.538533+0000","last_peered":"2024-09-18T01:28:49.538533+0000","last_clean":"2024-09-18T01:28:49.538533+0000","last_became_active":"2024-09-18T01:25:10.677118+0000","last_became_peered":"2024-09-18T01:25:10.677118+0000","last_unstale":"2024-09-18T01:28:49.538533+0000","last_undegraded":"2024-09-18T01:28:49.538533+0000","last_fullsized":"2024-09-18T01:28:49.538533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:49.538452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:49.538452+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.538452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:45.840473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'29","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.676629+0000","last_change":"2024-09-18T01:28:36.676691+0000","last_active":"2024-09-18T01:28:36.676629+0000","last_peered":"2024-09-18T01:28:36.676629+0000","last_clean":"2024-09-18T01:28:36.676629+0000","last_became_active":"2024-09-18T01:25:12.693426+0000","last_became_peered":"2024-09-18T01:25:12.693426+0000","last_unstale":"2024-09-18T01:28:36.676629+0000","last_undegraded":"2024-09-18T01:28:36.676629+0000","last_fullsized":"2024-09-18T01:28:36.676629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'29","last_scrub_stamp":"2024-09-18T01:28:36.676525+0000","last_deep_scrub":"35'29","last_deep_scrub_stamp":"2024-09-18T01:28:36.676525+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.676525+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:10.438462+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'286","reported_seq":394,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.005383+0000","last_change":"2024-09-18T01:28:55.005433+0000","last_active":"2024-09-18T01:28:55.005383+0000","last_peered":"2024-09-18T01:28:55.005383+0000","last_clean":"2024-09-18T01:28:55.005383+0000","last_became_active":"2024-09-18T01:25:14.707544+0000","last_became_peered":"2024-09-18T01:25:14.707544+0000","last_unstale":"2024-09-18T01:28:55.005383+0000","last_undegraded":"2024-09-18T01:28:55.005383+0000","last_fullsized":"2024-09-18T01:28:55.005383+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-09-18T01:28:55.005253+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-09-18T01:28:55.005253+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.005253+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:36.156462+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.798041+0000","last_change":"2024-09-18T01:28:49.798066+0000","last_active":"2024-09-18T01:28:49.798041+0000","last_peered":"2024-09-18T01:28:49.798041+0000","last_clean":"2024-09-18T01:28:49.798041+0000","last_became_active":"2024-09-18T01:25:16.713458+0000","last_became_peered":"2024-09-18T01:25:16.713458+0000","last_unstale":"2024-09-18T01:28:49.798041+0000","last_undegraded":"2024-09-18T01:28:49.798041+0000","last_fullsized":"2024-09-18T01:28:49.798041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:49.797948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:49.797948+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.797948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:24:57.198351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.439200+0000","last_change":"2024-09-18T01:28:56.439235+0000","last_active":"2024-09-18T01:28:56.439200+0000","last_peered":"2024-09-18T01:28:56.439200+0000","last_clean":"2024-09-18T01:28:56.439200+0000","last_became_active":"2024-09-18T01:25:08.680700+0000","last_became_peered":"2024-09-18T01:25:08.680700+0000","last_unstale":"2024-09-18T01:28:56.439200+0000","last_undegraded":"2024-09-18T01:28:56.439200+0000","last_fullsized":"2024-09-18T01:28:56.439200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:28:56.439096+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:28:56.439096+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.439096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:40:37.562803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'6","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799189+0000","last_change":"2024-09-18T01:25:06.691595+0000","last_active":"2024-09-18T01:27:29.799189+0000","last_peered":"2024-09-18T01:27:29.799189+0000","last_clean":"2024-09-18T01:27:29.799189+0000","last_became_active":"2024-09-18T01:25:06.691107+0000","last_became_peered":"2024-09-18T01:25:06.691107+0000","last_unstale":"2024-09-18T01:27:29.799189+0000","last_undegraded":"2024-09-18T01:27:29.799189+0000","last_fullsized":"2024-09-18T01:27:29.799189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.093957+0000","last_change":"2024-09-18T01:28:36.094004+0000","last_active":"2024-09-18T01:28:36.093957+0000","last_peered":"2024-09-18T01:28:36.093957+0000","last_clean":"2024-09-18T01:28:36.093957+0000","last_became_active":"2024-09-18T01:25:10.681273+0000","last_became_peered":"2024-09-18T01:25:10.681273+0000","last_unstale":"2024-09-18T01:28:36.093957+0000","last_undegraded":"2024-09-18T01:28:36.093957+0000","last_fullsized":"2024-09-18T01:28:36.093957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:36.093832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:36.093832+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.093832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:01.927384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'46","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.714556+0000","last_change":"2024-09-18T01:28:34.714630+0000","last_active":"2024-09-18T01:28:34.714556+0000","last_peered":"2024-09-18T01:28:34.714556+0000","last_clean":"2024-09-18T01:28:34.714556+0000","last_became_active":"2024-09-18T01:25:12.697114+0000","last_became_peered":"2024-09-18T01:25:12.697114+0000","last_unstale":"2024-09-18T01:28:34.714556+0000","last_undegraded":"2024-09-18T01:28:34.714556+0000","last_fullsized":"2024-09-18T01:28:34.714556+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:34.714456+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:34.714456+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.714456+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:50.227668+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":61,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":417,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.646306+0000","last_change":"2024-09-18T01:28:32.646333+0000","last_active":"2024-09-18T01:28:32.646306+0000","last_peered":"2024-09-18T01:28:32.646306+0000","last_clean":"2024-09-18T01:28:32.646306+0000","last_became_active":"2024-09-18T01:25:14.698792+0000","last_became_peered":"2024-09-18T01:25:14.698792+0000","last_unstale":"2024-09-18T01:28:32.646306+0000","last_undegraded":"2024-09-18T01:28:32.646306+0000","last_fullsized":"2024-09-18T01:28:32.646306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:32.646216+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:32.646216+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.646216+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:58:39.844651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.153487+0000","last_change":"2024-09-18T01:25:08.680575+0000","last_active":"2024-09-18T01:28:17.153487+0000","last_peered":"2024-09-18T01:28:17.153487+0000","last_clean":"2024-09-18T01:28:17.153487+0000","last_became_active":"2024-09-18T01:25:08.680143+0000","last_became_peered":"2024-09-18T01:25:08.680143+0000","last_unstale":"2024-09-18T01:28:17.153487+0000","last_undegraded":"2024-09-18T01:28:17.153487+0000","last_fullsized":"2024-09-18T01:28:17.153487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.797634+0000","last_change":"2024-09-18T01:25:06.701050+0000","last_active":"2024-09-18T01:27:24.797634+0000","last_peered":"2024-09-18T01:27:24.797634+0000","last_clean":"2024-09-18T01:27:24.797634+0000","last_became_active":"2024-09-18T01:25:06.700650+0000","last_became_peered":"2024-09-18T01:25:06.700650+0000","last_unstale":"2024-09-18T01:27:24.797634+0000","last_undegraded":"2024-09-18T01:27:24.797634+0000","last_fullsized":"2024-09-18T01:27:24.797634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.335233+0000","last_change":"2024-09-18T01:28:37.335266+0000","last_active":"2024-09-18T01:28:37.335233+0000","last_peered":"2024-09-18T01:28:37.335233+0000","last_clean":"2024-09-18T01:28:37.335233+0000","last_became_active":"2024-09-18T01:25:10.683195+0000","last_became_peered":"2024-09-18T01:25:10.683195+0000","last_unstale":"2024-09-18T01:28:37.335233+0000","last_undegraded":"2024-09-18T01:28:37.335233+0000","last_fullsized":"2024-09-18T01:28:37.335233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:37.335139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:37.335139+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.335139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:26.770573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'59","reported_seq":125,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.709604+0000","last_change":"2024-09-18T01:28:38.709650+0000","last_active":"2024-09-18T01:28:38.709604+0000","last_peered":"2024-09-18T01:28:38.709604+0000","last_clean":"2024-09-18T01:28:38.709604+0000","last_became_active":"2024-09-18T01:25:12.687943+0000","last_became_peered":"2024-09-18T01:25:12.687943+0000","last_unstale":"2024-09-18T01:28:38.709604+0000","last_undegraded":"2024-09-18T01:28:38.709604+0000","last_fullsized":"2024-09-18T01:28:38.709604+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'59","last_scrub_stamp":"2024-09-18T01:28:38.709506+0000","last_deep_scrub":"35'59","last_deep_scrub_stamp":"2024-09-18T01:28:38.709506+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.709506+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:03.906269+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.615166+0000","last_change":"2024-09-18T01:28:33.615199+0000","last_active":"2024-09-18T01:28:33.615166+0000","last_peered":"2024-09-18T01:28:33.615166+0000","last_clean":"2024-09-18T01:28:33.615166+0000","last_became_active":"2024-09-18T01:25:14.698795+0000","last_became_peered":"2024-09-18T01:25:14.698795+0000","last_unstale":"2024-09-18T01:28:33.615166+0000","last_undegraded":"2024-09-18T01:28:33.615166+0000","last_fullsized":"2024-09-18T01:28:33.615166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:33.615076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:33.615076+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.615076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:23.050510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'3","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.709518+0000","last_change":"2024-09-18T01:28:37.709545+0000","last_active":"2024-09-18T01:28:37.709518+0000","last_peered":"2024-09-18T01:28:37.709518+0000","last_clean":"2024-09-18T01:28:37.709518+0000","last_became_active":"2024-09-18T01:25:16.707206+0000","last_became_peered":"2024-09-18T01:25:16.707206+0000","last_unstale":"2024-09-18T01:28:37.709518+0000","last_undegraded":"2024-09-18T01:28:37.709518+0000","last_fullsized":"2024-09-18T01:28:37.709518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:28:37.709423+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:28:37.709423+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.709423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:50:03.029261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.304984+0000","last_change":"2024-09-18T01:29:01.305009+0000","last_active":"2024-09-18T01:29:01.304984+0000","last_peered":"2024-09-18T01:29:01.304984+0000","last_clean":"2024-09-18T01:29:01.304984+0000","last_became_active":"2024-09-18T01:25:08.682878+0000","last_became_peered":"2024-09-18T01:25:08.682878+0000","last_unstale":"2024-09-18T01:29:01.304984+0000","last_undegraded":"2024-09-18T01:29:01.304984+0000","last_fullsized":"2024-09-18T01:29:01.304984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:01.304883+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:01.304883+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.304883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:08.393205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.173116+0000","last_change":"2024-09-18T01:25:06.700753+0000","last_active":"2024-09-18T01:28:17.173116+0000","last_peered":"2024-09-18T01:28:17.173116+0000","last_clean":"2024-09-18T01:28:17.173116+0000","last_became_active":"2024-09-18T01:25:06.700357+0000","last_became_peered":"2024-09-18T01:25:06.700357+0000","last_unstale":"2024-09-18T01:28:17.173116+0000","last_undegraded":"2024-09-18T01:28:17.173116+0000","last_fullsized":"2024-09-18T01:28:17.173116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"35'2","reported_seq":230,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:45.605147+0000","last_change":"2024-09-18T01:28:45.605224+0000","last_active":"2024-09-18T01:28:45.605147+0000","last_peered":"2024-09-18T01:28:45.605147+0000","last_clean":"2024-09-18T01:28:45.605147+0000","last_became_active":"2024-09-18T01:25:10.679652+0000","last_became_peered":"2024-09-18T01:25:10.679652+0000","last_unstale":"2024-09-18T01:28:45.605147+0000","last_undegraded":"2024-09-18T01:28:45.605147+0000","last_fullsized":"2024-09-18T01:28:45.605147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:45.605047+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:45.605047+0000","last_clean_scrub_stamp":"2024-09-18T01:28:45.605047+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:05:23.022870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'43","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.069418+0000","last_change":"2024-09-18T01:28:33.069454+0000","last_active":"2024-09-18T01:28:33.069418+0000","last_peered":"2024-09-18T01:28:33.069418+0000","last_clean":"2024-09-18T01:28:33.069418+0000","last_became_active":"2024-09-18T01:25:12.691691+0000","last_became_peered":"2024-09-18T01:25:12.691691+0000","last_unstale":"2024-09-18T01:28:33.069418+0000","last_undegraded":"2024-09-18T01:28:33.069418+0000","last_fullsized":"2024-09-18T01:28:33.069418+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'43","last_scrub_stamp":"2024-09-18T01:28:33.069322+0000","last_deep_scrub":"35'43","last_deep_scrub_stamp":"2024-09-18T01:28:33.069322+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.069322+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:48.566800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.665588+0000","last_change":"2024-09-18T01:28:29.665641+0000","last_active":"2024-09-18T01:28:29.665588+0000","last_peered":"2024-09-18T01:28:29.665588+0000","last_clean":"2024-09-18T01:28:29.665588+0000","last_became_active":"2024-09-18T01:25:14.706505+0000","last_became_peered":"2024-09-18T01:25:14.706505+0000","last_unstale":"2024-09-18T01:28:29.665588+0000","last_undegraded":"2024-09-18T01:28:29.665588+0000","last_fullsized":"2024-09-18T01:28:29.665588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.665468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.665468+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.665468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:49:54.985306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'3","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798573+0000","last_change":"2024-09-18T01:25:16.713810+0000","last_active":"2024-09-18T01:27:24.798573+0000","last_peered":"2024-09-18T01:27:24.798573+0000","last_clean":"2024-09-18T01:27:24.798573+0000","last_became_active":"2024-09-18T01:25:16.713453+0000","last_became_peered":"2024-09-18T01:25:16.713453+0000","last_unstale":"2024-09-18T01:27:24.798573+0000","last_undegraded":"2024-09-18T01:27:24.798573+0000","last_fullsized":"2024-09-18T01:27:24.798573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.807321+0000","last_change":"2024-09-18T01:29:03.807348+0000","last_active":"2024-09-18T01:29:03.807321+0000","last_peered":"2024-09-18T01:29:03.807321+0000","last_clean":"2024-09-18T01:29:03.807321+0000","last_became_active":"2024-09-18T01:25:08.674525+0000","last_became_peered":"2024-09-18T01:25:08.674525+0000","last_unstale":"2024-09-18T01:29:03.807321+0000","last_undegraded":"2024-09-18T01:29:03.807321+0000","last_fullsized":"2024-09-18T01:29:03.807321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:03.807231+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:03.807231+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.807231+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:06:51.447638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.085667+0000","last_change":"2024-09-18T01:25:06.696117+0000","last_active":"2024-09-18T01:28:17.085667+0000","last_peered":"2024-09-18T01:28:17.085667+0000","last_clean":"2024-09-18T01:28:17.085667+0000","last_became_active":"2024-09-18T01:25:06.694058+0000","last_became_peered":"2024-09-18T01:25:06.694058+0000","last_unstale":"2024-09-18T01:28:17.085667+0000","last_undegraded":"2024-09-18T01:28:17.085667+0000","last_fullsized":"2024-09-18T01:28:17.085667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:59.802731+0000","last_change":"2024-09-18T01:25:43.903991+0000","last_active":"2024-09-18T01:27:59.802731+0000","last_peered":"2024-09-18T01:27:59.802731+0000","last_clean":"2024-09-18T01:27:59.802731+0000","last_became_active":"2024-09-18T01:25:43.903638+0000","last_became_peered":"2024-09-18T01:25:43.903638+0000","last_unstale":"2024-09-18T01:27:59.802731+0000","last_undegraded":"2024-09-18T01:27:59.802731+0000","last_fullsized":"2024-09-18T01:27:59.802731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'60","reported_seq":130,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.055906+0000","last_change":"2024-09-18T01:28:54.055969+0000","last_active":"2024-09-18T01:28:54.055906+0000","last_peered":"2024-09-18T01:28:54.055906+0000","last_clean":"2024-09-18T01:28:54.055906+0000","last_became_active":"2024-09-18T01:25:12.693182+0000","last_became_peered":"2024-09-18T01:25:12.693182+0000","last_unstale":"2024-09-18T01:28:54.055906+0000","last_undegraded":"2024-09-18T01:28:54.055906+0000","last_fullsized":"2024-09-18T01:28:54.055906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'60","last_scrub_stamp":"2024-09-18T01:28:54.055805+0000","last_deep_scrub":"35'60","last_deep_scrub_stamp":"2024-09-18T01:28:54.055805+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.055805+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:07.480785+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":360,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.671836+0000","last_change":"2024-09-18T01:28:28.671899+0000","last_active":"2024-09-18T01:28:28.671836+0000","last_peered":"2024-09-18T01:28:28.671836+0000","last_clean":"2024-09-18T01:28:28.671836+0000","last_became_active":"2024-09-18T01:25:14.706540+0000","last_became_peered":"2024-09-18T01:25:14.706540+0000","last_unstale":"2024-09-18T01:28:28.671836+0000","last_undegraded":"2024-09-18T01:28:28.671836+0000","last_fullsized":"2024-09-18T01:28:28.671836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:28.671739+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:28.671739+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.671739+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:02.156270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:27.798366+0000","last_change":"2024-09-18T01:25:16.714648+0000","last_active":"2024-09-18T01:27:27.798366+0000","last_peered":"2024-09-18T01:27:27.798366+0000","last_clean":"2024-09-18T01:27:27.798366+0000","last_became_active":"2024-09-18T01:25:16.714363+0000","last_became_peered":"2024-09-18T01:25:16.714363+0000","last_unstale":"2024-09-18T01:27:27.798366+0000","last_undegraded":"2024-09-18T01:27:27.798366+0000","last_fullsized":"2024-09-18T01:27:27.798366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'4","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.853824+0000","last_change":"2024-09-18T01:28:55.853852+0000","last_active":"2024-09-18T01:28:55.853824+0000","last_peered":"2024-09-18T01:28:55.853824+0000","last_clean":"2024-09-18T01:28:55.853824+0000","last_became_active":"2024-09-18T01:25:08.670617+0000","last_became_peered":"2024-09-18T01:25:08.670617+0000","last_unstale":"2024-09-18T01:28:55.853824+0000","last_undegraded":"2024-09-18T01:28:55.853824+0000","last_fullsized":"2024-09-18T01:28:55.853824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:55.853740+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:55.853740+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.853740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:37:55.765115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798228+0000","last_change":"2024-09-18T01:25:06.693637+0000","last_active":"2024-09-18T01:27:24.798228+0000","last_peered":"2024-09-18T01:27:24.798228+0000","last_clean":"2024-09-18T01:27:24.798228+0000","last_became_active":"2024-09-18T01:25:06.689545+0000","last_became_peered":"2024-09-18T01:25:06.689545+0000","last_unstale":"2024-09-18T01:27:24.798228+0000","last_undegraded":"2024-09-18T01:27:24.798228+0000","last_fullsized":"2024-09-18T01:27:24.798228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:54.802027+0000","last_change":"2024-09-18T01:25:43.907490+0000","last_active":"2024-09-18T01:27:54.802027+0000","last_peered":"2024-09-18T01:27:54.802027+0000","last_clean":"2024-09-18T01:27:54.802027+0000","last_became_active":"2024-09-18T01:25:43.907094+0000","last_became_peered":"2024-09-18T01:25:43.907094+0000","last_unstale":"2024-09-18T01:27:54.802027+0000","last_undegraded":"2024-09-18T01:27:54.802027+0000","last_fullsized":"2024-09-18T01:27:54.802027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'81","reported_seq":166,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.022817+0000","last_change":"2024-09-18T01:28:57.022879+0000","last_active":"2024-09-18T01:28:57.022817+0000","last_peered":"2024-09-18T01:28:57.022817+0000","last_clean":"2024-09-18T01:28:57.022817+0000","last_became_active":"2024-09-18T01:25:12.692821+0000","last_became_peered":"2024-09-18T01:25:12.692821+0000","last_unstale":"2024-09-18T01:28:57.022817+0000","last_undegraded":"2024-09-18T01:28:57.022817+0000","last_fullsized":"2024-09-18T01:28:57.022817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'81","last_scrub_stamp":"2024-09-18T01:28:57.022705+0000","last_deep_scrub":"35'81","last_deep_scrub_stamp":"2024-09-18T01:28:57.022705+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.022705+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:33.670619+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":84,"num_read_kb":81,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.550650+0000","last_change":"2024-09-18T01:28:47.550677+0000","last_active":"2024-09-18T01:28:47.550650+0000","last_peered":"2024-09-18T01:28:47.550650+0000","last_clean":"2024-09-18T01:28:47.550650+0000","last_became_active":"2024-09-18T01:25:14.707514+0000","last_became_peered":"2024-09-18T01:25:14.707514+0000","last_unstale":"2024-09-18T01:28:47.550650+0000","last_undegraded":"2024-09-18T01:28:47.550650+0000","last_fullsized":"2024-09-18T01:28:47.550650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:47.550559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:47.550559+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.550559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:14:27.993350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.275086+0000","last_change":"2024-09-18T01:25:16.706301+0000","last_active":"2024-09-18T01:28:17.275086+0000","last_peered":"2024-09-18T01:28:17.275086+0000","last_clean":"2024-09-18T01:28:17.275086+0000","last_became_active":"2024-09-18T01:25:16.705938+0000","last_became_peered":"2024-09-18T01:25:16.705938+0000","last_unstale":"2024-09-18T01:28:17.275086+0000","last_undegraded":"2024-09-18T01:28:17.275086+0000","last_fullsized":"2024-09-18T01:28:17.275086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.222832+0000","last_change":"2024-09-18T01:28:49.222874+0000","last_active":"2024-09-18T01:28:49.222832+0000","last_peered":"2024-09-18T01:28:49.222832+0000","last_clean":"2024-09-18T01:28:49.222832+0000","last_became_active":"2024-09-18T01:25:08.687135+0000","last_became_peered":"2024-09-18T01:25:08.687135+0000","last_unstale":"2024-09-18T01:28:49.222832+0000","last_undegraded":"2024-09-18T01:28:49.222832+0000","last_fullsized":"2024-09-18T01:28:49.222832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:49.222741+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:49.222741+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.222741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:14.553771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:22.797633+0000","last_change":"2024-09-18T01:25:06.681219+0000","last_active":"2024-09-18T01:27:22.797633+0000","last_peered":"2024-09-18T01:27:22.797633+0000","last_clean":"2024-09-18T01:27:22.797633+0000","last_became_active":"2024-09-18T01:25:06.680774+0000","last_became_peered":"2024-09-18T01:25:06.680774+0000","last_unstale":"2024-09-18T01:27:22.797633+0000","last_undegraded":"2024-09-18T01:27:22.797633+0000","last_fullsized":"2024-09-18T01:27:22.797633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.752242+0000","last_change":"2024-09-18T01:28:48.752267+0000","last_active":"2024-09-18T01:28:48.752242+0000","last_peered":"2024-09-18T01:28:48.752242+0000","last_clean":"2024-09-18T01:28:48.752242+0000","last_became_active":"2024-09-18T01:25:10.674983+0000","last_became_peered":"2024-09-18T01:25:10.674983+0000","last_unstale":"2024-09-18T01:28:48.752242+0000","last_undegraded":"2024-09-18T01:28:48.752242+0000","last_fullsized":"2024-09-18T01:28:48.752242+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:48.752118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:48.752118+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.752118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:42:22.390584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'46","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.373357+0000","last_change":"2024-09-18T01:28:33.373391+0000","last_active":"2024-09-18T01:28:33.373357+0000","last_peered":"2024-09-18T01:28:33.373357+0000","last_clean":"2024-09-18T01:28:33.373357+0000","last_became_active":"2024-09-18T01:25:12.683339+0000","last_became_peered":"2024-09-18T01:25:12.683339+0000","last_unstale":"2024-09-18T01:28:33.373357+0000","last_undegraded":"2024-09-18T01:28:33.373357+0000","last_fullsized":"2024-09-18T01:28:33.373357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:33.373272+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:33.373272+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.373272+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:10:34.585302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.045271+0000","last_change":"2024-09-18T01:28:59.045296+0000","last_active":"2024-09-18T01:28:59.045271+0000","last_peered":"2024-09-18T01:28:59.045271+0000","last_clean":"2024-09-18T01:28:59.045271+0000","last_became_active":"2024-09-18T01:25:14.707116+0000","last_became_peered":"2024-09-18T01:25:14.707116+0000","last_unstale":"2024-09-18T01:28:59.045271+0000","last_undegraded":"2024-09-18T01:28:59.045271+0000","last_fullsized":"2024-09-18T01:28:59.045271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:59.045185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:59.045185+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.045185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:59:27.668851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.234156+0000","last_change":"2024-09-18T01:25:16.708368+0000","last_active":"2024-09-18T01:28:17.234156+0000","last_peered":"2024-09-18T01:28:17.234156+0000","last_clean":"2024-09-18T01:28:17.234156+0000","last_became_active":"2024-09-18T01:25:16.708095+0000","last_became_peered":"2024-09-18T01:25:16.708095+0000","last_unstale":"2024-09-18T01:28:17.234156+0000","last_undegraded":"2024-09-18T01:28:17.234156+0000","last_fullsized":"2024-09-18T01:28:17.234156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.038065+0000","last_change":"2024-09-18T01:28:42.038123+0000","last_active":"2024-09-18T01:28:42.038065+0000","last_peered":"2024-09-18T01:28:42.038065+0000","last_clean":"2024-09-18T01:28:42.038065+0000","last_became_active":"2024-09-18T01:25:08.688251+0000","last_became_peered":"2024-09-18T01:25:08.688251+0000","last_unstale":"2024-09-18T01:28:42.038065+0000","last_undegraded":"2024-09-18T01:28:42.038065+0000","last_fullsized":"2024-09-18T01:28:42.038065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:42.037965+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:42.037965+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.037965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:21:09.764214+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.854553+0000","last_change":"2024-09-18T01:25:06.684669+0000","last_active":"2024-09-18T01:28:23.854553+0000","last_peered":"2024-09-18T01:28:23.854553+0000","last_clean":"2024-09-18T01:28:23.854553+0000","last_became_active":"2024-09-18T01:25:06.683437+0000","last_became_peered":"2024-09-18T01:25:06.683437+0000","last_unstale":"2024-09-18T01:28:23.854553+0000","last_undegraded":"2024-09-18T01:28:23.854553+0000","last_fullsized":"2024-09-18T01:28:23.854553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.594007+0000","last_change":"2024-09-18T01:28:44.594031+0000","last_active":"2024-09-18T01:28:44.594007+0000","last_peered":"2024-09-18T01:28:44.594007+0000","last_clean":"2024-09-18T01:28:44.594007+0000","last_became_active":"2024-09-18T01:25:10.679740+0000","last_became_peered":"2024-09-18T01:25:10.679740+0000","last_unstale":"2024-09-18T01:28:44.594007+0000","last_undegraded":"2024-09-18T01:28:44.594007+0000","last_fullsized":"2024-09-18T01:28:44.594007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:44.593908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:44.593908+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.593908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:48.222246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'45","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.694703+0000","last_change":"2024-09-18T01:28:40.694748+0000","last_active":"2024-09-18T01:28:40.694703+0000","last_peered":"2024-09-18T01:28:40.694703+0000","last_clean":"2024-09-18T01:28:40.694703+0000","last_became_active":"2024-09-18T01:25:12.686455+0000","last_became_peered":"2024-09-18T01:25:12.686455+0000","last_unstale":"2024-09-18T01:28:40.694703+0000","last_undegraded":"2024-09-18T01:28:40.694703+0000","last_fullsized":"2024-09-18T01:28:40.694703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-18T01:28:40.694620+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-18T01:28:40.694620+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.694620+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:30.077444+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":415,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.649222+0000","last_change":"2024-09-18T01:28:30.649256+0000","last_active":"2024-09-18T01:28:30.649222+0000","last_peered":"2024-09-18T01:28:30.649222+0000","last_clean":"2024-09-18T01:28:30.649222+0000","last_became_active":"2024-09-18T01:25:14.703877+0000","last_became_peered":"2024-09-18T01:25:14.703877+0000","last_unstale":"2024-09-18T01:28:30.649222+0000","last_undegraded":"2024-09-18T01:28:30.649222+0000","last_fullsized":"2024-09-18T01:28:30.649222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:30.649113+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:30.649113+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.649113+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:03.499336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'12","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.235860+0000","last_change":"2024-09-18T01:25:16.714095+0000","last_active":"2024-09-18T01:28:17.235860+0000","last_peered":"2024-09-18T01:28:17.235860+0000","last_clean":"2024-09-18T01:28:17.235860+0000","last_became_active":"2024-09-18T01:25:16.713677+0000","last_became_peered":"2024-09-18T01:25:16.713677+0000","last_unstale":"2024-09-18T01:28:17.235860+0000","last_undegraded":"2024-09-18T01:28:17.235860+0000","last_fullsized":"2024-09-18T01:28:17.235860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.862565+0000","last_change":"2024-09-18T01:28:57.862588+0000","last_active":"2024-09-18T01:28:57.862565+0000","last_peered":"2024-09-18T01:28:57.862565+0000","last_clean":"2024-09-18T01:28:57.862565+0000","last_became_active":"2024-09-18T01:25:08.673276+0000","last_became_peered":"2024-09-18T01:25:08.673276+0000","last_unstale":"2024-09-18T01:28:57.862565+0000","last_undegraded":"2024-09-18T01:28:57.862565+0000","last_fullsized":"2024-09-18T01:28:57.862565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:57.862460+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:57.862460+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.862460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:25:54.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797377+0000","last_change":"2024-09-18T01:25:06.683319+0000","last_active":"2024-09-18T01:27:19.797377+0000","last_peered":"2024-09-18T01:27:19.797377+0000","last_clean":"2024-09-18T01:27:19.797377+0000","last_became_active":"2024-09-18T01:25:06.682841+0000","last_became_peered":"2024-09-18T01:25:06.682841+0000","last_unstale":"2024-09-18T01:27:19.797377+0000","last_undegraded":"2024-09-18T01:27:19.797377+0000","last_fullsized":"2024-09-18T01:27:19.797377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":428,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.267239+0000","last_change":"2024-09-18T01:28:40.267271+0000","last_active":"2024-09-18T01:28:40.267239+0000","last_peered":"2024-09-18T01:28:40.267239+0000","last_clean":"2024-09-18T01:28:40.267239+0000","last_became_active":"2024-09-18T01:25:10.679483+0000","last_became_peered":"2024-09-18T01:25:10.679483+0000","last_unstale":"2024-09-18T01:28:40.267239+0000","last_undegraded":"2024-09-18T01:28:40.267239+0000","last_fullsized":"2024-09-18T01:28:40.267239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-18T01:28:40.267152+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-18T01:28:40.267152+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.267152+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:35.825702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.098067+0000","last_change":"2024-09-18T01:28:53.098116+0000","last_active":"2024-09-18T01:28:53.098067+0000","last_peered":"2024-09-18T01:28:53.098067+0000","last_clean":"2024-09-18T01:28:53.098067+0000","last_became_active":"2024-09-18T01:25:12.696726+0000","last_became_peered":"2024-09-18T01:25:12.696726+0000","last_unstale":"2024-09-18T01:28:53.098067+0000","last_undegraded":"2024-09-18T01:28:53.098067+0000","last_fullsized":"2024-09-18T01:28:53.098067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-18T01:28:53.097976+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-18T01:28:53.097976+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.097976+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:31:13.343479+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":522,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.350851+0000","last_change":"2024-09-18T01:28:35.350881+0000","last_active":"2024-09-18T01:28:35.350851+0000","last_peered":"2024-09-18T01:28:35.350851+0000","last_clean":"2024-09-18T01:28:35.350851+0000","last_became_active":"2024-09-18T01:25:14.702900+0000","last_became_peered":"2024-09-18T01:25:14.702900+0000","last_unstale":"2024-09-18T01:28:35.350851+0000","last_undegraded":"2024-09-18T01:28:35.350851+0000","last_fullsized":"2024-09-18T01:28:35.350851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:35.350746+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:35.350746+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.350746+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:24.733569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.703207+0000","last_change":"2024-09-18T01:28:41.703271+0000","last_active":"2024-09-18T01:28:41.703207+0000","last_peered":"2024-09-18T01:28:41.703207+0000","last_clean":"2024-09-18T01:28:41.703207+0000","last_became_active":"2024-09-18T01:25:16.712084+0000","last_became_peered":"2024-09-18T01:25:16.712084+0000","last_unstale":"2024-09-18T01:28:41.703207+0000","last_undegraded":"2024-09-18T01:28:41.703207+0000","last_fullsized":"2024-09-18T01:28:41.703207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:41.703089+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:41.703089+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.703089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:26:56.294603+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'8","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.243527+0000","last_change":"2024-09-18T01:28:52.243573+0000","last_active":"2024-09-18T01:28:52.243527+0000","last_peered":"2024-09-18T01:28:52.243527+0000","last_clean":"2024-09-18T01:28:52.243527+0000","last_became_active":"2024-09-18T01:25:08.686802+0000","last_became_peered":"2024-09-18T01:25:08.686802+0000","last_unstale":"2024-09-18T01:28:52.243527+0000","last_undegraded":"2024-09-18T01:28:52.243527+0000","last_fullsized":"2024-09-18T01:28:52.243527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:52.243420+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:52.243420+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.243420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:29.295501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.082427+0000","last_change":"2024-09-18T01:25:06.695782+0000","last_active":"2024-09-18T01:28:17.082427+0000","last_peered":"2024-09-18T01:28:17.082427+0000","last_clean":"2024-09-18T01:28:17.082427+0000","last_became_active":"2024-09-18T01:25:06.691644+0000","last_became_peered":"2024-09-18T01:25:06.691644+0000","last_unstale":"2024-09-18T01:28:17.082427+0000","last_undegraded":"2024-09-18T01:28:17.082427+0000","last_fullsized":"2024-09-18T01:28:17.082427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.109354+0000","last_change":"2024-09-18T01:28:32.109380+0000","last_active":"2024-09-18T01:28:32.109354+0000","last_peered":"2024-09-18T01:28:32.109354+0000","last_clean":"2024-09-18T01:28:32.109354+0000","last_became_active":"2024-09-18T01:25:10.682075+0000","last_became_peered":"2024-09-18T01:25:10.682075+0000","last_unstale":"2024-09-18T01:28:32.109354+0000","last_undegraded":"2024-09-18T01:28:32.109354+0000","last_fullsized":"2024-09-18T01:28:32.109354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:32.109232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:32.109232+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.109232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:37.084368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'49","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.423913+0000","last_change":"2024-09-18T01:28:32.423980+0000","last_active":"2024-09-18T01:28:32.423913+0000","last_peered":"2024-09-18T01:28:32.423913+0000","last_clean":"2024-09-18T01:28:32.423913+0000","last_became_active":"2024-09-18T01:25:12.686460+0000","last_became_peered":"2024-09-18T01:25:12.686460+0000","last_unstale":"2024-09-18T01:28:32.423913+0000","last_undegraded":"2024-09-18T01:28:32.423913+0000","last_fullsized":"2024-09-18T01:28:32.423913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-09-18T01:28:32.423801+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-09-18T01:28:32.423801+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.423801+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:00:55.455121+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.575274+0000","last_change":"2024-09-18T01:28:27.575318+0000","last_active":"2024-09-18T01:28:27.575274+0000","last_peered":"2024-09-18T01:28:27.575274+0000","last_clean":"2024-09-18T01:28:27.575274+0000","last_became_active":"2024-09-18T01:25:14.706506+0000","last_became_peered":"2024-09-18T01:25:14.706506+0000","last_unstale":"2024-09-18T01:28:27.575274+0000","last_undegraded":"2024-09-18T01:28:27.575274+0000","last_fullsized":"2024-09-18T01:28:27.575274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:27.575151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:27.575151+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.575151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:28.541634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'7","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.228066+0000","last_change":"2024-09-18T01:28:55.228116+0000","last_active":"2024-09-18T01:28:55.228066+0000","last_peered":"2024-09-18T01:28:55.228066+0000","last_clean":"2024-09-18T01:28:55.228066+0000","last_became_active":"2024-09-18T01:25:16.709084+0000","last_became_peered":"2024-09-18T01:25:16.709084+0000","last_unstale":"2024-09-18T01:28:55.228066+0000","last_undegraded":"2024-09-18T01:28:55.228066+0000","last_fullsized":"2024-09-18T01:28:55.228066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:28:55.227978+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:28:55.227978+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.227978+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:40.596230+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'7","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.022778+0000","last_change":"2024-09-18T01:28:44.022803+0000","last_active":"2024-09-18T01:28:44.022778+0000","last_peered":"2024-09-18T01:28:44.022778+0000","last_clean":"2024-09-18T01:28:44.022778+0000","last_became_active":"2024-09-18T01:25:08.687896+0000","last_became_peered":"2024-09-18T01:25:08.687896+0000","last_unstale":"2024-09-18T01:28:44.022778+0000","last_undegraded":"2024-09-18T01:28:44.022778+0000","last_fullsized":"2024-09-18T01:28:44.022778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:28:44.022693+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:28:44.022693+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.022693+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:27.889066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":206,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.087667+0000","last_change":"2024-09-18T01:24:52.297138+0000","last_active":"2024-09-18T01:28:27.087667+0000","last_peered":"2024-09-18T01:28:27.087667+0000","last_clean":"2024-09-18T01:28:27.087667+0000","last_became_active":"2024-09-18T01:24:52.296214+0000","last_became_peered":"2024-09-18T01:24:52.296214+0000","last_unstale":"2024-09-18T01:28:27.087667+0000","last_undegraded":"2024-09-18T01:28:27.087667+0000","last_fullsized":"2024-09-18T01:28:27.087667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:51.161687+0000","last_clean_scrub_stamp":"2024-09-18T01:24:51.161687+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:04.795123+0000","last_change":"2024-09-18T01:24:58.197569+0000","last_active":"2024-09-18T01:27:04.795123+0000","last_peered":"2024-09-18T01:27:04.795123+0000","last_clean":"2024-09-18T01:27:04.795123+0000","last_became_active":"2024-09-18T01:24:56.194443+0000","last_became_peered":"2024-09-18T01:24:56.194443+0000","last_unstale":"2024-09-18T01:27:04.795123+0000","last_undegraded":"2024-09-18T01:27:04.795123+0000","last_fullsized":"2024-09-18T01:27:04.795123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033763700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.853099+0000","last_change":"2024-09-18T01:25:06.684714+0000","last_active":"2024-09-18T01:28:16.853099+0000","last_peered":"2024-09-18T01:28:16.853099+0000","last_clean":"2024-09-18T01:28:16.853099+0000","last_became_active":"2024-09-18T01:25:06.683975+0000","last_became_peered":"2024-09-18T01:25:06.683975+0000","last_unstale":"2024-09-18T01:28:16.853099+0000","last_undegraded":"2024-09-18T01:28:16.853099+0000","last_fullsized":"2024-09-18T01:28:16.853099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.273056+0000","last_change":"2024-09-18T01:28:41.273084+0000","last_active":"2024-09-18T01:28:41.273056+0000","last_peered":"2024-09-18T01:28:41.273056+0000","last_clean":"2024-09-18T01:28:41.273056+0000","last_became_active":"2024-09-18T01:25:10.679572+0000","last_became_peered":"2024-09-18T01:25:10.679572+0000","last_unstale":"2024-09-18T01:28:41.273056+0000","last_undegraded":"2024-09-18T01:28:41.273056+0000","last_fullsized":"2024-09-18T01:28:41.273056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:41.272968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:41.272968+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.272968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:18:48.599189+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'94","reported_seq":190,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.133511+0000","last_change":"2024-09-18T01:28:39.133548+0000","last_active":"2024-09-18T01:28:39.133511+0000","last_peered":"2024-09-18T01:28:39.133511+0000","last_clean":"2024-09-18T01:28:39.133511+0000","last_became_active":"2024-09-18T01:25:12.691952+0000","last_became_peered":"2024-09-18T01:25:12.691952+0000","last_unstale":"2024-09-18T01:28:39.133511+0000","last_undegraded":"2024-09-18T01:28:39.133511+0000","last_fullsized":"2024-09-18T01:28:39.133511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'94","last_scrub_stamp":"2024-09-18T01:28:39.133419+0000","last_deep_scrub":"35'94","last_deep_scrub_stamp":"2024-09-18T01:28:39.133419+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.133419+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:11:05.713633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.670335+0000","last_change":"2024-09-18T01:28:31.670355+0000","last_active":"2024-09-18T01:28:31.670335+0000","last_peered":"2024-09-18T01:28:31.670335+0000","last_clean":"2024-09-18T01:28:31.670335+0000","last_became_active":"2024-09-18T01:25:14.706519+0000","last_became_peered":"2024-09-18T01:25:14.706519+0000","last_unstale":"2024-09-18T01:28:31.670335+0000","last_undegraded":"2024-09-18T01:28:31.670335+0000","last_fullsized":"2024-09-18T01:28:31.670335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.670230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.670230+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.670230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:37.902202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'85","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:45.758581+0000","last_change":"2024-09-18T01:28:45.758628+0000","last_active":"2024-09-18T01:28:45.758581+0000","last_peered":"2024-09-18T01:28:45.758581+0000","last_clean":"2024-09-18T01:28:45.758581+0000","last_became_active":"2024-09-18T01:25:16.712102+0000","last_became_peered":"2024-09-18T01:25:16.712102+0000","last_unstale":"2024-09-18T01:28:45.758581+0000","last_undegraded":"2024-09-18T01:28:45.758581+0000","last_fullsized":"2024-09-18T01:28:45.758581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'85","last_scrub_stamp":"2024-09-18T01:28:45.758460+0000","last_deep_scrub":"35'85","last_deep_scrub_stamp":"2024-09-18T01:28:45.758460+0000","last_clean_scrub_stamp":"2024-09-18T01:28:45.758460+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:39.752325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":221,"num_write":168,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'7","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.228113+0000","last_change":"2024-09-18T01:25:08.672900+0000","last_active":"2024-09-18T01:28:17.228113+0000","last_peered":"2024-09-18T01:28:17.228113+0000","last_clean":"2024-09-18T01:28:17.228113+0000","last_became_active":"2024-09-18T01:25:08.671578+0000","last_became_peered":"2024-09-18T01:25:08.671578+0000","last_unstale":"2024-09-18T01:28:17.228113+0000","last_undegraded":"2024-09-18T01:28:17.228113+0000","last_fullsized":"2024-09-18T01:28:17.228113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.925412+0000","last_change":"2024-09-18T01:24:58.197615+0000","last_active":"2024-09-18T01:28:27.925412+0000","last_peered":"2024-09-18T01:28:27.925412+0000","last_clean":"2024-09-18T01:28:27.925412+0000","last_became_active":"2024-09-18T01:24:56.191554+0000","last_became_peered":"2024-09-18T01:24:56.191554+0000","last_unstale":"2024-09-18T01:28:27.925412+0000","last_undegraded":"2024-09-18T01:28:27.925412+0000","last_fullsized":"2024-09-18T01:28:27.925412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041584599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.795950+0000","last_change":"2024-09-18T01:25:06.681216+0000","last_active":"2024-09-18T01:27:12.795950+0000","last_peered":"2024-09-18T01:27:12.795950+0000","last_clean":"2024-09-18T01:27:12.795950+0000","last_became_active":"2024-09-18T01:25:06.680635+0000","last_became_peered":"2024-09-18T01:25:06.680635+0000","last_unstale":"2024-09-18T01:27:12.795950+0000","last_undegraded":"2024-09-18T01:27:12.795950+0000","last_fullsized":"2024-09-18T01:27:12.795950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.041908+0000","last_change":"2024-09-18T01:28:34.041935+0000","last_active":"2024-09-18T01:28:34.041908+0000","last_peered":"2024-09-18T01:28:34.041908+0000","last_clean":"2024-09-18T01:28:34.041908+0000","last_became_active":"2024-09-18T01:25:10.681988+0000","last_became_peered":"2024-09-18T01:25:10.681988+0000","last_unstale":"2024-09-18T01:28:34.041908+0000","last_undegraded":"2024-09-18T01:28:34.041908+0000","last_fullsized":"2024-09-18T01:28:34.041908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:34.041811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:34.041811+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.041811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:05:37.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'297","reported_seq":528,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.359366+0000","last_change":"2024-09-18T01:28:27.359441+0000","last_active":"2024-09-18T01:28:27.359366+0000","last_peered":"2024-09-18T01:28:27.359366+0000","last_clean":"2024-09-18T01:28:27.359366+0000","last_became_active":"2024-09-18T01:25:12.693664+0000","last_became_peered":"2024-09-18T01:25:12.693664+0000","last_unstale":"2024-09-18T01:28:27.359366+0000","last_undegraded":"2024-09-18T01:28:27.359366+0000","last_fullsized":"2024-09-18T01:28:27.359366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'297","last_scrub_stamp":"2024-09-18T01:28:27.359261+0000","last_deep_scrub":"35'297","last_deep_scrub_stamp":"2024-09-18T01:28:27.359261+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.359261+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:28:05.502483+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.086167+0000","last_change":"2024-09-18T01:28:51.086190+0000","last_active":"2024-09-18T01:28:51.086167+0000","last_peered":"2024-09-18T01:28:51.086167+0000","last_clean":"2024-09-18T01:28:51.086167+0000","last_became_active":"2024-09-18T01:25:14.707143+0000","last_became_peered":"2024-09-18T01:25:14.707143+0000","last_unstale":"2024-09-18T01:28:51.086167+0000","last_undegraded":"2024-09-18T01:28:51.086167+0000","last_fullsized":"2024-09-18T01:28:51.086167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:51.086082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:51.086082+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.086082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:29:21.095319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.101097+0000","last_change":"2024-09-18T01:25:16.714554+0000","last_active":"2024-09-18T01:28:17.101097+0000","last_peered":"2024-09-18T01:28:17.101097+0000","last_clean":"2024-09-18T01:28:17.101097+0000","last_became_active":"2024-09-18T01:25:16.712931+0000","last_became_peered":"2024-09-18T01:25:16.712931+0000","last_unstale":"2024-09-18T01:28:17.101097+0000","last_undegraded":"2024-09-18T01:28:17.101097+0000","last_fullsized":"2024-09-18T01:28:17.101097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:16.962705+0000","last_change":"2024-09-18T01:25:08.681154+0000","last_active":"2024-09-18T01:28:16.962705+0000","last_peered":"2024-09-18T01:28:16.962705+0000","last_clean":"2024-09-18T01:28:16.962705+0000","last_became_active":"2024-09-18T01:25:08.680541+0000","last_became_peered":"2024-09-18T01:25:08.680541+0000","last_unstale":"2024-09-18T01:28:16.962705+0000","last_undegraded":"2024-09-18T01:28:16.962705+0000","last_fullsized":"2024-09-18T01:28:16.962705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:04.794550+0000","last_change":"2024-09-18T01:24:58.350485+0000","last_active":"2024-09-18T01:27:04.794550+0000","last_peered":"2024-09-18T01:27:04.794550+0000","last_clean":"2024-09-18T01:27:04.794550+0000","last_became_active":"2024-09-18T01:24:56.191162+0000","last_became_peered":"2024-09-18T01:24:56.191162+0000","last_unstale":"2024-09-18T01:27:04.794550+0000","last_undegraded":"2024-09-18T01:27:04.794550+0000","last_fullsized":"2024-09-18T01:27:04.794550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040921399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:26.669300+0000","last_change":"2024-09-18T01:25:06.686498+0000","last_active":"2024-09-18T01:28:26.669300+0000","last_peered":"2024-09-18T01:28:26.669300+0000","last_clean":"2024-09-18T01:28:26.669300+0000","last_became_active":"2024-09-18T01:25:06.686053+0000","last_became_peered":"2024-09-18T01:25:06.686053+0000","last_unstale":"2024-09-18T01:28:26.669300+0000","last_undegraded":"2024-09-18T01:28:26.669300+0000","last_fullsized":"2024-09-18T01:28:26.669300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.729103+0000","last_change":"2024-09-18T01:28:47.729134+0000","last_active":"2024-09-18T01:28:47.729103+0000","last_peered":"2024-09-18T01:28:47.729103+0000","last_clean":"2024-09-18T01:28:47.729103+0000","last_became_active":"2024-09-18T01:25:10.677597+0000","last_became_peered":"2024-09-18T01:25:10.677597+0000","last_unstale":"2024-09-18T01:28:47.729103+0000","last_undegraded":"2024-09-18T01:28:47.729103+0000","last_fullsized":"2024-09-18T01:28:47.729103+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:47.729010+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:47.729010+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.729010+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:44:00.635385+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'23","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.678836+0000","last_change":"2024-09-18T01:28:39.678878+0000","last_active":"2024-09-18T01:28:39.678836+0000","last_peered":"2024-09-18T01:28:39.678836+0000","last_clean":"2024-09-18T01:28:39.678836+0000","last_became_active":"2024-09-18T01:25:12.687799+0000","last_became_peered":"2024-09-18T01:25:12.687799+0000","last_unstale":"2024-09-18T01:28:39.678836+0000","last_undegraded":"2024-09-18T01:28:39.678836+0000","last_fullsized":"2024-09-18T01:28:39.678836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-09-18T01:28:39.678752+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-09-18T01:28:39.678752+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.678752+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:45.910724+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.698381+0000","last_change":"2024-09-18T01:28:27.698401+0000","last_active":"2024-09-18T01:28:27.698381+0000","last_peered":"2024-09-18T01:28:27.698381+0000","last_clean":"2024-09-18T01:28:27.698381+0000","last_became_active":"2024-09-18T01:25:14.706611+0000","last_became_peered":"2024-09-18T01:25:14.706611+0000","last_unstale":"2024-09-18T01:28:27.698381+0000","last_undegraded":"2024-09-18T01:28:27.698381+0000","last_fullsized":"2024-09-18T01:28:27.698381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:27.698307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:27.698307+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.698307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:17.902689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799910+0000","last_change":"2024-09-18T01:25:16.711670+0000","last_active":"2024-09-18T01:27:34.799910+0000","last_peered":"2024-09-18T01:27:34.799910+0000","last_clean":"2024-09-18T01:27:34.799910+0000","last_became_active":"2024-09-18T01:25:16.711404+0000","last_became_peered":"2024-09-18T01:25:16.711404+0000","last_unstale":"2024-09-18T01:27:34.799910+0000","last_undegraded":"2024-09-18T01:27:34.799910+0000","last_fullsized":"2024-09-18T01:27:34.799910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.103574+0000","last_change":"2024-09-18T01:25:08.673345+0000","last_active":"2024-09-18T01:28:17.103574+0000","last_peered":"2024-09-18T01:28:17.103574+0000","last_clean":"2024-09-18T01:28:17.103574+0000","last_became_active":"2024-09-18T01:25:08.672969+0000","last_became_peered":"2024-09-18T01:25:08.672969+0000","last_unstale":"2024-09-18T01:28:17.103574+0000","last_undegraded":"2024-09-18T01:28:17.103574+0000","last_fullsized":"2024-09-18T01:28:17.103574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:04.795077+0000","last_change":"2024-09-18T01:24:58.198236+0000","last_active":"2024-09-18T01:27:04.795077+0000","last_peered":"2024-09-18T01:27:04.795077+0000","last_clean":"2024-09-18T01:27:04.795077+0000","last_became_active":"2024-09-18T01:24:56.191713+0000","last_became_peered":"2024-09-18T01:24:56.191713+0000","last_unstale":"2024-09-18T01:27:04.795077+0000","last_undegraded":"2024-09-18T01:27:04.795077+0000","last_fullsized":"2024-09-18T01:27:04.795077+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010043490000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.795992+0000","last_change":"2024-09-18T01:25:06.700684+0000","last_active":"2024-09-18T01:27:14.795992+0000","last_peered":"2024-09-18T01:27:14.795992+0000","last_clean":"2024-09-18T01:27:14.795992+0000","last_became_active":"2024-09-18T01:25:06.700397+0000","last_became_peered":"2024-09-18T01:25:06.700397+0000","last_unstale":"2024-09-18T01:27:14.795992+0000","last_undegraded":"2024-09-18T01:27:14.795992+0000","last_fullsized":"2024-09-18T01:27:14.795992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.497443+0000","last_change":"2024-09-18T01:28:52.497466+0000","last_active":"2024-09-18T01:28:52.497443+0000","last_peered":"2024-09-18T01:28:52.497443+0000","last_clean":"2024-09-18T01:28:52.497443+0000","last_became_active":"2024-09-18T01:25:10.676320+0000","last_became_peered":"2024-09-18T01:25:10.676320+0000","last_unstale":"2024-09-18T01:28:52.497443+0000","last_undegraded":"2024-09-18T01:28:52.497443+0000","last_fullsized":"2024-09-18T01:28:52.497443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:52.497353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:52.497353+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.497353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:53:33.827801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'20","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.994925+0000","last_change":"2024-09-18T01:28:42.995001+0000","last_active":"2024-09-18T01:28:42.994925+0000","last_peered":"2024-09-18T01:28:42.994925+0000","last_clean":"2024-09-18T01:28:42.994925+0000","last_became_active":"2024-09-18T01:25:12.692373+0000","last_became_peered":"2024-09-18T01:25:12.692373+0000","last_unstale":"2024-09-18T01:28:42.994925+0000","last_undegraded":"2024-09-18T01:28:42.994925+0000","last_fullsized":"2024-09-18T01:28:42.994925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:28:42.994815+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:28:42.994815+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.994815+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:43.271590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.107009+0000","last_change":"2024-09-18T01:29:03.107033+0000","last_active":"2024-09-18T01:29:03.107009+0000","last_peered":"2024-09-18T01:29:03.107009+0000","last_clean":"2024-09-18T01:29:03.107009+0000","last_became_active":"2024-09-18T01:25:14.707409+0000","last_became_peered":"2024-09-18T01:25:14.707409+0000","last_unstale":"2024-09-18T01:29:03.107009+0000","last_undegraded":"2024-09-18T01:29:03.107009+0000","last_fullsized":"2024-09-18T01:29:03.107009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:03.106906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:03.106906+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.106906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:24.958182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'6","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799160+0000","last_change":"2024-09-18T01:25:16.711391+0000","last_active":"2024-09-18T01:27:29.799160+0000","last_peered":"2024-09-18T01:27:29.799160+0000","last_clean":"2024-09-18T01:27:29.799160+0000","last_became_active":"2024-09-18T01:25:16.711104+0000","last_became_peered":"2024-09-18T01:25:16.711104+0000","last_unstale":"2024-09-18T01:27:29.799160+0000","last_undegraded":"2024-09-18T01:27:29.799160+0000","last_fullsized":"2024-09-18T01:27:29.799160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'6","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.183700+0000","last_change":"2024-09-18T01:28:50.183724+0000","last_active":"2024-09-18T01:28:50.183700+0000","last_peered":"2024-09-18T01:28:50.183700+0000","last_clean":"2024-09-18T01:28:50.183700+0000","last_became_active":"2024-09-18T01:25:08.687139+0000","last_became_peered":"2024-09-18T01:25:08.687139+0000","last_unstale":"2024-09-18T01:28:50.183700+0000","last_undegraded":"2024-09-18T01:28:50.183700+0000","last_fullsized":"2024-09-18T01:28:50.183700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:50.183577+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:50.183577+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.183577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:25.770565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.796027+0000","last_change":"2024-09-18T01:25:06.692246+0000","last_active":"2024-09-18T01:27:14.796027+0000","last_peered":"2024-09-18T01:27:14.796027+0000","last_clean":"2024-09-18T01:27:14.796027+0000","last_became_active":"2024-09-18T01:25:06.691871+0000","last_became_peered":"2024-09-18T01:25:06.691871+0000","last_unstale":"2024-09-18T01:27:14.796027+0000","last_undegraded":"2024-09-18T01:27:14.796027+0000","last_fullsized":"2024-09-18T01:27:14.796027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:26.669297+0000","last_change":"2024-09-18T01:24:58.199959+0000","last_active":"2024-09-18T01:28:26.669297+0000","last_peered":"2024-09-18T01:28:26.669297+0000","last_clean":"2024-09-18T01:28:26.669297+0000","last_became_active":"2024-09-18T01:24:56.191033+0000","last_became_peered":"2024-09-18T01:24:56.191033+0000","last_unstale":"2024-09-18T01:28:26.669297+0000","last_undegraded":"2024-09-18T01:28:26.669297+0000","last_fullsized":"2024-09-18T01:28:26.669297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000547898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.523217+0000","last_change":"2024-09-18T01:28:50.523244+0000","last_active":"2024-09-18T01:28:50.523217+0000","last_peered":"2024-09-18T01:28:50.523217+0000","last_clean":"2024-09-18T01:28:50.523217+0000","last_became_active":"2024-09-18T01:25:10.676531+0000","last_became_peered":"2024-09-18T01:25:10.676531+0000","last_unstale":"2024-09-18T01:28:50.523217+0000","last_undegraded":"2024-09-18T01:28:50.523217+0000","last_fullsized":"2024-09-18T01:28:50.523217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:50.523096+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:50.523096+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.523096+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:41:44.218280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'90","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.549813+0000","last_change":"2024-09-18T01:28:36.549893+0000","last_active":"2024-09-18T01:28:36.549813+0000","last_peered":"2024-09-18T01:28:36.549813+0000","last_clean":"2024-09-18T01:28:36.549813+0000","last_became_active":"2024-09-18T01:25:12.693127+0000","last_became_peered":"2024-09-18T01:25:12.693127+0000","last_unstale":"2024-09-18T01:28:36.549813+0000","last_undegraded":"2024-09-18T01:28:36.549813+0000","last_fullsized":"2024-09-18T01:28:36.549813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'90","last_scrub_stamp":"2024-09-18T01:28:36.549705+0000","last_deep_scrub":"35'90","last_deep_scrub_stamp":"2024-09-18T01:28:36.549705+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.549705+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:32.108255+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.622599+0000","last_change":"2024-09-18T01:28:28.622620+0000","last_active":"2024-09-18T01:28:28.622599+0000","last_peered":"2024-09-18T01:28:28.622599+0000","last_clean":"2024-09-18T01:28:28.622599+0000","last_became_active":"2024-09-18T01:25:14.703993+0000","last_became_peered":"2024-09-18T01:25:14.703993+0000","last_unstale":"2024-09-18T01:28:28.622599+0000","last_undegraded":"2024-09-18T01:28:28.622599+0000","last_fullsized":"2024-09-18T01:28:28.622599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:28.622514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:28.622514+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.622514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:15:53.831184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.439480+0000","last_change":"2024-09-18T01:28:55.439559+0000","last_active":"2024-09-18T01:28:55.439480+0000","last_peered":"2024-09-18T01:28:55.439480+0000","last_clean":"2024-09-18T01:28:55.439480+0000","last_became_active":"2024-09-18T01:25:16.703278+0000","last_became_peered":"2024-09-18T01:25:16.703278+0000","last_unstale":"2024-09-18T01:28:55.439480+0000","last_undegraded":"2024-09-18T01:28:55.439480+0000","last_fullsized":"2024-09-18T01:28:55.439480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-18T01:28:55.439368+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-18T01:28:55.439368+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.439368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:24.662471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.209938+0000","last_change":"2024-09-18T01:28:56.209968+0000","last_active":"2024-09-18T01:28:56.209938+0000","last_peered":"2024-09-18T01:28:56.209938+0000","last_clean":"2024-09-18T01:28:56.209938+0000","last_became_active":"2024-09-18T01:25:08.686087+0000","last_became_peered":"2024-09-18T01:25:08.686087+0000","last_unstale":"2024-09-18T01:28:56.209938+0000","last_undegraded":"2024-09-18T01:28:56.209938+0000","last_fullsized":"2024-09-18T01:28:56.209938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:56.209817+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:56.209817+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.209817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:57:02.811375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.857090+0000","last_change":"2024-09-18T01:25:06.681153+0000","last_active":"2024-09-18T01:28:23.857090+0000","last_peered":"2024-09-18T01:28:23.857090+0000","last_clean":"2024-09-18T01:28:23.857090+0000","last_became_active":"2024-09-18T01:25:06.680623+0000","last_became_peered":"2024-09-18T01:25:06.680623+0000","last_unstale":"2024-09-18T01:28:23.857090+0000","last_undegraded":"2024-09-18T01:28:23.857090+0000","last_fullsized":"2024-09-18T01:28:23.857090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:04.795159+0000","last_change":"2024-09-18T01:24:58.198528+0000","last_active":"2024-09-18T01:27:04.795159+0000","last_peered":"2024-09-18T01:27:04.795159+0000","last_clean":"2024-09-18T01:27:04.795159+0000","last_became_active":"2024-09-18T01:24:56.191687+0000","last_became_peered":"2024-09-18T01:24:56.191687+0000","last_unstale":"2024-09-18T01:27:04.795159+0000","last_undegraded":"2024-09-18T01:27:04.795159+0000","last_fullsized":"2024-09-18T01:27:04.795159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012745390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.087154+0000","last_change":"2024-09-18T01:28:37.087179+0000","last_active":"2024-09-18T01:28:37.087154+0000","last_peered":"2024-09-18T01:28:37.087154+0000","last_clean":"2024-09-18T01:28:37.087154+0000","last_became_active":"2024-09-18T01:25:10.681311+0000","last_became_peered":"2024-09-18T01:25:10.681311+0000","last_unstale":"2024-09-18T01:28:37.087154+0000","last_undegraded":"2024-09-18T01:28:37.087154+0000","last_fullsized":"2024-09-18T01:28:37.087154+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:37.087060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:37.087060+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.087060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:59:56.318845+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'29","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.395365+0000","last_change":"2024-09-18T01:28:28.395402+0000","last_active":"2024-09-18T01:28:28.395365+0000","last_peered":"2024-09-18T01:28:28.395365+0000","last_clean":"2024-09-18T01:28:28.395365+0000","last_became_active":"2024-09-18T01:25:12.692357+0000","last_became_peered":"2024-09-18T01:25:12.692357+0000","last_unstale":"2024-09-18T01:28:28.395365+0000","last_undegraded":"2024-09-18T01:28:28.395365+0000","last_fullsized":"2024-09-18T01:28:28.395365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'29","last_scrub_stamp":"2024-09-18T01:28:28.395277+0000","last_deep_scrub":"35'29","last_deep_scrub_stamp":"2024-09-18T01:28:28.395277+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.395277+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:50.311253+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":398,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:43.280228+0000","last_change":"2024-09-18T01:28:43.280257+0000","last_active":"2024-09-18T01:28:43.280228+0000","last_peered":"2024-09-18T01:28:43.280228+0000","last_clean":"2024-09-18T01:28:43.280228+0000","last_became_active":"2024-09-18T01:25:14.705703+0000","last_became_peered":"2024-09-18T01:25:14.705703+0000","last_unstale":"2024-09-18T01:28:43.280228+0000","last_undegraded":"2024-09-18T01:28:43.280228+0000","last_fullsized":"2024-09-18T01:28:43.280228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:43.280138+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:43.280138+0000","last_clean_scrub_stamp":"2024-09-18T01:28:43.280138+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:32.165248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800057+0000","last_change":"2024-09-18T01:25:16.711811+0000","last_active":"2024-09-18T01:27:34.800057+0000","last_peered":"2024-09-18T01:27:34.800057+0000","last_clean":"2024-09-18T01:27:34.800057+0000","last_became_active":"2024-09-18T01:25:16.711531+0000","last_became_peered":"2024-09-18T01:25:16.711531+0000","last_unstale":"2024-09-18T01:27:34.800057+0000","last_undegraded":"2024-09-18T01:27:34.800057+0000","last_fullsized":"2024-09-18T01:27:34.800057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'20","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.122293+0000","last_change":"2024-09-18T01:29:04.122320+0000","last_active":"2024-09-18T01:29:04.122293+0000","last_peered":"2024-09-18T01:29:04.122293+0000","last_clean":"2024-09-18T01:29:04.122293+0000","last_became_active":"2024-09-18T01:25:08.681285+0000","last_became_peered":"2024-09-18T01:25:08.681285+0000","last_unstale":"2024-09-18T01:29:04.122293+0000","last_undegraded":"2024-09-18T01:29:04.122293+0000","last_fullsized":"2024-09-18T01:29:04.122293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:29:04.122206+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:29:04.122206+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.122206+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:24.652487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":56,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797594+0000","last_change":"2024-09-18T01:25:06.684116+0000","last_active":"2024-09-18T01:27:19.797594+0000","last_peered":"2024-09-18T01:27:19.797594+0000","last_clean":"2024-09-18T01:27:19.797594+0000","last_became_active":"2024-09-18T01:25:06.683740+0000","last_became_peered":"2024-09-18T01:25:06.683740+0000","last_unstale":"2024-09-18T01:27:19.797594+0000","last_undegraded":"2024-09-18T01:27:19.797594+0000","last_fullsized":"2024-09-18T01:27:19.797594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:07.795391+0000","last_change":"2024-09-18T01:24:58.199970+0000","last_active":"2024-09-18T01:27:07.795391+0000","last_peered":"2024-09-18T01:27:07.795391+0000","last_clean":"2024-09-18T01:27:07.795391+0000","last_became_active":"2024-09-18T01:24:56.192301+0000","last_became_peered":"2024-09-18T01:24:56.192301+0000","last_unstale":"2024-09-18T01:27:07.795391+0000","last_undegraded":"2024-09-18T01:27:07.795391+0000","last_fullsized":"2024-09-18T01:27:07.795391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056449699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.070036+0000","last_change":"2024-09-18T01:28:30.070061+0000","last_active":"2024-09-18T01:28:30.070036+0000","last_peered":"2024-09-18T01:28:30.070036+0000","last_clean":"2024-09-18T01:28:30.070036+0000","last_became_active":"2024-09-18T01:25:10.682111+0000","last_became_peered":"2024-09-18T01:25:10.682111+0000","last_unstale":"2024-09-18T01:28:30.070036+0000","last_undegraded":"2024-09-18T01:28:30.070036+0000","last_fullsized":"2024-09-18T01:28:30.070036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:30.069896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:30.069896+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.069896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:14.982005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'23","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.044518+0000","last_change":"2024-09-18T01:28:41.044578+0000","last_active":"2024-09-18T01:28:41.044518+0000","last_peered":"2024-09-18T01:28:41.044518+0000","last_clean":"2024-09-18T01:28:41.044518+0000","last_became_active":"2024-09-18T01:25:12.692313+0000","last_became_peered":"2024-09-18T01:25:12.692313+0000","last_unstale":"2024-09-18T01:28:41.044518+0000","last_undegraded":"2024-09-18T01:28:41.044518+0000","last_fullsized":"2024-09-18T01:28:41.044518+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-09-18T01:28:41.044429+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-09-18T01:28:41.044429+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.044429+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:56.982066+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":410,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.567197+0000","last_change":"2024-09-18T01:28:34.567260+0000","last_active":"2024-09-18T01:28:34.567197+0000","last_peered":"2024-09-18T01:28:34.567197+0000","last_clean":"2024-09-18T01:28:34.567197+0000","last_became_active":"2024-09-18T01:25:14.698755+0000","last_became_peered":"2024-09-18T01:25:14.698755+0000","last_unstale":"2024-09-18T01:28:34.567197+0000","last_undegraded":"2024-09-18T01:28:34.567197+0000","last_fullsized":"2024-09-18T01:28:34.567197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:34.567070+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:34.567070+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.567070+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:46:39.422894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800041+0000","last_change":"2024-09-18T01:25:16.712818+0000","last_active":"2024-09-18T01:27:34.800041+0000","last_peered":"2024-09-18T01:27:34.800041+0000","last_clean":"2024-09-18T01:27:34.800041+0000","last_became_active":"2024-09-18T01:25:16.712556+0000","last_became_peered":"2024-09-18T01:25:16.712556+0000","last_unstale":"2024-09-18T01:27:34.800041+0000","last_undegraded":"2024-09-18T01:27:34.800041+0000","last_fullsized":"2024-09-18T01:27:34.800041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'14","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.895806+0000","last_change":"2024-09-18T01:29:01.895871+0000","last_active":"2024-09-18T01:29:01.895806+0000","last_peered":"2024-09-18T01:29:01.895806+0000","last_clean":"2024-09-18T01:29:01.895806+0000","last_became_active":"2024-09-18T01:25:08.674560+0000","last_became_peered":"2024-09-18T01:25:08.674560+0000","last_unstale":"2024-09-18T01:29:01.895806+0000","last_undegraded":"2024-09-18T01:29:01.895806+0000","last_fullsized":"2024-09-18T01:29:01.895806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-18T01:29:01.895707+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-18T01:29:01.895707+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.895707+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:56.827853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.309038+0000","last_change":"2024-09-18T01:29:04.309098+0000","last_active":"2024-09-18T01:29:04.309038+0000","last_peered":"2024-09-18T01:29:04.309038+0000","last_clean":"2024-09-18T01:29:04.309038+0000","last_became_active":"2024-09-18T01:25:06.686277+0000","last_became_peered":"2024-09-18T01:25:06.686277+0000","last_unstale":"2024-09-18T01:29:04.309038+0000","last_undegraded":"2024-09-18T01:29:04.309038+0000","last_fullsized":"2024-09-18T01:29:04.309038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:04.308925+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:04.308925+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.308925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:20.714722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:09.795925+0000","last_change":"2024-09-18T01:24:58.198307+0000","last_active":"2024-09-18T01:27:09.795925+0000","last_peered":"2024-09-18T01:27:09.795925+0000","last_clean":"2024-09-18T01:27:09.795925+0000","last_became_active":"2024-09-18T01:24:56.602991+0000","last_became_peered":"2024-09-18T01:24:56.602991+0000","last_unstale":"2024-09-18T01:27:09.795925+0000","last_undegraded":"2024-09-18T01:27:09.795925+0000","last_fullsized":"2024-09-18T01:27:09.795925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077351,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.105445+0000","last_change":"2024-09-18T01:28:28.105468+0000","last_active":"2024-09-18T01:28:28.105445+0000","last_peered":"2024-09-18T01:28:28.105445+0000","last_clean":"2024-09-18T01:28:28.105445+0000","last_became_active":"2024-09-18T01:25:10.682057+0000","last_became_peered":"2024-09-18T01:25:10.682057+0000","last_unstale":"2024-09-18T01:28:28.105445+0000","last_undegraded":"2024-09-18T01:28:28.105445+0000","last_fullsized":"2024-09-18T01:28:28.105445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:28.105351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:28.105351+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.105351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:52:34.334975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'104","reported_seq":203,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.726830+0000","last_change":"2024-09-18T01:28:35.726873+0000","last_active":"2024-09-18T01:28:35.726830+0000","last_peered":"2024-09-18T01:28:35.726830+0000","last_clean":"2024-09-18T01:28:35.726830+0000","last_became_active":"2024-09-18T01:25:12.694361+0000","last_became_peered":"2024-09-18T01:25:12.694361+0000","last_unstale":"2024-09-18T01:28:35.726830+0000","last_undegraded":"2024-09-18T01:28:35.726830+0000","last_fullsized":"2024-09-18T01:28:35.726830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'104","last_scrub_stamp":"2024-09-18T01:28:35.726737+0000","last_deep_scrub":"35'104","last_deep_scrub_stamp":"2024-09-18T01:28:35.726737+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.726737+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:56.458829+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.552717+0000","last_change":"2024-09-18T01:28:39.552741+0000","last_active":"2024-09-18T01:28:39.552717+0000","last_peered":"2024-09-18T01:28:39.552717+0000","last_clean":"2024-09-18T01:28:39.552717+0000","last_became_active":"2024-09-18T01:25:14.706960+0000","last_became_peered":"2024-09-18T01:25:14.706960+0000","last_unstale":"2024-09-18T01:28:39.552717+0000","last_undegraded":"2024-09-18T01:28:39.552717+0000","last_fullsized":"2024-09-18T01:28:39.552717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:39.552625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:39.552625+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.552625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:28.437734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799216+0000","last_change":"2024-09-18T01:25:16.716922+0000","last_active":"2024-09-18T01:27:34.799216+0000","last_peered":"2024-09-18T01:27:34.799216+0000","last_clean":"2024-09-18T01:27:34.799216+0000","last_became_active":"2024-09-18T01:25:16.716607+0000","last_became_peered":"2024-09-18T01:25:16.716607+0000","last_unstale":"2024-09-18T01:27:34.799216+0000","last_undegraded":"2024-09-18T01:27:34.799216+0000","last_fullsized":"2024-09-18T01:27:34.799216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.797626+0000","last_change":"2024-09-18T01:25:16.717173+0000","last_active":"2024-09-18T01:27:24.797626+0000","last_peered":"2024-09-18T01:27:24.797626+0000","last_clean":"2024-09-18T01:27:24.797626+0000","last_became_active":"2024-09-18T01:25:16.716867+0000","last_became_peered":"2024-09-18T01:25:16.716867+0000","last_unstale":"2024-09-18T01:27:24.797626+0000","last_undegraded":"2024-09-18T01:27:24.797626+0000","last_fullsized":"2024-09-18T01:27:24.797626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.798425+0000","last_change":"2024-09-18T01:25:08.676006+0000","last_active":"2024-09-18T01:27:29.798425+0000","last_peered":"2024-09-18T01:27:29.798425+0000","last_clean":"2024-09-18T01:27:29.798425+0000","last_became_active":"2024-09-18T01:25:08.675590+0000","last_became_peered":"2024-09-18T01:25:08.675590+0000","last_unstale":"2024-09-18T01:27:29.798425+0000","last_undegraded":"2024-09-18T01:27:29.798425+0000","last_fullsized":"2024-09-18T01:27:29.798425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799147+0000","last_change":"2024-09-18T01:25:06.693775+0000","last_active":"2024-09-18T01:27:29.799147+0000","last_peered":"2024-09-18T01:27:29.799147+0000","last_clean":"2024-09-18T01:27:29.799147+0000","last_became_active":"2024-09-18T01:25:06.689996+0000","last_became_peered":"2024-09-18T01:25:06.689996+0000","last_unstale":"2024-09-18T01:27:29.799147+0000","last_undegraded":"2024-09-18T01:27:29.799147+0000","last_fullsized":"2024-09-18T01:27:29.799147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.304703+0000","last_change":"2024-09-18T01:28:38.304730+0000","last_active":"2024-09-18T01:28:38.304703+0000","last_peered":"2024-09-18T01:28:38.304703+0000","last_clean":"2024-09-18T01:28:38.304703+0000","last_became_active":"2024-09-18T01:25:10.679704+0000","last_became_peered":"2024-09-18T01:25:10.679704+0000","last_unstale":"2024-09-18T01:28:38.304703+0000","last_undegraded":"2024-09-18T01:28:38.304703+0000","last_fullsized":"2024-09-18T01:28:38.304703+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:38.304607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:38.304607+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.304607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:00.590243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'47","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.045384+0000","last_change":"2024-09-18T01:28:56.045435+0000","last_active":"2024-09-18T01:28:56.045384+0000","last_peered":"2024-09-18T01:28:56.045384+0000","last_clean":"2024-09-18T01:28:56.045384+0000","last_became_active":"2024-09-18T01:25:12.692870+0000","last_became_peered":"2024-09-18T01:25:12.692870+0000","last_unstale":"2024-09-18T01:28:56.045384+0000","last_undegraded":"2024-09-18T01:28:56.045384+0000","last_fullsized":"2024-09-18T01:28:56.045384+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-09-18T01:28:56.045290+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-09-18T01:28:56.045290+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.045290+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:42:03.283767+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.058508+0000","last_change":"2024-09-18T01:28:49.058531+0000","last_active":"2024-09-18T01:28:49.058508+0000","last_peered":"2024-09-18T01:28:49.058508+0000","last_clean":"2024-09-18T01:28:49.058508+0000","last_became_active":"2024-09-18T01:25:14.706381+0000","last_became_peered":"2024-09-18T01:25:14.706381+0000","last_unstale":"2024-09-18T01:28:49.058508+0000","last_undegraded":"2024-09-18T01:28:49.058508+0000","last_fullsized":"2024-09-18T01:28:49.058508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:49.058417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:49.058417+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.058417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:09.897723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'17","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.472238+0000","last_change":"2024-09-18T01:28:51.472284+0000","last_active":"2024-09-18T01:28:51.472238+0000","last_peered":"2024-09-18T01:28:51.472238+0000","last_clean":"2024-09-18T01:28:51.472238+0000","last_became_active":"2024-09-18T01:25:16.703227+0000","last_became_peered":"2024-09-18T01:25:16.703227+0000","last_unstale":"2024-09-18T01:28:51.472238+0000","last_undegraded":"2024-09-18T01:28:51.472238+0000","last_fullsized":"2024-09-18T01:28:51.472238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-18T01:28:51.472131+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-18T01:28:51.472131+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.472131+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:46:57.519168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.271075+0000","last_change":"2024-09-18T01:28:48.271102+0000","last_active":"2024-09-18T01:28:48.271075+0000","last_peered":"2024-09-18T01:28:48.271075+0000","last_clean":"2024-09-18T01:28:48.271075+0000","last_became_active":"2024-09-18T01:25:08.687482+0000","last_became_peered":"2024-09-18T01:25:08.687482+0000","last_unstale":"2024-09-18T01:28:48.271075+0000","last_undegraded":"2024-09-18T01:28:48.271075+0000","last_fullsized":"2024-09-18T01:28:48.271075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:28:48.270983+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:28:48.270983+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.270983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:51.899321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.803452+0000","last_change":"2024-09-18T01:28:54.803480+0000","last_active":"2024-09-18T01:28:54.803452+0000","last_peered":"2024-09-18T01:28:54.803452+0000","last_clean":"2024-09-18T01:28:54.803452+0000","last_became_active":"2024-09-18T01:25:06.705406+0000","last_became_peered":"2024-09-18T01:25:06.705406+0000","last_unstale":"2024-09-18T01:28:54.803452+0000","last_undegraded":"2024-09-18T01:28:54.803452+0000","last_fullsized":"2024-09-18T01:28:54.803452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:54.803363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:54.803363+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.803363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:05:32.221186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.114679+0000","last_change":"2024-09-18T01:28:29.114710+0000","last_active":"2024-09-18T01:28:29.114679+0000","last_peered":"2024-09-18T01:28:29.114679+0000","last_clean":"2024-09-18T01:28:29.114679+0000","last_became_active":"2024-09-18T01:25:10.682230+0000","last_became_peered":"2024-09-18T01:25:10.682230+0000","last_unstale":"2024-09-18T01:28:29.114679+0000","last_undegraded":"2024-09-18T01:28:29.114679+0000","last_fullsized":"2024-09-18T01:28:29.114679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.114588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.114588+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.114588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:42:02.700134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.620008+0000","last_change":"2024-09-18T01:28:41.620043+0000","last_active":"2024-09-18T01:28:41.620008+0000","last_peered":"2024-09-18T01:28:41.620008+0000","last_clean":"2024-09-18T01:28:41.620008+0000","last_became_active":"2024-09-18T01:25:12.687018+0000","last_became_peered":"2024-09-18T01:25:12.687018+0000","last_unstale":"2024-09-18T01:28:41.620008+0000","last_undegraded":"2024-09-18T01:28:41.620008+0000","last_fullsized":"2024-09-18T01:28:41.620008+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:41.619916+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:41.619916+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.619916+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:43.740728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.669948+0000","last_change":"2024-09-18T01:28:29.669975+0000","last_active":"2024-09-18T01:28:29.669948+0000","last_peered":"2024-09-18T01:28:29.669948+0000","last_clean":"2024-09-18T01:28:29.669948+0000","last_became_active":"2024-09-18T01:25:14.707008+0000","last_became_peered":"2024-09-18T01:25:14.707008+0000","last_unstale":"2024-09-18T01:28:29.669948+0000","last_undegraded":"2024-09-18T01:28:29.669948+0000","last_fullsized":"2024-09-18T01:28:29.669948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.669852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.669852+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.669852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:18.373919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.180740+0000","last_change":"2024-09-18T01:25:16.714484+0000","last_active":"2024-09-18T01:28:17.180740+0000","last_peered":"2024-09-18T01:28:17.180740+0000","last_clean":"2024-09-18T01:28:17.180740+0000","last_became_active":"2024-09-18T01:25:16.714160+0000","last_became_peered":"2024-09-18T01:25:16.714160+0000","last_unstale":"2024-09-18T01:28:17.180740+0000","last_undegraded":"2024-09-18T01:28:17.180740+0000","last_fullsized":"2024-09-18T01:28:17.180740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.422795+0000","last_change":"2024-09-18T01:29:01.422822+0000","last_active":"2024-09-18T01:29:01.422795+0000","last_peered":"2024-09-18T01:29:01.422795+0000","last_clean":"2024-09-18T01:29:01.422795+0000","last_became_active":"2024-09-18T01:25:08.671365+0000","last_became_peered":"2024-09-18T01:25:08.671365+0000","last_unstale":"2024-09-18T01:29:01.422795+0000","last_undegraded":"2024-09-18T01:29:01.422795+0000","last_fullsized":"2024-09-18T01:29:01.422795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:01.422709+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:01.422709+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.422709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:17.828506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.855381+0000","last_change":"2024-09-18T01:29:02.855411+0000","last_active":"2024-09-18T01:29:02.855381+0000","last_peered":"2024-09-18T01:29:02.855381+0000","last_clean":"2024-09-18T01:29:02.855381+0000","last_became_active":"2024-09-18T01:25:06.703081+0000","last_became_peered":"2024-09-18T01:25:06.703081+0000","last_unstale":"2024-09-18T01:29:02.855381+0000","last_undegraded":"2024-09-18T01:29:02.855381+0000","last_fullsized":"2024-09-18T01:29:02.855381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:02.855275+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:02.855275+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.855275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:21.389785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.718726+0000","last_change":"2024-09-18T01:28:44.718746+0000","last_active":"2024-09-18T01:28:44.718726+0000","last_peered":"2024-09-18T01:28:44.718726+0000","last_clean":"2024-09-18T01:28:44.718726+0000","last_became_active":"2024-09-18T01:25:10.680316+0000","last_became_peered":"2024-09-18T01:25:10.680316+0000","last_unstale":"2024-09-18T01:28:44.718726+0000","last_undegraded":"2024-09-18T01:28:44.718726+0000","last_fullsized":"2024-09-18T01:28:44.718726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:44.718622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:44.718622+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.718622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:03.968563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'47","reported_seq":119,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.607584+0000","last_change":"2024-09-18T01:28:42.607643+0000","last_active":"2024-09-18T01:28:42.607584+0000","last_peered":"2024-09-18T01:28:42.607584+0000","last_clean":"2024-09-18T01:28:42.607584+0000","last_became_active":"2024-09-18T01:25:12.682270+0000","last_became_peered":"2024-09-18T01:25:12.682270+0000","last_unstale":"2024-09-18T01:28:42.607584+0000","last_undegraded":"2024-09-18T01:28:42.607584+0000","last_fullsized":"2024-09-18T01:28:42.607584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-09-18T01:28:42.607487+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-09-18T01:28:42.607487+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.607487+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:54.508090+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.271313+0000","last_change":"2024-09-18T01:28:39.271337+0000","last_active":"2024-09-18T01:28:39.271313+0000","last_peered":"2024-09-18T01:28:39.271313+0000","last_clean":"2024-09-18T01:28:39.271313+0000","last_became_active":"2024-09-18T01:25:14.703583+0000","last_became_peered":"2024-09-18T01:25:14.703583+0000","last_unstale":"2024-09-18T01:28:39.271313+0000","last_undegraded":"2024-09-18T01:28:39.271313+0000","last_fullsized":"2024-09-18T01:28:39.271313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:39.271224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:39.271224+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.271224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:54.971763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:49.802344+0000","last_change":"2024-09-18T01:25:16.714459+0000","last_active":"2024-09-18T01:27:49.802344+0000","last_peered":"2024-09-18T01:27:49.802344+0000","last_clean":"2024-09-18T01:27:49.802344+0000","last_became_active":"2024-09-18T01:25:16.714061+0000","last_became_peered":"2024-09-18T01:25:16.714061+0000","last_unstale":"2024-09-18T01:27:49.802344+0000","last_undegraded":"2024-09-18T01:27:49.802344+0000","last_fullsized":"2024-09-18T01:27:49.802344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.003975+0000","last_change":"2024-09-18T01:28:46.004012+0000","last_active":"2024-09-18T01:28:46.003975+0000","last_peered":"2024-09-18T01:28:46.003975+0000","last_clean":"2024-09-18T01:28:46.003975+0000","last_became_active":"2024-09-18T01:25:08.688016+0000","last_became_peered":"2024-09-18T01:25:08.688016+0000","last_unstale":"2024-09-18T01:28:46.003975+0000","last_undegraded":"2024-09-18T01:28:46.003975+0000","last_fullsized":"2024-09-18T01:28:46.003975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:46.003879+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:46.003879+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.003879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:50.020572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800124+0000","last_change":"2024-09-18T01:25:06.691298+0000","last_active":"2024-09-18T01:27:34.800124+0000","last_peered":"2024-09-18T01:27:34.800124+0000","last_clean":"2024-09-18T01:27:34.800124+0000","last_became_active":"2024-09-18T01:25:06.688747+0000","last_became_peered":"2024-09-18T01:25:06.688747+0000","last_unstale":"2024-09-18T01:27:34.800124+0000","last_undegraded":"2024-09-18T01:27:34.800124+0000","last_fullsized":"2024-09-18T01:27:34.800124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.109559+0000","last_change":"2024-09-18T01:28:38.109581+0000","last_active":"2024-09-18T01:28:38.109559+0000","last_peered":"2024-09-18T01:28:38.109559+0000","last_clean":"2024-09-18T01:28:38.109559+0000","last_became_active":"2024-09-18T01:25:10.680831+0000","last_became_peered":"2024-09-18T01:25:10.680831+0000","last_unstale":"2024-09-18T01:28:38.109559+0000","last_undegraded":"2024-09-18T01:28:38.109559+0000","last_fullsized":"2024-09-18T01:28:38.109559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:38.109472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:38.109472+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.109472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:44.941883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.715067+0000","last_change":"2024-09-18T01:28:42.715108+0000","last_active":"2024-09-18T01:28:42.715067+0000","last_peered":"2024-09-18T01:28:42.715067+0000","last_clean":"2024-09-18T01:28:42.715067+0000","last_became_active":"2024-09-18T01:25:12.686918+0000","last_became_peered":"2024-09-18T01:25:12.686918+0000","last_unstale":"2024-09-18T01:28:42.715067+0000","last_undegraded":"2024-09-18T01:28:42.715067+0000","last_fullsized":"2024-09-18T01:28:42.715067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-18T01:28:42.714970+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-18T01:28:42.714970+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.714970+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:01:05.208541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.654223+0000","last_change":"2024-09-18T01:28:32.654249+0000","last_active":"2024-09-18T01:28:32.654223+0000","last_peered":"2024-09-18T01:28:32.654223+0000","last_clean":"2024-09-18T01:28:32.654223+0000","last_became_active":"2024-09-18T01:25:14.695120+0000","last_became_peered":"2024-09-18T01:25:14.695120+0000","last_unstale":"2024-09-18T01:28:32.654223+0000","last_undegraded":"2024-09-18T01:28:32.654223+0000","last_fullsized":"2024-09-18T01:28:32.654223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:32.654135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:32.654135+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.654135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:02:10.947460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'5","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.227940+0000","last_change":"2024-09-18T01:25:08.678193+0000","last_active":"2024-09-18T01:28:17.227940+0000","last_peered":"2024-09-18T01:28:17.227940+0000","last_clean":"2024-09-18T01:28:17.227940+0000","last_became_active":"2024-09-18T01:25:08.677941+0000","last_became_peered":"2024-09-18T01:25:08.677941+0000","last_unstale":"2024-09-18T01:28:17.227940+0000","last_undegraded":"2024-09-18T01:28:17.227940+0000","last_fullsized":"2024-09-18T01:28:17.227940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.088733+0000","last_change":"2024-09-18T01:25:06.695779+0000","last_active":"2024-09-18T01:28:17.088733+0000","last_peered":"2024-09-18T01:28:17.088733+0000","last_clean":"2024-09-18T01:28:17.088733+0000","last_became_active":"2024-09-18T01:25:06.692823+0000","last_became_peered":"2024-09-18T01:25:06.692823+0000","last_unstale":"2024-09-18T01:28:17.088733+0000","last_undegraded":"2024-09-18T01:28:17.088733+0000","last_fullsized":"2024-09-18T01:28:17.088733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.590029+0000","last_change":"2024-09-18T01:28:46.590054+0000","last_active":"2024-09-18T01:28:46.590029+0000","last_peered":"2024-09-18T01:28:46.590029+0000","last_clean":"2024-09-18T01:28:46.590029+0000","last_became_active":"2024-09-18T01:25:10.677481+0000","last_became_peered":"2024-09-18T01:25:10.677481+0000","last_unstale":"2024-09-18T01:28:46.590029+0000","last_undegraded":"2024-09-18T01:28:46.590029+0000","last_fullsized":"2024-09-18T01:28:46.590029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:46.589926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:46.589926+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.589926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:21:01.356370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'71","reported_seq":150,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.576795+0000","last_change":"2024-09-18T01:28:40.576840+0000","last_active":"2024-09-18T01:28:40.576795+0000","last_peered":"2024-09-18T01:28:40.576795+0000","last_clean":"2024-09-18T01:28:40.576795+0000","last_became_active":"2024-09-18T01:25:12.687014+0000","last_became_peered":"2024-09-18T01:25:12.687014+0000","last_unstale":"2024-09-18T01:28:40.576795+0000","last_undegraded":"2024-09-18T01:28:40.576795+0000","last_fullsized":"2024-09-18T01:28:40.576795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'71","last_scrub_stamp":"2024-09-18T01:28:40.576711+0000","last_deep_scrub":"35'71","last_deep_scrub_stamp":"2024-09-18T01:28:40.576711+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.576711+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:02:19.666203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.637762+0000","last_change":"2024-09-18T01:28:31.637788+0000","last_active":"2024-09-18T01:28:31.637762+0000","last_peered":"2024-09-18T01:28:31.637762+0000","last_clean":"2024-09-18T01:28:31.637762+0000","last_became_active":"2024-09-18T01:25:14.698753+0000","last_became_peered":"2024-09-18T01:25:14.698753+0000","last_unstale":"2024-09-18T01:28:31.637762+0000","last_undegraded":"2024-09-18T01:28:31.637762+0000","last_fullsized":"2024-09-18T01:28:31.637762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.637674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.637674+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.637674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:05:28.601978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'20","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.155923+0000","last_change":"2024-09-18T01:25:16.714340+0000","last_active":"2024-09-18T01:28:17.155923+0000","last_peered":"2024-09-18T01:28:17.155923+0000","last_clean":"2024-09-18T01:28:17.155923+0000","last_became_active":"2024-09-18T01:25:16.713750+0000","last_became_peered":"2024-09-18T01:25:16.713750+0000","last_unstale":"2024-09-18T01:28:17.155923+0000","last_undegraded":"2024-09-18T01:28:17.155923+0000","last_fullsized":"2024-09-18T01:28:17.155923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'6","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:26.669705+0000","last_change":"2024-09-18T01:25:08.681356+0000","last_active":"2024-09-18T01:28:26.669705+0000","last_peered":"2024-09-18T01:28:26.669705+0000","last_clean":"2024-09-18T01:28:26.669705+0000","last_became_active":"2024-09-18T01:25:08.680604+0000","last_became_peered":"2024-09-18T01:25:08.680604+0000","last_unstale":"2024-09-18T01:28:26.669705+0000","last_undegraded":"2024-09-18T01:28:26.669705+0000","last_fullsized":"2024-09-18T01:28:26.669705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799976+0000","last_change":"2024-09-18T01:25:06.688269+0000","last_active":"2024-09-18T01:27:34.799976+0000","last_peered":"2024-09-18T01:27:34.799976+0000","last_clean":"2024-09-18T01:27:34.799976+0000","last_became_active":"2024-09-18T01:25:06.686125+0000","last_became_peered":"2024-09-18T01:25:06.686125+0000","last_unstale":"2024-09-18T01:27:34.799976+0000","last_undegraded":"2024-09-18T01:27:34.799976+0000","last_fullsized":"2024-09-18T01:27:34.799976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":238,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.694878+0000","last_change":"2024-09-18T01:25:43.912490+0000","last_active":"2024-09-18T01:28:23.694878+0000","last_peered":"2024-09-18T01:28:23.694878+0000","last_clean":"2024-09-18T01:28:23.694878+0000","last_became_active":"2024-09-18T01:25:43.908273+0000","last_became_peered":"2024-09-18T01:25:43.908273+0000","last_unstale":"2024-09-18T01:28:23.694878+0000","last_undegraded":"2024-09-18T01:28:23.694878+0000","last_fullsized":"2024-09-18T01:28:23.694878+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:09.660485+0000","last_clean_scrub_stamp":"2024-09-18T01:25:09.660485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.076283+0000","last_change":"2024-09-18T01:29:00.076347+0000","last_active":"2024-09-18T01:29:00.076283+0000","last_peered":"2024-09-18T01:29:00.076283+0000","last_clean":"2024-09-18T01:29:00.076283+0000","last_became_active":"2024-09-18T01:25:12.692486+0000","last_became_peered":"2024-09-18T01:25:12.692486+0000","last_unstale":"2024-09-18T01:29:00.076283+0000","last_undegraded":"2024-09-18T01:29:00.076283+0000","last_fullsized":"2024-09-18T01:29:00.076283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:29:00.076171+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:29:00.076171+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.076171+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:57:19.965536+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.203333+0000","last_change":"2024-09-18T01:28:51.203356+0000","last_active":"2024-09-18T01:28:51.203333+0000","last_peered":"2024-09-18T01:28:51.203333+0000","last_clean":"2024-09-18T01:28:51.203333+0000","last_became_active":"2024-09-18T01:25:14.709980+0000","last_became_peered":"2024-09-18T01:25:14.709980+0000","last_unstale":"2024-09-18T01:28:51.203333+0000","last_undegraded":"2024-09-18T01:28:51.203333+0000","last_fullsized":"2024-09-18T01:28:51.203333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:51.203243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:51.203243+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.203243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:37:51.114618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800735+0000","last_change":"2024-09-18T01:25:16.709176+0000","last_active":"2024-09-18T01:27:39.800735+0000","last_peered":"2024-09-18T01:27:39.800735+0000","last_clean":"2024-09-18T01:27:39.800735+0000","last_became_active":"2024-09-18T01:25:16.708905+0000","last_became_peered":"2024-09-18T01:25:16.708905+0000","last_unstale":"2024-09-18T01:27:39.800735+0000","last_undegraded":"2024-09-18T01:27:39.800735+0000","last_fullsized":"2024-09-18T01:27:39.800735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'6","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.081418+0000","last_change":"2024-09-18T01:28:40.081446+0000","last_active":"2024-09-18T01:28:40.081418+0000","last_peered":"2024-09-18T01:28:40.081418+0000","last_clean":"2024-09-18T01:28:40.081418+0000","last_became_active":"2024-09-18T01:25:08.688610+0000","last_became_peered":"2024-09-18T01:25:08.688610+0000","last_unstale":"2024-09-18T01:28:40.081418+0000","last_undegraded":"2024-09-18T01:28:40.081418+0000","last_fullsized":"2024-09-18T01:28:40.081418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:40.081320+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:40.081320+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.081320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:49.789353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800700+0000","last_change":"2024-09-18T01:25:06.685750+0000","last_active":"2024-09-18T01:27:39.800700+0000","last_peered":"2024-09-18T01:27:39.800700+0000","last_clean":"2024-09-18T01:27:39.800700+0000","last_became_active":"2024-09-18T01:25:06.685167+0000","last_became_peered":"2024-09-18T01:25:06.685167+0000","last_unstale":"2024-09-18T01:27:39.800700+0000","last_undegraded":"2024-09-18T01:27:39.800700+0000","last_fullsized":"2024-09-18T01:27:39.800700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.752136+0000","last_change":"2024-09-18T01:28:46.752160+0000","last_active":"2024-09-18T01:28:46.752136+0000","last_peered":"2024-09-18T01:28:46.752136+0000","last_clean":"2024-09-18T01:28:46.752136+0000","last_became_active":"2024-09-18T01:25:10.678586+0000","last_became_peered":"2024-09-18T01:25:10.678586+0000","last_unstale":"2024-09-18T01:28:46.752136+0000","last_undegraded":"2024-09-18T01:28:46.752136+0000","last_fullsized":"2024-09-18T01:28:46.752136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:46.752053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:46.752053+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.752053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:18:54.078274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'46","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.589579+0000","last_change":"2024-09-18T01:28:38.589617+0000","last_active":"2024-09-18T01:28:38.589579+0000","last_peered":"2024-09-18T01:28:38.589579+0000","last_clean":"2024-09-18T01:28:38.589579+0000","last_became_active":"2024-09-18T01:25:12.687935+0000","last_became_peered":"2024-09-18T01:25:12.687935+0000","last_unstale":"2024-09-18T01:28:38.589579+0000","last_undegraded":"2024-09-18T01:28:38.589579+0000","last_fullsized":"2024-09-18T01:28:38.589579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:38.589489+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:38.589489+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.589489+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:04:54.499330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.683081+0000","last_change":"2024-09-18T01:28:30.683121+0000","last_active":"2024-09-18T01:28:30.683081+0000","last_peered":"2024-09-18T01:28:30.683081+0000","last_clean":"2024-09-18T01:28:30.683081+0000","last_became_active":"2024-09-18T01:25:14.701702+0000","last_became_peered":"2024-09-18T01:25:14.701702+0000","last_unstale":"2024-09-18T01:28:30.683081+0000","last_undegraded":"2024-09-18T01:28:30.683081+0000","last_fullsized":"2024-09-18T01:28:30.683081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:30.682992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:30.682992+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.682992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:55.879755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800702+0000","last_change":"2024-09-18T01:25:16.716015+0000","last_active":"2024-09-18T01:27:39.800702+0000","last_peered":"2024-09-18T01:27:39.800702+0000","last_clean":"2024-09-18T01:27:39.800702+0000","last_became_active":"2024-09-18T01:25:16.715669+0000","last_became_peered":"2024-09-18T01:25:16.715669+0000","last_unstale":"2024-09-18T01:27:39.800702+0000","last_undegraded":"2024-09-18T01:27:39.800702+0000","last_fullsized":"2024-09-18T01:27:39.800702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"35'16","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.428199+0000","last_change":"2024-09-18T01:29:03.428235+0000","last_active":"2024-09-18T01:29:03.428199+0000","last_peered":"2024-09-18T01:29:03.428199+0000","last_clean":"2024-09-18T01:29:03.428199+0000","last_became_active":"2024-09-18T01:25:08.672541+0000","last_became_peered":"2024-09-18T01:25:08.672541+0000","last_unstale":"2024-09-18T01:29:03.428199+0000","last_undegraded":"2024-09-18T01:29:03.428199+0000","last_fullsized":"2024-09-18T01:29:03.428199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-18T01:29:03.428109+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-18T01:29:03.428109+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.428109+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:25:08.371120+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800796+0000","last_change":"2024-09-18T01:25:06.687447+0000","last_active":"2024-09-18T01:27:39.800796+0000","last_peered":"2024-09-18T01:27:39.800796+0000","last_clean":"2024-09-18T01:27:39.800796+0000","last_became_active":"2024-09-18T01:25:06.684658+0000","last_became_peered":"2024-09-18T01:25:06.684658+0000","last_unstale":"2024-09-18T01:27:39.800796+0000","last_undegraded":"2024-09-18T01:27:39.800796+0000","last_fullsized":"2024-09-18T01:27:39.800796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.324781+0000","last_change":"2024-09-18T01:28:44.324803+0000","last_active":"2024-09-18T01:28:44.324781+0000","last_peered":"2024-09-18T01:28:44.324781+0000","last_clean":"2024-09-18T01:28:44.324781+0000","last_became_active":"2024-09-18T01:25:10.679369+0000","last_became_peered":"2024-09-18T01:25:10.679369+0000","last_unstale":"2024-09-18T01:28:44.324781+0000","last_undegraded":"2024-09-18T01:28:44.324781+0000","last_fullsized":"2024-09-18T01:28:44.324781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:44.324660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:44.324660+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.324660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:21.528723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'22","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.075395+0000","last_change":"2024-09-18T01:28:52.075434+0000","last_active":"2024-09-18T01:28:52.075395+0000","last_peered":"2024-09-18T01:28:52.075395+0000","last_clean":"2024-09-18T01:28:52.075395+0000","last_became_active":"2024-09-18T01:25:12.696757+0000","last_became_peered":"2024-09-18T01:25:12.696757+0000","last_unstale":"2024-09-18T01:28:52.075395+0000","last_undegraded":"2024-09-18T01:28:52.075395+0000","last_fullsized":"2024-09-18T01:28:52.075395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-18T01:28:52.075306+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-18T01:28:52.075306+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.075306+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:59:02.612796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":384,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.663286+0000","last_change":"2024-09-18T01:28:33.663311+0000","last_active":"2024-09-18T01:28:33.663286+0000","last_peered":"2024-09-18T01:28:33.663286+0000","last_clean":"2024-09-18T01:28:33.663286+0000","last_became_active":"2024-09-18T01:25:14.708840+0000","last_became_peered":"2024-09-18T01:25:14.708840+0000","last_unstale":"2024-09-18T01:28:33.663286+0000","last_undegraded":"2024-09-18T01:28:33.663286+0000","last_fullsized":"2024-09-18T01:28:33.663286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:33.663217+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:33.663217+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.663217+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:17:45.430908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800590+0000","last_change":"2024-09-18T01:25:16.707474+0000","last_active":"2024-09-18T01:27:39.800590+0000","last_peered":"2024-09-18T01:27:39.800590+0000","last_clean":"2024-09-18T01:27:39.800590+0000","last_became_active":"2024-09-18T01:25:16.706764+0000","last_became_peered":"2024-09-18T01:25:16.706764+0000","last_unstale":"2024-09-18T01:27:39.800590+0000","last_undegraded":"2024-09-18T01:27:39.800590+0000","last_fullsized":"2024-09-18T01:27:39.800590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.788422+0000","last_change":"2024-09-18T01:28:51.788470+0000","last_active":"2024-09-18T01:28:51.788422+0000","last_peered":"2024-09-18T01:28:51.788422+0000","last_clean":"2024-09-18T01:28:51.788422+0000","last_became_active":"2024-09-18T01:25:08.669920+0000","last_became_peered":"2024-09-18T01:25:08.669920+0000","last_unstale":"2024-09-18T01:28:51.788422+0000","last_undegraded":"2024-09-18T01:28:51.788422+0000","last_fullsized":"2024-09-18T01:28:51.788422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:51.788294+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:51.788294+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.788294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:52:03.688898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800761+0000","last_change":"2024-09-18T01:25:06.685435+0000","last_active":"2024-09-18T01:27:39.800761+0000","last_peered":"2024-09-18T01:27:39.800761+0000","last_clean":"2024-09-18T01:27:39.800761+0000","last_became_active":"2024-09-18T01:25:06.684984+0000","last_became_peered":"2024-09-18T01:25:06.684984+0000","last_unstale":"2024-09-18T01:27:39.800761+0000","last_undegraded":"2024-09-18T01:27:39.800761+0000","last_fullsized":"2024-09-18T01:27:39.800761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.258238+0000","last_change":"2024-09-18T01:28:42.258260+0000","last_active":"2024-09-18T01:28:42.258238+0000","last_peered":"2024-09-18T01:28:42.258238+0000","last_clean":"2024-09-18T01:28:42.258238+0000","last_became_active":"2024-09-18T01:25:10.679468+0000","last_became_peered":"2024-09-18T01:25:10.679468+0000","last_unstale":"2024-09-18T01:28:42.258238+0000","last_undegraded":"2024-09-18T01:28:42.258238+0000","last_fullsized":"2024-09-18T01:28:42.258238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:42.258155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:42.258155+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.258155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:43:55.164530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'73","reported_seq":155,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.399904+0000","last_change":"2024-09-18T01:28:29.399990+0000","last_active":"2024-09-18T01:28:29.399904+0000","last_peered":"2024-09-18T01:28:29.399904+0000","last_clean":"2024-09-18T01:28:29.399904+0000","last_became_active":"2024-09-18T01:25:12.688618+0000","last_became_peered":"2024-09-18T01:25:12.688618+0000","last_unstale":"2024-09-18T01:28:29.399904+0000","last_undegraded":"2024-09-18T01:28:29.399904+0000","last_fullsized":"2024-09-18T01:28:29.399904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'73","last_scrub_stamp":"2024-09-18T01:28:29.399801+0000","last_deep_scrub":"35'73","last_deep_scrub_stamp":"2024-09-18T01:28:29.399801+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.399801+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:16:18.035775+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:43.592312+0000","last_change":"2024-09-18T01:28:43.592338+0000","last_active":"2024-09-18T01:28:43.592312+0000","last_peered":"2024-09-18T01:28:43.592312+0000","last_clean":"2024-09-18T01:28:43.592312+0000","last_became_active":"2024-09-18T01:25:14.706586+0000","last_became_peered":"2024-09-18T01:25:14.706586+0000","last_unstale":"2024-09-18T01:28:43.592312+0000","last_undegraded":"2024-09-18T01:28:43.592312+0000","last_fullsized":"2024-09-18T01:28:43.592312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:43.592225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:43.592225+0000","last_clean_scrub_stamp":"2024-09-18T01:28:43.592225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:47:15.204874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801668+0000","last_change":"2024-09-18T01:25:16.714536+0000","last_active":"2024-09-18T01:27:44.801668+0000","last_peered":"2024-09-18T01:27:44.801668+0000","last_clean":"2024-09-18T01:27:44.801668+0000","last_became_active":"2024-09-18T01:25:16.713789+0000","last_became_peered":"2024-09-18T01:25:16.713789+0000","last_unstale":"2024-09-18T01:27:44.801668+0000","last_undegraded":"2024-09-18T01:27:44.801668+0000","last_fullsized":"2024-09-18T01:27:44.801668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.847149+0000","last_change":"2024-09-18T01:28:53.847173+0000","last_active":"2024-09-18T01:28:53.847149+0000","last_peered":"2024-09-18T01:28:53.847149+0000","last_clean":"2024-09-18T01:28:53.847149+0000","last_became_active":"2024-09-18T01:25:08.670268+0000","last_became_peered":"2024-09-18T01:25:08.670268+0000","last_unstale":"2024-09-18T01:28:53.847149+0000","last_undegraded":"2024-09-18T01:28:53.847149+0000","last_fullsized":"2024-09-18T01:28:53.847149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:53.847065+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:53.847065+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.847065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:14.842558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.854804+0000","last_change":"2024-09-18T01:25:06.689500+0000","last_active":"2024-09-18T01:28:23.854804+0000","last_peered":"2024-09-18T01:28:23.854804+0000","last_clean":"2024-09-18T01:28:23.854804+0000","last_became_active":"2024-09-18T01:25:06.687382+0000","last_became_peered":"2024-09-18T01:25:06.687382+0000","last_unstale":"2024-09-18T01:28:23.854804+0000","last_undegraded":"2024-09-18T01:28:23.854804+0000","last_fullsized":"2024-09-18T01:28:23.854804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:43.756227+0000","last_change":"2024-09-18T01:28:43.756254+0000","last_active":"2024-09-18T01:28:43.756227+0000","last_peered":"2024-09-18T01:28:43.756227+0000","last_clean":"2024-09-18T01:28:43.756227+0000","last_became_active":"2024-09-18T01:25:10.682337+0000","last_became_peered":"2024-09-18T01:25:10.682337+0000","last_unstale":"2024-09-18T01:28:43.756227+0000","last_undegraded":"2024-09-18T01:28:43.756227+0000","last_fullsized":"2024-09-18T01:28:43.756227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:43.756140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:43.756140+0000","last_clean_scrub_stamp":"2024-09-18T01:28:43.756140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:26.328226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'43","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.556548+0000","last_change":"2024-09-18T01:28:37.556582+0000","last_active":"2024-09-18T01:28:37.556548+0000","last_peered":"2024-09-18T01:28:37.556548+0000","last_clean":"2024-09-18T01:28:37.556548+0000","last_became_active":"2024-09-18T01:25:12.693129+0000","last_became_peered":"2024-09-18T01:25:12.693129+0000","last_unstale":"2024-09-18T01:28:37.556548+0000","last_undegraded":"2024-09-18T01:28:37.556548+0000","last_fullsized":"2024-09-18T01:28:37.556548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'43","last_scrub_stamp":"2024-09-18T01:28:37.556467+0000","last_deep_scrub":"35'43","last_deep_scrub_stamp":"2024-09-18T01:28:37.556467+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.556467+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:47:34.949630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.064141+0000","last_change":"2024-09-18T01:28:50.064170+0000","last_active":"2024-09-18T01:28:50.064141+0000","last_peered":"2024-09-18T01:28:50.064141+0000","last_clean":"2024-09-18T01:28:50.064141+0000","last_became_active":"2024-09-18T01:25:14.706325+0000","last_became_peered":"2024-09-18T01:25:14.706325+0000","last_unstale":"2024-09-18T01:28:50.064141+0000","last_undegraded":"2024-09-18T01:28:50.064141+0000","last_fullsized":"2024-09-18T01:28:50.064141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:50.064039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:50.064039+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.064039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:44:36.736877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801744+0000","last_change":"2024-09-18T01:25:16.716357+0000","last_active":"2024-09-18T01:27:44.801744+0000","last_peered":"2024-09-18T01:27:44.801744+0000","last_clean":"2024-09-18T01:27:44.801744+0000","last_became_active":"2024-09-18T01:25:16.716084+0000","last_became_peered":"2024-09-18T01:25:16.716084+0000","last_unstale":"2024-09-18T01:27:44.801744+0000","last_undegraded":"2024-09-18T01:27:44.801744+0000","last_fullsized":"2024-09-18T01:27:44.801744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799836+0000","last_change":"2024-09-18T01:25:08.678786+0000","last_active":"2024-09-18T01:27:34.799836+0000","last_peered":"2024-09-18T01:27:34.799836+0000","last_clean":"2024-09-18T01:27:34.799836+0000","last_became_active":"2024-09-18T01:25:08.678539+0000","last_became_peered":"2024-09-18T01:25:08.678539+0000","last_unstale":"2024-09-18T01:27:34.799836+0000","last_undegraded":"2024-09-18T01:27:34.799836+0000","last_fullsized":"2024-09-18T01:27:34.799836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:26.669410+0000","last_change":"2024-09-18T01:25:06.682960+0000","last_active":"2024-09-18T01:28:26.669410+0000","last_peered":"2024-09-18T01:28:26.669410+0000","last_clean":"2024-09-18T01:28:26.669410+0000","last_became_active":"2024-09-18T01:25:06.682592+0000","last_became_peered":"2024-09-18T01:25:06.682592+0000","last_unstale":"2024-09-18T01:28:26.669410+0000","last_undegraded":"2024-09-18T01:28:26.669410+0000","last_fullsized":"2024-09-18T01:28:26.669410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.341584+0000","last_change":"2024-09-18T01:28:34.341623+0000","last_active":"2024-09-18T01:28:34.341584+0000","last_peered":"2024-09-18T01:28:34.341584+0000","last_clean":"2024-09-18T01:28:34.341584+0000","last_became_active":"2024-09-18T01:25:10.683833+0000","last_became_peered":"2024-09-18T01:25:10.683833+0000","last_unstale":"2024-09-18T01:28:34.341584+0000","last_undegraded":"2024-09-18T01:28:34.341584+0000","last_fullsized":"2024-09-18T01:28:34.341584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:34.341474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:34.341474+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.341474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:33.233882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'38","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.014129+0000","last_change":"2024-09-18T01:28:58.014174+0000","last_active":"2024-09-18T01:28:58.014129+0000","last_peered":"2024-09-18T01:28:58.014129+0000","last_clean":"2024-09-18T01:28:58.014129+0000","last_became_active":"2024-09-18T01:25:12.691752+0000","last_became_peered":"2024-09-18T01:25:12.691752+0000","last_unstale":"2024-09-18T01:28:58.014129+0000","last_undegraded":"2024-09-18T01:28:58.014129+0000","last_fullsized":"2024-09-18T01:28:58.014129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'38","last_scrub_stamp":"2024-09-18T01:28:58.014049+0000","last_deep_scrub":"35'38","last_deep_scrub_stamp":"2024-09-18T01:28:58.014049+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.014049+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:10:57.324269+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801592+0000","last_change":"2024-09-18T01:25:14.711982+0000","last_active":"2024-09-18T01:27:44.801592+0000","last_peered":"2024-09-18T01:27:44.801592+0000","last_clean":"2024-09-18T01:27:44.801592+0000","last_became_active":"2024-09-18T01:25:14.711635+0000","last_became_peered":"2024-09-18T01:25:14.711635+0000","last_unstale":"2024-09-18T01:27:44.801592+0000","last_undegraded":"2024-09-18T01:27:44.801592+0000","last_fullsized":"2024-09-18T01:27:44.801592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:13.676001+0000","last_clean_scrub_stamp":"2024-09-18T01:25:13.676001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801703+0000","last_change":"2024-09-18T01:25:16.715865+0000","last_active":"2024-09-18T01:27:44.801703+0000","last_peered":"2024-09-18T01:27:44.801703+0000","last_clean":"2024-09-18T01:27:44.801703+0000","last_became_active":"2024-09-18T01:25:16.715581+0000","last_became_peered":"2024-09-18T01:25:16.715581+0000","last_unstale":"2024-09-18T01:27:44.801703+0000","last_undegraded":"2024-09-18T01:27:44.801703+0000","last_fullsized":"2024-09-18T01:27:44.801703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'8","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.804555+0000","last_change":"2024-09-18T01:28:52.804583+0000","last_active":"2024-09-18T01:28:52.804555+0000","last_peered":"2024-09-18T01:28:52.804555+0000","last_clean":"2024-09-18T01:28:52.804555+0000","last_became_active":"2024-09-18T01:25:08.668430+0000","last_became_peered":"2024-09-18T01:25:08.668430+0000","last_unstale":"2024-09-18T01:28:52.804555+0000","last_undegraded":"2024-09-18T01:28:52.804555+0000","last_fullsized":"2024-09-18T01:28:52.804555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:52.804464+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:52.804464+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.804464+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:58:10.937040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.797240+0000","last_change":"2024-09-18T01:25:06.687779+0000","last_active":"2024-09-18T01:27:14.797240+0000","last_peered":"2024-09-18T01:27:14.797240+0000","last_clean":"2024-09-18T01:27:14.797240+0000","last_became_active":"2024-09-18T01:25:06.686394+0000","last_became_peered":"2024-09-18T01:25:06.686394+0000","last_unstale":"2024-09-18T01:27:14.797240+0000","last_undegraded":"2024-09-18T01:27:14.797240+0000","last_fullsized":"2024-09-18T01:27:14.797240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.382361+0000","last_change":"2024-09-18T01:28:36.382417+0000","last_active":"2024-09-18T01:28:36.382361+0000","last_peered":"2024-09-18T01:28:36.382361+0000","last_clean":"2024-09-18T01:28:36.382361+0000","last_became_active":"2024-09-18T01:25:10.683351+0000","last_became_peered":"2024-09-18T01:25:10.683351+0000","last_unstale":"2024-09-18T01:28:36.382361+0000","last_undegraded":"2024-09-18T01:28:36.382361+0000","last_fullsized":"2024-09-18T01:28:36.382361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:28:36.382253+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:28:36.382253+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.382253+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:41:10.171758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'54","reported_seq":123,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.048989+0000","last_change":"2024-09-18T01:28:35.049047+0000","last_active":"2024-09-18T01:28:35.048989+0000","last_peered":"2024-09-18T01:28:35.048989+0000","last_clean":"2024-09-18T01:28:35.048989+0000","last_became_active":"2024-09-18T01:25:12.691715+0000","last_became_peered":"2024-09-18T01:25:12.691715+0000","last_unstale":"2024-09-18T01:28:35.048989+0000","last_undegraded":"2024-09-18T01:28:35.048989+0000","last_fullsized":"2024-09-18T01:28:35.048989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'54","last_scrub_stamp":"2024-09-18T01:28:35.048876+0000","last_deep_scrub":"35'54","last_deep_scrub_stamp":"2024-09-18T01:28:35.048876+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.048876+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:53.636298+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.564860+0000","last_change":"2024-09-18T01:28:35.564885+0000","last_active":"2024-09-18T01:28:35.564860+0000","last_peered":"2024-09-18T01:28:35.564860+0000","last_clean":"2024-09-18T01:28:35.564860+0000","last_became_active":"2024-09-18T01:25:14.706398+0000","last_became_peered":"2024-09-18T01:25:14.706398+0000","last_unstale":"2024-09-18T01:28:35.564860+0000","last_undegraded":"2024-09-18T01:28:35.564860+0000","last_fullsized":"2024-09-18T01:28:35.564860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:35.564741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:35.564741+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.564741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:51.265281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800848+0000","last_change":"2024-09-18T01:25:16.714114+0000","last_active":"2024-09-18T01:27:39.800848+0000","last_peered":"2024-09-18T01:27:39.800848+0000","last_clean":"2024-09-18T01:27:39.800848+0000","last_became_active":"2024-09-18T01:25:16.713579+0000","last_became_peered":"2024-09-18T01:25:16.713579+0000","last_unstale":"2024-09-18T01:27:39.800848+0000","last_undegraded":"2024-09-18T01:27:39.800848+0000","last_fullsized":"2024-09-18T01:27:39.800848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'8","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.238991+0000","last_change":"2024-09-18T01:28:54.239025+0000","last_active":"2024-09-18T01:28:54.238991+0000","last_peered":"2024-09-18T01:28:54.238991+0000","last_clean":"2024-09-18T01:28:54.238991+0000","last_became_active":"2024-09-18T01:25:08.686645+0000","last_became_peered":"2024-09-18T01:25:08.686645+0000","last_unstale":"2024-09-18T01:28:54.238991+0000","last_undegraded":"2024-09-18T01:28:54.238991+0000","last_fullsized":"2024-09-18T01:28:54.238991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:54.238884+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:54.238884+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.238884+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:10:44.376100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.761993+0000","last_change":"2024-09-18T01:29:04.762016+0000","last_active":"2024-09-18T01:29:04.761993+0000","last_peered":"2024-09-18T01:29:04.761993+0000","last_clean":"2024-09-18T01:29:04.761993+0000","last_became_active":"2024-09-18T01:25:06.702991+0000","last_became_peered":"2024-09-18T01:25:06.702991+0000","last_unstale":"2024-09-18T01:29:04.761993+0000","last_undegraded":"2024-09-18T01:29:04.761993+0000","last_fullsized":"2024-09-18T01:29:04.761993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:04.761904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:04.761904+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.761904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:25.122552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:07.539353+0000","last_change":"2024-09-18T01:29:07.539378+0000","last_active":"2024-09-18T01:29:07.539353+0000","last_peered":"2024-09-18T01:29:07.539353+0000","last_clean":"2024-09-18T01:29:07.539353+0000","last_became_active":"2024-09-18T01:25:08.672983+0000","last_became_peered":"2024-09-18T01:25:08.672983+0000","last_unstale":"2024-09-18T01:29:07.539353+0000","last_undegraded":"2024-09-18T01:29:07.539353+0000","last_fullsized":"2024-09-18T01:29:07.539353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:07.539265+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:07.539265+0000","last_clean_scrub_stamp":"2024-09-18T01:29:07.539265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:48.424256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.795938+0000","last_change":"2024-09-18T01:25:06.681343+0000","last_active":"2024-09-18T01:27:12.795938+0000","last_peered":"2024-09-18T01:27:12.795938+0000","last_clean":"2024-09-18T01:27:12.795938+0000","last_became_active":"2024-09-18T01:25:06.680853+0000","last_became_peered":"2024-09-18T01:25:06.680853+0000","last_unstale":"2024-09-18T01:27:12.795938+0000","last_undegraded":"2024-09-18T01:27:12.795938+0000","last_fullsized":"2024-09-18T01:27:12.795938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.116985+0000","last_change":"2024-09-18T01:29:02.117009+0000","last_active":"2024-09-18T01:29:02.116985+0000","last_peered":"2024-09-18T01:29:02.116985+0000","last_clean":"2024-09-18T01:29:02.116985+0000","last_became_active":"2024-09-18T01:25:08.682254+0000","last_became_peered":"2024-09-18T01:25:08.682254+0000","last_unstale":"2024-09-18T01:29:02.116985+0000","last_undegraded":"2024-09-18T01:29:02.116985+0000","last_fullsized":"2024-09-18T01:29:02.116985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:02.116885+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:02.116885+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.116885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:35:11.500133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:14.796562+0000","last_change":"2024-09-18T01:25:06.684384+0000","last_active":"2024-09-18T01:27:14.796562+0000","last_peered":"2024-09-18T01:27:14.796562+0000","last_clean":"2024-09-18T01:27:14.796562+0000","last_became_active":"2024-09-18T01:25:06.682878+0000","last_became_peered":"2024-09-18T01:25:06.682878+0000","last_unstale":"2024-09-18T01:27:14.796562+0000","last_undegraded":"2024-09-18T01:27:14.796562+0000","last_fullsized":"2024-09-18T01:27:14.796562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:05.482563+0000","last_change":"2024-09-18T01:29:05.482588+0000","last_active":"2024-09-18T01:29:05.482563+0000","last_peered":"2024-09-18T01:29:05.482563+0000","last_clean":"2024-09-18T01:29:05.482563+0000","last_became_active":"2024-09-18T01:25:08.672574+0000","last_became_peered":"2024-09-18T01:25:08.672574+0000","last_unstale":"2024-09-18T01:29:05.482563+0000","last_undegraded":"2024-09-18T01:29:05.482563+0000","last_fullsized":"2024-09-18T01:29:05.482563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:05.482430+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:05.482430+0000","last_clean_scrub_stamp":"2024-09-18T01:29:05.482430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:36:37.124121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:12.796009+0000","last_change":"2024-09-18T01:25:06.681262+0000","last_active":"2024-09-18T01:27:12.796009+0000","last_peered":"2024-09-18T01:27:12.796009+0000","last_clean":"2024-09-18T01:27:12.796009+0000","last_became_active":"2024-09-18T01:25:06.680712+0000","last_became_peered":"2024-09-18T01:25:06.680712+0000","last_unstale":"2024-09-18T01:27:12.796009+0000","last_undegraded":"2024-09-18T01:27:12.796009+0000","last_fullsized":"2024-09-18T01:27:12.796009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.473521+0000","last_change":"2024-09-18T01:28:59.473553+0000","last_active":"2024-09-18T01:28:59.473521+0000","last_peered":"2024-09-18T01:28:59.473521+0000","last_clean":"2024-09-18T01:28:59.473521+0000","last_became_active":"2024-09-18T01:25:08.671408+0000","last_became_peered":"2024-09-18T01:25:08.671408+0000","last_unstale":"2024-09-18T01:28:59.473521+0000","last_undegraded":"2024-09-18T01:28:59.473521+0000","last_fullsized":"2024-09-18T01:28:59.473521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:59.473436+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:59.473436+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.473436+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:23:43.979561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:17.796717+0000","last_change":"2024-09-18T01:25:06.683019+0000","last_active":"2024-09-18T01:27:17.796717+0000","last_peered":"2024-09-18T01:27:17.796717+0000","last_clean":"2024-09-18T01:27:17.796717+0000","last_became_active":"2024-09-18T01:25:06.682577+0000","last_became_peered":"2024-09-18T01:25:06.682577+0000","last_unstale":"2024-09-18T01:27:17.796717+0000","last_undegraded":"2024-09-18T01:27:17.796717+0000","last_fullsized":"2024-09-18T01:27:17.796717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'8","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:45.320022+0000","last_change":"2024-09-18T01:28:45.320051+0000","last_active":"2024-09-18T01:28:45.320022+0000","last_peered":"2024-09-18T01:28:45.320022+0000","last_clean":"2024-09-18T01:28:45.320022+0000","last_became_active":"2024-09-18T01:25:08.687797+0000","last_became_peered":"2024-09-18T01:25:08.687797+0000","last_unstale":"2024-09-18T01:28:45.320022+0000","last_undegraded":"2024-09-18T01:28:45.320022+0000","last_fullsized":"2024-09-18T01:28:45.320022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:45.319930+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:45.319930+0000","last_clean_scrub_stamp":"2024-09-18T01:28:45.319930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:09:56.008523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797897+0000","last_change":"2024-09-18T01:25:06.687325+0000","last_active":"2024-09-18T01:27:19.797897+0000","last_peered":"2024-09-18T01:27:19.797897+0000","last_clean":"2024-09-18T01:27:19.797897+0000","last_became_active":"2024-09-18T01:25:06.686154+0000","last_became_peered":"2024-09-18T01:25:06.686154+0000","last_unstale":"2024-09-18T01:27:19.797897+0000","last_undegraded":"2024-09-18T01:27:19.797897+0000","last_fullsized":"2024-09-18T01:27:19.797897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'8","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.490659+0000","last_change":"2024-09-18T01:28:53.490691+0000","last_active":"2024-09-18T01:28:53.490659+0000","last_peered":"2024-09-18T01:28:53.490659+0000","last_clean":"2024-09-18T01:28:53.490659+0000","last_became_active":"2024-09-18T01:25:08.680947+0000","last_became_peered":"2024-09-18T01:25:08.680947+0000","last_unstale":"2024-09-18T01:28:53.490659+0000","last_undegraded":"2024-09-18T01:28:53.490659+0000","last_fullsized":"2024-09-18T01:28:53.490659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:53.490566+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:53.490566+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.490566+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:33.730590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.848509+0000","last_change":"2024-09-18T01:29:00.848536+0000","last_active":"2024-09-18T01:29:00.848509+0000","last_peered":"2024-09-18T01:29:00.848509+0000","last_clean":"2024-09-18T01:29:00.848509+0000","last_became_active":"2024-09-18T01:25:06.703622+0000","last_became_peered":"2024-09-18T01:25:06.703622+0000","last_unstale":"2024-09-18T01:29:00.848509+0000","last_undegraded":"2024-09-18T01:29:00.848509+0000","last_fullsized":"2024-09-18T01:29:00.848509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:00.848412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:00.848412+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.848412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:47:06.895449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.252665+0000","last_change":"2024-09-18T01:28:59.252691+0000","last_active":"2024-09-18T01:28:59.252665+0000","last_peered":"2024-09-18T01:28:59.252665+0000","last_clean":"2024-09-18T01:28:59.252665+0000","last_became_active":"2024-09-18T01:25:08.682143+0000","last_became_peered":"2024-09-18T01:25:08.682143+0000","last_unstale":"2024-09-18T01:28:59.252665+0000","last_undegraded":"2024-09-18T01:28:59.252665+0000","last_fullsized":"2024-09-18T01:28:59.252665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:59.252539+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:59.252539+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.252539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:19.613187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.409050+0000","last_change":"2024-09-18T01:29:02.409092+0000","last_active":"2024-09-18T01:29:02.409050+0000","last_peered":"2024-09-18T01:29:02.409050+0000","last_clean":"2024-09-18T01:29:02.409050+0000","last_became_active":"2024-09-18T01:25:06.687436+0000","last_became_peered":"2024-09-18T01:25:06.687436+0000","last_unstale":"2024-09-18T01:29:02.409050+0000","last_undegraded":"2024-09-18T01:29:02.409050+0000","last_fullsized":"2024-09-18T01:29:02.409050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:02.408948+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:02.408948+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.408948+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:27.550849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'14","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.296638+0000","last_change":"2024-09-18T01:29:00.296663+0000","last_active":"2024-09-18T01:29:00.296638+0000","last_peered":"2024-09-18T01:29:00.296638+0000","last_clean":"2024-09-18T01:29:00.296638+0000","last_became_active":"2024-09-18T01:25:08.675801+0000","last_became_peered":"2024-09-18T01:25:08.675801+0000","last_unstale":"2024-09-18T01:29:00.296638+0000","last_undegraded":"2024-09-18T01:29:00.296638+0000","last_fullsized":"2024-09-18T01:29:00.296638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-18T01:29:00.296517+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-18T01:29:00.296517+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.296517+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:42:52.269835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797295+0000","last_change":"2024-09-18T01:25:06.693564+0000","last_active":"2024-09-18T01:27:19.797295+0000","last_peered":"2024-09-18T01:27:19.797295+0000","last_clean":"2024-09-18T01:27:19.797295+0000","last_became_active":"2024-09-18T01:25:06.691345+0000","last_became_peered":"2024-09-18T01:25:06.691345+0000","last_unstale":"2024-09-18T01:27:19.797295+0000","last_undegraded":"2024-09-18T01:27:19.797295+0000","last_fullsized":"2024-09-18T01:27:19.797295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'16","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.037028+0000","last_change":"2024-09-18T01:28:48.037058+0000","last_active":"2024-09-18T01:28:48.037028+0000","last_peered":"2024-09-18T01:28:48.037028+0000","last_clean":"2024-09-18T01:28:48.037028+0000","last_became_active":"2024-09-18T01:25:08.685358+0000","last_became_peered":"2024-09-18T01:25:08.685358+0000","last_unstale":"2024-09-18T01:28:48.037028+0000","last_undegraded":"2024-09-18T01:28:48.037028+0000","last_fullsized":"2024-09-18T01:28:48.037028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-18T01:28:48.036938+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-18T01:28:48.036938+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.036938+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:05:58.460295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.429216+0000","last_change":"2024-09-18T01:29:00.429241+0000","last_active":"2024-09-18T01:29:00.429216+0000","last_peered":"2024-09-18T01:29:00.429216+0000","last_clean":"2024-09-18T01:29:00.429216+0000","last_became_active":"2024-09-18T01:25:06.695735+0000","last_became_peered":"2024-09-18T01:25:06.695735+0000","last_unstale":"2024-09-18T01:29:00.429216+0000","last_undegraded":"2024-09-18T01:29:00.429216+0000","last_fullsized":"2024-09-18T01:29:00.429216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:00.429123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:00.429123+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.429123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:01:39.782859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:22.797682+0000","last_change":"2024-09-18T01:25:43.852539+0000","last_active":"2024-09-18T01:27:22.797682+0000","last_peered":"2024-09-18T01:27:22.797682+0000","last_clean":"2024-09-18T01:27:22.797682+0000","last_became_active":"2024-09-18T01:25:43.849600+0000","last_became_peered":"2024-09-18T01:25:43.849600+0000","last_unstale":"2024-09-18T01:27:22.797682+0000","last_undegraded":"2024-09-18T01:27:22.797682+0000","last_fullsized":"2024-09-18T01:27:22.797682+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.302664+0000","last_change":"2024-09-18T01:29:02.302718+0000","last_active":"2024-09-18T01:29:02.302664+0000","last_peered":"2024-09-18T01:29:02.302664+0000","last_clean":"2024-09-18T01:29:02.302664+0000","last_became_active":"2024-09-18T01:25:06.688967+0000","last_became_peered":"2024-09-18T01:25:06.688967+0000","last_unstale":"2024-09-18T01:29:02.302664+0000","last_undegraded":"2024-09-18T01:29:02.302664+0000","last_fullsized":"2024-09-18T01:29:02.302664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:02.302563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:02.302563+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.302563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:50.858341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'10","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.183138+0000","last_change":"2024-09-18T01:25:08.684071+0000","last_active":"2024-09-18T01:28:17.183138+0000","last_peered":"2024-09-18T01:28:17.183138+0000","last_clean":"2024-09-18T01:28:17.183138+0000","last_became_active":"2024-09-18T01:25:08.683590+0000","last_became_peered":"2024-09-18T01:25:08.683590+0000","last_unstale":"2024-09-18T01:28:17.183138+0000","last_undegraded":"2024-09-18T01:28:17.183138+0000","last_fullsized":"2024-09-18T01:28:17.183138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'6","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.855472+0000","last_change":"2024-09-18T01:25:06.686285+0000","last_active":"2024-09-18T01:28:23.855472+0000","last_peered":"2024-09-18T01:28:23.855472+0000","last_clean":"2024-09-18T01:28:23.855472+0000","last_became_active":"2024-09-18T01:25:06.685814+0000","last_became_peered":"2024-09-18T01:25:06.685814+0000","last_unstale":"2024-09-18T01:28:23.855472+0000","last_undegraded":"2024-09-18T01:28:23.855472+0000","last_fullsized":"2024-09-18T01:28:23.855472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.208969+0000","last_change":"2024-09-18T01:28:53.209000+0000","last_active":"2024-09-18T01:28:53.208969+0000","last_peered":"2024-09-18T01:28:53.208969+0000","last_clean":"2024-09-18T01:28:53.208969+0000","last_became_active":"2024-09-18T01:25:08.686703+0000","last_became_peered":"2024-09-18T01:25:08.686703+0000","last_unstale":"2024-09-18T01:28:53.208969+0000","last_undegraded":"2024-09-18T01:28:53.208969+0000","last_fullsized":"2024-09-18T01:28:53.208969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:53.208858+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:53.208858+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.208858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:49.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798253+0000","last_change":"2024-09-18T01:25:06.691078+0000","last_active":"2024-09-18T01:27:24.798253+0000","last_peered":"2024-09-18T01:27:24.798253+0000","last_clean":"2024-09-18T01:27:24.798253+0000","last_became_active":"2024-09-18T01:25:06.685120+0000","last_became_peered":"2024-09-18T01:25:06.685120+0000","last_unstale":"2024-09-18T01:27:24.798253+0000","last_undegraded":"2024-09-18T01:27:24.798253+0000","last_fullsized":"2024-09-18T01:27:24.798253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'7","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.231212+0000","last_change":"2024-09-18T01:25:08.685436+0000","last_active":"2024-09-18T01:28:17.231212+0000","last_peered":"2024-09-18T01:28:17.231212+0000","last_clean":"2024-09-18T01:28:17.231212+0000","last_became_active":"2024-09-18T01:25:08.685158+0000","last_became_peered":"2024-09-18T01:25:08.685158+0000","last_unstale":"2024-09-18T01:28:17.231212+0000","last_undegraded":"2024-09-18T01:28:17.231212+0000","last_fullsized":"2024-09-18T01:28:17.231212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798291+0000","last_change":"2024-09-18T01:25:06.687424+0000","last_active":"2024-09-18T01:27:24.798291+0000","last_peered":"2024-09-18T01:27:24.798291+0000","last_clean":"2024-09-18T01:27:24.798291+0000","last_became_active":"2024-09-18T01:25:06.684845+0000","last_became_peered":"2024-09-18T01:25:06.684845+0000","last_unstale":"2024-09-18T01:27:24.798291+0000","last_undegraded":"2024-09-18T01:27:24.798291+0000","last_fullsized":"2024-09-18T01:27:24.798291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.994067+0000","last_change":"2024-09-18T01:28:44.994102+0000","last_active":"2024-09-18T01:28:44.994067+0000","last_peered":"2024-09-18T01:28:44.994067+0000","last_clean":"2024-09-18T01:28:44.994067+0000","last_became_active":"2024-09-18T01:25:08.687840+0000","last_became_peered":"2024-09-18T01:25:08.687840+0000","last_unstale":"2024-09-18T01:28:44.994067+0000","last_undegraded":"2024-09-18T01:28:44.994067+0000","last_fullsized":"2024-09-18T01:28:44.994067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:44.993971+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:44.993971+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.993971+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:14.403429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.816140+0000","last_change":"2024-09-18T01:28:58.816170+0000","last_active":"2024-09-18T01:28:58.816140+0000","last_peered":"2024-09-18T01:28:58.816140+0000","last_clean":"2024-09-18T01:28:58.816140+0000","last_became_active":"2024-09-18T01:25:06.704247+0000","last_became_peered":"2024-09-18T01:25:06.704247+0000","last_unstale":"2024-09-18T01:28:58.816140+0000","last_undegraded":"2024-09-18T01:28:58.816140+0000","last_fullsized":"2024-09-18T01:28:58.816140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:58.816043+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:58.816043+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.816043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:36.858075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'12","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.206306+0000","last_change":"2024-09-18T01:28:58.206349+0000","last_active":"2024-09-18T01:28:58.206306+0000","last_peered":"2024-09-18T01:28:58.206306+0000","last_clean":"2024-09-18T01:28:58.206306+0000","last_became_active":"2024-09-18T01:25:08.680916+0000","last_became_peered":"2024-09-18T01:25:08.680916+0000","last_unstale":"2024-09-18T01:28:58.206306+0000","last_undegraded":"2024-09-18T01:28:58.206306+0000","last_fullsized":"2024-09-18T01:28:58.206306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-18T01:28:58.206180+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-18T01:28:58.206180+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.206180+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:27.429284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799255+0000","last_change":"2024-09-18T01:25:06.694171+0000","last_active":"2024-09-18T01:27:29.799255+0000","last_peered":"2024-09-18T01:27:29.799255+0000","last_clean":"2024-09-18T01:27:29.799255+0000","last_became_active":"2024-09-18T01:25:06.693000+0000","last_became_peered":"2024-09-18T01:25:06.693000+0000","last_unstale":"2024-09-18T01:27:29.799255+0000","last_undegraded":"2024-09-18T01:27:29.799255+0000","last_fullsized":"2024-09-18T01:27:29.799255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.798940+0000","last_change":"2024-09-18T01:25:06.694282+0000","last_active":"2024-09-18T01:27:29.798940+0000","last_peered":"2024-09-18T01:27:29.798940+0000","last_clean":"2024-09-18T01:27:29.798940+0000","last_became_active":"2024-09-18T01:25:06.691141+0000","last_became_peered":"2024-09-18T01:25:06.691141+0000","last_unstale":"2024-09-18T01:27:29.798940+0000","last_undegraded":"2024-09-18T01:27:29.798940+0000","last_fullsized":"2024-09-18T01:27:29.798940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'12","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.447712+0000","last_change":"2024-09-18T01:28:54.447736+0000","last_active":"2024-09-18T01:28:54.447712+0000","last_peered":"2024-09-18T01:28:54.447712+0000","last_clean":"2024-09-18T01:28:54.447712+0000","last_became_active":"2024-09-18T01:25:08.681053+0000","last_became_peered":"2024-09-18T01:25:08.681053+0000","last_unstale":"2024-09-18T01:28:54.447712+0000","last_undegraded":"2024-09-18T01:28:54.447712+0000","last_fullsized":"2024-09-18T01:28:54.447712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-18T01:28:54.447595+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-18T01:28:54.447595+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.447595+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:28.469233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.509241+0000","last_change":"2024-09-18T01:28:58.509277+0000","last_active":"2024-09-18T01:28:58.509241+0000","last_peered":"2024-09-18T01:28:58.509241+0000","last_clean":"2024-09-18T01:28:58.509241+0000","last_became_active":"2024-09-18T01:25:06.695875+0000","last_became_peered":"2024-09-18T01:25:06.695875+0000","last_unstale":"2024-09-18T01:28:58.509241+0000","last_undegraded":"2024-09-18T01:28:58.509241+0000","last_fullsized":"2024-09-18T01:28:58.509241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:58.509138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:58.509138+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.509138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:11.477929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.288654+0000","last_change":"2024-09-18T01:28:46.288688+0000","last_active":"2024-09-18T01:28:46.288654+0000","last_peered":"2024-09-18T01:28:46.288654+0000","last_clean":"2024-09-18T01:28:46.288654+0000","last_became_active":"2024-09-18T01:25:08.687583+0000","last_became_peered":"2024-09-18T01:25:08.687583+0000","last_unstale":"2024-09-18T01:28:46.288654+0000","last_undegraded":"2024-09-18T01:28:46.288654+0000","last_fullsized":"2024-09-18T01:28:46.288654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:46.288559+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:46.288559+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.288559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:46:19.008800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1751,"ondisk_log_size":1751,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":479,"ondisk_log_size":479,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673015,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":487424,"data_stored":155040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673015,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":744524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673016,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36364,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335476,"statfs":{"total":96636764160,"available":96599527424,"internally_reserved":0,"allocated":1044480,"data_stored":744891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":154885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:29:08.962 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.962 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.963 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.963 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.963 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.963 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.963 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.963 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.963 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.964 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.964 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.964 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.964 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.964 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.964 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.964 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.964 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.965 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.965 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.965 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.965 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.965 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.965 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.965 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.965 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.965 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.966 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.966 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.966 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.966 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.966 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.966 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.966 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.966 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.967 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.967 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.967 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.967 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.967 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.967 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.967 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.967 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.968 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.968 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.968 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.968 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T01:24:51.161687+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=51, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.968 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.968 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.968 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.968 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.969 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.969 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.969 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.969 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.969 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.969 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.969 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.969 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.969 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.970 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.970 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.970 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.970 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.970 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.970 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.970 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.971 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.971 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.971 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.971 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.971 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.971 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.971 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.971 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.972 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.972 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.972 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.972 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.972 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.972 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.972 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.972 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-18T01:25:09.660485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.973 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.973 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.973 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.973 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.973 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.973 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.973 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.974 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.974 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.974 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.974 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.974 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-18T01:25:13.676001+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.974 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.974 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.974 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.975 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.975 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.975 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.975 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.975 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.975 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.975 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.976 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.976 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.976 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.976 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.976 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.976 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.976 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:08.976 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T01:29:28.978 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:29:29.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.086+0000 7fd7b2d5f640 1 Processor -- start 2024-09-18T01:29:29.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.086+0000 7fd7b2d5f640 1 -- start start 2024-09-18T01:29:29.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.087+0000 7fd7b2d5f640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd7ac09bd50 0x7fd7ac09c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:29:29.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.087+0000 7fd7b2d5f640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7ac09d3b0 con 0x7fd7ac09c670 2024-09-18T01:29:29.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.087+0000 7fd7b2d5f640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fd7ac098230 con 0x7fd7ac09bd50 2024-09-18T01:29:29.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.087+0000 7fd7b0afb640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd7ac09bd50 0x7fd7ac09c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:29:29.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.087+0000 7fd7abfff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fd7ac09c670 0x7fd7ac0990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:44488/0 (socket says 172.21.15.92:44488) 2024-09-18T01:29:29.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.087+0000 7fd7abfff640 1 -- 172.21.15.92:0/568454198 learned_addr learned my addr 172.21.15.92:0/568454198 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:29:29.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.087+0000 7fd7b0afb640 1 -- 172.21.15.92:0/568454198 >> v1:172.21.15.92:6789/0 conn(0x7fd7ac09c670 legacy=0x7fd7ac0990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:29:29.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.087+0000 7fd7b0afb640 1 -- 172.21.15.92:0/568454198 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ac0983e0 con 0x7fd7ac09bd50 2024-09-18T01:29:29.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.088+0000 7fd7b0afb640 1 --2- 172.21.15.92:0/568454198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7ac09bd50 0x7fd7ac09c130 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009720 tx=0x7fd7a002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd6117f8ad7aa63 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:29:29.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.088+0000 7fd7ab7fe640 1 -- 172.21.15.92:0/568454198 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7a0037070 con 0x7fd7ac09bd50 2024-09-18T01:29:29.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.088+0000 7fd7ab7fe640 1 -- 172.21.15.92:0/568454198 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a002ad90 con 0x7fd7ac09bd50 2024-09-18T01:29:29.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.088+0000 7fd7ab7fe640 1 -- 172.21.15.92:0/568454198 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7a0032590 con 0x7fd7ac09bd50 2024-09-18T01:29:29.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.089+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/568454198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7ac09bd50 msgr2=0x7fd7ac09c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:29:29.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.089+0000 7fd7b2d5f640 1 --2- 172.21.15.92:0/568454198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7ac09bd50 0x7fd7ac09c130 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009720 tx=0x7fd7a002a110 comp rx=0 tx=0).stop 2024-09-18T01:29:29.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.089+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/568454198 shutdown_connections 2024-09-18T01:29:29.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.089+0000 7fd7b2d5f640 1 --2- 172.21.15.92:0/568454198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7ac09bd50 0x7fd7ac09c130 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:29:29.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.089+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/568454198 >> 172.21.15.92:0/568454198 conn(0x7fd7ac06d4a0 msgr2=0x7fd7ac06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:29:29.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.089+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/568454198 shutdown_connections 2024-09-18T01:29:29.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.089+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/568454198 wait complete. 2024-09-18T01:29:29.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.089+0000 7fd7b2d5f640 1 Processor -- start 2024-09-18T01:29:29.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.089+0000 7fd7b2d5f640 1 -- start start 2024-09-18T01:29:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.090+0000 7fd7b2d5f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7ac09bd50 0x7fd7ac093570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:29:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.090+0000 7fd7b2d5f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac099b90 con 0x7fd7ac09bd50 2024-09-18T01:29:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.090+0000 7fd7b0afb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7ac09bd50 0x7fd7ac093570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:29:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.090+0000 7fd7b0afb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7ac09bd50 0x7fd7ac093570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49076/0 (socket says 172.21.15.92:49076) 2024-09-18T01:29:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.090+0000 7fd7b0afb640 1 -- 172.21.15.92:0/1406349687 learned_addr learned my addr 172.21.15.92:0/1406349687 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:29:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.090+0000 7fd7b0afb640 1 -- 172.21.15.92:0/1406349687 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ac094eb0 con 0x7fd7ac09bd50 2024-09-18T01:29:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.090+0000 7fd7b0afb640 1 --2- 172.21.15.92:0/1406349687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7ac09bd50 0x7fd7ac093570 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009840 tx=0x7fd7a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:29:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.091+0000 7fd7a97fa640 1 -- 172.21.15.92:0/1406349687 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7a0041070 con 0x7fd7ac09bd50 2024-09-18T01:29:29.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.091+0000 7fd7a97fa640 1 -- 172.21.15.92:0/1406349687 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a003c460 con 0x7fd7ac09bd50 2024-09-18T01:29:29.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.091+0000 7fd7a97fa640 1 -- 172.21.15.92:0/1406349687 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7a0037040 con 0x7fd7ac09bd50 2024-09-18T01:29:29.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.091+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/1406349687 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ac095590 con 0x7fd7ac09bd50 2024-09-18T01:29:29.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.091+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/1406349687 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ac0961c0 con 0x7fd7ac09bd50 2024-09-18T01:29:29.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.091+0000 7fd7a97fa640 1 -- 172.21.15.92:0/1406349687 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd7a0044070 con 0x7fd7ac09bd50 2024-09-18T01:29:29.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.092+0000 7fd7a97fa640 1 --2- 172.21.15.92:0/1406349687 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd7900382a0 0x7fd79003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:29:29.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.092+0000 7fd7a97fa640 1 -- 172.21.15.92:0/1406349687 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd7a006c790 con 0x7fd7ac09bd50 2024-09-18T01:29:29.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.092+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/1406349687 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7ac09a130 con 0x7fd7ac09bd50 2024-09-18T01:29:29.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.092+0000 7fd7abfff640 1 --2- 172.21.15.92:0/1406349687 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd7900382a0 0x7fd79003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:29:29.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.092+0000 7fd7abfff640 1 --2- 172.21.15.92:0/1406349687 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd7900382a0 0x7fd79003a760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd798007fd0 tx=0x7fd798007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:29:29.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.097+0000 7fd7a97fa640 1 -- 172.21.15.92:0/1406349687 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7ac0961c0 con 0x7fd7ac09bd50 2024-09-18T01:29:29.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.259+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/1406349687 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd7ac09d020 con 0x7fd7900382a0 2024-09-18T01:29:29.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.275+0000 7fd7a97fa640 1 -- 172.21.15.92:0/1406349687 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665201 (secure 0 0 0) 0x7fd7ac09d020 con 0x7fd7900382a0 2024-09-18T01:29:29.283 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:29:29.288 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-18T01:29:29.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.279+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/1406349687 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd7900382a0 msgr2=0x7fd79003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:29:29.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.279+0000 7fd7b2d5f640 1 --2- 172.21.15.92:0/1406349687 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd7900382a0 0x7fd79003a760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd798007fd0 tx=0x7fd798007ac0 comp rx=0 tx=0).stop 2024-09-18T01:29:29.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.279+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/1406349687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7ac09bd50 msgr2=0x7fd7ac093570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:29:29.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.279+0000 7fd7b2d5f640 1 --2- 172.21.15.92:0/1406349687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7ac09bd50 0x7fd7ac093570 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009840 tx=0x7fd7a00046c0 comp rx=0 tx=0).stop 2024-09-18T01:29:29.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.280+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/1406349687 shutdown_connections 2024-09-18T01:29:29.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.280+0000 7fd7b2d5f640 1 --2- 172.21.15.92:0/1406349687 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7fd7900382a0 0x7fd79003a760 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:29:29.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.280+0000 7fd7b2d5f640 1 --2- 172.21.15.92:0/1406349687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7ac09bd50 0x7fd7ac093570 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:29:29.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.280+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/1406349687 >> 172.21.15.92:0/1406349687 conn(0x7fd7ac06d4a0 msgr2=0x7fd7ac09eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:29:29.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.280+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/1406349687 shutdown_connections 2024-09-18T01:29:29.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:29.280+0000 7fd7b2d5f640 1 -- 172.21.15.92:0/1406349687 wait complete. 2024-09-18T01:29:29.292 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-18T01:29:28.847618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5383,"num_read_kb":4932,"num_write":2371,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":993,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2872,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5014,"ondisk_log_size":5014,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156800,"kb_used_data":2944,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330560,"statfs":{"total":386547056640,"available":386386493440,"internally_reserved":0,"allocated":3014656,"data_stored":1799340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003944"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:11.909701+0000","last_change":"2024-09-18T01:29:11.909701+0000","last_active":"2024-09-18T01:29:11.909701+0000","last_peered":"2024-09-18T01:29:11.909701+0000","last_clean":"2024-09-18T01:29:11.909701+0000","last_became_active":"2024-09-18T01:25:06.691940+0000","last_became_peered":"2024-09-18T01:25:06.691940+0000","last_unstale":"2024-09-18T01:29:11.909701+0000","last_undegraded":"2024-09-18T01:29:11.909701+0000","last_fullsized":"2024-09-18T01:29:11.909701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:11.909580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:11.909580+0000","last_clean_scrub_stamp":"2024-09-18T01:29:11.909580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:37.051480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'14","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.261128+0000","last_change":"2024-09-18T01:29:03.261180+0000","last_active":"2024-09-18T01:29:03.261128+0000","last_peered":"2024-09-18T01:29:03.261128+0000","last_clean":"2024-09-18T01:29:03.261128+0000","last_became_active":"2024-09-18T01:25:08.683538+0000","last_became_peered":"2024-09-18T01:25:08.683538+0000","last_unstale":"2024-09-18T01:29:03.261128+0000","last_undegraded":"2024-09-18T01:29:03.261128+0000","last_fullsized":"2024-09-18T01:29:03.261128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-18T01:29:03.261027+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-18T01:29:03.261027+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.261027+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:47.678527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:06.500013+0000","last_change":"2024-09-18T01:29:06.500013+0000","last_active":"2024-09-18T01:29:06.500013+0000","last_peered":"2024-09-18T01:29:06.500013+0000","last_clean":"2024-09-18T01:29:06.500013+0000","last_became_active":"2024-09-18T01:25:06.686950+0000","last_became_peered":"2024-09-18T01:25:06.686950+0000","last_unstale":"2024-09-18T01:29:06.500013+0000","last_undegraded":"2024-09-18T01:29:06.500013+0000","last_fullsized":"2024-09-18T01:29:06.500013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:06.499890+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:06.499890+0000","last_clean_scrub_stamp":"2024-09-18T01:29:06.499890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:52:59.744454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'20","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:10.052337+0000","last_change":"2024-09-18T01:29:10.052360+0000","last_active":"2024-09-18T01:29:10.052337+0000","last_peered":"2024-09-18T01:29:10.052337+0000","last_clean":"2024-09-18T01:29:10.052337+0000","last_became_active":"2024-09-18T01:25:08.673552+0000","last_became_peered":"2024-09-18T01:25:08.673552+0000","last_unstale":"2024-09-18T01:29:10.052337+0000","last_undegraded":"2024-09-18T01:29:10.052337+0000","last_fullsized":"2024-09-18T01:29:10.052337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:29:10.052252+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:29:10.052252+0000","last_clean_scrub_stamp":"2024-09-18T01:29:10.052252+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:56.273557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:23.963482+0000","last_change":"2024-09-18T01:29:23.963521+0000","last_active":"2024-09-18T01:29:23.963482+0000","last_peered":"2024-09-18T01:29:23.963482+0000","last_clean":"2024-09-18T01:29:23.963482+0000","last_became_active":"2024-09-18T01:25:06.687068+0000","last_became_peered":"2024-09-18T01:25:06.687068+0000","last_unstale":"2024-09-18T01:29:23.963482+0000","last_undegraded":"2024-09-18T01:29:23.963482+0000","last_fullsized":"2024-09-18T01:29:23.963482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:23.963371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:23.963371+0000","last_clean_scrub_stamp":"2024-09-18T01:29:23.963371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:04.048367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'10","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.112529+0000","last_change":"2024-09-18T01:29:01.112565+0000","last_active":"2024-09-18T01:29:01.112529+0000","last_peered":"2024-09-18T01:29:01.112529+0000","last_clean":"2024-09-18T01:29:01.112529+0000","last_became_active":"2024-09-18T01:25:08.685074+0000","last_became_peered":"2024-09-18T01:25:08.685074+0000","last_unstale":"2024-09-18T01:29:01.112529+0000","last_undegraded":"2024-09-18T01:29:01.112529+0000","last_fullsized":"2024-09-18T01:29:01.112529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-18T01:29:01.112427+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-18T01:29:01.112427+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.112427+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:56:10.526652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:08.841231+0000","last_change":"2024-09-18T01:29:08.841231+0000","last_active":"2024-09-18T01:29:08.841231+0000","last_peered":"2024-09-18T01:29:08.841231+0000","last_clean":"2024-09-18T01:29:08.841231+0000","last_became_active":"2024-09-18T01:25:06.690552+0000","last_became_peered":"2024-09-18T01:25:06.690552+0000","last_unstale":"2024-09-18T01:29:08.841231+0000","last_undegraded":"2024-09-18T01:29:08.841231+0000","last_fullsized":"2024-09-18T01:29:08.841231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:08.841069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:08.841069+0000","last_clean_scrub_stamp":"2024-09-18T01:29:08.841069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:57.396847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'8","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:09.074903+0000","last_change":"2024-09-18T01:29:09.074932+0000","last_active":"2024-09-18T01:29:09.074903+0000","last_peered":"2024-09-18T01:29:09.074903+0000","last_clean":"2024-09-18T01:29:09.074903+0000","last_became_active":"2024-09-18T01:25:08.674210+0000","last_became_peered":"2024-09-18T01:25:08.674210+0000","last_unstale":"2024-09-18T01:29:09.074903+0000","last_undegraded":"2024-09-18T01:29:09.074903+0000","last_fullsized":"2024-09-18T01:29:09.074903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:09.074810+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:09.074810+0000","last_clean_scrub_stamp":"2024-09-18T01:29:09.074810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:07:50.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.963269+0000","last_change":"2024-09-18T01:29:22.963305+0000","last_active":"2024-09-18T01:29:22.963269+0000","last_peered":"2024-09-18T01:29:22.963269+0000","last_clean":"2024-09-18T01:29:22.963269+0000","last_became_active":"2024-09-18T01:25:06.687608+0000","last_became_peered":"2024-09-18T01:25:06.687608+0000","last_unstale":"2024-09-18T01:29:22.963269+0000","last_undegraded":"2024-09-18T01:29:22.963269+0000","last_fullsized":"2024-09-18T01:29:22.963269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:22.963164+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:22.963164+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.963164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:38:37.098811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:07.382340+0000","last_change":"2024-09-18T01:29:07.382340+0000","last_active":"2024-09-18T01:29:07.382340+0000","last_peered":"2024-09-18T01:29:07.382340+0000","last_clean":"2024-09-18T01:29:07.382340+0000","last_became_active":"2024-09-18T01:25:08.683812+0000","last_became_peered":"2024-09-18T01:25:08.683812+0000","last_unstale":"2024-09-18T01:29:07.382340+0000","last_undegraded":"2024-09-18T01:29:07.382340+0000","last_fullsized":"2024-09-18T01:29:07.382340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:07.382155+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:07.382155+0000","last_clean_scrub_stamp":"2024-09-18T01:29:07.382155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:11:57.693419+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'6","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:06.799683+0000","last_change":"2024-09-18T01:29:06.799712+0000","last_active":"2024-09-18T01:29:06.799683+0000","last_peered":"2024-09-18T01:29:06.799683+0000","last_clean":"2024-09-18T01:29:06.799683+0000","last_became_active":"2024-09-18T01:25:06.702616+0000","last_became_peered":"2024-09-18T01:25:06.702616+0000","last_unstale":"2024-09-18T01:29:06.799683+0000","last_undegraded":"2024-09-18T01:29:06.799683+0000","last_fullsized":"2024-09-18T01:29:06.799683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:06.799588+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:06.799588+0000","last_clean_scrub_stamp":"2024-09-18T01:29:06.799588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:10:06.055871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'8","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:20.807122+0000","last_change":"2024-09-18T01:29:20.807158+0000","last_active":"2024-09-18T01:29:20.807122+0000","last_peered":"2024-09-18T01:29:20.807122+0000","last_clean":"2024-09-18T01:29:20.807122+0000","last_became_active":"2024-09-18T01:25:43.904427+0000","last_became_peered":"2024-09-18T01:25:43.904427+0000","last_unstale":"2024-09-18T01:29:20.807122+0000","last_undegraded":"2024-09-18T01:29:20.807122+0000","last_fullsized":"2024-09-18T01:29:20.807122+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:20.807032+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:20.807032+0000","last_clean_scrub_stamp":"2024-09-18T01:29:20.807032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:57.777645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800683+0000","last_change":"2024-09-18T01:25:06.683548+0000","last_active":"2024-09-18T01:27:39.800683+0000","last_peered":"2024-09-18T01:27:39.800683+0000","last_clean":"2024-09-18T01:27:39.800683+0000","last_became_active":"2024-09-18T01:25:06.683195+0000","last_became_peered":"2024-09-18T01:25:06.683195+0000","last_unstale":"2024-09-18T01:27:39.800683+0000","last_undegraded":"2024-09-18T01:27:39.800683+0000","last_fullsized":"2024-09-18T01:27:39.800683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.828610+0000","last_change":"2024-09-18T01:28:50.828610+0000","last_active":"2024-09-18T01:28:50.828610+0000","last_peered":"2024-09-18T01:28:50.828610+0000","last_clean":"2024-09-18T01:28:50.828610+0000","last_became_active":"2024-09-18T01:25:08.677579+0000","last_became_peered":"2024-09-18T01:25:08.677579+0000","last_unstale":"2024-09-18T01:28:50.828610+0000","last_undegraded":"2024-09-18T01:28:50.828610+0000","last_fullsized":"2024-09-18T01:28:50.828610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:50.828488+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:50.828488+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.828488+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:52.949299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:10.514401+0000","last_change":"2024-09-18T01:29:10.514429+0000","last_active":"2024-09-18T01:29:10.514401+0000","last_peered":"2024-09-18T01:29:10.514401+0000","last_clean":"2024-09-18T01:29:10.514401+0000","last_became_active":"2024-09-18T01:25:06.686049+0000","last_became_peered":"2024-09-18T01:25:06.686049+0000","last_unstale":"2024-09-18T01:29:10.514401+0000","last_undegraded":"2024-09-18T01:29:10.514401+0000","last_fullsized":"2024-09-18T01:29:10.514401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:10.514311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:10.514311+0000","last_clean_scrub_stamp":"2024-09-18T01:29:10.514311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:03.733247+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.902549+0000","last_change":"2024-09-18T01:29:15.902549+0000","last_active":"2024-09-18T01:29:15.902549+0000","last_peered":"2024-09-18T01:29:15.902549+0000","last_clean":"2024-09-18T01:29:15.902549+0000","last_became_active":"2024-09-18T01:25:08.676310+0000","last_became_peered":"2024-09-18T01:25:08.676310+0000","last_unstale":"2024-09-18T01:29:15.902549+0000","last_undegraded":"2024-09-18T01:29:15.902549+0000","last_fullsized":"2024-09-18T01:29:15.902549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:15.902400+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:15.902400+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.902400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:53:09.146964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'24","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:14.063470+0000","last_change":"2024-09-18T01:29:14.063497+0000","last_active":"2024-09-18T01:29:14.063470+0000","last_peered":"2024-09-18T01:29:14.063470+0000","last_clean":"2024-09-18T01:29:14.063470+0000","last_became_active":"2024-09-18T01:25:08.671858+0000","last_became_peered":"2024-09-18T01:25:08.671858+0000","last_unstale":"2024-09-18T01:29:14.063470+0000","last_undegraded":"2024-09-18T01:29:14.063470+0000","last_fullsized":"2024-09-18T01:29:14.063470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-09-18T01:29:14.063380+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-09-18T01:29:14.063380+0000","last_clean_scrub_stamp":"2024-09-18T01:29:14.063380+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:10.994209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":55,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:06.335499+0000","last_change":"2024-09-18T01:29:06.335526+0000","last_active":"2024-09-18T01:29:06.335499+0000","last_peered":"2024-09-18T01:29:06.335499+0000","last_clean":"2024-09-18T01:29:06.335499+0000","last_became_active":"2024-09-18T01:25:06.691034+0000","last_became_peered":"2024-09-18T01:25:06.691034+0000","last_unstale":"2024-09-18T01:29:06.335499+0000","last_undegraded":"2024-09-18T01:29:06.335499+0000","last_fullsized":"2024-09-18T01:29:06.335499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:06.335392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:06.335392+0000","last_clean_scrub_stamp":"2024-09-18T01:29:06.335392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:25:11.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:09.339591+0000","last_change":"2024-09-18T01:29:09.339656+0000","last_active":"2024-09-18T01:29:09.339591+0000","last_peered":"2024-09-18T01:29:09.339591+0000","last_clean":"2024-09-18T01:29:09.339591+0000","last_became_active":"2024-09-18T01:25:08.685043+0000","last_became_peered":"2024-09-18T01:25:08.685043+0000","last_unstale":"2024-09-18T01:29:09.339591+0000","last_undegraded":"2024-09-18T01:29:09.339591+0000","last_fullsized":"2024-09-18T01:29:09.339591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:09.339488+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:09.339488+0000","last_clean_scrub_stamp":"2024-09-18T01:29:09.339488+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:53:02.584051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.864615+0000","last_change":"2024-09-18T01:28:56.864648+0000","last_active":"2024-09-18T01:28:56.864615+0000","last_peered":"2024-09-18T01:28:56.864615+0000","last_clean":"2024-09-18T01:28:56.864615+0000","last_became_active":"2024-09-18T01:25:06.704414+0000","last_became_peered":"2024-09-18T01:25:06.704414+0000","last_unstale":"2024-09-18T01:28:56.864615+0000","last_undegraded":"2024-09-18T01:28:56.864615+0000","last_fullsized":"2024-09-18T01:28:56.864615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:56.864507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:56.864507+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.864507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:33.916587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:21.352124+0000","last_change":"2024-09-18T01:29:21.352155+0000","last_active":"2024-09-18T01:29:21.352124+0000","last_peered":"2024-09-18T01:29:21.352124+0000","last_clean":"2024-09-18T01:29:21.352124+0000","last_became_active":"2024-09-18T01:25:08.684921+0000","last_became_peered":"2024-09-18T01:25:08.684921+0000","last_unstale":"2024-09-18T01:29:21.352124+0000","last_undegraded":"2024-09-18T01:29:21.352124+0000","last_fullsized":"2024-09-18T01:29:21.352124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-18T01:29:21.352023+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-18T01:29:21.352023+0000","last_clean_scrub_stamp":"2024-09-18T01:29:21.352023+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:52:46.841207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'3","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:19.323198+0000","last_change":"2024-09-18T01:29:19.323237+0000","last_active":"2024-09-18T01:29:19.323198+0000","last_peered":"2024-09-18T01:29:19.323198+0000","last_clean":"2024-09-18T01:29:19.323198+0000","last_became_active":"2024-09-18T01:25:06.687737+0000","last_became_peered":"2024-09-18T01:25:06.687737+0000","last_unstale":"2024-09-18T01:29:19.323198+0000","last_undegraded":"2024-09-18T01:29:19.323198+0000","last_fullsized":"2024-09-18T01:29:19.323198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:29:19.323097+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:29:19.323097+0000","last_clean_scrub_stamp":"2024-09-18T01:29:19.323097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:46:52.157016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'16","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.461976+0000","last_change":"2024-09-18T01:28:57.462002+0000","last_active":"2024-09-18T01:28:57.461976+0000","last_peered":"2024-09-18T01:28:57.461976+0000","last_clean":"2024-09-18T01:28:57.461976+0000","last_became_active":"2024-09-18T01:25:08.671338+0000","last_became_peered":"2024-09-18T01:25:08.671338+0000","last_unstale":"2024-09-18T01:28:57.461976+0000","last_undegraded":"2024-09-18T01:28:57.461976+0000","last_fullsized":"2024-09-18T01:28:57.461976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-18T01:28:57.461821+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-18T01:28:57.461821+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.461821+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:42:49.435139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:12.322211+0000","last_change":"2024-09-18T01:29:12.322252+0000","last_active":"2024-09-18T01:29:12.322211+0000","last_peered":"2024-09-18T01:29:12.322211+0000","last_clean":"2024-09-18T01:29:12.322211+0000","last_became_active":"2024-09-18T01:25:06.688356+0000","last_became_peered":"2024-09-18T01:25:06.688356+0000","last_unstale":"2024-09-18T01:29:12.322211+0000","last_undegraded":"2024-09-18T01:29:12.322211+0000","last_fullsized":"2024-09-18T01:29:12.322211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:12.322091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:12.322091+0000","last_clean_scrub_stamp":"2024-09-18T01:29:12.322091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:12.845103+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.810538+0000","last_change":"2024-09-18T01:28:59.810589+0000","last_active":"2024-09-18T01:28:59.810538+0000","last_peered":"2024-09-18T01:28:59.810538+0000","last_clean":"2024-09-18T01:28:59.810538+0000","last_became_active":"2024-09-18T01:25:08.673915+0000","last_became_peered":"2024-09-18T01:25:08.673915+0000","last_unstale":"2024-09-18T01:28:59.810538+0000","last_undegraded":"2024-09-18T01:28:59.810538+0000","last_fullsized":"2024-09-18T01:28:59.810538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:59.810429+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:59.810429+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.810429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:41:53.505612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.441061+0000","last_change":"2024-09-18T01:29:04.441106+0000","last_active":"2024-09-18T01:29:04.441061+0000","last_peered":"2024-09-18T01:29:04.441061+0000","last_clean":"2024-09-18T01:29:04.441061+0000","last_became_active":"2024-09-18T01:25:06.686900+0000","last_became_peered":"2024-09-18T01:25:06.686900+0000","last_unstale":"2024-09-18T01:29:04.441061+0000","last_undegraded":"2024-09-18T01:29:04.441061+0000","last_fullsized":"2024-09-18T01:29:04.441061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:04.440953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:04.440953+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.440953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:10.843955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'6","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.177086+0000","last_change":"2024-09-18T01:28:57.177149+0000","last_active":"2024-09-18T01:28:57.177086+0000","last_peered":"2024-09-18T01:28:57.177086+0000","last_clean":"2024-09-18T01:28:57.177086+0000","last_became_active":"2024-09-18T01:25:08.682225+0000","last_became_peered":"2024-09-18T01:25:08.682225+0000","last_unstale":"2024-09-18T01:28:57.177086+0000","last_undegraded":"2024-09-18T01:28:57.177086+0000","last_fullsized":"2024-09-18T01:28:57.177086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:57.176987+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:57.176987+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.176987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:15.711498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799058+0000","last_change":"2024-09-18T01:25:06.695620+0000","last_active":"2024-09-18T01:27:29.799058+0000","last_peered":"2024-09-18T01:27:29.799058+0000","last_clean":"2024-09-18T01:27:29.799058+0000","last_became_active":"2024-09-18T01:25:06.693647+0000","last_became_peered":"2024-09-18T01:25:06.693647+0000","last_unstale":"2024-09-18T01:27:29.799058+0000","last_undegraded":"2024-09-18T01:27:29.799058+0000","last_fullsized":"2024-09-18T01:27:29.799058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'36","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:24.468568+0000","last_change":"2024-09-18T01:29:24.468601+0000","last_active":"2024-09-18T01:29:24.468568+0000","last_peered":"2024-09-18T01:29:24.468568+0000","last_clean":"2024-09-18T01:29:24.468568+0000","last_became_active":"2024-09-18T01:25:16.712438+0000","last_became_peered":"2024-09-18T01:25:16.712438+0000","last_unstale":"2024-09-18T01:29:24.468568+0000","last_undegraded":"2024-09-18T01:29:24.468568+0000","last_fullsized":"2024-09-18T01:29:24.468568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-18T01:29:24.468472+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-18T01:29:24.468472+0000","last_clean_scrub_stamp":"2024-09-18T01:29:24.468472+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:50.839508+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:12.042125+0000","last_change":"2024-09-18T01:29:12.042182+0000","last_active":"2024-09-18T01:29:12.042125+0000","last_peered":"2024-09-18T01:29:12.042125+0000","last_clean":"2024-09-18T01:29:12.042125+0000","last_became_active":"2024-09-18T01:25:08.673605+0000","last_became_peered":"2024-09-18T01:25:08.673605+0000","last_unstale":"2024-09-18T01:29:12.042125+0000","last_undegraded":"2024-09-18T01:29:12.042125+0000","last_fullsized":"2024-09-18T01:29:12.042125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-18T01:29:12.042027+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-18T01:29:12.042027+0000","last_clean_scrub_stamp":"2024-09-18T01:29:12.042027+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:46:44.157159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.006313+0000","last_change":"2024-09-18T01:29:22.006342+0000","last_active":"2024-09-18T01:29:22.006313+0000","last_peered":"2024-09-18T01:29:22.006313+0000","last_clean":"2024-09-18T01:29:22.006313+0000","last_became_active":"2024-09-18T01:25:06.685173+0000","last_became_peered":"2024-09-18T01:25:06.685173+0000","last_unstale":"2024-09-18T01:29:22.006313+0000","last_undegraded":"2024-09-18T01:29:22.006313+0000","last_fullsized":"2024-09-18T01:29:22.006313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:22.006222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:22.006222+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.006222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:40:54.716533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.112958+0000","last_change":"2024-09-18T01:28:31.112996+0000","last_active":"2024-09-18T01:28:31.112958+0000","last_peered":"2024-09-18T01:28:31.112958+0000","last_clean":"2024-09-18T01:28:31.112958+0000","last_became_active":"2024-09-18T01:25:10.684454+0000","last_became_peered":"2024-09-18T01:25:10.684454+0000","last_unstale":"2024-09-18T01:28:31.112958+0000","last_undegraded":"2024-09-18T01:28:31.112958+0000","last_fullsized":"2024-09-18T01:28:31.112958+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.112838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.112838+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.112838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:47:30.069158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'50","reported_seq":117,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.035327+0000","last_change":"2024-09-18T01:28:47.035364+0000","last_active":"2024-09-18T01:28:47.035327+0000","last_peered":"2024-09-18T01:28:47.035327+0000","last_clean":"2024-09-18T01:28:47.035327+0000","last_became_active":"2024-09-18T01:25:12.692059+0000","last_became_peered":"2024-09-18T01:25:12.692059+0000","last_unstale":"2024-09-18T01:28:47.035327+0000","last_undegraded":"2024-09-18T01:28:47.035327+0000","last_fullsized":"2024-09-18T01:28:47.035327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'50","last_scrub_stamp":"2024-09-18T01:28:47.035239+0000","last_deep_scrub":"35'50","last_deep_scrub_stamp":"2024-09-18T01:28:47.035239+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.035239+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:17:16.348705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.307401+0000","last_change":"2024-09-18T01:28:47.307427+0000","last_active":"2024-09-18T01:28:47.307401+0000","last_peered":"2024-09-18T01:28:47.307401+0000","last_clean":"2024-09-18T01:28:47.307401+0000","last_became_active":"2024-09-18T01:25:14.709879+0000","last_became_peered":"2024-09-18T01:25:14.709879+0000","last_unstale":"2024-09-18T01:28:47.307401+0000","last_undegraded":"2024-09-18T01:28:47.307401+0000","last_fullsized":"2024-09-18T01:28:47.307401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:47.307314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:47.307314+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.307314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:14:14.624869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:23.422289+0000","last_change":"2024-09-18T01:29:23.422317+0000","last_active":"2024-09-18T01:29:23.422289+0000","last_peered":"2024-09-18T01:29:23.422289+0000","last_clean":"2024-09-18T01:29:23.422289+0000","last_became_active":"2024-09-18T01:25:16.711764+0000","last_became_peered":"2024-09-18T01:25:16.711764+0000","last_unstale":"2024-09-18T01:29:23.422289+0000","last_undegraded":"2024-09-18T01:29:23.422289+0000","last_fullsized":"2024-09-18T01:29:23.422289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:29:23.422205+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:29:23.422205+0000","last_clean_scrub_stamp":"2024-09-18T01:29:23.422205+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:13.289594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:18.855001+0000","last_change":"2024-09-18T01:29:18.855070+0000","last_active":"2024-09-18T01:29:18.855001+0000","last_peered":"2024-09-18T01:29:18.855001+0000","last_clean":"2024-09-18T01:29:18.855001+0000","last_became_active":"2024-09-18T01:25:43.848631+0000","last_became_peered":"2024-09-18T01:25:43.848631+0000","last_unstale":"2024-09-18T01:29:18.855001+0000","last_undegraded":"2024-09-18T01:29:18.855001+0000","last_fullsized":"2024-09-18T01:29:18.855001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:18.854897+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:18.854897+0000","last_clean_scrub_stamp":"2024-09-18T01:29:18.854897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:19.377910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:09.885829+0000","last_change":"2024-09-18T01:29:09.885855+0000","last_active":"2024-09-18T01:29:09.885829+0000","last_peered":"2024-09-18T01:29:09.885829+0000","last_clean":"2024-09-18T01:29:09.885829+0000","last_became_active":"2024-09-18T01:25:06.690813+0000","last_became_peered":"2024-09-18T01:25:06.690813+0000","last_unstale":"2024-09-18T01:29:09.885829+0000","last_undegraded":"2024-09-18T01:29:09.885829+0000","last_fullsized":"2024-09-18T01:29:09.885829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:09.885735+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:09.885735+0000","last_clean_scrub_stamp":"2024-09-18T01:29:09.885735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:54.303235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.568137+0000","last_change":"2024-09-18T01:28:48.568158+0000","last_active":"2024-09-18T01:28:48.568137+0000","last_peered":"2024-09-18T01:28:48.568137+0000","last_clean":"2024-09-18T01:28:48.568137+0000","last_became_active":"2024-09-18T01:25:10.677226+0000","last_became_peered":"2024-09-18T01:25:10.677226+0000","last_unstale":"2024-09-18T01:28:48.568137+0000","last_undegraded":"2024-09-18T01:28:48.568137+0000","last_fullsized":"2024-09-18T01:28:48.568137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:48.568063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:48.568063+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.568063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:31.051544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'17","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.394431+0000","last_change":"2024-09-18T01:28:30.394506+0000","last_active":"2024-09-18T01:28:30.394431+0000","last_peered":"2024-09-18T01:28:30.394431+0000","last_clean":"2024-09-18T01:28:30.394431+0000","last_became_active":"2024-09-18T01:25:12.688366+0000","last_became_peered":"2024-09-18T01:25:12.688366+0000","last_unstale":"2024-09-18T01:28:30.394431+0000","last_undegraded":"2024-09-18T01:28:30.394431+0000","last_fullsized":"2024-09-18T01:28:30.394431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-18T01:28:30.394314+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-18T01:28:30.394314+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.394314+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:51.126406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.435350+0000","last_change":"2024-09-18T01:28:31.435372+0000","last_active":"2024-09-18T01:28:31.435350+0000","last_peered":"2024-09-18T01:28:31.435350+0000","last_clean":"2024-09-18T01:28:31.435350+0000","last_became_active":"2024-09-18T01:25:14.702918+0000","last_became_peered":"2024-09-18T01:25:14.702918+0000","last_unstale":"2024-09-18T01:28:31.435350+0000","last_undegraded":"2024-09-18T01:28:31.435350+0000","last_fullsized":"2024-09-18T01:28:31.435350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.435257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.435257+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.435257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:21.639639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'7","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:23.506256+0000","last_change":"2024-09-18T01:29:23.506302+0000","last_active":"2024-09-18T01:29:23.506256+0000","last_peered":"2024-09-18T01:29:23.506256+0000","last_clean":"2024-09-18T01:29:23.506256+0000","last_became_active":"2024-09-18T01:25:16.713571+0000","last_became_peered":"2024-09-18T01:25:16.713571+0000","last_unstale":"2024-09-18T01:29:23.506256+0000","last_undegraded":"2024-09-18T01:29:23.506256+0000","last_fullsized":"2024-09-18T01:29:23.506256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:29:23.506126+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:29:23.506126+0000","last_clean_scrub_stamp":"2024-09-18T01:29:23.506126+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:32:33.295833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'8","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:13.079477+0000","last_change":"2024-09-18T01:29:13.079505+0000","last_active":"2024-09-18T01:29:13.079477+0000","last_peered":"2024-09-18T01:29:13.079477+0000","last_clean":"2024-09-18T01:29:13.079477+0000","last_became_active":"2024-09-18T01:25:08.671904+0000","last_became_peered":"2024-09-18T01:25:08.671904+0000","last_unstale":"2024-09-18T01:29:13.079477+0000","last_undegraded":"2024-09-18T01:29:13.079477+0000","last_fullsized":"2024-09-18T01:29:13.079477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:13.079378+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:13.079378+0000","last_clean_scrub_stamp":"2024-09-18T01:29:13.079378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:15:05.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799005+0000","last_change":"2024-09-18T01:25:06.681491+0000","last_active":"2024-09-18T01:27:29.799005+0000","last_peered":"2024-09-18T01:27:29.799005+0000","last_clean":"2024-09-18T01:27:29.799005+0000","last_became_active":"2024-09-18T01:25:06.681065+0000","last_became_peered":"2024-09-18T01:25:06.681065+0000","last_unstale":"2024-09-18T01:27:29.799005+0000","last_undegraded":"2024-09-18T01:27:29.799005+0000","last_fullsized":"2024-09-18T01:27:29.799005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.538533+0000","last_change":"2024-09-18T01:28:49.538567+0000","last_active":"2024-09-18T01:28:49.538533+0000","last_peered":"2024-09-18T01:28:49.538533+0000","last_clean":"2024-09-18T01:28:49.538533+0000","last_became_active":"2024-09-18T01:25:10.677118+0000","last_became_peered":"2024-09-18T01:25:10.677118+0000","last_unstale":"2024-09-18T01:28:49.538533+0000","last_undegraded":"2024-09-18T01:28:49.538533+0000","last_fullsized":"2024-09-18T01:28:49.538533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:49.538452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:49.538452+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.538452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:45.840473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'29","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.676629+0000","last_change":"2024-09-18T01:28:36.676691+0000","last_active":"2024-09-18T01:28:36.676629+0000","last_peered":"2024-09-18T01:28:36.676629+0000","last_clean":"2024-09-18T01:28:36.676629+0000","last_became_active":"2024-09-18T01:25:12.693426+0000","last_became_peered":"2024-09-18T01:25:12.693426+0000","last_unstale":"2024-09-18T01:28:36.676629+0000","last_undegraded":"2024-09-18T01:28:36.676629+0000","last_fullsized":"2024-09-18T01:28:36.676629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'29","last_scrub_stamp":"2024-09-18T01:28:36.676525+0000","last_deep_scrub":"35'29","last_deep_scrub_stamp":"2024-09-18T01:28:36.676525+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.676525+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:10.438462+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'286","reported_seq":394,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.005383+0000","last_change":"2024-09-18T01:28:55.005433+0000","last_active":"2024-09-18T01:28:55.005383+0000","last_peered":"2024-09-18T01:28:55.005383+0000","last_clean":"2024-09-18T01:28:55.005383+0000","last_became_active":"2024-09-18T01:25:14.707544+0000","last_became_peered":"2024-09-18T01:25:14.707544+0000","last_unstale":"2024-09-18T01:28:55.005383+0000","last_undegraded":"2024-09-18T01:28:55.005383+0000","last_fullsized":"2024-09-18T01:28:55.005383+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-09-18T01:28:55.005253+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-09-18T01:28:55.005253+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.005253+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:36.156462+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.798041+0000","last_change":"2024-09-18T01:28:49.798066+0000","last_active":"2024-09-18T01:28:49.798041+0000","last_peered":"2024-09-18T01:28:49.798041+0000","last_clean":"2024-09-18T01:28:49.798041+0000","last_became_active":"2024-09-18T01:25:16.713458+0000","last_became_peered":"2024-09-18T01:25:16.713458+0000","last_unstale":"2024-09-18T01:28:49.798041+0000","last_undegraded":"2024-09-18T01:28:49.798041+0000","last_fullsized":"2024-09-18T01:28:49.798041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:49.797948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:49.797948+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.797948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:24:57.198351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.439200+0000","last_change":"2024-09-18T01:28:56.439235+0000","last_active":"2024-09-18T01:28:56.439200+0000","last_peered":"2024-09-18T01:28:56.439200+0000","last_clean":"2024-09-18T01:28:56.439200+0000","last_became_active":"2024-09-18T01:25:08.680700+0000","last_became_peered":"2024-09-18T01:25:08.680700+0000","last_unstale":"2024-09-18T01:28:56.439200+0000","last_undegraded":"2024-09-18T01:28:56.439200+0000","last_fullsized":"2024-09-18T01:28:56.439200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:28:56.439096+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:28:56.439096+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.439096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:40:37.562803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:08.369873+0000","last_change":"2024-09-18T01:29:08.369913+0000","last_active":"2024-09-18T01:29:08.369873+0000","last_peered":"2024-09-18T01:29:08.369873+0000","last_clean":"2024-09-18T01:29:08.369873+0000","last_became_active":"2024-09-18T01:25:06.691107+0000","last_became_peered":"2024-09-18T01:25:06.691107+0000","last_unstale":"2024-09-18T01:29:08.369873+0000","last_undegraded":"2024-09-18T01:29:08.369873+0000","last_fullsized":"2024-09-18T01:29:08.369873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:08.369779+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:08.369779+0000","last_clean_scrub_stamp":"2024-09-18T01:29:08.369779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:36:40.011470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.093957+0000","last_change":"2024-09-18T01:28:36.094004+0000","last_active":"2024-09-18T01:28:36.093957+0000","last_peered":"2024-09-18T01:28:36.093957+0000","last_clean":"2024-09-18T01:28:36.093957+0000","last_became_active":"2024-09-18T01:25:10.681273+0000","last_became_peered":"2024-09-18T01:25:10.681273+0000","last_unstale":"2024-09-18T01:28:36.093957+0000","last_undegraded":"2024-09-18T01:28:36.093957+0000","last_fullsized":"2024-09-18T01:28:36.093957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:36.093832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:36.093832+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.093832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:01.927384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'46","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.714556+0000","last_change":"2024-09-18T01:28:34.714630+0000","last_active":"2024-09-18T01:28:34.714556+0000","last_peered":"2024-09-18T01:28:34.714556+0000","last_clean":"2024-09-18T01:28:34.714556+0000","last_became_active":"2024-09-18T01:25:12.697114+0000","last_became_peered":"2024-09-18T01:25:12.697114+0000","last_unstale":"2024-09-18T01:28:34.714556+0000","last_undegraded":"2024-09-18T01:28:34.714556+0000","last_fullsized":"2024-09-18T01:28:34.714556+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:34.714456+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:34.714456+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.714456+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:50.227668+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":61,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":417,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.646306+0000","last_change":"2024-09-18T01:28:32.646333+0000","last_active":"2024-09-18T01:28:32.646306+0000","last_peered":"2024-09-18T01:28:32.646306+0000","last_clean":"2024-09-18T01:28:32.646306+0000","last_became_active":"2024-09-18T01:25:14.698792+0000","last_became_peered":"2024-09-18T01:25:14.698792+0000","last_unstale":"2024-09-18T01:28:32.646306+0000","last_undegraded":"2024-09-18T01:28:32.646306+0000","last_fullsized":"2024-09-18T01:28:32.646306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:32.646216+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:32.646216+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.646216+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:58:39.844651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:05.092140+0000","last_change":"2024-09-18T01:29:05.092180+0000","last_active":"2024-09-18T01:29:05.092140+0000","last_peered":"2024-09-18T01:29:05.092140+0000","last_clean":"2024-09-18T01:29:05.092140+0000","last_became_active":"2024-09-18T01:25:08.680143+0000","last_became_peered":"2024-09-18T01:25:08.680143+0000","last_unstale":"2024-09-18T01:29:05.092140+0000","last_undegraded":"2024-09-18T01:29:05.092140+0000","last_fullsized":"2024-09-18T01:29:05.092140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:05.092029+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:05.092029+0000","last_clean_scrub_stamp":"2024-09-18T01:29:05.092029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:55:27.777779+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:14.882933+0000","last_change":"2024-09-18T01:29:14.882963+0000","last_active":"2024-09-18T01:29:14.882933+0000","last_peered":"2024-09-18T01:29:14.882933+0000","last_clean":"2024-09-18T01:29:14.882933+0000","last_became_active":"2024-09-18T01:25:06.700650+0000","last_became_peered":"2024-09-18T01:25:06.700650+0000","last_unstale":"2024-09-18T01:29:14.882933+0000","last_undegraded":"2024-09-18T01:29:14.882933+0000","last_fullsized":"2024-09-18T01:29:14.882933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:14.882819+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:14.882819+0000","last_clean_scrub_stamp":"2024-09-18T01:29:14.882819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:11:27.887379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.335233+0000","last_change":"2024-09-18T01:28:37.335266+0000","last_active":"2024-09-18T01:28:37.335233+0000","last_peered":"2024-09-18T01:28:37.335233+0000","last_clean":"2024-09-18T01:28:37.335233+0000","last_became_active":"2024-09-18T01:25:10.683195+0000","last_became_peered":"2024-09-18T01:25:10.683195+0000","last_unstale":"2024-09-18T01:28:37.335233+0000","last_undegraded":"2024-09-18T01:28:37.335233+0000","last_fullsized":"2024-09-18T01:28:37.335233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:37.335139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:37.335139+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.335139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:26.770573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'59","reported_seq":125,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.709604+0000","last_change":"2024-09-18T01:28:38.709650+0000","last_active":"2024-09-18T01:28:38.709604+0000","last_peered":"2024-09-18T01:28:38.709604+0000","last_clean":"2024-09-18T01:28:38.709604+0000","last_became_active":"2024-09-18T01:25:12.687943+0000","last_became_peered":"2024-09-18T01:25:12.687943+0000","last_unstale":"2024-09-18T01:28:38.709604+0000","last_undegraded":"2024-09-18T01:28:38.709604+0000","last_fullsized":"2024-09-18T01:28:38.709604+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'59","last_scrub_stamp":"2024-09-18T01:28:38.709506+0000","last_deep_scrub":"35'59","last_deep_scrub_stamp":"2024-09-18T01:28:38.709506+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.709506+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:03.906269+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.615166+0000","last_change":"2024-09-18T01:28:33.615199+0000","last_active":"2024-09-18T01:28:33.615166+0000","last_peered":"2024-09-18T01:28:33.615166+0000","last_clean":"2024-09-18T01:28:33.615166+0000","last_became_active":"2024-09-18T01:25:14.698795+0000","last_became_peered":"2024-09-18T01:25:14.698795+0000","last_unstale":"2024-09-18T01:28:33.615166+0000","last_undegraded":"2024-09-18T01:28:33.615166+0000","last_fullsized":"2024-09-18T01:28:33.615166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:33.615076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:33.615076+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.615076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:23.050510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'3","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.709518+0000","last_change":"2024-09-18T01:28:37.709545+0000","last_active":"2024-09-18T01:28:37.709518+0000","last_peered":"2024-09-18T01:28:37.709518+0000","last_clean":"2024-09-18T01:28:37.709518+0000","last_became_active":"2024-09-18T01:25:16.707206+0000","last_became_peered":"2024-09-18T01:25:16.707206+0000","last_unstale":"2024-09-18T01:28:37.709518+0000","last_undegraded":"2024-09-18T01:28:37.709518+0000","last_fullsized":"2024-09-18T01:28:37.709518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:28:37.709423+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:28:37.709423+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.709423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:50:03.029261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.304984+0000","last_change":"2024-09-18T01:29:01.305009+0000","last_active":"2024-09-18T01:29:01.304984+0000","last_peered":"2024-09-18T01:29:01.304984+0000","last_clean":"2024-09-18T01:29:01.304984+0000","last_became_active":"2024-09-18T01:25:08.682878+0000","last_became_peered":"2024-09-18T01:25:08.682878+0000","last_unstale":"2024-09-18T01:29:01.304984+0000","last_undegraded":"2024-09-18T01:29:01.304984+0000","last_fullsized":"2024-09-18T01:29:01.304984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:01.304883+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:01.304883+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.304883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:08.393205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:13.892400+0000","last_change":"2024-09-18T01:29:13.892430+0000","last_active":"2024-09-18T01:29:13.892400+0000","last_peered":"2024-09-18T01:29:13.892400+0000","last_clean":"2024-09-18T01:29:13.892400+0000","last_became_active":"2024-09-18T01:25:06.700357+0000","last_became_peered":"2024-09-18T01:25:06.700357+0000","last_unstale":"2024-09-18T01:29:13.892400+0000","last_undegraded":"2024-09-18T01:29:13.892400+0000","last_fullsized":"2024-09-18T01:29:13.892400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:13.892307+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:13.892307+0000","last_clean_scrub_stamp":"2024-09-18T01:29:13.892307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:12:04.203571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"35'2","reported_seq":230,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:45.605147+0000","last_change":"2024-09-18T01:28:45.605224+0000","last_active":"2024-09-18T01:28:45.605147+0000","last_peered":"2024-09-18T01:28:45.605147+0000","last_clean":"2024-09-18T01:28:45.605147+0000","last_became_active":"2024-09-18T01:25:10.679652+0000","last_became_peered":"2024-09-18T01:25:10.679652+0000","last_unstale":"2024-09-18T01:28:45.605147+0000","last_undegraded":"2024-09-18T01:28:45.605147+0000","last_fullsized":"2024-09-18T01:28:45.605147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:45.605047+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:45.605047+0000","last_clean_scrub_stamp":"2024-09-18T01:28:45.605047+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:05:23.022870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'43","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.069418+0000","last_change":"2024-09-18T01:28:33.069454+0000","last_active":"2024-09-18T01:28:33.069418+0000","last_peered":"2024-09-18T01:28:33.069418+0000","last_clean":"2024-09-18T01:28:33.069418+0000","last_became_active":"2024-09-18T01:25:12.691691+0000","last_became_peered":"2024-09-18T01:25:12.691691+0000","last_unstale":"2024-09-18T01:28:33.069418+0000","last_undegraded":"2024-09-18T01:28:33.069418+0000","last_fullsized":"2024-09-18T01:28:33.069418+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'43","last_scrub_stamp":"2024-09-18T01:28:33.069322+0000","last_deep_scrub":"35'43","last_deep_scrub_stamp":"2024-09-18T01:28:33.069322+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.069322+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:48.566800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.665588+0000","last_change":"2024-09-18T01:28:29.665641+0000","last_active":"2024-09-18T01:28:29.665588+0000","last_peered":"2024-09-18T01:28:29.665588+0000","last_clean":"2024-09-18T01:28:29.665588+0000","last_became_active":"2024-09-18T01:25:14.706505+0000","last_became_peered":"2024-09-18T01:25:14.706505+0000","last_unstale":"2024-09-18T01:28:29.665588+0000","last_undegraded":"2024-09-18T01:28:29.665588+0000","last_fullsized":"2024-09-18T01:28:29.665588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.665468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.665468+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.665468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:49:54.985306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'3","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798573+0000","last_change":"2024-09-18T01:25:16.713810+0000","last_active":"2024-09-18T01:27:24.798573+0000","last_peered":"2024-09-18T01:27:24.798573+0000","last_clean":"2024-09-18T01:27:24.798573+0000","last_became_active":"2024-09-18T01:25:16.713453+0000","last_became_peered":"2024-09-18T01:25:16.713453+0000","last_unstale":"2024-09-18T01:27:24.798573+0000","last_undegraded":"2024-09-18T01:27:24.798573+0000","last_fullsized":"2024-09-18T01:27:24.798573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.807321+0000","last_change":"2024-09-18T01:29:03.807348+0000","last_active":"2024-09-18T01:29:03.807321+0000","last_peered":"2024-09-18T01:29:03.807321+0000","last_clean":"2024-09-18T01:29:03.807321+0000","last_became_active":"2024-09-18T01:25:08.674525+0000","last_became_peered":"2024-09-18T01:25:08.674525+0000","last_unstale":"2024-09-18T01:29:03.807321+0000","last_undegraded":"2024-09-18T01:29:03.807321+0000","last_fullsized":"2024-09-18T01:29:03.807321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:03.807231+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:03.807231+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.807231+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:06:51.447638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:16.988275+0000","last_change":"2024-09-18T01:29:16.988304+0000","last_active":"2024-09-18T01:29:16.988275+0000","last_peered":"2024-09-18T01:29:16.988275+0000","last_clean":"2024-09-18T01:29:16.988275+0000","last_became_active":"2024-09-18T01:25:06.694058+0000","last_became_peered":"2024-09-18T01:25:06.694058+0000","last_unstale":"2024-09-18T01:29:16.988275+0000","last_undegraded":"2024-09-18T01:29:16.988275+0000","last_fullsized":"2024-09-18T01:29:16.988275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:16.988182+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:16.988182+0000","last_clean_scrub_stamp":"2024-09-18T01:29:16.988182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:28:36.102353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:19.818585+0000","last_change":"2024-09-18T01:29:19.818621+0000","last_active":"2024-09-18T01:29:19.818585+0000","last_peered":"2024-09-18T01:29:19.818585+0000","last_clean":"2024-09-18T01:29:19.818585+0000","last_became_active":"2024-09-18T01:25:43.903638+0000","last_became_peered":"2024-09-18T01:25:43.903638+0000","last_unstale":"2024-09-18T01:29:19.818585+0000","last_undegraded":"2024-09-18T01:29:19.818585+0000","last_fullsized":"2024-09-18T01:29:19.818585+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:19.818447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:19.818447+0000","last_clean_scrub_stamp":"2024-09-18T01:29:19.818447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:13.037383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'60","reported_seq":130,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.055906+0000","last_change":"2024-09-18T01:28:54.055969+0000","last_active":"2024-09-18T01:28:54.055906+0000","last_peered":"2024-09-18T01:28:54.055906+0000","last_clean":"2024-09-18T01:28:54.055906+0000","last_became_active":"2024-09-18T01:25:12.693182+0000","last_became_peered":"2024-09-18T01:25:12.693182+0000","last_unstale":"2024-09-18T01:28:54.055906+0000","last_undegraded":"2024-09-18T01:28:54.055906+0000","last_fullsized":"2024-09-18T01:28:54.055906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'60","last_scrub_stamp":"2024-09-18T01:28:54.055805+0000","last_deep_scrub":"35'60","last_deep_scrub_stamp":"2024-09-18T01:28:54.055805+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.055805+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:07.480785+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":360,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.671836+0000","last_change":"2024-09-18T01:28:28.671899+0000","last_active":"2024-09-18T01:28:28.671836+0000","last_peered":"2024-09-18T01:28:28.671836+0000","last_clean":"2024-09-18T01:28:28.671836+0000","last_became_active":"2024-09-18T01:25:14.706540+0000","last_became_peered":"2024-09-18T01:25:14.706540+0000","last_unstale":"2024-09-18T01:28:28.671836+0000","last_undegraded":"2024-09-18T01:28:28.671836+0000","last_fullsized":"2024-09-18T01:28:28.671836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:28.671739+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:28.671739+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.671739+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:02.156270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:27.509089+0000","last_change":"2024-09-18T01:29:27.509135+0000","last_active":"2024-09-18T01:29:27.509089+0000","last_peered":"2024-09-18T01:29:27.509089+0000","last_clean":"2024-09-18T01:29:27.509089+0000","last_became_active":"2024-09-18T01:25:16.714363+0000","last_became_peered":"2024-09-18T01:25:16.714363+0000","last_unstale":"2024-09-18T01:29:27.509089+0000","last_undegraded":"2024-09-18T01:29:27.509089+0000","last_fullsized":"2024-09-18T01:29:27.509089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:27.508960+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:27.508960+0000","last_clean_scrub_stamp":"2024-09-18T01:29:27.508960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:14:05.164814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'4","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.853824+0000","last_change":"2024-09-18T01:28:55.853852+0000","last_active":"2024-09-18T01:28:55.853824+0000","last_peered":"2024-09-18T01:28:55.853824+0000","last_clean":"2024-09-18T01:28:55.853824+0000","last_became_active":"2024-09-18T01:25:08.670617+0000","last_became_peered":"2024-09-18T01:25:08.670617+0000","last_unstale":"2024-09-18T01:28:55.853824+0000","last_undegraded":"2024-09-18T01:28:55.853824+0000","last_fullsized":"2024-09-18T01:28:55.853824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:55.853740+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:55.853740+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.853740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:37:55.765115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798228+0000","last_change":"2024-09-18T01:25:06.693637+0000","last_active":"2024-09-18T01:27:24.798228+0000","last_peered":"2024-09-18T01:27:24.798228+0000","last_clean":"2024-09-18T01:27:24.798228+0000","last_became_active":"2024-09-18T01:25:06.689545+0000","last_became_peered":"2024-09-18T01:25:06.689545+0000","last_unstale":"2024-09-18T01:27:24.798228+0000","last_undegraded":"2024-09-18T01:27:24.798228+0000","last_fullsized":"2024-09-18T01:27:24.798228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:21.809065+0000","last_change":"2024-09-18T01:29:21.809086+0000","last_active":"2024-09-18T01:29:21.809065+0000","last_peered":"2024-09-18T01:29:21.809065+0000","last_clean":"2024-09-18T01:29:21.809065+0000","last_became_active":"2024-09-18T01:25:43.907094+0000","last_became_peered":"2024-09-18T01:25:43.907094+0000","last_unstale":"2024-09-18T01:29:21.809065+0000","last_undegraded":"2024-09-18T01:29:21.809065+0000","last_fullsized":"2024-09-18T01:29:21.809065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:21.808965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:21.808965+0000","last_clean_scrub_stamp":"2024-09-18T01:29:21.808965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:05:46.175533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'81","reported_seq":166,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.022817+0000","last_change":"2024-09-18T01:28:57.022879+0000","last_active":"2024-09-18T01:28:57.022817+0000","last_peered":"2024-09-18T01:28:57.022817+0000","last_clean":"2024-09-18T01:28:57.022817+0000","last_became_active":"2024-09-18T01:25:12.692821+0000","last_became_peered":"2024-09-18T01:25:12.692821+0000","last_unstale":"2024-09-18T01:28:57.022817+0000","last_undegraded":"2024-09-18T01:28:57.022817+0000","last_fullsized":"2024-09-18T01:28:57.022817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'81","last_scrub_stamp":"2024-09-18T01:28:57.022705+0000","last_deep_scrub":"35'81","last_deep_scrub_stamp":"2024-09-18T01:28:57.022705+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.022705+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:33.670619+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":84,"num_read_kb":81,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.550650+0000","last_change":"2024-09-18T01:28:47.550677+0000","last_active":"2024-09-18T01:28:47.550650+0000","last_peered":"2024-09-18T01:28:47.550650+0000","last_clean":"2024-09-18T01:28:47.550650+0000","last_became_active":"2024-09-18T01:25:14.707514+0000","last_became_peered":"2024-09-18T01:25:14.707514+0000","last_unstale":"2024-09-18T01:28:47.550650+0000","last_undegraded":"2024-09-18T01:28:47.550650+0000","last_fullsized":"2024-09-18T01:28:47.550650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:47.550559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:47.550559+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.550559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:14:27.993350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'21","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.535497+0000","last_change":"2024-09-18T01:29:22.535536+0000","last_active":"2024-09-18T01:29:22.535497+0000","last_peered":"2024-09-18T01:29:22.535497+0000","last_clean":"2024-09-18T01:29:22.535497+0000","last_became_active":"2024-09-18T01:25:16.705938+0000","last_became_peered":"2024-09-18T01:25:16.705938+0000","last_unstale":"2024-09-18T01:29:22.535497+0000","last_undegraded":"2024-09-18T01:29:22.535497+0000","last_fullsized":"2024-09-18T01:29:22.535497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-09-18T01:29:22.535413+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-09-18T01:29:22.535413+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.535413+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:20.985121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.222832+0000","last_change":"2024-09-18T01:28:49.222874+0000","last_active":"2024-09-18T01:28:49.222832+0000","last_peered":"2024-09-18T01:28:49.222832+0000","last_clean":"2024-09-18T01:28:49.222832+0000","last_became_active":"2024-09-18T01:25:08.687135+0000","last_became_peered":"2024-09-18T01:25:08.687135+0000","last_unstale":"2024-09-18T01:28:49.222832+0000","last_undegraded":"2024-09-18T01:28:49.222832+0000","last_fullsized":"2024-09-18T01:28:49.222832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:49.222741+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:49.222741+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.222741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:14.553771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:16.453010+0000","last_change":"2024-09-18T01:29:16.453033+0000","last_active":"2024-09-18T01:29:16.453010+0000","last_peered":"2024-09-18T01:29:16.453010+0000","last_clean":"2024-09-18T01:29:16.453010+0000","last_became_active":"2024-09-18T01:25:06.680774+0000","last_became_peered":"2024-09-18T01:25:06.680774+0000","last_unstale":"2024-09-18T01:29:16.453010+0000","last_undegraded":"2024-09-18T01:29:16.453010+0000","last_fullsized":"2024-09-18T01:29:16.453010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:16.452922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:16.452922+0000","last_clean_scrub_stamp":"2024-09-18T01:29:16.452922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:46:49.286842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.752242+0000","last_change":"2024-09-18T01:28:48.752267+0000","last_active":"2024-09-18T01:28:48.752242+0000","last_peered":"2024-09-18T01:28:48.752242+0000","last_clean":"2024-09-18T01:28:48.752242+0000","last_became_active":"2024-09-18T01:25:10.674983+0000","last_became_peered":"2024-09-18T01:25:10.674983+0000","last_unstale":"2024-09-18T01:28:48.752242+0000","last_undegraded":"2024-09-18T01:28:48.752242+0000","last_fullsized":"2024-09-18T01:28:48.752242+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:48.752118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:48.752118+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.752118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:42:22.390584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'46","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.373357+0000","last_change":"2024-09-18T01:28:33.373391+0000","last_active":"2024-09-18T01:28:33.373357+0000","last_peered":"2024-09-18T01:28:33.373357+0000","last_clean":"2024-09-18T01:28:33.373357+0000","last_became_active":"2024-09-18T01:25:12.683339+0000","last_became_peered":"2024-09-18T01:25:12.683339+0000","last_unstale":"2024-09-18T01:28:33.373357+0000","last_undegraded":"2024-09-18T01:28:33.373357+0000","last_fullsized":"2024-09-18T01:28:33.373357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:33.373272+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:33.373272+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.373272+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:10:34.585302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.045271+0000","last_change":"2024-09-18T01:28:59.045296+0000","last_active":"2024-09-18T01:28:59.045271+0000","last_peered":"2024-09-18T01:28:59.045271+0000","last_clean":"2024-09-18T01:28:59.045271+0000","last_became_active":"2024-09-18T01:25:14.707116+0000","last_became_peered":"2024-09-18T01:25:14.707116+0000","last_unstale":"2024-09-18T01:28:59.045271+0000","last_undegraded":"2024-09-18T01:28:59.045271+0000","last_fullsized":"2024-09-18T01:28:59.045271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:59.045185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:59.045185+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.045185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:59:27.668851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.045461+0000","last_change":"2024-09-18T01:29:15.045461+0000","last_active":"2024-09-18T01:29:15.045461+0000","last_peered":"2024-09-18T01:29:15.045461+0000","last_clean":"2024-09-18T01:29:15.045461+0000","last_became_active":"2024-09-18T01:25:16.708095+0000","last_became_peered":"2024-09-18T01:25:16.708095+0000","last_unstale":"2024-09-18T01:29:15.045461+0000","last_undegraded":"2024-09-18T01:29:15.045461+0000","last_fullsized":"2024-09-18T01:29:15.045461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:15.045296+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:15.045296+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.045296+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:34:54.730738+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.038065+0000","last_change":"2024-09-18T01:28:42.038123+0000","last_active":"2024-09-18T01:28:42.038065+0000","last_peered":"2024-09-18T01:28:42.038065+0000","last_clean":"2024-09-18T01:28:42.038065+0000","last_became_active":"2024-09-18T01:25:08.688251+0000","last_became_peered":"2024-09-18T01:25:08.688251+0000","last_unstale":"2024-09-18T01:28:42.038065+0000","last_undegraded":"2024-09-18T01:28:42.038065+0000","last_fullsized":"2024-09-18T01:28:42.038065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:42.037965+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:42.037965+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.037965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:21:09.764214+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:23.854553+0000","last_change":"2024-09-18T01:25:06.684669+0000","last_active":"2024-09-18T01:28:23.854553+0000","last_peered":"2024-09-18T01:28:23.854553+0000","last_clean":"2024-09-18T01:28:23.854553+0000","last_became_active":"2024-09-18T01:25:06.683437+0000","last_became_peered":"2024-09-18T01:25:06.683437+0000","last_unstale":"2024-09-18T01:28:23.854553+0000","last_undegraded":"2024-09-18T01:28:23.854553+0000","last_fullsized":"2024-09-18T01:28:23.854553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.594007+0000","last_change":"2024-09-18T01:28:44.594031+0000","last_active":"2024-09-18T01:28:44.594007+0000","last_peered":"2024-09-18T01:28:44.594007+0000","last_clean":"2024-09-18T01:28:44.594007+0000","last_became_active":"2024-09-18T01:25:10.679740+0000","last_became_peered":"2024-09-18T01:25:10.679740+0000","last_unstale":"2024-09-18T01:28:44.594007+0000","last_undegraded":"2024-09-18T01:28:44.594007+0000","last_fullsized":"2024-09-18T01:28:44.594007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:44.593908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:44.593908+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.593908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:48.222246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'45","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.694703+0000","last_change":"2024-09-18T01:28:40.694748+0000","last_active":"2024-09-18T01:28:40.694703+0000","last_peered":"2024-09-18T01:28:40.694703+0000","last_clean":"2024-09-18T01:28:40.694703+0000","last_became_active":"2024-09-18T01:25:12.686455+0000","last_became_peered":"2024-09-18T01:25:12.686455+0000","last_unstale":"2024-09-18T01:28:40.694703+0000","last_undegraded":"2024-09-18T01:28:40.694703+0000","last_fullsized":"2024-09-18T01:28:40.694703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-18T01:28:40.694620+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-18T01:28:40.694620+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.694620+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:30.077444+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":415,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.649222+0000","last_change":"2024-09-18T01:28:30.649256+0000","last_active":"2024-09-18T01:28:30.649222+0000","last_peered":"2024-09-18T01:28:30.649222+0000","last_clean":"2024-09-18T01:28:30.649222+0000","last_became_active":"2024-09-18T01:25:14.703877+0000","last_became_peered":"2024-09-18T01:25:14.703877+0000","last_unstale":"2024-09-18T01:28:30.649222+0000","last_undegraded":"2024-09-18T01:28:30.649222+0000","last_fullsized":"2024-09-18T01:28:30.649222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:30.649113+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:30.649113+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.649113+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:03.499336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'13","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:24.473786+0000","last_change":"2024-09-18T01:29:24.473786+0000","last_active":"2024-09-18T01:29:24.473786+0000","last_peered":"2024-09-18T01:29:24.473786+0000","last_clean":"2024-09-18T01:29:24.473786+0000","last_became_active":"2024-09-18T01:25:16.713677+0000","last_became_peered":"2024-09-18T01:25:16.713677+0000","last_unstale":"2024-09-18T01:29:24.473786+0000","last_undegraded":"2024-09-18T01:29:24.473786+0000","last_fullsized":"2024-09-18T01:29:24.473786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'13","last_scrub_stamp":"2024-09-18T01:29:24.473594+0000","last_deep_scrub":"35'13","last_deep_scrub_stamp":"2024-09-18T01:29:24.473594+0000","last_clean_scrub_stamp":"2024-09-18T01:29:24.473594+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:16:45.309204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.862565+0000","last_change":"2024-09-18T01:28:57.862588+0000","last_active":"2024-09-18T01:28:57.862565+0000","last_peered":"2024-09-18T01:28:57.862565+0000","last_clean":"2024-09-18T01:28:57.862565+0000","last_became_active":"2024-09-18T01:25:08.673276+0000","last_became_peered":"2024-09-18T01:25:08.673276+0000","last_unstale":"2024-09-18T01:28:57.862565+0000","last_undegraded":"2024-09-18T01:28:57.862565+0000","last_fullsized":"2024-09-18T01:28:57.862565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:57.862460+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:57.862460+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.862460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:25:54.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797377+0000","last_change":"2024-09-18T01:25:06.683319+0000","last_active":"2024-09-18T01:27:19.797377+0000","last_peered":"2024-09-18T01:27:19.797377+0000","last_clean":"2024-09-18T01:27:19.797377+0000","last_became_active":"2024-09-18T01:25:06.682841+0000","last_became_peered":"2024-09-18T01:25:06.682841+0000","last_unstale":"2024-09-18T01:27:19.797377+0000","last_undegraded":"2024-09-18T01:27:19.797377+0000","last_fullsized":"2024-09-18T01:27:19.797377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":428,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.267239+0000","last_change":"2024-09-18T01:28:40.267271+0000","last_active":"2024-09-18T01:28:40.267239+0000","last_peered":"2024-09-18T01:28:40.267239+0000","last_clean":"2024-09-18T01:28:40.267239+0000","last_became_active":"2024-09-18T01:25:10.679483+0000","last_became_peered":"2024-09-18T01:25:10.679483+0000","last_unstale":"2024-09-18T01:28:40.267239+0000","last_undegraded":"2024-09-18T01:28:40.267239+0000","last_fullsized":"2024-09-18T01:28:40.267239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-18T01:28:40.267152+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-18T01:28:40.267152+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.267152+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:35.825702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.098067+0000","last_change":"2024-09-18T01:28:53.098116+0000","last_active":"2024-09-18T01:28:53.098067+0000","last_peered":"2024-09-18T01:28:53.098067+0000","last_clean":"2024-09-18T01:28:53.098067+0000","last_became_active":"2024-09-18T01:25:12.696726+0000","last_became_peered":"2024-09-18T01:25:12.696726+0000","last_unstale":"2024-09-18T01:28:53.098067+0000","last_undegraded":"2024-09-18T01:28:53.098067+0000","last_fullsized":"2024-09-18T01:28:53.098067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-18T01:28:53.097976+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-18T01:28:53.097976+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.097976+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:31:13.343479+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":522,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.350851+0000","last_change":"2024-09-18T01:28:35.350881+0000","last_active":"2024-09-18T01:28:35.350851+0000","last_peered":"2024-09-18T01:28:35.350851+0000","last_clean":"2024-09-18T01:28:35.350851+0000","last_became_active":"2024-09-18T01:25:14.702900+0000","last_became_peered":"2024-09-18T01:25:14.702900+0000","last_unstale":"2024-09-18T01:28:35.350851+0000","last_undegraded":"2024-09-18T01:28:35.350851+0000","last_fullsized":"2024-09-18T01:28:35.350851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:35.350746+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:35.350746+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.350746+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:24.733569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.703207+0000","last_change":"2024-09-18T01:28:41.703271+0000","last_active":"2024-09-18T01:28:41.703207+0000","last_peered":"2024-09-18T01:28:41.703207+0000","last_clean":"2024-09-18T01:28:41.703207+0000","last_became_active":"2024-09-18T01:25:16.712084+0000","last_became_peered":"2024-09-18T01:25:16.712084+0000","last_unstale":"2024-09-18T01:28:41.703207+0000","last_undegraded":"2024-09-18T01:28:41.703207+0000","last_fullsized":"2024-09-18T01:28:41.703207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:41.703089+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:41.703089+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.703089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:26:56.294603+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'8","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.243527+0000","last_change":"2024-09-18T01:28:52.243573+0000","last_active":"2024-09-18T01:28:52.243527+0000","last_peered":"2024-09-18T01:28:52.243527+0000","last_clean":"2024-09-18T01:28:52.243527+0000","last_became_active":"2024-09-18T01:25:08.686802+0000","last_became_peered":"2024-09-18T01:25:08.686802+0000","last_unstale":"2024-09-18T01:28:52.243527+0000","last_undegraded":"2024-09-18T01:28:52.243527+0000","last_fullsized":"2024-09-18T01:28:52.243527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:52.243420+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:52.243420+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.243420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:29.295501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:18.033853+0000","last_change":"2024-09-18T01:29:18.033899+0000","last_active":"2024-09-18T01:29:18.033853+0000","last_peered":"2024-09-18T01:29:18.033853+0000","last_clean":"2024-09-18T01:29:18.033853+0000","last_became_active":"2024-09-18T01:25:06.691644+0000","last_became_peered":"2024-09-18T01:25:06.691644+0000","last_unstale":"2024-09-18T01:29:18.033853+0000","last_undegraded":"2024-09-18T01:29:18.033853+0000","last_fullsized":"2024-09-18T01:29:18.033853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:18.033754+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:18.033754+0000","last_clean_scrub_stamp":"2024-09-18T01:29:18.033754+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:54:59.833695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.109354+0000","last_change":"2024-09-18T01:28:32.109380+0000","last_active":"2024-09-18T01:28:32.109354+0000","last_peered":"2024-09-18T01:28:32.109354+0000","last_clean":"2024-09-18T01:28:32.109354+0000","last_became_active":"2024-09-18T01:25:10.682075+0000","last_became_peered":"2024-09-18T01:25:10.682075+0000","last_unstale":"2024-09-18T01:28:32.109354+0000","last_undegraded":"2024-09-18T01:28:32.109354+0000","last_fullsized":"2024-09-18T01:28:32.109354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:32.109232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:32.109232+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.109232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:37.084368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'49","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.423913+0000","last_change":"2024-09-18T01:28:32.423980+0000","last_active":"2024-09-18T01:28:32.423913+0000","last_peered":"2024-09-18T01:28:32.423913+0000","last_clean":"2024-09-18T01:28:32.423913+0000","last_became_active":"2024-09-18T01:25:12.686460+0000","last_became_peered":"2024-09-18T01:25:12.686460+0000","last_unstale":"2024-09-18T01:28:32.423913+0000","last_undegraded":"2024-09-18T01:28:32.423913+0000","last_fullsized":"2024-09-18T01:28:32.423913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-09-18T01:28:32.423801+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-09-18T01:28:32.423801+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.423801+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:00:55.455121+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.575274+0000","last_change":"2024-09-18T01:28:27.575318+0000","last_active":"2024-09-18T01:28:27.575274+0000","last_peered":"2024-09-18T01:28:27.575274+0000","last_clean":"2024-09-18T01:28:27.575274+0000","last_became_active":"2024-09-18T01:25:14.706506+0000","last_became_peered":"2024-09-18T01:25:14.706506+0000","last_unstale":"2024-09-18T01:28:27.575274+0000","last_undegraded":"2024-09-18T01:28:27.575274+0000","last_fullsized":"2024-09-18T01:28:27.575274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:27.575151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:27.575151+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.575151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:28.541634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'7","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.228066+0000","last_change":"2024-09-18T01:28:55.228116+0000","last_active":"2024-09-18T01:28:55.228066+0000","last_peered":"2024-09-18T01:28:55.228066+0000","last_clean":"2024-09-18T01:28:55.228066+0000","last_became_active":"2024-09-18T01:25:16.709084+0000","last_became_peered":"2024-09-18T01:25:16.709084+0000","last_unstale":"2024-09-18T01:28:55.228066+0000","last_undegraded":"2024-09-18T01:28:55.228066+0000","last_fullsized":"2024-09-18T01:28:55.228066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:28:55.227978+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:28:55.227978+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.227978+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:40.596230+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'7","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.022803+0000","last_change":"2024-09-18T01:28:44.022803+0000","last_active":"2024-09-18T01:28:44.022803+0000","last_peered":"2024-09-18T01:28:44.022803+0000","last_clean":"2024-09-18T01:28:44.022803+0000","last_became_active":"2024-09-18T01:25:08.687896+0000","last_became_peered":"2024-09-18T01:25:08.687896+0000","last_unstale":"2024-09-18T01:28:44.022803+0000","last_undegraded":"2024-09-18T01:28:44.022803+0000","last_fullsized":"2024-09-18T01:28:44.022803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:28:44.022693+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:28:44.022693+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.022693+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:27.889066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":216,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:13.331194+0000","last_change":"2024-09-18T01:29:13.331251+0000","last_active":"2024-09-18T01:29:13.331194+0000","last_peered":"2024-09-18T01:29:13.331194+0000","last_clean":"2024-09-18T01:29:13.331194+0000","last_became_active":"2024-09-18T01:24:52.296214+0000","last_became_peered":"2024-09-18T01:24:52.296214+0000","last_unstale":"2024-09-18T01:29:13.331194+0000","last_undegraded":"2024-09-18T01:29:13.331194+0000","last_fullsized":"2024-09-18T01:29:13.331194+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-09-18T01:29:13.331084+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-09-18T01:29:13.331084+0000","last_clean_scrub_stamp":"2024-09-18T01:29:13.331084+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:06.550020+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.925420+0000","last_change":"2024-09-18T01:24:58.197569+0000","last_active":"2024-09-18T01:28:27.925420+0000","last_peered":"2024-09-18T01:28:27.925420+0000","last_clean":"2024-09-18T01:28:27.925420+0000","last_became_active":"2024-09-18T01:24:56.194443+0000","last_became_peered":"2024-09-18T01:24:56.194443+0000","last_unstale":"2024-09-18T01:28:27.925420+0000","last_undegraded":"2024-09-18T01:28:27.925420+0000","last_fullsized":"2024-09-18T01:28:27.925420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033763700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.925468+0000","last_change":"2024-09-18T01:25:06.684714+0000","last_active":"2024-09-18T01:28:27.925468+0000","last_peered":"2024-09-18T01:28:27.925468+0000","last_clean":"2024-09-18T01:28:27.925468+0000","last_became_active":"2024-09-18T01:25:06.683975+0000","last_became_peered":"2024-09-18T01:25:06.683975+0000","last_unstale":"2024-09-18T01:28:27.925468+0000","last_undegraded":"2024-09-18T01:28:27.925468+0000","last_fullsized":"2024-09-18T01:28:27.925468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.273084+0000","last_change":"2024-09-18T01:28:41.273084+0000","last_active":"2024-09-18T01:28:41.273084+0000","last_peered":"2024-09-18T01:28:41.273084+0000","last_clean":"2024-09-18T01:28:41.273084+0000","last_became_active":"2024-09-18T01:25:10.679572+0000","last_became_peered":"2024-09-18T01:25:10.679572+0000","last_unstale":"2024-09-18T01:28:41.273084+0000","last_undegraded":"2024-09-18T01:28:41.273084+0000","last_fullsized":"2024-09-18T01:28:41.273084+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:41.272968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:41.272968+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.272968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:18:48.599189+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'94","reported_seq":190,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.133511+0000","last_change":"2024-09-18T01:28:39.133548+0000","last_active":"2024-09-18T01:28:39.133511+0000","last_peered":"2024-09-18T01:28:39.133511+0000","last_clean":"2024-09-18T01:28:39.133511+0000","last_became_active":"2024-09-18T01:25:12.691952+0000","last_became_peered":"2024-09-18T01:25:12.691952+0000","last_unstale":"2024-09-18T01:28:39.133511+0000","last_undegraded":"2024-09-18T01:28:39.133511+0000","last_fullsized":"2024-09-18T01:28:39.133511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'94","last_scrub_stamp":"2024-09-18T01:28:39.133419+0000","last_deep_scrub":"35'94","last_deep_scrub_stamp":"2024-09-18T01:28:39.133419+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.133419+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:11:05.713633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.670335+0000","last_change":"2024-09-18T01:28:31.670355+0000","last_active":"2024-09-18T01:28:31.670335+0000","last_peered":"2024-09-18T01:28:31.670335+0000","last_clean":"2024-09-18T01:28:31.670335+0000","last_became_active":"2024-09-18T01:25:14.706519+0000","last_became_peered":"2024-09-18T01:25:14.706519+0000","last_unstale":"2024-09-18T01:28:31.670335+0000","last_undegraded":"2024-09-18T01:28:31.670335+0000","last_fullsized":"2024-09-18T01:28:31.670335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.670230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.670230+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.670230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:37.902202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'85","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:45.758581+0000","last_change":"2024-09-18T01:28:45.758628+0000","last_active":"2024-09-18T01:28:45.758581+0000","last_peered":"2024-09-18T01:28:45.758581+0000","last_clean":"2024-09-18T01:28:45.758581+0000","last_became_active":"2024-09-18T01:25:16.712102+0000","last_became_peered":"2024-09-18T01:25:16.712102+0000","last_unstale":"2024-09-18T01:28:45.758581+0000","last_undegraded":"2024-09-18T01:28:45.758581+0000","last_fullsized":"2024-09-18T01:28:45.758581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'85","last_scrub_stamp":"2024-09-18T01:28:45.758460+0000","last_deep_scrub":"35'85","last_deep_scrub_stamp":"2024-09-18T01:28:45.758460+0000","last_clean_scrub_stamp":"2024-09-18T01:28:45.758460+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:39.752325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":221,"num_write":168,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'8","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.999319+0000","last_change":"2024-09-18T01:29:15.999350+0000","last_active":"2024-09-18T01:29:15.999319+0000","last_peered":"2024-09-18T01:29:15.999319+0000","last_clean":"2024-09-18T01:29:15.999319+0000","last_became_active":"2024-09-18T01:25:08.671578+0000","last_became_peered":"2024-09-18T01:25:08.671578+0000","last_unstale":"2024-09-18T01:29:15.999319+0000","last_undegraded":"2024-09-18T01:29:15.999319+0000","last_fullsized":"2024-09-18T01:29:15.999319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:15.999222+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:15.999222+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.999222+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:05:28.202872+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.925412+0000","last_change":"2024-09-18T01:24:58.197615+0000","last_active":"2024-09-18T01:28:27.925412+0000","last_peered":"2024-09-18T01:28:27.925412+0000","last_clean":"2024-09-18T01:28:27.925412+0000","last_became_active":"2024-09-18T01:24:56.191554+0000","last_became_peered":"2024-09-18T01:24:56.191554+0000","last_unstale":"2024-09-18T01:28:27.925412+0000","last_undegraded":"2024-09-18T01:28:27.925412+0000","last_fullsized":"2024-09-18T01:28:27.925412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041584599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:17.493372+0000","last_change":"2024-09-18T01:29:17.493372+0000","last_active":"2024-09-18T01:29:17.493372+0000","last_peered":"2024-09-18T01:29:17.493372+0000","last_clean":"2024-09-18T01:29:17.493372+0000","last_became_active":"2024-09-18T01:25:06.680635+0000","last_became_peered":"2024-09-18T01:25:06.680635+0000","last_unstale":"2024-09-18T01:29:17.493372+0000","last_undegraded":"2024-09-18T01:29:17.493372+0000","last_fullsized":"2024-09-18T01:29:17.493372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:17.493252+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:17.493252+0000","last_clean_scrub_stamp":"2024-09-18T01:29:17.493252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:00:56.730173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.041908+0000","last_change":"2024-09-18T01:28:34.041935+0000","last_active":"2024-09-18T01:28:34.041908+0000","last_peered":"2024-09-18T01:28:34.041908+0000","last_clean":"2024-09-18T01:28:34.041908+0000","last_became_active":"2024-09-18T01:25:10.681988+0000","last_became_peered":"2024-09-18T01:25:10.681988+0000","last_unstale":"2024-09-18T01:28:34.041908+0000","last_undegraded":"2024-09-18T01:28:34.041908+0000","last_fullsized":"2024-09-18T01:28:34.041908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:34.041811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:34.041811+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.041811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:05:37.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'297","reported_seq":529,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.359441+0000","last_change":"2024-09-18T01:28:27.359441+0000","last_active":"2024-09-18T01:28:27.359441+0000","last_peered":"2024-09-18T01:28:27.359441+0000","last_clean":"2024-09-18T01:28:27.359441+0000","last_became_active":"2024-09-18T01:25:12.693664+0000","last_became_peered":"2024-09-18T01:25:12.693664+0000","last_unstale":"2024-09-18T01:28:27.359441+0000","last_undegraded":"2024-09-18T01:28:27.359441+0000","last_fullsized":"2024-09-18T01:28:27.359441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'297","last_scrub_stamp":"2024-09-18T01:28:27.359261+0000","last_deep_scrub":"35'297","last_deep_scrub_stamp":"2024-09-18T01:28:27.359261+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.359261+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:28:05.502483+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.086190+0000","last_change":"2024-09-18T01:28:51.086190+0000","last_active":"2024-09-18T01:28:51.086190+0000","last_peered":"2024-09-18T01:28:51.086190+0000","last_clean":"2024-09-18T01:28:51.086190+0000","last_became_active":"2024-09-18T01:25:14.707143+0000","last_became_peered":"2024-09-18T01:25:14.707143+0000","last_unstale":"2024-09-18T01:28:51.086190+0000","last_undegraded":"2024-09-18T01:28:51.086190+0000","last_fullsized":"2024-09-18T01:28:51.086190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:51.086082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:51.086082+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.086082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:29:21.095319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:17.101097+0000","last_change":"2024-09-18T01:25:16.714554+0000","last_active":"2024-09-18T01:28:17.101097+0000","last_peered":"2024-09-18T01:28:17.101097+0000","last_clean":"2024-09-18T01:28:17.101097+0000","last_became_active":"2024-09-18T01:25:16.712931+0000","last_became_peered":"2024-09-18T01:25:16.712931+0000","last_unstale":"2024-09-18T01:28:17.101097+0000","last_undegraded":"2024-09-18T01:28:17.101097+0000","last_fullsized":"2024-09-18T01:28:17.101097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:11.476574+0000","last_change":"2024-09-18T01:29:11.476574+0000","last_active":"2024-09-18T01:29:11.476574+0000","last_peered":"2024-09-18T01:29:11.476574+0000","last_clean":"2024-09-18T01:29:11.476574+0000","last_became_active":"2024-09-18T01:25:08.680541+0000","last_became_peered":"2024-09-18T01:25:08.680541+0000","last_unstale":"2024-09-18T01:29:11.476574+0000","last_undegraded":"2024-09-18T01:29:11.476574+0000","last_fullsized":"2024-09-18T01:29:11.476574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:11.476456+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:11.476456+0000","last_clean_scrub_stamp":"2024-09-18T01:29:11.476456+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:48.447070+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:07.830066+0000","last_change":"2024-09-18T01:29:07.830066+0000","last_active":"2024-09-18T01:29:07.830066+0000","last_peered":"2024-09-18T01:29:07.830066+0000","last_clean":"2024-09-18T01:29:07.830066+0000","last_became_active":"2024-09-18T01:24:56.191162+0000","last_became_peered":"2024-09-18T01:24:56.191162+0000","last_unstale":"2024-09-18T01:29:07.830066+0000","last_undegraded":"2024-09-18T01:29:07.830066+0000","last_fullsized":"2024-09-18T01:29:07.830066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:07.829938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:07.829938+0000","last_clean_scrub_stamp":"2024-09-18T01:29:07.829938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:20.798729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040921399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:08.500119+0000","last_change":"2024-09-18T01:29:08.500146+0000","last_active":"2024-09-18T01:29:08.500119+0000","last_peered":"2024-09-18T01:29:08.500119+0000","last_clean":"2024-09-18T01:29:08.500119+0000","last_became_active":"2024-09-18T01:25:06.686053+0000","last_became_peered":"2024-09-18T01:25:06.686053+0000","last_unstale":"2024-09-18T01:29:08.500119+0000","last_undegraded":"2024-09-18T01:29:08.500119+0000","last_fullsized":"2024-09-18T01:29:08.500119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:08.500012+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:08.500012+0000","last_clean_scrub_stamp":"2024-09-18T01:29:08.500012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:34.922339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.729103+0000","last_change":"2024-09-18T01:28:47.729134+0000","last_active":"2024-09-18T01:28:47.729103+0000","last_peered":"2024-09-18T01:28:47.729103+0000","last_clean":"2024-09-18T01:28:47.729103+0000","last_became_active":"2024-09-18T01:25:10.677597+0000","last_became_peered":"2024-09-18T01:25:10.677597+0000","last_unstale":"2024-09-18T01:28:47.729103+0000","last_undegraded":"2024-09-18T01:28:47.729103+0000","last_fullsized":"2024-09-18T01:28:47.729103+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:47.729010+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:47.729010+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.729010+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:44:00.635385+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'23","reported_seq":101,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.678878+0000","last_change":"2024-09-18T01:28:39.678878+0000","last_active":"2024-09-18T01:28:39.678878+0000","last_peered":"2024-09-18T01:28:39.678878+0000","last_clean":"2024-09-18T01:28:39.678878+0000","last_became_active":"2024-09-18T01:25:12.687799+0000","last_became_peered":"2024-09-18T01:25:12.687799+0000","last_unstale":"2024-09-18T01:28:39.678878+0000","last_undegraded":"2024-09-18T01:28:39.678878+0000","last_fullsized":"2024-09-18T01:28:39.678878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-09-18T01:28:39.678752+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-09-18T01:28:39.678752+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.678752+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:45.910724+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.698401+0000","last_change":"2024-09-18T01:28:27.698401+0000","last_active":"2024-09-18T01:28:27.698401+0000","last_peered":"2024-09-18T01:28:27.698401+0000","last_clean":"2024-09-18T01:28:27.698401+0000","last_became_active":"2024-09-18T01:25:14.706611+0000","last_became_peered":"2024-09-18T01:25:14.706611+0000","last_unstale":"2024-09-18T01:28:27.698401+0000","last_undegraded":"2024-09-18T01:28:27.698401+0000","last_fullsized":"2024-09-18T01:28:27.698401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:27.698307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:27.698307+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.698307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:17.902689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799910+0000","last_change":"2024-09-18T01:25:16.711670+0000","last_active":"2024-09-18T01:27:34.799910+0000","last_peered":"2024-09-18T01:27:34.799910+0000","last_clean":"2024-09-18T01:27:34.799910+0000","last_became_active":"2024-09-18T01:25:16.711404+0000","last_became_peered":"2024-09-18T01:25:16.711404+0000","last_unstale":"2024-09-18T01:27:34.799910+0000","last_undegraded":"2024-09-18T01:27:34.799910+0000","last_fullsized":"2024-09-18T01:27:34.799910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:09.483226+0000","last_change":"2024-09-18T01:29:09.483226+0000","last_active":"2024-09-18T01:29:09.483226+0000","last_peered":"2024-09-18T01:29:09.483226+0000","last_clean":"2024-09-18T01:29:09.483226+0000","last_became_active":"2024-09-18T01:25:08.672969+0000","last_became_peered":"2024-09-18T01:25:08.672969+0000","last_unstale":"2024-09-18T01:29:09.483226+0000","last_undegraded":"2024-09-18T01:29:09.483226+0000","last_fullsized":"2024-09-18T01:29:09.483226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:09.483012+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:09.483012+0000","last_clean_scrub_stamp":"2024-09-18T01:29:09.483012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:10.006025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.925409+0000","last_change":"2024-09-18T01:24:58.198236+0000","last_active":"2024-09-18T01:28:27.925409+0000","last_peered":"2024-09-18T01:28:27.925409+0000","last_clean":"2024-09-18T01:28:27.925409+0000","last_became_active":"2024-09-18T01:24:56.191713+0000","last_became_peered":"2024-09-18T01:24:56.191713+0000","last_unstale":"2024-09-18T01:28:27.925409+0000","last_undegraded":"2024-09-18T01:28:27.925409+0000","last_fullsized":"2024-09-18T01:28:27.925409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010043490000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:12.924407+0000","last_change":"2024-09-18T01:29:12.924407+0000","last_active":"2024-09-18T01:29:12.924407+0000","last_peered":"2024-09-18T01:29:12.924407+0000","last_clean":"2024-09-18T01:29:12.924407+0000","last_became_active":"2024-09-18T01:25:06.700397+0000","last_became_peered":"2024-09-18T01:25:06.700397+0000","last_unstale":"2024-09-18T01:29:12.924407+0000","last_undegraded":"2024-09-18T01:29:12.924407+0000","last_fullsized":"2024-09-18T01:29:12.924407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:12.924288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:12.924288+0000","last_clean_scrub_stamp":"2024-09-18T01:29:12.924288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:25:17.867300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.497466+0000","last_change":"2024-09-18T01:28:52.497466+0000","last_active":"2024-09-18T01:28:52.497466+0000","last_peered":"2024-09-18T01:28:52.497466+0000","last_clean":"2024-09-18T01:28:52.497466+0000","last_became_active":"2024-09-18T01:25:10.676320+0000","last_became_peered":"2024-09-18T01:25:10.676320+0000","last_unstale":"2024-09-18T01:28:52.497466+0000","last_undegraded":"2024-09-18T01:28:52.497466+0000","last_fullsized":"2024-09-18T01:28:52.497466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:52.497353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:52.497353+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.497353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:53:33.827801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'20","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.994925+0000","last_change":"2024-09-18T01:28:42.995001+0000","last_active":"2024-09-18T01:28:42.994925+0000","last_peered":"2024-09-18T01:28:42.994925+0000","last_clean":"2024-09-18T01:28:42.994925+0000","last_became_active":"2024-09-18T01:25:12.692373+0000","last_became_peered":"2024-09-18T01:25:12.692373+0000","last_unstale":"2024-09-18T01:28:42.994925+0000","last_undegraded":"2024-09-18T01:28:42.994925+0000","last_fullsized":"2024-09-18T01:28:42.994925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:28:42.994815+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:28:42.994815+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.994815+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:43.271590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.107009+0000","last_change":"2024-09-18T01:29:03.107033+0000","last_active":"2024-09-18T01:29:03.107009+0000","last_peered":"2024-09-18T01:29:03.107009+0000","last_clean":"2024-09-18T01:29:03.107009+0000","last_became_active":"2024-09-18T01:25:14.707409+0000","last_became_peered":"2024-09-18T01:25:14.707409+0000","last_unstale":"2024-09-18T01:29:03.107009+0000","last_undegraded":"2024-09-18T01:29:03.107009+0000","last_fullsized":"2024-09-18T01:29:03.107009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:03.106906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:03.106906+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.106906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:24.958182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'6","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.398266+0000","last_change":"2024-09-18T01:29:22.398293+0000","last_active":"2024-09-18T01:29:22.398266+0000","last_peered":"2024-09-18T01:29:22.398266+0000","last_clean":"2024-09-18T01:29:22.398266+0000","last_became_active":"2024-09-18T01:25:16.711104+0000","last_became_peered":"2024-09-18T01:25:16.711104+0000","last_unstale":"2024-09-18T01:29:22.398266+0000","last_undegraded":"2024-09-18T01:29:22.398266+0000","last_fullsized":"2024-09-18T01:29:22.398266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:22.398178+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:22.398178+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.398178+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:15:04.145641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.183724+0000","last_change":"2024-09-18T01:28:50.183724+0000","last_active":"2024-09-18T01:28:50.183724+0000","last_peered":"2024-09-18T01:28:50.183724+0000","last_clean":"2024-09-18T01:28:50.183724+0000","last_became_active":"2024-09-18T01:25:08.687139+0000","last_became_peered":"2024-09-18T01:25:08.687139+0000","last_unstale":"2024-09-18T01:28:50.183724+0000","last_undegraded":"2024-09-18T01:28:50.183724+0000","last_fullsized":"2024-09-18T01:28:50.183724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:50.183577+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:50.183577+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.183577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:25.770565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:10.886037+0000","last_change":"2024-09-18T01:29:10.886037+0000","last_active":"2024-09-18T01:29:10.886037+0000","last_peered":"2024-09-18T01:29:10.886037+0000","last_clean":"2024-09-18T01:29:10.886037+0000","last_became_active":"2024-09-18T01:25:06.691871+0000","last_became_peered":"2024-09-18T01:25:06.691871+0000","last_unstale":"2024-09-18T01:29:10.886037+0000","last_undegraded":"2024-09-18T01:29:10.886037+0000","last_fullsized":"2024-09-18T01:29:10.886037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:10.885874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:10.885874+0000","last_clean_scrub_stamp":"2024-09-18T01:29:10.885874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:27.291671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:13.464330+0000","last_change":"2024-09-18T01:29:13.464359+0000","last_active":"2024-09-18T01:29:13.464330+0000","last_peered":"2024-09-18T01:29:13.464330+0000","last_clean":"2024-09-18T01:29:13.464330+0000","last_became_active":"2024-09-18T01:24:56.191033+0000","last_became_peered":"2024-09-18T01:24:56.191033+0000","last_unstale":"2024-09-18T01:29:13.464330+0000","last_undegraded":"2024-09-18T01:29:13.464330+0000","last_fullsized":"2024-09-18T01:29:13.464330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:13.464088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:13.464088+0000","last_clean_scrub_stamp":"2024-09-18T01:29:13.464088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:17.184392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000547898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.523244+0000","last_change":"2024-09-18T01:28:50.523244+0000","last_active":"2024-09-18T01:28:50.523244+0000","last_peered":"2024-09-18T01:28:50.523244+0000","last_clean":"2024-09-18T01:28:50.523244+0000","last_became_active":"2024-09-18T01:25:10.676531+0000","last_became_peered":"2024-09-18T01:25:10.676531+0000","last_unstale":"2024-09-18T01:28:50.523244+0000","last_undegraded":"2024-09-18T01:28:50.523244+0000","last_fullsized":"2024-09-18T01:28:50.523244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:50.523096+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:50.523096+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.523096+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:41:44.218280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'90","reported_seq":179,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.549893+0000","last_change":"2024-09-18T01:28:36.549893+0000","last_active":"2024-09-18T01:28:36.549893+0000","last_peered":"2024-09-18T01:28:36.549893+0000","last_clean":"2024-09-18T01:28:36.549893+0000","last_became_active":"2024-09-18T01:25:12.693127+0000","last_became_peered":"2024-09-18T01:25:12.693127+0000","last_unstale":"2024-09-18T01:28:36.549893+0000","last_undegraded":"2024-09-18T01:28:36.549893+0000","last_fullsized":"2024-09-18T01:28:36.549893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'90","last_scrub_stamp":"2024-09-18T01:28:36.549705+0000","last_deep_scrub":"35'90","last_deep_scrub_stamp":"2024-09-18T01:28:36.549705+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.549705+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:32.108255+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.622620+0000","last_change":"2024-09-18T01:28:28.622620+0000","last_active":"2024-09-18T01:28:28.622620+0000","last_peered":"2024-09-18T01:28:28.622620+0000","last_clean":"2024-09-18T01:28:28.622620+0000","last_became_active":"2024-09-18T01:25:14.703993+0000","last_became_peered":"2024-09-18T01:25:14.703993+0000","last_unstale":"2024-09-18T01:28:28.622620+0000","last_undegraded":"2024-09-18T01:28:28.622620+0000","last_fullsized":"2024-09-18T01:28:28.622620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:28.622514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:28.622514+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.622514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:15:53.831184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.439480+0000","last_change":"2024-09-18T01:28:55.439559+0000","last_active":"2024-09-18T01:28:55.439480+0000","last_peered":"2024-09-18T01:28:55.439480+0000","last_clean":"2024-09-18T01:28:55.439480+0000","last_became_active":"2024-09-18T01:25:16.703278+0000","last_became_peered":"2024-09-18T01:25:16.703278+0000","last_unstale":"2024-09-18T01:28:55.439480+0000","last_undegraded":"2024-09-18T01:28:55.439480+0000","last_fullsized":"2024-09-18T01:28:55.439480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-18T01:28:55.439368+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-18T01:28:55.439368+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.439368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:24.662471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.209968+0000","last_change":"2024-09-18T01:28:56.209968+0000","last_active":"2024-09-18T01:28:56.209968+0000","last_peered":"2024-09-18T01:28:56.209968+0000","last_clean":"2024-09-18T01:28:56.209968+0000","last_became_active":"2024-09-18T01:25:08.686087+0000","last_became_peered":"2024-09-18T01:25:08.686087+0000","last_unstale":"2024-09-18T01:28:56.209968+0000","last_undegraded":"2024-09-18T01:28:56.209968+0000","last_fullsized":"2024-09-18T01:28:56.209968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:56.209817+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:56.209817+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.209817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:57:02.811375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.466459+0000","last_change":"2024-09-18T01:29:15.466459+0000","last_active":"2024-09-18T01:29:15.466459+0000","last_peered":"2024-09-18T01:29:15.466459+0000","last_clean":"2024-09-18T01:29:15.466459+0000","last_became_active":"2024-09-18T01:25:06.680623+0000","last_became_peered":"2024-09-18T01:25:06.680623+0000","last_unstale":"2024-09-18T01:29:15.466459+0000","last_undegraded":"2024-09-18T01:29:15.466459+0000","last_fullsized":"2024-09-18T01:29:15.466459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:15.466302+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:15.466302+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.466302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:12:48.261541+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.925414+0000","last_change":"2024-09-18T01:24:58.198528+0000","last_active":"2024-09-18T01:28:27.925414+0000","last_peered":"2024-09-18T01:28:27.925414+0000","last_clean":"2024-09-18T01:28:27.925414+0000","last_became_active":"2024-09-18T01:24:56.191687+0000","last_became_peered":"2024-09-18T01:24:56.191687+0000","last_unstale":"2024-09-18T01:28:27.925414+0000","last_undegraded":"2024-09-18T01:28:27.925414+0000","last_fullsized":"2024-09-18T01:28:27.925414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012745390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.087179+0000","last_change":"2024-09-18T01:28:37.087179+0000","last_active":"2024-09-18T01:28:37.087179+0000","last_peered":"2024-09-18T01:28:37.087179+0000","last_clean":"2024-09-18T01:28:37.087179+0000","last_became_active":"2024-09-18T01:25:10.681311+0000","last_became_peered":"2024-09-18T01:25:10.681311+0000","last_unstale":"2024-09-18T01:28:37.087179+0000","last_undegraded":"2024-09-18T01:28:37.087179+0000","last_fullsized":"2024-09-18T01:28:37.087179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:37.087060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:37.087060+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.087060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:59:56.318845+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'29","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.395402+0000","last_change":"2024-09-18T01:28:28.395402+0000","last_active":"2024-09-18T01:28:28.395402+0000","last_peered":"2024-09-18T01:28:28.395402+0000","last_clean":"2024-09-18T01:28:28.395402+0000","last_became_active":"2024-09-18T01:25:12.692357+0000","last_became_peered":"2024-09-18T01:25:12.692357+0000","last_unstale":"2024-09-18T01:28:28.395402+0000","last_undegraded":"2024-09-18T01:28:28.395402+0000","last_fullsized":"2024-09-18T01:28:28.395402+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'29","last_scrub_stamp":"2024-09-18T01:28:28.395277+0000","last_deep_scrub":"35'29","last_deep_scrub_stamp":"2024-09-18T01:28:28.395277+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.395277+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:50.311253+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":399,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:43.280257+0000","last_change":"2024-09-18T01:28:43.280257+0000","last_active":"2024-09-18T01:28:43.280257+0000","last_peered":"2024-09-18T01:28:43.280257+0000","last_clean":"2024-09-18T01:28:43.280257+0000","last_became_active":"2024-09-18T01:25:14.705703+0000","last_became_peered":"2024-09-18T01:25:14.705703+0000","last_unstale":"2024-09-18T01:28:43.280257+0000","last_undegraded":"2024-09-18T01:28:43.280257+0000","last_fullsized":"2024-09-18T01:28:43.280257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:43.280138+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:43.280138+0000","last_clean_scrub_stamp":"2024-09-18T01:28:43.280138+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:32.165248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800057+0000","last_change":"2024-09-18T01:25:16.711811+0000","last_active":"2024-09-18T01:27:34.800057+0000","last_peered":"2024-09-18T01:27:34.800057+0000","last_clean":"2024-09-18T01:27:34.800057+0000","last_became_active":"2024-09-18T01:25:16.711531+0000","last_became_peered":"2024-09-18T01:25:16.711531+0000","last_unstale":"2024-09-18T01:27:34.800057+0000","last_undegraded":"2024-09-18T01:27:34.800057+0000","last_fullsized":"2024-09-18T01:27:34.800057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'20","reported_seq":90,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.122320+0000","last_change":"2024-09-18T01:29:04.122320+0000","last_active":"2024-09-18T01:29:04.122320+0000","last_peered":"2024-09-18T01:29:04.122320+0000","last_clean":"2024-09-18T01:29:04.122320+0000","last_became_active":"2024-09-18T01:25:08.681285+0000","last_became_peered":"2024-09-18T01:25:08.681285+0000","last_unstale":"2024-09-18T01:29:04.122320+0000","last_undegraded":"2024-09-18T01:29:04.122320+0000","last_fullsized":"2024-09-18T01:29:04.122320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:29:04.122206+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:29:04.122206+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.122206+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:24.652487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":56,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797594+0000","last_change":"2024-09-18T01:25:06.684116+0000","last_active":"2024-09-18T01:27:19.797594+0000","last_peered":"2024-09-18T01:27:19.797594+0000","last_clean":"2024-09-18T01:27:19.797594+0000","last_became_active":"2024-09-18T01:25:06.683740+0000","last_became_peered":"2024-09-18T01:25:06.683740+0000","last_unstale":"2024-09-18T01:27:19.797594+0000","last_undegraded":"2024-09-18T01:27:19.797594+0000","last_fullsized":"2024-09-18T01:27:19.797594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:14.448119+0000","last_change":"2024-09-18T01:29:14.448119+0000","last_active":"2024-09-18T01:29:14.448119+0000","last_peered":"2024-09-18T01:29:14.448119+0000","last_clean":"2024-09-18T01:29:14.448119+0000","last_became_active":"2024-09-18T01:24:56.192301+0000","last_became_peered":"2024-09-18T01:24:56.192301+0000","last_unstale":"2024-09-18T01:29:14.448119+0000","last_undegraded":"2024-09-18T01:29:14.448119+0000","last_fullsized":"2024-09-18T01:29:14.448119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:14.447964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:14.447964+0000","last_clean_scrub_stamp":"2024-09-18T01:29:14.447964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:38.190018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056449699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.070061+0000","last_change":"2024-09-18T01:28:30.070061+0000","last_active":"2024-09-18T01:28:30.070061+0000","last_peered":"2024-09-18T01:28:30.070061+0000","last_clean":"2024-09-18T01:28:30.070061+0000","last_became_active":"2024-09-18T01:25:10.682111+0000","last_became_peered":"2024-09-18T01:25:10.682111+0000","last_unstale":"2024-09-18T01:28:30.070061+0000","last_undegraded":"2024-09-18T01:28:30.070061+0000","last_fullsized":"2024-09-18T01:28:30.070061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:30.069896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:30.069896+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.069896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:14.982005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'23","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.044578+0000","last_change":"2024-09-18T01:28:41.044578+0000","last_active":"2024-09-18T01:28:41.044578+0000","last_peered":"2024-09-18T01:28:41.044578+0000","last_clean":"2024-09-18T01:28:41.044578+0000","last_became_active":"2024-09-18T01:25:12.692313+0000","last_became_peered":"2024-09-18T01:25:12.692313+0000","last_unstale":"2024-09-18T01:28:41.044578+0000","last_undegraded":"2024-09-18T01:28:41.044578+0000","last_fullsized":"2024-09-18T01:28:41.044578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-09-18T01:28:41.044429+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-09-18T01:28:41.044429+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.044429+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:56.982066+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":411,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.567260+0000","last_change":"2024-09-18T01:28:34.567260+0000","last_active":"2024-09-18T01:28:34.567260+0000","last_peered":"2024-09-18T01:28:34.567260+0000","last_clean":"2024-09-18T01:28:34.567260+0000","last_became_active":"2024-09-18T01:25:14.698755+0000","last_became_peered":"2024-09-18T01:25:14.698755+0000","last_unstale":"2024-09-18T01:28:34.567260+0000","last_undegraded":"2024-09-18T01:28:34.567260+0000","last_fullsized":"2024-09-18T01:28:34.567260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:34.567070+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:34.567070+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.567070+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:46:39.422894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800041+0000","last_change":"2024-09-18T01:25:16.712818+0000","last_active":"2024-09-18T01:27:34.800041+0000","last_peered":"2024-09-18T01:27:34.800041+0000","last_clean":"2024-09-18T01:27:34.800041+0000","last_became_active":"2024-09-18T01:25:16.712556+0000","last_became_peered":"2024-09-18T01:25:16.712556+0000","last_unstale":"2024-09-18T01:27:34.800041+0000","last_undegraded":"2024-09-18T01:27:34.800041+0000","last_fullsized":"2024-09-18T01:27:34.800041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'14","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.895871+0000","last_change":"2024-09-18T01:29:01.895871+0000","last_active":"2024-09-18T01:29:01.895871+0000","last_peered":"2024-09-18T01:29:01.895871+0000","last_clean":"2024-09-18T01:29:01.895871+0000","last_became_active":"2024-09-18T01:25:08.674560+0000","last_became_peered":"2024-09-18T01:25:08.674560+0000","last_unstale":"2024-09-18T01:29:01.895871+0000","last_undegraded":"2024-09-18T01:29:01.895871+0000","last_fullsized":"2024-09-18T01:29:01.895871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-18T01:29:01.895707+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-18T01:29:01.895707+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.895707+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:56.827853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.309038+0000","last_change":"2024-09-18T01:29:04.309098+0000","last_active":"2024-09-18T01:29:04.309038+0000","last_peered":"2024-09-18T01:29:04.309038+0000","last_clean":"2024-09-18T01:29:04.309038+0000","last_became_active":"2024-09-18T01:25:06.686277+0000","last_became_peered":"2024-09-18T01:25:06.686277+0000","last_unstale":"2024-09-18T01:29:04.309038+0000","last_undegraded":"2024-09-18T01:29:04.309038+0000","last_fullsized":"2024-09-18T01:29:04.309038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:04.308925+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:04.308925+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.308925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:20.714722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.925616+0000","last_change":"2024-09-18T01:24:58.198307+0000","last_active":"2024-09-18T01:28:27.925616+0000","last_peered":"2024-09-18T01:28:27.925616+0000","last_clean":"2024-09-18T01:28:27.925616+0000","last_became_active":"2024-09-18T01:24:56.602991+0000","last_became_peered":"2024-09-18T01:24:56.602991+0000","last_unstale":"2024-09-18T01:28:27.925616+0000","last_undegraded":"2024-09-18T01:28:27.925616+0000","last_fullsized":"2024-09-18T01:28:27.925616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:24:55.181905+0000","last_clean_scrub_stamp":"2024-09-18T01:24:55.181905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077351,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.105468+0000","last_change":"2024-09-18T01:28:28.105468+0000","last_active":"2024-09-18T01:28:28.105468+0000","last_peered":"2024-09-18T01:28:28.105468+0000","last_clean":"2024-09-18T01:28:28.105468+0000","last_became_active":"2024-09-18T01:25:10.682057+0000","last_became_peered":"2024-09-18T01:25:10.682057+0000","last_unstale":"2024-09-18T01:28:28.105468+0000","last_undegraded":"2024-09-18T01:28:28.105468+0000","last_fullsized":"2024-09-18T01:28:28.105468+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:28.105351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:28.105351+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.105351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:52:34.334975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'104","reported_seq":204,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.726873+0000","last_change":"2024-09-18T01:28:35.726873+0000","last_active":"2024-09-18T01:28:35.726873+0000","last_peered":"2024-09-18T01:28:35.726873+0000","last_clean":"2024-09-18T01:28:35.726873+0000","last_became_active":"2024-09-18T01:25:12.694361+0000","last_became_peered":"2024-09-18T01:25:12.694361+0000","last_unstale":"2024-09-18T01:28:35.726873+0000","last_undegraded":"2024-09-18T01:28:35.726873+0000","last_fullsized":"2024-09-18T01:28:35.726873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'104","last_scrub_stamp":"2024-09-18T01:28:35.726737+0000","last_deep_scrub":"35'104","last_deep_scrub_stamp":"2024-09-18T01:28:35.726737+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.726737+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:56.458829+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.552741+0000","last_change":"2024-09-18T01:28:39.552741+0000","last_active":"2024-09-18T01:28:39.552741+0000","last_peered":"2024-09-18T01:28:39.552741+0000","last_clean":"2024-09-18T01:28:39.552741+0000","last_became_active":"2024-09-18T01:25:14.706960+0000","last_became_peered":"2024-09-18T01:25:14.706960+0000","last_unstale":"2024-09-18T01:28:39.552741+0000","last_undegraded":"2024-09-18T01:28:39.552741+0000","last_fullsized":"2024-09-18T01:28:39.552741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:39.552625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:39.552625+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.552625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:28.437734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"33'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:16.932450+0000","last_change":"2024-09-18T01:29:16.932474+0000","last_active":"2024-09-18T01:29:16.932450+0000","last_peered":"2024-09-18T01:29:16.932450+0000","last_clean":"2024-09-18T01:29:16.932450+0000","last_became_active":"2024-09-18T01:25:16.716607+0000","last_became_peered":"2024-09-18T01:25:16.716607+0000","last_unstale":"2024-09-18T01:29:16.932450+0000","last_undegraded":"2024-09-18T01:29:16.932450+0000","last_fullsized":"2024-09-18T01:29:16.932450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:16.932352+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:16.932352+0000","last_clean_scrub_stamp":"2024-09-18T01:29:16.932352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:57.817343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:17.899165+0000","last_change":"2024-09-18T01:29:17.899188+0000","last_active":"2024-09-18T01:29:17.899165+0000","last_peered":"2024-09-18T01:29:17.899165+0000","last_clean":"2024-09-18T01:29:17.899165+0000","last_became_active":"2024-09-18T01:25:16.716867+0000","last_became_peered":"2024-09-18T01:25:16.716867+0000","last_unstale":"2024-09-18T01:29:17.899165+0000","last_undegraded":"2024-09-18T01:29:17.899165+0000","last_fullsized":"2024-09-18T01:29:17.899165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:17.899080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:17.899080+0000","last_clean_scrub_stamp":"2024-09-18T01:29:17.899080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:44.321407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:05.764214+0000","last_change":"2024-09-18T01:29:05.764239+0000","last_active":"2024-09-18T01:29:05.764214+0000","last_peered":"2024-09-18T01:29:05.764214+0000","last_clean":"2024-09-18T01:29:05.764214+0000","last_became_active":"2024-09-18T01:25:08.675590+0000","last_became_peered":"2024-09-18T01:25:08.675590+0000","last_unstale":"2024-09-18T01:29:05.764214+0000","last_undegraded":"2024-09-18T01:29:05.764214+0000","last_fullsized":"2024-09-18T01:29:05.764214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:05.764128+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:05.764128+0000","last_clean_scrub_stamp":"2024-09-18T01:29:05.764128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:09.224112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799147+0000","last_change":"2024-09-18T01:25:06.693775+0000","last_active":"2024-09-18T01:27:29.799147+0000","last_peered":"2024-09-18T01:27:29.799147+0000","last_clean":"2024-09-18T01:27:29.799147+0000","last_became_active":"2024-09-18T01:25:06.689996+0000","last_became_peered":"2024-09-18T01:25:06.689996+0000","last_unstale":"2024-09-18T01:27:29.799147+0000","last_undegraded":"2024-09-18T01:27:29.799147+0000","last_fullsized":"2024-09-18T01:27:29.799147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.304703+0000","last_change":"2024-09-18T01:28:38.304730+0000","last_active":"2024-09-18T01:28:38.304703+0000","last_peered":"2024-09-18T01:28:38.304703+0000","last_clean":"2024-09-18T01:28:38.304703+0000","last_became_active":"2024-09-18T01:25:10.679704+0000","last_became_peered":"2024-09-18T01:25:10.679704+0000","last_unstale":"2024-09-18T01:28:38.304703+0000","last_undegraded":"2024-09-18T01:28:38.304703+0000","last_fullsized":"2024-09-18T01:28:38.304703+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:38.304607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:38.304607+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.304607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:00.590243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'47","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.045384+0000","last_change":"2024-09-18T01:28:56.045435+0000","last_active":"2024-09-18T01:28:56.045384+0000","last_peered":"2024-09-18T01:28:56.045384+0000","last_clean":"2024-09-18T01:28:56.045384+0000","last_became_active":"2024-09-18T01:25:12.692870+0000","last_became_peered":"2024-09-18T01:25:12.692870+0000","last_unstale":"2024-09-18T01:28:56.045384+0000","last_undegraded":"2024-09-18T01:28:56.045384+0000","last_fullsized":"2024-09-18T01:28:56.045384+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-09-18T01:28:56.045290+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-09-18T01:28:56.045290+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.045290+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:42:03.283767+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.058508+0000","last_change":"2024-09-18T01:28:49.058531+0000","last_active":"2024-09-18T01:28:49.058508+0000","last_peered":"2024-09-18T01:28:49.058508+0000","last_clean":"2024-09-18T01:28:49.058508+0000","last_became_active":"2024-09-18T01:25:14.706381+0000","last_became_peered":"2024-09-18T01:25:14.706381+0000","last_unstale":"2024-09-18T01:28:49.058508+0000","last_undegraded":"2024-09-18T01:28:49.058508+0000","last_fullsized":"2024-09-18T01:28:49.058508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:49.058417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:49.058417+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.058417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:09.897723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'17","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.472284+0000","last_change":"2024-09-18T01:28:51.472284+0000","last_active":"2024-09-18T01:28:51.472284+0000","last_peered":"2024-09-18T01:28:51.472284+0000","last_clean":"2024-09-18T01:28:51.472284+0000","last_became_active":"2024-09-18T01:25:16.703227+0000","last_became_peered":"2024-09-18T01:25:16.703227+0000","last_unstale":"2024-09-18T01:28:51.472284+0000","last_undegraded":"2024-09-18T01:28:51.472284+0000","last_fullsized":"2024-09-18T01:28:51.472284+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-18T01:28:51.472131+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-18T01:28:51.472131+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.472131+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:46:57.519168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.271075+0000","last_change":"2024-09-18T01:28:48.271102+0000","last_active":"2024-09-18T01:28:48.271075+0000","last_peered":"2024-09-18T01:28:48.271075+0000","last_clean":"2024-09-18T01:28:48.271075+0000","last_became_active":"2024-09-18T01:25:08.687482+0000","last_became_peered":"2024-09-18T01:25:08.687482+0000","last_unstale":"2024-09-18T01:28:48.271075+0000","last_undegraded":"2024-09-18T01:28:48.271075+0000","last_fullsized":"2024-09-18T01:28:48.271075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:28:48.270983+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:28:48.270983+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.270983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:51.899321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.803452+0000","last_change":"2024-09-18T01:28:54.803480+0000","last_active":"2024-09-18T01:28:54.803452+0000","last_peered":"2024-09-18T01:28:54.803452+0000","last_clean":"2024-09-18T01:28:54.803452+0000","last_became_active":"2024-09-18T01:25:06.705406+0000","last_became_peered":"2024-09-18T01:25:06.705406+0000","last_unstale":"2024-09-18T01:28:54.803452+0000","last_undegraded":"2024-09-18T01:28:54.803452+0000","last_fullsized":"2024-09-18T01:28:54.803452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:54.803363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:54.803363+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.803363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:05:32.221186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.114679+0000","last_change":"2024-09-18T01:28:29.114710+0000","last_active":"2024-09-18T01:28:29.114679+0000","last_peered":"2024-09-18T01:28:29.114679+0000","last_clean":"2024-09-18T01:28:29.114679+0000","last_became_active":"2024-09-18T01:25:10.682230+0000","last_became_peered":"2024-09-18T01:25:10.682230+0000","last_unstale":"2024-09-18T01:28:29.114679+0000","last_undegraded":"2024-09-18T01:28:29.114679+0000","last_fullsized":"2024-09-18T01:28:29.114679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.114588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.114588+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.114588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:42:02.700134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.620008+0000","last_change":"2024-09-18T01:28:41.620043+0000","last_active":"2024-09-18T01:28:41.620008+0000","last_peered":"2024-09-18T01:28:41.620008+0000","last_clean":"2024-09-18T01:28:41.620008+0000","last_became_active":"2024-09-18T01:25:12.687018+0000","last_became_peered":"2024-09-18T01:25:12.687018+0000","last_unstale":"2024-09-18T01:28:41.620008+0000","last_undegraded":"2024-09-18T01:28:41.620008+0000","last_fullsized":"2024-09-18T01:28:41.620008+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:41.619916+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:41.619916+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.619916+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:43.740728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.669948+0000","last_change":"2024-09-18T01:28:29.669975+0000","last_active":"2024-09-18T01:28:29.669948+0000","last_peered":"2024-09-18T01:28:29.669948+0000","last_clean":"2024-09-18T01:28:29.669948+0000","last_became_active":"2024-09-18T01:25:14.707008+0000","last_became_peered":"2024-09-18T01:25:14.707008+0000","last_unstale":"2024-09-18T01:28:29.669948+0000","last_undegraded":"2024-09-18T01:28:29.669948+0000","last_fullsized":"2024-09-18T01:28:29.669948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.669852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.669852+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.669852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:18.373919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:26.482777+0000","last_change":"2024-09-18T01:29:26.482829+0000","last_active":"2024-09-18T01:29:26.482777+0000","last_peered":"2024-09-18T01:29:26.482777+0000","last_clean":"2024-09-18T01:29:26.482777+0000","last_became_active":"2024-09-18T01:25:16.714160+0000","last_became_peered":"2024-09-18T01:25:16.714160+0000","last_unstale":"2024-09-18T01:29:26.482777+0000","last_undegraded":"2024-09-18T01:29:26.482777+0000","last_fullsized":"2024-09-18T01:29:26.482777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:26.482657+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:26.482657+0000","last_clean_scrub_stamp":"2024-09-18T01:29:26.482657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:06:53.262007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.422795+0000","last_change":"2024-09-18T01:29:01.422822+0000","last_active":"2024-09-18T01:29:01.422795+0000","last_peered":"2024-09-18T01:29:01.422795+0000","last_clean":"2024-09-18T01:29:01.422795+0000","last_became_active":"2024-09-18T01:25:08.671365+0000","last_became_peered":"2024-09-18T01:25:08.671365+0000","last_unstale":"2024-09-18T01:29:01.422795+0000","last_undegraded":"2024-09-18T01:29:01.422795+0000","last_fullsized":"2024-09-18T01:29:01.422795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:01.422709+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:01.422709+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.422709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:17.828506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.855381+0000","last_change":"2024-09-18T01:29:02.855411+0000","last_active":"2024-09-18T01:29:02.855381+0000","last_peered":"2024-09-18T01:29:02.855381+0000","last_clean":"2024-09-18T01:29:02.855381+0000","last_became_active":"2024-09-18T01:25:06.703081+0000","last_became_peered":"2024-09-18T01:25:06.703081+0000","last_unstale":"2024-09-18T01:29:02.855381+0000","last_undegraded":"2024-09-18T01:29:02.855381+0000","last_fullsized":"2024-09-18T01:29:02.855381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:02.855275+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:02.855275+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.855275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:21.389785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.718726+0000","last_change":"2024-09-18T01:28:44.718746+0000","last_active":"2024-09-18T01:28:44.718726+0000","last_peered":"2024-09-18T01:28:44.718726+0000","last_clean":"2024-09-18T01:28:44.718726+0000","last_became_active":"2024-09-18T01:25:10.680316+0000","last_became_peered":"2024-09-18T01:25:10.680316+0000","last_unstale":"2024-09-18T01:28:44.718726+0000","last_undegraded":"2024-09-18T01:28:44.718726+0000","last_fullsized":"2024-09-18T01:28:44.718726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:44.718622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:44.718622+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.718622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:03.968563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'47","reported_seq":119,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.607584+0000","last_change":"2024-09-18T01:28:42.607643+0000","last_active":"2024-09-18T01:28:42.607584+0000","last_peered":"2024-09-18T01:28:42.607584+0000","last_clean":"2024-09-18T01:28:42.607584+0000","last_became_active":"2024-09-18T01:25:12.682270+0000","last_became_peered":"2024-09-18T01:25:12.682270+0000","last_unstale":"2024-09-18T01:28:42.607584+0000","last_undegraded":"2024-09-18T01:28:42.607584+0000","last_fullsized":"2024-09-18T01:28:42.607584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-09-18T01:28:42.607487+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-09-18T01:28:42.607487+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.607487+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:54.508090+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.271313+0000","last_change":"2024-09-18T01:28:39.271337+0000","last_active":"2024-09-18T01:28:39.271313+0000","last_peered":"2024-09-18T01:28:39.271313+0000","last_clean":"2024-09-18T01:28:39.271313+0000","last_became_active":"2024-09-18T01:25:14.703583+0000","last_became_peered":"2024-09-18T01:25:14.703583+0000","last_unstale":"2024-09-18T01:28:39.271313+0000","last_undegraded":"2024-09-18T01:28:39.271313+0000","last_fullsized":"2024-09-18T01:28:39.271313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:39.271224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:39.271224+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.271224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:54.971763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:49.802344+0000","last_change":"2024-09-18T01:25:16.714459+0000","last_active":"2024-09-18T01:27:49.802344+0000","last_peered":"2024-09-18T01:27:49.802344+0000","last_clean":"2024-09-18T01:27:49.802344+0000","last_became_active":"2024-09-18T01:25:16.714061+0000","last_became_peered":"2024-09-18T01:25:16.714061+0000","last_unstale":"2024-09-18T01:27:49.802344+0000","last_undegraded":"2024-09-18T01:27:49.802344+0000","last_fullsized":"2024-09-18T01:27:49.802344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.003975+0000","last_change":"2024-09-18T01:28:46.004012+0000","last_active":"2024-09-18T01:28:46.003975+0000","last_peered":"2024-09-18T01:28:46.003975+0000","last_clean":"2024-09-18T01:28:46.003975+0000","last_became_active":"2024-09-18T01:25:08.688016+0000","last_became_peered":"2024-09-18T01:25:08.688016+0000","last_unstale":"2024-09-18T01:28:46.003975+0000","last_undegraded":"2024-09-18T01:28:46.003975+0000","last_fullsized":"2024-09-18T01:28:46.003975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:46.003879+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:46.003879+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.003879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:50.020572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:10.337492+0000","last_change":"2024-09-18T01:29:10.337537+0000","last_active":"2024-09-18T01:29:10.337492+0000","last_peered":"2024-09-18T01:29:10.337492+0000","last_clean":"2024-09-18T01:29:10.337492+0000","last_became_active":"2024-09-18T01:25:06.688747+0000","last_became_peered":"2024-09-18T01:25:06.688747+0000","last_unstale":"2024-09-18T01:29:10.337492+0000","last_undegraded":"2024-09-18T01:29:10.337492+0000","last_fullsized":"2024-09-18T01:29:10.337492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:10.337368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:10.337368+0000","last_clean_scrub_stamp":"2024-09-18T01:29:10.337368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:51.222358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.109559+0000","last_change":"2024-09-18T01:28:38.109581+0000","last_active":"2024-09-18T01:28:38.109559+0000","last_peered":"2024-09-18T01:28:38.109559+0000","last_clean":"2024-09-18T01:28:38.109559+0000","last_became_active":"2024-09-18T01:25:10.680831+0000","last_became_peered":"2024-09-18T01:25:10.680831+0000","last_unstale":"2024-09-18T01:28:38.109559+0000","last_undegraded":"2024-09-18T01:28:38.109559+0000","last_fullsized":"2024-09-18T01:28:38.109559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:38.109472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:38.109472+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.109472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:44.941883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.715067+0000","last_change":"2024-09-18T01:28:42.715108+0000","last_active":"2024-09-18T01:28:42.715067+0000","last_peered":"2024-09-18T01:28:42.715067+0000","last_clean":"2024-09-18T01:28:42.715067+0000","last_became_active":"2024-09-18T01:25:12.686918+0000","last_became_peered":"2024-09-18T01:25:12.686918+0000","last_unstale":"2024-09-18T01:28:42.715067+0000","last_undegraded":"2024-09-18T01:28:42.715067+0000","last_fullsized":"2024-09-18T01:28:42.715067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-18T01:28:42.714970+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-18T01:28:42.714970+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.714970+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:01:05.208541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.654223+0000","last_change":"2024-09-18T01:28:32.654249+0000","last_active":"2024-09-18T01:28:32.654223+0000","last_peered":"2024-09-18T01:28:32.654223+0000","last_clean":"2024-09-18T01:28:32.654223+0000","last_became_active":"2024-09-18T01:25:14.695120+0000","last_became_peered":"2024-09-18T01:25:14.695120+0000","last_unstale":"2024-09-18T01:28:32.654223+0000","last_undegraded":"2024-09-18T01:28:32.654223+0000","last_fullsized":"2024-09-18T01:28:32.654223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:32.654135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:32.654135+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.654135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:02:10.947460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:08.068938+0000","last_change":"2024-09-18T01:29:08.068938+0000","last_active":"2024-09-18T01:29:08.068938+0000","last_peered":"2024-09-18T01:29:08.068938+0000","last_clean":"2024-09-18T01:29:08.068938+0000","last_became_active":"2024-09-18T01:25:08.677941+0000","last_became_peered":"2024-09-18T01:25:08.677941+0000","last_unstale":"2024-09-18T01:29:08.068938+0000","last_undegraded":"2024-09-18T01:29:08.068938+0000","last_fullsized":"2024-09-18T01:29:08.068938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:08.068815+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:08.068815+0000","last_clean_scrub_stamp":"2024-09-18T01:29:08.068815+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:33:09.305362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:20.091205+0000","last_change":"2024-09-18T01:29:20.091256+0000","last_active":"2024-09-18T01:29:20.091205+0000","last_peered":"2024-09-18T01:29:20.091205+0000","last_clean":"2024-09-18T01:29:20.091205+0000","last_became_active":"2024-09-18T01:25:06.692823+0000","last_became_peered":"2024-09-18T01:25:06.692823+0000","last_unstale":"2024-09-18T01:29:20.091205+0000","last_undegraded":"2024-09-18T01:29:20.091205+0000","last_fullsized":"2024-09-18T01:29:20.091205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:20.091088+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:20.091088+0000","last_clean_scrub_stamp":"2024-09-18T01:29:20.091088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:25.879095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.590054+0000","last_change":"2024-09-18T01:28:46.590054+0000","last_active":"2024-09-18T01:28:46.590054+0000","last_peered":"2024-09-18T01:28:46.590054+0000","last_clean":"2024-09-18T01:28:46.590054+0000","last_became_active":"2024-09-18T01:25:10.677481+0000","last_became_peered":"2024-09-18T01:25:10.677481+0000","last_unstale":"2024-09-18T01:28:46.590054+0000","last_undegraded":"2024-09-18T01:28:46.590054+0000","last_fullsized":"2024-09-18T01:28:46.590054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:46.589926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:46.589926+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.589926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:21:01.356370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'71","reported_seq":150,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.576795+0000","last_change":"2024-09-18T01:28:40.576840+0000","last_active":"2024-09-18T01:28:40.576795+0000","last_peered":"2024-09-18T01:28:40.576795+0000","last_clean":"2024-09-18T01:28:40.576795+0000","last_became_active":"2024-09-18T01:25:12.687014+0000","last_became_peered":"2024-09-18T01:25:12.687014+0000","last_unstale":"2024-09-18T01:28:40.576795+0000","last_undegraded":"2024-09-18T01:28:40.576795+0000","last_fullsized":"2024-09-18T01:28:40.576795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'71","last_scrub_stamp":"2024-09-18T01:28:40.576711+0000","last_deep_scrub":"35'71","last_deep_scrub_stamp":"2024-09-18T01:28:40.576711+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.576711+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:02:19.666203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.637762+0000","last_change":"2024-09-18T01:28:31.637788+0000","last_active":"2024-09-18T01:28:31.637762+0000","last_peered":"2024-09-18T01:28:31.637762+0000","last_clean":"2024-09-18T01:28:31.637762+0000","last_became_active":"2024-09-18T01:25:14.698753+0000","last_became_peered":"2024-09-18T01:25:14.698753+0000","last_unstale":"2024-09-18T01:28:31.637762+0000","last_undegraded":"2024-09-18T01:28:31.637762+0000","last_fullsized":"2024-09-18T01:28:31.637762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.637674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.637674+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.637674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:05:28.601978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'20","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:25.471860+0000","last_change":"2024-09-18T01:29:25.471884+0000","last_active":"2024-09-18T01:29:25.471860+0000","last_peered":"2024-09-18T01:29:25.471860+0000","last_clean":"2024-09-18T01:29:25.471860+0000","last_became_active":"2024-09-18T01:25:16.713750+0000","last_became_peered":"2024-09-18T01:25:16.713750+0000","last_unstale":"2024-09-18T01:29:25.471860+0000","last_undegraded":"2024-09-18T01:29:25.471860+0000","last_fullsized":"2024-09-18T01:29:25.471860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:29:25.471720+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:29:25.471720+0000","last_clean_scrub_stamp":"2024-09-18T01:29:25.471720+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:52.495077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:21.531580+0000","last_change":"2024-09-18T01:29:21.531608+0000","last_active":"2024-09-18T01:29:21.531580+0000","last_peered":"2024-09-18T01:29:21.531580+0000","last_clean":"2024-09-18T01:29:21.531580+0000","last_became_active":"2024-09-18T01:25:08.680604+0000","last_became_peered":"2024-09-18T01:25:08.680604+0000","last_unstale":"2024-09-18T01:29:21.531580+0000","last_undegraded":"2024-09-18T01:29:21.531580+0000","last_fullsized":"2024-09-18T01:29:21.531580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:21.531492+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:21.531492+0000","last_clean_scrub_stamp":"2024-09-18T01:29:21.531492+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:47.902528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:20.338164+0000","last_change":"2024-09-18T01:29:20.338195+0000","last_active":"2024-09-18T01:29:20.338164+0000","last_peered":"2024-09-18T01:29:20.338164+0000","last_clean":"2024-09-18T01:29:20.338164+0000","last_became_active":"2024-09-18T01:25:06.686125+0000","last_became_peered":"2024-09-18T01:25:06.686125+0000","last_unstale":"2024-09-18T01:29:20.338164+0000","last_undegraded":"2024-09-18T01:29:20.338164+0000","last_fullsized":"2024-09-18T01:29:20.338164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:20.338067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:20.338067+0000","last_clean_scrub_stamp":"2024-09-18T01:29:20.338067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:00:59.574989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"35'5","reported_seq":248,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.771802+0000","last_change":"2024-09-18T01:29:22.771832+0000","last_active":"2024-09-18T01:29:22.771802+0000","last_peered":"2024-09-18T01:29:22.771802+0000","last_clean":"2024-09-18T01:29:22.771802+0000","last_became_active":"2024-09-18T01:25:43.908273+0000","last_became_peered":"2024-09-18T01:25:43.908273+0000","last_unstale":"2024-09-18T01:29:22.771802+0000","last_undegraded":"2024-09-18T01:29:22.771802+0000","last_fullsized":"2024-09-18T01:29:22.771802+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-18T01:29:22.771713+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-18T01:29:22.771713+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.771713+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:26.492018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.076283+0000","last_change":"2024-09-18T01:29:00.076347+0000","last_active":"2024-09-18T01:29:00.076283+0000","last_peered":"2024-09-18T01:29:00.076283+0000","last_clean":"2024-09-18T01:29:00.076283+0000","last_became_active":"2024-09-18T01:25:12.692486+0000","last_became_peered":"2024-09-18T01:25:12.692486+0000","last_unstale":"2024-09-18T01:29:00.076283+0000","last_undegraded":"2024-09-18T01:29:00.076283+0000","last_fullsized":"2024-09-18T01:29:00.076283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:29:00.076171+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:29:00.076171+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.076171+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:57:19.965536+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.203333+0000","last_change":"2024-09-18T01:28:51.203356+0000","last_active":"2024-09-18T01:28:51.203333+0000","last_peered":"2024-09-18T01:28:51.203333+0000","last_clean":"2024-09-18T01:28:51.203333+0000","last_became_active":"2024-09-18T01:25:14.709980+0000","last_became_peered":"2024-09-18T01:25:14.709980+0000","last_unstale":"2024-09-18T01:28:51.203333+0000","last_undegraded":"2024-09-18T01:28:51.203333+0000","last_fullsized":"2024-09-18T01:28:51.203333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:51.203243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:51.203243+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.203243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:37:51.114618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:19.057956+0000","last_change":"2024-09-18T01:29:19.057982+0000","last_active":"2024-09-18T01:29:19.057956+0000","last_peered":"2024-09-18T01:29:19.057956+0000","last_clean":"2024-09-18T01:29:19.057956+0000","last_became_active":"2024-09-18T01:25:16.708905+0000","last_became_peered":"2024-09-18T01:25:16.708905+0000","last_unstale":"2024-09-18T01:29:19.057956+0000","last_undegraded":"2024-09-18T01:29:19.057956+0000","last_fullsized":"2024-09-18T01:29:19.057956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:19.057861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:19.057861+0000","last_clean_scrub_stamp":"2024-09-18T01:29:19.057861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:45.617512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'6","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.081418+0000","last_change":"2024-09-18T01:28:40.081446+0000","last_active":"2024-09-18T01:28:40.081418+0000","last_peered":"2024-09-18T01:28:40.081418+0000","last_clean":"2024-09-18T01:28:40.081418+0000","last_became_active":"2024-09-18T01:25:08.688610+0000","last_became_peered":"2024-09-18T01:25:08.688610+0000","last_unstale":"2024-09-18T01:28:40.081418+0000","last_undegraded":"2024-09-18T01:28:40.081418+0000","last_fullsized":"2024-09-18T01:28:40.081418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:40.081320+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:40.081320+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.081320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:49.789353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.319196+0000","last_change":"2024-09-18T01:29:15.319222+0000","last_active":"2024-09-18T01:29:15.319196+0000","last_peered":"2024-09-18T01:29:15.319196+0000","last_clean":"2024-09-18T01:29:15.319196+0000","last_became_active":"2024-09-18T01:25:06.685167+0000","last_became_peered":"2024-09-18T01:25:06.685167+0000","last_unstale":"2024-09-18T01:29:15.319196+0000","last_undegraded":"2024-09-18T01:29:15.319196+0000","last_fullsized":"2024-09-18T01:29:15.319196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:15.319106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:15.319106+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.319106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:05:39.685673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.752136+0000","last_change":"2024-09-18T01:28:46.752160+0000","last_active":"2024-09-18T01:28:46.752136+0000","last_peered":"2024-09-18T01:28:46.752136+0000","last_clean":"2024-09-18T01:28:46.752136+0000","last_became_active":"2024-09-18T01:25:10.678586+0000","last_became_peered":"2024-09-18T01:25:10.678586+0000","last_unstale":"2024-09-18T01:28:46.752136+0000","last_undegraded":"2024-09-18T01:28:46.752136+0000","last_fullsized":"2024-09-18T01:28:46.752136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:46.752053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:46.752053+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.752053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:18:54.078274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'46","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.589617+0000","last_change":"2024-09-18T01:28:38.589617+0000","last_active":"2024-09-18T01:28:38.589617+0000","last_peered":"2024-09-18T01:28:38.589617+0000","last_clean":"2024-09-18T01:28:38.589617+0000","last_became_active":"2024-09-18T01:25:12.687935+0000","last_became_peered":"2024-09-18T01:25:12.687935+0000","last_unstale":"2024-09-18T01:28:38.589617+0000","last_undegraded":"2024-09-18T01:28:38.589617+0000","last_fullsized":"2024-09-18T01:28:38.589617+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:38.589489+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:38.589489+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.589489+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:04:54.499330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.683121+0000","last_change":"2024-09-18T01:28:30.683121+0000","last_active":"2024-09-18T01:28:30.683121+0000","last_peered":"2024-09-18T01:28:30.683121+0000","last_clean":"2024-09-18T01:28:30.683121+0000","last_became_active":"2024-09-18T01:25:14.701702+0000","last_became_peered":"2024-09-18T01:25:14.701702+0000","last_unstale":"2024-09-18T01:28:30.683121+0000","last_undegraded":"2024-09-18T01:28:30.683121+0000","last_fullsized":"2024-09-18T01:28:30.683121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:30.682992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:30.682992+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.682992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:55.879755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800702+0000","last_change":"2024-09-18T01:25:16.716015+0000","last_active":"2024-09-18T01:27:39.800702+0000","last_peered":"2024-09-18T01:27:39.800702+0000","last_clean":"2024-09-18T01:27:39.800702+0000","last_became_active":"2024-09-18T01:25:16.715669+0000","last_became_peered":"2024-09-18T01:25:16.715669+0000","last_unstale":"2024-09-18T01:27:39.800702+0000","last_undegraded":"2024-09-18T01:27:39.800702+0000","last_fullsized":"2024-09-18T01:27:39.800702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"35'16","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.428199+0000","last_change":"2024-09-18T01:29:03.428235+0000","last_active":"2024-09-18T01:29:03.428199+0000","last_peered":"2024-09-18T01:29:03.428199+0000","last_clean":"2024-09-18T01:29:03.428199+0000","last_became_active":"2024-09-18T01:25:08.672541+0000","last_became_peered":"2024-09-18T01:25:08.672541+0000","last_unstale":"2024-09-18T01:29:03.428199+0000","last_undegraded":"2024-09-18T01:29:03.428199+0000","last_fullsized":"2024-09-18T01:29:03.428199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-18T01:29:03.428109+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-18T01:29:03.428109+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.428109+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:25:08.371120+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800796+0000","last_change":"2024-09-18T01:25:06.687447+0000","last_active":"2024-09-18T01:27:39.800796+0000","last_peered":"2024-09-18T01:27:39.800796+0000","last_clean":"2024-09-18T01:27:39.800796+0000","last_became_active":"2024-09-18T01:25:06.684658+0000","last_became_peered":"2024-09-18T01:25:06.684658+0000","last_unstale":"2024-09-18T01:27:39.800796+0000","last_undegraded":"2024-09-18T01:27:39.800796+0000","last_fullsized":"2024-09-18T01:27:39.800796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.324781+0000","last_change":"2024-09-18T01:28:44.324803+0000","last_active":"2024-09-18T01:28:44.324781+0000","last_peered":"2024-09-18T01:28:44.324781+0000","last_clean":"2024-09-18T01:28:44.324781+0000","last_became_active":"2024-09-18T01:25:10.679369+0000","last_became_peered":"2024-09-18T01:25:10.679369+0000","last_unstale":"2024-09-18T01:28:44.324781+0000","last_undegraded":"2024-09-18T01:28:44.324781+0000","last_fullsized":"2024-09-18T01:28:44.324781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:44.324660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:44.324660+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.324660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:21.528723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'22","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.075434+0000","last_change":"2024-09-18T01:28:52.075434+0000","last_active":"2024-09-18T01:28:52.075434+0000","last_peered":"2024-09-18T01:28:52.075434+0000","last_clean":"2024-09-18T01:28:52.075434+0000","last_became_active":"2024-09-18T01:25:12.696757+0000","last_became_peered":"2024-09-18T01:25:12.696757+0000","last_unstale":"2024-09-18T01:28:52.075434+0000","last_undegraded":"2024-09-18T01:28:52.075434+0000","last_fullsized":"2024-09-18T01:28:52.075434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-18T01:28:52.075306+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-18T01:28:52.075306+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.075306+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:59:02.612796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":385,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.663311+0000","last_change":"2024-09-18T01:28:33.663311+0000","last_active":"2024-09-18T01:28:33.663311+0000","last_peered":"2024-09-18T01:28:33.663311+0000","last_clean":"2024-09-18T01:28:33.663311+0000","last_became_active":"2024-09-18T01:25:14.708840+0000","last_became_peered":"2024-09-18T01:25:14.708840+0000","last_unstale":"2024-09-18T01:28:33.663311+0000","last_undegraded":"2024-09-18T01:28:33.663311+0000","last_fullsized":"2024-09-18T01:28:33.663311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:33.663217+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:33.663217+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.663217+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:17:45.430908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:11.070033+0000","last_change":"2024-09-18T01:29:11.070057+0000","last_active":"2024-09-18T01:29:11.070033+0000","last_peered":"2024-09-18T01:29:11.070033+0000","last_clean":"2024-09-18T01:29:11.070033+0000","last_became_active":"2024-09-18T01:25:16.706764+0000","last_became_peered":"2024-09-18T01:25:16.706764+0000","last_unstale":"2024-09-18T01:29:11.070033+0000","last_undegraded":"2024-09-18T01:29:11.070033+0000","last_fullsized":"2024-09-18T01:29:11.070033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:11.069944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:11.069944+0000","last_clean_scrub_stamp":"2024-09-18T01:29:11.069944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:55:33.719107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.788422+0000","last_change":"2024-09-18T01:28:51.788470+0000","last_active":"2024-09-18T01:28:51.788422+0000","last_peered":"2024-09-18T01:28:51.788422+0000","last_clean":"2024-09-18T01:28:51.788422+0000","last_became_active":"2024-09-18T01:25:08.669920+0000","last_became_peered":"2024-09-18T01:25:08.669920+0000","last_unstale":"2024-09-18T01:28:51.788422+0000","last_undegraded":"2024-09-18T01:28:51.788422+0000","last_fullsized":"2024-09-18T01:28:51.788422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:51.788294+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:51.788294+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.788294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:52:03.688898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:14.311265+0000","last_change":"2024-09-18T01:29:14.311308+0000","last_active":"2024-09-18T01:29:14.311265+0000","last_peered":"2024-09-18T01:29:14.311265+0000","last_clean":"2024-09-18T01:29:14.311265+0000","last_became_active":"2024-09-18T01:25:06.684984+0000","last_became_peered":"2024-09-18T01:25:06.684984+0000","last_unstale":"2024-09-18T01:29:14.311265+0000","last_undegraded":"2024-09-18T01:29:14.311265+0000","last_fullsized":"2024-09-18T01:29:14.311265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:14.311116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:14.311116+0000","last_clean_scrub_stamp":"2024-09-18T01:29:14.311116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:51.281729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.258238+0000","last_change":"2024-09-18T01:28:42.258260+0000","last_active":"2024-09-18T01:28:42.258238+0000","last_peered":"2024-09-18T01:28:42.258238+0000","last_clean":"2024-09-18T01:28:42.258238+0000","last_became_active":"2024-09-18T01:25:10.679468+0000","last_became_peered":"2024-09-18T01:25:10.679468+0000","last_unstale":"2024-09-18T01:28:42.258238+0000","last_undegraded":"2024-09-18T01:28:42.258238+0000","last_fullsized":"2024-09-18T01:28:42.258238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:42.258155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:42.258155+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.258155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:43:55.164530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'73","reported_seq":155,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.399904+0000","last_change":"2024-09-18T01:28:29.399990+0000","last_active":"2024-09-18T01:28:29.399904+0000","last_peered":"2024-09-18T01:28:29.399904+0000","last_clean":"2024-09-18T01:28:29.399904+0000","last_became_active":"2024-09-18T01:25:12.688618+0000","last_became_peered":"2024-09-18T01:25:12.688618+0000","last_unstale":"2024-09-18T01:28:29.399904+0000","last_undegraded":"2024-09-18T01:28:29.399904+0000","last_fullsized":"2024-09-18T01:28:29.399904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'73","last_scrub_stamp":"2024-09-18T01:28:29.399801+0000","last_deep_scrub":"35'73","last_deep_scrub_stamp":"2024-09-18T01:28:29.399801+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.399801+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:16:18.035775+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:43.592312+0000","last_change":"2024-09-18T01:28:43.592338+0000","last_active":"2024-09-18T01:28:43.592312+0000","last_peered":"2024-09-18T01:28:43.592312+0000","last_clean":"2024-09-18T01:28:43.592312+0000","last_became_active":"2024-09-18T01:25:14.706586+0000","last_became_peered":"2024-09-18T01:25:14.706586+0000","last_unstale":"2024-09-18T01:28:43.592312+0000","last_undegraded":"2024-09-18T01:28:43.592312+0000","last_fullsized":"2024-09-18T01:28:43.592312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:43.592225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:43.592225+0000","last_clean_scrub_stamp":"2024-09-18T01:28:43.592225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:47:15.204874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801668+0000","last_change":"2024-09-18T01:25:16.714536+0000","last_active":"2024-09-18T01:27:44.801668+0000","last_peered":"2024-09-18T01:27:44.801668+0000","last_clean":"2024-09-18T01:27:44.801668+0000","last_became_active":"2024-09-18T01:25:16.713789+0000","last_became_peered":"2024-09-18T01:25:16.713789+0000","last_unstale":"2024-09-18T01:27:44.801668+0000","last_undegraded":"2024-09-18T01:27:44.801668+0000","last_fullsized":"2024-09-18T01:27:44.801668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.847149+0000","last_change":"2024-09-18T01:28:53.847173+0000","last_active":"2024-09-18T01:28:53.847149+0000","last_peered":"2024-09-18T01:28:53.847149+0000","last_clean":"2024-09-18T01:28:53.847149+0000","last_became_active":"2024-09-18T01:25:08.670268+0000","last_became_peered":"2024-09-18T01:25:08.670268+0000","last_unstale":"2024-09-18T01:28:53.847149+0000","last_undegraded":"2024-09-18T01:28:53.847149+0000","last_fullsized":"2024-09-18T01:28:53.847149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:53.847065+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:53.847065+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.847065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:14.842558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:21.043742+0000","last_change":"2024-09-18T01:29:21.043769+0000","last_active":"2024-09-18T01:29:21.043742+0000","last_peered":"2024-09-18T01:29:21.043742+0000","last_clean":"2024-09-18T01:29:21.043742+0000","last_became_active":"2024-09-18T01:25:06.687382+0000","last_became_peered":"2024-09-18T01:25:06.687382+0000","last_unstale":"2024-09-18T01:29:21.043742+0000","last_undegraded":"2024-09-18T01:29:21.043742+0000","last_fullsized":"2024-09-18T01:29:21.043742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:21.043645+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:21.043645+0000","last_clean_scrub_stamp":"2024-09-18T01:29:21.043645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:24:01.222359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:43.756227+0000","last_change":"2024-09-18T01:28:43.756254+0000","last_active":"2024-09-18T01:28:43.756227+0000","last_peered":"2024-09-18T01:28:43.756227+0000","last_clean":"2024-09-18T01:28:43.756227+0000","last_became_active":"2024-09-18T01:25:10.682337+0000","last_became_peered":"2024-09-18T01:25:10.682337+0000","last_unstale":"2024-09-18T01:28:43.756227+0000","last_undegraded":"2024-09-18T01:28:43.756227+0000","last_fullsized":"2024-09-18T01:28:43.756227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:43.756140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:43.756140+0000","last_clean_scrub_stamp":"2024-09-18T01:28:43.756140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:26.328226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'43","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.556548+0000","last_change":"2024-09-18T01:28:37.556582+0000","last_active":"2024-09-18T01:28:37.556548+0000","last_peered":"2024-09-18T01:28:37.556548+0000","last_clean":"2024-09-18T01:28:37.556548+0000","last_became_active":"2024-09-18T01:25:12.693129+0000","last_became_peered":"2024-09-18T01:25:12.693129+0000","last_unstale":"2024-09-18T01:28:37.556548+0000","last_undegraded":"2024-09-18T01:28:37.556548+0000","last_fullsized":"2024-09-18T01:28:37.556548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'43","last_scrub_stamp":"2024-09-18T01:28:37.556467+0000","last_deep_scrub":"35'43","last_deep_scrub_stamp":"2024-09-18T01:28:37.556467+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.556467+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:47:34.949630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.064141+0000","last_change":"2024-09-18T01:28:50.064170+0000","last_active":"2024-09-18T01:28:50.064141+0000","last_peered":"2024-09-18T01:28:50.064141+0000","last_clean":"2024-09-18T01:28:50.064141+0000","last_became_active":"2024-09-18T01:25:14.706325+0000","last_became_peered":"2024-09-18T01:25:14.706325+0000","last_unstale":"2024-09-18T01:28:50.064141+0000","last_undegraded":"2024-09-18T01:28:50.064141+0000","last_fullsized":"2024-09-18T01:28:50.064141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:50.064039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:50.064039+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.064039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:44:36.736877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801744+0000","last_change":"2024-09-18T01:25:16.716357+0000","last_active":"2024-09-18T01:27:44.801744+0000","last_peered":"2024-09-18T01:27:44.801744+0000","last_clean":"2024-09-18T01:27:44.801744+0000","last_became_active":"2024-09-18T01:25:16.716084+0000","last_became_peered":"2024-09-18T01:25:16.716084+0000","last_unstale":"2024-09-18T01:27:44.801744+0000","last_undegraded":"2024-09-18T01:27:44.801744+0000","last_fullsized":"2024-09-18T01:27:44.801744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:06.065241+0000","last_change":"2024-09-18T01:29:06.065262+0000","last_active":"2024-09-18T01:29:06.065241+0000","last_peered":"2024-09-18T01:29:06.065241+0000","last_clean":"2024-09-18T01:29:06.065241+0000","last_became_active":"2024-09-18T01:25:08.678539+0000","last_became_peered":"2024-09-18T01:25:08.678539+0000","last_unstale":"2024-09-18T01:29:06.065241+0000","last_undegraded":"2024-09-18T01:29:06.065241+0000","last_fullsized":"2024-09-18T01:29:06.065241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:06.065116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:06.065116+0000","last_clean_scrub_stamp":"2024-09-18T01:29:06.065116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:59.304634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:20.560666+0000","last_change":"2024-09-18T01:29:20.560694+0000","last_active":"2024-09-18T01:29:20.560666+0000","last_peered":"2024-09-18T01:29:20.560666+0000","last_clean":"2024-09-18T01:29:20.560666+0000","last_became_active":"2024-09-18T01:25:06.682592+0000","last_became_peered":"2024-09-18T01:25:06.682592+0000","last_unstale":"2024-09-18T01:29:20.560666+0000","last_undegraded":"2024-09-18T01:29:20.560666+0000","last_fullsized":"2024-09-18T01:29:20.560666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:20.560575+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:20.560575+0000","last_clean_scrub_stamp":"2024-09-18T01:29:20.560575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:10.427964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.341584+0000","last_change":"2024-09-18T01:28:34.341623+0000","last_active":"2024-09-18T01:28:34.341584+0000","last_peered":"2024-09-18T01:28:34.341584+0000","last_clean":"2024-09-18T01:28:34.341584+0000","last_became_active":"2024-09-18T01:25:10.683833+0000","last_became_peered":"2024-09-18T01:25:10.683833+0000","last_unstale":"2024-09-18T01:28:34.341584+0000","last_undegraded":"2024-09-18T01:28:34.341584+0000","last_fullsized":"2024-09-18T01:28:34.341584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:34.341474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:34.341474+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.341474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:33.233882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'38","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.014129+0000","last_change":"2024-09-18T01:28:58.014174+0000","last_active":"2024-09-18T01:28:58.014129+0000","last_peered":"2024-09-18T01:28:58.014129+0000","last_clean":"2024-09-18T01:28:58.014129+0000","last_became_active":"2024-09-18T01:25:12.691752+0000","last_became_peered":"2024-09-18T01:25:12.691752+0000","last_unstale":"2024-09-18T01:28:58.014129+0000","last_undegraded":"2024-09-18T01:28:58.014129+0000","last_fullsized":"2024-09-18T01:28:58.014129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'38","last_scrub_stamp":"2024-09-18T01:28:58.014049+0000","last_deep_scrub":"35'38","last_deep_scrub_stamp":"2024-09-18T01:28:58.014049+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.014049+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:10:57.324269+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:07.043534+0000","last_change":"2024-09-18T01:29:07.043556+0000","last_active":"2024-09-18T01:29:07.043534+0000","last_peered":"2024-09-18T01:29:07.043534+0000","last_clean":"2024-09-18T01:29:07.043534+0000","last_became_active":"2024-09-18T01:25:14.711635+0000","last_became_peered":"2024-09-18T01:25:14.711635+0000","last_unstale":"2024-09-18T01:29:07.043534+0000","last_undegraded":"2024-09-18T01:29:07.043534+0000","last_fullsized":"2024-09-18T01:29:07.043534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:07.043432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:07.043432+0000","last_clean_scrub_stamp":"2024-09-18T01:29:07.043432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:03.921303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801703+0000","last_change":"2024-09-18T01:25:16.715865+0000","last_active":"2024-09-18T01:27:44.801703+0000","last_peered":"2024-09-18T01:27:44.801703+0000","last_clean":"2024-09-18T01:27:44.801703+0000","last_became_active":"2024-09-18T01:25:16.715581+0000","last_became_peered":"2024-09-18T01:25:16.715581+0000","last_unstale":"2024-09-18T01:27:44.801703+0000","last_undegraded":"2024-09-18T01:27:44.801703+0000","last_fullsized":"2024-09-18T01:27:44.801703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'8","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.804555+0000","last_change":"2024-09-18T01:28:52.804583+0000","last_active":"2024-09-18T01:28:52.804555+0000","last_peered":"2024-09-18T01:28:52.804555+0000","last_clean":"2024-09-18T01:28:52.804555+0000","last_became_active":"2024-09-18T01:25:08.668430+0000","last_became_peered":"2024-09-18T01:25:08.668430+0000","last_unstale":"2024-09-18T01:28:52.804555+0000","last_undegraded":"2024-09-18T01:28:52.804555+0000","last_fullsized":"2024-09-18T01:28:52.804555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:52.804464+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:52.804464+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.804464+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:58:10.937040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:18.303939+0000","last_change":"2024-09-18T01:29:18.303939+0000","last_active":"2024-09-18T01:29:18.303939+0000","last_peered":"2024-09-18T01:29:18.303939+0000","last_clean":"2024-09-18T01:29:18.303939+0000","last_became_active":"2024-09-18T01:25:06.686394+0000","last_became_peered":"2024-09-18T01:25:06.686394+0000","last_unstale":"2024-09-18T01:29:18.303939+0000","last_undegraded":"2024-09-18T01:29:18.303939+0000","last_fullsized":"2024-09-18T01:29:18.303939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:18.303802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:18.303802+0000","last_clean_scrub_stamp":"2024-09-18T01:29:18.303802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:12:51.099041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.382361+0000","last_change":"2024-09-18T01:28:36.382417+0000","last_active":"2024-09-18T01:28:36.382361+0000","last_peered":"2024-09-18T01:28:36.382361+0000","last_clean":"2024-09-18T01:28:36.382361+0000","last_became_active":"2024-09-18T01:25:10.683351+0000","last_became_peered":"2024-09-18T01:25:10.683351+0000","last_unstale":"2024-09-18T01:28:36.382361+0000","last_undegraded":"2024-09-18T01:28:36.382361+0000","last_fullsized":"2024-09-18T01:28:36.382361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:28:36.382253+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:28:36.382253+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.382253+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:41:10.171758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'54","reported_seq":123,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.048989+0000","last_change":"2024-09-18T01:28:35.049047+0000","last_active":"2024-09-18T01:28:35.048989+0000","last_peered":"2024-09-18T01:28:35.048989+0000","last_clean":"2024-09-18T01:28:35.048989+0000","last_became_active":"2024-09-18T01:25:12.691715+0000","last_became_peered":"2024-09-18T01:25:12.691715+0000","last_unstale":"2024-09-18T01:28:35.048989+0000","last_undegraded":"2024-09-18T01:28:35.048989+0000","last_fullsized":"2024-09-18T01:28:35.048989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'54","last_scrub_stamp":"2024-09-18T01:28:35.048876+0000","last_deep_scrub":"35'54","last_deep_scrub_stamp":"2024-09-18T01:28:35.048876+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.048876+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:53.636298+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.564860+0000","last_change":"2024-09-18T01:28:35.564885+0000","last_active":"2024-09-18T01:28:35.564860+0000","last_peered":"2024-09-18T01:28:35.564860+0000","last_clean":"2024-09-18T01:28:35.564860+0000","last_became_active":"2024-09-18T01:25:14.706398+0000","last_became_peered":"2024-09-18T01:25:14.706398+0000","last_unstale":"2024-09-18T01:28:35.564860+0000","last_undegraded":"2024-09-18T01:28:35.564860+0000","last_fullsized":"2024-09-18T01:28:35.564860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:35.564741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:35.564741+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.564741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:51.265281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800848+0000","last_change":"2024-09-18T01:25:16.714114+0000","last_active":"2024-09-18T01:27:39.800848+0000","last_peered":"2024-09-18T01:27:39.800848+0000","last_clean":"2024-09-18T01:27:39.800848+0000","last_became_active":"2024-09-18T01:25:16.713579+0000","last_became_peered":"2024-09-18T01:25:16.713579+0000","last_unstale":"2024-09-18T01:27:39.800848+0000","last_undegraded":"2024-09-18T01:27:39.800848+0000","last_fullsized":"2024-09-18T01:27:39.800848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'8","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.238991+0000","last_change":"2024-09-18T01:28:54.239025+0000","last_active":"2024-09-18T01:28:54.238991+0000","last_peered":"2024-09-18T01:28:54.238991+0000","last_clean":"2024-09-18T01:28:54.238991+0000","last_became_active":"2024-09-18T01:25:08.686645+0000","last_became_peered":"2024-09-18T01:25:08.686645+0000","last_unstale":"2024-09-18T01:28:54.238991+0000","last_undegraded":"2024-09-18T01:28:54.238991+0000","last_fullsized":"2024-09-18T01:28:54.238991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:54.238884+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:54.238884+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.238884+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:10:44.376100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.762016+0000","last_change":"2024-09-18T01:29:04.762016+0000","last_active":"2024-09-18T01:29:04.762016+0000","last_peered":"2024-09-18T01:29:04.762016+0000","last_clean":"2024-09-18T01:29:04.762016+0000","last_became_active":"2024-09-18T01:25:06.702991+0000","last_became_peered":"2024-09-18T01:25:06.702991+0000","last_unstale":"2024-09-18T01:29:04.762016+0000","last_undegraded":"2024-09-18T01:29:04.762016+0000","last_fullsized":"2024-09-18T01:29:04.762016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:04.761904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:04.761904+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.761904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:25.122552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:07.539378+0000","last_change":"2024-09-18T01:29:07.539378+0000","last_active":"2024-09-18T01:29:07.539378+0000","last_peered":"2024-09-18T01:29:07.539378+0000","last_clean":"2024-09-18T01:29:07.539378+0000","last_became_active":"2024-09-18T01:25:08.672983+0000","last_became_peered":"2024-09-18T01:25:08.672983+0000","last_unstale":"2024-09-18T01:29:07.539378+0000","last_undegraded":"2024-09-18T01:29:07.539378+0000","last_fullsized":"2024-09-18T01:29:07.539378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:07.539265+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:07.539265+0000","last_clean_scrub_stamp":"2024-09-18T01:29:07.539265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:48.424256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:19.547156+0000","last_change":"2024-09-18T01:29:19.547195+0000","last_active":"2024-09-18T01:29:19.547156+0000","last_peered":"2024-09-18T01:29:19.547156+0000","last_clean":"2024-09-18T01:29:19.547156+0000","last_became_active":"2024-09-18T01:25:06.680853+0000","last_became_peered":"2024-09-18T01:25:06.680853+0000","last_unstale":"2024-09-18T01:29:19.547156+0000","last_undegraded":"2024-09-18T01:29:19.547156+0000","last_fullsized":"2024-09-18T01:29:19.547156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:19.547055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:19.547055+0000","last_clean_scrub_stamp":"2024-09-18T01:29:19.547055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:15:01.294518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.116985+0000","last_change":"2024-09-18T01:29:02.117009+0000","last_active":"2024-09-18T01:29:02.116985+0000","last_peered":"2024-09-18T01:29:02.116985+0000","last_clean":"2024-09-18T01:29:02.116985+0000","last_became_active":"2024-09-18T01:25:08.682254+0000","last_became_peered":"2024-09-18T01:25:08.682254+0000","last_unstale":"2024-09-18T01:29:02.116985+0000","last_undegraded":"2024-09-18T01:29:02.116985+0000","last_fullsized":"2024-09-18T01:29:02.116985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:02.116885+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:02.116885+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.116885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:35:11.500133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.925775+0000","last_change":"2024-09-18T01:25:06.684384+0000","last_active":"2024-09-18T01:28:27.925775+0000","last_peered":"2024-09-18T01:28:27.925775+0000","last_clean":"2024-09-18T01:28:27.925775+0000","last_became_active":"2024-09-18T01:25:06.682878+0000","last_became_peered":"2024-09-18T01:25:06.682878+0000","last_unstale":"2024-09-18T01:28:27.925775+0000","last_undegraded":"2024-09-18T01:28:27.925775+0000","last_fullsized":"2024-09-18T01:28:27.925775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:05.482588+0000","last_change":"2024-09-18T01:29:05.482588+0000","last_active":"2024-09-18T01:29:05.482588+0000","last_peered":"2024-09-18T01:29:05.482588+0000","last_clean":"2024-09-18T01:29:05.482588+0000","last_became_active":"2024-09-18T01:25:08.672574+0000","last_became_peered":"2024-09-18T01:25:08.672574+0000","last_unstale":"2024-09-18T01:29:05.482588+0000","last_undegraded":"2024-09-18T01:29:05.482588+0000","last_fullsized":"2024-09-18T01:29:05.482588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:05.482430+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:05.482430+0000","last_clean_scrub_stamp":"2024-09-18T01:29:05.482430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:36:37.124121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:18.523309+0000","last_change":"2024-09-18T01:29:18.523339+0000","last_active":"2024-09-18T01:29:18.523309+0000","last_peered":"2024-09-18T01:29:18.523309+0000","last_clean":"2024-09-18T01:29:18.523309+0000","last_became_active":"2024-09-18T01:25:06.680712+0000","last_became_peered":"2024-09-18T01:25:06.680712+0000","last_unstale":"2024-09-18T01:29:18.523309+0000","last_undegraded":"2024-09-18T01:29:18.523309+0000","last_fullsized":"2024-09-18T01:29:18.523309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:18.523194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:18.523194+0000","last_clean_scrub_stamp":"2024-09-18T01:29:18.523194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:52:44.012377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.473553+0000","last_change":"2024-09-18T01:28:59.473553+0000","last_active":"2024-09-18T01:28:59.473553+0000","last_peered":"2024-09-18T01:28:59.473553+0000","last_clean":"2024-09-18T01:28:59.473553+0000","last_became_active":"2024-09-18T01:25:08.671408+0000","last_became_peered":"2024-09-18T01:25:08.671408+0000","last_unstale":"2024-09-18T01:28:59.473553+0000","last_undegraded":"2024-09-18T01:28:59.473553+0000","last_fullsized":"2024-09-18T01:28:59.473553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:59.473436+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:59.473436+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.473436+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:23:43.979561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:12.469830+0000","last_change":"2024-09-18T01:29:12.469830+0000","last_active":"2024-09-18T01:29:12.469830+0000","last_peered":"2024-09-18T01:29:12.469830+0000","last_clean":"2024-09-18T01:29:12.469830+0000","last_became_active":"2024-09-18T01:25:06.682577+0000","last_became_peered":"2024-09-18T01:25:06.682577+0000","last_unstale":"2024-09-18T01:29:12.469830+0000","last_undegraded":"2024-09-18T01:29:12.469830+0000","last_fullsized":"2024-09-18T01:29:12.469830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:12.469703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:12.469703+0000","last_clean_scrub_stamp":"2024-09-18T01:29:12.469703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:05:36.836271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'8","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:45.320051+0000","last_change":"2024-09-18T01:28:45.320051+0000","last_active":"2024-09-18T01:28:45.320051+0000","last_peered":"2024-09-18T01:28:45.320051+0000","last_clean":"2024-09-18T01:28:45.320051+0000","last_became_active":"2024-09-18T01:25:08.687797+0000","last_became_peered":"2024-09-18T01:25:08.687797+0000","last_unstale":"2024-09-18T01:28:45.320051+0000","last_undegraded":"2024-09-18T01:28:45.320051+0000","last_fullsized":"2024-09-18T01:28:45.320051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:45.319930+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:45.319930+0000","last_clean_scrub_stamp":"2024-09-18T01:28:45.319930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:09:56.008523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:17.259269+0000","last_change":"2024-09-18T01:29:17.259295+0000","last_active":"2024-09-18T01:29:17.259269+0000","last_peered":"2024-09-18T01:29:17.259269+0000","last_clean":"2024-09-18T01:29:17.259269+0000","last_became_active":"2024-09-18T01:25:06.686154+0000","last_became_peered":"2024-09-18T01:25:06.686154+0000","last_unstale":"2024-09-18T01:29:17.259269+0000","last_undegraded":"2024-09-18T01:29:17.259269+0000","last_fullsized":"2024-09-18T01:29:17.259269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:17.259180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:17.259180+0000","last_clean_scrub_stamp":"2024-09-18T01:29:17.259180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:41.001234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'8","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.490691+0000","last_change":"2024-09-18T01:28:53.490691+0000","last_active":"2024-09-18T01:28:53.490691+0000","last_peered":"2024-09-18T01:28:53.490691+0000","last_clean":"2024-09-18T01:28:53.490691+0000","last_became_active":"2024-09-18T01:25:08.680947+0000","last_became_peered":"2024-09-18T01:25:08.680947+0000","last_unstale":"2024-09-18T01:28:53.490691+0000","last_undegraded":"2024-09-18T01:28:53.490691+0000","last_fullsized":"2024-09-18T01:28:53.490691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:53.490566+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:53.490566+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.490566+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:33.730590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.848509+0000","last_change":"2024-09-18T01:29:00.848536+0000","last_active":"2024-09-18T01:29:00.848509+0000","last_peered":"2024-09-18T01:29:00.848509+0000","last_clean":"2024-09-18T01:29:00.848509+0000","last_became_active":"2024-09-18T01:25:06.703622+0000","last_became_peered":"2024-09-18T01:25:06.703622+0000","last_unstale":"2024-09-18T01:29:00.848509+0000","last_undegraded":"2024-09-18T01:29:00.848509+0000","last_fullsized":"2024-09-18T01:29:00.848509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:00.848412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:00.848412+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.848412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:47:06.895449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.252691+0000","last_change":"2024-09-18T01:28:59.252691+0000","last_active":"2024-09-18T01:28:59.252691+0000","last_peered":"2024-09-18T01:28:59.252691+0000","last_clean":"2024-09-18T01:28:59.252691+0000","last_became_active":"2024-09-18T01:25:08.682143+0000","last_became_peered":"2024-09-18T01:25:08.682143+0000","last_unstale":"2024-09-18T01:28:59.252691+0000","last_undegraded":"2024-09-18T01:28:59.252691+0000","last_fullsized":"2024-09-18T01:28:59.252691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:59.252539+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:59.252539+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.252539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:19.613187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.409092+0000","last_change":"2024-09-18T01:29:02.409092+0000","last_active":"2024-09-18T01:29:02.409092+0000","last_peered":"2024-09-18T01:29:02.409092+0000","last_clean":"2024-09-18T01:29:02.409092+0000","last_became_active":"2024-09-18T01:25:06.687436+0000","last_became_peered":"2024-09-18T01:25:06.687436+0000","last_unstale":"2024-09-18T01:29:02.409092+0000","last_undegraded":"2024-09-18T01:29:02.409092+0000","last_fullsized":"2024-09-18T01:29:02.409092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:02.408948+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:02.408948+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.408948+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:27.550849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'14","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.296638+0000","last_change":"2024-09-18T01:29:00.296663+0000","last_active":"2024-09-18T01:29:00.296638+0000","last_peered":"2024-09-18T01:29:00.296638+0000","last_clean":"2024-09-18T01:29:00.296638+0000","last_became_active":"2024-09-18T01:25:08.675801+0000","last_became_peered":"2024-09-18T01:25:08.675801+0000","last_unstale":"2024-09-18T01:29:00.296638+0000","last_undegraded":"2024-09-18T01:29:00.296638+0000","last_fullsized":"2024-09-18T01:29:00.296638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-18T01:29:00.296517+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-18T01:29:00.296517+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.296517+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:42:52.269835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:19.797295+0000","last_change":"2024-09-18T01:25:06.693564+0000","last_active":"2024-09-18T01:27:19.797295+0000","last_peered":"2024-09-18T01:27:19.797295+0000","last_clean":"2024-09-18T01:27:19.797295+0000","last_became_active":"2024-09-18T01:25:06.691345+0000","last_became_peered":"2024-09-18T01:25:06.691345+0000","last_unstale":"2024-09-18T01:27:19.797295+0000","last_undegraded":"2024-09-18T01:27:19.797295+0000","last_fullsized":"2024-09-18T01:27:19.797295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'16","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.037028+0000","last_change":"2024-09-18T01:28:48.037058+0000","last_active":"2024-09-18T01:28:48.037028+0000","last_peered":"2024-09-18T01:28:48.037028+0000","last_clean":"2024-09-18T01:28:48.037028+0000","last_became_active":"2024-09-18T01:25:08.685358+0000","last_became_peered":"2024-09-18T01:25:08.685358+0000","last_unstale":"2024-09-18T01:28:48.037028+0000","last_undegraded":"2024-09-18T01:28:48.037028+0000","last_fullsized":"2024-09-18T01:28:48.037028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-18T01:28:48.036938+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-18T01:28:48.036938+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.036938+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:05:58.460295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.429216+0000","last_change":"2024-09-18T01:29:00.429241+0000","last_active":"2024-09-18T01:29:00.429216+0000","last_peered":"2024-09-18T01:29:00.429216+0000","last_clean":"2024-09-18T01:29:00.429216+0000","last_became_active":"2024-09-18T01:25:06.695735+0000","last_became_peered":"2024-09-18T01:25:06.695735+0000","last_unstale":"2024-09-18T01:29:00.429216+0000","last_undegraded":"2024-09-18T01:29:00.429216+0000","last_fullsized":"2024-09-18T01:29:00.429216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:00.429123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:00.429123+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.429123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:01:39.782859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:22.797682+0000","last_change":"2024-09-18T01:25:43.852539+0000","last_active":"2024-09-18T01:27:22.797682+0000","last_peered":"2024-09-18T01:27:22.797682+0000","last_clean":"2024-09-18T01:27:22.797682+0000","last_became_active":"2024-09-18T01:25:43.849600+0000","last_became_peered":"2024-09-18T01:25:43.849600+0000","last_unstale":"2024-09-18T01:27:22.797682+0000","last_undegraded":"2024-09-18T01:27:22.797682+0000","last_fullsized":"2024-09-18T01:27:22.797682+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:07.649352+0000","last_clean_scrub_stamp":"2024-09-18T01:25:07.649352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.302664+0000","last_change":"2024-09-18T01:29:02.302718+0000","last_active":"2024-09-18T01:29:02.302664+0000","last_peered":"2024-09-18T01:29:02.302664+0000","last_clean":"2024-09-18T01:29:02.302664+0000","last_became_active":"2024-09-18T01:25:06.688967+0000","last_became_peered":"2024-09-18T01:25:06.688967+0000","last_unstale":"2024-09-18T01:29:02.302664+0000","last_undegraded":"2024-09-18T01:29:02.302664+0000","last_fullsized":"2024-09-18T01:29:02.302664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:02.302563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:02.302563+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.302563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:50.858341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'10","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:05.327721+0000","last_change":"2024-09-18T01:29:05.327746+0000","last_active":"2024-09-18T01:29:05.327721+0000","last_peered":"2024-09-18T01:29:05.327721+0000","last_clean":"2024-09-18T01:29:05.327721+0000","last_became_active":"2024-09-18T01:25:08.683590+0000","last_became_peered":"2024-09-18T01:25:08.683590+0000","last_unstale":"2024-09-18T01:29:05.327721+0000","last_undegraded":"2024-09-18T01:29:05.327721+0000","last_fullsized":"2024-09-18T01:29:05.327721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-18T01:29:05.327617+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-18T01:29:05.327617+0000","last_clean_scrub_stamp":"2024-09-18T01:29:05.327617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:30.469517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:16.305773+0000","last_change":"2024-09-18T01:29:16.305809+0000","last_active":"2024-09-18T01:29:16.305773+0000","last_peered":"2024-09-18T01:29:16.305773+0000","last_clean":"2024-09-18T01:29:16.305773+0000","last_became_active":"2024-09-18T01:25:06.685814+0000","last_became_peered":"2024-09-18T01:25:06.685814+0000","last_unstale":"2024-09-18T01:29:16.305773+0000","last_undegraded":"2024-09-18T01:29:16.305773+0000","last_fullsized":"2024-09-18T01:29:16.305773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:16.305681+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:16.305681+0000","last_clean_scrub_stamp":"2024-09-18T01:29:16.305681+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:20.025985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.208969+0000","last_change":"2024-09-18T01:28:53.209000+0000","last_active":"2024-09-18T01:28:53.208969+0000","last_peered":"2024-09-18T01:28:53.208969+0000","last_clean":"2024-09-18T01:28:53.208969+0000","last_became_active":"2024-09-18T01:25:08.686703+0000","last_became_peered":"2024-09-18T01:25:08.686703+0000","last_unstale":"2024-09-18T01:28:53.208969+0000","last_undegraded":"2024-09-18T01:28:53.208969+0000","last_fullsized":"2024-09-18T01:28:53.208969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:53.208858+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:53.208858+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.208858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:49.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798253+0000","last_change":"2024-09-18T01:25:06.691078+0000","last_active":"2024-09-18T01:27:24.798253+0000","last_peered":"2024-09-18T01:27:24.798253+0000","last_clean":"2024-09-18T01:27:24.798253+0000","last_became_active":"2024-09-18T01:25:06.685120+0000","last_became_peered":"2024-09-18T01:25:06.685120+0000","last_unstale":"2024-09-18T01:27:24.798253+0000","last_undegraded":"2024-09-18T01:27:24.798253+0000","last_fullsized":"2024-09-18T01:27:24.798253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'8","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:11.346898+0000","last_change":"2024-09-18T01:29:11.346932+0000","last_active":"2024-09-18T01:29:11.346898+0000","last_peered":"2024-09-18T01:29:11.346898+0000","last_clean":"2024-09-18T01:29:11.346898+0000","last_became_active":"2024-09-18T01:25:08.685158+0000","last_became_peered":"2024-09-18T01:25:08.685158+0000","last_unstale":"2024-09-18T01:29:11.346898+0000","last_undegraded":"2024-09-18T01:29:11.346898+0000","last_fullsized":"2024-09-18T01:29:11.346898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:11.346794+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:11.346794+0000","last_clean_scrub_stamp":"2024-09-18T01:29:11.346794+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:37.769121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:24.798291+0000","last_change":"2024-09-18T01:25:06.687424+0000","last_active":"2024-09-18T01:27:24.798291+0000","last_peered":"2024-09-18T01:27:24.798291+0000","last_clean":"2024-09-18T01:27:24.798291+0000","last_became_active":"2024-09-18T01:25:06.684845+0000","last_became_peered":"2024-09-18T01:25:06.684845+0000","last_unstale":"2024-09-18T01:27:24.798291+0000","last_undegraded":"2024-09-18T01:27:24.798291+0000","last_fullsized":"2024-09-18T01:27:24.798291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.994067+0000","last_change":"2024-09-18T01:28:44.994102+0000","last_active":"2024-09-18T01:28:44.994067+0000","last_peered":"2024-09-18T01:28:44.994067+0000","last_clean":"2024-09-18T01:28:44.994067+0000","last_became_active":"2024-09-18T01:25:08.687840+0000","last_became_peered":"2024-09-18T01:25:08.687840+0000","last_unstale":"2024-09-18T01:28:44.994067+0000","last_undegraded":"2024-09-18T01:28:44.994067+0000","last_fullsized":"2024-09-18T01:28:44.994067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:44.993971+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:44.993971+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.993971+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:14.403429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.816140+0000","last_change":"2024-09-18T01:28:58.816170+0000","last_active":"2024-09-18T01:28:58.816140+0000","last_peered":"2024-09-18T01:28:58.816140+0000","last_clean":"2024-09-18T01:28:58.816140+0000","last_became_active":"2024-09-18T01:25:06.704247+0000","last_became_peered":"2024-09-18T01:25:06.704247+0000","last_unstale":"2024-09-18T01:28:58.816140+0000","last_undegraded":"2024-09-18T01:28:58.816140+0000","last_fullsized":"2024-09-18T01:28:58.816140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:58.816043+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:58.816043+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.816043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:36.858075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'12","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.206306+0000","last_change":"2024-09-18T01:28:58.206349+0000","last_active":"2024-09-18T01:28:58.206306+0000","last_peered":"2024-09-18T01:28:58.206306+0000","last_clean":"2024-09-18T01:28:58.206306+0000","last_became_active":"2024-09-18T01:25:08.680916+0000","last_became_peered":"2024-09-18T01:25:08.680916+0000","last_unstale":"2024-09-18T01:28:58.206306+0000","last_undegraded":"2024-09-18T01:28:58.206306+0000","last_fullsized":"2024-09-18T01:28:58.206306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-18T01:28:58.206180+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-18T01:28:58.206180+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.206180+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:27.429284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799255+0000","last_change":"2024-09-18T01:25:06.694171+0000","last_active":"2024-09-18T01:27:29.799255+0000","last_peered":"2024-09-18T01:27:29.799255+0000","last_clean":"2024-09-18T01:27:29.799255+0000","last_became_active":"2024-09-18T01:25:06.693000+0000","last_became_peered":"2024-09-18T01:25:06.693000+0000","last_unstale":"2024-09-18T01:27:29.799255+0000","last_undegraded":"2024-09-18T01:27:29.799255+0000","last_fullsized":"2024-09-18T01:27:29.799255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.798940+0000","last_change":"2024-09-18T01:25:06.694282+0000","last_active":"2024-09-18T01:27:29.798940+0000","last_peered":"2024-09-18T01:27:29.798940+0000","last_clean":"2024-09-18T01:27:29.798940+0000","last_became_active":"2024-09-18T01:25:06.691141+0000","last_became_peered":"2024-09-18T01:25:06.691141+0000","last_unstale":"2024-09-18T01:27:29.798940+0000","last_undegraded":"2024-09-18T01:27:29.798940+0000","last_fullsized":"2024-09-18T01:27:29.798940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'12","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.447712+0000","last_change":"2024-09-18T01:28:54.447736+0000","last_active":"2024-09-18T01:28:54.447712+0000","last_peered":"2024-09-18T01:28:54.447712+0000","last_clean":"2024-09-18T01:28:54.447712+0000","last_became_active":"2024-09-18T01:25:08.681053+0000","last_became_peered":"2024-09-18T01:25:08.681053+0000","last_unstale":"2024-09-18T01:28:54.447712+0000","last_undegraded":"2024-09-18T01:28:54.447712+0000","last_fullsized":"2024-09-18T01:28:54.447712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-18T01:28:54.447595+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-18T01:28:54.447595+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.447595+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:28.469233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.509241+0000","last_change":"2024-09-18T01:28:58.509277+0000","last_active":"2024-09-18T01:28:58.509241+0000","last_peered":"2024-09-18T01:28:58.509241+0000","last_clean":"2024-09-18T01:28:58.509241+0000","last_became_active":"2024-09-18T01:25:06.695875+0000","last_became_peered":"2024-09-18T01:25:06.695875+0000","last_unstale":"2024-09-18T01:28:58.509241+0000","last_undegraded":"2024-09-18T01:28:58.509241+0000","last_fullsized":"2024-09-18T01:28:58.509241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:58.509138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:58.509138+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.509138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:11.477929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.288654+0000","last_change":"2024-09-18T01:28:46.288688+0000","last_active":"2024-09-18T01:28:46.288654+0000","last_peered":"2024-09-18T01:28:46.288654+0000","last_clean":"2024-09-18T01:28:46.288654+0000","last_became_active":"2024-09-18T01:25:08.687583+0000","last_became_peered":"2024-09-18T01:25:08.687583+0000","last_unstale":"2024-09-18T01:28:46.288654+0000","last_undegraded":"2024-09-18T01:28:46.288654+0000","last_fullsized":"2024-09-18T01:28:46.288654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:46.288559+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:46.288559+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.288559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:46:19.008800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1751,"ondisk_log_size":1751,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":487424,"data_stored":155040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673019,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":744524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673020,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36364,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335476,"statfs":{"total":96636764160,"available":96599527424,"internally_reserved":0,"allocated":1044480,"data_stored":744891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":154885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:29:29.304 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.304 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.304 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.305 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.305 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.305 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.305 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.306 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.306 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.306 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.306 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.306 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.306 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.307 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.307 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.307 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.307 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.307 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T01:24:55.181905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=24, tm_sec=55, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.308 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.308 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.308 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.308 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.309 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.309 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.309 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.309 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.309 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.310 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.310 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-18T01:25:07.649352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.310 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.310 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.310 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.310 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:29.310 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T01:29:49.311 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:29:49.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.417+0000 7f117463c640 1 Processor -- start 2024-09-18T01:29:49.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.417+0000 7f117463c640 1 -- start start 2024-09-18T01:29:49.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.418+0000 7f117463c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f116c09bd50 0x7f116c09c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:29:49.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.418+0000 7f117463c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f116c09d3b0 con 0x7f116c09c670 2024-09-18T01:29:49.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.418+0000 7f117463c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f116c098230 con 0x7f116c09bd50 2024-09-18T01:29:49.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.418+0000 7f11723d8640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f116c09bd50 0x7f116c09c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:29:49.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.418+0000 7f1171bd7640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f116c09c670 0x7f116c0990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:38582/0 (socket says 172.21.15.92:38582) 2024-09-18T01:29:49.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.418+0000 7f1171bd7640 1 -- 172.21.15.92:0/3515170124 learned_addr learned my addr 172.21.15.92:0/3515170124 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:29:49.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.418+0000 7f11723d8640 1 -- 172.21.15.92:0/3515170124 >> v1:172.21.15.92:6789/0 conn(0x7f116c09c670 legacy=0x7f116c0990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:29:49.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.418+0000 7f11723d8640 1 -- 172.21.15.92:0/3515170124 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c0983e0 con 0x7f116c09bd50 2024-09-18T01:29:49.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.419+0000 7f11723d8640 1 --2- 172.21.15.92:0/3515170124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f116c09bd50 0x7f116c09c130 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f1160009720 tx=0x7f116002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c7c766cecbd278 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:29:49.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.419+0000 7f11713d6640 1 -- 172.21.15.92:0/3515170124 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1160037070 con 0x7f116c09bd50 2024-09-18T01:29:49.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.419+0000 7f11713d6640 1 -- 172.21.15.92:0/3515170124 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f116002ad90 con 0x7f116c09bd50 2024-09-18T01:29:49.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.419+0000 7f11713d6640 1 -- 172.21.15.92:0/3515170124 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1160032590 con 0x7f116c09bd50 2024-09-18T01:29:49.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.420+0000 7f117463c640 1 -- 172.21.15.92:0/3515170124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f116c09bd50 msgr2=0x7f116c09c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:29:49.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.420+0000 7f117463c640 1 --2- 172.21.15.92:0/3515170124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f116c09bd50 0x7f116c09c130 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f1160009720 tx=0x7f116002a110 comp rx=0 tx=0).stop 2024-09-18T01:29:49.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.420+0000 7f117463c640 1 -- 172.21.15.92:0/3515170124 shutdown_connections 2024-09-18T01:29:49.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.420+0000 7f117463c640 1 --2- 172.21.15.92:0/3515170124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f116c09bd50 0x7f116c09c130 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:29:49.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.420+0000 7f117463c640 1 -- 172.21.15.92:0/3515170124 >> 172.21.15.92:0/3515170124 conn(0x7f116c06d4a0 msgr2=0x7f116c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:29:49.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.420+0000 7f117463c640 1 -- 172.21.15.92:0/3515170124 shutdown_connections 2024-09-18T01:29:49.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.420+0000 7f117463c640 1 -- 172.21.15.92:0/3515170124 wait complete. 2024-09-18T01:29:49.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.421+0000 7f117463c640 1 Processor -- start 2024-09-18T01:29:49.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.421+0000 7f117463c640 1 -- start start 2024-09-18T01:29:49.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.421+0000 7f117463c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f116c09bd50 0x7f116c093570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:29:49.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.421+0000 7f117463c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f116c099b90 con 0x7f116c09bd50 2024-09-18T01:29:49.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.421+0000 7f11723d8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f116c09bd50 0x7f116c093570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:29:49.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.421+0000 7f11723d8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f116c09bd50 0x7f116c093570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52776/0 (socket says 172.21.15.92:52776) 2024-09-18T01:29:49.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.421+0000 7f11723d8640 1 -- 172.21.15.92:0/1774117099 learned_addr learned my addr 172.21.15.92:0/1774117099 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:29:49.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.422+0000 7f11723d8640 1 -- 172.21.15.92:0/1774117099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c094eb0 con 0x7f116c09bd50 2024-09-18T01:29:49.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.422+0000 7f11723d8640 1 --2- 172.21.15.92:0/1774117099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f116c09bd50 0x7f116c093570 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1160009840 tx=0x7f11600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:29:49.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.422+0000 7f115effd640 1 -- 172.21.15.92:0/1774117099 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1160041070 con 0x7f116c09bd50 2024-09-18T01:29:49.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.422+0000 7f115effd640 1 -- 172.21.15.92:0/1774117099 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f116003c460 con 0x7f116c09bd50 2024-09-18T01:29:49.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.422+0000 7f117463c640 1 -- 172.21.15.92:0/1774117099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116c095590 con 0x7f116c09bd50 2024-09-18T01:29:49.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.422+0000 7f115effd640 1 -- 172.21.15.92:0/1774117099 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1160037040 con 0x7f116c09bd50 2024-09-18T01:29:49.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.422+0000 7f117463c640 1 -- 172.21.15.92:0/1774117099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116c0961c0 con 0x7f116c09bd50 2024-09-18T01:29:49.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.423+0000 7f115effd640 1 -- 172.21.15.92:0/1774117099 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1160044070 con 0x7f116c09bd50 2024-09-18T01:29:49.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.423+0000 7f115effd640 1 --2- 172.21.15.92:0/1774117099 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f11500382a0 0x7f115003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:29:49.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.423+0000 7f115effd640 1 -- 172.21.15.92:0/1774117099 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f116006c5b0 con 0x7f116c09bd50 2024-09-18T01:29:49.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.423+0000 7f117463c640 1 -- 172.21.15.92:0/1774117099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f116c09a130 con 0x7f116c09bd50 2024-09-18T01:29:49.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.423+0000 7f1171bd7640 1 --2- 172.21.15.92:0/1774117099 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f11500382a0 0x7f115003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:29:49.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.424+0000 7f1171bd7640 1 --2- 172.21.15.92:0/1774117099 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f11500382a0 0x7f115003a760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1168007fd0 tx=0x7f1168007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:29:49.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.428+0000 7f115effd640 1 -- 172.21.15.92:0/1774117099 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f116c0961c0 con 0x7f116c09bd50 2024-09-18T01:29:49.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.590+0000 7f117463c640 1 -- 172.21.15.92:0/1774117099 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f116c09d020 con 0x7f11500382a0 2024-09-18T01:29:49.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.606+0000 7f115effd640 1 -- 172.21.15.92:0/1774117099 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666152 (secure 0 0 0) 0x7f116c09d020 con 0x7f11500382a0 2024-09-18T01:29:49.614 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:29:49.619 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-18T01:29:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.610+0000 7f117463c640 1 -- 172.21.15.92:0/1774117099 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f11500382a0 msgr2=0x7f115003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:29:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.610+0000 7f117463c640 1 --2- 172.21.15.92:0/1774117099 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f11500382a0 0x7f115003a760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1168007fd0 tx=0x7f1168007ac0 comp rx=0 tx=0).stop 2024-09-18T01:29:49.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.611+0000 7f117463c640 1 -- 172.21.15.92:0/1774117099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f116c09bd50 msgr2=0x7f116c093570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:29:49.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.611+0000 7f117463c640 1 --2- 172.21.15.92:0/1774117099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f116c09bd50 0x7f116c093570 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1160009840 tx=0x7f11600046c0 comp rx=0 tx=0).stop 2024-09-18T01:29:49.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.611+0000 7f117463c640 1 -- 172.21.15.92:0/1774117099 shutdown_connections 2024-09-18T01:29:49.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.611+0000 7f117463c640 1 --2- 172.21.15.92:0/1774117099 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f11500382a0 0x7f115003a760 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:29:49.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.611+0000 7f117463c640 1 --2- 172.21.15.92:0/1774117099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f116c09bd50 0x7f116c093570 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:29:49.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.611+0000 7f117463c640 1 -- 172.21.15.92:0/1774117099 >> 172.21.15.92:0/1774117099 conn(0x7f116c06d4a0 msgr2=0x7f116c09eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:29:49.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.611+0000 7f117463c640 1 -- 172.21.15.92:0/1774117099 shutdown_connections 2024-09-18T01:29:49.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:29:49.611+0000 7f117463c640 1 -- 172.21.15.92:0/1774117099 wait complete. 2024-09-18T01:29:49.623 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-18T01:29:48.854084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5383,"num_read_kb":4932,"num_write":2371,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":993,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5017,"ondisk_log_size":5017,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156800,"kb_used_data":2944,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330560,"statfs":{"total":386547056640,"available":386386493440,"internally_reserved":0,"allocated":3014656,"data_stored":1799340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003834"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:11.909701+0000","last_change":"2024-09-18T01:29:11.909701+0000","last_active":"2024-09-18T01:29:11.909701+0000","last_peered":"2024-09-18T01:29:11.909701+0000","last_clean":"2024-09-18T01:29:11.909701+0000","last_became_active":"2024-09-18T01:25:06.691940+0000","last_became_peered":"2024-09-18T01:25:06.691940+0000","last_unstale":"2024-09-18T01:29:11.909701+0000","last_undegraded":"2024-09-18T01:29:11.909701+0000","last_fullsized":"2024-09-18T01:29:11.909701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:11.909580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:11.909580+0000","last_clean_scrub_stamp":"2024-09-18T01:29:11.909580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:37.051480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'14","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.261128+0000","last_change":"2024-09-18T01:29:03.261180+0000","last_active":"2024-09-18T01:29:03.261128+0000","last_peered":"2024-09-18T01:29:03.261128+0000","last_clean":"2024-09-18T01:29:03.261128+0000","last_became_active":"2024-09-18T01:25:08.683538+0000","last_became_peered":"2024-09-18T01:25:08.683538+0000","last_unstale":"2024-09-18T01:29:03.261128+0000","last_undegraded":"2024-09-18T01:29:03.261128+0000","last_fullsized":"2024-09-18T01:29:03.261128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-18T01:29:03.261027+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-18T01:29:03.261027+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.261027+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:47.678527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:06.500013+0000","last_change":"2024-09-18T01:29:06.500013+0000","last_active":"2024-09-18T01:29:06.500013+0000","last_peered":"2024-09-18T01:29:06.500013+0000","last_clean":"2024-09-18T01:29:06.500013+0000","last_became_active":"2024-09-18T01:25:06.686950+0000","last_became_peered":"2024-09-18T01:25:06.686950+0000","last_unstale":"2024-09-18T01:29:06.500013+0000","last_undegraded":"2024-09-18T01:29:06.500013+0000","last_fullsized":"2024-09-18T01:29:06.500013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:06.499890+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:06.499890+0000","last_clean_scrub_stamp":"2024-09-18T01:29:06.499890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:52:59.744454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'20","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:10.052337+0000","last_change":"2024-09-18T01:29:10.052360+0000","last_active":"2024-09-18T01:29:10.052337+0000","last_peered":"2024-09-18T01:29:10.052337+0000","last_clean":"2024-09-18T01:29:10.052337+0000","last_became_active":"2024-09-18T01:25:08.673552+0000","last_became_peered":"2024-09-18T01:25:08.673552+0000","last_unstale":"2024-09-18T01:29:10.052337+0000","last_undegraded":"2024-09-18T01:29:10.052337+0000","last_fullsized":"2024-09-18T01:29:10.052337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:29:10.052252+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:29:10.052252+0000","last_clean_scrub_stamp":"2024-09-18T01:29:10.052252+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:56.273557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:23.963482+0000","last_change":"2024-09-18T01:29:23.963521+0000","last_active":"2024-09-18T01:29:23.963482+0000","last_peered":"2024-09-18T01:29:23.963482+0000","last_clean":"2024-09-18T01:29:23.963482+0000","last_became_active":"2024-09-18T01:25:06.687068+0000","last_became_peered":"2024-09-18T01:25:06.687068+0000","last_unstale":"2024-09-18T01:29:23.963482+0000","last_undegraded":"2024-09-18T01:29:23.963482+0000","last_fullsized":"2024-09-18T01:29:23.963482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:23.963371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:23.963371+0000","last_clean_scrub_stamp":"2024-09-18T01:29:23.963371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:04.048367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'10","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.112529+0000","last_change":"2024-09-18T01:29:01.112565+0000","last_active":"2024-09-18T01:29:01.112529+0000","last_peered":"2024-09-18T01:29:01.112529+0000","last_clean":"2024-09-18T01:29:01.112529+0000","last_became_active":"2024-09-18T01:25:08.685074+0000","last_became_peered":"2024-09-18T01:25:08.685074+0000","last_unstale":"2024-09-18T01:29:01.112529+0000","last_undegraded":"2024-09-18T01:29:01.112529+0000","last_fullsized":"2024-09-18T01:29:01.112529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-18T01:29:01.112427+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-18T01:29:01.112427+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.112427+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:56:10.526652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:08.841231+0000","last_change":"2024-09-18T01:29:08.841231+0000","last_active":"2024-09-18T01:29:08.841231+0000","last_peered":"2024-09-18T01:29:08.841231+0000","last_clean":"2024-09-18T01:29:08.841231+0000","last_became_active":"2024-09-18T01:25:06.690552+0000","last_became_peered":"2024-09-18T01:25:06.690552+0000","last_unstale":"2024-09-18T01:29:08.841231+0000","last_undegraded":"2024-09-18T01:29:08.841231+0000","last_fullsized":"2024-09-18T01:29:08.841231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:08.841069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:08.841069+0000","last_clean_scrub_stamp":"2024-09-18T01:29:08.841069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:57.396847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'8","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:09.074903+0000","last_change":"2024-09-18T01:29:09.074932+0000","last_active":"2024-09-18T01:29:09.074903+0000","last_peered":"2024-09-18T01:29:09.074903+0000","last_clean":"2024-09-18T01:29:09.074903+0000","last_became_active":"2024-09-18T01:25:08.674210+0000","last_became_peered":"2024-09-18T01:25:08.674210+0000","last_unstale":"2024-09-18T01:29:09.074903+0000","last_undegraded":"2024-09-18T01:29:09.074903+0000","last_fullsized":"2024-09-18T01:29:09.074903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:09.074810+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:09.074810+0000","last_clean_scrub_stamp":"2024-09-18T01:29:09.074810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:07:50.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.963269+0000","last_change":"2024-09-18T01:29:22.963305+0000","last_active":"2024-09-18T01:29:22.963269+0000","last_peered":"2024-09-18T01:29:22.963269+0000","last_clean":"2024-09-18T01:29:22.963269+0000","last_became_active":"2024-09-18T01:25:06.687608+0000","last_became_peered":"2024-09-18T01:25:06.687608+0000","last_unstale":"2024-09-18T01:29:22.963269+0000","last_undegraded":"2024-09-18T01:29:22.963269+0000","last_fullsized":"2024-09-18T01:29:22.963269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:22.963164+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:22.963164+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.963164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:38:37.098811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:07.382340+0000","last_change":"2024-09-18T01:29:07.382340+0000","last_active":"2024-09-18T01:29:07.382340+0000","last_peered":"2024-09-18T01:29:07.382340+0000","last_clean":"2024-09-18T01:29:07.382340+0000","last_became_active":"2024-09-18T01:25:08.683812+0000","last_became_peered":"2024-09-18T01:25:08.683812+0000","last_unstale":"2024-09-18T01:29:07.382340+0000","last_undegraded":"2024-09-18T01:29:07.382340+0000","last_fullsized":"2024-09-18T01:29:07.382340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:07.382155+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:07.382155+0000","last_clean_scrub_stamp":"2024-09-18T01:29:07.382155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:11:57.693419+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'6","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:06.799683+0000","last_change":"2024-09-18T01:29:06.799712+0000","last_active":"2024-09-18T01:29:06.799683+0000","last_peered":"2024-09-18T01:29:06.799683+0000","last_clean":"2024-09-18T01:29:06.799683+0000","last_became_active":"2024-09-18T01:25:06.702616+0000","last_became_peered":"2024-09-18T01:25:06.702616+0000","last_unstale":"2024-09-18T01:29:06.799683+0000","last_undegraded":"2024-09-18T01:29:06.799683+0000","last_fullsized":"2024-09-18T01:29:06.799683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:06.799588+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:06.799588+0000","last_clean_scrub_stamp":"2024-09-18T01:29:06.799588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:10:06.055871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'8","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:20.807122+0000","last_change":"2024-09-18T01:29:20.807158+0000","last_active":"2024-09-18T01:29:20.807122+0000","last_peered":"2024-09-18T01:29:20.807122+0000","last_clean":"2024-09-18T01:29:20.807122+0000","last_became_active":"2024-09-18T01:25:43.904427+0000","last_became_peered":"2024-09-18T01:25:43.904427+0000","last_unstale":"2024-09-18T01:29:20.807122+0000","last_undegraded":"2024-09-18T01:29:20.807122+0000","last_fullsized":"2024-09-18T01:29:20.807122+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:20.807032+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:20.807032+0000","last_clean_scrub_stamp":"2024-09-18T01:29:20.807032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:57.777645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:44.059117+0000","last_change":"2024-09-18T01:29:44.059143+0000","last_active":"2024-09-18T01:29:44.059117+0000","last_peered":"2024-09-18T01:29:44.059117+0000","last_clean":"2024-09-18T01:29:44.059117+0000","last_became_active":"2024-09-18T01:25:06.683195+0000","last_became_peered":"2024-09-18T01:25:06.683195+0000","last_unstale":"2024-09-18T01:29:44.059117+0000","last_undegraded":"2024-09-18T01:29:44.059117+0000","last_fullsized":"2024-09-18T01:29:44.059117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:44.059005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:44.059005+0000","last_clean_scrub_stamp":"2024-09-18T01:29:44.059005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:34:09.970378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.828610+0000","last_change":"2024-09-18T01:28:50.828610+0000","last_active":"2024-09-18T01:28:50.828610+0000","last_peered":"2024-09-18T01:28:50.828610+0000","last_clean":"2024-09-18T01:28:50.828610+0000","last_became_active":"2024-09-18T01:25:08.677579+0000","last_became_peered":"2024-09-18T01:25:08.677579+0000","last_unstale":"2024-09-18T01:28:50.828610+0000","last_undegraded":"2024-09-18T01:28:50.828610+0000","last_fullsized":"2024-09-18T01:28:50.828610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:50.828488+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:50.828488+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.828488+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:52.949299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:10.514401+0000","last_change":"2024-09-18T01:29:10.514429+0000","last_active":"2024-09-18T01:29:10.514401+0000","last_peered":"2024-09-18T01:29:10.514401+0000","last_clean":"2024-09-18T01:29:10.514401+0000","last_became_active":"2024-09-18T01:25:06.686049+0000","last_became_peered":"2024-09-18T01:25:06.686049+0000","last_unstale":"2024-09-18T01:29:10.514401+0000","last_undegraded":"2024-09-18T01:29:10.514401+0000","last_fullsized":"2024-09-18T01:29:10.514401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:10.514311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:10.514311+0000","last_clean_scrub_stamp":"2024-09-18T01:29:10.514311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:03.733247+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.902549+0000","last_change":"2024-09-18T01:29:15.902549+0000","last_active":"2024-09-18T01:29:15.902549+0000","last_peered":"2024-09-18T01:29:15.902549+0000","last_clean":"2024-09-18T01:29:15.902549+0000","last_became_active":"2024-09-18T01:25:08.676310+0000","last_became_peered":"2024-09-18T01:25:08.676310+0000","last_unstale":"2024-09-18T01:29:15.902549+0000","last_undegraded":"2024-09-18T01:29:15.902549+0000","last_fullsized":"2024-09-18T01:29:15.902549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:15.902400+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:15.902400+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.902400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:53:09.146964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'24","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:14.063470+0000","last_change":"2024-09-18T01:29:14.063497+0000","last_active":"2024-09-18T01:29:14.063470+0000","last_peered":"2024-09-18T01:29:14.063470+0000","last_clean":"2024-09-18T01:29:14.063470+0000","last_became_active":"2024-09-18T01:25:08.671858+0000","last_became_peered":"2024-09-18T01:25:08.671858+0000","last_unstale":"2024-09-18T01:29:14.063470+0000","last_undegraded":"2024-09-18T01:29:14.063470+0000","last_fullsized":"2024-09-18T01:29:14.063470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-09-18T01:29:14.063380+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-09-18T01:29:14.063380+0000","last_clean_scrub_stamp":"2024-09-18T01:29:14.063380+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:10.994209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":55,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:06.335499+0000","last_change":"2024-09-18T01:29:06.335526+0000","last_active":"2024-09-18T01:29:06.335499+0000","last_peered":"2024-09-18T01:29:06.335499+0000","last_clean":"2024-09-18T01:29:06.335499+0000","last_became_active":"2024-09-18T01:25:06.691034+0000","last_became_peered":"2024-09-18T01:25:06.691034+0000","last_unstale":"2024-09-18T01:29:06.335499+0000","last_undegraded":"2024-09-18T01:29:06.335499+0000","last_fullsized":"2024-09-18T01:29:06.335499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:06.335392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:06.335392+0000","last_clean_scrub_stamp":"2024-09-18T01:29:06.335392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:25:11.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:09.339591+0000","last_change":"2024-09-18T01:29:09.339656+0000","last_active":"2024-09-18T01:29:09.339591+0000","last_peered":"2024-09-18T01:29:09.339591+0000","last_clean":"2024-09-18T01:29:09.339591+0000","last_became_active":"2024-09-18T01:25:08.685043+0000","last_became_peered":"2024-09-18T01:25:08.685043+0000","last_unstale":"2024-09-18T01:29:09.339591+0000","last_undegraded":"2024-09-18T01:29:09.339591+0000","last_fullsized":"2024-09-18T01:29:09.339591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:09.339488+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:09.339488+0000","last_clean_scrub_stamp":"2024-09-18T01:29:09.339488+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:53:02.584051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.864615+0000","last_change":"2024-09-18T01:28:56.864648+0000","last_active":"2024-09-18T01:28:56.864615+0000","last_peered":"2024-09-18T01:28:56.864615+0000","last_clean":"2024-09-18T01:28:56.864615+0000","last_became_active":"2024-09-18T01:25:06.704414+0000","last_became_peered":"2024-09-18T01:25:06.704414+0000","last_unstale":"2024-09-18T01:28:56.864615+0000","last_undegraded":"2024-09-18T01:28:56.864615+0000","last_fullsized":"2024-09-18T01:28:56.864615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:56.864507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:56.864507+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.864507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:33.916587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:21.352124+0000","last_change":"2024-09-18T01:29:21.352155+0000","last_active":"2024-09-18T01:29:21.352124+0000","last_peered":"2024-09-18T01:29:21.352124+0000","last_clean":"2024-09-18T01:29:21.352124+0000","last_became_active":"2024-09-18T01:25:08.684921+0000","last_became_peered":"2024-09-18T01:25:08.684921+0000","last_unstale":"2024-09-18T01:29:21.352124+0000","last_undegraded":"2024-09-18T01:29:21.352124+0000","last_fullsized":"2024-09-18T01:29:21.352124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-18T01:29:21.352023+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-18T01:29:21.352023+0000","last_clean_scrub_stamp":"2024-09-18T01:29:21.352023+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:52:46.841207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'3","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:19.323198+0000","last_change":"2024-09-18T01:29:19.323237+0000","last_active":"2024-09-18T01:29:19.323198+0000","last_peered":"2024-09-18T01:29:19.323198+0000","last_clean":"2024-09-18T01:29:19.323198+0000","last_became_active":"2024-09-18T01:25:06.687737+0000","last_became_peered":"2024-09-18T01:25:06.687737+0000","last_unstale":"2024-09-18T01:29:19.323198+0000","last_undegraded":"2024-09-18T01:29:19.323198+0000","last_fullsized":"2024-09-18T01:29:19.323198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:29:19.323097+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:29:19.323097+0000","last_clean_scrub_stamp":"2024-09-18T01:29:19.323097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:46:52.157016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'16","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.461976+0000","last_change":"2024-09-18T01:28:57.462002+0000","last_active":"2024-09-18T01:28:57.461976+0000","last_peered":"2024-09-18T01:28:57.461976+0000","last_clean":"2024-09-18T01:28:57.461976+0000","last_became_active":"2024-09-18T01:25:08.671338+0000","last_became_peered":"2024-09-18T01:25:08.671338+0000","last_unstale":"2024-09-18T01:28:57.461976+0000","last_undegraded":"2024-09-18T01:28:57.461976+0000","last_fullsized":"2024-09-18T01:28:57.461976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-18T01:28:57.461821+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-18T01:28:57.461821+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.461821+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:42:49.435139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:12.322211+0000","last_change":"2024-09-18T01:29:12.322252+0000","last_active":"2024-09-18T01:29:12.322211+0000","last_peered":"2024-09-18T01:29:12.322211+0000","last_clean":"2024-09-18T01:29:12.322211+0000","last_became_active":"2024-09-18T01:25:06.688356+0000","last_became_peered":"2024-09-18T01:25:06.688356+0000","last_unstale":"2024-09-18T01:29:12.322211+0000","last_undegraded":"2024-09-18T01:29:12.322211+0000","last_fullsized":"2024-09-18T01:29:12.322211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:12.322091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:12.322091+0000","last_clean_scrub_stamp":"2024-09-18T01:29:12.322091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:12.845103+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.810538+0000","last_change":"2024-09-18T01:28:59.810589+0000","last_active":"2024-09-18T01:28:59.810538+0000","last_peered":"2024-09-18T01:28:59.810538+0000","last_clean":"2024-09-18T01:28:59.810538+0000","last_became_active":"2024-09-18T01:25:08.673915+0000","last_became_peered":"2024-09-18T01:25:08.673915+0000","last_unstale":"2024-09-18T01:28:59.810538+0000","last_undegraded":"2024-09-18T01:28:59.810538+0000","last_fullsized":"2024-09-18T01:28:59.810538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:59.810429+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:59.810429+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.810429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:41:53.505612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.441061+0000","last_change":"2024-09-18T01:29:04.441106+0000","last_active":"2024-09-18T01:29:04.441061+0000","last_peered":"2024-09-18T01:29:04.441061+0000","last_clean":"2024-09-18T01:29:04.441061+0000","last_became_active":"2024-09-18T01:25:06.686900+0000","last_became_peered":"2024-09-18T01:25:06.686900+0000","last_unstale":"2024-09-18T01:29:04.441061+0000","last_undegraded":"2024-09-18T01:29:04.441061+0000","last_fullsized":"2024-09-18T01:29:04.441061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:04.440953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:04.440953+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.440953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:10.843955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'6","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.177086+0000","last_change":"2024-09-18T01:28:57.177149+0000","last_active":"2024-09-18T01:28:57.177086+0000","last_peered":"2024-09-18T01:28:57.177086+0000","last_clean":"2024-09-18T01:28:57.177086+0000","last_became_active":"2024-09-18T01:25:08.682225+0000","last_became_peered":"2024-09-18T01:25:08.682225+0000","last_unstale":"2024-09-18T01:28:57.177086+0000","last_undegraded":"2024-09-18T01:28:57.177086+0000","last_fullsized":"2024-09-18T01:28:57.177086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:57.176987+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:57.176987+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.176987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:15.711498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:29.799058+0000","last_change":"2024-09-18T01:25:06.695620+0000","last_active":"2024-09-18T01:27:29.799058+0000","last_peered":"2024-09-18T01:27:29.799058+0000","last_clean":"2024-09-18T01:27:29.799058+0000","last_became_active":"2024-09-18T01:25:06.693647+0000","last_became_peered":"2024-09-18T01:25:06.693647+0000","last_unstale":"2024-09-18T01:27:29.799058+0000","last_undegraded":"2024-09-18T01:27:29.799058+0000","last_fullsized":"2024-09-18T01:27:29.799058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:05.642362+0000","last_clean_scrub_stamp":"2024-09-18T01:25:05.642362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'36","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:24.468568+0000","last_change":"2024-09-18T01:29:24.468601+0000","last_active":"2024-09-18T01:29:24.468568+0000","last_peered":"2024-09-18T01:29:24.468568+0000","last_clean":"2024-09-18T01:29:24.468568+0000","last_became_active":"2024-09-18T01:25:16.712438+0000","last_became_peered":"2024-09-18T01:25:16.712438+0000","last_unstale":"2024-09-18T01:29:24.468568+0000","last_undegraded":"2024-09-18T01:29:24.468568+0000","last_fullsized":"2024-09-18T01:29:24.468568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-18T01:29:24.468472+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-18T01:29:24.468472+0000","last_clean_scrub_stamp":"2024-09-18T01:29:24.468472+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:50.839508+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:12.042125+0000","last_change":"2024-09-18T01:29:12.042182+0000","last_active":"2024-09-18T01:29:12.042125+0000","last_peered":"2024-09-18T01:29:12.042125+0000","last_clean":"2024-09-18T01:29:12.042125+0000","last_became_active":"2024-09-18T01:25:08.673605+0000","last_became_peered":"2024-09-18T01:25:08.673605+0000","last_unstale":"2024-09-18T01:29:12.042125+0000","last_undegraded":"2024-09-18T01:29:12.042125+0000","last_fullsized":"2024-09-18T01:29:12.042125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-18T01:29:12.042027+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-18T01:29:12.042027+0000","last_clean_scrub_stamp":"2024-09-18T01:29:12.042027+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:46:44.157159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.006313+0000","last_change":"2024-09-18T01:29:22.006342+0000","last_active":"2024-09-18T01:29:22.006313+0000","last_peered":"2024-09-18T01:29:22.006313+0000","last_clean":"2024-09-18T01:29:22.006313+0000","last_became_active":"2024-09-18T01:25:06.685173+0000","last_became_peered":"2024-09-18T01:25:06.685173+0000","last_unstale":"2024-09-18T01:29:22.006313+0000","last_undegraded":"2024-09-18T01:29:22.006313+0000","last_fullsized":"2024-09-18T01:29:22.006313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:22.006222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:22.006222+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.006222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:40:54.716533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.112958+0000","last_change":"2024-09-18T01:28:31.112996+0000","last_active":"2024-09-18T01:28:31.112958+0000","last_peered":"2024-09-18T01:28:31.112958+0000","last_clean":"2024-09-18T01:28:31.112958+0000","last_became_active":"2024-09-18T01:25:10.684454+0000","last_became_peered":"2024-09-18T01:25:10.684454+0000","last_unstale":"2024-09-18T01:28:31.112958+0000","last_undegraded":"2024-09-18T01:28:31.112958+0000","last_fullsized":"2024-09-18T01:28:31.112958+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.112838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.112838+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.112838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:47:30.069158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'50","reported_seq":117,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.035327+0000","last_change":"2024-09-18T01:28:47.035364+0000","last_active":"2024-09-18T01:28:47.035327+0000","last_peered":"2024-09-18T01:28:47.035327+0000","last_clean":"2024-09-18T01:28:47.035327+0000","last_became_active":"2024-09-18T01:25:12.692059+0000","last_became_peered":"2024-09-18T01:25:12.692059+0000","last_unstale":"2024-09-18T01:28:47.035327+0000","last_undegraded":"2024-09-18T01:28:47.035327+0000","last_fullsized":"2024-09-18T01:28:47.035327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'50","last_scrub_stamp":"2024-09-18T01:28:47.035239+0000","last_deep_scrub":"35'50","last_deep_scrub_stamp":"2024-09-18T01:28:47.035239+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.035239+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:17:16.348705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.307401+0000","last_change":"2024-09-18T01:28:47.307427+0000","last_active":"2024-09-18T01:28:47.307401+0000","last_peered":"2024-09-18T01:28:47.307401+0000","last_clean":"2024-09-18T01:28:47.307401+0000","last_became_active":"2024-09-18T01:25:14.709879+0000","last_became_peered":"2024-09-18T01:25:14.709879+0000","last_unstale":"2024-09-18T01:28:47.307401+0000","last_undegraded":"2024-09-18T01:28:47.307401+0000","last_fullsized":"2024-09-18T01:28:47.307401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:47.307314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:47.307314+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.307314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:14:14.624869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:23.422289+0000","last_change":"2024-09-18T01:29:23.422317+0000","last_active":"2024-09-18T01:29:23.422289+0000","last_peered":"2024-09-18T01:29:23.422289+0000","last_clean":"2024-09-18T01:29:23.422289+0000","last_became_active":"2024-09-18T01:25:16.711764+0000","last_became_peered":"2024-09-18T01:25:16.711764+0000","last_unstale":"2024-09-18T01:29:23.422289+0000","last_undegraded":"2024-09-18T01:29:23.422289+0000","last_fullsized":"2024-09-18T01:29:23.422289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:29:23.422205+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:29:23.422205+0000","last_clean_scrub_stamp":"2024-09-18T01:29:23.422205+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:13.289594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:18.855001+0000","last_change":"2024-09-18T01:29:18.855070+0000","last_active":"2024-09-18T01:29:18.855001+0000","last_peered":"2024-09-18T01:29:18.855001+0000","last_clean":"2024-09-18T01:29:18.855001+0000","last_became_active":"2024-09-18T01:25:43.848631+0000","last_became_peered":"2024-09-18T01:25:43.848631+0000","last_unstale":"2024-09-18T01:29:18.855001+0000","last_undegraded":"2024-09-18T01:29:18.855001+0000","last_fullsized":"2024-09-18T01:29:18.855001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:18.854897+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:18.854897+0000","last_clean_scrub_stamp":"2024-09-18T01:29:18.854897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:19.377910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:09.885829+0000","last_change":"2024-09-18T01:29:09.885855+0000","last_active":"2024-09-18T01:29:09.885829+0000","last_peered":"2024-09-18T01:29:09.885829+0000","last_clean":"2024-09-18T01:29:09.885829+0000","last_became_active":"2024-09-18T01:25:06.690813+0000","last_became_peered":"2024-09-18T01:25:06.690813+0000","last_unstale":"2024-09-18T01:29:09.885829+0000","last_undegraded":"2024-09-18T01:29:09.885829+0000","last_fullsized":"2024-09-18T01:29:09.885829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:09.885735+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:09.885735+0000","last_clean_scrub_stamp":"2024-09-18T01:29:09.885735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:54.303235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.568137+0000","last_change":"2024-09-18T01:28:48.568158+0000","last_active":"2024-09-18T01:28:48.568137+0000","last_peered":"2024-09-18T01:28:48.568137+0000","last_clean":"2024-09-18T01:28:48.568137+0000","last_became_active":"2024-09-18T01:25:10.677226+0000","last_became_peered":"2024-09-18T01:25:10.677226+0000","last_unstale":"2024-09-18T01:28:48.568137+0000","last_undegraded":"2024-09-18T01:28:48.568137+0000","last_fullsized":"2024-09-18T01:28:48.568137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:48.568063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:48.568063+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.568063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:31.051544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'17","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.394431+0000","last_change":"2024-09-18T01:28:30.394506+0000","last_active":"2024-09-18T01:28:30.394431+0000","last_peered":"2024-09-18T01:28:30.394431+0000","last_clean":"2024-09-18T01:28:30.394431+0000","last_became_active":"2024-09-18T01:25:12.688366+0000","last_became_peered":"2024-09-18T01:25:12.688366+0000","last_unstale":"2024-09-18T01:28:30.394431+0000","last_undegraded":"2024-09-18T01:28:30.394431+0000","last_fullsized":"2024-09-18T01:28:30.394431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-18T01:28:30.394314+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-18T01:28:30.394314+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.394314+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:51.126406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.435350+0000","last_change":"2024-09-18T01:28:31.435372+0000","last_active":"2024-09-18T01:28:31.435350+0000","last_peered":"2024-09-18T01:28:31.435350+0000","last_clean":"2024-09-18T01:28:31.435350+0000","last_became_active":"2024-09-18T01:25:14.702918+0000","last_became_peered":"2024-09-18T01:25:14.702918+0000","last_unstale":"2024-09-18T01:28:31.435350+0000","last_undegraded":"2024-09-18T01:28:31.435350+0000","last_fullsized":"2024-09-18T01:28:31.435350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.435257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.435257+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.435257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:21.639639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'7","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:23.506256+0000","last_change":"2024-09-18T01:29:23.506302+0000","last_active":"2024-09-18T01:29:23.506256+0000","last_peered":"2024-09-18T01:29:23.506256+0000","last_clean":"2024-09-18T01:29:23.506256+0000","last_became_active":"2024-09-18T01:25:16.713571+0000","last_became_peered":"2024-09-18T01:25:16.713571+0000","last_unstale":"2024-09-18T01:29:23.506256+0000","last_undegraded":"2024-09-18T01:29:23.506256+0000","last_fullsized":"2024-09-18T01:29:23.506256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:29:23.506126+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:29:23.506126+0000","last_clean_scrub_stamp":"2024-09-18T01:29:23.506126+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:32:33.295833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'8","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:13.079477+0000","last_change":"2024-09-18T01:29:13.079505+0000","last_active":"2024-09-18T01:29:13.079477+0000","last_peered":"2024-09-18T01:29:13.079477+0000","last_clean":"2024-09-18T01:29:13.079477+0000","last_became_active":"2024-09-18T01:25:08.671904+0000","last_became_peered":"2024-09-18T01:25:08.671904+0000","last_unstale":"2024-09-18T01:29:13.079477+0000","last_undegraded":"2024-09-18T01:29:13.079477+0000","last_fullsized":"2024-09-18T01:29:13.079477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:13.079378+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:13.079378+0000","last_clean_scrub_stamp":"2024-09-18T01:29:13.079378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:15:05.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:42.063429+0000","last_change":"2024-09-18T01:29:42.063475+0000","last_active":"2024-09-18T01:29:42.063429+0000","last_peered":"2024-09-18T01:29:42.063429+0000","last_clean":"2024-09-18T01:29:42.063429+0000","last_became_active":"2024-09-18T01:25:06.681065+0000","last_became_peered":"2024-09-18T01:25:06.681065+0000","last_unstale":"2024-09-18T01:29:42.063429+0000","last_undegraded":"2024-09-18T01:29:42.063429+0000","last_fullsized":"2024-09-18T01:29:42.063429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:42.063326+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:42.063326+0000","last_clean_scrub_stamp":"2024-09-18T01:29:42.063326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:48:54.754100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.538533+0000","last_change":"2024-09-18T01:28:49.538567+0000","last_active":"2024-09-18T01:28:49.538533+0000","last_peered":"2024-09-18T01:28:49.538533+0000","last_clean":"2024-09-18T01:28:49.538533+0000","last_became_active":"2024-09-18T01:25:10.677118+0000","last_became_peered":"2024-09-18T01:25:10.677118+0000","last_unstale":"2024-09-18T01:28:49.538533+0000","last_undegraded":"2024-09-18T01:28:49.538533+0000","last_fullsized":"2024-09-18T01:28:49.538533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:49.538452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:49.538452+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.538452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:45.840473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'29","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.676629+0000","last_change":"2024-09-18T01:28:36.676691+0000","last_active":"2024-09-18T01:28:36.676629+0000","last_peered":"2024-09-18T01:28:36.676629+0000","last_clean":"2024-09-18T01:28:36.676629+0000","last_became_active":"2024-09-18T01:25:12.693426+0000","last_became_peered":"2024-09-18T01:25:12.693426+0000","last_unstale":"2024-09-18T01:28:36.676629+0000","last_undegraded":"2024-09-18T01:28:36.676629+0000","last_fullsized":"2024-09-18T01:28:36.676629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'29","last_scrub_stamp":"2024-09-18T01:28:36.676525+0000","last_deep_scrub":"35'29","last_deep_scrub_stamp":"2024-09-18T01:28:36.676525+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.676525+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:10.438462+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'286","reported_seq":394,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.005383+0000","last_change":"2024-09-18T01:28:55.005433+0000","last_active":"2024-09-18T01:28:55.005383+0000","last_peered":"2024-09-18T01:28:55.005383+0000","last_clean":"2024-09-18T01:28:55.005383+0000","last_became_active":"2024-09-18T01:25:14.707544+0000","last_became_peered":"2024-09-18T01:25:14.707544+0000","last_unstale":"2024-09-18T01:28:55.005383+0000","last_undegraded":"2024-09-18T01:28:55.005383+0000","last_fullsized":"2024-09-18T01:28:55.005383+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-09-18T01:28:55.005253+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-09-18T01:28:55.005253+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.005253+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:36.156462+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.798041+0000","last_change":"2024-09-18T01:28:49.798066+0000","last_active":"2024-09-18T01:28:49.798041+0000","last_peered":"2024-09-18T01:28:49.798041+0000","last_clean":"2024-09-18T01:28:49.798041+0000","last_became_active":"2024-09-18T01:25:16.713458+0000","last_became_peered":"2024-09-18T01:25:16.713458+0000","last_unstale":"2024-09-18T01:28:49.798041+0000","last_undegraded":"2024-09-18T01:28:49.798041+0000","last_fullsized":"2024-09-18T01:28:49.798041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:49.797948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:49.797948+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.797948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:24:57.198351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.439200+0000","last_change":"2024-09-18T01:28:56.439235+0000","last_active":"2024-09-18T01:28:56.439200+0000","last_peered":"2024-09-18T01:28:56.439200+0000","last_clean":"2024-09-18T01:28:56.439200+0000","last_became_active":"2024-09-18T01:25:08.680700+0000","last_became_peered":"2024-09-18T01:25:08.680700+0000","last_unstale":"2024-09-18T01:28:56.439200+0000","last_undegraded":"2024-09-18T01:28:56.439200+0000","last_fullsized":"2024-09-18T01:28:56.439200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:28:56.439096+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:28:56.439096+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.439096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:40:37.562803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:08.369873+0000","last_change":"2024-09-18T01:29:08.369913+0000","last_active":"2024-09-18T01:29:08.369873+0000","last_peered":"2024-09-18T01:29:08.369873+0000","last_clean":"2024-09-18T01:29:08.369873+0000","last_became_active":"2024-09-18T01:25:06.691107+0000","last_became_peered":"2024-09-18T01:25:06.691107+0000","last_unstale":"2024-09-18T01:29:08.369873+0000","last_undegraded":"2024-09-18T01:29:08.369873+0000","last_fullsized":"2024-09-18T01:29:08.369873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:08.369779+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:08.369779+0000","last_clean_scrub_stamp":"2024-09-18T01:29:08.369779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:36:40.011470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.093957+0000","last_change":"2024-09-18T01:28:36.094004+0000","last_active":"2024-09-18T01:28:36.093957+0000","last_peered":"2024-09-18T01:28:36.093957+0000","last_clean":"2024-09-18T01:28:36.093957+0000","last_became_active":"2024-09-18T01:25:10.681273+0000","last_became_peered":"2024-09-18T01:25:10.681273+0000","last_unstale":"2024-09-18T01:28:36.093957+0000","last_undegraded":"2024-09-18T01:28:36.093957+0000","last_fullsized":"2024-09-18T01:28:36.093957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:36.093832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:36.093832+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.093832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:01.927384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'46","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.714556+0000","last_change":"2024-09-18T01:28:34.714630+0000","last_active":"2024-09-18T01:28:34.714556+0000","last_peered":"2024-09-18T01:28:34.714556+0000","last_clean":"2024-09-18T01:28:34.714556+0000","last_became_active":"2024-09-18T01:25:12.697114+0000","last_became_peered":"2024-09-18T01:25:12.697114+0000","last_unstale":"2024-09-18T01:28:34.714556+0000","last_undegraded":"2024-09-18T01:28:34.714556+0000","last_fullsized":"2024-09-18T01:28:34.714556+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:34.714456+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:34.714456+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.714456+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:50.227668+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":61,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":417,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.646306+0000","last_change":"2024-09-18T01:28:32.646333+0000","last_active":"2024-09-18T01:28:32.646306+0000","last_peered":"2024-09-18T01:28:32.646306+0000","last_clean":"2024-09-18T01:28:32.646306+0000","last_became_active":"2024-09-18T01:25:14.698792+0000","last_became_peered":"2024-09-18T01:25:14.698792+0000","last_unstale":"2024-09-18T01:28:32.646306+0000","last_undegraded":"2024-09-18T01:28:32.646306+0000","last_fullsized":"2024-09-18T01:28:32.646306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:32.646216+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:32.646216+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.646216+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:58:39.844651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:05.092180+0000","last_change":"2024-09-18T01:29:05.092180+0000","last_active":"2024-09-18T01:29:05.092180+0000","last_peered":"2024-09-18T01:29:05.092180+0000","last_clean":"2024-09-18T01:29:05.092180+0000","last_became_active":"2024-09-18T01:25:08.680143+0000","last_became_peered":"2024-09-18T01:25:08.680143+0000","last_unstale":"2024-09-18T01:29:05.092180+0000","last_undegraded":"2024-09-18T01:29:05.092180+0000","last_fullsized":"2024-09-18T01:29:05.092180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:05.092029+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:05.092029+0000","last_clean_scrub_stamp":"2024-09-18T01:29:05.092029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:55:27.777779+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:14.882963+0000","last_change":"2024-09-18T01:29:14.882963+0000","last_active":"2024-09-18T01:29:14.882963+0000","last_peered":"2024-09-18T01:29:14.882963+0000","last_clean":"2024-09-18T01:29:14.882963+0000","last_became_active":"2024-09-18T01:25:06.700650+0000","last_became_peered":"2024-09-18T01:25:06.700650+0000","last_unstale":"2024-09-18T01:29:14.882963+0000","last_undegraded":"2024-09-18T01:29:14.882963+0000","last_fullsized":"2024-09-18T01:29:14.882963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:14.882819+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:14.882819+0000","last_clean_scrub_stamp":"2024-09-18T01:29:14.882819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:11:27.887379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.335266+0000","last_change":"2024-09-18T01:28:37.335266+0000","last_active":"2024-09-18T01:28:37.335266+0000","last_peered":"2024-09-18T01:28:37.335266+0000","last_clean":"2024-09-18T01:28:37.335266+0000","last_became_active":"2024-09-18T01:25:10.683195+0000","last_became_peered":"2024-09-18T01:25:10.683195+0000","last_unstale":"2024-09-18T01:28:37.335266+0000","last_undegraded":"2024-09-18T01:28:37.335266+0000","last_fullsized":"2024-09-18T01:28:37.335266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:37.335139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:37.335139+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.335139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:26.770573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'59","reported_seq":126,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.709650+0000","last_change":"2024-09-18T01:28:38.709650+0000","last_active":"2024-09-18T01:28:38.709650+0000","last_peered":"2024-09-18T01:28:38.709650+0000","last_clean":"2024-09-18T01:28:38.709650+0000","last_became_active":"2024-09-18T01:25:12.687943+0000","last_became_peered":"2024-09-18T01:25:12.687943+0000","last_unstale":"2024-09-18T01:28:38.709650+0000","last_undegraded":"2024-09-18T01:28:38.709650+0000","last_fullsized":"2024-09-18T01:28:38.709650+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'59","last_scrub_stamp":"2024-09-18T01:28:38.709506+0000","last_deep_scrub":"35'59","last_deep_scrub_stamp":"2024-09-18T01:28:38.709506+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.709506+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:03.906269+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.615199+0000","last_change":"2024-09-18T01:28:33.615199+0000","last_active":"2024-09-18T01:28:33.615199+0000","last_peered":"2024-09-18T01:28:33.615199+0000","last_clean":"2024-09-18T01:28:33.615199+0000","last_became_active":"2024-09-18T01:25:14.698795+0000","last_became_peered":"2024-09-18T01:25:14.698795+0000","last_unstale":"2024-09-18T01:28:33.615199+0000","last_undegraded":"2024-09-18T01:28:33.615199+0000","last_fullsized":"2024-09-18T01:28:33.615199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:33.615076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:33.615076+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.615076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:23.050510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'3","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.709545+0000","last_change":"2024-09-18T01:28:37.709545+0000","last_active":"2024-09-18T01:28:37.709545+0000","last_peered":"2024-09-18T01:28:37.709545+0000","last_clean":"2024-09-18T01:28:37.709545+0000","last_became_active":"2024-09-18T01:25:16.707206+0000","last_became_peered":"2024-09-18T01:25:16.707206+0000","last_unstale":"2024-09-18T01:28:37.709545+0000","last_undegraded":"2024-09-18T01:28:37.709545+0000","last_fullsized":"2024-09-18T01:28:37.709545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:28:37.709423+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:28:37.709423+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.709423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:50:03.029261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.305009+0000","last_change":"2024-09-18T01:29:01.305009+0000","last_active":"2024-09-18T01:29:01.305009+0000","last_peered":"2024-09-18T01:29:01.305009+0000","last_clean":"2024-09-18T01:29:01.305009+0000","last_became_active":"2024-09-18T01:25:08.682878+0000","last_became_peered":"2024-09-18T01:25:08.682878+0000","last_unstale":"2024-09-18T01:29:01.305009+0000","last_undegraded":"2024-09-18T01:29:01.305009+0000","last_fullsized":"2024-09-18T01:29:01.305009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:01.304883+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:01.304883+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.304883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:08.393205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:13.892430+0000","last_change":"2024-09-18T01:29:13.892430+0000","last_active":"2024-09-18T01:29:13.892430+0000","last_peered":"2024-09-18T01:29:13.892430+0000","last_clean":"2024-09-18T01:29:13.892430+0000","last_became_active":"2024-09-18T01:25:06.700357+0000","last_became_peered":"2024-09-18T01:25:06.700357+0000","last_unstale":"2024-09-18T01:29:13.892430+0000","last_undegraded":"2024-09-18T01:29:13.892430+0000","last_fullsized":"2024-09-18T01:29:13.892430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:13.892307+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:13.892307+0000","last_clean_scrub_stamp":"2024-09-18T01:29:13.892307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:12:04.203571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"35'2","reported_seq":231,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:45.605224+0000","last_change":"2024-09-18T01:28:45.605224+0000","last_active":"2024-09-18T01:28:45.605224+0000","last_peered":"2024-09-18T01:28:45.605224+0000","last_clean":"2024-09-18T01:28:45.605224+0000","last_became_active":"2024-09-18T01:25:10.679652+0000","last_became_peered":"2024-09-18T01:25:10.679652+0000","last_unstale":"2024-09-18T01:28:45.605224+0000","last_undegraded":"2024-09-18T01:28:45.605224+0000","last_fullsized":"2024-09-18T01:28:45.605224+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:45.605047+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:45.605047+0000","last_clean_scrub_stamp":"2024-09-18T01:28:45.605047+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:05:23.022870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'43","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.069454+0000","last_change":"2024-09-18T01:28:33.069454+0000","last_active":"2024-09-18T01:28:33.069454+0000","last_peered":"2024-09-18T01:28:33.069454+0000","last_clean":"2024-09-18T01:28:33.069454+0000","last_became_active":"2024-09-18T01:25:12.691691+0000","last_became_peered":"2024-09-18T01:25:12.691691+0000","last_unstale":"2024-09-18T01:28:33.069454+0000","last_undegraded":"2024-09-18T01:28:33.069454+0000","last_fullsized":"2024-09-18T01:28:33.069454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'43","last_scrub_stamp":"2024-09-18T01:28:33.069322+0000","last_deep_scrub":"35'43","last_deep_scrub_stamp":"2024-09-18T01:28:33.069322+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.069322+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:48.566800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.665641+0000","last_change":"2024-09-18T01:28:29.665641+0000","last_active":"2024-09-18T01:28:29.665641+0000","last_peered":"2024-09-18T01:28:29.665641+0000","last_clean":"2024-09-18T01:28:29.665641+0000","last_became_active":"2024-09-18T01:25:14.706505+0000","last_became_peered":"2024-09-18T01:25:14.706505+0000","last_unstale":"2024-09-18T01:28:29.665641+0000","last_undegraded":"2024-09-18T01:28:29.665641+0000","last_fullsized":"2024-09-18T01:28:29.665641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.665468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.665468+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.665468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:49:54.985306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'4","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:26.499974+0000","last_change":"2024-09-18T01:29:26.499974+0000","last_active":"2024-09-18T01:29:26.499974+0000","last_peered":"2024-09-18T01:29:26.499974+0000","last_clean":"2024-09-18T01:29:26.499974+0000","last_became_active":"2024-09-18T01:25:16.713453+0000","last_became_peered":"2024-09-18T01:25:16.713453+0000","last_unstale":"2024-09-18T01:29:26.499974+0000","last_undegraded":"2024-09-18T01:29:26.499974+0000","last_fullsized":"2024-09-18T01:29:26.499974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:26.499843+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:26.499843+0000","last_clean_scrub_stamp":"2024-09-18T01:29:26.499843+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:32:36.289550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.807348+0000","last_change":"2024-09-18T01:29:03.807348+0000","last_active":"2024-09-18T01:29:03.807348+0000","last_peered":"2024-09-18T01:29:03.807348+0000","last_clean":"2024-09-18T01:29:03.807348+0000","last_became_active":"2024-09-18T01:25:08.674525+0000","last_became_peered":"2024-09-18T01:25:08.674525+0000","last_unstale":"2024-09-18T01:29:03.807348+0000","last_undegraded":"2024-09-18T01:29:03.807348+0000","last_fullsized":"2024-09-18T01:29:03.807348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:03.807231+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:03.807231+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.807231+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:06:51.447638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:16.988304+0000","last_change":"2024-09-18T01:29:16.988304+0000","last_active":"2024-09-18T01:29:16.988304+0000","last_peered":"2024-09-18T01:29:16.988304+0000","last_clean":"2024-09-18T01:29:16.988304+0000","last_became_active":"2024-09-18T01:25:06.694058+0000","last_became_peered":"2024-09-18T01:25:06.694058+0000","last_unstale":"2024-09-18T01:29:16.988304+0000","last_undegraded":"2024-09-18T01:29:16.988304+0000","last_fullsized":"2024-09-18T01:29:16.988304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:16.988182+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:16.988182+0000","last_clean_scrub_stamp":"2024-09-18T01:29:16.988182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:28:36.102353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:19.818585+0000","last_change":"2024-09-18T01:29:19.818621+0000","last_active":"2024-09-18T01:29:19.818585+0000","last_peered":"2024-09-18T01:29:19.818585+0000","last_clean":"2024-09-18T01:29:19.818585+0000","last_became_active":"2024-09-18T01:25:43.903638+0000","last_became_peered":"2024-09-18T01:25:43.903638+0000","last_unstale":"2024-09-18T01:29:19.818585+0000","last_undegraded":"2024-09-18T01:29:19.818585+0000","last_fullsized":"2024-09-18T01:29:19.818585+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:19.818447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:19.818447+0000","last_clean_scrub_stamp":"2024-09-18T01:29:19.818447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:13.037383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'60","reported_seq":131,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.055969+0000","last_change":"2024-09-18T01:28:54.055969+0000","last_active":"2024-09-18T01:28:54.055969+0000","last_peered":"2024-09-18T01:28:54.055969+0000","last_clean":"2024-09-18T01:28:54.055969+0000","last_became_active":"2024-09-18T01:25:12.693182+0000","last_became_peered":"2024-09-18T01:25:12.693182+0000","last_unstale":"2024-09-18T01:28:54.055969+0000","last_undegraded":"2024-09-18T01:28:54.055969+0000","last_fullsized":"2024-09-18T01:28:54.055969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'60","last_scrub_stamp":"2024-09-18T01:28:54.055805+0000","last_deep_scrub":"35'60","last_deep_scrub_stamp":"2024-09-18T01:28:54.055805+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.055805+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:07.480785+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":361,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.671899+0000","last_change":"2024-09-18T01:28:28.671899+0000","last_active":"2024-09-18T01:28:28.671899+0000","last_peered":"2024-09-18T01:28:28.671899+0000","last_clean":"2024-09-18T01:28:28.671899+0000","last_became_active":"2024-09-18T01:25:14.706540+0000","last_became_peered":"2024-09-18T01:25:14.706540+0000","last_unstale":"2024-09-18T01:28:28.671899+0000","last_undegraded":"2024-09-18T01:28:28.671899+0000","last_fullsized":"2024-09-18T01:28:28.671899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:28.671739+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:28.671739+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.671739+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:02.156270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:27.509135+0000","last_change":"2024-09-18T01:29:27.509135+0000","last_active":"2024-09-18T01:29:27.509135+0000","last_peered":"2024-09-18T01:29:27.509135+0000","last_clean":"2024-09-18T01:29:27.509135+0000","last_became_active":"2024-09-18T01:25:16.714363+0000","last_became_peered":"2024-09-18T01:25:16.714363+0000","last_unstale":"2024-09-18T01:29:27.509135+0000","last_undegraded":"2024-09-18T01:29:27.509135+0000","last_fullsized":"2024-09-18T01:29:27.509135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:27.508960+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:27.508960+0000","last_clean_scrub_stamp":"2024-09-18T01:29:27.508960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:14:05.164814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'4","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.853852+0000","last_change":"2024-09-18T01:28:55.853852+0000","last_active":"2024-09-18T01:28:55.853852+0000","last_peered":"2024-09-18T01:28:55.853852+0000","last_clean":"2024-09-18T01:28:55.853852+0000","last_became_active":"2024-09-18T01:25:08.670617+0000","last_became_peered":"2024-09-18T01:25:08.670617+0000","last_unstale":"2024-09-18T01:28:55.853852+0000","last_undegraded":"2024-09-18T01:28:55.853852+0000","last_fullsized":"2024-09-18T01:28:55.853852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:55.853740+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:55.853740+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.853740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:37:55.765115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:28.958546+0000","last_change":"2024-09-18T01:29:28.958546+0000","last_active":"2024-09-18T01:29:28.958546+0000","last_peered":"2024-09-18T01:29:28.958546+0000","last_clean":"2024-09-18T01:29:28.958546+0000","last_became_active":"2024-09-18T01:25:06.689545+0000","last_became_peered":"2024-09-18T01:25:06.689545+0000","last_unstale":"2024-09-18T01:29:28.958546+0000","last_undegraded":"2024-09-18T01:29:28.958546+0000","last_fullsized":"2024-09-18T01:29:28.958546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:28.958426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:28.958426+0000","last_clean_scrub_stamp":"2024-09-18T01:29:28.958426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:38:45.450412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:21.809065+0000","last_change":"2024-09-18T01:29:21.809086+0000","last_active":"2024-09-18T01:29:21.809065+0000","last_peered":"2024-09-18T01:29:21.809065+0000","last_clean":"2024-09-18T01:29:21.809065+0000","last_became_active":"2024-09-18T01:25:43.907094+0000","last_became_peered":"2024-09-18T01:25:43.907094+0000","last_unstale":"2024-09-18T01:29:21.809065+0000","last_undegraded":"2024-09-18T01:29:21.809065+0000","last_fullsized":"2024-09-18T01:29:21.809065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:21.808965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:21.808965+0000","last_clean_scrub_stamp":"2024-09-18T01:29:21.808965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:05:46.175533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'81","reported_seq":167,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.022879+0000","last_change":"2024-09-18T01:28:57.022879+0000","last_active":"2024-09-18T01:28:57.022879+0000","last_peered":"2024-09-18T01:28:57.022879+0000","last_clean":"2024-09-18T01:28:57.022879+0000","last_became_active":"2024-09-18T01:25:12.692821+0000","last_became_peered":"2024-09-18T01:25:12.692821+0000","last_unstale":"2024-09-18T01:28:57.022879+0000","last_undegraded":"2024-09-18T01:28:57.022879+0000","last_fullsized":"2024-09-18T01:28:57.022879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'81","last_scrub_stamp":"2024-09-18T01:28:57.022705+0000","last_deep_scrub":"35'81","last_deep_scrub_stamp":"2024-09-18T01:28:57.022705+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.022705+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:33.670619+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":84,"num_read_kb":81,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.550677+0000","last_change":"2024-09-18T01:28:47.550677+0000","last_active":"2024-09-18T01:28:47.550677+0000","last_peered":"2024-09-18T01:28:47.550677+0000","last_clean":"2024-09-18T01:28:47.550677+0000","last_became_active":"2024-09-18T01:25:14.707514+0000","last_became_peered":"2024-09-18T01:25:14.707514+0000","last_unstale":"2024-09-18T01:28:47.550677+0000","last_undegraded":"2024-09-18T01:28:47.550677+0000","last_fullsized":"2024-09-18T01:28:47.550677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:47.550559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:47.550559+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.550559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:14:27.993350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'21","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.535536+0000","last_change":"2024-09-18T01:29:22.535536+0000","last_active":"2024-09-18T01:29:22.535536+0000","last_peered":"2024-09-18T01:29:22.535536+0000","last_clean":"2024-09-18T01:29:22.535536+0000","last_became_active":"2024-09-18T01:25:16.705938+0000","last_became_peered":"2024-09-18T01:25:16.705938+0000","last_unstale":"2024-09-18T01:29:22.535536+0000","last_undegraded":"2024-09-18T01:29:22.535536+0000","last_fullsized":"2024-09-18T01:29:22.535536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-09-18T01:29:22.535413+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-09-18T01:29:22.535413+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.535413+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:20.985121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.222874+0000","last_change":"2024-09-18T01:28:49.222874+0000","last_active":"2024-09-18T01:28:49.222874+0000","last_peered":"2024-09-18T01:28:49.222874+0000","last_clean":"2024-09-18T01:28:49.222874+0000","last_became_active":"2024-09-18T01:25:08.687135+0000","last_became_peered":"2024-09-18T01:25:08.687135+0000","last_unstale":"2024-09-18T01:28:49.222874+0000","last_undegraded":"2024-09-18T01:28:49.222874+0000","last_fullsized":"2024-09-18T01:28:49.222874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:49.222741+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:49.222741+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.222741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:14.553771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:16.453033+0000","last_change":"2024-09-18T01:29:16.453033+0000","last_active":"2024-09-18T01:29:16.453033+0000","last_peered":"2024-09-18T01:29:16.453033+0000","last_clean":"2024-09-18T01:29:16.453033+0000","last_became_active":"2024-09-18T01:25:06.680774+0000","last_became_peered":"2024-09-18T01:25:06.680774+0000","last_unstale":"2024-09-18T01:29:16.453033+0000","last_undegraded":"2024-09-18T01:29:16.453033+0000","last_fullsized":"2024-09-18T01:29:16.453033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:16.452922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:16.452922+0000","last_clean_scrub_stamp":"2024-09-18T01:29:16.452922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:46:49.286842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.752267+0000","last_change":"2024-09-18T01:28:48.752267+0000","last_active":"2024-09-18T01:28:48.752267+0000","last_peered":"2024-09-18T01:28:48.752267+0000","last_clean":"2024-09-18T01:28:48.752267+0000","last_became_active":"2024-09-18T01:25:10.674983+0000","last_became_peered":"2024-09-18T01:25:10.674983+0000","last_unstale":"2024-09-18T01:28:48.752267+0000","last_undegraded":"2024-09-18T01:28:48.752267+0000","last_fullsized":"2024-09-18T01:28:48.752267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:48.752118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:48.752118+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.752118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:42:22.390584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'46","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.373391+0000","last_change":"2024-09-18T01:28:33.373391+0000","last_active":"2024-09-18T01:28:33.373391+0000","last_peered":"2024-09-18T01:28:33.373391+0000","last_clean":"2024-09-18T01:28:33.373391+0000","last_became_active":"2024-09-18T01:25:12.683339+0000","last_became_peered":"2024-09-18T01:25:12.683339+0000","last_unstale":"2024-09-18T01:28:33.373391+0000","last_undegraded":"2024-09-18T01:28:33.373391+0000","last_fullsized":"2024-09-18T01:28:33.373391+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:33.373272+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:33.373272+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.373272+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:10:34.585302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.045296+0000","last_change":"2024-09-18T01:28:59.045296+0000","last_active":"2024-09-18T01:28:59.045296+0000","last_peered":"2024-09-18T01:28:59.045296+0000","last_clean":"2024-09-18T01:28:59.045296+0000","last_became_active":"2024-09-18T01:25:14.707116+0000","last_became_peered":"2024-09-18T01:25:14.707116+0000","last_unstale":"2024-09-18T01:28:59.045296+0000","last_undegraded":"2024-09-18T01:28:59.045296+0000","last_fullsized":"2024-09-18T01:28:59.045296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:59.045185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:59.045185+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.045185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:59:27.668851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.045461+0000","last_change":"2024-09-18T01:29:15.045461+0000","last_active":"2024-09-18T01:29:15.045461+0000","last_peered":"2024-09-18T01:29:15.045461+0000","last_clean":"2024-09-18T01:29:15.045461+0000","last_became_active":"2024-09-18T01:25:16.708095+0000","last_became_peered":"2024-09-18T01:25:16.708095+0000","last_unstale":"2024-09-18T01:29:15.045461+0000","last_undegraded":"2024-09-18T01:29:15.045461+0000","last_fullsized":"2024-09-18T01:29:15.045461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:15.045296+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:15.045296+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.045296+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:34:54.730738+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.038123+0000","last_change":"2024-09-18T01:28:42.038123+0000","last_active":"2024-09-18T01:28:42.038123+0000","last_peered":"2024-09-18T01:28:42.038123+0000","last_clean":"2024-09-18T01:28:42.038123+0000","last_became_active":"2024-09-18T01:25:08.688251+0000","last_became_peered":"2024-09-18T01:25:08.688251+0000","last_unstale":"2024-09-18T01:28:42.038123+0000","last_undegraded":"2024-09-18T01:28:42.038123+0000","last_fullsized":"2024-09-18T01:28:42.038123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:42.037965+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:42.037965+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.037965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:21:09.764214+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:32.002677+0000","last_change":"2024-09-18T01:29:32.002706+0000","last_active":"2024-09-18T01:29:32.002677+0000","last_peered":"2024-09-18T01:29:32.002677+0000","last_clean":"2024-09-18T01:29:32.002677+0000","last_became_active":"2024-09-18T01:25:06.683437+0000","last_became_peered":"2024-09-18T01:25:06.683437+0000","last_unstale":"2024-09-18T01:29:32.002677+0000","last_undegraded":"2024-09-18T01:29:32.002677+0000","last_fullsized":"2024-09-18T01:29:32.002677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:32.002575+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:32.002575+0000","last_clean_scrub_stamp":"2024-09-18T01:29:32.002575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:11.297705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.594031+0000","last_change":"2024-09-18T01:28:44.594031+0000","last_active":"2024-09-18T01:28:44.594031+0000","last_peered":"2024-09-18T01:28:44.594031+0000","last_clean":"2024-09-18T01:28:44.594031+0000","last_became_active":"2024-09-18T01:25:10.679740+0000","last_became_peered":"2024-09-18T01:25:10.679740+0000","last_unstale":"2024-09-18T01:28:44.594031+0000","last_undegraded":"2024-09-18T01:28:44.594031+0000","last_fullsized":"2024-09-18T01:28:44.594031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:44.593908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:44.593908+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.593908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:48.222246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'45","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.694748+0000","last_change":"2024-09-18T01:28:40.694748+0000","last_active":"2024-09-18T01:28:40.694748+0000","last_peered":"2024-09-18T01:28:40.694748+0000","last_clean":"2024-09-18T01:28:40.694748+0000","last_became_active":"2024-09-18T01:25:12.686455+0000","last_became_peered":"2024-09-18T01:25:12.686455+0000","last_unstale":"2024-09-18T01:28:40.694748+0000","last_undegraded":"2024-09-18T01:28:40.694748+0000","last_fullsized":"2024-09-18T01:28:40.694748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-18T01:28:40.694620+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-18T01:28:40.694620+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.694620+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:30.077444+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":416,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.649256+0000","last_change":"2024-09-18T01:28:30.649256+0000","last_active":"2024-09-18T01:28:30.649256+0000","last_peered":"2024-09-18T01:28:30.649256+0000","last_clean":"2024-09-18T01:28:30.649256+0000","last_became_active":"2024-09-18T01:25:14.703877+0000","last_became_peered":"2024-09-18T01:25:14.703877+0000","last_unstale":"2024-09-18T01:28:30.649256+0000","last_undegraded":"2024-09-18T01:28:30.649256+0000","last_fullsized":"2024-09-18T01:28:30.649256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:30.649113+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:30.649113+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.649113+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:03.499336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'13","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:24.473786+0000","last_change":"2024-09-18T01:29:24.473786+0000","last_active":"2024-09-18T01:29:24.473786+0000","last_peered":"2024-09-18T01:29:24.473786+0000","last_clean":"2024-09-18T01:29:24.473786+0000","last_became_active":"2024-09-18T01:25:16.713677+0000","last_became_peered":"2024-09-18T01:25:16.713677+0000","last_unstale":"2024-09-18T01:29:24.473786+0000","last_undegraded":"2024-09-18T01:29:24.473786+0000","last_fullsized":"2024-09-18T01:29:24.473786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'13","last_scrub_stamp":"2024-09-18T01:29:24.473594+0000","last_deep_scrub":"35'13","last_deep_scrub_stamp":"2024-09-18T01:29:24.473594+0000","last_clean_scrub_stamp":"2024-09-18T01:29:24.473594+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:16:45.309204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.862588+0000","last_change":"2024-09-18T01:28:57.862588+0000","last_active":"2024-09-18T01:28:57.862588+0000","last_peered":"2024-09-18T01:28:57.862588+0000","last_clean":"2024-09-18T01:28:57.862588+0000","last_became_active":"2024-09-18T01:25:08.673276+0000","last_became_peered":"2024-09-18T01:25:08.673276+0000","last_unstale":"2024-09-18T01:28:57.862588+0000","last_undegraded":"2024-09-18T01:28:57.862588+0000","last_fullsized":"2024-09-18T01:28:57.862588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:57.862460+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:57.862460+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.862460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:25:54.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:43.086769+0000","last_change":"2024-09-18T01:29:43.086795+0000","last_active":"2024-09-18T01:29:43.086769+0000","last_peered":"2024-09-18T01:29:43.086769+0000","last_clean":"2024-09-18T01:29:43.086769+0000","last_became_active":"2024-09-18T01:25:06.682841+0000","last_became_peered":"2024-09-18T01:25:06.682841+0000","last_unstale":"2024-09-18T01:29:43.086769+0000","last_undegraded":"2024-09-18T01:29:43.086769+0000","last_fullsized":"2024-09-18T01:29:43.086769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:43.086666+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:43.086666+0000","last_clean_scrub_stamp":"2024-09-18T01:29:43.086666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:26:27.561510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":429,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.267271+0000","last_change":"2024-09-18T01:28:40.267271+0000","last_active":"2024-09-18T01:28:40.267271+0000","last_peered":"2024-09-18T01:28:40.267271+0000","last_clean":"2024-09-18T01:28:40.267271+0000","last_became_active":"2024-09-18T01:25:10.679483+0000","last_became_peered":"2024-09-18T01:25:10.679483+0000","last_unstale":"2024-09-18T01:28:40.267271+0000","last_undegraded":"2024-09-18T01:28:40.267271+0000","last_fullsized":"2024-09-18T01:28:40.267271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-18T01:28:40.267152+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-18T01:28:40.267152+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.267152+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:35.825702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.098116+0000","last_change":"2024-09-18T01:28:53.098116+0000","last_active":"2024-09-18T01:28:53.098116+0000","last_peered":"2024-09-18T01:28:53.098116+0000","last_clean":"2024-09-18T01:28:53.098116+0000","last_became_active":"2024-09-18T01:25:12.696726+0000","last_became_peered":"2024-09-18T01:25:12.696726+0000","last_unstale":"2024-09-18T01:28:53.098116+0000","last_undegraded":"2024-09-18T01:28:53.098116+0000","last_fullsized":"2024-09-18T01:28:53.098116+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-18T01:28:53.097976+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-18T01:28:53.097976+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.097976+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:31:13.343479+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":523,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.350881+0000","last_change":"2024-09-18T01:28:35.350881+0000","last_active":"2024-09-18T01:28:35.350881+0000","last_peered":"2024-09-18T01:28:35.350881+0000","last_clean":"2024-09-18T01:28:35.350881+0000","last_became_active":"2024-09-18T01:25:14.702900+0000","last_became_peered":"2024-09-18T01:25:14.702900+0000","last_unstale":"2024-09-18T01:28:35.350881+0000","last_undegraded":"2024-09-18T01:28:35.350881+0000","last_fullsized":"2024-09-18T01:28:35.350881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:35.350746+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:35.350746+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.350746+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:24.733569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.703271+0000","last_change":"2024-09-18T01:28:41.703271+0000","last_active":"2024-09-18T01:28:41.703271+0000","last_peered":"2024-09-18T01:28:41.703271+0000","last_clean":"2024-09-18T01:28:41.703271+0000","last_became_active":"2024-09-18T01:25:16.712084+0000","last_became_peered":"2024-09-18T01:25:16.712084+0000","last_unstale":"2024-09-18T01:28:41.703271+0000","last_undegraded":"2024-09-18T01:28:41.703271+0000","last_fullsized":"2024-09-18T01:28:41.703271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:41.703089+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:41.703089+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.703089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:26:56.294603+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'8","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.243573+0000","last_change":"2024-09-18T01:28:52.243573+0000","last_active":"2024-09-18T01:28:52.243573+0000","last_peered":"2024-09-18T01:28:52.243573+0000","last_clean":"2024-09-18T01:28:52.243573+0000","last_became_active":"2024-09-18T01:25:08.686802+0000","last_became_peered":"2024-09-18T01:25:08.686802+0000","last_unstale":"2024-09-18T01:28:52.243573+0000","last_undegraded":"2024-09-18T01:28:52.243573+0000","last_fullsized":"2024-09-18T01:28:52.243573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:52.243420+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:52.243420+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.243420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:29.295501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:18.033899+0000","last_change":"2024-09-18T01:29:18.033899+0000","last_active":"2024-09-18T01:29:18.033899+0000","last_peered":"2024-09-18T01:29:18.033899+0000","last_clean":"2024-09-18T01:29:18.033899+0000","last_became_active":"2024-09-18T01:25:06.691644+0000","last_became_peered":"2024-09-18T01:25:06.691644+0000","last_unstale":"2024-09-18T01:29:18.033899+0000","last_undegraded":"2024-09-18T01:29:18.033899+0000","last_fullsized":"2024-09-18T01:29:18.033899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:18.033754+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:18.033754+0000","last_clean_scrub_stamp":"2024-09-18T01:29:18.033754+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:54:59.833695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.109380+0000","last_change":"2024-09-18T01:28:32.109380+0000","last_active":"2024-09-18T01:28:32.109380+0000","last_peered":"2024-09-18T01:28:32.109380+0000","last_clean":"2024-09-18T01:28:32.109380+0000","last_became_active":"2024-09-18T01:25:10.682075+0000","last_became_peered":"2024-09-18T01:25:10.682075+0000","last_unstale":"2024-09-18T01:28:32.109380+0000","last_undegraded":"2024-09-18T01:28:32.109380+0000","last_fullsized":"2024-09-18T01:28:32.109380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:32.109232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:32.109232+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.109232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:37.084368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'49","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.423980+0000","last_change":"2024-09-18T01:28:32.423980+0000","last_active":"2024-09-18T01:28:32.423980+0000","last_peered":"2024-09-18T01:28:32.423980+0000","last_clean":"2024-09-18T01:28:32.423980+0000","last_became_active":"2024-09-18T01:25:12.686460+0000","last_became_peered":"2024-09-18T01:25:12.686460+0000","last_unstale":"2024-09-18T01:28:32.423980+0000","last_undegraded":"2024-09-18T01:28:32.423980+0000","last_fullsized":"2024-09-18T01:28:32.423980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-09-18T01:28:32.423801+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-09-18T01:28:32.423801+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.423801+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:00:55.455121+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.575318+0000","last_change":"2024-09-18T01:28:27.575318+0000","last_active":"2024-09-18T01:28:27.575318+0000","last_peered":"2024-09-18T01:28:27.575318+0000","last_clean":"2024-09-18T01:28:27.575318+0000","last_became_active":"2024-09-18T01:25:14.706506+0000","last_became_peered":"2024-09-18T01:25:14.706506+0000","last_unstale":"2024-09-18T01:28:27.575318+0000","last_undegraded":"2024-09-18T01:28:27.575318+0000","last_fullsized":"2024-09-18T01:28:27.575318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:27.575151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:27.575151+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.575151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:28.541634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'7","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.228116+0000","last_change":"2024-09-18T01:28:55.228116+0000","last_active":"2024-09-18T01:28:55.228116+0000","last_peered":"2024-09-18T01:28:55.228116+0000","last_clean":"2024-09-18T01:28:55.228116+0000","last_became_active":"2024-09-18T01:25:16.709084+0000","last_became_peered":"2024-09-18T01:25:16.709084+0000","last_unstale":"2024-09-18T01:28:55.228116+0000","last_undegraded":"2024-09-18T01:28:55.228116+0000","last_fullsized":"2024-09-18T01:28:55.228116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:28:55.227978+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:28:55.227978+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.227978+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:40.596230+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'7","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.022803+0000","last_change":"2024-09-18T01:28:44.022803+0000","last_active":"2024-09-18T01:28:44.022803+0000","last_peered":"2024-09-18T01:28:44.022803+0000","last_clean":"2024-09-18T01:28:44.022803+0000","last_became_active":"2024-09-18T01:25:08.687896+0000","last_became_peered":"2024-09-18T01:25:08.687896+0000","last_unstale":"2024-09-18T01:28:44.022803+0000","last_undegraded":"2024-09-18T01:28:44.022803+0000","last_fullsized":"2024-09-18T01:28:44.022803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:28:44.022693+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:28:44.022693+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.022693+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:27.889066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":216,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:13.331194+0000","last_change":"2024-09-18T01:29:13.331251+0000","last_active":"2024-09-18T01:29:13.331194+0000","last_peered":"2024-09-18T01:29:13.331194+0000","last_clean":"2024-09-18T01:29:13.331194+0000","last_became_active":"2024-09-18T01:24:52.296214+0000","last_became_peered":"2024-09-18T01:24:52.296214+0000","last_unstale":"2024-09-18T01:29:13.331194+0000","last_undegraded":"2024-09-18T01:29:13.331194+0000","last_fullsized":"2024-09-18T01:29:13.331194+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-09-18T01:29:13.331084+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-09-18T01:29:13.331084+0000","last_clean_scrub_stamp":"2024-09-18T01:29:13.331084+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:06.550020+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"35'2","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:40.062021+0000","last_change":"2024-09-18T01:29:40.062068+0000","last_active":"2024-09-18T01:29:40.062021+0000","last_peered":"2024-09-18T01:29:40.062021+0000","last_clean":"2024-09-18T01:29:40.062021+0000","last_became_active":"2024-09-18T01:24:56.194443+0000","last_became_peered":"2024-09-18T01:24:56.194443+0000","last_unstale":"2024-09-18T01:29:40.062021+0000","last_undegraded":"2024-09-18T01:29:40.062021+0000","last_fullsized":"2024-09-18T01:29:40.062021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:40.061919+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:40.061919+0000","last_clean_scrub_stamp":"2024-09-18T01:29:40.061919+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:56:03.404879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033763700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:29.948219+0000","last_change":"2024-09-18T01:29:29.948273+0000","last_active":"2024-09-18T01:29:29.948219+0000","last_peered":"2024-09-18T01:29:29.948219+0000","last_clean":"2024-09-18T01:29:29.948219+0000","last_became_active":"2024-09-18T01:25:06.683975+0000","last_became_peered":"2024-09-18T01:25:06.683975+0000","last_unstale":"2024-09-18T01:29:29.948219+0000","last_undegraded":"2024-09-18T01:29:29.948219+0000","last_fullsized":"2024-09-18T01:29:29.948219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:29.948108+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:29.948108+0000","last_clean_scrub_stamp":"2024-09-18T01:29:29.948108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:26:00.090673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.273084+0000","last_change":"2024-09-18T01:28:41.273084+0000","last_active":"2024-09-18T01:28:41.273084+0000","last_peered":"2024-09-18T01:28:41.273084+0000","last_clean":"2024-09-18T01:28:41.273084+0000","last_became_active":"2024-09-18T01:25:10.679572+0000","last_became_peered":"2024-09-18T01:25:10.679572+0000","last_unstale":"2024-09-18T01:28:41.273084+0000","last_undegraded":"2024-09-18T01:28:41.273084+0000","last_fullsized":"2024-09-18T01:28:41.273084+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:41.272968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:41.272968+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.272968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:18:48.599189+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'94","reported_seq":191,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.133548+0000","last_change":"2024-09-18T01:28:39.133548+0000","last_active":"2024-09-18T01:28:39.133548+0000","last_peered":"2024-09-18T01:28:39.133548+0000","last_clean":"2024-09-18T01:28:39.133548+0000","last_became_active":"2024-09-18T01:25:12.691952+0000","last_became_peered":"2024-09-18T01:25:12.691952+0000","last_unstale":"2024-09-18T01:28:39.133548+0000","last_undegraded":"2024-09-18T01:28:39.133548+0000","last_fullsized":"2024-09-18T01:28:39.133548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'94","last_scrub_stamp":"2024-09-18T01:28:39.133419+0000","last_deep_scrub":"35'94","last_deep_scrub_stamp":"2024-09-18T01:28:39.133419+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.133419+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:11:05.713633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.670355+0000","last_change":"2024-09-18T01:28:31.670355+0000","last_active":"2024-09-18T01:28:31.670355+0000","last_peered":"2024-09-18T01:28:31.670355+0000","last_clean":"2024-09-18T01:28:31.670355+0000","last_became_active":"2024-09-18T01:25:14.706519+0000","last_became_peered":"2024-09-18T01:25:14.706519+0000","last_unstale":"2024-09-18T01:28:31.670355+0000","last_undegraded":"2024-09-18T01:28:31.670355+0000","last_fullsized":"2024-09-18T01:28:31.670355+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.670230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.670230+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.670230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:37.902202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'85","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:45.758628+0000","last_change":"2024-09-18T01:28:45.758628+0000","last_active":"2024-09-18T01:28:45.758628+0000","last_peered":"2024-09-18T01:28:45.758628+0000","last_clean":"2024-09-18T01:28:45.758628+0000","last_became_active":"2024-09-18T01:25:16.712102+0000","last_became_peered":"2024-09-18T01:25:16.712102+0000","last_unstale":"2024-09-18T01:28:45.758628+0000","last_undegraded":"2024-09-18T01:28:45.758628+0000","last_fullsized":"2024-09-18T01:28:45.758628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'85","last_scrub_stamp":"2024-09-18T01:28:45.758460+0000","last_deep_scrub":"35'85","last_deep_scrub_stamp":"2024-09-18T01:28:45.758460+0000","last_clean_scrub_stamp":"2024-09-18T01:28:45.758460+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:39.752325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":221,"num_write":168,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'8","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.999350+0000","last_change":"2024-09-18T01:29:15.999350+0000","last_active":"2024-09-18T01:29:15.999350+0000","last_peered":"2024-09-18T01:29:15.999350+0000","last_clean":"2024-09-18T01:29:15.999350+0000","last_became_active":"2024-09-18T01:25:08.671578+0000","last_became_peered":"2024-09-18T01:25:08.671578+0000","last_unstale":"2024-09-18T01:29:15.999350+0000","last_undegraded":"2024-09-18T01:29:15.999350+0000","last_fullsized":"2024-09-18T01:29:15.999350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:15.999222+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:15.999222+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.999222+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:05:28.202872+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:37.006840+0000","last_change":"2024-09-18T01:29:37.006867+0000","last_active":"2024-09-18T01:29:37.006840+0000","last_peered":"2024-09-18T01:29:37.006840+0000","last_clean":"2024-09-18T01:29:37.006840+0000","last_became_active":"2024-09-18T01:24:56.191554+0000","last_became_peered":"2024-09-18T01:24:56.191554+0000","last_unstale":"2024-09-18T01:29:37.006840+0000","last_undegraded":"2024-09-18T01:29:37.006840+0000","last_fullsized":"2024-09-18T01:29:37.006840+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:37.006743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:37.006743+0000","last_clean_scrub_stamp":"2024-09-18T01:29:37.006743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:45:10.731378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041584599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:17.493372+0000","last_change":"2024-09-18T01:29:17.493372+0000","last_active":"2024-09-18T01:29:17.493372+0000","last_peered":"2024-09-18T01:29:17.493372+0000","last_clean":"2024-09-18T01:29:17.493372+0000","last_became_active":"2024-09-18T01:25:06.680635+0000","last_became_peered":"2024-09-18T01:25:06.680635+0000","last_unstale":"2024-09-18T01:29:17.493372+0000","last_undegraded":"2024-09-18T01:29:17.493372+0000","last_fullsized":"2024-09-18T01:29:17.493372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:17.493252+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:17.493252+0000","last_clean_scrub_stamp":"2024-09-18T01:29:17.493252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:00:56.730173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.041935+0000","last_change":"2024-09-18T01:28:34.041935+0000","last_active":"2024-09-18T01:28:34.041935+0000","last_peered":"2024-09-18T01:28:34.041935+0000","last_clean":"2024-09-18T01:28:34.041935+0000","last_became_active":"2024-09-18T01:25:10.681988+0000","last_became_peered":"2024-09-18T01:25:10.681988+0000","last_unstale":"2024-09-18T01:28:34.041935+0000","last_undegraded":"2024-09-18T01:28:34.041935+0000","last_fullsized":"2024-09-18T01:28:34.041935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:34.041811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:34.041811+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.041811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:05:37.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'297","reported_seq":529,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.359441+0000","last_change":"2024-09-18T01:28:27.359441+0000","last_active":"2024-09-18T01:28:27.359441+0000","last_peered":"2024-09-18T01:28:27.359441+0000","last_clean":"2024-09-18T01:28:27.359441+0000","last_became_active":"2024-09-18T01:25:12.693664+0000","last_became_peered":"2024-09-18T01:25:12.693664+0000","last_unstale":"2024-09-18T01:28:27.359441+0000","last_undegraded":"2024-09-18T01:28:27.359441+0000","last_fullsized":"2024-09-18T01:28:27.359441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'297","last_scrub_stamp":"2024-09-18T01:28:27.359261+0000","last_deep_scrub":"35'297","last_deep_scrub_stamp":"2024-09-18T01:28:27.359261+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.359261+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:28:05.502483+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.086190+0000","last_change":"2024-09-18T01:28:51.086190+0000","last_active":"2024-09-18T01:28:51.086190+0000","last_peered":"2024-09-18T01:28:51.086190+0000","last_clean":"2024-09-18T01:28:51.086190+0000","last_became_active":"2024-09-18T01:25:14.707143+0000","last_became_peered":"2024-09-18T01:25:14.707143+0000","last_unstale":"2024-09-18T01:28:51.086190+0000","last_undegraded":"2024-09-18T01:28:51.086190+0000","last_fullsized":"2024-09-18T01:28:51.086190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:51.086082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:51.086082+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.086082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:29:21.095319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:28.486151+0000","last_change":"2024-09-18T01:29:28.486151+0000","last_active":"2024-09-18T01:29:28.486151+0000","last_peered":"2024-09-18T01:29:28.486151+0000","last_clean":"2024-09-18T01:29:28.486151+0000","last_became_active":"2024-09-18T01:25:16.712931+0000","last_became_peered":"2024-09-18T01:25:16.712931+0000","last_unstale":"2024-09-18T01:29:28.486151+0000","last_undegraded":"2024-09-18T01:29:28.486151+0000","last_fullsized":"2024-09-18T01:29:28.486151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-18T01:29:28.485989+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-18T01:29:28.485989+0000","last_clean_scrub_stamp":"2024-09-18T01:29:28.485989+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:55.509346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:11.476574+0000","last_change":"2024-09-18T01:29:11.476574+0000","last_active":"2024-09-18T01:29:11.476574+0000","last_peered":"2024-09-18T01:29:11.476574+0000","last_clean":"2024-09-18T01:29:11.476574+0000","last_became_active":"2024-09-18T01:25:08.680541+0000","last_became_peered":"2024-09-18T01:25:08.680541+0000","last_unstale":"2024-09-18T01:29:11.476574+0000","last_undegraded":"2024-09-18T01:29:11.476574+0000","last_fullsized":"2024-09-18T01:29:11.476574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:11.476456+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:11.476456+0000","last_clean_scrub_stamp":"2024-09-18T01:29:11.476456+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:48.447070+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:07.830066+0000","last_change":"2024-09-18T01:29:07.830066+0000","last_active":"2024-09-18T01:29:07.830066+0000","last_peered":"2024-09-18T01:29:07.830066+0000","last_clean":"2024-09-18T01:29:07.830066+0000","last_became_active":"2024-09-18T01:24:56.191162+0000","last_became_peered":"2024-09-18T01:24:56.191162+0000","last_unstale":"2024-09-18T01:29:07.830066+0000","last_undegraded":"2024-09-18T01:29:07.830066+0000","last_fullsized":"2024-09-18T01:29:07.830066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:07.829938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:07.829938+0000","last_clean_scrub_stamp":"2024-09-18T01:29:07.829938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:20.798729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040921399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:08.500119+0000","last_change":"2024-09-18T01:29:08.500146+0000","last_active":"2024-09-18T01:29:08.500119+0000","last_peered":"2024-09-18T01:29:08.500119+0000","last_clean":"2024-09-18T01:29:08.500119+0000","last_became_active":"2024-09-18T01:25:06.686053+0000","last_became_peered":"2024-09-18T01:25:06.686053+0000","last_unstale":"2024-09-18T01:29:08.500119+0000","last_undegraded":"2024-09-18T01:29:08.500119+0000","last_fullsized":"2024-09-18T01:29:08.500119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:08.500012+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:08.500012+0000","last_clean_scrub_stamp":"2024-09-18T01:29:08.500012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:34.922339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.729134+0000","last_change":"2024-09-18T01:28:47.729134+0000","last_active":"2024-09-18T01:28:47.729134+0000","last_peered":"2024-09-18T01:28:47.729134+0000","last_clean":"2024-09-18T01:28:47.729134+0000","last_became_active":"2024-09-18T01:25:10.677597+0000","last_became_peered":"2024-09-18T01:25:10.677597+0000","last_unstale":"2024-09-18T01:28:47.729134+0000","last_undegraded":"2024-09-18T01:28:47.729134+0000","last_fullsized":"2024-09-18T01:28:47.729134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:47.729010+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:47.729010+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.729010+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:44:00.635385+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'23","reported_seq":101,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.678878+0000","last_change":"2024-09-18T01:28:39.678878+0000","last_active":"2024-09-18T01:28:39.678878+0000","last_peered":"2024-09-18T01:28:39.678878+0000","last_clean":"2024-09-18T01:28:39.678878+0000","last_became_active":"2024-09-18T01:25:12.687799+0000","last_became_peered":"2024-09-18T01:25:12.687799+0000","last_unstale":"2024-09-18T01:28:39.678878+0000","last_undegraded":"2024-09-18T01:28:39.678878+0000","last_fullsized":"2024-09-18T01:28:39.678878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-09-18T01:28:39.678752+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-09-18T01:28:39.678752+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.678752+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:45.910724+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.698401+0000","last_change":"2024-09-18T01:28:27.698401+0000","last_active":"2024-09-18T01:28:27.698401+0000","last_peered":"2024-09-18T01:28:27.698401+0000","last_clean":"2024-09-18T01:28:27.698401+0000","last_became_active":"2024-09-18T01:25:14.706611+0000","last_became_peered":"2024-09-18T01:25:14.706611+0000","last_unstale":"2024-09-18T01:28:27.698401+0000","last_undegraded":"2024-09-18T01:28:27.698401+0000","last_fullsized":"2024-09-18T01:28:27.698401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:27.698307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:27.698307+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.698307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:17.902689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.799910+0000","last_change":"2024-09-18T01:25:16.711670+0000","last_active":"2024-09-18T01:27:34.799910+0000","last_peered":"2024-09-18T01:27:34.799910+0000","last_clean":"2024-09-18T01:27:34.799910+0000","last_became_active":"2024-09-18T01:25:16.711404+0000","last_became_peered":"2024-09-18T01:25:16.711404+0000","last_unstale":"2024-09-18T01:27:34.799910+0000","last_undegraded":"2024-09-18T01:27:34.799910+0000","last_fullsized":"2024-09-18T01:27:34.799910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:09.483226+0000","last_change":"2024-09-18T01:29:09.483226+0000","last_active":"2024-09-18T01:29:09.483226+0000","last_peered":"2024-09-18T01:29:09.483226+0000","last_clean":"2024-09-18T01:29:09.483226+0000","last_became_active":"2024-09-18T01:25:08.672969+0000","last_became_peered":"2024-09-18T01:25:08.672969+0000","last_unstale":"2024-09-18T01:29:09.483226+0000","last_undegraded":"2024-09-18T01:29:09.483226+0000","last_fullsized":"2024-09-18T01:29:09.483226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:09.483012+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:09.483012+0000","last_clean_scrub_stamp":"2024-09-18T01:29:09.483012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:10.006025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"35'3","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:38.024854+0000","last_change":"2024-09-18T01:29:38.024882+0000","last_active":"2024-09-18T01:29:38.024854+0000","last_peered":"2024-09-18T01:29:38.024854+0000","last_clean":"2024-09-18T01:29:38.024854+0000","last_became_active":"2024-09-18T01:24:56.191713+0000","last_became_peered":"2024-09-18T01:24:56.191713+0000","last_unstale":"2024-09-18T01:29:38.024854+0000","last_undegraded":"2024-09-18T01:29:38.024854+0000","last_fullsized":"2024-09-18T01:29:38.024854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:29:38.024769+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:29:38.024769+0000","last_clean_scrub_stamp":"2024-09-18T01:29:38.024769+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:00:16.212484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0010043490000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:12.924407+0000","last_change":"2024-09-18T01:29:12.924407+0000","last_active":"2024-09-18T01:29:12.924407+0000","last_peered":"2024-09-18T01:29:12.924407+0000","last_clean":"2024-09-18T01:29:12.924407+0000","last_became_active":"2024-09-18T01:25:06.700397+0000","last_became_peered":"2024-09-18T01:25:06.700397+0000","last_unstale":"2024-09-18T01:29:12.924407+0000","last_undegraded":"2024-09-18T01:29:12.924407+0000","last_fullsized":"2024-09-18T01:29:12.924407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:12.924288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:12.924288+0000","last_clean_scrub_stamp":"2024-09-18T01:29:12.924288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:25:17.867300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.497466+0000","last_change":"2024-09-18T01:28:52.497466+0000","last_active":"2024-09-18T01:28:52.497466+0000","last_peered":"2024-09-18T01:28:52.497466+0000","last_clean":"2024-09-18T01:28:52.497466+0000","last_became_active":"2024-09-18T01:25:10.676320+0000","last_became_peered":"2024-09-18T01:25:10.676320+0000","last_unstale":"2024-09-18T01:28:52.497466+0000","last_undegraded":"2024-09-18T01:28:52.497466+0000","last_fullsized":"2024-09-18T01:28:52.497466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:52.497353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:52.497353+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.497353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:53:33.827801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'20","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.995001+0000","last_change":"2024-09-18T01:28:42.995001+0000","last_active":"2024-09-18T01:28:42.995001+0000","last_peered":"2024-09-18T01:28:42.995001+0000","last_clean":"2024-09-18T01:28:42.995001+0000","last_became_active":"2024-09-18T01:25:12.692373+0000","last_became_peered":"2024-09-18T01:25:12.692373+0000","last_unstale":"2024-09-18T01:28:42.995001+0000","last_undegraded":"2024-09-18T01:28:42.995001+0000","last_fullsized":"2024-09-18T01:28:42.995001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:28:42.994815+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:28:42.994815+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.994815+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:43.271590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.107033+0000","last_change":"2024-09-18T01:29:03.107033+0000","last_active":"2024-09-18T01:29:03.107033+0000","last_peered":"2024-09-18T01:29:03.107033+0000","last_clean":"2024-09-18T01:29:03.107033+0000","last_became_active":"2024-09-18T01:25:14.707409+0000","last_became_peered":"2024-09-18T01:25:14.707409+0000","last_unstale":"2024-09-18T01:29:03.107033+0000","last_undegraded":"2024-09-18T01:29:03.107033+0000","last_fullsized":"2024-09-18T01:29:03.107033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:03.106906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:03.106906+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.106906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:24.958182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'6","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.398293+0000","last_change":"2024-09-18T01:29:22.398293+0000","last_active":"2024-09-18T01:29:22.398293+0000","last_peered":"2024-09-18T01:29:22.398293+0000","last_clean":"2024-09-18T01:29:22.398293+0000","last_became_active":"2024-09-18T01:25:16.711104+0000","last_became_peered":"2024-09-18T01:25:16.711104+0000","last_unstale":"2024-09-18T01:29:22.398293+0000","last_undegraded":"2024-09-18T01:29:22.398293+0000","last_fullsized":"2024-09-18T01:29:22.398293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:22.398178+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:22.398178+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.398178+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:15:04.145641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.183724+0000","last_change":"2024-09-18T01:28:50.183724+0000","last_active":"2024-09-18T01:28:50.183724+0000","last_peered":"2024-09-18T01:28:50.183724+0000","last_clean":"2024-09-18T01:28:50.183724+0000","last_became_active":"2024-09-18T01:25:08.687139+0000","last_became_peered":"2024-09-18T01:25:08.687139+0000","last_unstale":"2024-09-18T01:28:50.183724+0000","last_undegraded":"2024-09-18T01:28:50.183724+0000","last_fullsized":"2024-09-18T01:28:50.183724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:50.183577+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:50.183577+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.183577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:25.770565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:10.886037+0000","last_change":"2024-09-18T01:29:10.886037+0000","last_active":"2024-09-18T01:29:10.886037+0000","last_peered":"2024-09-18T01:29:10.886037+0000","last_clean":"2024-09-18T01:29:10.886037+0000","last_became_active":"2024-09-18T01:25:06.691871+0000","last_became_peered":"2024-09-18T01:25:06.691871+0000","last_unstale":"2024-09-18T01:29:10.886037+0000","last_undegraded":"2024-09-18T01:29:10.886037+0000","last_fullsized":"2024-09-18T01:29:10.886037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:10.885874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:10.885874+0000","last_clean_scrub_stamp":"2024-09-18T01:29:10.885874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:27.291671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:13.464330+0000","last_change":"2024-09-18T01:29:13.464359+0000","last_active":"2024-09-18T01:29:13.464330+0000","last_peered":"2024-09-18T01:29:13.464330+0000","last_clean":"2024-09-18T01:29:13.464330+0000","last_became_active":"2024-09-18T01:24:56.191033+0000","last_became_peered":"2024-09-18T01:24:56.191033+0000","last_unstale":"2024-09-18T01:29:13.464330+0000","last_undegraded":"2024-09-18T01:29:13.464330+0000","last_fullsized":"2024-09-18T01:29:13.464330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:13.464088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:13.464088+0000","last_clean_scrub_stamp":"2024-09-18T01:29:13.464088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:17.184392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000547898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.523244+0000","last_change":"2024-09-18T01:28:50.523244+0000","last_active":"2024-09-18T01:28:50.523244+0000","last_peered":"2024-09-18T01:28:50.523244+0000","last_clean":"2024-09-18T01:28:50.523244+0000","last_became_active":"2024-09-18T01:25:10.676531+0000","last_became_peered":"2024-09-18T01:25:10.676531+0000","last_unstale":"2024-09-18T01:28:50.523244+0000","last_undegraded":"2024-09-18T01:28:50.523244+0000","last_fullsized":"2024-09-18T01:28:50.523244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:50.523096+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:50.523096+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.523096+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:41:44.218280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'90","reported_seq":179,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.549893+0000","last_change":"2024-09-18T01:28:36.549893+0000","last_active":"2024-09-18T01:28:36.549893+0000","last_peered":"2024-09-18T01:28:36.549893+0000","last_clean":"2024-09-18T01:28:36.549893+0000","last_became_active":"2024-09-18T01:25:12.693127+0000","last_became_peered":"2024-09-18T01:25:12.693127+0000","last_unstale":"2024-09-18T01:28:36.549893+0000","last_undegraded":"2024-09-18T01:28:36.549893+0000","last_fullsized":"2024-09-18T01:28:36.549893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'90","last_scrub_stamp":"2024-09-18T01:28:36.549705+0000","last_deep_scrub":"35'90","last_deep_scrub_stamp":"2024-09-18T01:28:36.549705+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.549705+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:32.108255+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.622620+0000","last_change":"2024-09-18T01:28:28.622620+0000","last_active":"2024-09-18T01:28:28.622620+0000","last_peered":"2024-09-18T01:28:28.622620+0000","last_clean":"2024-09-18T01:28:28.622620+0000","last_became_active":"2024-09-18T01:25:14.703993+0000","last_became_peered":"2024-09-18T01:25:14.703993+0000","last_unstale":"2024-09-18T01:28:28.622620+0000","last_undegraded":"2024-09-18T01:28:28.622620+0000","last_fullsized":"2024-09-18T01:28:28.622620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:28.622514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:28.622514+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.622514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:15:53.831184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.439559+0000","last_change":"2024-09-18T01:28:55.439559+0000","last_active":"2024-09-18T01:28:55.439559+0000","last_peered":"2024-09-18T01:28:55.439559+0000","last_clean":"2024-09-18T01:28:55.439559+0000","last_became_active":"2024-09-18T01:25:16.703278+0000","last_became_peered":"2024-09-18T01:25:16.703278+0000","last_unstale":"2024-09-18T01:28:55.439559+0000","last_undegraded":"2024-09-18T01:28:55.439559+0000","last_fullsized":"2024-09-18T01:28:55.439559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-18T01:28:55.439368+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-18T01:28:55.439368+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.439368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:24.662471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.209968+0000","last_change":"2024-09-18T01:28:56.209968+0000","last_active":"2024-09-18T01:28:56.209968+0000","last_peered":"2024-09-18T01:28:56.209968+0000","last_clean":"2024-09-18T01:28:56.209968+0000","last_became_active":"2024-09-18T01:25:08.686087+0000","last_became_peered":"2024-09-18T01:25:08.686087+0000","last_unstale":"2024-09-18T01:28:56.209968+0000","last_undegraded":"2024-09-18T01:28:56.209968+0000","last_fullsized":"2024-09-18T01:28:56.209968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:56.209817+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:56.209817+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.209817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:57:02.811375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.466459+0000","last_change":"2024-09-18T01:29:15.466459+0000","last_active":"2024-09-18T01:29:15.466459+0000","last_peered":"2024-09-18T01:29:15.466459+0000","last_clean":"2024-09-18T01:29:15.466459+0000","last_became_active":"2024-09-18T01:25:06.680623+0000","last_became_peered":"2024-09-18T01:25:06.680623+0000","last_unstale":"2024-09-18T01:29:15.466459+0000","last_undegraded":"2024-09-18T01:29:15.466459+0000","last_fullsized":"2024-09-18T01:29:15.466459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:15.466302+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:15.466302+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.466302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:12:48.261541+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:39.019271+0000","last_change":"2024-09-18T01:29:39.019295+0000","last_active":"2024-09-18T01:29:39.019271+0000","last_peered":"2024-09-18T01:29:39.019271+0000","last_clean":"2024-09-18T01:29:39.019271+0000","last_became_active":"2024-09-18T01:24:56.191687+0000","last_became_peered":"2024-09-18T01:24:56.191687+0000","last_unstale":"2024-09-18T01:29:39.019271+0000","last_undegraded":"2024-09-18T01:29:39.019271+0000","last_fullsized":"2024-09-18T01:29:39.019271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:39.019144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:39.019144+0000","last_clean_scrub_stamp":"2024-09-18T01:29:39.019144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:17:01.457685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012745390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.087179+0000","last_change":"2024-09-18T01:28:37.087179+0000","last_active":"2024-09-18T01:28:37.087179+0000","last_peered":"2024-09-18T01:28:37.087179+0000","last_clean":"2024-09-18T01:28:37.087179+0000","last_became_active":"2024-09-18T01:25:10.681311+0000","last_became_peered":"2024-09-18T01:25:10.681311+0000","last_unstale":"2024-09-18T01:28:37.087179+0000","last_undegraded":"2024-09-18T01:28:37.087179+0000","last_fullsized":"2024-09-18T01:28:37.087179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:37.087060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:37.087060+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.087060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:59:56.318845+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'29","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.395402+0000","last_change":"2024-09-18T01:28:28.395402+0000","last_active":"2024-09-18T01:28:28.395402+0000","last_peered":"2024-09-18T01:28:28.395402+0000","last_clean":"2024-09-18T01:28:28.395402+0000","last_became_active":"2024-09-18T01:25:12.692357+0000","last_became_peered":"2024-09-18T01:25:12.692357+0000","last_unstale":"2024-09-18T01:28:28.395402+0000","last_undegraded":"2024-09-18T01:28:28.395402+0000","last_fullsized":"2024-09-18T01:28:28.395402+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'29","last_scrub_stamp":"2024-09-18T01:28:28.395277+0000","last_deep_scrub":"35'29","last_deep_scrub_stamp":"2024-09-18T01:28:28.395277+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.395277+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:50.311253+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":399,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:43.280257+0000","last_change":"2024-09-18T01:28:43.280257+0000","last_active":"2024-09-18T01:28:43.280257+0000","last_peered":"2024-09-18T01:28:43.280257+0000","last_clean":"2024-09-18T01:28:43.280257+0000","last_became_active":"2024-09-18T01:25:14.705703+0000","last_became_peered":"2024-09-18T01:25:14.705703+0000","last_unstale":"2024-09-18T01:28:43.280257+0000","last_undegraded":"2024-09-18T01:28:43.280257+0000","last_fullsized":"2024-09-18T01:28:43.280257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:43.280138+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:43.280138+0000","last_clean_scrub_stamp":"2024-09-18T01:28:43.280138+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:32.165248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:34.800057+0000","last_change":"2024-09-18T01:25:16.711811+0000","last_active":"2024-09-18T01:27:34.800057+0000","last_peered":"2024-09-18T01:27:34.800057+0000","last_clean":"2024-09-18T01:27:34.800057+0000","last_became_active":"2024-09-18T01:25:16.711531+0000","last_became_peered":"2024-09-18T01:25:16.711531+0000","last_unstale":"2024-09-18T01:27:34.800057+0000","last_undegraded":"2024-09-18T01:27:34.800057+0000","last_fullsized":"2024-09-18T01:27:34.800057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'20","reported_seq":90,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.122320+0000","last_change":"2024-09-18T01:29:04.122320+0000","last_active":"2024-09-18T01:29:04.122320+0000","last_peered":"2024-09-18T01:29:04.122320+0000","last_clean":"2024-09-18T01:29:04.122320+0000","last_became_active":"2024-09-18T01:25:08.681285+0000","last_became_peered":"2024-09-18T01:25:08.681285+0000","last_unstale":"2024-09-18T01:29:04.122320+0000","last_undegraded":"2024-09-18T01:29:04.122320+0000","last_fullsized":"2024-09-18T01:29:04.122320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:29:04.122206+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:29:04.122206+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.122206+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:24.652487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":56,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:35.974654+0000","last_change":"2024-09-18T01:29:35.974714+0000","last_active":"2024-09-18T01:29:35.974654+0000","last_peered":"2024-09-18T01:29:35.974654+0000","last_clean":"2024-09-18T01:29:35.974654+0000","last_became_active":"2024-09-18T01:25:06.683740+0000","last_became_peered":"2024-09-18T01:25:06.683740+0000","last_unstale":"2024-09-18T01:29:35.974654+0000","last_undegraded":"2024-09-18T01:29:35.974654+0000","last_fullsized":"2024-09-18T01:29:35.974654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:35.974537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:35.974537+0000","last_clean_scrub_stamp":"2024-09-18T01:29:35.974537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:25:23.044287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:14.448119+0000","last_change":"2024-09-18T01:29:14.448119+0000","last_active":"2024-09-18T01:29:14.448119+0000","last_peered":"2024-09-18T01:29:14.448119+0000","last_clean":"2024-09-18T01:29:14.448119+0000","last_became_active":"2024-09-18T01:24:56.192301+0000","last_became_peered":"2024-09-18T01:24:56.192301+0000","last_unstale":"2024-09-18T01:29:14.448119+0000","last_undegraded":"2024-09-18T01:29:14.448119+0000","last_fullsized":"2024-09-18T01:29:14.448119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:14.447964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:14.447964+0000","last_clean_scrub_stamp":"2024-09-18T01:29:14.447964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:38.190018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056449699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.070061+0000","last_change":"2024-09-18T01:28:30.070061+0000","last_active":"2024-09-18T01:28:30.070061+0000","last_peered":"2024-09-18T01:28:30.070061+0000","last_clean":"2024-09-18T01:28:30.070061+0000","last_became_active":"2024-09-18T01:25:10.682111+0000","last_became_peered":"2024-09-18T01:25:10.682111+0000","last_unstale":"2024-09-18T01:28:30.070061+0000","last_undegraded":"2024-09-18T01:28:30.070061+0000","last_fullsized":"2024-09-18T01:28:30.070061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:30.069896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:30.069896+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.069896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:14.982005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'23","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.044578+0000","last_change":"2024-09-18T01:28:41.044578+0000","last_active":"2024-09-18T01:28:41.044578+0000","last_peered":"2024-09-18T01:28:41.044578+0000","last_clean":"2024-09-18T01:28:41.044578+0000","last_became_active":"2024-09-18T01:25:12.692313+0000","last_became_peered":"2024-09-18T01:25:12.692313+0000","last_unstale":"2024-09-18T01:28:41.044578+0000","last_undegraded":"2024-09-18T01:28:41.044578+0000","last_fullsized":"2024-09-18T01:28:41.044578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-09-18T01:28:41.044429+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-09-18T01:28:41.044429+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.044429+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:56.982066+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":411,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.567260+0000","last_change":"2024-09-18T01:28:34.567260+0000","last_active":"2024-09-18T01:28:34.567260+0000","last_peered":"2024-09-18T01:28:34.567260+0000","last_clean":"2024-09-18T01:28:34.567260+0000","last_became_active":"2024-09-18T01:25:14.698755+0000","last_became_peered":"2024-09-18T01:25:14.698755+0000","last_unstale":"2024-09-18T01:28:34.567260+0000","last_undegraded":"2024-09-18T01:28:34.567260+0000","last_fullsized":"2024-09-18T01:28:34.567260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:34.567070+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:34.567070+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.567070+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:46:39.422894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'5","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:25.484216+0000","last_change":"2024-09-18T01:29:25.484242+0000","last_active":"2024-09-18T01:29:25.484216+0000","last_peered":"2024-09-18T01:29:25.484216+0000","last_clean":"2024-09-18T01:29:25.484216+0000","last_became_active":"2024-09-18T01:25:16.712556+0000","last_became_peered":"2024-09-18T01:25:16.712556+0000","last_unstale":"2024-09-18T01:29:25.484216+0000","last_undegraded":"2024-09-18T01:29:25.484216+0000","last_fullsized":"2024-09-18T01:29:25.484216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-18T01:29:25.484127+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-18T01:29:25.484127+0000","last_clean_scrub_stamp":"2024-09-18T01:29:25.484127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:23.933836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'14","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.895871+0000","last_change":"2024-09-18T01:29:01.895871+0000","last_active":"2024-09-18T01:29:01.895871+0000","last_peered":"2024-09-18T01:29:01.895871+0000","last_clean":"2024-09-18T01:29:01.895871+0000","last_became_active":"2024-09-18T01:25:08.674560+0000","last_became_peered":"2024-09-18T01:25:08.674560+0000","last_unstale":"2024-09-18T01:29:01.895871+0000","last_undegraded":"2024-09-18T01:29:01.895871+0000","last_fullsized":"2024-09-18T01:29:01.895871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-18T01:29:01.895707+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-18T01:29:01.895707+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.895707+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:56.827853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.309098+0000","last_change":"2024-09-18T01:29:04.309098+0000","last_active":"2024-09-18T01:29:04.309098+0000","last_peered":"2024-09-18T01:29:04.309098+0000","last_clean":"2024-09-18T01:29:04.309098+0000","last_became_active":"2024-09-18T01:25:06.686277+0000","last_became_peered":"2024-09-18T01:25:06.686277+0000","last_unstale":"2024-09-18T01:29:04.309098+0000","last_undegraded":"2024-09-18T01:29:04.309098+0000","last_fullsized":"2024-09-18T01:29:04.309098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:04.308925+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:04.308925+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.308925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:20.714722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:41.035447+0000","last_change":"2024-09-18T01:29:41.035472+0000","last_active":"2024-09-18T01:29:41.035447+0000","last_peered":"2024-09-18T01:29:41.035447+0000","last_clean":"2024-09-18T01:29:41.035447+0000","last_became_active":"2024-09-18T01:24:56.602991+0000","last_became_peered":"2024-09-18T01:24:56.602991+0000","last_unstale":"2024-09-18T01:29:41.035447+0000","last_undegraded":"2024-09-18T01:29:41.035447+0000","last_fullsized":"2024-09-18T01:29:41.035447+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:41.035351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:41.035351+0000","last_clean_scrub_stamp":"2024-09-18T01:29:41.035351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:39:37.234139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077351,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.105468+0000","last_change":"2024-09-18T01:28:28.105468+0000","last_active":"2024-09-18T01:28:28.105468+0000","last_peered":"2024-09-18T01:28:28.105468+0000","last_clean":"2024-09-18T01:28:28.105468+0000","last_became_active":"2024-09-18T01:25:10.682057+0000","last_became_peered":"2024-09-18T01:25:10.682057+0000","last_unstale":"2024-09-18T01:28:28.105468+0000","last_undegraded":"2024-09-18T01:28:28.105468+0000","last_fullsized":"2024-09-18T01:28:28.105468+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:28.105351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:28.105351+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.105351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:52:34.334975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'104","reported_seq":204,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.726873+0000","last_change":"2024-09-18T01:28:35.726873+0000","last_active":"2024-09-18T01:28:35.726873+0000","last_peered":"2024-09-18T01:28:35.726873+0000","last_clean":"2024-09-18T01:28:35.726873+0000","last_became_active":"2024-09-18T01:25:12.694361+0000","last_became_peered":"2024-09-18T01:25:12.694361+0000","last_unstale":"2024-09-18T01:28:35.726873+0000","last_undegraded":"2024-09-18T01:28:35.726873+0000","last_fullsized":"2024-09-18T01:28:35.726873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'104","last_scrub_stamp":"2024-09-18T01:28:35.726737+0000","last_deep_scrub":"35'104","last_deep_scrub_stamp":"2024-09-18T01:28:35.726737+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.726737+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:56.458829+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.552741+0000","last_change":"2024-09-18T01:28:39.552741+0000","last_active":"2024-09-18T01:28:39.552741+0000","last_peered":"2024-09-18T01:28:39.552741+0000","last_clean":"2024-09-18T01:28:39.552741+0000","last_became_active":"2024-09-18T01:25:14.706960+0000","last_became_peered":"2024-09-18T01:25:14.706960+0000","last_unstale":"2024-09-18T01:28:39.552741+0000","last_undegraded":"2024-09-18T01:28:39.552741+0000","last_fullsized":"2024-09-18T01:28:39.552741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:39.552625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:39.552625+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.552625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:28.437734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"33'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:16.932450+0000","last_change":"2024-09-18T01:29:16.932474+0000","last_active":"2024-09-18T01:29:16.932450+0000","last_peered":"2024-09-18T01:29:16.932450+0000","last_clean":"2024-09-18T01:29:16.932450+0000","last_became_active":"2024-09-18T01:25:16.716607+0000","last_became_peered":"2024-09-18T01:25:16.716607+0000","last_unstale":"2024-09-18T01:29:16.932450+0000","last_undegraded":"2024-09-18T01:29:16.932450+0000","last_fullsized":"2024-09-18T01:29:16.932450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:16.932352+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:16.932352+0000","last_clean_scrub_stamp":"2024-09-18T01:29:16.932352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:57.817343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:17.899188+0000","last_change":"2024-09-18T01:29:17.899188+0000","last_active":"2024-09-18T01:29:17.899188+0000","last_peered":"2024-09-18T01:29:17.899188+0000","last_clean":"2024-09-18T01:29:17.899188+0000","last_became_active":"2024-09-18T01:25:16.716867+0000","last_became_peered":"2024-09-18T01:25:16.716867+0000","last_unstale":"2024-09-18T01:29:17.899188+0000","last_undegraded":"2024-09-18T01:29:17.899188+0000","last_fullsized":"2024-09-18T01:29:17.899188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:17.899080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:17.899080+0000","last_clean_scrub_stamp":"2024-09-18T01:29:17.899080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:44.321407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:05.764214+0000","last_change":"2024-09-18T01:29:05.764239+0000","last_active":"2024-09-18T01:29:05.764214+0000","last_peered":"2024-09-18T01:29:05.764214+0000","last_clean":"2024-09-18T01:29:05.764214+0000","last_became_active":"2024-09-18T01:25:08.675590+0000","last_became_peered":"2024-09-18T01:25:08.675590+0000","last_unstale":"2024-09-18T01:29:05.764214+0000","last_undegraded":"2024-09-18T01:29:05.764214+0000","last_fullsized":"2024-09-18T01:29:05.764214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:05.764128+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:05.764128+0000","last_clean_scrub_stamp":"2024-09-18T01:29:05.764128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:09.224112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:30.982036+0000","last_change":"2024-09-18T01:29:30.982063+0000","last_active":"2024-09-18T01:29:30.982036+0000","last_peered":"2024-09-18T01:29:30.982036+0000","last_clean":"2024-09-18T01:29:30.982036+0000","last_became_active":"2024-09-18T01:25:06.689996+0000","last_became_peered":"2024-09-18T01:25:06.689996+0000","last_unstale":"2024-09-18T01:29:30.982036+0000","last_undegraded":"2024-09-18T01:29:30.982036+0000","last_fullsized":"2024-09-18T01:29:30.982036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:30.981931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:30.981931+0000","last_clean_scrub_stamp":"2024-09-18T01:29:30.981931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:37:57.728593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.304703+0000","last_change":"2024-09-18T01:28:38.304730+0000","last_active":"2024-09-18T01:28:38.304703+0000","last_peered":"2024-09-18T01:28:38.304703+0000","last_clean":"2024-09-18T01:28:38.304703+0000","last_became_active":"2024-09-18T01:25:10.679704+0000","last_became_peered":"2024-09-18T01:25:10.679704+0000","last_unstale":"2024-09-18T01:28:38.304703+0000","last_undegraded":"2024-09-18T01:28:38.304703+0000","last_fullsized":"2024-09-18T01:28:38.304703+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:38.304607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:38.304607+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.304607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:00.590243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'47","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.045384+0000","last_change":"2024-09-18T01:28:56.045435+0000","last_active":"2024-09-18T01:28:56.045384+0000","last_peered":"2024-09-18T01:28:56.045384+0000","last_clean":"2024-09-18T01:28:56.045384+0000","last_became_active":"2024-09-18T01:25:12.692870+0000","last_became_peered":"2024-09-18T01:25:12.692870+0000","last_unstale":"2024-09-18T01:28:56.045384+0000","last_undegraded":"2024-09-18T01:28:56.045384+0000","last_fullsized":"2024-09-18T01:28:56.045384+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-09-18T01:28:56.045290+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-09-18T01:28:56.045290+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.045290+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:42:03.283767+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.058508+0000","last_change":"2024-09-18T01:28:49.058531+0000","last_active":"2024-09-18T01:28:49.058508+0000","last_peered":"2024-09-18T01:28:49.058508+0000","last_clean":"2024-09-18T01:28:49.058508+0000","last_became_active":"2024-09-18T01:25:14.706381+0000","last_became_peered":"2024-09-18T01:25:14.706381+0000","last_unstale":"2024-09-18T01:28:49.058508+0000","last_undegraded":"2024-09-18T01:28:49.058508+0000","last_fullsized":"2024-09-18T01:28:49.058508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:49.058417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:49.058417+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.058417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:09.897723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'17","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.472284+0000","last_change":"2024-09-18T01:28:51.472284+0000","last_active":"2024-09-18T01:28:51.472284+0000","last_peered":"2024-09-18T01:28:51.472284+0000","last_clean":"2024-09-18T01:28:51.472284+0000","last_became_active":"2024-09-18T01:25:16.703227+0000","last_became_peered":"2024-09-18T01:25:16.703227+0000","last_unstale":"2024-09-18T01:28:51.472284+0000","last_undegraded":"2024-09-18T01:28:51.472284+0000","last_fullsized":"2024-09-18T01:28:51.472284+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-18T01:28:51.472131+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-18T01:28:51.472131+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.472131+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:46:57.519168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.271075+0000","last_change":"2024-09-18T01:28:48.271102+0000","last_active":"2024-09-18T01:28:48.271075+0000","last_peered":"2024-09-18T01:28:48.271075+0000","last_clean":"2024-09-18T01:28:48.271075+0000","last_became_active":"2024-09-18T01:25:08.687482+0000","last_became_peered":"2024-09-18T01:25:08.687482+0000","last_unstale":"2024-09-18T01:28:48.271075+0000","last_undegraded":"2024-09-18T01:28:48.271075+0000","last_fullsized":"2024-09-18T01:28:48.271075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:28:48.270983+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:28:48.270983+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.270983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:51.899321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.803452+0000","last_change":"2024-09-18T01:28:54.803480+0000","last_active":"2024-09-18T01:28:54.803452+0000","last_peered":"2024-09-18T01:28:54.803452+0000","last_clean":"2024-09-18T01:28:54.803452+0000","last_became_active":"2024-09-18T01:25:06.705406+0000","last_became_peered":"2024-09-18T01:25:06.705406+0000","last_unstale":"2024-09-18T01:28:54.803452+0000","last_undegraded":"2024-09-18T01:28:54.803452+0000","last_fullsized":"2024-09-18T01:28:54.803452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:54.803363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:54.803363+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.803363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:05:32.221186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.114679+0000","last_change":"2024-09-18T01:28:29.114710+0000","last_active":"2024-09-18T01:28:29.114679+0000","last_peered":"2024-09-18T01:28:29.114679+0000","last_clean":"2024-09-18T01:28:29.114679+0000","last_became_active":"2024-09-18T01:25:10.682230+0000","last_became_peered":"2024-09-18T01:25:10.682230+0000","last_unstale":"2024-09-18T01:28:29.114679+0000","last_undegraded":"2024-09-18T01:28:29.114679+0000","last_fullsized":"2024-09-18T01:28:29.114679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.114588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.114588+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.114588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:42:02.700134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.620008+0000","last_change":"2024-09-18T01:28:41.620043+0000","last_active":"2024-09-18T01:28:41.620008+0000","last_peered":"2024-09-18T01:28:41.620008+0000","last_clean":"2024-09-18T01:28:41.620008+0000","last_became_active":"2024-09-18T01:25:12.687018+0000","last_became_peered":"2024-09-18T01:25:12.687018+0000","last_unstale":"2024-09-18T01:28:41.620008+0000","last_undegraded":"2024-09-18T01:28:41.620008+0000","last_fullsized":"2024-09-18T01:28:41.620008+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:41.619916+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:41.619916+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.619916+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:43.740728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.669948+0000","last_change":"2024-09-18T01:28:29.669975+0000","last_active":"2024-09-18T01:28:29.669948+0000","last_peered":"2024-09-18T01:28:29.669948+0000","last_clean":"2024-09-18T01:28:29.669948+0000","last_became_active":"2024-09-18T01:25:14.707008+0000","last_became_peered":"2024-09-18T01:25:14.707008+0000","last_unstale":"2024-09-18T01:28:29.669948+0000","last_undegraded":"2024-09-18T01:28:29.669948+0000","last_fullsized":"2024-09-18T01:28:29.669948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.669852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.669852+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.669852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:18.373919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:26.482777+0000","last_change":"2024-09-18T01:29:26.482829+0000","last_active":"2024-09-18T01:29:26.482777+0000","last_peered":"2024-09-18T01:29:26.482777+0000","last_clean":"2024-09-18T01:29:26.482777+0000","last_became_active":"2024-09-18T01:25:16.714160+0000","last_became_peered":"2024-09-18T01:25:16.714160+0000","last_unstale":"2024-09-18T01:29:26.482777+0000","last_undegraded":"2024-09-18T01:29:26.482777+0000","last_fullsized":"2024-09-18T01:29:26.482777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:26.482657+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:26.482657+0000","last_clean_scrub_stamp":"2024-09-18T01:29:26.482657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:06:53.262007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.422822+0000","last_change":"2024-09-18T01:29:01.422822+0000","last_active":"2024-09-18T01:29:01.422822+0000","last_peered":"2024-09-18T01:29:01.422822+0000","last_clean":"2024-09-18T01:29:01.422822+0000","last_became_active":"2024-09-18T01:25:08.671365+0000","last_became_peered":"2024-09-18T01:25:08.671365+0000","last_unstale":"2024-09-18T01:29:01.422822+0000","last_undegraded":"2024-09-18T01:29:01.422822+0000","last_fullsized":"2024-09-18T01:29:01.422822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:01.422709+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:01.422709+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.422709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:17.828506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.855381+0000","last_change":"2024-09-18T01:29:02.855411+0000","last_active":"2024-09-18T01:29:02.855381+0000","last_peered":"2024-09-18T01:29:02.855381+0000","last_clean":"2024-09-18T01:29:02.855381+0000","last_became_active":"2024-09-18T01:25:06.703081+0000","last_became_peered":"2024-09-18T01:25:06.703081+0000","last_unstale":"2024-09-18T01:29:02.855381+0000","last_undegraded":"2024-09-18T01:29:02.855381+0000","last_fullsized":"2024-09-18T01:29:02.855381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:02.855275+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:02.855275+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.855275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:21.389785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.718726+0000","last_change":"2024-09-18T01:28:44.718746+0000","last_active":"2024-09-18T01:28:44.718726+0000","last_peered":"2024-09-18T01:28:44.718726+0000","last_clean":"2024-09-18T01:28:44.718726+0000","last_became_active":"2024-09-18T01:25:10.680316+0000","last_became_peered":"2024-09-18T01:25:10.680316+0000","last_unstale":"2024-09-18T01:28:44.718726+0000","last_undegraded":"2024-09-18T01:28:44.718726+0000","last_fullsized":"2024-09-18T01:28:44.718726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:44.718622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:44.718622+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.718622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:03.968563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'47","reported_seq":119,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.607584+0000","last_change":"2024-09-18T01:28:42.607643+0000","last_active":"2024-09-18T01:28:42.607584+0000","last_peered":"2024-09-18T01:28:42.607584+0000","last_clean":"2024-09-18T01:28:42.607584+0000","last_became_active":"2024-09-18T01:25:12.682270+0000","last_became_peered":"2024-09-18T01:25:12.682270+0000","last_unstale":"2024-09-18T01:28:42.607584+0000","last_undegraded":"2024-09-18T01:28:42.607584+0000","last_fullsized":"2024-09-18T01:28:42.607584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-09-18T01:28:42.607487+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-09-18T01:28:42.607487+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.607487+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:54.508090+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.271313+0000","last_change":"2024-09-18T01:28:39.271337+0000","last_active":"2024-09-18T01:28:39.271313+0000","last_peered":"2024-09-18T01:28:39.271313+0000","last_clean":"2024-09-18T01:28:39.271313+0000","last_became_active":"2024-09-18T01:25:14.703583+0000","last_became_peered":"2024-09-18T01:25:14.703583+0000","last_unstale":"2024-09-18T01:28:39.271313+0000","last_undegraded":"2024-09-18T01:28:39.271313+0000","last_fullsized":"2024-09-18T01:28:39.271313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:39.271224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:39.271224+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.271224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:54.971763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:49.802344+0000","last_change":"2024-09-18T01:25:16.714459+0000","last_active":"2024-09-18T01:27:49.802344+0000","last_peered":"2024-09-18T01:27:49.802344+0000","last_clean":"2024-09-18T01:27:49.802344+0000","last_became_active":"2024-09-18T01:25:16.714061+0000","last_became_peered":"2024-09-18T01:25:16.714061+0000","last_unstale":"2024-09-18T01:27:49.802344+0000","last_undegraded":"2024-09-18T01:27:49.802344+0000","last_fullsized":"2024-09-18T01:27:49.802344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.003975+0000","last_change":"2024-09-18T01:28:46.004012+0000","last_active":"2024-09-18T01:28:46.003975+0000","last_peered":"2024-09-18T01:28:46.003975+0000","last_clean":"2024-09-18T01:28:46.003975+0000","last_became_active":"2024-09-18T01:25:08.688016+0000","last_became_peered":"2024-09-18T01:25:08.688016+0000","last_unstale":"2024-09-18T01:28:46.003975+0000","last_undegraded":"2024-09-18T01:28:46.003975+0000","last_fullsized":"2024-09-18T01:28:46.003975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:46.003879+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:46.003879+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.003879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:50.020572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:10.337492+0000","last_change":"2024-09-18T01:29:10.337537+0000","last_active":"2024-09-18T01:29:10.337492+0000","last_peered":"2024-09-18T01:29:10.337492+0000","last_clean":"2024-09-18T01:29:10.337492+0000","last_became_active":"2024-09-18T01:25:06.688747+0000","last_became_peered":"2024-09-18T01:25:06.688747+0000","last_unstale":"2024-09-18T01:29:10.337492+0000","last_undegraded":"2024-09-18T01:29:10.337492+0000","last_fullsized":"2024-09-18T01:29:10.337492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:10.337368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:10.337368+0000","last_clean_scrub_stamp":"2024-09-18T01:29:10.337368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:51.222358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.109559+0000","last_change":"2024-09-18T01:28:38.109581+0000","last_active":"2024-09-18T01:28:38.109559+0000","last_peered":"2024-09-18T01:28:38.109559+0000","last_clean":"2024-09-18T01:28:38.109559+0000","last_became_active":"2024-09-18T01:25:10.680831+0000","last_became_peered":"2024-09-18T01:25:10.680831+0000","last_unstale":"2024-09-18T01:28:38.109559+0000","last_undegraded":"2024-09-18T01:28:38.109559+0000","last_fullsized":"2024-09-18T01:28:38.109559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:38.109472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:38.109472+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.109472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:44.941883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.715067+0000","last_change":"2024-09-18T01:28:42.715108+0000","last_active":"2024-09-18T01:28:42.715067+0000","last_peered":"2024-09-18T01:28:42.715067+0000","last_clean":"2024-09-18T01:28:42.715067+0000","last_became_active":"2024-09-18T01:25:12.686918+0000","last_became_peered":"2024-09-18T01:25:12.686918+0000","last_unstale":"2024-09-18T01:28:42.715067+0000","last_undegraded":"2024-09-18T01:28:42.715067+0000","last_fullsized":"2024-09-18T01:28:42.715067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-18T01:28:42.714970+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-18T01:28:42.714970+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.714970+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:01:05.208541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.654223+0000","last_change":"2024-09-18T01:28:32.654249+0000","last_active":"2024-09-18T01:28:32.654223+0000","last_peered":"2024-09-18T01:28:32.654223+0000","last_clean":"2024-09-18T01:28:32.654223+0000","last_became_active":"2024-09-18T01:25:14.695120+0000","last_became_peered":"2024-09-18T01:25:14.695120+0000","last_unstale":"2024-09-18T01:28:32.654223+0000","last_undegraded":"2024-09-18T01:28:32.654223+0000","last_fullsized":"2024-09-18T01:28:32.654223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:32.654135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:32.654135+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.654135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:02:10.947460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:08.068938+0000","last_change":"2024-09-18T01:29:08.068938+0000","last_active":"2024-09-18T01:29:08.068938+0000","last_peered":"2024-09-18T01:29:08.068938+0000","last_clean":"2024-09-18T01:29:08.068938+0000","last_became_active":"2024-09-18T01:25:08.677941+0000","last_became_peered":"2024-09-18T01:25:08.677941+0000","last_unstale":"2024-09-18T01:29:08.068938+0000","last_undegraded":"2024-09-18T01:29:08.068938+0000","last_fullsized":"2024-09-18T01:29:08.068938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:08.068815+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:08.068815+0000","last_clean_scrub_stamp":"2024-09-18T01:29:08.068815+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:33:09.305362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:20.091205+0000","last_change":"2024-09-18T01:29:20.091256+0000","last_active":"2024-09-18T01:29:20.091205+0000","last_peered":"2024-09-18T01:29:20.091205+0000","last_clean":"2024-09-18T01:29:20.091205+0000","last_became_active":"2024-09-18T01:25:06.692823+0000","last_became_peered":"2024-09-18T01:25:06.692823+0000","last_unstale":"2024-09-18T01:29:20.091205+0000","last_undegraded":"2024-09-18T01:29:20.091205+0000","last_fullsized":"2024-09-18T01:29:20.091205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:20.091088+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:20.091088+0000","last_clean_scrub_stamp":"2024-09-18T01:29:20.091088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:25.879095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.590054+0000","last_change":"2024-09-18T01:28:46.590054+0000","last_active":"2024-09-18T01:28:46.590054+0000","last_peered":"2024-09-18T01:28:46.590054+0000","last_clean":"2024-09-18T01:28:46.590054+0000","last_became_active":"2024-09-18T01:25:10.677481+0000","last_became_peered":"2024-09-18T01:25:10.677481+0000","last_unstale":"2024-09-18T01:28:46.590054+0000","last_undegraded":"2024-09-18T01:28:46.590054+0000","last_fullsized":"2024-09-18T01:28:46.590054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:46.589926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:46.589926+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.589926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:21:01.356370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'71","reported_seq":150,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.576795+0000","last_change":"2024-09-18T01:28:40.576840+0000","last_active":"2024-09-18T01:28:40.576795+0000","last_peered":"2024-09-18T01:28:40.576795+0000","last_clean":"2024-09-18T01:28:40.576795+0000","last_became_active":"2024-09-18T01:25:12.687014+0000","last_became_peered":"2024-09-18T01:25:12.687014+0000","last_unstale":"2024-09-18T01:28:40.576795+0000","last_undegraded":"2024-09-18T01:28:40.576795+0000","last_fullsized":"2024-09-18T01:28:40.576795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'71","last_scrub_stamp":"2024-09-18T01:28:40.576711+0000","last_deep_scrub":"35'71","last_deep_scrub_stamp":"2024-09-18T01:28:40.576711+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.576711+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:02:19.666203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.637762+0000","last_change":"2024-09-18T01:28:31.637788+0000","last_active":"2024-09-18T01:28:31.637762+0000","last_peered":"2024-09-18T01:28:31.637762+0000","last_clean":"2024-09-18T01:28:31.637762+0000","last_became_active":"2024-09-18T01:25:14.698753+0000","last_became_peered":"2024-09-18T01:25:14.698753+0000","last_unstale":"2024-09-18T01:28:31.637762+0000","last_undegraded":"2024-09-18T01:28:31.637762+0000","last_fullsized":"2024-09-18T01:28:31.637762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.637674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.637674+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.637674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:05:28.601978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'20","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:25.471860+0000","last_change":"2024-09-18T01:29:25.471884+0000","last_active":"2024-09-18T01:29:25.471860+0000","last_peered":"2024-09-18T01:29:25.471860+0000","last_clean":"2024-09-18T01:29:25.471860+0000","last_became_active":"2024-09-18T01:25:16.713750+0000","last_became_peered":"2024-09-18T01:25:16.713750+0000","last_unstale":"2024-09-18T01:29:25.471860+0000","last_undegraded":"2024-09-18T01:29:25.471860+0000","last_fullsized":"2024-09-18T01:29:25.471860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:29:25.471720+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:29:25.471720+0000","last_clean_scrub_stamp":"2024-09-18T01:29:25.471720+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:52.495077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:21.531580+0000","last_change":"2024-09-18T01:29:21.531608+0000","last_active":"2024-09-18T01:29:21.531580+0000","last_peered":"2024-09-18T01:29:21.531580+0000","last_clean":"2024-09-18T01:29:21.531580+0000","last_became_active":"2024-09-18T01:25:08.680604+0000","last_became_peered":"2024-09-18T01:25:08.680604+0000","last_unstale":"2024-09-18T01:29:21.531580+0000","last_undegraded":"2024-09-18T01:29:21.531580+0000","last_fullsized":"2024-09-18T01:29:21.531580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:21.531492+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:21.531492+0000","last_clean_scrub_stamp":"2024-09-18T01:29:21.531492+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:47.902528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:20.338164+0000","last_change":"2024-09-18T01:29:20.338195+0000","last_active":"2024-09-18T01:29:20.338164+0000","last_peered":"2024-09-18T01:29:20.338164+0000","last_clean":"2024-09-18T01:29:20.338164+0000","last_became_active":"2024-09-18T01:25:06.686125+0000","last_became_peered":"2024-09-18T01:25:06.686125+0000","last_unstale":"2024-09-18T01:29:20.338164+0000","last_undegraded":"2024-09-18T01:29:20.338164+0000","last_fullsized":"2024-09-18T01:29:20.338164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:20.338067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:20.338067+0000","last_clean_scrub_stamp":"2024-09-18T01:29:20.338067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:00:59.574989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"35'5","reported_seq":248,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.771802+0000","last_change":"2024-09-18T01:29:22.771832+0000","last_active":"2024-09-18T01:29:22.771802+0000","last_peered":"2024-09-18T01:29:22.771802+0000","last_clean":"2024-09-18T01:29:22.771802+0000","last_became_active":"2024-09-18T01:25:43.908273+0000","last_became_peered":"2024-09-18T01:25:43.908273+0000","last_unstale":"2024-09-18T01:29:22.771802+0000","last_undegraded":"2024-09-18T01:29:22.771802+0000","last_fullsized":"2024-09-18T01:29:22.771802+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-18T01:29:22.771713+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-18T01:29:22.771713+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.771713+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:26.492018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.076283+0000","last_change":"2024-09-18T01:29:00.076347+0000","last_active":"2024-09-18T01:29:00.076283+0000","last_peered":"2024-09-18T01:29:00.076283+0000","last_clean":"2024-09-18T01:29:00.076283+0000","last_became_active":"2024-09-18T01:25:12.692486+0000","last_became_peered":"2024-09-18T01:25:12.692486+0000","last_unstale":"2024-09-18T01:29:00.076283+0000","last_undegraded":"2024-09-18T01:29:00.076283+0000","last_fullsized":"2024-09-18T01:29:00.076283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:29:00.076171+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:29:00.076171+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.076171+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:57:19.965536+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.203333+0000","last_change":"2024-09-18T01:28:51.203356+0000","last_active":"2024-09-18T01:28:51.203333+0000","last_peered":"2024-09-18T01:28:51.203333+0000","last_clean":"2024-09-18T01:28:51.203333+0000","last_became_active":"2024-09-18T01:25:14.709980+0000","last_became_peered":"2024-09-18T01:25:14.709980+0000","last_unstale":"2024-09-18T01:28:51.203333+0000","last_undegraded":"2024-09-18T01:28:51.203333+0000","last_fullsized":"2024-09-18T01:28:51.203333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:51.203243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:51.203243+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.203243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:37:51.114618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:19.057956+0000","last_change":"2024-09-18T01:29:19.057982+0000","last_active":"2024-09-18T01:29:19.057956+0000","last_peered":"2024-09-18T01:29:19.057956+0000","last_clean":"2024-09-18T01:29:19.057956+0000","last_became_active":"2024-09-18T01:25:16.708905+0000","last_became_peered":"2024-09-18T01:25:16.708905+0000","last_unstale":"2024-09-18T01:29:19.057956+0000","last_undegraded":"2024-09-18T01:29:19.057956+0000","last_fullsized":"2024-09-18T01:29:19.057956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:19.057861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:19.057861+0000","last_clean_scrub_stamp":"2024-09-18T01:29:19.057861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:45.617512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'6","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.081418+0000","last_change":"2024-09-18T01:28:40.081446+0000","last_active":"2024-09-18T01:28:40.081418+0000","last_peered":"2024-09-18T01:28:40.081418+0000","last_clean":"2024-09-18T01:28:40.081418+0000","last_became_active":"2024-09-18T01:25:08.688610+0000","last_became_peered":"2024-09-18T01:25:08.688610+0000","last_unstale":"2024-09-18T01:28:40.081418+0000","last_undegraded":"2024-09-18T01:28:40.081418+0000","last_fullsized":"2024-09-18T01:28:40.081418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:40.081320+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:40.081320+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.081320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:49.789353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.319196+0000","last_change":"2024-09-18T01:29:15.319222+0000","last_active":"2024-09-18T01:29:15.319196+0000","last_peered":"2024-09-18T01:29:15.319196+0000","last_clean":"2024-09-18T01:29:15.319196+0000","last_became_active":"2024-09-18T01:25:06.685167+0000","last_became_peered":"2024-09-18T01:25:06.685167+0000","last_unstale":"2024-09-18T01:29:15.319196+0000","last_undegraded":"2024-09-18T01:29:15.319196+0000","last_fullsized":"2024-09-18T01:29:15.319196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:15.319106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:15.319106+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.319106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:05:39.685673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.752136+0000","last_change":"2024-09-18T01:28:46.752160+0000","last_active":"2024-09-18T01:28:46.752136+0000","last_peered":"2024-09-18T01:28:46.752136+0000","last_clean":"2024-09-18T01:28:46.752136+0000","last_became_active":"2024-09-18T01:25:10.678586+0000","last_became_peered":"2024-09-18T01:25:10.678586+0000","last_unstale":"2024-09-18T01:28:46.752136+0000","last_undegraded":"2024-09-18T01:28:46.752136+0000","last_fullsized":"2024-09-18T01:28:46.752136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:46.752053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:46.752053+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.752053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:18:54.078274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'46","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.589617+0000","last_change":"2024-09-18T01:28:38.589617+0000","last_active":"2024-09-18T01:28:38.589617+0000","last_peered":"2024-09-18T01:28:38.589617+0000","last_clean":"2024-09-18T01:28:38.589617+0000","last_became_active":"2024-09-18T01:25:12.687935+0000","last_became_peered":"2024-09-18T01:25:12.687935+0000","last_unstale":"2024-09-18T01:28:38.589617+0000","last_undegraded":"2024-09-18T01:28:38.589617+0000","last_fullsized":"2024-09-18T01:28:38.589617+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:38.589489+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:38.589489+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.589489+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:04:54.499330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.683121+0000","last_change":"2024-09-18T01:28:30.683121+0000","last_active":"2024-09-18T01:28:30.683121+0000","last_peered":"2024-09-18T01:28:30.683121+0000","last_clean":"2024-09-18T01:28:30.683121+0000","last_became_active":"2024-09-18T01:25:14.701702+0000","last_became_peered":"2024-09-18T01:25:14.701702+0000","last_unstale":"2024-09-18T01:28:30.683121+0000","last_undegraded":"2024-09-18T01:28:30.683121+0000","last_fullsized":"2024-09-18T01:28:30.683121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:30.682992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:30.682992+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.682992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:55.879755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800702+0000","last_change":"2024-09-18T01:25:16.716015+0000","last_active":"2024-09-18T01:27:39.800702+0000","last_peered":"2024-09-18T01:27:39.800702+0000","last_clean":"2024-09-18T01:27:39.800702+0000","last_became_active":"2024-09-18T01:25:16.715669+0000","last_became_peered":"2024-09-18T01:25:16.715669+0000","last_unstale":"2024-09-18T01:27:39.800702+0000","last_undegraded":"2024-09-18T01:27:39.800702+0000","last_fullsized":"2024-09-18T01:27:39.800702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"35'16","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.428199+0000","last_change":"2024-09-18T01:29:03.428235+0000","last_active":"2024-09-18T01:29:03.428199+0000","last_peered":"2024-09-18T01:29:03.428199+0000","last_clean":"2024-09-18T01:29:03.428199+0000","last_became_active":"2024-09-18T01:25:08.672541+0000","last_became_peered":"2024-09-18T01:25:08.672541+0000","last_unstale":"2024-09-18T01:29:03.428199+0000","last_undegraded":"2024-09-18T01:29:03.428199+0000","last_fullsized":"2024-09-18T01:29:03.428199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-18T01:29:03.428109+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-18T01:29:03.428109+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.428109+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:25:08.371120+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:25.982509+0000","last_change":"2024-09-18T01:29:25.982533+0000","last_active":"2024-09-18T01:29:25.982509+0000","last_peered":"2024-09-18T01:29:25.982509+0000","last_clean":"2024-09-18T01:29:25.982509+0000","last_became_active":"2024-09-18T01:25:06.684658+0000","last_became_peered":"2024-09-18T01:25:06.684658+0000","last_unstale":"2024-09-18T01:29:25.982509+0000","last_undegraded":"2024-09-18T01:29:25.982509+0000","last_fullsized":"2024-09-18T01:29:25.982509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:25.982424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:25.982424+0000","last_clean_scrub_stamp":"2024-09-18T01:29:25.982424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:22:34.882345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.324781+0000","last_change":"2024-09-18T01:28:44.324803+0000","last_active":"2024-09-18T01:28:44.324781+0000","last_peered":"2024-09-18T01:28:44.324781+0000","last_clean":"2024-09-18T01:28:44.324781+0000","last_became_active":"2024-09-18T01:25:10.679369+0000","last_became_peered":"2024-09-18T01:25:10.679369+0000","last_unstale":"2024-09-18T01:28:44.324781+0000","last_undegraded":"2024-09-18T01:28:44.324781+0000","last_fullsized":"2024-09-18T01:28:44.324781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:44.324660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:44.324660+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.324660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:21.528723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'22","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.075434+0000","last_change":"2024-09-18T01:28:52.075434+0000","last_active":"2024-09-18T01:28:52.075434+0000","last_peered":"2024-09-18T01:28:52.075434+0000","last_clean":"2024-09-18T01:28:52.075434+0000","last_became_active":"2024-09-18T01:25:12.696757+0000","last_became_peered":"2024-09-18T01:25:12.696757+0000","last_unstale":"2024-09-18T01:28:52.075434+0000","last_undegraded":"2024-09-18T01:28:52.075434+0000","last_fullsized":"2024-09-18T01:28:52.075434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-18T01:28:52.075306+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-18T01:28:52.075306+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.075306+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:59:02.612796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":385,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.663311+0000","last_change":"2024-09-18T01:28:33.663311+0000","last_active":"2024-09-18T01:28:33.663311+0000","last_peered":"2024-09-18T01:28:33.663311+0000","last_clean":"2024-09-18T01:28:33.663311+0000","last_became_active":"2024-09-18T01:25:14.708840+0000","last_became_peered":"2024-09-18T01:25:14.708840+0000","last_unstale":"2024-09-18T01:28:33.663311+0000","last_undegraded":"2024-09-18T01:28:33.663311+0000","last_fullsized":"2024-09-18T01:28:33.663311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:33.663217+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:33.663217+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.663217+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:17:45.430908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:11.070033+0000","last_change":"2024-09-18T01:29:11.070057+0000","last_active":"2024-09-18T01:29:11.070033+0000","last_peered":"2024-09-18T01:29:11.070033+0000","last_clean":"2024-09-18T01:29:11.070033+0000","last_became_active":"2024-09-18T01:25:16.706764+0000","last_became_peered":"2024-09-18T01:25:16.706764+0000","last_unstale":"2024-09-18T01:29:11.070033+0000","last_undegraded":"2024-09-18T01:29:11.070033+0000","last_fullsized":"2024-09-18T01:29:11.070033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:11.069944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:11.069944+0000","last_clean_scrub_stamp":"2024-09-18T01:29:11.069944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:55:33.719107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.788422+0000","last_change":"2024-09-18T01:28:51.788470+0000","last_active":"2024-09-18T01:28:51.788422+0000","last_peered":"2024-09-18T01:28:51.788422+0000","last_clean":"2024-09-18T01:28:51.788422+0000","last_became_active":"2024-09-18T01:25:08.669920+0000","last_became_peered":"2024-09-18T01:25:08.669920+0000","last_unstale":"2024-09-18T01:28:51.788422+0000","last_undegraded":"2024-09-18T01:28:51.788422+0000","last_fullsized":"2024-09-18T01:28:51.788422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:51.788294+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:51.788294+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.788294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:52:03.688898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:14.311265+0000","last_change":"2024-09-18T01:29:14.311308+0000","last_active":"2024-09-18T01:29:14.311265+0000","last_peered":"2024-09-18T01:29:14.311265+0000","last_clean":"2024-09-18T01:29:14.311265+0000","last_became_active":"2024-09-18T01:25:06.684984+0000","last_became_peered":"2024-09-18T01:25:06.684984+0000","last_unstale":"2024-09-18T01:29:14.311265+0000","last_undegraded":"2024-09-18T01:29:14.311265+0000","last_fullsized":"2024-09-18T01:29:14.311265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:14.311116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:14.311116+0000","last_clean_scrub_stamp":"2024-09-18T01:29:14.311116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:51.281729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.258238+0000","last_change":"2024-09-18T01:28:42.258260+0000","last_active":"2024-09-18T01:28:42.258238+0000","last_peered":"2024-09-18T01:28:42.258238+0000","last_clean":"2024-09-18T01:28:42.258238+0000","last_became_active":"2024-09-18T01:25:10.679468+0000","last_became_peered":"2024-09-18T01:25:10.679468+0000","last_unstale":"2024-09-18T01:28:42.258238+0000","last_undegraded":"2024-09-18T01:28:42.258238+0000","last_fullsized":"2024-09-18T01:28:42.258238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:42.258155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:42.258155+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.258155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:43:55.164530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'73","reported_seq":155,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.399904+0000","last_change":"2024-09-18T01:28:29.399990+0000","last_active":"2024-09-18T01:28:29.399904+0000","last_peered":"2024-09-18T01:28:29.399904+0000","last_clean":"2024-09-18T01:28:29.399904+0000","last_became_active":"2024-09-18T01:25:12.688618+0000","last_became_peered":"2024-09-18T01:25:12.688618+0000","last_unstale":"2024-09-18T01:28:29.399904+0000","last_undegraded":"2024-09-18T01:28:29.399904+0000","last_fullsized":"2024-09-18T01:28:29.399904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'73","last_scrub_stamp":"2024-09-18T01:28:29.399801+0000","last_deep_scrub":"35'73","last_deep_scrub_stamp":"2024-09-18T01:28:29.399801+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.399801+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:16:18.035775+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:43.592312+0000","last_change":"2024-09-18T01:28:43.592338+0000","last_active":"2024-09-18T01:28:43.592312+0000","last_peered":"2024-09-18T01:28:43.592312+0000","last_clean":"2024-09-18T01:28:43.592312+0000","last_became_active":"2024-09-18T01:25:14.706586+0000","last_became_peered":"2024-09-18T01:25:14.706586+0000","last_unstale":"2024-09-18T01:28:43.592312+0000","last_undegraded":"2024-09-18T01:28:43.592312+0000","last_fullsized":"2024-09-18T01:28:43.592312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:43.592225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:43.592225+0000","last_clean_scrub_stamp":"2024-09-18T01:28:43.592225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:47:15.204874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:27.470607+0000","last_change":"2024-09-18T01:29:27.470664+0000","last_active":"2024-09-18T01:29:27.470607+0000","last_peered":"2024-09-18T01:29:27.470607+0000","last_clean":"2024-09-18T01:29:27.470607+0000","last_became_active":"2024-09-18T01:25:16.713789+0000","last_became_peered":"2024-09-18T01:25:16.713789+0000","last_unstale":"2024-09-18T01:29:27.470607+0000","last_undegraded":"2024-09-18T01:29:27.470607+0000","last_fullsized":"2024-09-18T01:29:27.470607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:27.470502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:27.470502+0000","last_clean_scrub_stamp":"2024-09-18T01:29:27.470502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:16:48.306112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.847149+0000","last_change":"2024-09-18T01:28:53.847173+0000","last_active":"2024-09-18T01:28:53.847149+0000","last_peered":"2024-09-18T01:28:53.847149+0000","last_clean":"2024-09-18T01:28:53.847149+0000","last_became_active":"2024-09-18T01:25:08.670268+0000","last_became_peered":"2024-09-18T01:25:08.670268+0000","last_unstale":"2024-09-18T01:28:53.847149+0000","last_undegraded":"2024-09-18T01:28:53.847149+0000","last_fullsized":"2024-09-18T01:28:53.847149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:53.847065+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:53.847065+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.847065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:14.842558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:21.043742+0000","last_change":"2024-09-18T01:29:21.043769+0000","last_active":"2024-09-18T01:29:21.043742+0000","last_peered":"2024-09-18T01:29:21.043742+0000","last_clean":"2024-09-18T01:29:21.043742+0000","last_became_active":"2024-09-18T01:25:06.687382+0000","last_became_peered":"2024-09-18T01:25:06.687382+0000","last_unstale":"2024-09-18T01:29:21.043742+0000","last_undegraded":"2024-09-18T01:29:21.043742+0000","last_fullsized":"2024-09-18T01:29:21.043742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:21.043645+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:21.043645+0000","last_clean_scrub_stamp":"2024-09-18T01:29:21.043645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:24:01.222359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:43.756227+0000","last_change":"2024-09-18T01:28:43.756254+0000","last_active":"2024-09-18T01:28:43.756227+0000","last_peered":"2024-09-18T01:28:43.756227+0000","last_clean":"2024-09-18T01:28:43.756227+0000","last_became_active":"2024-09-18T01:25:10.682337+0000","last_became_peered":"2024-09-18T01:25:10.682337+0000","last_unstale":"2024-09-18T01:28:43.756227+0000","last_undegraded":"2024-09-18T01:28:43.756227+0000","last_fullsized":"2024-09-18T01:28:43.756227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:43.756140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:43.756140+0000","last_clean_scrub_stamp":"2024-09-18T01:28:43.756140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:26.328226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'43","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.556548+0000","last_change":"2024-09-18T01:28:37.556582+0000","last_active":"2024-09-18T01:28:37.556548+0000","last_peered":"2024-09-18T01:28:37.556548+0000","last_clean":"2024-09-18T01:28:37.556548+0000","last_became_active":"2024-09-18T01:25:12.693129+0000","last_became_peered":"2024-09-18T01:25:12.693129+0000","last_unstale":"2024-09-18T01:28:37.556548+0000","last_undegraded":"2024-09-18T01:28:37.556548+0000","last_fullsized":"2024-09-18T01:28:37.556548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'43","last_scrub_stamp":"2024-09-18T01:28:37.556467+0000","last_deep_scrub":"35'43","last_deep_scrub_stamp":"2024-09-18T01:28:37.556467+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.556467+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:47:34.949630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.064141+0000","last_change":"2024-09-18T01:28:50.064170+0000","last_active":"2024-09-18T01:28:50.064141+0000","last_peered":"2024-09-18T01:28:50.064141+0000","last_clean":"2024-09-18T01:28:50.064141+0000","last_became_active":"2024-09-18T01:25:14.706325+0000","last_became_peered":"2024-09-18T01:25:14.706325+0000","last_unstale":"2024-09-18T01:28:50.064141+0000","last_undegraded":"2024-09-18T01:28:50.064141+0000","last_fullsized":"2024-09-18T01:28:50.064141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:50.064039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:50.064039+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.064039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:44:36.736877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801744+0000","last_change":"2024-09-18T01:25:16.716357+0000","last_active":"2024-09-18T01:27:44.801744+0000","last_peered":"2024-09-18T01:27:44.801744+0000","last_clean":"2024-09-18T01:27:44.801744+0000","last_became_active":"2024-09-18T01:25:16.716084+0000","last_became_peered":"2024-09-18T01:25:16.716084+0000","last_unstale":"2024-09-18T01:27:44.801744+0000","last_undegraded":"2024-09-18T01:27:44.801744+0000","last_fullsized":"2024-09-18T01:27:44.801744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:06.065241+0000","last_change":"2024-09-18T01:29:06.065262+0000","last_active":"2024-09-18T01:29:06.065241+0000","last_peered":"2024-09-18T01:29:06.065241+0000","last_clean":"2024-09-18T01:29:06.065241+0000","last_became_active":"2024-09-18T01:25:08.678539+0000","last_became_peered":"2024-09-18T01:25:08.678539+0000","last_unstale":"2024-09-18T01:29:06.065241+0000","last_undegraded":"2024-09-18T01:29:06.065241+0000","last_fullsized":"2024-09-18T01:29:06.065241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:06.065116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:06.065116+0000","last_clean_scrub_stamp":"2024-09-18T01:29:06.065116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:59.304634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:20.560666+0000","last_change":"2024-09-18T01:29:20.560694+0000","last_active":"2024-09-18T01:29:20.560666+0000","last_peered":"2024-09-18T01:29:20.560666+0000","last_clean":"2024-09-18T01:29:20.560666+0000","last_became_active":"2024-09-18T01:25:06.682592+0000","last_became_peered":"2024-09-18T01:25:06.682592+0000","last_unstale":"2024-09-18T01:29:20.560666+0000","last_undegraded":"2024-09-18T01:29:20.560666+0000","last_fullsized":"2024-09-18T01:29:20.560666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:20.560575+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:20.560575+0000","last_clean_scrub_stamp":"2024-09-18T01:29:20.560575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:10.427964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.341584+0000","last_change":"2024-09-18T01:28:34.341623+0000","last_active":"2024-09-18T01:28:34.341584+0000","last_peered":"2024-09-18T01:28:34.341584+0000","last_clean":"2024-09-18T01:28:34.341584+0000","last_became_active":"2024-09-18T01:25:10.683833+0000","last_became_peered":"2024-09-18T01:25:10.683833+0000","last_unstale":"2024-09-18T01:28:34.341584+0000","last_undegraded":"2024-09-18T01:28:34.341584+0000","last_fullsized":"2024-09-18T01:28:34.341584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:34.341474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:34.341474+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.341474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:33.233882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'38","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.014129+0000","last_change":"2024-09-18T01:28:58.014174+0000","last_active":"2024-09-18T01:28:58.014129+0000","last_peered":"2024-09-18T01:28:58.014129+0000","last_clean":"2024-09-18T01:28:58.014129+0000","last_became_active":"2024-09-18T01:25:12.691752+0000","last_became_peered":"2024-09-18T01:25:12.691752+0000","last_unstale":"2024-09-18T01:28:58.014129+0000","last_undegraded":"2024-09-18T01:28:58.014129+0000","last_fullsized":"2024-09-18T01:28:58.014129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'38","last_scrub_stamp":"2024-09-18T01:28:58.014049+0000","last_deep_scrub":"35'38","last_deep_scrub_stamp":"2024-09-18T01:28:58.014049+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.014049+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:10:57.324269+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:07.043534+0000","last_change":"2024-09-18T01:29:07.043556+0000","last_active":"2024-09-18T01:29:07.043534+0000","last_peered":"2024-09-18T01:29:07.043534+0000","last_clean":"2024-09-18T01:29:07.043534+0000","last_became_active":"2024-09-18T01:25:14.711635+0000","last_became_peered":"2024-09-18T01:25:14.711635+0000","last_unstale":"2024-09-18T01:29:07.043534+0000","last_undegraded":"2024-09-18T01:29:07.043534+0000","last_fullsized":"2024-09-18T01:29:07.043534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:07.043432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:07.043432+0000","last_clean_scrub_stamp":"2024-09-18T01:29:07.043432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:03.921303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:44.801703+0000","last_change":"2024-09-18T01:25:16.715865+0000","last_active":"2024-09-18T01:27:44.801703+0000","last_peered":"2024-09-18T01:27:44.801703+0000","last_clean":"2024-09-18T01:27:44.801703+0000","last_became_active":"2024-09-18T01:25:16.715581+0000","last_became_peered":"2024-09-18T01:25:16.715581+0000","last_unstale":"2024-09-18T01:27:44.801703+0000","last_undegraded":"2024-09-18T01:27:44.801703+0000","last_fullsized":"2024-09-18T01:27:44.801703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'8","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.804555+0000","last_change":"2024-09-18T01:28:52.804583+0000","last_active":"2024-09-18T01:28:52.804555+0000","last_peered":"2024-09-18T01:28:52.804555+0000","last_clean":"2024-09-18T01:28:52.804555+0000","last_became_active":"2024-09-18T01:25:08.668430+0000","last_became_peered":"2024-09-18T01:25:08.668430+0000","last_unstale":"2024-09-18T01:28:52.804555+0000","last_undegraded":"2024-09-18T01:28:52.804555+0000","last_fullsized":"2024-09-18T01:28:52.804555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:52.804464+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:52.804464+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.804464+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:58:10.937040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:18.303939+0000","last_change":"2024-09-18T01:29:18.303939+0000","last_active":"2024-09-18T01:29:18.303939+0000","last_peered":"2024-09-18T01:29:18.303939+0000","last_clean":"2024-09-18T01:29:18.303939+0000","last_became_active":"2024-09-18T01:25:06.686394+0000","last_became_peered":"2024-09-18T01:25:06.686394+0000","last_unstale":"2024-09-18T01:29:18.303939+0000","last_undegraded":"2024-09-18T01:29:18.303939+0000","last_fullsized":"2024-09-18T01:29:18.303939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:18.303802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:18.303802+0000","last_clean_scrub_stamp":"2024-09-18T01:29:18.303802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:12:51.099041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.382361+0000","last_change":"2024-09-18T01:28:36.382417+0000","last_active":"2024-09-18T01:28:36.382361+0000","last_peered":"2024-09-18T01:28:36.382361+0000","last_clean":"2024-09-18T01:28:36.382361+0000","last_became_active":"2024-09-18T01:25:10.683351+0000","last_became_peered":"2024-09-18T01:25:10.683351+0000","last_unstale":"2024-09-18T01:28:36.382361+0000","last_undegraded":"2024-09-18T01:28:36.382361+0000","last_fullsized":"2024-09-18T01:28:36.382361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:28:36.382253+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:28:36.382253+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.382253+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:41:10.171758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'54","reported_seq":123,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.048989+0000","last_change":"2024-09-18T01:28:35.049047+0000","last_active":"2024-09-18T01:28:35.048989+0000","last_peered":"2024-09-18T01:28:35.048989+0000","last_clean":"2024-09-18T01:28:35.048989+0000","last_became_active":"2024-09-18T01:25:12.691715+0000","last_became_peered":"2024-09-18T01:25:12.691715+0000","last_unstale":"2024-09-18T01:28:35.048989+0000","last_undegraded":"2024-09-18T01:28:35.048989+0000","last_fullsized":"2024-09-18T01:28:35.048989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'54","last_scrub_stamp":"2024-09-18T01:28:35.048876+0000","last_deep_scrub":"35'54","last_deep_scrub_stamp":"2024-09-18T01:28:35.048876+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.048876+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:53.636298+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.564860+0000","last_change":"2024-09-18T01:28:35.564885+0000","last_active":"2024-09-18T01:28:35.564860+0000","last_peered":"2024-09-18T01:28:35.564860+0000","last_clean":"2024-09-18T01:28:35.564860+0000","last_became_active":"2024-09-18T01:25:14.706398+0000","last_became_peered":"2024-09-18T01:25:14.706398+0000","last_unstale":"2024-09-18T01:28:35.564860+0000","last_undegraded":"2024-09-18T01:28:35.564860+0000","last_fullsized":"2024-09-18T01:28:35.564860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:35.564741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:35.564741+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.564741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:51.265281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:27:39.800848+0000","last_change":"2024-09-18T01:25:16.714114+0000","last_active":"2024-09-18T01:27:39.800848+0000","last_peered":"2024-09-18T01:27:39.800848+0000","last_clean":"2024-09-18T01:27:39.800848+0000","last_became_active":"2024-09-18T01:25:16.713579+0000","last_became_peered":"2024-09-18T01:25:16.713579+0000","last_unstale":"2024-09-18T01:27:39.800848+0000","last_undegraded":"2024-09-18T01:27:39.800848+0000","last_fullsized":"2024-09-18T01:27:39.800848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:25:15.690484+0000","last_clean_scrub_stamp":"2024-09-18T01:25:15.690484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'8","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.239025+0000","last_change":"2024-09-18T01:28:54.239025+0000","last_active":"2024-09-18T01:28:54.239025+0000","last_peered":"2024-09-18T01:28:54.239025+0000","last_clean":"2024-09-18T01:28:54.239025+0000","last_became_active":"2024-09-18T01:25:08.686645+0000","last_became_peered":"2024-09-18T01:25:08.686645+0000","last_unstale":"2024-09-18T01:28:54.239025+0000","last_undegraded":"2024-09-18T01:28:54.239025+0000","last_fullsized":"2024-09-18T01:28:54.239025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:54.238884+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:54.238884+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.238884+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:10:44.376100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.762016+0000","last_change":"2024-09-18T01:29:04.762016+0000","last_active":"2024-09-18T01:29:04.762016+0000","last_peered":"2024-09-18T01:29:04.762016+0000","last_clean":"2024-09-18T01:29:04.762016+0000","last_became_active":"2024-09-18T01:25:06.702991+0000","last_became_peered":"2024-09-18T01:25:06.702991+0000","last_unstale":"2024-09-18T01:29:04.762016+0000","last_undegraded":"2024-09-18T01:29:04.762016+0000","last_fullsized":"2024-09-18T01:29:04.762016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:04.761904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:04.761904+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.761904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:25.122552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:07.539378+0000","last_change":"2024-09-18T01:29:07.539378+0000","last_active":"2024-09-18T01:29:07.539378+0000","last_peered":"2024-09-18T01:29:07.539378+0000","last_clean":"2024-09-18T01:29:07.539378+0000","last_became_active":"2024-09-18T01:25:08.672983+0000","last_became_peered":"2024-09-18T01:25:08.672983+0000","last_unstale":"2024-09-18T01:29:07.539378+0000","last_undegraded":"2024-09-18T01:29:07.539378+0000","last_fullsized":"2024-09-18T01:29:07.539378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:07.539265+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:07.539265+0000","last_clean_scrub_stamp":"2024-09-18T01:29:07.539265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:48.424256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:19.547156+0000","last_change":"2024-09-18T01:29:19.547195+0000","last_active":"2024-09-18T01:29:19.547156+0000","last_peered":"2024-09-18T01:29:19.547156+0000","last_clean":"2024-09-18T01:29:19.547156+0000","last_became_active":"2024-09-18T01:25:06.680853+0000","last_became_peered":"2024-09-18T01:25:06.680853+0000","last_unstale":"2024-09-18T01:29:19.547156+0000","last_undegraded":"2024-09-18T01:29:19.547156+0000","last_fullsized":"2024-09-18T01:29:19.547156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:19.547055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:19.547055+0000","last_clean_scrub_stamp":"2024-09-18T01:29:19.547055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:15:01.294518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'8","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.117009+0000","last_change":"2024-09-18T01:29:02.117009+0000","last_active":"2024-09-18T01:29:02.117009+0000","last_peered":"2024-09-18T01:29:02.117009+0000","last_clean":"2024-09-18T01:29:02.117009+0000","last_became_active":"2024-09-18T01:25:08.682254+0000","last_became_peered":"2024-09-18T01:25:08.682254+0000","last_unstale":"2024-09-18T01:29:02.117009+0000","last_undegraded":"2024-09-18T01:29:02.117009+0000","last_fullsized":"2024-09-18T01:29:02.117009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:02.116885+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:02.116885+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.116885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:35:11.500133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:34.011610+0000","last_change":"2024-09-18T01:29:34.011635+0000","last_active":"2024-09-18T01:29:34.011610+0000","last_peered":"2024-09-18T01:29:34.011610+0000","last_clean":"2024-09-18T01:29:34.011610+0000","last_became_active":"2024-09-18T01:25:06.682878+0000","last_became_peered":"2024-09-18T01:25:06.682878+0000","last_unstale":"2024-09-18T01:29:34.011610+0000","last_undegraded":"2024-09-18T01:29:34.011610+0000","last_fullsized":"2024-09-18T01:29:34.011610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:34.011517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:34.011517+0000","last_clean_scrub_stamp":"2024-09-18T01:29:34.011517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:26:00.016155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:05.482588+0000","last_change":"2024-09-18T01:29:05.482588+0000","last_active":"2024-09-18T01:29:05.482588+0000","last_peered":"2024-09-18T01:29:05.482588+0000","last_clean":"2024-09-18T01:29:05.482588+0000","last_became_active":"2024-09-18T01:25:08.672574+0000","last_became_peered":"2024-09-18T01:25:08.672574+0000","last_unstale":"2024-09-18T01:29:05.482588+0000","last_undegraded":"2024-09-18T01:29:05.482588+0000","last_fullsized":"2024-09-18T01:29:05.482588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:05.482430+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:05.482430+0000","last_clean_scrub_stamp":"2024-09-18T01:29:05.482430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:36:37.124121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:18.523309+0000","last_change":"2024-09-18T01:29:18.523339+0000","last_active":"2024-09-18T01:29:18.523309+0000","last_peered":"2024-09-18T01:29:18.523309+0000","last_clean":"2024-09-18T01:29:18.523309+0000","last_became_active":"2024-09-18T01:25:06.680712+0000","last_became_peered":"2024-09-18T01:25:06.680712+0000","last_unstale":"2024-09-18T01:29:18.523309+0000","last_undegraded":"2024-09-18T01:29:18.523309+0000","last_fullsized":"2024-09-18T01:29:18.523309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:18.523194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:18.523194+0000","last_clean_scrub_stamp":"2024-09-18T01:29:18.523194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:52:44.012377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.473553+0000","last_change":"2024-09-18T01:28:59.473553+0000","last_active":"2024-09-18T01:28:59.473553+0000","last_peered":"2024-09-18T01:28:59.473553+0000","last_clean":"2024-09-18T01:28:59.473553+0000","last_became_active":"2024-09-18T01:25:08.671408+0000","last_became_peered":"2024-09-18T01:25:08.671408+0000","last_unstale":"2024-09-18T01:28:59.473553+0000","last_undegraded":"2024-09-18T01:28:59.473553+0000","last_fullsized":"2024-09-18T01:28:59.473553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:59.473436+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:59.473436+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.473436+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:23:43.979561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:12.469830+0000","last_change":"2024-09-18T01:29:12.469830+0000","last_active":"2024-09-18T01:29:12.469830+0000","last_peered":"2024-09-18T01:29:12.469830+0000","last_clean":"2024-09-18T01:29:12.469830+0000","last_became_active":"2024-09-18T01:25:06.682577+0000","last_became_peered":"2024-09-18T01:25:06.682577+0000","last_unstale":"2024-09-18T01:29:12.469830+0000","last_undegraded":"2024-09-18T01:29:12.469830+0000","last_fullsized":"2024-09-18T01:29:12.469830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:12.469703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:12.469703+0000","last_clean_scrub_stamp":"2024-09-18T01:29:12.469703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:05:36.836271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'8","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:45.320051+0000","last_change":"2024-09-18T01:28:45.320051+0000","last_active":"2024-09-18T01:28:45.320051+0000","last_peered":"2024-09-18T01:28:45.320051+0000","last_clean":"2024-09-18T01:28:45.320051+0000","last_became_active":"2024-09-18T01:25:08.687797+0000","last_became_peered":"2024-09-18T01:25:08.687797+0000","last_unstale":"2024-09-18T01:28:45.320051+0000","last_undegraded":"2024-09-18T01:28:45.320051+0000","last_fullsized":"2024-09-18T01:28:45.320051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:45.319930+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:45.319930+0000","last_clean_scrub_stamp":"2024-09-18T01:28:45.319930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:09:56.008523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:17.259295+0000","last_change":"2024-09-18T01:29:17.259295+0000","last_active":"2024-09-18T01:29:17.259295+0000","last_peered":"2024-09-18T01:29:17.259295+0000","last_clean":"2024-09-18T01:29:17.259295+0000","last_became_active":"2024-09-18T01:25:06.686154+0000","last_became_peered":"2024-09-18T01:25:06.686154+0000","last_unstale":"2024-09-18T01:29:17.259295+0000","last_undegraded":"2024-09-18T01:29:17.259295+0000","last_fullsized":"2024-09-18T01:29:17.259295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:17.259180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:17.259180+0000","last_clean_scrub_stamp":"2024-09-18T01:29:17.259180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:41.001234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'8","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.490691+0000","last_change":"2024-09-18T01:28:53.490691+0000","last_active":"2024-09-18T01:28:53.490691+0000","last_peered":"2024-09-18T01:28:53.490691+0000","last_clean":"2024-09-18T01:28:53.490691+0000","last_became_active":"2024-09-18T01:25:08.680947+0000","last_became_peered":"2024-09-18T01:25:08.680947+0000","last_unstale":"2024-09-18T01:28:53.490691+0000","last_undegraded":"2024-09-18T01:28:53.490691+0000","last_fullsized":"2024-09-18T01:28:53.490691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:53.490566+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:53.490566+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.490566+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:33.730590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.848536+0000","last_change":"2024-09-18T01:29:00.848536+0000","last_active":"2024-09-18T01:29:00.848536+0000","last_peered":"2024-09-18T01:29:00.848536+0000","last_clean":"2024-09-18T01:29:00.848536+0000","last_became_active":"2024-09-18T01:25:06.703622+0000","last_became_peered":"2024-09-18T01:25:06.703622+0000","last_unstale":"2024-09-18T01:29:00.848536+0000","last_undegraded":"2024-09-18T01:29:00.848536+0000","last_fullsized":"2024-09-18T01:29:00.848536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:00.848412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:00.848412+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.848412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:47:06.895449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.252691+0000","last_change":"2024-09-18T01:28:59.252691+0000","last_active":"2024-09-18T01:28:59.252691+0000","last_peered":"2024-09-18T01:28:59.252691+0000","last_clean":"2024-09-18T01:28:59.252691+0000","last_became_active":"2024-09-18T01:25:08.682143+0000","last_became_peered":"2024-09-18T01:25:08.682143+0000","last_unstale":"2024-09-18T01:28:59.252691+0000","last_undegraded":"2024-09-18T01:28:59.252691+0000","last_fullsized":"2024-09-18T01:28:59.252691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:59.252539+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:59.252539+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.252539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:19.613187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.409092+0000","last_change":"2024-09-18T01:29:02.409092+0000","last_active":"2024-09-18T01:29:02.409092+0000","last_peered":"2024-09-18T01:29:02.409092+0000","last_clean":"2024-09-18T01:29:02.409092+0000","last_became_active":"2024-09-18T01:25:06.687436+0000","last_became_peered":"2024-09-18T01:25:06.687436+0000","last_unstale":"2024-09-18T01:29:02.409092+0000","last_undegraded":"2024-09-18T01:29:02.409092+0000","last_fullsized":"2024-09-18T01:29:02.409092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:02.408948+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:02.408948+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.408948+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:27.550849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'14","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.296638+0000","last_change":"2024-09-18T01:29:00.296663+0000","last_active":"2024-09-18T01:29:00.296638+0000","last_peered":"2024-09-18T01:29:00.296638+0000","last_clean":"2024-09-18T01:29:00.296638+0000","last_became_active":"2024-09-18T01:25:08.675801+0000","last_became_peered":"2024-09-18T01:25:08.675801+0000","last_unstale":"2024-09-18T01:29:00.296638+0000","last_undegraded":"2024-09-18T01:29:00.296638+0000","last_fullsized":"2024-09-18T01:29:00.296638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-18T01:29:00.296517+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-18T01:29:00.296517+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.296517+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:42:52.269835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:26.958405+0000","last_change":"2024-09-18T01:29:26.958405+0000","last_active":"2024-09-18T01:29:26.958405+0000","last_peered":"2024-09-18T01:29:26.958405+0000","last_clean":"2024-09-18T01:29:26.958405+0000","last_became_active":"2024-09-18T01:25:06.691345+0000","last_became_peered":"2024-09-18T01:25:06.691345+0000","last_unstale":"2024-09-18T01:29:26.958405+0000","last_undegraded":"2024-09-18T01:29:26.958405+0000","last_fullsized":"2024-09-18T01:29:26.958405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:26.958274+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:26.958274+0000","last_clean_scrub_stamp":"2024-09-18T01:29:26.958274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:37:15.878720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'16","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.037028+0000","last_change":"2024-09-18T01:28:48.037058+0000","last_active":"2024-09-18T01:28:48.037028+0000","last_peered":"2024-09-18T01:28:48.037028+0000","last_clean":"2024-09-18T01:28:48.037028+0000","last_became_active":"2024-09-18T01:25:08.685358+0000","last_became_peered":"2024-09-18T01:25:08.685358+0000","last_unstale":"2024-09-18T01:28:48.037028+0000","last_undegraded":"2024-09-18T01:28:48.037028+0000","last_fullsized":"2024-09-18T01:28:48.037028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-18T01:28:48.036938+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-18T01:28:48.036938+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.036938+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:05:58.460295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.429241+0000","last_change":"2024-09-18T01:29:00.429241+0000","last_active":"2024-09-18T01:29:00.429241+0000","last_peered":"2024-09-18T01:29:00.429241+0000","last_clean":"2024-09-18T01:29:00.429241+0000","last_became_active":"2024-09-18T01:25:06.695735+0000","last_became_peered":"2024-09-18T01:25:06.695735+0000","last_unstale":"2024-09-18T01:29:00.429241+0000","last_undegraded":"2024-09-18T01:29:00.429241+0000","last_fullsized":"2024-09-18T01:29:00.429241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:00.429123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:00.429123+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.429123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:01:39.782859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"35'6","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:28.528436+0000","last_change":"2024-09-18T01:29:28.528436+0000","last_active":"2024-09-18T01:29:28.528436+0000","last_peered":"2024-09-18T01:29:28.528436+0000","last_clean":"2024-09-18T01:29:28.528436+0000","last_became_active":"2024-09-18T01:25:43.849600+0000","last_became_peered":"2024-09-18T01:25:43.849600+0000","last_unstale":"2024-09-18T01:29:28.528436+0000","last_undegraded":"2024-09-18T01:29:28.528436+0000","last_fullsized":"2024-09-18T01:29:28.528436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:28.528319+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:28.528319+0000","last_clean_scrub_stamp":"2024-09-18T01:29:28.528319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:34:33.997166+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.302718+0000","last_change":"2024-09-18T01:29:02.302718+0000","last_active":"2024-09-18T01:29:02.302718+0000","last_peered":"2024-09-18T01:29:02.302718+0000","last_clean":"2024-09-18T01:29:02.302718+0000","last_became_active":"2024-09-18T01:25:06.688967+0000","last_became_peered":"2024-09-18T01:25:06.688967+0000","last_unstale":"2024-09-18T01:29:02.302718+0000","last_undegraded":"2024-09-18T01:29:02.302718+0000","last_fullsized":"2024-09-18T01:29:02.302718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:02.302563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:02.302563+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.302563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:50.858341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'10","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:05.327746+0000","last_change":"2024-09-18T01:29:05.327746+0000","last_active":"2024-09-18T01:29:05.327746+0000","last_peered":"2024-09-18T01:29:05.327746+0000","last_clean":"2024-09-18T01:29:05.327746+0000","last_became_active":"2024-09-18T01:25:08.683590+0000","last_became_peered":"2024-09-18T01:25:08.683590+0000","last_unstale":"2024-09-18T01:29:05.327746+0000","last_undegraded":"2024-09-18T01:29:05.327746+0000","last_fullsized":"2024-09-18T01:29:05.327746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-18T01:29:05.327617+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-18T01:29:05.327617+0000","last_clean_scrub_stamp":"2024-09-18T01:29:05.327617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:30.469517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:16.305809+0000","last_change":"2024-09-18T01:29:16.305809+0000","last_active":"2024-09-18T01:29:16.305809+0000","last_peered":"2024-09-18T01:29:16.305809+0000","last_clean":"2024-09-18T01:29:16.305809+0000","last_became_active":"2024-09-18T01:25:06.685814+0000","last_became_peered":"2024-09-18T01:25:06.685814+0000","last_unstale":"2024-09-18T01:29:16.305809+0000","last_undegraded":"2024-09-18T01:29:16.305809+0000","last_fullsized":"2024-09-18T01:29:16.305809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:16.305681+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:16.305681+0000","last_clean_scrub_stamp":"2024-09-18T01:29:16.305681+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:20.025985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.209000+0000","last_change":"2024-09-18T01:28:53.209000+0000","last_active":"2024-09-18T01:28:53.209000+0000","last_peered":"2024-09-18T01:28:53.209000+0000","last_clean":"2024-09-18T01:28:53.209000+0000","last_became_active":"2024-09-18T01:25:08.686703+0000","last_became_peered":"2024-09-18T01:25:08.686703+0000","last_unstale":"2024-09-18T01:28:53.209000+0000","last_undegraded":"2024-09-18T01:28:53.209000+0000","last_fullsized":"2024-09-18T01:28:53.209000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:53.208858+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:53.208858+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.208858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:49.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:24.945635+0000","last_change":"2024-09-18T01:29:24.945635+0000","last_active":"2024-09-18T01:29:24.945635+0000","last_peered":"2024-09-18T01:29:24.945635+0000","last_clean":"2024-09-18T01:29:24.945635+0000","last_became_active":"2024-09-18T01:25:06.685120+0000","last_became_peered":"2024-09-18T01:25:06.685120+0000","last_unstale":"2024-09-18T01:29:24.945635+0000","last_undegraded":"2024-09-18T01:29:24.945635+0000","last_fullsized":"2024-09-18T01:29:24.945635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:24.945495+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:24.945495+0000","last_clean_scrub_stamp":"2024-09-18T01:29:24.945495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:44:29.408596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'8","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:11.346932+0000","last_change":"2024-09-18T01:29:11.346932+0000","last_active":"2024-09-18T01:29:11.346932+0000","last_peered":"2024-09-18T01:29:11.346932+0000","last_clean":"2024-09-18T01:29:11.346932+0000","last_became_active":"2024-09-18T01:25:08.685158+0000","last_became_peered":"2024-09-18T01:25:08.685158+0000","last_unstale":"2024-09-18T01:29:11.346932+0000","last_undegraded":"2024-09-18T01:29:11.346932+0000","last_fullsized":"2024-09-18T01:29:11.346932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:11.346794+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:11.346794+0000","last_clean_scrub_stamp":"2024-09-18T01:29:11.346794+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:37.769121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:27.937030+0000","last_change":"2024-09-18T01:29:27.937030+0000","last_active":"2024-09-18T01:29:27.937030+0000","last_peered":"2024-09-18T01:29:27.937030+0000","last_clean":"2024-09-18T01:29:27.937030+0000","last_became_active":"2024-09-18T01:25:06.684845+0000","last_became_peered":"2024-09-18T01:25:06.684845+0000","last_unstale":"2024-09-18T01:29:27.937030+0000","last_undegraded":"2024-09-18T01:29:27.937030+0000","last_fullsized":"2024-09-18T01:29:27.937030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:27.936877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:27.936877+0000","last_clean_scrub_stamp":"2024-09-18T01:29:27.936877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:09.745937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.994102+0000","last_change":"2024-09-18T01:28:44.994102+0000","last_active":"2024-09-18T01:28:44.994102+0000","last_peered":"2024-09-18T01:28:44.994102+0000","last_clean":"2024-09-18T01:28:44.994102+0000","last_became_active":"2024-09-18T01:25:08.687840+0000","last_became_peered":"2024-09-18T01:25:08.687840+0000","last_unstale":"2024-09-18T01:28:44.994102+0000","last_undegraded":"2024-09-18T01:28:44.994102+0000","last_fullsized":"2024-09-18T01:28:44.994102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:44.993971+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:44.993971+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.993971+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:14.403429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.816140+0000","last_change":"2024-09-18T01:28:58.816170+0000","last_active":"2024-09-18T01:28:58.816140+0000","last_peered":"2024-09-18T01:28:58.816140+0000","last_clean":"2024-09-18T01:28:58.816140+0000","last_became_active":"2024-09-18T01:25:06.704247+0000","last_became_peered":"2024-09-18T01:25:06.704247+0000","last_unstale":"2024-09-18T01:28:58.816140+0000","last_undegraded":"2024-09-18T01:28:58.816140+0000","last_fullsized":"2024-09-18T01:28:58.816140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:58.816043+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:58.816043+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.816043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:36.858075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'12","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.206349+0000","last_change":"2024-09-18T01:28:58.206349+0000","last_active":"2024-09-18T01:28:58.206349+0000","last_peered":"2024-09-18T01:28:58.206349+0000","last_clean":"2024-09-18T01:28:58.206349+0000","last_became_active":"2024-09-18T01:25:08.680916+0000","last_became_peered":"2024-09-18T01:25:08.680916+0000","last_unstale":"2024-09-18T01:28:58.206349+0000","last_undegraded":"2024-09-18T01:28:58.206349+0000","last_fullsized":"2024-09-18T01:28:58.206349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-18T01:28:58.206180+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-18T01:28:58.206180+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.206180+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:27.429284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:33.030354+0000","last_change":"2024-09-18T01:29:33.030397+0000","last_active":"2024-09-18T01:29:33.030354+0000","last_peered":"2024-09-18T01:29:33.030354+0000","last_clean":"2024-09-18T01:29:33.030354+0000","last_became_active":"2024-09-18T01:25:06.693000+0000","last_became_peered":"2024-09-18T01:25:06.693000+0000","last_unstale":"2024-09-18T01:29:33.030354+0000","last_undegraded":"2024-09-18T01:29:33.030354+0000","last_fullsized":"2024-09-18T01:29:33.030354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:33.030229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:33.030229+0000","last_clean_scrub_stamp":"2024-09-18T01:29:33.030229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:09:34.335736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:34.965754+0000","last_change":"2024-09-18T01:29:34.965782+0000","last_active":"2024-09-18T01:29:34.965754+0000","last_peered":"2024-09-18T01:29:34.965754+0000","last_clean":"2024-09-18T01:29:34.965754+0000","last_became_active":"2024-09-18T01:25:06.691141+0000","last_became_peered":"2024-09-18T01:25:06.691141+0000","last_unstale":"2024-09-18T01:29:34.965754+0000","last_undegraded":"2024-09-18T01:29:34.965754+0000","last_fullsized":"2024-09-18T01:29:34.965754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:34.965662+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:34.965662+0000","last_clean_scrub_stamp":"2024-09-18T01:29:34.965662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:38:57.583845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'12","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.447712+0000","last_change":"2024-09-18T01:28:54.447736+0000","last_active":"2024-09-18T01:28:54.447712+0000","last_peered":"2024-09-18T01:28:54.447712+0000","last_clean":"2024-09-18T01:28:54.447712+0000","last_became_active":"2024-09-18T01:25:08.681053+0000","last_became_peered":"2024-09-18T01:25:08.681053+0000","last_unstale":"2024-09-18T01:28:54.447712+0000","last_undegraded":"2024-09-18T01:28:54.447712+0000","last_fullsized":"2024-09-18T01:28:54.447712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-18T01:28:54.447595+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-18T01:28:54.447595+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.447595+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:28.469233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.509277+0000","last_change":"2024-09-18T01:28:58.509277+0000","last_active":"2024-09-18T01:28:58.509277+0000","last_peered":"2024-09-18T01:28:58.509277+0000","last_clean":"2024-09-18T01:28:58.509277+0000","last_became_active":"2024-09-18T01:25:06.695875+0000","last_became_peered":"2024-09-18T01:25:06.695875+0000","last_unstale":"2024-09-18T01:28:58.509277+0000","last_undegraded":"2024-09-18T01:28:58.509277+0000","last_fullsized":"2024-09-18T01:28:58.509277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:58.509138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:58.509138+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.509138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:11.477929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.288654+0000","last_change":"2024-09-18T01:28:46.288688+0000","last_active":"2024-09-18T01:28:46.288654+0000","last_peered":"2024-09-18T01:28:46.288654+0000","last_clean":"2024-09-18T01:28:46.288654+0000","last_became_active":"2024-09-18T01:25:08.687583+0000","last_became_peered":"2024-09-18T01:25:08.687583+0000","last_unstale":"2024-09-18T01:28:46.288654+0000","last_undegraded":"2024-09-18T01:28:46.288654+0000","last_fullsized":"2024-09-18T01:28:46.288654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:46.288559+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:46.288559+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.288559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:46:19.008800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1751,"ondisk_log_size":1751,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673023,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":487424,"data_stored":155040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673023,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":744524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673024,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36364,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335476,"statfs":{"total":96636764160,"available":96599527424,"internally_reserved":0,"allocated":1044480,"data_stored":744891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":154885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:29:49.635 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-18T01:25:05.642362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:49.637 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:49.638 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:49.639 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:49.640 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:49.640 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:49.640 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:49.640 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-18T01:25:15.690484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=28, tm_sec=25, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:29:49.641 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T01:30:09.643 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:30:09.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.752+0000 7f28ceea4640 1 Processor -- start 2024-09-18T01:30:09.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.752+0000 7f28ceea4640 1 -- start start 2024-09-18T01:30:09.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.752+0000 7f28ceea4640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f28c806eda0 0x7f28c806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:30:09.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.752+0000 7f28ceea4640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28c806eba0 con 0x7f28c806f6c0 2024-09-18T01:30:09.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.752+0000 7f28ceea4640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f28c806d2f0 con 0x7f28c806eda0 2024-09-18T01:30:09.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.752+0000 7f28ccc40640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f28c806eda0 0x7f28c806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:30:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.753+0000 7f28bffff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f28c806f6c0 0x7f28c8121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:52506/0 (socket says 172.21.15.92:52506) 2024-09-18T01:30:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.753+0000 7f28bffff640 1 -- 172.21.15.92:0/1706439585 learned_addr learned my addr 172.21.15.92:0/1706439585 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:30:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.753+0000 7f28ccc40640 1 -- 172.21.15.92:0/1706439585 >> v1:172.21.15.92:6789/0 conn(0x7f28c806f6c0 legacy=0x7f28c8121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:30:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.753+0000 7f28ccc40640 1 -- 172.21.15.92:0/1706439585 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c8070d50 con 0x7f28c806eda0 2024-09-18T01:30:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.753+0000 7f28ccc40640 1 --2- 172.21.15.92:0/1706439585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c806eda0 0x7f28c806f180 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009720 tx=0x7f28c402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a778c5e7364a445 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:30:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.754+0000 7f28bf7fe640 1 -- 172.21.15.92:0/1706439585 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28c4037070 con 0x7f28c806eda0 2024-09-18T01:30:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.754+0000 7f28bf7fe640 1 -- 172.21.15.92:0/1706439585 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c402ae20 con 0x7f28c806eda0 2024-09-18T01:30:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.754+0000 7f28bf7fe640 1 -- 172.21.15.92:0/1706439585 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28c4032590 con 0x7f28c806eda0 2024-09-18T01:30:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.754+0000 7f28ceea4640 1 -- 172.21.15.92:0/1706439585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c806eda0 msgr2=0x7f28c806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:30:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.754+0000 7f28ceea4640 1 --2- 172.21.15.92:0/1706439585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c806eda0 0x7f28c806f180 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009720 tx=0x7f28c402a1a0 comp rx=0 tx=0).stop 2024-09-18T01:30:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.754+0000 7f28ceea4640 1 -- 172.21.15.92:0/1706439585 shutdown_connections 2024-09-18T01:30:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.754+0000 7f28ceea4640 1 --2- 172.21.15.92:0/1706439585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c806eda0 0x7f28c806f180 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:30:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.754+0000 7f28ceea4640 1 -- 172.21.15.92:0/1706439585 >> 172.21.15.92:0/1706439585 conn(0x7f28c809a890 msgr2=0x7f28c809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:30:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.754+0000 7f28ceea4640 1 -- 172.21.15.92:0/1706439585 shutdown_connections 2024-09-18T01:30:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.754+0000 7f28ceea4640 1 -- 172.21.15.92:0/1706439585 wait complete. 2024-09-18T01:30:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.755+0000 7f28ceea4640 1 Processor -- start 2024-09-18T01:30:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.755+0000 7f28ceea4640 1 -- start start 2024-09-18T01:30:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.756+0000 7f28ceea4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c806eda0 0x7f28c81c17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:30:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.756+0000 7f28ceea4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f28c8122160 con 0x7f28c806eda0 2024-09-18T01:30:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.756+0000 7f28ccc40640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c806eda0 0x7f28c81c17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:30:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.756+0000 7f28ccc40640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c806eda0 0x7f28c81c17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40028/0 (socket says 172.21.15.92:40028) 2024-09-18T01:30:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.756+0000 7f28ccc40640 1 -- 172.21.15.92:0/351044485 learned_addr learned my addr 172.21.15.92:0/351044485 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:30:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.756+0000 7f28ccc40640 1 -- 172.21.15.92:0/351044485 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c808db50 con 0x7f28c806eda0 2024-09-18T01:30:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.756+0000 7f28ccc40640 1 --2- 172.21.15.92:0/351044485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c806eda0 0x7f28c81c17a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f28c402a1e0 tx=0x7f28c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:30:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.756+0000 7f28bd7fa640 1 -- 172.21.15.92:0/351044485 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28c4042070 con 0x7f28c806eda0 2024-09-18T01:30:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.756+0000 7f28bd7fa640 1 -- 172.21.15.92:0/351044485 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c403e590 con 0x7f28c806eda0 2024-09-18T01:30:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.756+0000 7f28ceea4640 1 -- 172.21.15.92:0/351044485 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c81c1ce0 con 0x7f28c806eda0 2024-09-18T01:30:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.756+0000 7f28bd7fa640 1 -- 172.21.15.92:0/351044485 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28c4037040 con 0x7f28c806eda0 2024-09-18T01:30:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.756+0000 7f28ceea4640 1 -- 172.21.15.92:0/351044485 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c81c21b0 con 0x7f28c806eda0 2024-09-18T01:30:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.757+0000 7f28bd7fa640 1 -- 172.21.15.92:0/351044485 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f28c4045070 con 0x7f28c806eda0 2024-09-18T01:30:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.757+0000 7f28bd7fa640 1 --2- 172.21.15.92:0/351044485 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28b40382d0 0x7f28b403a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:30:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.757+0000 7f28bd7fa640 1 -- 172.21.15.92:0/351044485 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f28c406c620 con 0x7f28c806eda0 2024-09-18T01:30:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.757+0000 7f28ceea4640 1 -- 172.21.15.92:0/351044485 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28c808d6b0 con 0x7f28c806eda0 2024-09-18T01:30:09.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.758+0000 7f28bffff640 1 --2- 172.21.15.92:0/351044485 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28b40382d0 0x7f28b403a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:30:09.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.758+0000 7f28bffff640 1 --2- 172.21.15.92:0/351044485 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28b40382d0 0x7f28b403a790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f28b8007fd0 tx=0x7f28b8007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:30:09.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.762+0000 7f28bd7fa640 1 -- 172.21.15.92:0/351044485 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f28c403e8b0 con 0x7f28c806eda0 2024-09-18T01:30:09.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.924+0000 7f28ceea4640 1 -- 172.21.15.92:0/351044485 --> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28c808e3b0 con 0x7f28b40382d0 2024-09-18T01:30:09.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.939+0000 7f28bd7fa640 1 -- 172.21.15.92:0/351044485 <== mgr.4099 v2:172.21.15.100:6824/2336055460 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666458 (secure 0 0 0) 0x7f28c808e3b0 con 0x7f28b40382d0 2024-09-18T01:30:09.949 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-18T01:30:09.954 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-18T01:30:09.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.944+0000 7f28ceea4640 1 -- 172.21.15.92:0/351044485 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28b40382d0 msgr2=0x7f28b403a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:30:09.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.944+0000 7f28ceea4640 1 --2- 172.21.15.92:0/351044485 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28b40382d0 0x7f28b403a790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f28b8007fd0 tx=0x7f28b8007ac0 comp rx=0 tx=0).stop 2024-09-18T01:30:09.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.944+0000 7f28ceea4640 1 -- 172.21.15.92:0/351044485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c806eda0 msgr2=0x7f28c81c17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:30:09.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.944+0000 7f28ceea4640 1 --2- 172.21.15.92:0/351044485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c806eda0 0x7f28c81c17a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f28c402a1e0 tx=0x7f28c40046c0 comp rx=0 tx=0).stop 2024-09-18T01:30:09.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.944+0000 7f28ceea4640 1 -- 172.21.15.92:0/351044485 shutdown_connections 2024-09-18T01:30:09.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.944+0000 7f28ceea4640 1 --2- 172.21.15.92:0/351044485 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f28b40382d0 0x7f28b403a790 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:30:09.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.944+0000 7f28ceea4640 1 --2- 172.21.15.92:0/351044485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c806eda0 0x7f28c81c17a0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:30:09.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.944+0000 7f28ceea4640 1 -- 172.21.15.92:0/351044485 >> 172.21.15.92:0/351044485 conn(0x7f28c809a890 msgr2=0x7f28c806d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:30:09.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.944+0000 7f28ceea4640 1 -- 172.21.15.92:0/351044485 shutdown_connections 2024-09-18T01:30:09.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:09.944+0000 7f28ceea4640 1 -- 172.21.15.92:0/351044485 wait complete. 2024-09-18T01:30:09.958 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-18T01:30:08.860738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5383,"num_read_kb":4932,"num_write":2371,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":993,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5017,"ondisk_log_size":5017,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156800,"kb_used_data":2944,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330560,"statfs":{"total":386547056640,"available":386386493440,"internally_reserved":0,"allocated":3014656,"data_stored":1799340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003720"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:11.909701+0000","last_change":"2024-09-18T01:29:11.909701+0000","last_active":"2024-09-18T01:29:11.909701+0000","last_peered":"2024-09-18T01:29:11.909701+0000","last_clean":"2024-09-18T01:29:11.909701+0000","last_became_active":"2024-09-18T01:25:06.691940+0000","last_became_peered":"2024-09-18T01:25:06.691940+0000","last_unstale":"2024-09-18T01:29:11.909701+0000","last_undegraded":"2024-09-18T01:29:11.909701+0000","last_fullsized":"2024-09-18T01:29:11.909701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:11.909580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:11.909580+0000","last_clean_scrub_stamp":"2024-09-18T01:29:11.909580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:37.051480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'14","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.261128+0000","last_change":"2024-09-18T01:29:03.261180+0000","last_active":"2024-09-18T01:29:03.261128+0000","last_peered":"2024-09-18T01:29:03.261128+0000","last_clean":"2024-09-18T01:29:03.261128+0000","last_became_active":"2024-09-18T01:25:08.683538+0000","last_became_peered":"2024-09-18T01:25:08.683538+0000","last_unstale":"2024-09-18T01:29:03.261128+0000","last_undegraded":"2024-09-18T01:29:03.261128+0000","last_fullsized":"2024-09-18T01:29:03.261128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-18T01:29:03.261027+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-18T01:29:03.261027+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.261027+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:47.678527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:06.500013+0000","last_change":"2024-09-18T01:29:06.500013+0000","last_active":"2024-09-18T01:29:06.500013+0000","last_peered":"2024-09-18T01:29:06.500013+0000","last_clean":"2024-09-18T01:29:06.500013+0000","last_became_active":"2024-09-18T01:25:06.686950+0000","last_became_peered":"2024-09-18T01:25:06.686950+0000","last_unstale":"2024-09-18T01:29:06.500013+0000","last_undegraded":"2024-09-18T01:29:06.500013+0000","last_fullsized":"2024-09-18T01:29:06.500013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:06.499890+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:06.499890+0000","last_clean_scrub_stamp":"2024-09-18T01:29:06.499890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:52:59.744454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'20","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:10.052337+0000","last_change":"2024-09-18T01:29:10.052360+0000","last_active":"2024-09-18T01:29:10.052337+0000","last_peered":"2024-09-18T01:29:10.052337+0000","last_clean":"2024-09-18T01:29:10.052337+0000","last_became_active":"2024-09-18T01:25:08.673552+0000","last_became_peered":"2024-09-18T01:25:08.673552+0000","last_unstale":"2024-09-18T01:29:10.052337+0000","last_undegraded":"2024-09-18T01:29:10.052337+0000","last_fullsized":"2024-09-18T01:29:10.052337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:29:10.052252+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:29:10.052252+0000","last_clean_scrub_stamp":"2024-09-18T01:29:10.052252+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:56.273557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:23.963482+0000","last_change":"2024-09-18T01:29:23.963521+0000","last_active":"2024-09-18T01:29:23.963482+0000","last_peered":"2024-09-18T01:29:23.963482+0000","last_clean":"2024-09-18T01:29:23.963482+0000","last_became_active":"2024-09-18T01:25:06.687068+0000","last_became_peered":"2024-09-18T01:25:06.687068+0000","last_unstale":"2024-09-18T01:29:23.963482+0000","last_undegraded":"2024-09-18T01:29:23.963482+0000","last_fullsized":"2024-09-18T01:29:23.963482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:23.963371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:23.963371+0000","last_clean_scrub_stamp":"2024-09-18T01:29:23.963371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:04.048367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'10","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.112529+0000","last_change":"2024-09-18T01:29:01.112565+0000","last_active":"2024-09-18T01:29:01.112529+0000","last_peered":"2024-09-18T01:29:01.112529+0000","last_clean":"2024-09-18T01:29:01.112529+0000","last_became_active":"2024-09-18T01:25:08.685074+0000","last_became_peered":"2024-09-18T01:25:08.685074+0000","last_unstale":"2024-09-18T01:29:01.112529+0000","last_undegraded":"2024-09-18T01:29:01.112529+0000","last_fullsized":"2024-09-18T01:29:01.112529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-18T01:29:01.112427+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-18T01:29:01.112427+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.112427+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:56:10.526652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:08.841231+0000","last_change":"2024-09-18T01:29:08.841231+0000","last_active":"2024-09-18T01:29:08.841231+0000","last_peered":"2024-09-18T01:29:08.841231+0000","last_clean":"2024-09-18T01:29:08.841231+0000","last_became_active":"2024-09-18T01:25:06.690552+0000","last_became_peered":"2024-09-18T01:25:06.690552+0000","last_unstale":"2024-09-18T01:29:08.841231+0000","last_undegraded":"2024-09-18T01:29:08.841231+0000","last_fullsized":"2024-09-18T01:29:08.841231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:08.841069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:08.841069+0000","last_clean_scrub_stamp":"2024-09-18T01:29:08.841069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:57.396847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'8","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:09.074903+0000","last_change":"2024-09-18T01:29:09.074932+0000","last_active":"2024-09-18T01:29:09.074903+0000","last_peered":"2024-09-18T01:29:09.074903+0000","last_clean":"2024-09-18T01:29:09.074903+0000","last_became_active":"2024-09-18T01:25:08.674210+0000","last_became_peered":"2024-09-18T01:25:08.674210+0000","last_unstale":"2024-09-18T01:29:09.074903+0000","last_undegraded":"2024-09-18T01:29:09.074903+0000","last_fullsized":"2024-09-18T01:29:09.074903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:09.074810+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:09.074810+0000","last_clean_scrub_stamp":"2024-09-18T01:29:09.074810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:07:50.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.963269+0000","last_change":"2024-09-18T01:29:22.963305+0000","last_active":"2024-09-18T01:29:22.963269+0000","last_peered":"2024-09-18T01:29:22.963269+0000","last_clean":"2024-09-18T01:29:22.963269+0000","last_became_active":"2024-09-18T01:25:06.687608+0000","last_became_peered":"2024-09-18T01:25:06.687608+0000","last_unstale":"2024-09-18T01:29:22.963269+0000","last_undegraded":"2024-09-18T01:29:22.963269+0000","last_fullsized":"2024-09-18T01:29:22.963269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:22.963164+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:22.963164+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.963164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:38:37.098811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:07.382340+0000","last_change":"2024-09-18T01:29:07.382340+0000","last_active":"2024-09-18T01:29:07.382340+0000","last_peered":"2024-09-18T01:29:07.382340+0000","last_clean":"2024-09-18T01:29:07.382340+0000","last_became_active":"2024-09-18T01:25:08.683812+0000","last_became_peered":"2024-09-18T01:25:08.683812+0000","last_unstale":"2024-09-18T01:29:07.382340+0000","last_undegraded":"2024-09-18T01:29:07.382340+0000","last_fullsized":"2024-09-18T01:29:07.382340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:07.382155+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:07.382155+0000","last_clean_scrub_stamp":"2024-09-18T01:29:07.382155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:11:57.693419+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'6","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:06.799683+0000","last_change":"2024-09-18T01:29:06.799712+0000","last_active":"2024-09-18T01:29:06.799683+0000","last_peered":"2024-09-18T01:29:06.799683+0000","last_clean":"2024-09-18T01:29:06.799683+0000","last_became_active":"2024-09-18T01:25:06.702616+0000","last_became_peered":"2024-09-18T01:25:06.702616+0000","last_unstale":"2024-09-18T01:29:06.799683+0000","last_undegraded":"2024-09-18T01:29:06.799683+0000","last_fullsized":"2024-09-18T01:29:06.799683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:06.799588+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:06.799588+0000","last_clean_scrub_stamp":"2024-09-18T01:29:06.799588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:10:06.055871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'8","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:20.807158+0000","last_change":"2024-09-18T01:29:20.807158+0000","last_active":"2024-09-18T01:29:20.807158+0000","last_peered":"2024-09-18T01:29:20.807158+0000","last_clean":"2024-09-18T01:29:20.807158+0000","last_became_active":"2024-09-18T01:25:43.904427+0000","last_became_peered":"2024-09-18T01:25:43.904427+0000","last_unstale":"2024-09-18T01:29:20.807158+0000","last_undegraded":"2024-09-18T01:29:20.807158+0000","last_fullsized":"2024-09-18T01:29:20.807158+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:20.807032+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:20.807032+0000","last_clean_scrub_stamp":"2024-09-18T01:29:20.807032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:57.777645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:44.059117+0000","last_change":"2024-09-18T01:29:44.059143+0000","last_active":"2024-09-18T01:29:44.059117+0000","last_peered":"2024-09-18T01:29:44.059117+0000","last_clean":"2024-09-18T01:29:44.059117+0000","last_became_active":"2024-09-18T01:25:06.683195+0000","last_became_peered":"2024-09-18T01:25:06.683195+0000","last_unstale":"2024-09-18T01:29:44.059117+0000","last_undegraded":"2024-09-18T01:29:44.059117+0000","last_fullsized":"2024-09-18T01:29:44.059117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:44.059005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:44.059005+0000","last_clean_scrub_stamp":"2024-09-18T01:29:44.059005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:34:09.970378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.828610+0000","last_change":"2024-09-18T01:28:50.828610+0000","last_active":"2024-09-18T01:28:50.828610+0000","last_peered":"2024-09-18T01:28:50.828610+0000","last_clean":"2024-09-18T01:28:50.828610+0000","last_became_active":"2024-09-18T01:25:08.677579+0000","last_became_peered":"2024-09-18T01:25:08.677579+0000","last_unstale":"2024-09-18T01:28:50.828610+0000","last_undegraded":"2024-09-18T01:28:50.828610+0000","last_fullsized":"2024-09-18T01:28:50.828610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:50.828488+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:50.828488+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.828488+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:52.949299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:10.514429+0000","last_change":"2024-09-18T01:29:10.514429+0000","last_active":"2024-09-18T01:29:10.514429+0000","last_peered":"2024-09-18T01:29:10.514429+0000","last_clean":"2024-09-18T01:29:10.514429+0000","last_became_active":"2024-09-18T01:25:06.686049+0000","last_became_peered":"2024-09-18T01:25:06.686049+0000","last_unstale":"2024-09-18T01:29:10.514429+0000","last_undegraded":"2024-09-18T01:29:10.514429+0000","last_fullsized":"2024-09-18T01:29:10.514429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:10.514311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:10.514311+0000","last_clean_scrub_stamp":"2024-09-18T01:29:10.514311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:03.733247+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.902549+0000","last_change":"2024-09-18T01:29:15.902549+0000","last_active":"2024-09-18T01:29:15.902549+0000","last_peered":"2024-09-18T01:29:15.902549+0000","last_clean":"2024-09-18T01:29:15.902549+0000","last_became_active":"2024-09-18T01:25:08.676310+0000","last_became_peered":"2024-09-18T01:25:08.676310+0000","last_unstale":"2024-09-18T01:29:15.902549+0000","last_undegraded":"2024-09-18T01:29:15.902549+0000","last_fullsized":"2024-09-18T01:29:15.902549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:15.902400+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:15.902400+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.902400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:53:09.146964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'24","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:14.063497+0000","last_change":"2024-09-18T01:29:14.063497+0000","last_active":"2024-09-18T01:29:14.063497+0000","last_peered":"2024-09-18T01:29:14.063497+0000","last_clean":"2024-09-18T01:29:14.063497+0000","last_became_active":"2024-09-18T01:25:08.671858+0000","last_became_peered":"2024-09-18T01:25:08.671858+0000","last_unstale":"2024-09-18T01:29:14.063497+0000","last_undegraded":"2024-09-18T01:29:14.063497+0000","last_fullsized":"2024-09-18T01:29:14.063497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-09-18T01:29:14.063380+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-09-18T01:29:14.063380+0000","last_clean_scrub_stamp":"2024-09-18T01:29:14.063380+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:10.994209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":55,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:06.335526+0000","last_change":"2024-09-18T01:29:06.335526+0000","last_active":"2024-09-18T01:29:06.335526+0000","last_peered":"2024-09-18T01:29:06.335526+0000","last_clean":"2024-09-18T01:29:06.335526+0000","last_became_active":"2024-09-18T01:25:06.691034+0000","last_became_peered":"2024-09-18T01:25:06.691034+0000","last_unstale":"2024-09-18T01:29:06.335526+0000","last_undegraded":"2024-09-18T01:29:06.335526+0000","last_fullsized":"2024-09-18T01:29:06.335526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:06.335392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:06.335392+0000","last_clean_scrub_stamp":"2024-09-18T01:29:06.335392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:25:11.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:09.339656+0000","last_change":"2024-09-18T01:29:09.339656+0000","last_active":"2024-09-18T01:29:09.339656+0000","last_peered":"2024-09-18T01:29:09.339656+0000","last_clean":"2024-09-18T01:29:09.339656+0000","last_became_active":"2024-09-18T01:25:08.685043+0000","last_became_peered":"2024-09-18T01:25:08.685043+0000","last_unstale":"2024-09-18T01:29:09.339656+0000","last_undegraded":"2024-09-18T01:29:09.339656+0000","last_fullsized":"2024-09-18T01:29:09.339656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:09.339488+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:09.339488+0000","last_clean_scrub_stamp":"2024-09-18T01:29:09.339488+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:53:02.584051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.864648+0000","last_change":"2024-09-18T01:28:56.864648+0000","last_active":"2024-09-18T01:28:56.864648+0000","last_peered":"2024-09-18T01:28:56.864648+0000","last_clean":"2024-09-18T01:28:56.864648+0000","last_became_active":"2024-09-18T01:25:06.704414+0000","last_became_peered":"2024-09-18T01:25:06.704414+0000","last_unstale":"2024-09-18T01:28:56.864648+0000","last_undegraded":"2024-09-18T01:28:56.864648+0000","last_fullsized":"2024-09-18T01:28:56.864648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:56.864507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:56.864507+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.864507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:33.916587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:21.352155+0000","last_change":"2024-09-18T01:29:21.352155+0000","last_active":"2024-09-18T01:29:21.352155+0000","last_peered":"2024-09-18T01:29:21.352155+0000","last_clean":"2024-09-18T01:29:21.352155+0000","last_became_active":"2024-09-18T01:25:08.684921+0000","last_became_peered":"2024-09-18T01:25:08.684921+0000","last_unstale":"2024-09-18T01:29:21.352155+0000","last_undegraded":"2024-09-18T01:29:21.352155+0000","last_fullsized":"2024-09-18T01:29:21.352155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-18T01:29:21.352023+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-18T01:29:21.352023+0000","last_clean_scrub_stamp":"2024-09-18T01:29:21.352023+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:52:46.841207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'3","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:19.323237+0000","last_change":"2024-09-18T01:29:19.323237+0000","last_active":"2024-09-18T01:29:19.323237+0000","last_peered":"2024-09-18T01:29:19.323237+0000","last_clean":"2024-09-18T01:29:19.323237+0000","last_became_active":"2024-09-18T01:25:06.687737+0000","last_became_peered":"2024-09-18T01:25:06.687737+0000","last_unstale":"2024-09-18T01:29:19.323237+0000","last_undegraded":"2024-09-18T01:29:19.323237+0000","last_fullsized":"2024-09-18T01:29:19.323237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:29:19.323097+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:29:19.323097+0000","last_clean_scrub_stamp":"2024-09-18T01:29:19.323097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:46:52.157016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'16","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.462002+0000","last_change":"2024-09-18T01:28:57.462002+0000","last_active":"2024-09-18T01:28:57.462002+0000","last_peered":"2024-09-18T01:28:57.462002+0000","last_clean":"2024-09-18T01:28:57.462002+0000","last_became_active":"2024-09-18T01:25:08.671338+0000","last_became_peered":"2024-09-18T01:25:08.671338+0000","last_unstale":"2024-09-18T01:28:57.462002+0000","last_undegraded":"2024-09-18T01:28:57.462002+0000","last_fullsized":"2024-09-18T01:28:57.462002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-18T01:28:57.461821+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-18T01:28:57.461821+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.461821+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:42:49.435139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:12.322252+0000","last_change":"2024-09-18T01:29:12.322252+0000","last_active":"2024-09-18T01:29:12.322252+0000","last_peered":"2024-09-18T01:29:12.322252+0000","last_clean":"2024-09-18T01:29:12.322252+0000","last_became_active":"2024-09-18T01:25:06.688356+0000","last_became_peered":"2024-09-18T01:25:06.688356+0000","last_unstale":"2024-09-18T01:29:12.322252+0000","last_undegraded":"2024-09-18T01:29:12.322252+0000","last_fullsized":"2024-09-18T01:29:12.322252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:12.322091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:12.322091+0000","last_clean_scrub_stamp":"2024-09-18T01:29:12.322091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:12.845103+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.810589+0000","last_change":"2024-09-18T01:28:59.810589+0000","last_active":"2024-09-18T01:28:59.810589+0000","last_peered":"2024-09-18T01:28:59.810589+0000","last_clean":"2024-09-18T01:28:59.810589+0000","last_became_active":"2024-09-18T01:25:08.673915+0000","last_became_peered":"2024-09-18T01:25:08.673915+0000","last_unstale":"2024-09-18T01:28:59.810589+0000","last_undegraded":"2024-09-18T01:28:59.810589+0000","last_fullsized":"2024-09-18T01:28:59.810589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:59.810429+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:59.810429+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.810429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:41:53.505612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.441106+0000","last_change":"2024-09-18T01:29:04.441106+0000","last_active":"2024-09-18T01:29:04.441106+0000","last_peered":"2024-09-18T01:29:04.441106+0000","last_clean":"2024-09-18T01:29:04.441106+0000","last_became_active":"2024-09-18T01:25:06.686900+0000","last_became_peered":"2024-09-18T01:25:06.686900+0000","last_unstale":"2024-09-18T01:29:04.441106+0000","last_undegraded":"2024-09-18T01:29:04.441106+0000","last_fullsized":"2024-09-18T01:29:04.441106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:04.440953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:04.440953+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.440953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:10.843955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'6","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.177149+0000","last_change":"2024-09-18T01:28:57.177149+0000","last_active":"2024-09-18T01:28:57.177149+0000","last_peered":"2024-09-18T01:28:57.177149+0000","last_clean":"2024-09-18T01:28:57.177149+0000","last_became_active":"2024-09-18T01:25:08.682225+0000","last_became_peered":"2024-09-18T01:25:08.682225+0000","last_unstale":"2024-09-18T01:28:57.177149+0000","last_undegraded":"2024-09-18T01:28:57.177149+0000","last_fullsized":"2024-09-18T01:28:57.177149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:57.176987+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:57.176987+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.176987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:15.711498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:45.045635+0000","last_change":"2024-09-18T01:29:45.045635+0000","last_active":"2024-09-18T01:29:45.045635+0000","last_peered":"2024-09-18T01:29:45.045635+0000","last_clean":"2024-09-18T01:29:45.045635+0000","last_became_active":"2024-09-18T01:25:06.693647+0000","last_became_peered":"2024-09-18T01:25:06.693647+0000","last_unstale":"2024-09-18T01:29:45.045635+0000","last_undegraded":"2024-09-18T01:29:45.045635+0000","last_fullsized":"2024-09-18T01:29:45.045635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:45.045510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:45.045510+0000","last_clean_scrub_stamp":"2024-09-18T01:29:45.045510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:31:50.748540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'36","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:24.468568+0000","last_change":"2024-09-18T01:29:24.468601+0000","last_active":"2024-09-18T01:29:24.468568+0000","last_peered":"2024-09-18T01:29:24.468568+0000","last_clean":"2024-09-18T01:29:24.468568+0000","last_became_active":"2024-09-18T01:25:16.712438+0000","last_became_peered":"2024-09-18T01:25:16.712438+0000","last_unstale":"2024-09-18T01:29:24.468568+0000","last_undegraded":"2024-09-18T01:29:24.468568+0000","last_fullsized":"2024-09-18T01:29:24.468568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-18T01:29:24.468472+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-18T01:29:24.468472+0000","last_clean_scrub_stamp":"2024-09-18T01:29:24.468472+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:50.839508+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:12.042182+0000","last_change":"2024-09-18T01:29:12.042182+0000","last_active":"2024-09-18T01:29:12.042182+0000","last_peered":"2024-09-18T01:29:12.042182+0000","last_clean":"2024-09-18T01:29:12.042182+0000","last_became_active":"2024-09-18T01:25:08.673605+0000","last_became_peered":"2024-09-18T01:25:08.673605+0000","last_unstale":"2024-09-18T01:29:12.042182+0000","last_undegraded":"2024-09-18T01:29:12.042182+0000","last_fullsized":"2024-09-18T01:29:12.042182+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-18T01:29:12.042027+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-18T01:29:12.042027+0000","last_clean_scrub_stamp":"2024-09-18T01:29:12.042027+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:46:44.157159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.006342+0000","last_change":"2024-09-18T01:29:22.006342+0000","last_active":"2024-09-18T01:29:22.006342+0000","last_peered":"2024-09-18T01:29:22.006342+0000","last_clean":"2024-09-18T01:29:22.006342+0000","last_became_active":"2024-09-18T01:25:06.685173+0000","last_became_peered":"2024-09-18T01:25:06.685173+0000","last_unstale":"2024-09-18T01:29:22.006342+0000","last_undegraded":"2024-09-18T01:29:22.006342+0000","last_fullsized":"2024-09-18T01:29:22.006342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:22.006222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:22.006222+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.006222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:40:54.716533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.112996+0000","last_change":"2024-09-18T01:28:31.112996+0000","last_active":"2024-09-18T01:28:31.112996+0000","last_peered":"2024-09-18T01:28:31.112996+0000","last_clean":"2024-09-18T01:28:31.112996+0000","last_became_active":"2024-09-18T01:25:10.684454+0000","last_became_peered":"2024-09-18T01:25:10.684454+0000","last_unstale":"2024-09-18T01:28:31.112996+0000","last_undegraded":"2024-09-18T01:28:31.112996+0000","last_fullsized":"2024-09-18T01:28:31.112996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.112838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.112838+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.112838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:47:30.069158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'50","reported_seq":118,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.035364+0000","last_change":"2024-09-18T01:28:47.035364+0000","last_active":"2024-09-18T01:28:47.035364+0000","last_peered":"2024-09-18T01:28:47.035364+0000","last_clean":"2024-09-18T01:28:47.035364+0000","last_became_active":"2024-09-18T01:25:12.692059+0000","last_became_peered":"2024-09-18T01:25:12.692059+0000","last_unstale":"2024-09-18T01:28:47.035364+0000","last_undegraded":"2024-09-18T01:28:47.035364+0000","last_fullsized":"2024-09-18T01:28:47.035364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'50","last_scrub_stamp":"2024-09-18T01:28:47.035239+0000","last_deep_scrub":"35'50","last_deep_scrub_stamp":"2024-09-18T01:28:47.035239+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.035239+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:17:16.348705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.307427+0000","last_change":"2024-09-18T01:28:47.307427+0000","last_active":"2024-09-18T01:28:47.307427+0000","last_peered":"2024-09-18T01:28:47.307427+0000","last_clean":"2024-09-18T01:28:47.307427+0000","last_became_active":"2024-09-18T01:25:14.709879+0000","last_became_peered":"2024-09-18T01:25:14.709879+0000","last_unstale":"2024-09-18T01:28:47.307427+0000","last_undegraded":"2024-09-18T01:28:47.307427+0000","last_fullsized":"2024-09-18T01:28:47.307427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:47.307314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:47.307314+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.307314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:14:14.624869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:23.422289+0000","last_change":"2024-09-18T01:29:23.422317+0000","last_active":"2024-09-18T01:29:23.422289+0000","last_peered":"2024-09-18T01:29:23.422289+0000","last_clean":"2024-09-18T01:29:23.422289+0000","last_became_active":"2024-09-18T01:25:16.711764+0000","last_became_peered":"2024-09-18T01:25:16.711764+0000","last_unstale":"2024-09-18T01:29:23.422289+0000","last_undegraded":"2024-09-18T01:29:23.422289+0000","last_fullsized":"2024-09-18T01:29:23.422289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:29:23.422205+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:29:23.422205+0000","last_clean_scrub_stamp":"2024-09-18T01:29:23.422205+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:13.289594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:18.855001+0000","last_change":"2024-09-18T01:29:18.855070+0000","last_active":"2024-09-18T01:29:18.855001+0000","last_peered":"2024-09-18T01:29:18.855001+0000","last_clean":"2024-09-18T01:29:18.855001+0000","last_became_active":"2024-09-18T01:25:43.848631+0000","last_became_peered":"2024-09-18T01:25:43.848631+0000","last_unstale":"2024-09-18T01:29:18.855001+0000","last_undegraded":"2024-09-18T01:29:18.855001+0000","last_fullsized":"2024-09-18T01:29:18.855001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:18.854897+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:18.854897+0000","last_clean_scrub_stamp":"2024-09-18T01:29:18.854897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:19.377910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:09.885855+0000","last_change":"2024-09-18T01:29:09.885855+0000","last_active":"2024-09-18T01:29:09.885855+0000","last_peered":"2024-09-18T01:29:09.885855+0000","last_clean":"2024-09-18T01:29:09.885855+0000","last_became_active":"2024-09-18T01:25:06.690813+0000","last_became_peered":"2024-09-18T01:25:06.690813+0000","last_unstale":"2024-09-18T01:29:09.885855+0000","last_undegraded":"2024-09-18T01:29:09.885855+0000","last_fullsized":"2024-09-18T01:29:09.885855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:09.885735+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:09.885735+0000","last_clean_scrub_stamp":"2024-09-18T01:29:09.885735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:54.303235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.568158+0000","last_change":"2024-09-18T01:28:48.568158+0000","last_active":"2024-09-18T01:28:48.568158+0000","last_peered":"2024-09-18T01:28:48.568158+0000","last_clean":"2024-09-18T01:28:48.568158+0000","last_became_active":"2024-09-18T01:25:10.677226+0000","last_became_peered":"2024-09-18T01:25:10.677226+0000","last_unstale":"2024-09-18T01:28:48.568158+0000","last_undegraded":"2024-09-18T01:28:48.568158+0000","last_fullsized":"2024-09-18T01:28:48.568158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:48.568063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:48.568063+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.568063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:31.051544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'17","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.394506+0000","last_change":"2024-09-18T01:28:30.394506+0000","last_active":"2024-09-18T01:28:30.394506+0000","last_peered":"2024-09-18T01:28:30.394506+0000","last_clean":"2024-09-18T01:28:30.394506+0000","last_became_active":"2024-09-18T01:25:12.688366+0000","last_became_peered":"2024-09-18T01:25:12.688366+0000","last_unstale":"2024-09-18T01:28:30.394506+0000","last_undegraded":"2024-09-18T01:28:30.394506+0000","last_fullsized":"2024-09-18T01:28:30.394506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-18T01:28:30.394314+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-18T01:28:30.394314+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.394314+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:51.126406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.435372+0000","last_change":"2024-09-18T01:28:31.435372+0000","last_active":"2024-09-18T01:28:31.435372+0000","last_peered":"2024-09-18T01:28:31.435372+0000","last_clean":"2024-09-18T01:28:31.435372+0000","last_became_active":"2024-09-18T01:25:14.702918+0000","last_became_peered":"2024-09-18T01:25:14.702918+0000","last_unstale":"2024-09-18T01:28:31.435372+0000","last_undegraded":"2024-09-18T01:28:31.435372+0000","last_fullsized":"2024-09-18T01:28:31.435372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.435257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.435257+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.435257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:21.639639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'7","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:23.506256+0000","last_change":"2024-09-18T01:29:23.506302+0000","last_active":"2024-09-18T01:29:23.506256+0000","last_peered":"2024-09-18T01:29:23.506256+0000","last_clean":"2024-09-18T01:29:23.506256+0000","last_became_active":"2024-09-18T01:25:16.713571+0000","last_became_peered":"2024-09-18T01:25:16.713571+0000","last_unstale":"2024-09-18T01:29:23.506256+0000","last_undegraded":"2024-09-18T01:29:23.506256+0000","last_fullsized":"2024-09-18T01:29:23.506256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:29:23.506126+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:29:23.506126+0000","last_clean_scrub_stamp":"2024-09-18T01:29:23.506126+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:32:33.295833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'8","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:13.079505+0000","last_change":"2024-09-18T01:29:13.079505+0000","last_active":"2024-09-18T01:29:13.079505+0000","last_peered":"2024-09-18T01:29:13.079505+0000","last_clean":"2024-09-18T01:29:13.079505+0000","last_became_active":"2024-09-18T01:25:08.671904+0000","last_became_peered":"2024-09-18T01:25:08.671904+0000","last_unstale":"2024-09-18T01:29:13.079505+0000","last_undegraded":"2024-09-18T01:29:13.079505+0000","last_fullsized":"2024-09-18T01:29:13.079505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:13.079378+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:13.079378+0000","last_clean_scrub_stamp":"2024-09-18T01:29:13.079378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:15:05.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:42.063475+0000","last_change":"2024-09-18T01:29:42.063475+0000","last_active":"2024-09-18T01:29:42.063475+0000","last_peered":"2024-09-18T01:29:42.063475+0000","last_clean":"2024-09-18T01:29:42.063475+0000","last_became_active":"2024-09-18T01:25:06.681065+0000","last_became_peered":"2024-09-18T01:25:06.681065+0000","last_unstale":"2024-09-18T01:29:42.063475+0000","last_undegraded":"2024-09-18T01:29:42.063475+0000","last_fullsized":"2024-09-18T01:29:42.063475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:42.063326+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:42.063326+0000","last_clean_scrub_stamp":"2024-09-18T01:29:42.063326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:48:54.754100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.538567+0000","last_change":"2024-09-18T01:28:49.538567+0000","last_active":"2024-09-18T01:28:49.538567+0000","last_peered":"2024-09-18T01:28:49.538567+0000","last_clean":"2024-09-18T01:28:49.538567+0000","last_became_active":"2024-09-18T01:25:10.677118+0000","last_became_peered":"2024-09-18T01:25:10.677118+0000","last_unstale":"2024-09-18T01:28:49.538567+0000","last_undegraded":"2024-09-18T01:28:49.538567+0000","last_fullsized":"2024-09-18T01:28:49.538567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:49.538452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:49.538452+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.538452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:45.840473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'29","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.676691+0000","last_change":"2024-09-18T01:28:36.676691+0000","last_active":"2024-09-18T01:28:36.676691+0000","last_peered":"2024-09-18T01:28:36.676691+0000","last_clean":"2024-09-18T01:28:36.676691+0000","last_became_active":"2024-09-18T01:25:12.693426+0000","last_became_peered":"2024-09-18T01:25:12.693426+0000","last_unstale":"2024-09-18T01:28:36.676691+0000","last_undegraded":"2024-09-18T01:28:36.676691+0000","last_fullsized":"2024-09-18T01:28:36.676691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'29","last_scrub_stamp":"2024-09-18T01:28:36.676525+0000","last_deep_scrub":"35'29","last_deep_scrub_stamp":"2024-09-18T01:28:36.676525+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.676525+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:10.438462+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'286","reported_seq":395,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.005433+0000","last_change":"2024-09-18T01:28:55.005433+0000","last_active":"2024-09-18T01:28:55.005433+0000","last_peered":"2024-09-18T01:28:55.005433+0000","last_clean":"2024-09-18T01:28:55.005433+0000","last_became_active":"2024-09-18T01:25:14.707544+0000","last_became_peered":"2024-09-18T01:25:14.707544+0000","last_unstale":"2024-09-18T01:28:55.005433+0000","last_undegraded":"2024-09-18T01:28:55.005433+0000","last_fullsized":"2024-09-18T01:28:55.005433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-09-18T01:28:55.005253+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-09-18T01:28:55.005253+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.005253+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:36.156462+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.798041+0000","last_change":"2024-09-18T01:28:49.798066+0000","last_active":"2024-09-18T01:28:49.798041+0000","last_peered":"2024-09-18T01:28:49.798041+0000","last_clean":"2024-09-18T01:28:49.798041+0000","last_became_active":"2024-09-18T01:25:16.713458+0000","last_became_peered":"2024-09-18T01:25:16.713458+0000","last_unstale":"2024-09-18T01:28:49.798041+0000","last_undegraded":"2024-09-18T01:28:49.798041+0000","last_fullsized":"2024-09-18T01:28:49.798041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:49.797948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:49.797948+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.797948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:24:57.198351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.439235+0000","last_change":"2024-09-18T01:28:56.439235+0000","last_active":"2024-09-18T01:28:56.439235+0000","last_peered":"2024-09-18T01:28:56.439235+0000","last_clean":"2024-09-18T01:28:56.439235+0000","last_became_active":"2024-09-18T01:25:08.680700+0000","last_became_peered":"2024-09-18T01:25:08.680700+0000","last_unstale":"2024-09-18T01:28:56.439235+0000","last_undegraded":"2024-09-18T01:28:56.439235+0000","last_fullsized":"2024-09-18T01:28:56.439235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:28:56.439096+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:28:56.439096+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.439096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:40:37.562803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:08.369913+0000","last_change":"2024-09-18T01:29:08.369913+0000","last_active":"2024-09-18T01:29:08.369913+0000","last_peered":"2024-09-18T01:29:08.369913+0000","last_clean":"2024-09-18T01:29:08.369913+0000","last_became_active":"2024-09-18T01:25:06.691107+0000","last_became_peered":"2024-09-18T01:25:06.691107+0000","last_unstale":"2024-09-18T01:29:08.369913+0000","last_undegraded":"2024-09-18T01:29:08.369913+0000","last_fullsized":"2024-09-18T01:29:08.369913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:08.369779+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:08.369779+0000","last_clean_scrub_stamp":"2024-09-18T01:29:08.369779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:36:40.011470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.094004+0000","last_change":"2024-09-18T01:28:36.094004+0000","last_active":"2024-09-18T01:28:36.094004+0000","last_peered":"2024-09-18T01:28:36.094004+0000","last_clean":"2024-09-18T01:28:36.094004+0000","last_became_active":"2024-09-18T01:25:10.681273+0000","last_became_peered":"2024-09-18T01:25:10.681273+0000","last_unstale":"2024-09-18T01:28:36.094004+0000","last_undegraded":"2024-09-18T01:28:36.094004+0000","last_fullsized":"2024-09-18T01:28:36.094004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:36.093832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:36.093832+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.093832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:01.927384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'46","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.714630+0000","last_change":"2024-09-18T01:28:34.714630+0000","last_active":"2024-09-18T01:28:34.714630+0000","last_peered":"2024-09-18T01:28:34.714630+0000","last_clean":"2024-09-18T01:28:34.714630+0000","last_became_active":"2024-09-18T01:25:12.697114+0000","last_became_peered":"2024-09-18T01:25:12.697114+0000","last_unstale":"2024-09-18T01:28:34.714630+0000","last_undegraded":"2024-09-18T01:28:34.714630+0000","last_fullsized":"2024-09-18T01:28:34.714630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:34.714456+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:34.714456+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.714456+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:50.227668+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":61,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":418,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.646333+0000","last_change":"2024-09-18T01:28:32.646333+0000","last_active":"2024-09-18T01:28:32.646333+0000","last_peered":"2024-09-18T01:28:32.646333+0000","last_clean":"2024-09-18T01:28:32.646333+0000","last_became_active":"2024-09-18T01:25:14.698792+0000","last_became_peered":"2024-09-18T01:25:14.698792+0000","last_unstale":"2024-09-18T01:28:32.646333+0000","last_undegraded":"2024-09-18T01:28:32.646333+0000","last_fullsized":"2024-09-18T01:28:32.646333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:32.646216+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:32.646216+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.646216+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:58:39.844651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:05.092180+0000","last_change":"2024-09-18T01:29:05.092180+0000","last_active":"2024-09-18T01:29:05.092180+0000","last_peered":"2024-09-18T01:29:05.092180+0000","last_clean":"2024-09-18T01:29:05.092180+0000","last_became_active":"2024-09-18T01:25:08.680143+0000","last_became_peered":"2024-09-18T01:25:08.680143+0000","last_unstale":"2024-09-18T01:29:05.092180+0000","last_undegraded":"2024-09-18T01:29:05.092180+0000","last_fullsized":"2024-09-18T01:29:05.092180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:05.092029+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:05.092029+0000","last_clean_scrub_stamp":"2024-09-18T01:29:05.092029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:55:27.777779+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:14.882963+0000","last_change":"2024-09-18T01:29:14.882963+0000","last_active":"2024-09-18T01:29:14.882963+0000","last_peered":"2024-09-18T01:29:14.882963+0000","last_clean":"2024-09-18T01:29:14.882963+0000","last_became_active":"2024-09-18T01:25:06.700650+0000","last_became_peered":"2024-09-18T01:25:06.700650+0000","last_unstale":"2024-09-18T01:29:14.882963+0000","last_undegraded":"2024-09-18T01:29:14.882963+0000","last_fullsized":"2024-09-18T01:29:14.882963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:14.882819+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:14.882819+0000","last_clean_scrub_stamp":"2024-09-18T01:29:14.882819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:11:27.887379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.335266+0000","last_change":"2024-09-18T01:28:37.335266+0000","last_active":"2024-09-18T01:28:37.335266+0000","last_peered":"2024-09-18T01:28:37.335266+0000","last_clean":"2024-09-18T01:28:37.335266+0000","last_became_active":"2024-09-18T01:25:10.683195+0000","last_became_peered":"2024-09-18T01:25:10.683195+0000","last_unstale":"2024-09-18T01:28:37.335266+0000","last_undegraded":"2024-09-18T01:28:37.335266+0000","last_fullsized":"2024-09-18T01:28:37.335266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:37.335139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:37.335139+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.335139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:26.770573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'59","reported_seq":126,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.709650+0000","last_change":"2024-09-18T01:28:38.709650+0000","last_active":"2024-09-18T01:28:38.709650+0000","last_peered":"2024-09-18T01:28:38.709650+0000","last_clean":"2024-09-18T01:28:38.709650+0000","last_became_active":"2024-09-18T01:25:12.687943+0000","last_became_peered":"2024-09-18T01:25:12.687943+0000","last_unstale":"2024-09-18T01:28:38.709650+0000","last_undegraded":"2024-09-18T01:28:38.709650+0000","last_fullsized":"2024-09-18T01:28:38.709650+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'59","last_scrub_stamp":"2024-09-18T01:28:38.709506+0000","last_deep_scrub":"35'59","last_deep_scrub_stamp":"2024-09-18T01:28:38.709506+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.709506+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:03.906269+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.615199+0000","last_change":"2024-09-18T01:28:33.615199+0000","last_active":"2024-09-18T01:28:33.615199+0000","last_peered":"2024-09-18T01:28:33.615199+0000","last_clean":"2024-09-18T01:28:33.615199+0000","last_became_active":"2024-09-18T01:25:14.698795+0000","last_became_peered":"2024-09-18T01:25:14.698795+0000","last_unstale":"2024-09-18T01:28:33.615199+0000","last_undegraded":"2024-09-18T01:28:33.615199+0000","last_fullsized":"2024-09-18T01:28:33.615199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:33.615076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:33.615076+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.615076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:23.050510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'3","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.709545+0000","last_change":"2024-09-18T01:28:37.709545+0000","last_active":"2024-09-18T01:28:37.709545+0000","last_peered":"2024-09-18T01:28:37.709545+0000","last_clean":"2024-09-18T01:28:37.709545+0000","last_became_active":"2024-09-18T01:25:16.707206+0000","last_became_peered":"2024-09-18T01:25:16.707206+0000","last_unstale":"2024-09-18T01:28:37.709545+0000","last_undegraded":"2024-09-18T01:28:37.709545+0000","last_fullsized":"2024-09-18T01:28:37.709545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:28:37.709423+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:28:37.709423+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.709423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:50:03.029261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.305009+0000","last_change":"2024-09-18T01:29:01.305009+0000","last_active":"2024-09-18T01:29:01.305009+0000","last_peered":"2024-09-18T01:29:01.305009+0000","last_clean":"2024-09-18T01:29:01.305009+0000","last_became_active":"2024-09-18T01:25:08.682878+0000","last_became_peered":"2024-09-18T01:25:08.682878+0000","last_unstale":"2024-09-18T01:29:01.305009+0000","last_undegraded":"2024-09-18T01:29:01.305009+0000","last_fullsized":"2024-09-18T01:29:01.305009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:01.304883+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:01.304883+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.304883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:08.393205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:13.892430+0000","last_change":"2024-09-18T01:29:13.892430+0000","last_active":"2024-09-18T01:29:13.892430+0000","last_peered":"2024-09-18T01:29:13.892430+0000","last_clean":"2024-09-18T01:29:13.892430+0000","last_became_active":"2024-09-18T01:25:06.700357+0000","last_became_peered":"2024-09-18T01:25:06.700357+0000","last_unstale":"2024-09-18T01:29:13.892430+0000","last_undegraded":"2024-09-18T01:29:13.892430+0000","last_fullsized":"2024-09-18T01:29:13.892430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:13.892307+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:13.892307+0000","last_clean_scrub_stamp":"2024-09-18T01:29:13.892307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:12:04.203571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"35'2","reported_seq":231,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:45.605224+0000","last_change":"2024-09-18T01:28:45.605224+0000","last_active":"2024-09-18T01:28:45.605224+0000","last_peered":"2024-09-18T01:28:45.605224+0000","last_clean":"2024-09-18T01:28:45.605224+0000","last_became_active":"2024-09-18T01:25:10.679652+0000","last_became_peered":"2024-09-18T01:25:10.679652+0000","last_unstale":"2024-09-18T01:28:45.605224+0000","last_undegraded":"2024-09-18T01:28:45.605224+0000","last_fullsized":"2024-09-18T01:28:45.605224+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:45.605047+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:45.605047+0000","last_clean_scrub_stamp":"2024-09-18T01:28:45.605047+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:05:23.022870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'43","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.069454+0000","last_change":"2024-09-18T01:28:33.069454+0000","last_active":"2024-09-18T01:28:33.069454+0000","last_peered":"2024-09-18T01:28:33.069454+0000","last_clean":"2024-09-18T01:28:33.069454+0000","last_became_active":"2024-09-18T01:25:12.691691+0000","last_became_peered":"2024-09-18T01:25:12.691691+0000","last_unstale":"2024-09-18T01:28:33.069454+0000","last_undegraded":"2024-09-18T01:28:33.069454+0000","last_fullsized":"2024-09-18T01:28:33.069454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'43","last_scrub_stamp":"2024-09-18T01:28:33.069322+0000","last_deep_scrub":"35'43","last_deep_scrub_stamp":"2024-09-18T01:28:33.069322+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.069322+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:48.566800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.665641+0000","last_change":"2024-09-18T01:28:29.665641+0000","last_active":"2024-09-18T01:28:29.665641+0000","last_peered":"2024-09-18T01:28:29.665641+0000","last_clean":"2024-09-18T01:28:29.665641+0000","last_became_active":"2024-09-18T01:25:14.706505+0000","last_became_peered":"2024-09-18T01:25:14.706505+0000","last_unstale":"2024-09-18T01:28:29.665641+0000","last_undegraded":"2024-09-18T01:28:29.665641+0000","last_fullsized":"2024-09-18T01:28:29.665641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.665468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.665468+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.665468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:49:54.985306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'4","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:26.499974+0000","last_change":"2024-09-18T01:29:26.499974+0000","last_active":"2024-09-18T01:29:26.499974+0000","last_peered":"2024-09-18T01:29:26.499974+0000","last_clean":"2024-09-18T01:29:26.499974+0000","last_became_active":"2024-09-18T01:25:16.713453+0000","last_became_peered":"2024-09-18T01:25:16.713453+0000","last_unstale":"2024-09-18T01:29:26.499974+0000","last_undegraded":"2024-09-18T01:29:26.499974+0000","last_fullsized":"2024-09-18T01:29:26.499974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:26.499843+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:26.499843+0000","last_clean_scrub_stamp":"2024-09-18T01:29:26.499843+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:32:36.289550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.807348+0000","last_change":"2024-09-18T01:29:03.807348+0000","last_active":"2024-09-18T01:29:03.807348+0000","last_peered":"2024-09-18T01:29:03.807348+0000","last_clean":"2024-09-18T01:29:03.807348+0000","last_became_active":"2024-09-18T01:25:08.674525+0000","last_became_peered":"2024-09-18T01:25:08.674525+0000","last_unstale":"2024-09-18T01:29:03.807348+0000","last_undegraded":"2024-09-18T01:29:03.807348+0000","last_fullsized":"2024-09-18T01:29:03.807348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:03.807231+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:03.807231+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.807231+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:06:51.447638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:16.988304+0000","last_change":"2024-09-18T01:29:16.988304+0000","last_active":"2024-09-18T01:29:16.988304+0000","last_peered":"2024-09-18T01:29:16.988304+0000","last_clean":"2024-09-18T01:29:16.988304+0000","last_became_active":"2024-09-18T01:25:06.694058+0000","last_became_peered":"2024-09-18T01:25:06.694058+0000","last_unstale":"2024-09-18T01:29:16.988304+0000","last_undegraded":"2024-09-18T01:29:16.988304+0000","last_fullsized":"2024-09-18T01:29:16.988304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:16.988182+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:16.988182+0000","last_clean_scrub_stamp":"2024-09-18T01:29:16.988182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:28:36.102353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:19.818585+0000","last_change":"2024-09-18T01:29:19.818621+0000","last_active":"2024-09-18T01:29:19.818585+0000","last_peered":"2024-09-18T01:29:19.818585+0000","last_clean":"2024-09-18T01:29:19.818585+0000","last_became_active":"2024-09-18T01:25:43.903638+0000","last_became_peered":"2024-09-18T01:25:43.903638+0000","last_unstale":"2024-09-18T01:29:19.818585+0000","last_undegraded":"2024-09-18T01:29:19.818585+0000","last_fullsized":"2024-09-18T01:29:19.818585+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:19.818447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:19.818447+0000","last_clean_scrub_stamp":"2024-09-18T01:29:19.818447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:13.037383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'60","reported_seq":131,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.055969+0000","last_change":"2024-09-18T01:28:54.055969+0000","last_active":"2024-09-18T01:28:54.055969+0000","last_peered":"2024-09-18T01:28:54.055969+0000","last_clean":"2024-09-18T01:28:54.055969+0000","last_became_active":"2024-09-18T01:25:12.693182+0000","last_became_peered":"2024-09-18T01:25:12.693182+0000","last_unstale":"2024-09-18T01:28:54.055969+0000","last_undegraded":"2024-09-18T01:28:54.055969+0000","last_fullsized":"2024-09-18T01:28:54.055969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'60","last_scrub_stamp":"2024-09-18T01:28:54.055805+0000","last_deep_scrub":"35'60","last_deep_scrub_stamp":"2024-09-18T01:28:54.055805+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.055805+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:07.480785+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":361,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.671899+0000","last_change":"2024-09-18T01:28:28.671899+0000","last_active":"2024-09-18T01:28:28.671899+0000","last_peered":"2024-09-18T01:28:28.671899+0000","last_clean":"2024-09-18T01:28:28.671899+0000","last_became_active":"2024-09-18T01:25:14.706540+0000","last_became_peered":"2024-09-18T01:25:14.706540+0000","last_unstale":"2024-09-18T01:28:28.671899+0000","last_undegraded":"2024-09-18T01:28:28.671899+0000","last_fullsized":"2024-09-18T01:28:28.671899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:28.671739+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:28.671739+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.671739+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:02.156270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:27.509135+0000","last_change":"2024-09-18T01:29:27.509135+0000","last_active":"2024-09-18T01:29:27.509135+0000","last_peered":"2024-09-18T01:29:27.509135+0000","last_clean":"2024-09-18T01:29:27.509135+0000","last_became_active":"2024-09-18T01:25:16.714363+0000","last_became_peered":"2024-09-18T01:25:16.714363+0000","last_unstale":"2024-09-18T01:29:27.509135+0000","last_undegraded":"2024-09-18T01:29:27.509135+0000","last_fullsized":"2024-09-18T01:29:27.509135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:27.508960+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:27.508960+0000","last_clean_scrub_stamp":"2024-09-18T01:29:27.508960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:14:05.164814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'4","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.853852+0000","last_change":"2024-09-18T01:28:55.853852+0000","last_active":"2024-09-18T01:28:55.853852+0000","last_peered":"2024-09-18T01:28:55.853852+0000","last_clean":"2024-09-18T01:28:55.853852+0000","last_became_active":"2024-09-18T01:25:08.670617+0000","last_became_peered":"2024-09-18T01:25:08.670617+0000","last_unstale":"2024-09-18T01:28:55.853852+0000","last_undegraded":"2024-09-18T01:28:55.853852+0000","last_fullsized":"2024-09-18T01:28:55.853852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:55.853740+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:55.853740+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.853740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:37:55.765115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:28.958546+0000","last_change":"2024-09-18T01:29:28.958546+0000","last_active":"2024-09-18T01:29:28.958546+0000","last_peered":"2024-09-18T01:29:28.958546+0000","last_clean":"2024-09-18T01:29:28.958546+0000","last_became_active":"2024-09-18T01:25:06.689545+0000","last_became_peered":"2024-09-18T01:25:06.689545+0000","last_unstale":"2024-09-18T01:29:28.958546+0000","last_undegraded":"2024-09-18T01:29:28.958546+0000","last_fullsized":"2024-09-18T01:29:28.958546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:28.958426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:28.958426+0000","last_clean_scrub_stamp":"2024-09-18T01:29:28.958426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:38:45.450412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:21.809086+0000","last_change":"2024-09-18T01:29:21.809086+0000","last_active":"2024-09-18T01:29:21.809086+0000","last_peered":"2024-09-18T01:29:21.809086+0000","last_clean":"2024-09-18T01:29:21.809086+0000","last_became_active":"2024-09-18T01:25:43.907094+0000","last_became_peered":"2024-09-18T01:25:43.907094+0000","last_unstale":"2024-09-18T01:29:21.809086+0000","last_undegraded":"2024-09-18T01:29:21.809086+0000","last_fullsized":"2024-09-18T01:29:21.809086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:21.808965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:21.808965+0000","last_clean_scrub_stamp":"2024-09-18T01:29:21.808965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:05:46.175533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'81","reported_seq":167,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.022879+0000","last_change":"2024-09-18T01:28:57.022879+0000","last_active":"2024-09-18T01:28:57.022879+0000","last_peered":"2024-09-18T01:28:57.022879+0000","last_clean":"2024-09-18T01:28:57.022879+0000","last_became_active":"2024-09-18T01:25:12.692821+0000","last_became_peered":"2024-09-18T01:25:12.692821+0000","last_unstale":"2024-09-18T01:28:57.022879+0000","last_undegraded":"2024-09-18T01:28:57.022879+0000","last_fullsized":"2024-09-18T01:28:57.022879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'81","last_scrub_stamp":"2024-09-18T01:28:57.022705+0000","last_deep_scrub":"35'81","last_deep_scrub_stamp":"2024-09-18T01:28:57.022705+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.022705+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:33.670619+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":84,"num_read_kb":81,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.550677+0000","last_change":"2024-09-18T01:28:47.550677+0000","last_active":"2024-09-18T01:28:47.550677+0000","last_peered":"2024-09-18T01:28:47.550677+0000","last_clean":"2024-09-18T01:28:47.550677+0000","last_became_active":"2024-09-18T01:25:14.707514+0000","last_became_peered":"2024-09-18T01:25:14.707514+0000","last_unstale":"2024-09-18T01:28:47.550677+0000","last_undegraded":"2024-09-18T01:28:47.550677+0000","last_fullsized":"2024-09-18T01:28:47.550677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:47.550559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:47.550559+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.550559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:14:27.993350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'21","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.535536+0000","last_change":"2024-09-18T01:29:22.535536+0000","last_active":"2024-09-18T01:29:22.535536+0000","last_peered":"2024-09-18T01:29:22.535536+0000","last_clean":"2024-09-18T01:29:22.535536+0000","last_became_active":"2024-09-18T01:25:16.705938+0000","last_became_peered":"2024-09-18T01:25:16.705938+0000","last_unstale":"2024-09-18T01:29:22.535536+0000","last_undegraded":"2024-09-18T01:29:22.535536+0000","last_fullsized":"2024-09-18T01:29:22.535536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-09-18T01:29:22.535413+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-09-18T01:29:22.535413+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.535413+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:20.985121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.222874+0000","last_change":"2024-09-18T01:28:49.222874+0000","last_active":"2024-09-18T01:28:49.222874+0000","last_peered":"2024-09-18T01:28:49.222874+0000","last_clean":"2024-09-18T01:28:49.222874+0000","last_became_active":"2024-09-18T01:25:08.687135+0000","last_became_peered":"2024-09-18T01:25:08.687135+0000","last_unstale":"2024-09-18T01:28:49.222874+0000","last_undegraded":"2024-09-18T01:28:49.222874+0000","last_fullsized":"2024-09-18T01:28:49.222874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:49.222741+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:49.222741+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.222741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:14.553771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:16.453033+0000","last_change":"2024-09-18T01:29:16.453033+0000","last_active":"2024-09-18T01:29:16.453033+0000","last_peered":"2024-09-18T01:29:16.453033+0000","last_clean":"2024-09-18T01:29:16.453033+0000","last_became_active":"2024-09-18T01:25:06.680774+0000","last_became_peered":"2024-09-18T01:25:06.680774+0000","last_unstale":"2024-09-18T01:29:16.453033+0000","last_undegraded":"2024-09-18T01:29:16.453033+0000","last_fullsized":"2024-09-18T01:29:16.453033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:16.452922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:16.452922+0000","last_clean_scrub_stamp":"2024-09-18T01:29:16.452922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:46:49.286842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.752267+0000","last_change":"2024-09-18T01:28:48.752267+0000","last_active":"2024-09-18T01:28:48.752267+0000","last_peered":"2024-09-18T01:28:48.752267+0000","last_clean":"2024-09-18T01:28:48.752267+0000","last_became_active":"2024-09-18T01:25:10.674983+0000","last_became_peered":"2024-09-18T01:25:10.674983+0000","last_unstale":"2024-09-18T01:28:48.752267+0000","last_undegraded":"2024-09-18T01:28:48.752267+0000","last_fullsized":"2024-09-18T01:28:48.752267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:48.752118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:48.752118+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.752118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:42:22.390584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'46","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.373391+0000","last_change":"2024-09-18T01:28:33.373391+0000","last_active":"2024-09-18T01:28:33.373391+0000","last_peered":"2024-09-18T01:28:33.373391+0000","last_clean":"2024-09-18T01:28:33.373391+0000","last_became_active":"2024-09-18T01:25:12.683339+0000","last_became_peered":"2024-09-18T01:25:12.683339+0000","last_unstale":"2024-09-18T01:28:33.373391+0000","last_undegraded":"2024-09-18T01:28:33.373391+0000","last_fullsized":"2024-09-18T01:28:33.373391+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:33.373272+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:33.373272+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.373272+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:10:34.585302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.045296+0000","last_change":"2024-09-18T01:28:59.045296+0000","last_active":"2024-09-18T01:28:59.045296+0000","last_peered":"2024-09-18T01:28:59.045296+0000","last_clean":"2024-09-18T01:28:59.045296+0000","last_became_active":"2024-09-18T01:25:14.707116+0000","last_became_peered":"2024-09-18T01:25:14.707116+0000","last_unstale":"2024-09-18T01:28:59.045296+0000","last_undegraded":"2024-09-18T01:28:59.045296+0000","last_fullsized":"2024-09-18T01:28:59.045296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:59.045185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:59.045185+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.045185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:59:27.668851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.045461+0000","last_change":"2024-09-18T01:29:15.045461+0000","last_active":"2024-09-18T01:29:15.045461+0000","last_peered":"2024-09-18T01:29:15.045461+0000","last_clean":"2024-09-18T01:29:15.045461+0000","last_became_active":"2024-09-18T01:25:16.708095+0000","last_became_peered":"2024-09-18T01:25:16.708095+0000","last_unstale":"2024-09-18T01:29:15.045461+0000","last_undegraded":"2024-09-18T01:29:15.045461+0000","last_fullsized":"2024-09-18T01:29:15.045461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:15.045296+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:15.045296+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.045296+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:34:54.730738+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.038123+0000","last_change":"2024-09-18T01:28:42.038123+0000","last_active":"2024-09-18T01:28:42.038123+0000","last_peered":"2024-09-18T01:28:42.038123+0000","last_clean":"2024-09-18T01:28:42.038123+0000","last_became_active":"2024-09-18T01:25:08.688251+0000","last_became_peered":"2024-09-18T01:25:08.688251+0000","last_unstale":"2024-09-18T01:28:42.038123+0000","last_undegraded":"2024-09-18T01:28:42.038123+0000","last_fullsized":"2024-09-18T01:28:42.038123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:42.037965+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:42.037965+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.037965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:21:09.764214+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:32.002677+0000","last_change":"2024-09-18T01:29:32.002706+0000","last_active":"2024-09-18T01:29:32.002677+0000","last_peered":"2024-09-18T01:29:32.002677+0000","last_clean":"2024-09-18T01:29:32.002677+0000","last_became_active":"2024-09-18T01:25:06.683437+0000","last_became_peered":"2024-09-18T01:25:06.683437+0000","last_unstale":"2024-09-18T01:29:32.002677+0000","last_undegraded":"2024-09-18T01:29:32.002677+0000","last_fullsized":"2024-09-18T01:29:32.002677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:32.002575+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:32.002575+0000","last_clean_scrub_stamp":"2024-09-18T01:29:32.002575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:11.297705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.594031+0000","last_change":"2024-09-18T01:28:44.594031+0000","last_active":"2024-09-18T01:28:44.594031+0000","last_peered":"2024-09-18T01:28:44.594031+0000","last_clean":"2024-09-18T01:28:44.594031+0000","last_became_active":"2024-09-18T01:25:10.679740+0000","last_became_peered":"2024-09-18T01:25:10.679740+0000","last_unstale":"2024-09-18T01:28:44.594031+0000","last_undegraded":"2024-09-18T01:28:44.594031+0000","last_fullsized":"2024-09-18T01:28:44.594031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:44.593908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:44.593908+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.593908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:48.222246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'45","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.694748+0000","last_change":"2024-09-18T01:28:40.694748+0000","last_active":"2024-09-18T01:28:40.694748+0000","last_peered":"2024-09-18T01:28:40.694748+0000","last_clean":"2024-09-18T01:28:40.694748+0000","last_became_active":"2024-09-18T01:25:12.686455+0000","last_became_peered":"2024-09-18T01:25:12.686455+0000","last_unstale":"2024-09-18T01:28:40.694748+0000","last_undegraded":"2024-09-18T01:28:40.694748+0000","last_fullsized":"2024-09-18T01:28:40.694748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-18T01:28:40.694620+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-18T01:28:40.694620+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.694620+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:30.077444+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":416,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.649256+0000","last_change":"2024-09-18T01:28:30.649256+0000","last_active":"2024-09-18T01:28:30.649256+0000","last_peered":"2024-09-18T01:28:30.649256+0000","last_clean":"2024-09-18T01:28:30.649256+0000","last_became_active":"2024-09-18T01:25:14.703877+0000","last_became_peered":"2024-09-18T01:25:14.703877+0000","last_unstale":"2024-09-18T01:28:30.649256+0000","last_undegraded":"2024-09-18T01:28:30.649256+0000","last_fullsized":"2024-09-18T01:28:30.649256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:30.649113+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:30.649113+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.649113+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:03.499336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'13","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:24.473786+0000","last_change":"2024-09-18T01:29:24.473786+0000","last_active":"2024-09-18T01:29:24.473786+0000","last_peered":"2024-09-18T01:29:24.473786+0000","last_clean":"2024-09-18T01:29:24.473786+0000","last_became_active":"2024-09-18T01:25:16.713677+0000","last_became_peered":"2024-09-18T01:25:16.713677+0000","last_unstale":"2024-09-18T01:29:24.473786+0000","last_undegraded":"2024-09-18T01:29:24.473786+0000","last_fullsized":"2024-09-18T01:29:24.473786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'13","last_scrub_stamp":"2024-09-18T01:29:24.473594+0000","last_deep_scrub":"35'13","last_deep_scrub_stamp":"2024-09-18T01:29:24.473594+0000","last_clean_scrub_stamp":"2024-09-18T01:29:24.473594+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:16:45.309204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:57.862588+0000","last_change":"2024-09-18T01:28:57.862588+0000","last_active":"2024-09-18T01:28:57.862588+0000","last_peered":"2024-09-18T01:28:57.862588+0000","last_clean":"2024-09-18T01:28:57.862588+0000","last_became_active":"2024-09-18T01:25:08.673276+0000","last_became_peered":"2024-09-18T01:25:08.673276+0000","last_unstale":"2024-09-18T01:28:57.862588+0000","last_undegraded":"2024-09-18T01:28:57.862588+0000","last_fullsized":"2024-09-18T01:28:57.862588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:57.862460+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:57.862460+0000","last_clean_scrub_stamp":"2024-09-18T01:28:57.862460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:25:54.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:43.086769+0000","last_change":"2024-09-18T01:29:43.086795+0000","last_active":"2024-09-18T01:29:43.086769+0000","last_peered":"2024-09-18T01:29:43.086769+0000","last_clean":"2024-09-18T01:29:43.086769+0000","last_became_active":"2024-09-18T01:25:06.682841+0000","last_became_peered":"2024-09-18T01:25:06.682841+0000","last_unstale":"2024-09-18T01:29:43.086769+0000","last_undegraded":"2024-09-18T01:29:43.086769+0000","last_fullsized":"2024-09-18T01:29:43.086769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:43.086666+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:43.086666+0000","last_clean_scrub_stamp":"2024-09-18T01:29:43.086666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:26:27.561510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":429,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.267271+0000","last_change":"2024-09-18T01:28:40.267271+0000","last_active":"2024-09-18T01:28:40.267271+0000","last_peered":"2024-09-18T01:28:40.267271+0000","last_clean":"2024-09-18T01:28:40.267271+0000","last_became_active":"2024-09-18T01:25:10.679483+0000","last_became_peered":"2024-09-18T01:25:10.679483+0000","last_unstale":"2024-09-18T01:28:40.267271+0000","last_undegraded":"2024-09-18T01:28:40.267271+0000","last_fullsized":"2024-09-18T01:28:40.267271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-18T01:28:40.267152+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-18T01:28:40.267152+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.267152+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:35.825702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.098116+0000","last_change":"2024-09-18T01:28:53.098116+0000","last_active":"2024-09-18T01:28:53.098116+0000","last_peered":"2024-09-18T01:28:53.098116+0000","last_clean":"2024-09-18T01:28:53.098116+0000","last_became_active":"2024-09-18T01:25:12.696726+0000","last_became_peered":"2024-09-18T01:25:12.696726+0000","last_unstale":"2024-09-18T01:28:53.098116+0000","last_undegraded":"2024-09-18T01:28:53.098116+0000","last_fullsized":"2024-09-18T01:28:53.098116+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-18T01:28:53.097976+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-18T01:28:53.097976+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.097976+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:31:13.343479+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":523,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.350881+0000","last_change":"2024-09-18T01:28:35.350881+0000","last_active":"2024-09-18T01:28:35.350881+0000","last_peered":"2024-09-18T01:28:35.350881+0000","last_clean":"2024-09-18T01:28:35.350881+0000","last_became_active":"2024-09-18T01:25:14.702900+0000","last_became_peered":"2024-09-18T01:25:14.702900+0000","last_unstale":"2024-09-18T01:28:35.350881+0000","last_undegraded":"2024-09-18T01:28:35.350881+0000","last_fullsized":"2024-09-18T01:28:35.350881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:35.350746+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:35.350746+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.350746+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:24.733569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.703271+0000","last_change":"2024-09-18T01:28:41.703271+0000","last_active":"2024-09-18T01:28:41.703271+0000","last_peered":"2024-09-18T01:28:41.703271+0000","last_clean":"2024-09-18T01:28:41.703271+0000","last_became_active":"2024-09-18T01:25:16.712084+0000","last_became_peered":"2024-09-18T01:25:16.712084+0000","last_unstale":"2024-09-18T01:28:41.703271+0000","last_undegraded":"2024-09-18T01:28:41.703271+0000","last_fullsized":"2024-09-18T01:28:41.703271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:41.703089+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:41.703089+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.703089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:26:56.294603+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'8","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.243573+0000","last_change":"2024-09-18T01:28:52.243573+0000","last_active":"2024-09-18T01:28:52.243573+0000","last_peered":"2024-09-18T01:28:52.243573+0000","last_clean":"2024-09-18T01:28:52.243573+0000","last_became_active":"2024-09-18T01:25:08.686802+0000","last_became_peered":"2024-09-18T01:25:08.686802+0000","last_unstale":"2024-09-18T01:28:52.243573+0000","last_undegraded":"2024-09-18T01:28:52.243573+0000","last_fullsized":"2024-09-18T01:28:52.243573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:52.243420+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:52.243420+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.243420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:29.295501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:18.033899+0000","last_change":"2024-09-18T01:29:18.033899+0000","last_active":"2024-09-18T01:29:18.033899+0000","last_peered":"2024-09-18T01:29:18.033899+0000","last_clean":"2024-09-18T01:29:18.033899+0000","last_became_active":"2024-09-18T01:25:06.691644+0000","last_became_peered":"2024-09-18T01:25:06.691644+0000","last_unstale":"2024-09-18T01:29:18.033899+0000","last_undegraded":"2024-09-18T01:29:18.033899+0000","last_fullsized":"2024-09-18T01:29:18.033899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:18.033754+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:18.033754+0000","last_clean_scrub_stamp":"2024-09-18T01:29:18.033754+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:54:59.833695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.109380+0000","last_change":"2024-09-18T01:28:32.109380+0000","last_active":"2024-09-18T01:28:32.109380+0000","last_peered":"2024-09-18T01:28:32.109380+0000","last_clean":"2024-09-18T01:28:32.109380+0000","last_became_active":"2024-09-18T01:25:10.682075+0000","last_became_peered":"2024-09-18T01:25:10.682075+0000","last_unstale":"2024-09-18T01:28:32.109380+0000","last_undegraded":"2024-09-18T01:28:32.109380+0000","last_fullsized":"2024-09-18T01:28:32.109380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:32.109232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:32.109232+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.109232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:37.084368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'49","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.423980+0000","last_change":"2024-09-18T01:28:32.423980+0000","last_active":"2024-09-18T01:28:32.423980+0000","last_peered":"2024-09-18T01:28:32.423980+0000","last_clean":"2024-09-18T01:28:32.423980+0000","last_became_active":"2024-09-18T01:25:12.686460+0000","last_became_peered":"2024-09-18T01:25:12.686460+0000","last_unstale":"2024-09-18T01:28:32.423980+0000","last_undegraded":"2024-09-18T01:28:32.423980+0000","last_fullsized":"2024-09-18T01:28:32.423980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-09-18T01:28:32.423801+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-09-18T01:28:32.423801+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.423801+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:00:55.455121+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.575318+0000","last_change":"2024-09-18T01:28:27.575318+0000","last_active":"2024-09-18T01:28:27.575318+0000","last_peered":"2024-09-18T01:28:27.575318+0000","last_clean":"2024-09-18T01:28:27.575318+0000","last_became_active":"2024-09-18T01:25:14.706506+0000","last_became_peered":"2024-09-18T01:25:14.706506+0000","last_unstale":"2024-09-18T01:28:27.575318+0000","last_undegraded":"2024-09-18T01:28:27.575318+0000","last_fullsized":"2024-09-18T01:28:27.575318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:27.575151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:27.575151+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.575151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:28.541634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'7","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.228116+0000","last_change":"2024-09-18T01:28:55.228116+0000","last_active":"2024-09-18T01:28:55.228116+0000","last_peered":"2024-09-18T01:28:55.228116+0000","last_clean":"2024-09-18T01:28:55.228116+0000","last_became_active":"2024-09-18T01:25:16.709084+0000","last_became_peered":"2024-09-18T01:25:16.709084+0000","last_unstale":"2024-09-18T01:28:55.228116+0000","last_undegraded":"2024-09-18T01:28:55.228116+0000","last_fullsized":"2024-09-18T01:28:55.228116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:28:55.227978+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:28:55.227978+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.227978+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:40.596230+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'7","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.022803+0000","last_change":"2024-09-18T01:28:44.022803+0000","last_active":"2024-09-18T01:28:44.022803+0000","last_peered":"2024-09-18T01:28:44.022803+0000","last_clean":"2024-09-18T01:28:44.022803+0000","last_became_active":"2024-09-18T01:25:08.687896+0000","last_became_peered":"2024-09-18T01:25:08.687896+0000","last_unstale":"2024-09-18T01:28:44.022803+0000","last_undegraded":"2024-09-18T01:28:44.022803+0000","last_fullsized":"2024-09-18T01:28:44.022803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-18T01:28:44.022693+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-18T01:28:44.022693+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.022693+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:27.889066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":216,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:13.331194+0000","last_change":"2024-09-18T01:29:13.331251+0000","last_active":"2024-09-18T01:29:13.331194+0000","last_peered":"2024-09-18T01:29:13.331194+0000","last_clean":"2024-09-18T01:29:13.331194+0000","last_became_active":"2024-09-18T01:24:52.296214+0000","last_became_peered":"2024-09-18T01:24:52.296214+0000","last_unstale":"2024-09-18T01:29:13.331194+0000","last_undegraded":"2024-09-18T01:29:13.331194+0000","last_fullsized":"2024-09-18T01:29:13.331194+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-09-18T01:29:13.331084+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-09-18T01:29:13.331084+0000","last_clean_scrub_stamp":"2024-09-18T01:29:13.331084+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:06.550020+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"35'2","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:40.062021+0000","last_change":"2024-09-18T01:29:40.062068+0000","last_active":"2024-09-18T01:29:40.062021+0000","last_peered":"2024-09-18T01:29:40.062021+0000","last_clean":"2024-09-18T01:29:40.062021+0000","last_became_active":"2024-09-18T01:24:56.194443+0000","last_became_peered":"2024-09-18T01:24:56.194443+0000","last_unstale":"2024-09-18T01:29:40.062021+0000","last_undegraded":"2024-09-18T01:29:40.062021+0000","last_fullsized":"2024-09-18T01:29:40.062021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:40.061919+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:40.061919+0000","last_clean_scrub_stamp":"2024-09-18T01:29:40.061919+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:56:03.404879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033763700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:29.948219+0000","last_change":"2024-09-18T01:29:29.948273+0000","last_active":"2024-09-18T01:29:29.948219+0000","last_peered":"2024-09-18T01:29:29.948219+0000","last_clean":"2024-09-18T01:29:29.948219+0000","last_became_active":"2024-09-18T01:25:06.683975+0000","last_became_peered":"2024-09-18T01:25:06.683975+0000","last_unstale":"2024-09-18T01:29:29.948219+0000","last_undegraded":"2024-09-18T01:29:29.948219+0000","last_fullsized":"2024-09-18T01:29:29.948219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:29.948108+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:29.948108+0000","last_clean_scrub_stamp":"2024-09-18T01:29:29.948108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:26:00.090673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.273084+0000","last_change":"2024-09-18T01:28:41.273084+0000","last_active":"2024-09-18T01:28:41.273084+0000","last_peered":"2024-09-18T01:28:41.273084+0000","last_clean":"2024-09-18T01:28:41.273084+0000","last_became_active":"2024-09-18T01:25:10.679572+0000","last_became_peered":"2024-09-18T01:25:10.679572+0000","last_unstale":"2024-09-18T01:28:41.273084+0000","last_undegraded":"2024-09-18T01:28:41.273084+0000","last_fullsized":"2024-09-18T01:28:41.273084+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:41.272968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:41.272968+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.272968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:18:48.599189+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'94","reported_seq":191,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.133548+0000","last_change":"2024-09-18T01:28:39.133548+0000","last_active":"2024-09-18T01:28:39.133548+0000","last_peered":"2024-09-18T01:28:39.133548+0000","last_clean":"2024-09-18T01:28:39.133548+0000","last_became_active":"2024-09-18T01:25:12.691952+0000","last_became_peered":"2024-09-18T01:25:12.691952+0000","last_unstale":"2024-09-18T01:28:39.133548+0000","last_undegraded":"2024-09-18T01:28:39.133548+0000","last_fullsized":"2024-09-18T01:28:39.133548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'94","last_scrub_stamp":"2024-09-18T01:28:39.133419+0000","last_deep_scrub":"35'94","last_deep_scrub_stamp":"2024-09-18T01:28:39.133419+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.133419+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:11:05.713633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.670355+0000","last_change":"2024-09-18T01:28:31.670355+0000","last_active":"2024-09-18T01:28:31.670355+0000","last_peered":"2024-09-18T01:28:31.670355+0000","last_clean":"2024-09-18T01:28:31.670355+0000","last_became_active":"2024-09-18T01:25:14.706519+0000","last_became_peered":"2024-09-18T01:25:14.706519+0000","last_unstale":"2024-09-18T01:28:31.670355+0000","last_undegraded":"2024-09-18T01:28:31.670355+0000","last_fullsized":"2024-09-18T01:28:31.670355+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.670230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.670230+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.670230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:37.902202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'85","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:45.758628+0000","last_change":"2024-09-18T01:28:45.758628+0000","last_active":"2024-09-18T01:28:45.758628+0000","last_peered":"2024-09-18T01:28:45.758628+0000","last_clean":"2024-09-18T01:28:45.758628+0000","last_became_active":"2024-09-18T01:25:16.712102+0000","last_became_peered":"2024-09-18T01:25:16.712102+0000","last_unstale":"2024-09-18T01:28:45.758628+0000","last_undegraded":"2024-09-18T01:28:45.758628+0000","last_fullsized":"2024-09-18T01:28:45.758628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'85","last_scrub_stamp":"2024-09-18T01:28:45.758460+0000","last_deep_scrub":"35'85","last_deep_scrub_stamp":"2024-09-18T01:28:45.758460+0000","last_clean_scrub_stamp":"2024-09-18T01:28:45.758460+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:39.752325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":221,"num_write":168,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'8","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.999350+0000","last_change":"2024-09-18T01:29:15.999350+0000","last_active":"2024-09-18T01:29:15.999350+0000","last_peered":"2024-09-18T01:29:15.999350+0000","last_clean":"2024-09-18T01:29:15.999350+0000","last_became_active":"2024-09-18T01:25:08.671578+0000","last_became_peered":"2024-09-18T01:25:08.671578+0000","last_unstale":"2024-09-18T01:29:15.999350+0000","last_undegraded":"2024-09-18T01:29:15.999350+0000","last_fullsized":"2024-09-18T01:29:15.999350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:15.999222+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:15.999222+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.999222+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:05:28.202872+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:37.006840+0000","last_change":"2024-09-18T01:29:37.006867+0000","last_active":"2024-09-18T01:29:37.006840+0000","last_peered":"2024-09-18T01:29:37.006840+0000","last_clean":"2024-09-18T01:29:37.006840+0000","last_became_active":"2024-09-18T01:24:56.191554+0000","last_became_peered":"2024-09-18T01:24:56.191554+0000","last_unstale":"2024-09-18T01:29:37.006840+0000","last_undegraded":"2024-09-18T01:29:37.006840+0000","last_fullsized":"2024-09-18T01:29:37.006840+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:37.006743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:37.006743+0000","last_clean_scrub_stamp":"2024-09-18T01:29:37.006743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:45:10.731378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041584599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:17.493372+0000","last_change":"2024-09-18T01:29:17.493372+0000","last_active":"2024-09-18T01:29:17.493372+0000","last_peered":"2024-09-18T01:29:17.493372+0000","last_clean":"2024-09-18T01:29:17.493372+0000","last_became_active":"2024-09-18T01:25:06.680635+0000","last_became_peered":"2024-09-18T01:25:06.680635+0000","last_unstale":"2024-09-18T01:29:17.493372+0000","last_undegraded":"2024-09-18T01:29:17.493372+0000","last_fullsized":"2024-09-18T01:29:17.493372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:17.493252+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:17.493252+0000","last_clean_scrub_stamp":"2024-09-18T01:29:17.493252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:00:56.730173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.041935+0000","last_change":"2024-09-18T01:28:34.041935+0000","last_active":"2024-09-18T01:28:34.041935+0000","last_peered":"2024-09-18T01:28:34.041935+0000","last_clean":"2024-09-18T01:28:34.041935+0000","last_became_active":"2024-09-18T01:25:10.681988+0000","last_became_peered":"2024-09-18T01:25:10.681988+0000","last_unstale":"2024-09-18T01:28:34.041935+0000","last_undegraded":"2024-09-18T01:28:34.041935+0000","last_fullsized":"2024-09-18T01:28:34.041935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:34.041811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:34.041811+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.041811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:05:37.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'297","reported_seq":529,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.359441+0000","last_change":"2024-09-18T01:28:27.359441+0000","last_active":"2024-09-18T01:28:27.359441+0000","last_peered":"2024-09-18T01:28:27.359441+0000","last_clean":"2024-09-18T01:28:27.359441+0000","last_became_active":"2024-09-18T01:25:12.693664+0000","last_became_peered":"2024-09-18T01:25:12.693664+0000","last_unstale":"2024-09-18T01:28:27.359441+0000","last_undegraded":"2024-09-18T01:28:27.359441+0000","last_fullsized":"2024-09-18T01:28:27.359441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'297","last_scrub_stamp":"2024-09-18T01:28:27.359261+0000","last_deep_scrub":"35'297","last_deep_scrub_stamp":"2024-09-18T01:28:27.359261+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.359261+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:28:05.502483+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.086190+0000","last_change":"2024-09-18T01:28:51.086190+0000","last_active":"2024-09-18T01:28:51.086190+0000","last_peered":"2024-09-18T01:28:51.086190+0000","last_clean":"2024-09-18T01:28:51.086190+0000","last_became_active":"2024-09-18T01:25:14.707143+0000","last_became_peered":"2024-09-18T01:25:14.707143+0000","last_unstale":"2024-09-18T01:28:51.086190+0000","last_undegraded":"2024-09-18T01:28:51.086190+0000","last_fullsized":"2024-09-18T01:28:51.086190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:51.086082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:51.086082+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.086082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:29:21.095319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:28.486151+0000","last_change":"2024-09-18T01:29:28.486151+0000","last_active":"2024-09-18T01:29:28.486151+0000","last_peered":"2024-09-18T01:29:28.486151+0000","last_clean":"2024-09-18T01:29:28.486151+0000","last_became_active":"2024-09-18T01:25:16.712931+0000","last_became_peered":"2024-09-18T01:25:16.712931+0000","last_unstale":"2024-09-18T01:29:28.486151+0000","last_undegraded":"2024-09-18T01:29:28.486151+0000","last_fullsized":"2024-09-18T01:29:28.486151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-18T01:29:28.485989+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-18T01:29:28.485989+0000","last_clean_scrub_stamp":"2024-09-18T01:29:28.485989+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:55.509346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:11.476574+0000","last_change":"2024-09-18T01:29:11.476574+0000","last_active":"2024-09-18T01:29:11.476574+0000","last_peered":"2024-09-18T01:29:11.476574+0000","last_clean":"2024-09-18T01:29:11.476574+0000","last_became_active":"2024-09-18T01:25:08.680541+0000","last_became_peered":"2024-09-18T01:25:08.680541+0000","last_unstale":"2024-09-18T01:29:11.476574+0000","last_undegraded":"2024-09-18T01:29:11.476574+0000","last_fullsized":"2024-09-18T01:29:11.476574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:11.476456+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:11.476456+0000","last_clean_scrub_stamp":"2024-09-18T01:29:11.476456+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:48.447070+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:07.830066+0000","last_change":"2024-09-18T01:29:07.830066+0000","last_active":"2024-09-18T01:29:07.830066+0000","last_peered":"2024-09-18T01:29:07.830066+0000","last_clean":"2024-09-18T01:29:07.830066+0000","last_became_active":"2024-09-18T01:24:56.191162+0000","last_became_peered":"2024-09-18T01:24:56.191162+0000","last_unstale":"2024-09-18T01:29:07.830066+0000","last_undegraded":"2024-09-18T01:29:07.830066+0000","last_fullsized":"2024-09-18T01:29:07.830066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:07.829938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:07.829938+0000","last_clean_scrub_stamp":"2024-09-18T01:29:07.829938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:20.798729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040921399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:08.500119+0000","last_change":"2024-09-18T01:29:08.500146+0000","last_active":"2024-09-18T01:29:08.500119+0000","last_peered":"2024-09-18T01:29:08.500119+0000","last_clean":"2024-09-18T01:29:08.500119+0000","last_became_active":"2024-09-18T01:25:06.686053+0000","last_became_peered":"2024-09-18T01:25:06.686053+0000","last_unstale":"2024-09-18T01:29:08.500119+0000","last_undegraded":"2024-09-18T01:29:08.500119+0000","last_fullsized":"2024-09-18T01:29:08.500119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:08.500012+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:08.500012+0000","last_clean_scrub_stamp":"2024-09-18T01:29:08.500012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:34.922339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:47.729134+0000","last_change":"2024-09-18T01:28:47.729134+0000","last_active":"2024-09-18T01:28:47.729134+0000","last_peered":"2024-09-18T01:28:47.729134+0000","last_clean":"2024-09-18T01:28:47.729134+0000","last_became_active":"2024-09-18T01:25:10.677597+0000","last_became_peered":"2024-09-18T01:25:10.677597+0000","last_unstale":"2024-09-18T01:28:47.729134+0000","last_undegraded":"2024-09-18T01:28:47.729134+0000","last_fullsized":"2024-09-18T01:28:47.729134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:47.729010+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:47.729010+0000","last_clean_scrub_stamp":"2024-09-18T01:28:47.729010+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:44:00.635385+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'23","reported_seq":101,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.678878+0000","last_change":"2024-09-18T01:28:39.678878+0000","last_active":"2024-09-18T01:28:39.678878+0000","last_peered":"2024-09-18T01:28:39.678878+0000","last_clean":"2024-09-18T01:28:39.678878+0000","last_became_active":"2024-09-18T01:25:12.687799+0000","last_became_peered":"2024-09-18T01:25:12.687799+0000","last_unstale":"2024-09-18T01:28:39.678878+0000","last_undegraded":"2024-09-18T01:28:39.678878+0000","last_fullsized":"2024-09-18T01:28:39.678878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-09-18T01:28:39.678752+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-09-18T01:28:39.678752+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.678752+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:45.910724+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:27.698401+0000","last_change":"2024-09-18T01:28:27.698401+0000","last_active":"2024-09-18T01:28:27.698401+0000","last_peered":"2024-09-18T01:28:27.698401+0000","last_clean":"2024-09-18T01:28:27.698401+0000","last_became_active":"2024-09-18T01:25:14.706611+0000","last_became_peered":"2024-09-18T01:25:14.706611+0000","last_unstale":"2024-09-18T01:28:27.698401+0000","last_undegraded":"2024-09-18T01:28:27.698401+0000","last_fullsized":"2024-09-18T01:28:27.698401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:27.698307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:27.698307+0000","last_clean_scrub_stamp":"2024-09-18T01:28:27.698307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:17.902689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:46.009807+0000","last_change":"2024-09-18T01:29:46.009807+0000","last_active":"2024-09-18T01:29:46.009807+0000","last_peered":"2024-09-18T01:29:46.009807+0000","last_clean":"2024-09-18T01:29:46.009807+0000","last_became_active":"2024-09-18T01:25:16.711404+0000","last_became_peered":"2024-09-18T01:25:16.711404+0000","last_unstale":"2024-09-18T01:29:46.009807+0000","last_undegraded":"2024-09-18T01:29:46.009807+0000","last_fullsized":"2024-09-18T01:29:46.009807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:46.009678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:46.009678+0000","last_clean_scrub_stamp":"2024-09-18T01:29:46.009678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:01:05.180149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:09.483226+0000","last_change":"2024-09-18T01:29:09.483226+0000","last_active":"2024-09-18T01:29:09.483226+0000","last_peered":"2024-09-18T01:29:09.483226+0000","last_clean":"2024-09-18T01:29:09.483226+0000","last_became_active":"2024-09-18T01:25:08.672969+0000","last_became_peered":"2024-09-18T01:25:08.672969+0000","last_unstale":"2024-09-18T01:29:09.483226+0000","last_undegraded":"2024-09-18T01:29:09.483226+0000","last_fullsized":"2024-09-18T01:29:09.483226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:09.483012+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:09.483012+0000","last_clean_scrub_stamp":"2024-09-18T01:29:09.483012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:10.006025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"35'3","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:38.024854+0000","last_change":"2024-09-18T01:29:38.024882+0000","last_active":"2024-09-18T01:29:38.024854+0000","last_peered":"2024-09-18T01:29:38.024854+0000","last_clean":"2024-09-18T01:29:38.024854+0000","last_became_active":"2024-09-18T01:24:56.191713+0000","last_became_peered":"2024-09-18T01:24:56.191713+0000","last_unstale":"2024-09-18T01:29:38.024854+0000","last_undegraded":"2024-09-18T01:29:38.024854+0000","last_fullsized":"2024-09-18T01:29:38.024854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:29:38.024769+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:29:38.024769+0000","last_clean_scrub_stamp":"2024-09-18T01:29:38.024769+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:00:16.212484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0010043490000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:12.924407+0000","last_change":"2024-09-18T01:29:12.924407+0000","last_active":"2024-09-18T01:29:12.924407+0000","last_peered":"2024-09-18T01:29:12.924407+0000","last_clean":"2024-09-18T01:29:12.924407+0000","last_became_active":"2024-09-18T01:25:06.700397+0000","last_became_peered":"2024-09-18T01:25:06.700397+0000","last_unstale":"2024-09-18T01:29:12.924407+0000","last_undegraded":"2024-09-18T01:29:12.924407+0000","last_fullsized":"2024-09-18T01:29:12.924407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:12.924288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:12.924288+0000","last_clean_scrub_stamp":"2024-09-18T01:29:12.924288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:25:17.867300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.497466+0000","last_change":"2024-09-18T01:28:52.497466+0000","last_active":"2024-09-18T01:28:52.497466+0000","last_peered":"2024-09-18T01:28:52.497466+0000","last_clean":"2024-09-18T01:28:52.497466+0000","last_became_active":"2024-09-18T01:25:10.676320+0000","last_became_peered":"2024-09-18T01:25:10.676320+0000","last_unstale":"2024-09-18T01:28:52.497466+0000","last_undegraded":"2024-09-18T01:28:52.497466+0000","last_fullsized":"2024-09-18T01:28:52.497466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:52.497353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:52.497353+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.497353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:53:33.827801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'20","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.995001+0000","last_change":"2024-09-18T01:28:42.995001+0000","last_active":"2024-09-18T01:28:42.995001+0000","last_peered":"2024-09-18T01:28:42.995001+0000","last_clean":"2024-09-18T01:28:42.995001+0000","last_became_active":"2024-09-18T01:25:12.692373+0000","last_became_peered":"2024-09-18T01:25:12.692373+0000","last_unstale":"2024-09-18T01:28:42.995001+0000","last_undegraded":"2024-09-18T01:28:42.995001+0000","last_fullsized":"2024-09-18T01:28:42.995001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:28:42.994815+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:28:42.994815+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.994815+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:43.271590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.107033+0000","last_change":"2024-09-18T01:29:03.107033+0000","last_active":"2024-09-18T01:29:03.107033+0000","last_peered":"2024-09-18T01:29:03.107033+0000","last_clean":"2024-09-18T01:29:03.107033+0000","last_became_active":"2024-09-18T01:25:14.707409+0000","last_became_peered":"2024-09-18T01:25:14.707409+0000","last_unstale":"2024-09-18T01:29:03.107033+0000","last_undegraded":"2024-09-18T01:29:03.107033+0000","last_fullsized":"2024-09-18T01:29:03.107033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:03.106906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:03.106906+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.106906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:24.958182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'6","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.398293+0000","last_change":"2024-09-18T01:29:22.398293+0000","last_active":"2024-09-18T01:29:22.398293+0000","last_peered":"2024-09-18T01:29:22.398293+0000","last_clean":"2024-09-18T01:29:22.398293+0000","last_became_active":"2024-09-18T01:25:16.711104+0000","last_became_peered":"2024-09-18T01:25:16.711104+0000","last_unstale":"2024-09-18T01:29:22.398293+0000","last_undegraded":"2024-09-18T01:29:22.398293+0000","last_fullsized":"2024-09-18T01:29:22.398293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:22.398178+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:22.398178+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.398178+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:15:04.145641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.183724+0000","last_change":"2024-09-18T01:28:50.183724+0000","last_active":"2024-09-18T01:28:50.183724+0000","last_peered":"2024-09-18T01:28:50.183724+0000","last_clean":"2024-09-18T01:28:50.183724+0000","last_became_active":"2024-09-18T01:25:08.687139+0000","last_became_peered":"2024-09-18T01:25:08.687139+0000","last_unstale":"2024-09-18T01:28:50.183724+0000","last_undegraded":"2024-09-18T01:28:50.183724+0000","last_fullsized":"2024-09-18T01:28:50.183724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:50.183577+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:50.183577+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.183577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:25.770565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:10.886037+0000","last_change":"2024-09-18T01:29:10.886037+0000","last_active":"2024-09-18T01:29:10.886037+0000","last_peered":"2024-09-18T01:29:10.886037+0000","last_clean":"2024-09-18T01:29:10.886037+0000","last_became_active":"2024-09-18T01:25:06.691871+0000","last_became_peered":"2024-09-18T01:25:06.691871+0000","last_unstale":"2024-09-18T01:29:10.886037+0000","last_undegraded":"2024-09-18T01:29:10.886037+0000","last_fullsized":"2024-09-18T01:29:10.886037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:10.885874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:10.885874+0000","last_clean_scrub_stamp":"2024-09-18T01:29:10.885874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:27.291671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:13.464330+0000","last_change":"2024-09-18T01:29:13.464359+0000","last_active":"2024-09-18T01:29:13.464330+0000","last_peered":"2024-09-18T01:29:13.464330+0000","last_clean":"2024-09-18T01:29:13.464330+0000","last_became_active":"2024-09-18T01:24:56.191033+0000","last_became_peered":"2024-09-18T01:24:56.191033+0000","last_unstale":"2024-09-18T01:29:13.464330+0000","last_undegraded":"2024-09-18T01:29:13.464330+0000","last_fullsized":"2024-09-18T01:29:13.464330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:13.464088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:13.464088+0000","last_clean_scrub_stamp":"2024-09-18T01:29:13.464088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:17.184392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000547898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.523244+0000","last_change":"2024-09-18T01:28:50.523244+0000","last_active":"2024-09-18T01:28:50.523244+0000","last_peered":"2024-09-18T01:28:50.523244+0000","last_clean":"2024-09-18T01:28:50.523244+0000","last_became_active":"2024-09-18T01:25:10.676531+0000","last_became_peered":"2024-09-18T01:25:10.676531+0000","last_unstale":"2024-09-18T01:28:50.523244+0000","last_undegraded":"2024-09-18T01:28:50.523244+0000","last_fullsized":"2024-09-18T01:28:50.523244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:28:50.523096+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:28:50.523096+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.523096+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:41:44.218280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'90","reported_seq":179,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.549893+0000","last_change":"2024-09-18T01:28:36.549893+0000","last_active":"2024-09-18T01:28:36.549893+0000","last_peered":"2024-09-18T01:28:36.549893+0000","last_clean":"2024-09-18T01:28:36.549893+0000","last_became_active":"2024-09-18T01:25:12.693127+0000","last_became_peered":"2024-09-18T01:25:12.693127+0000","last_unstale":"2024-09-18T01:28:36.549893+0000","last_undegraded":"2024-09-18T01:28:36.549893+0000","last_fullsized":"2024-09-18T01:28:36.549893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'90","last_scrub_stamp":"2024-09-18T01:28:36.549705+0000","last_deep_scrub":"35'90","last_deep_scrub_stamp":"2024-09-18T01:28:36.549705+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.549705+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:32.108255+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.622620+0000","last_change":"2024-09-18T01:28:28.622620+0000","last_active":"2024-09-18T01:28:28.622620+0000","last_peered":"2024-09-18T01:28:28.622620+0000","last_clean":"2024-09-18T01:28:28.622620+0000","last_became_active":"2024-09-18T01:25:14.703993+0000","last_became_peered":"2024-09-18T01:25:14.703993+0000","last_unstale":"2024-09-18T01:28:28.622620+0000","last_undegraded":"2024-09-18T01:28:28.622620+0000","last_fullsized":"2024-09-18T01:28:28.622620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:28.622514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:28.622514+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.622514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:15:53.831184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:55.439559+0000","last_change":"2024-09-18T01:28:55.439559+0000","last_active":"2024-09-18T01:28:55.439559+0000","last_peered":"2024-09-18T01:28:55.439559+0000","last_clean":"2024-09-18T01:28:55.439559+0000","last_became_active":"2024-09-18T01:25:16.703278+0000","last_became_peered":"2024-09-18T01:25:16.703278+0000","last_unstale":"2024-09-18T01:28:55.439559+0000","last_undegraded":"2024-09-18T01:28:55.439559+0000","last_fullsized":"2024-09-18T01:28:55.439559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-18T01:28:55.439368+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-18T01:28:55.439368+0000","last_clean_scrub_stamp":"2024-09-18T01:28:55.439368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:24.662471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.209968+0000","last_change":"2024-09-18T01:28:56.209968+0000","last_active":"2024-09-18T01:28:56.209968+0000","last_peered":"2024-09-18T01:28:56.209968+0000","last_clean":"2024-09-18T01:28:56.209968+0000","last_became_active":"2024-09-18T01:25:08.686087+0000","last_became_peered":"2024-09-18T01:25:08.686087+0000","last_unstale":"2024-09-18T01:28:56.209968+0000","last_undegraded":"2024-09-18T01:28:56.209968+0000","last_fullsized":"2024-09-18T01:28:56.209968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:56.209817+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:56.209817+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.209817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:57:02.811375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.466459+0000","last_change":"2024-09-18T01:29:15.466459+0000","last_active":"2024-09-18T01:29:15.466459+0000","last_peered":"2024-09-18T01:29:15.466459+0000","last_clean":"2024-09-18T01:29:15.466459+0000","last_became_active":"2024-09-18T01:25:06.680623+0000","last_became_peered":"2024-09-18T01:25:06.680623+0000","last_unstale":"2024-09-18T01:29:15.466459+0000","last_undegraded":"2024-09-18T01:29:15.466459+0000","last_fullsized":"2024-09-18T01:29:15.466459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:15.466302+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:15.466302+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.466302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:12:48.261541+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:39.019271+0000","last_change":"2024-09-18T01:29:39.019295+0000","last_active":"2024-09-18T01:29:39.019271+0000","last_peered":"2024-09-18T01:29:39.019271+0000","last_clean":"2024-09-18T01:29:39.019271+0000","last_became_active":"2024-09-18T01:24:56.191687+0000","last_became_peered":"2024-09-18T01:24:56.191687+0000","last_unstale":"2024-09-18T01:29:39.019271+0000","last_undegraded":"2024-09-18T01:29:39.019271+0000","last_fullsized":"2024-09-18T01:29:39.019271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:39.019144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:39.019144+0000","last_clean_scrub_stamp":"2024-09-18T01:29:39.019144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:17:01.457685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012745390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.087179+0000","last_change":"2024-09-18T01:28:37.087179+0000","last_active":"2024-09-18T01:28:37.087179+0000","last_peered":"2024-09-18T01:28:37.087179+0000","last_clean":"2024-09-18T01:28:37.087179+0000","last_became_active":"2024-09-18T01:25:10.681311+0000","last_became_peered":"2024-09-18T01:25:10.681311+0000","last_unstale":"2024-09-18T01:28:37.087179+0000","last_undegraded":"2024-09-18T01:28:37.087179+0000","last_fullsized":"2024-09-18T01:28:37.087179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:37.087060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:37.087060+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.087060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:59:56.318845+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'29","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.395402+0000","last_change":"2024-09-18T01:28:28.395402+0000","last_active":"2024-09-18T01:28:28.395402+0000","last_peered":"2024-09-18T01:28:28.395402+0000","last_clean":"2024-09-18T01:28:28.395402+0000","last_became_active":"2024-09-18T01:25:12.692357+0000","last_became_peered":"2024-09-18T01:25:12.692357+0000","last_unstale":"2024-09-18T01:28:28.395402+0000","last_undegraded":"2024-09-18T01:28:28.395402+0000","last_fullsized":"2024-09-18T01:28:28.395402+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'29","last_scrub_stamp":"2024-09-18T01:28:28.395277+0000","last_deep_scrub":"35'29","last_deep_scrub_stamp":"2024-09-18T01:28:28.395277+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.395277+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:50.311253+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":399,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:43.280257+0000","last_change":"2024-09-18T01:28:43.280257+0000","last_active":"2024-09-18T01:28:43.280257+0000","last_peered":"2024-09-18T01:28:43.280257+0000","last_clean":"2024-09-18T01:28:43.280257+0000","last_became_active":"2024-09-18T01:25:14.705703+0000","last_became_peered":"2024-09-18T01:25:14.705703+0000","last_unstale":"2024-09-18T01:28:43.280257+0000","last_undegraded":"2024-09-18T01:28:43.280257+0000","last_fullsized":"2024-09-18T01:28:43.280257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:43.280138+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:43.280138+0000","last_clean_scrub_stamp":"2024-09-18T01:28:43.280138+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:32.165248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:46.972325+0000","last_change":"2024-09-18T01:29:46.972325+0000","last_active":"2024-09-18T01:29:46.972325+0000","last_peered":"2024-09-18T01:29:46.972325+0000","last_clean":"2024-09-18T01:29:46.972325+0000","last_became_active":"2024-09-18T01:25:16.711531+0000","last_became_peered":"2024-09-18T01:25:16.711531+0000","last_unstale":"2024-09-18T01:29:46.972325+0000","last_undegraded":"2024-09-18T01:29:46.972325+0000","last_fullsized":"2024-09-18T01:29:46.972325+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:46.972205+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:46.972205+0000","last_clean_scrub_stamp":"2024-09-18T01:29:46.972205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:57:32.147314+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'20","reported_seq":90,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.122320+0000","last_change":"2024-09-18T01:29:04.122320+0000","last_active":"2024-09-18T01:29:04.122320+0000","last_peered":"2024-09-18T01:29:04.122320+0000","last_clean":"2024-09-18T01:29:04.122320+0000","last_became_active":"2024-09-18T01:25:08.681285+0000","last_became_peered":"2024-09-18T01:25:08.681285+0000","last_unstale":"2024-09-18T01:29:04.122320+0000","last_undegraded":"2024-09-18T01:29:04.122320+0000","last_fullsized":"2024-09-18T01:29:04.122320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:29:04.122206+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:29:04.122206+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.122206+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:24.652487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":56,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:35.974654+0000","last_change":"2024-09-18T01:29:35.974714+0000","last_active":"2024-09-18T01:29:35.974654+0000","last_peered":"2024-09-18T01:29:35.974654+0000","last_clean":"2024-09-18T01:29:35.974654+0000","last_became_active":"2024-09-18T01:25:06.683740+0000","last_became_peered":"2024-09-18T01:25:06.683740+0000","last_unstale":"2024-09-18T01:29:35.974654+0000","last_undegraded":"2024-09-18T01:29:35.974654+0000","last_fullsized":"2024-09-18T01:29:35.974654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:35.974537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:35.974537+0000","last_clean_scrub_stamp":"2024-09-18T01:29:35.974537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:25:23.044287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:14.448119+0000","last_change":"2024-09-18T01:29:14.448119+0000","last_active":"2024-09-18T01:29:14.448119+0000","last_peered":"2024-09-18T01:29:14.448119+0000","last_clean":"2024-09-18T01:29:14.448119+0000","last_became_active":"2024-09-18T01:24:56.192301+0000","last_became_peered":"2024-09-18T01:24:56.192301+0000","last_unstale":"2024-09-18T01:29:14.448119+0000","last_undegraded":"2024-09-18T01:29:14.448119+0000","last_fullsized":"2024-09-18T01:29:14.448119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:14.447964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:14.447964+0000","last_clean_scrub_stamp":"2024-09-18T01:29:14.447964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:38.190018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056449699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.070061+0000","last_change":"2024-09-18T01:28:30.070061+0000","last_active":"2024-09-18T01:28:30.070061+0000","last_peered":"2024-09-18T01:28:30.070061+0000","last_clean":"2024-09-18T01:28:30.070061+0000","last_became_active":"2024-09-18T01:25:10.682111+0000","last_became_peered":"2024-09-18T01:25:10.682111+0000","last_unstale":"2024-09-18T01:28:30.070061+0000","last_undegraded":"2024-09-18T01:28:30.070061+0000","last_fullsized":"2024-09-18T01:28:30.070061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:30.069896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:30.069896+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.069896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:14.982005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'23","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.044578+0000","last_change":"2024-09-18T01:28:41.044578+0000","last_active":"2024-09-18T01:28:41.044578+0000","last_peered":"2024-09-18T01:28:41.044578+0000","last_clean":"2024-09-18T01:28:41.044578+0000","last_became_active":"2024-09-18T01:25:12.692313+0000","last_became_peered":"2024-09-18T01:25:12.692313+0000","last_unstale":"2024-09-18T01:28:41.044578+0000","last_undegraded":"2024-09-18T01:28:41.044578+0000","last_fullsized":"2024-09-18T01:28:41.044578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-09-18T01:28:41.044429+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-09-18T01:28:41.044429+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.044429+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:56.982066+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":411,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.567260+0000","last_change":"2024-09-18T01:28:34.567260+0000","last_active":"2024-09-18T01:28:34.567260+0000","last_peered":"2024-09-18T01:28:34.567260+0000","last_clean":"2024-09-18T01:28:34.567260+0000","last_became_active":"2024-09-18T01:25:14.698755+0000","last_became_peered":"2024-09-18T01:25:14.698755+0000","last_unstale":"2024-09-18T01:28:34.567260+0000","last_undegraded":"2024-09-18T01:28:34.567260+0000","last_fullsized":"2024-09-18T01:28:34.567260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:34.567070+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:34.567070+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.567070+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:46:39.422894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'5","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:25.484242+0000","last_change":"2024-09-18T01:29:25.484242+0000","last_active":"2024-09-18T01:29:25.484242+0000","last_peered":"2024-09-18T01:29:25.484242+0000","last_clean":"2024-09-18T01:29:25.484242+0000","last_became_active":"2024-09-18T01:25:16.712556+0000","last_became_peered":"2024-09-18T01:25:16.712556+0000","last_unstale":"2024-09-18T01:29:25.484242+0000","last_undegraded":"2024-09-18T01:29:25.484242+0000","last_fullsized":"2024-09-18T01:29:25.484242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-18T01:29:25.484127+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-18T01:29:25.484127+0000","last_clean_scrub_stamp":"2024-09-18T01:29:25.484127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:23.933836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'14","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.895871+0000","last_change":"2024-09-18T01:29:01.895871+0000","last_active":"2024-09-18T01:29:01.895871+0000","last_peered":"2024-09-18T01:29:01.895871+0000","last_clean":"2024-09-18T01:29:01.895871+0000","last_became_active":"2024-09-18T01:25:08.674560+0000","last_became_peered":"2024-09-18T01:25:08.674560+0000","last_unstale":"2024-09-18T01:29:01.895871+0000","last_undegraded":"2024-09-18T01:29:01.895871+0000","last_fullsized":"2024-09-18T01:29:01.895871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-18T01:29:01.895707+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-18T01:29:01.895707+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.895707+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:56.827853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.309098+0000","last_change":"2024-09-18T01:29:04.309098+0000","last_active":"2024-09-18T01:29:04.309098+0000","last_peered":"2024-09-18T01:29:04.309098+0000","last_clean":"2024-09-18T01:29:04.309098+0000","last_became_active":"2024-09-18T01:25:06.686277+0000","last_became_peered":"2024-09-18T01:25:06.686277+0000","last_unstale":"2024-09-18T01:29:04.309098+0000","last_undegraded":"2024-09-18T01:29:04.309098+0000","last_fullsized":"2024-09-18T01:29:04.309098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:04.308925+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:04.308925+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.308925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:20.714722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:41.035447+0000","last_change":"2024-09-18T01:29:41.035472+0000","last_active":"2024-09-18T01:29:41.035447+0000","last_peered":"2024-09-18T01:29:41.035447+0000","last_clean":"2024-09-18T01:29:41.035447+0000","last_became_active":"2024-09-18T01:24:56.602991+0000","last_became_peered":"2024-09-18T01:24:56.602991+0000","last_unstale":"2024-09-18T01:29:41.035447+0000","last_undegraded":"2024-09-18T01:29:41.035447+0000","last_fullsized":"2024-09-18T01:29:41.035447+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:41.035351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:41.035351+0000","last_clean_scrub_stamp":"2024-09-18T01:29:41.035351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:39:37.234139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077351,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:28.105468+0000","last_change":"2024-09-18T01:28:28.105468+0000","last_active":"2024-09-18T01:28:28.105468+0000","last_peered":"2024-09-18T01:28:28.105468+0000","last_clean":"2024-09-18T01:28:28.105468+0000","last_became_active":"2024-09-18T01:25:10.682057+0000","last_became_peered":"2024-09-18T01:25:10.682057+0000","last_unstale":"2024-09-18T01:28:28.105468+0000","last_undegraded":"2024-09-18T01:28:28.105468+0000","last_fullsized":"2024-09-18T01:28:28.105468+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:28.105351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:28.105351+0000","last_clean_scrub_stamp":"2024-09-18T01:28:28.105351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:52:34.334975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'104","reported_seq":204,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.726873+0000","last_change":"2024-09-18T01:28:35.726873+0000","last_active":"2024-09-18T01:28:35.726873+0000","last_peered":"2024-09-18T01:28:35.726873+0000","last_clean":"2024-09-18T01:28:35.726873+0000","last_became_active":"2024-09-18T01:25:12.694361+0000","last_became_peered":"2024-09-18T01:25:12.694361+0000","last_unstale":"2024-09-18T01:28:35.726873+0000","last_undegraded":"2024-09-18T01:28:35.726873+0000","last_fullsized":"2024-09-18T01:28:35.726873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'104","last_scrub_stamp":"2024-09-18T01:28:35.726737+0000","last_deep_scrub":"35'104","last_deep_scrub_stamp":"2024-09-18T01:28:35.726737+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.726737+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:56.458829+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.552741+0000","last_change":"2024-09-18T01:28:39.552741+0000","last_active":"2024-09-18T01:28:39.552741+0000","last_peered":"2024-09-18T01:28:39.552741+0000","last_clean":"2024-09-18T01:28:39.552741+0000","last_became_active":"2024-09-18T01:25:14.706960+0000","last_became_peered":"2024-09-18T01:25:14.706960+0000","last_unstale":"2024-09-18T01:28:39.552741+0000","last_undegraded":"2024-09-18T01:28:39.552741+0000","last_fullsized":"2024-09-18T01:28:39.552741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:39.552625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:39.552625+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.552625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:28.437734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"33'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:16.932474+0000","last_change":"2024-09-18T01:29:16.932474+0000","last_active":"2024-09-18T01:29:16.932474+0000","last_peered":"2024-09-18T01:29:16.932474+0000","last_clean":"2024-09-18T01:29:16.932474+0000","last_became_active":"2024-09-18T01:25:16.716607+0000","last_became_peered":"2024-09-18T01:25:16.716607+0000","last_unstale":"2024-09-18T01:29:16.932474+0000","last_undegraded":"2024-09-18T01:29:16.932474+0000","last_fullsized":"2024-09-18T01:29:16.932474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:16.932352+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:16.932352+0000","last_clean_scrub_stamp":"2024-09-18T01:29:16.932352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:57.817343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:17.899188+0000","last_change":"2024-09-18T01:29:17.899188+0000","last_active":"2024-09-18T01:29:17.899188+0000","last_peered":"2024-09-18T01:29:17.899188+0000","last_clean":"2024-09-18T01:29:17.899188+0000","last_became_active":"2024-09-18T01:25:16.716867+0000","last_became_peered":"2024-09-18T01:25:16.716867+0000","last_unstale":"2024-09-18T01:29:17.899188+0000","last_undegraded":"2024-09-18T01:29:17.899188+0000","last_fullsized":"2024-09-18T01:29:17.899188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:17.899080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:17.899080+0000","last_clean_scrub_stamp":"2024-09-18T01:29:17.899080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:44.321407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:05.764239+0000","last_change":"2024-09-18T01:29:05.764239+0000","last_active":"2024-09-18T01:29:05.764239+0000","last_peered":"2024-09-18T01:29:05.764239+0000","last_clean":"2024-09-18T01:29:05.764239+0000","last_became_active":"2024-09-18T01:25:08.675590+0000","last_became_peered":"2024-09-18T01:25:08.675590+0000","last_unstale":"2024-09-18T01:29:05.764239+0000","last_undegraded":"2024-09-18T01:29:05.764239+0000","last_fullsized":"2024-09-18T01:29:05.764239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:05.764128+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:05.764128+0000","last_clean_scrub_stamp":"2024-09-18T01:29:05.764128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:09.224112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:30.982063+0000","last_change":"2024-09-18T01:29:30.982063+0000","last_active":"2024-09-18T01:29:30.982063+0000","last_peered":"2024-09-18T01:29:30.982063+0000","last_clean":"2024-09-18T01:29:30.982063+0000","last_became_active":"2024-09-18T01:25:06.689996+0000","last_became_peered":"2024-09-18T01:25:06.689996+0000","last_unstale":"2024-09-18T01:29:30.982063+0000","last_undegraded":"2024-09-18T01:29:30.982063+0000","last_fullsized":"2024-09-18T01:29:30.982063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:30.981931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:30.981931+0000","last_clean_scrub_stamp":"2024-09-18T01:29:30.981931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:37:57.728593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.304730+0000","last_change":"2024-09-18T01:28:38.304730+0000","last_active":"2024-09-18T01:28:38.304730+0000","last_peered":"2024-09-18T01:28:38.304730+0000","last_clean":"2024-09-18T01:28:38.304730+0000","last_became_active":"2024-09-18T01:25:10.679704+0000","last_became_peered":"2024-09-18T01:25:10.679704+0000","last_unstale":"2024-09-18T01:28:38.304730+0000","last_undegraded":"2024-09-18T01:28:38.304730+0000","last_fullsized":"2024-09-18T01:28:38.304730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:38.304607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:38.304607+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.304607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:00.590243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'47","reported_seq":110,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:56.045435+0000","last_change":"2024-09-18T01:28:56.045435+0000","last_active":"2024-09-18T01:28:56.045435+0000","last_peered":"2024-09-18T01:28:56.045435+0000","last_clean":"2024-09-18T01:28:56.045435+0000","last_became_active":"2024-09-18T01:25:12.692870+0000","last_became_peered":"2024-09-18T01:25:12.692870+0000","last_unstale":"2024-09-18T01:28:56.045435+0000","last_undegraded":"2024-09-18T01:28:56.045435+0000","last_fullsized":"2024-09-18T01:28:56.045435+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-09-18T01:28:56.045290+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-09-18T01:28:56.045290+0000","last_clean_scrub_stamp":"2024-09-18T01:28:56.045290+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:42:03.283767+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:49.058531+0000","last_change":"2024-09-18T01:28:49.058531+0000","last_active":"2024-09-18T01:28:49.058531+0000","last_peered":"2024-09-18T01:28:49.058531+0000","last_clean":"2024-09-18T01:28:49.058531+0000","last_became_active":"2024-09-18T01:25:14.706381+0000","last_became_peered":"2024-09-18T01:25:14.706381+0000","last_unstale":"2024-09-18T01:28:49.058531+0000","last_undegraded":"2024-09-18T01:28:49.058531+0000","last_fullsized":"2024-09-18T01:28:49.058531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:49.058417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:49.058417+0000","last_clean_scrub_stamp":"2024-09-18T01:28:49.058417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:09.897723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'17","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.472284+0000","last_change":"2024-09-18T01:28:51.472284+0000","last_active":"2024-09-18T01:28:51.472284+0000","last_peered":"2024-09-18T01:28:51.472284+0000","last_clean":"2024-09-18T01:28:51.472284+0000","last_became_active":"2024-09-18T01:25:16.703227+0000","last_became_peered":"2024-09-18T01:25:16.703227+0000","last_unstale":"2024-09-18T01:28:51.472284+0000","last_undegraded":"2024-09-18T01:28:51.472284+0000","last_fullsized":"2024-09-18T01:28:51.472284+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-18T01:28:51.472131+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-18T01:28:51.472131+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.472131+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:46:57.519168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":68,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.271102+0000","last_change":"2024-09-18T01:28:48.271102+0000","last_active":"2024-09-18T01:28:48.271102+0000","last_peered":"2024-09-18T01:28:48.271102+0000","last_clean":"2024-09-18T01:28:48.271102+0000","last_became_active":"2024-09-18T01:25:08.687482+0000","last_became_peered":"2024-09-18T01:25:08.687482+0000","last_unstale":"2024-09-18T01:28:48.271102+0000","last_undegraded":"2024-09-18T01:28:48.271102+0000","last_fullsized":"2024-09-18T01:28:48.271102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:28:48.270983+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:28:48.270983+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.270983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:51.899321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.803480+0000","last_change":"2024-09-18T01:28:54.803480+0000","last_active":"2024-09-18T01:28:54.803480+0000","last_peered":"2024-09-18T01:28:54.803480+0000","last_clean":"2024-09-18T01:28:54.803480+0000","last_became_active":"2024-09-18T01:25:06.705406+0000","last_became_peered":"2024-09-18T01:25:06.705406+0000","last_unstale":"2024-09-18T01:28:54.803480+0000","last_undegraded":"2024-09-18T01:28:54.803480+0000","last_fullsized":"2024-09-18T01:28:54.803480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:54.803363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:54.803363+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.803363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:05:32.221186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.114710+0000","last_change":"2024-09-18T01:28:29.114710+0000","last_active":"2024-09-18T01:28:29.114710+0000","last_peered":"2024-09-18T01:28:29.114710+0000","last_clean":"2024-09-18T01:28:29.114710+0000","last_became_active":"2024-09-18T01:25:10.682230+0000","last_became_peered":"2024-09-18T01:25:10.682230+0000","last_unstale":"2024-09-18T01:28:29.114710+0000","last_undegraded":"2024-09-18T01:28:29.114710+0000","last_fullsized":"2024-09-18T01:28:29.114710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.114588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.114588+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.114588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:42:02.700134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:41.620043+0000","last_change":"2024-09-18T01:28:41.620043+0000","last_active":"2024-09-18T01:28:41.620043+0000","last_peered":"2024-09-18T01:28:41.620043+0000","last_clean":"2024-09-18T01:28:41.620043+0000","last_became_active":"2024-09-18T01:25:12.687018+0000","last_became_peered":"2024-09-18T01:25:12.687018+0000","last_unstale":"2024-09-18T01:28:41.620043+0000","last_undegraded":"2024-09-18T01:28:41.620043+0000","last_fullsized":"2024-09-18T01:28:41.620043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:41.619916+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:41.619916+0000","last_clean_scrub_stamp":"2024-09-18T01:28:41.619916+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:43.740728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.669975+0000","last_change":"2024-09-18T01:28:29.669975+0000","last_active":"2024-09-18T01:28:29.669975+0000","last_peered":"2024-09-18T01:28:29.669975+0000","last_clean":"2024-09-18T01:28:29.669975+0000","last_became_active":"2024-09-18T01:25:14.707008+0000","last_became_peered":"2024-09-18T01:25:14.707008+0000","last_unstale":"2024-09-18T01:28:29.669975+0000","last_undegraded":"2024-09-18T01:28:29.669975+0000","last_fullsized":"2024-09-18T01:28:29.669975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:29.669852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:29.669852+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.669852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:18.373919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:26.482777+0000","last_change":"2024-09-18T01:29:26.482829+0000","last_active":"2024-09-18T01:29:26.482777+0000","last_peered":"2024-09-18T01:29:26.482777+0000","last_clean":"2024-09-18T01:29:26.482777+0000","last_became_active":"2024-09-18T01:25:16.714160+0000","last_became_peered":"2024-09-18T01:25:16.714160+0000","last_unstale":"2024-09-18T01:29:26.482777+0000","last_undegraded":"2024-09-18T01:29:26.482777+0000","last_fullsized":"2024-09-18T01:29:26.482777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:26.482657+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:26.482657+0000","last_clean_scrub_stamp":"2024-09-18T01:29:26.482657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:06:53.262007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:01.422822+0000","last_change":"2024-09-18T01:29:01.422822+0000","last_active":"2024-09-18T01:29:01.422822+0000","last_peered":"2024-09-18T01:29:01.422822+0000","last_clean":"2024-09-18T01:29:01.422822+0000","last_became_active":"2024-09-18T01:25:08.671365+0000","last_became_peered":"2024-09-18T01:25:08.671365+0000","last_unstale":"2024-09-18T01:29:01.422822+0000","last_undegraded":"2024-09-18T01:29:01.422822+0000","last_fullsized":"2024-09-18T01:29:01.422822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:01.422709+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:01.422709+0000","last_clean_scrub_stamp":"2024-09-18T01:29:01.422709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:17.828506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.855411+0000","last_change":"2024-09-18T01:29:02.855411+0000","last_active":"2024-09-18T01:29:02.855411+0000","last_peered":"2024-09-18T01:29:02.855411+0000","last_clean":"2024-09-18T01:29:02.855411+0000","last_became_active":"2024-09-18T01:25:06.703081+0000","last_became_peered":"2024-09-18T01:25:06.703081+0000","last_unstale":"2024-09-18T01:29:02.855411+0000","last_undegraded":"2024-09-18T01:29:02.855411+0000","last_fullsized":"2024-09-18T01:29:02.855411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:02.855275+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:02.855275+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.855275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:21.389785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.718746+0000","last_change":"2024-09-18T01:28:44.718746+0000","last_active":"2024-09-18T01:28:44.718746+0000","last_peered":"2024-09-18T01:28:44.718746+0000","last_clean":"2024-09-18T01:28:44.718746+0000","last_became_active":"2024-09-18T01:25:10.680316+0000","last_became_peered":"2024-09-18T01:25:10.680316+0000","last_unstale":"2024-09-18T01:28:44.718746+0000","last_undegraded":"2024-09-18T01:28:44.718746+0000","last_fullsized":"2024-09-18T01:28:44.718746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:44.718622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:44.718622+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.718622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:03.968563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'47","reported_seq":120,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.607643+0000","last_change":"2024-09-18T01:28:42.607643+0000","last_active":"2024-09-18T01:28:42.607643+0000","last_peered":"2024-09-18T01:28:42.607643+0000","last_clean":"2024-09-18T01:28:42.607643+0000","last_became_active":"2024-09-18T01:25:12.682270+0000","last_became_peered":"2024-09-18T01:25:12.682270+0000","last_unstale":"2024-09-18T01:28:42.607643+0000","last_undegraded":"2024-09-18T01:28:42.607643+0000","last_fullsized":"2024-09-18T01:28:42.607643+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-09-18T01:28:42.607487+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-09-18T01:28:42.607487+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.607487+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:51:54.508090+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:39.271337+0000","last_change":"2024-09-18T01:28:39.271337+0000","last_active":"2024-09-18T01:28:39.271337+0000","last_peered":"2024-09-18T01:28:39.271337+0000","last_clean":"2024-09-18T01:28:39.271337+0000","last_became_active":"2024-09-18T01:25:14.703583+0000","last_became_peered":"2024-09-18T01:25:14.703583+0000","last_unstale":"2024-09-18T01:28:39.271337+0000","last_undegraded":"2024-09-18T01:28:39.271337+0000","last_fullsized":"2024-09-18T01:28:39.271337+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:39.271224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:39.271224+0000","last_clean_scrub_stamp":"2024-09-18T01:28:39.271224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:54.971763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:48.965741+0000","last_change":"2024-09-18T01:29:48.965766+0000","last_active":"2024-09-18T01:29:48.965741+0000","last_peered":"2024-09-18T01:29:48.965741+0000","last_clean":"2024-09-18T01:29:48.965741+0000","last_became_active":"2024-09-18T01:25:16.714061+0000","last_became_peered":"2024-09-18T01:25:16.714061+0000","last_unstale":"2024-09-18T01:29:48.965741+0000","last_undegraded":"2024-09-18T01:29:48.965741+0000","last_fullsized":"2024-09-18T01:29:48.965741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:48.965603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:48.965603+0000","last_clean_scrub_stamp":"2024-09-18T01:29:48.965603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:46:52.849926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'4","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.004012+0000","last_change":"2024-09-18T01:28:46.004012+0000","last_active":"2024-09-18T01:28:46.004012+0000","last_peered":"2024-09-18T01:28:46.004012+0000","last_clean":"2024-09-18T01:28:46.004012+0000","last_became_active":"2024-09-18T01:25:08.688016+0000","last_became_peered":"2024-09-18T01:25:08.688016+0000","last_unstale":"2024-09-18T01:28:46.004012+0000","last_undegraded":"2024-09-18T01:28:46.004012+0000","last_fullsized":"2024-09-18T01:28:46.004012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:46.003879+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:46.003879+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.003879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:50.020572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:10.337537+0000","last_change":"2024-09-18T01:29:10.337537+0000","last_active":"2024-09-18T01:29:10.337537+0000","last_peered":"2024-09-18T01:29:10.337537+0000","last_clean":"2024-09-18T01:29:10.337537+0000","last_became_active":"2024-09-18T01:25:06.688747+0000","last_became_peered":"2024-09-18T01:25:06.688747+0000","last_unstale":"2024-09-18T01:29:10.337537+0000","last_undegraded":"2024-09-18T01:29:10.337537+0000","last_fullsized":"2024-09-18T01:29:10.337537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:10.337368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:10.337368+0000","last_clean_scrub_stamp":"2024-09-18T01:29:10.337368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:51.222358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.109581+0000","last_change":"2024-09-18T01:28:38.109581+0000","last_active":"2024-09-18T01:28:38.109581+0000","last_peered":"2024-09-18T01:28:38.109581+0000","last_clean":"2024-09-18T01:28:38.109581+0000","last_became_active":"2024-09-18T01:25:10.680831+0000","last_became_peered":"2024-09-18T01:25:10.680831+0000","last_unstale":"2024-09-18T01:28:38.109581+0000","last_undegraded":"2024-09-18T01:28:38.109581+0000","last_fullsized":"2024-09-18T01:28:38.109581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:38.109472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:38.109472+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.109472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:44.941883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.715108+0000","last_change":"2024-09-18T01:28:42.715108+0000","last_active":"2024-09-18T01:28:42.715108+0000","last_peered":"2024-09-18T01:28:42.715108+0000","last_clean":"2024-09-18T01:28:42.715108+0000","last_became_active":"2024-09-18T01:25:12.686918+0000","last_became_peered":"2024-09-18T01:25:12.686918+0000","last_unstale":"2024-09-18T01:28:42.715108+0000","last_undegraded":"2024-09-18T01:28:42.715108+0000","last_fullsized":"2024-09-18T01:28:42.715108+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-18T01:28:42.714970+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-18T01:28:42.714970+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.714970+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:01:05.208541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:32.654249+0000","last_change":"2024-09-18T01:28:32.654249+0000","last_active":"2024-09-18T01:28:32.654249+0000","last_peered":"2024-09-18T01:28:32.654249+0000","last_clean":"2024-09-18T01:28:32.654249+0000","last_became_active":"2024-09-18T01:25:14.695120+0000","last_became_peered":"2024-09-18T01:25:14.695120+0000","last_unstale":"2024-09-18T01:28:32.654249+0000","last_undegraded":"2024-09-18T01:28:32.654249+0000","last_fullsized":"2024-09-18T01:28:32.654249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:32.654135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:32.654135+0000","last_clean_scrub_stamp":"2024-09-18T01:28:32.654135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:02:10.947460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:08.068938+0000","last_change":"2024-09-18T01:29:08.068938+0000","last_active":"2024-09-18T01:29:08.068938+0000","last_peered":"2024-09-18T01:29:08.068938+0000","last_clean":"2024-09-18T01:29:08.068938+0000","last_became_active":"2024-09-18T01:25:08.677941+0000","last_became_peered":"2024-09-18T01:25:08.677941+0000","last_unstale":"2024-09-18T01:29:08.068938+0000","last_undegraded":"2024-09-18T01:29:08.068938+0000","last_fullsized":"2024-09-18T01:29:08.068938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:08.068815+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:08.068815+0000","last_clean_scrub_stamp":"2024-09-18T01:29:08.068815+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:33:09.305362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:20.091256+0000","last_change":"2024-09-18T01:29:20.091256+0000","last_active":"2024-09-18T01:29:20.091256+0000","last_peered":"2024-09-18T01:29:20.091256+0000","last_clean":"2024-09-18T01:29:20.091256+0000","last_became_active":"2024-09-18T01:25:06.692823+0000","last_became_peered":"2024-09-18T01:25:06.692823+0000","last_unstale":"2024-09-18T01:29:20.091256+0000","last_undegraded":"2024-09-18T01:29:20.091256+0000","last_fullsized":"2024-09-18T01:29:20.091256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:20.091088+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:20.091088+0000","last_clean_scrub_stamp":"2024-09-18T01:29:20.091088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:25.879095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.590054+0000","last_change":"2024-09-18T01:28:46.590054+0000","last_active":"2024-09-18T01:28:46.590054+0000","last_peered":"2024-09-18T01:28:46.590054+0000","last_clean":"2024-09-18T01:28:46.590054+0000","last_became_active":"2024-09-18T01:25:10.677481+0000","last_became_peered":"2024-09-18T01:25:10.677481+0000","last_unstale":"2024-09-18T01:28:46.590054+0000","last_undegraded":"2024-09-18T01:28:46.590054+0000","last_fullsized":"2024-09-18T01:28:46.590054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:46.589926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:46.589926+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.589926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:21:01.356370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'71","reported_seq":150,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.576795+0000","last_change":"2024-09-18T01:28:40.576840+0000","last_active":"2024-09-18T01:28:40.576795+0000","last_peered":"2024-09-18T01:28:40.576795+0000","last_clean":"2024-09-18T01:28:40.576795+0000","last_became_active":"2024-09-18T01:25:12.687014+0000","last_became_peered":"2024-09-18T01:25:12.687014+0000","last_unstale":"2024-09-18T01:28:40.576795+0000","last_undegraded":"2024-09-18T01:28:40.576795+0000","last_fullsized":"2024-09-18T01:28:40.576795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'71","last_scrub_stamp":"2024-09-18T01:28:40.576711+0000","last_deep_scrub":"35'71","last_deep_scrub_stamp":"2024-09-18T01:28:40.576711+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.576711+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:02:19.666203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:31.637762+0000","last_change":"2024-09-18T01:28:31.637788+0000","last_active":"2024-09-18T01:28:31.637762+0000","last_peered":"2024-09-18T01:28:31.637762+0000","last_clean":"2024-09-18T01:28:31.637762+0000","last_became_active":"2024-09-18T01:25:14.698753+0000","last_became_peered":"2024-09-18T01:25:14.698753+0000","last_unstale":"2024-09-18T01:28:31.637762+0000","last_undegraded":"2024-09-18T01:28:31.637762+0000","last_fullsized":"2024-09-18T01:28:31.637762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:31.637674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:31.637674+0000","last_clean_scrub_stamp":"2024-09-18T01:28:31.637674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:05:28.601978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'20","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:25.471884+0000","last_change":"2024-09-18T01:29:25.471884+0000","last_active":"2024-09-18T01:29:25.471884+0000","last_peered":"2024-09-18T01:29:25.471884+0000","last_clean":"2024-09-18T01:29:25.471884+0000","last_became_active":"2024-09-18T01:25:16.713750+0000","last_became_peered":"2024-09-18T01:25:16.713750+0000","last_unstale":"2024-09-18T01:29:25.471884+0000","last_undegraded":"2024-09-18T01:29:25.471884+0000","last_fullsized":"2024-09-18T01:29:25.471884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-18T01:29:25.471720+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-18T01:29:25.471720+0000","last_clean_scrub_stamp":"2024-09-18T01:29:25.471720+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:52.495077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:21.531580+0000","last_change":"2024-09-18T01:29:21.531608+0000","last_active":"2024-09-18T01:29:21.531580+0000","last_peered":"2024-09-18T01:29:21.531580+0000","last_clean":"2024-09-18T01:29:21.531580+0000","last_became_active":"2024-09-18T01:25:08.680604+0000","last_became_peered":"2024-09-18T01:25:08.680604+0000","last_unstale":"2024-09-18T01:29:21.531580+0000","last_undegraded":"2024-09-18T01:29:21.531580+0000","last_fullsized":"2024-09-18T01:29:21.531580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:21.531492+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:21.531492+0000","last_clean_scrub_stamp":"2024-09-18T01:29:21.531492+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:47.902528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:20.338195+0000","last_change":"2024-09-18T01:29:20.338195+0000","last_active":"2024-09-18T01:29:20.338195+0000","last_peered":"2024-09-18T01:29:20.338195+0000","last_clean":"2024-09-18T01:29:20.338195+0000","last_became_active":"2024-09-18T01:25:06.686125+0000","last_became_peered":"2024-09-18T01:25:06.686125+0000","last_unstale":"2024-09-18T01:29:20.338195+0000","last_undegraded":"2024-09-18T01:29:20.338195+0000","last_fullsized":"2024-09-18T01:29:20.338195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:20.338067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:20.338067+0000","last_clean_scrub_stamp":"2024-09-18T01:29:20.338067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:00:59.574989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"35'5","reported_seq":248,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:22.771802+0000","last_change":"2024-09-18T01:29:22.771832+0000","last_active":"2024-09-18T01:29:22.771802+0000","last_peered":"2024-09-18T01:29:22.771802+0000","last_clean":"2024-09-18T01:29:22.771802+0000","last_became_active":"2024-09-18T01:25:43.908273+0000","last_became_peered":"2024-09-18T01:25:43.908273+0000","last_unstale":"2024-09-18T01:29:22.771802+0000","last_undegraded":"2024-09-18T01:29:22.771802+0000","last_fullsized":"2024-09-18T01:29:22.771802+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-18T01:29:22.771713+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-18T01:29:22.771713+0000","last_clean_scrub_stamp":"2024-09-18T01:29:22.771713+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:26.492018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.076283+0000","last_change":"2024-09-18T01:29:00.076347+0000","last_active":"2024-09-18T01:29:00.076283+0000","last_peered":"2024-09-18T01:29:00.076283+0000","last_clean":"2024-09-18T01:29:00.076283+0000","last_became_active":"2024-09-18T01:25:12.692486+0000","last_became_peered":"2024-09-18T01:25:12.692486+0000","last_unstale":"2024-09-18T01:29:00.076283+0000","last_undegraded":"2024-09-18T01:29:00.076283+0000","last_fullsized":"2024-09-18T01:29:00.076283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:29:00.076171+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:29:00.076171+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.076171+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:57:19.965536+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.203333+0000","last_change":"2024-09-18T01:28:51.203356+0000","last_active":"2024-09-18T01:28:51.203333+0000","last_peered":"2024-09-18T01:28:51.203333+0000","last_clean":"2024-09-18T01:28:51.203333+0000","last_became_active":"2024-09-18T01:25:14.709980+0000","last_became_peered":"2024-09-18T01:25:14.709980+0000","last_unstale":"2024-09-18T01:28:51.203333+0000","last_undegraded":"2024-09-18T01:28:51.203333+0000","last_fullsized":"2024-09-18T01:28:51.203333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:51.203243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:51.203243+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.203243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:37:51.114618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:19.057982+0000","last_change":"2024-09-18T01:29:19.057982+0000","last_active":"2024-09-18T01:29:19.057982+0000","last_peered":"2024-09-18T01:29:19.057982+0000","last_clean":"2024-09-18T01:29:19.057982+0000","last_became_active":"2024-09-18T01:25:16.708905+0000","last_became_peered":"2024-09-18T01:25:16.708905+0000","last_unstale":"2024-09-18T01:29:19.057982+0000","last_undegraded":"2024-09-18T01:29:19.057982+0000","last_fullsized":"2024-09-18T01:29:19.057982+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:19.057861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:19.057861+0000","last_clean_scrub_stamp":"2024-09-18T01:29:19.057861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:45.617512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'6","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:40.081418+0000","last_change":"2024-09-18T01:28:40.081446+0000","last_active":"2024-09-18T01:28:40.081418+0000","last_peered":"2024-09-18T01:28:40.081418+0000","last_clean":"2024-09-18T01:28:40.081418+0000","last_became_active":"2024-09-18T01:25:08.688610+0000","last_became_peered":"2024-09-18T01:25:08.688610+0000","last_unstale":"2024-09-18T01:28:40.081418+0000","last_undegraded":"2024-09-18T01:28:40.081418+0000","last_fullsized":"2024-09-18T01:28:40.081418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:40.081320+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:40.081320+0000","last_clean_scrub_stamp":"2024-09-18T01:28:40.081320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:49.789353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:15.319196+0000","last_change":"2024-09-18T01:29:15.319222+0000","last_active":"2024-09-18T01:29:15.319196+0000","last_peered":"2024-09-18T01:29:15.319196+0000","last_clean":"2024-09-18T01:29:15.319196+0000","last_became_active":"2024-09-18T01:25:06.685167+0000","last_became_peered":"2024-09-18T01:25:06.685167+0000","last_unstale":"2024-09-18T01:29:15.319196+0000","last_undegraded":"2024-09-18T01:29:15.319196+0000","last_fullsized":"2024-09-18T01:29:15.319196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:15.319106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:15.319106+0000","last_clean_scrub_stamp":"2024-09-18T01:29:15.319106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:05:39.685673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.752136+0000","last_change":"2024-09-18T01:28:46.752160+0000","last_active":"2024-09-18T01:28:46.752136+0000","last_peered":"2024-09-18T01:28:46.752136+0000","last_clean":"2024-09-18T01:28:46.752136+0000","last_became_active":"2024-09-18T01:25:10.678586+0000","last_became_peered":"2024-09-18T01:25:10.678586+0000","last_unstale":"2024-09-18T01:28:46.752136+0000","last_undegraded":"2024-09-18T01:28:46.752136+0000","last_fullsized":"2024-09-18T01:28:46.752136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:46.752053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:46.752053+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.752053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:18:54.078274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'46","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:38.589617+0000","last_change":"2024-09-18T01:28:38.589617+0000","last_active":"2024-09-18T01:28:38.589617+0000","last_peered":"2024-09-18T01:28:38.589617+0000","last_clean":"2024-09-18T01:28:38.589617+0000","last_became_active":"2024-09-18T01:25:12.687935+0000","last_became_peered":"2024-09-18T01:25:12.687935+0000","last_unstale":"2024-09-18T01:28:38.589617+0000","last_undegraded":"2024-09-18T01:28:38.589617+0000","last_fullsized":"2024-09-18T01:28:38.589617+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-18T01:28:38.589489+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-18T01:28:38.589489+0000","last_clean_scrub_stamp":"2024-09-18T01:28:38.589489+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:04:54.499330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:30.683121+0000","last_change":"2024-09-18T01:28:30.683121+0000","last_active":"2024-09-18T01:28:30.683121+0000","last_peered":"2024-09-18T01:28:30.683121+0000","last_clean":"2024-09-18T01:28:30.683121+0000","last_became_active":"2024-09-18T01:25:14.701702+0000","last_became_peered":"2024-09-18T01:25:14.701702+0000","last_unstale":"2024-09-18T01:28:30.683121+0000","last_undegraded":"2024-09-18T01:28:30.683121+0000","last_fullsized":"2024-09-18T01:28:30.683121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:30.682992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:30.682992+0000","last_clean_scrub_stamp":"2024-09-18T01:28:30.682992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:55.879755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:50.938682+0000","last_change":"2024-09-18T01:29:50.938682+0000","last_active":"2024-09-18T01:29:50.938682+0000","last_peered":"2024-09-18T01:29:50.938682+0000","last_clean":"2024-09-18T01:29:50.938682+0000","last_became_active":"2024-09-18T01:25:16.715669+0000","last_became_peered":"2024-09-18T01:25:16.715669+0000","last_unstale":"2024-09-18T01:29:50.938682+0000","last_undegraded":"2024-09-18T01:29:50.938682+0000","last_fullsized":"2024-09-18T01:29:50.938682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:29:50.938567+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:29:50.938567+0000","last_clean_scrub_stamp":"2024-09-18T01:29:50.938567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:00:20.714515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"35'16","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:03.428235+0000","last_change":"2024-09-18T01:29:03.428235+0000","last_active":"2024-09-18T01:29:03.428235+0000","last_peered":"2024-09-18T01:29:03.428235+0000","last_clean":"2024-09-18T01:29:03.428235+0000","last_became_active":"2024-09-18T01:25:08.672541+0000","last_became_peered":"2024-09-18T01:25:08.672541+0000","last_unstale":"2024-09-18T01:29:03.428235+0000","last_undegraded":"2024-09-18T01:29:03.428235+0000","last_fullsized":"2024-09-18T01:29:03.428235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-18T01:29:03.428109+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-18T01:29:03.428109+0000","last_clean_scrub_stamp":"2024-09-18T01:29:03.428109+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:25:08.371120+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:25.982509+0000","last_change":"2024-09-18T01:29:25.982533+0000","last_active":"2024-09-18T01:29:25.982509+0000","last_peered":"2024-09-18T01:29:25.982509+0000","last_clean":"2024-09-18T01:29:25.982509+0000","last_became_active":"2024-09-18T01:25:06.684658+0000","last_became_peered":"2024-09-18T01:25:06.684658+0000","last_unstale":"2024-09-18T01:29:25.982509+0000","last_undegraded":"2024-09-18T01:29:25.982509+0000","last_fullsized":"2024-09-18T01:29:25.982509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:25.982424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:25.982424+0000","last_clean_scrub_stamp":"2024-09-18T01:29:25.982424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:22:34.882345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.324781+0000","last_change":"2024-09-18T01:28:44.324803+0000","last_active":"2024-09-18T01:28:44.324781+0000","last_peered":"2024-09-18T01:28:44.324781+0000","last_clean":"2024-09-18T01:28:44.324781+0000","last_became_active":"2024-09-18T01:25:10.679369+0000","last_became_peered":"2024-09-18T01:25:10.679369+0000","last_unstale":"2024-09-18T01:28:44.324781+0000","last_undegraded":"2024-09-18T01:28:44.324781+0000","last_fullsized":"2024-09-18T01:28:44.324781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:44.324660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:44.324660+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.324660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:21.528723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'22","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.075434+0000","last_change":"2024-09-18T01:28:52.075434+0000","last_active":"2024-09-18T01:28:52.075434+0000","last_peered":"2024-09-18T01:28:52.075434+0000","last_clean":"2024-09-18T01:28:52.075434+0000","last_became_active":"2024-09-18T01:25:12.696757+0000","last_became_peered":"2024-09-18T01:25:12.696757+0000","last_unstale":"2024-09-18T01:28:52.075434+0000","last_undegraded":"2024-09-18T01:28:52.075434+0000","last_fullsized":"2024-09-18T01:28:52.075434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-18T01:28:52.075306+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-18T01:28:52.075306+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.075306+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:59:02.612796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":385,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:33.663311+0000","last_change":"2024-09-18T01:28:33.663311+0000","last_active":"2024-09-18T01:28:33.663311+0000","last_peered":"2024-09-18T01:28:33.663311+0000","last_clean":"2024-09-18T01:28:33.663311+0000","last_became_active":"2024-09-18T01:25:14.708840+0000","last_became_peered":"2024-09-18T01:25:14.708840+0000","last_unstale":"2024-09-18T01:28:33.663311+0000","last_undegraded":"2024-09-18T01:28:33.663311+0000","last_fullsized":"2024-09-18T01:28:33.663311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-18T01:28:33.663217+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-18T01:28:33.663217+0000","last_clean_scrub_stamp":"2024-09-18T01:28:33.663217+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:17:45.430908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:11.070057+0000","last_change":"2024-09-18T01:29:11.070057+0000","last_active":"2024-09-18T01:29:11.070057+0000","last_peered":"2024-09-18T01:29:11.070057+0000","last_clean":"2024-09-18T01:29:11.070057+0000","last_became_active":"2024-09-18T01:25:16.706764+0000","last_became_peered":"2024-09-18T01:25:16.706764+0000","last_unstale":"2024-09-18T01:29:11.070057+0000","last_undegraded":"2024-09-18T01:29:11.070057+0000","last_fullsized":"2024-09-18T01:29:11.070057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:11.069944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:11.069944+0000","last_clean_scrub_stamp":"2024-09-18T01:29:11.069944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:55:33.719107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:51.788422+0000","last_change":"2024-09-18T01:28:51.788470+0000","last_active":"2024-09-18T01:28:51.788422+0000","last_peered":"2024-09-18T01:28:51.788422+0000","last_clean":"2024-09-18T01:28:51.788422+0000","last_became_active":"2024-09-18T01:25:08.669920+0000","last_became_peered":"2024-09-18T01:25:08.669920+0000","last_unstale":"2024-09-18T01:28:51.788422+0000","last_undegraded":"2024-09-18T01:28:51.788422+0000","last_fullsized":"2024-09-18T01:28:51.788422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:51.788294+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:51.788294+0000","last_clean_scrub_stamp":"2024-09-18T01:28:51.788294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:52:03.688898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:14.311265+0000","last_change":"2024-09-18T01:29:14.311308+0000","last_active":"2024-09-18T01:29:14.311265+0000","last_peered":"2024-09-18T01:29:14.311265+0000","last_clean":"2024-09-18T01:29:14.311265+0000","last_became_active":"2024-09-18T01:25:06.684984+0000","last_became_peered":"2024-09-18T01:25:06.684984+0000","last_unstale":"2024-09-18T01:29:14.311265+0000","last_undegraded":"2024-09-18T01:29:14.311265+0000","last_fullsized":"2024-09-18T01:29:14.311265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:14.311116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:14.311116+0000","last_clean_scrub_stamp":"2024-09-18T01:29:14.311116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:51.281729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:42.258238+0000","last_change":"2024-09-18T01:28:42.258260+0000","last_active":"2024-09-18T01:28:42.258238+0000","last_peered":"2024-09-18T01:28:42.258238+0000","last_clean":"2024-09-18T01:28:42.258238+0000","last_became_active":"2024-09-18T01:25:10.679468+0000","last_became_peered":"2024-09-18T01:25:10.679468+0000","last_unstale":"2024-09-18T01:28:42.258238+0000","last_undegraded":"2024-09-18T01:28:42.258238+0000","last_fullsized":"2024-09-18T01:28:42.258238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:42.258155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:42.258155+0000","last_clean_scrub_stamp":"2024-09-18T01:28:42.258155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:43:55.164530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'73","reported_seq":156,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:29.399990+0000","last_change":"2024-09-18T01:28:29.399990+0000","last_active":"2024-09-18T01:28:29.399990+0000","last_peered":"2024-09-18T01:28:29.399990+0000","last_clean":"2024-09-18T01:28:29.399990+0000","last_became_active":"2024-09-18T01:25:12.688618+0000","last_became_peered":"2024-09-18T01:25:12.688618+0000","last_unstale":"2024-09-18T01:28:29.399990+0000","last_undegraded":"2024-09-18T01:28:29.399990+0000","last_fullsized":"2024-09-18T01:28:29.399990+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'73","last_scrub_stamp":"2024-09-18T01:28:29.399801+0000","last_deep_scrub":"35'73","last_deep_scrub_stamp":"2024-09-18T01:28:29.399801+0000","last_clean_scrub_stamp":"2024-09-18T01:28:29.399801+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:16:18.035775+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:43.592338+0000","last_change":"2024-09-18T01:28:43.592338+0000","last_active":"2024-09-18T01:28:43.592338+0000","last_peered":"2024-09-18T01:28:43.592338+0000","last_clean":"2024-09-18T01:28:43.592338+0000","last_became_active":"2024-09-18T01:25:14.706586+0000","last_became_peered":"2024-09-18T01:25:14.706586+0000","last_unstale":"2024-09-18T01:28:43.592338+0000","last_undegraded":"2024-09-18T01:28:43.592338+0000","last_fullsized":"2024-09-18T01:28:43.592338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:43.592225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:43.592225+0000","last_clean_scrub_stamp":"2024-09-18T01:28:43.592225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:47:15.204874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:27.470607+0000","last_change":"2024-09-18T01:29:27.470664+0000","last_active":"2024-09-18T01:29:27.470607+0000","last_peered":"2024-09-18T01:29:27.470607+0000","last_clean":"2024-09-18T01:29:27.470607+0000","last_became_active":"2024-09-18T01:25:16.713789+0000","last_became_peered":"2024-09-18T01:25:16.713789+0000","last_unstale":"2024-09-18T01:29:27.470607+0000","last_undegraded":"2024-09-18T01:29:27.470607+0000","last_fullsized":"2024-09-18T01:29:27.470607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:27.470502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:27.470502+0000","last_clean_scrub_stamp":"2024-09-18T01:29:27.470502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:16:48.306112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.847149+0000","last_change":"2024-09-18T01:28:53.847173+0000","last_active":"2024-09-18T01:28:53.847149+0000","last_peered":"2024-09-18T01:28:53.847149+0000","last_clean":"2024-09-18T01:28:53.847149+0000","last_became_active":"2024-09-18T01:25:08.670268+0000","last_became_peered":"2024-09-18T01:25:08.670268+0000","last_unstale":"2024-09-18T01:28:53.847149+0000","last_undegraded":"2024-09-18T01:28:53.847149+0000","last_fullsized":"2024-09-18T01:28:53.847149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:53.847065+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:53.847065+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.847065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:14.842558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:21.043742+0000","last_change":"2024-09-18T01:29:21.043769+0000","last_active":"2024-09-18T01:29:21.043742+0000","last_peered":"2024-09-18T01:29:21.043742+0000","last_clean":"2024-09-18T01:29:21.043742+0000","last_became_active":"2024-09-18T01:25:06.687382+0000","last_became_peered":"2024-09-18T01:25:06.687382+0000","last_unstale":"2024-09-18T01:29:21.043742+0000","last_undegraded":"2024-09-18T01:29:21.043742+0000","last_fullsized":"2024-09-18T01:29:21.043742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:21.043645+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:21.043645+0000","last_clean_scrub_stamp":"2024-09-18T01:29:21.043645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:24:01.222359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:43.756227+0000","last_change":"2024-09-18T01:28:43.756254+0000","last_active":"2024-09-18T01:28:43.756227+0000","last_peered":"2024-09-18T01:28:43.756227+0000","last_clean":"2024-09-18T01:28:43.756227+0000","last_became_active":"2024-09-18T01:25:10.682337+0000","last_became_peered":"2024-09-18T01:25:10.682337+0000","last_unstale":"2024-09-18T01:28:43.756227+0000","last_undegraded":"2024-09-18T01:28:43.756227+0000","last_fullsized":"2024-09-18T01:28:43.756227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:43.756140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:43.756140+0000","last_clean_scrub_stamp":"2024-09-18T01:28:43.756140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:26.328226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'43","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:37.556582+0000","last_change":"2024-09-18T01:28:37.556582+0000","last_active":"2024-09-18T01:28:37.556582+0000","last_peered":"2024-09-18T01:28:37.556582+0000","last_clean":"2024-09-18T01:28:37.556582+0000","last_became_active":"2024-09-18T01:25:12.693129+0000","last_became_peered":"2024-09-18T01:25:12.693129+0000","last_unstale":"2024-09-18T01:28:37.556582+0000","last_undegraded":"2024-09-18T01:28:37.556582+0000","last_fullsized":"2024-09-18T01:28:37.556582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'43","last_scrub_stamp":"2024-09-18T01:28:37.556467+0000","last_deep_scrub":"35'43","last_deep_scrub_stamp":"2024-09-18T01:28:37.556467+0000","last_clean_scrub_stamp":"2024-09-18T01:28:37.556467+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:47:34.949630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:50.064170+0000","last_change":"2024-09-18T01:28:50.064170+0000","last_active":"2024-09-18T01:28:50.064170+0000","last_peered":"2024-09-18T01:28:50.064170+0000","last_clean":"2024-09-18T01:28:50.064170+0000","last_became_active":"2024-09-18T01:25:14.706325+0000","last_became_peered":"2024-09-18T01:25:14.706325+0000","last_unstale":"2024-09-18T01:28:50.064170+0000","last_undegraded":"2024-09-18T01:28:50.064170+0000","last_fullsized":"2024-09-18T01:28:50.064170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:50.064039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:50.064039+0000","last_clean_scrub_stamp":"2024-09-18T01:28:50.064039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:44:36.736877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:51.943463+0000","last_change":"2024-09-18T01:29:51.943489+0000","last_active":"2024-09-18T01:29:51.943463+0000","last_peered":"2024-09-18T01:29:51.943463+0000","last_clean":"2024-09-18T01:29:51.943463+0000","last_became_active":"2024-09-18T01:25:16.716084+0000","last_became_peered":"2024-09-18T01:25:16.716084+0000","last_unstale":"2024-09-18T01:29:51.943463+0000","last_undegraded":"2024-09-18T01:29:51.943463+0000","last_fullsized":"2024-09-18T01:29:51.943463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:51.943364+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:51.943364+0000","last_clean_scrub_stamp":"2024-09-18T01:29:51.943364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:56:27.900699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:06.065262+0000","last_change":"2024-09-18T01:29:06.065262+0000","last_active":"2024-09-18T01:29:06.065262+0000","last_peered":"2024-09-18T01:29:06.065262+0000","last_clean":"2024-09-18T01:29:06.065262+0000","last_became_active":"2024-09-18T01:25:08.678539+0000","last_became_peered":"2024-09-18T01:25:08.678539+0000","last_unstale":"2024-09-18T01:29:06.065262+0000","last_undegraded":"2024-09-18T01:29:06.065262+0000","last_fullsized":"2024-09-18T01:29:06.065262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:06.065116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:06.065116+0000","last_clean_scrub_stamp":"2024-09-18T01:29:06.065116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:59.304634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:20.560666+0000","last_change":"2024-09-18T01:29:20.560694+0000","last_active":"2024-09-18T01:29:20.560666+0000","last_peered":"2024-09-18T01:29:20.560666+0000","last_clean":"2024-09-18T01:29:20.560666+0000","last_became_active":"2024-09-18T01:25:06.682592+0000","last_became_peered":"2024-09-18T01:25:06.682592+0000","last_unstale":"2024-09-18T01:29:20.560666+0000","last_undegraded":"2024-09-18T01:29:20.560666+0000","last_fullsized":"2024-09-18T01:29:20.560666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:29:20.560575+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:29:20.560575+0000","last_clean_scrub_stamp":"2024-09-18T01:29:20.560575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:10.427964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:34.341623+0000","last_change":"2024-09-18T01:28:34.341623+0000","last_active":"2024-09-18T01:28:34.341623+0000","last_peered":"2024-09-18T01:28:34.341623+0000","last_clean":"2024-09-18T01:28:34.341623+0000","last_became_active":"2024-09-18T01:25:10.683833+0000","last_became_peered":"2024-09-18T01:25:10.683833+0000","last_unstale":"2024-09-18T01:28:34.341623+0000","last_undegraded":"2024-09-18T01:28:34.341623+0000","last_fullsized":"2024-09-18T01:28:34.341623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:34.341474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:34.341474+0000","last_clean_scrub_stamp":"2024-09-18T01:28:34.341474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:33.233882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'38","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.014129+0000","last_change":"2024-09-18T01:28:58.014174+0000","last_active":"2024-09-18T01:28:58.014129+0000","last_peered":"2024-09-18T01:28:58.014129+0000","last_clean":"2024-09-18T01:28:58.014129+0000","last_became_active":"2024-09-18T01:25:12.691752+0000","last_became_peered":"2024-09-18T01:25:12.691752+0000","last_unstale":"2024-09-18T01:28:58.014129+0000","last_undegraded":"2024-09-18T01:28:58.014129+0000","last_fullsized":"2024-09-18T01:28:58.014129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'38","last_scrub_stamp":"2024-09-18T01:28:58.014049+0000","last_deep_scrub":"35'38","last_deep_scrub_stamp":"2024-09-18T01:28:58.014049+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.014049+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:10:57.324269+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:07.043534+0000","last_change":"2024-09-18T01:29:07.043556+0000","last_active":"2024-09-18T01:29:07.043534+0000","last_peered":"2024-09-18T01:29:07.043534+0000","last_clean":"2024-09-18T01:29:07.043534+0000","last_became_active":"2024-09-18T01:25:14.711635+0000","last_became_peered":"2024-09-18T01:25:14.711635+0000","last_unstale":"2024-09-18T01:29:07.043534+0000","last_undegraded":"2024-09-18T01:29:07.043534+0000","last_fullsized":"2024-09-18T01:29:07.043534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:07.043432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:07.043432+0000","last_clean_scrub_stamp":"2024-09-18T01:29:07.043432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:03.921303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:49.925485+0000","last_change":"2024-09-18T01:29:49.925512+0000","last_active":"2024-09-18T01:29:49.925485+0000","last_peered":"2024-09-18T01:29:49.925485+0000","last_clean":"2024-09-18T01:29:49.925485+0000","last_became_active":"2024-09-18T01:25:16.715581+0000","last_became_peered":"2024-09-18T01:25:16.715581+0000","last_unstale":"2024-09-18T01:29:49.925485+0000","last_undegraded":"2024-09-18T01:29:49.925485+0000","last_fullsized":"2024-09-18T01:29:49.925485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:49.925390+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:49.925390+0000","last_clean_scrub_stamp":"2024-09-18T01:29:49.925390+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:25:34.472492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:52.804583+0000","last_change":"2024-09-18T01:28:52.804583+0000","last_active":"2024-09-18T01:28:52.804583+0000","last_peered":"2024-09-18T01:28:52.804583+0000","last_clean":"2024-09-18T01:28:52.804583+0000","last_became_active":"2024-09-18T01:25:08.668430+0000","last_became_peered":"2024-09-18T01:25:08.668430+0000","last_unstale":"2024-09-18T01:28:52.804583+0000","last_undegraded":"2024-09-18T01:28:52.804583+0000","last_fullsized":"2024-09-18T01:28:52.804583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:52.804464+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:52.804464+0000","last_clean_scrub_stamp":"2024-09-18T01:28:52.804464+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:58:10.937040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:18.303939+0000","last_change":"2024-09-18T01:29:18.303939+0000","last_active":"2024-09-18T01:29:18.303939+0000","last_peered":"2024-09-18T01:29:18.303939+0000","last_clean":"2024-09-18T01:29:18.303939+0000","last_became_active":"2024-09-18T01:25:06.686394+0000","last_became_peered":"2024-09-18T01:25:06.686394+0000","last_unstale":"2024-09-18T01:29:18.303939+0000","last_undegraded":"2024-09-18T01:29:18.303939+0000","last_fullsized":"2024-09-18T01:29:18.303939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:18.303802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:18.303802+0000","last_clean_scrub_stamp":"2024-09-18T01:29:18.303802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:12:51.099041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:36.382417+0000","last_change":"2024-09-18T01:28:36.382417+0000","last_active":"2024-09-18T01:28:36.382417+0000","last_peered":"2024-09-18T01:28:36.382417+0000","last_clean":"2024-09-18T01:28:36.382417+0000","last_became_active":"2024-09-18T01:25:10.683351+0000","last_became_peered":"2024-09-18T01:25:10.683351+0000","last_unstale":"2024-09-18T01:28:36.382417+0000","last_undegraded":"2024-09-18T01:28:36.382417+0000","last_fullsized":"2024-09-18T01:28:36.382417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-18T01:28:36.382253+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-18T01:28:36.382253+0000","last_clean_scrub_stamp":"2024-09-18T01:28:36.382253+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:41:10.171758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'54","reported_seq":123,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.048989+0000","last_change":"2024-09-18T01:28:35.049047+0000","last_active":"2024-09-18T01:28:35.048989+0000","last_peered":"2024-09-18T01:28:35.048989+0000","last_clean":"2024-09-18T01:28:35.048989+0000","last_became_active":"2024-09-18T01:25:12.691715+0000","last_became_peered":"2024-09-18T01:25:12.691715+0000","last_unstale":"2024-09-18T01:28:35.048989+0000","last_undegraded":"2024-09-18T01:28:35.048989+0000","last_fullsized":"2024-09-18T01:28:35.048989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'54","last_scrub_stamp":"2024-09-18T01:28:35.048876+0000","last_deep_scrub":"35'54","last_deep_scrub_stamp":"2024-09-18T01:28:35.048876+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.048876+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:53.636298+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:35.564860+0000","last_change":"2024-09-18T01:28:35.564885+0000","last_active":"2024-09-18T01:28:35.564860+0000","last_peered":"2024-09-18T01:28:35.564860+0000","last_clean":"2024-09-18T01:28:35.564860+0000","last_became_active":"2024-09-18T01:25:14.706398+0000","last_became_peered":"2024-09-18T01:25:14.706398+0000","last_unstale":"2024-09-18T01:28:35.564860+0000","last_undegraded":"2024-09-18T01:28:35.564860+0000","last_fullsized":"2024-09-18T01:28:35.564860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:35.564741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:35.564741+0000","last_clean_scrub_stamp":"2024-09-18T01:28:35.564741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:39:51.265281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:47.942634+0000","last_change":"2024-09-18T01:29:47.942634+0000","last_active":"2024-09-18T01:29:47.942634+0000","last_peered":"2024-09-18T01:29:47.942634+0000","last_clean":"2024-09-18T01:29:47.942634+0000","last_became_active":"2024-09-18T01:25:16.713579+0000","last_became_peered":"2024-09-18T01:25:16.713579+0000","last_unstale":"2024-09-18T01:29:47.942634+0000","last_undegraded":"2024-09-18T01:29:47.942634+0000","last_fullsized":"2024-09-18T01:29:47.942634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:47.942471+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:47.942471+0000","last_clean_scrub_stamp":"2024-09-18T01:29:47.942471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:23:03.493942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'8","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.239025+0000","last_change":"2024-09-18T01:28:54.239025+0000","last_active":"2024-09-18T01:28:54.239025+0000","last_peered":"2024-09-18T01:28:54.239025+0000","last_clean":"2024-09-18T01:28:54.239025+0000","last_became_active":"2024-09-18T01:25:08.686645+0000","last_became_peered":"2024-09-18T01:25:08.686645+0000","last_unstale":"2024-09-18T01:28:54.239025+0000","last_undegraded":"2024-09-18T01:28:54.239025+0000","last_fullsized":"2024-09-18T01:28:54.239025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:54.238884+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:54.238884+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.238884+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:10:44.376100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:04.762016+0000","last_change":"2024-09-18T01:29:04.762016+0000","last_active":"2024-09-18T01:29:04.762016+0000","last_peered":"2024-09-18T01:29:04.762016+0000","last_clean":"2024-09-18T01:29:04.762016+0000","last_became_active":"2024-09-18T01:25:06.702991+0000","last_became_peered":"2024-09-18T01:25:06.702991+0000","last_unstale":"2024-09-18T01:29:04.762016+0000","last_undegraded":"2024-09-18T01:29:04.762016+0000","last_fullsized":"2024-09-18T01:29:04.762016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:04.761904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:04.761904+0000","last_clean_scrub_stamp":"2024-09-18T01:29:04.761904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:25.122552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:07.539378+0000","last_change":"2024-09-18T01:29:07.539378+0000","last_active":"2024-09-18T01:29:07.539378+0000","last_peered":"2024-09-18T01:29:07.539378+0000","last_clean":"2024-09-18T01:29:07.539378+0000","last_became_active":"2024-09-18T01:25:08.672983+0000","last_became_peered":"2024-09-18T01:25:08.672983+0000","last_unstale":"2024-09-18T01:29:07.539378+0000","last_undegraded":"2024-09-18T01:29:07.539378+0000","last_fullsized":"2024-09-18T01:29:07.539378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:07.539265+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:07.539265+0000","last_clean_scrub_stamp":"2024-09-18T01:29:07.539265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:48.424256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:19.547156+0000","last_change":"2024-09-18T01:29:19.547195+0000","last_active":"2024-09-18T01:29:19.547156+0000","last_peered":"2024-09-18T01:29:19.547156+0000","last_clean":"2024-09-18T01:29:19.547156+0000","last_became_active":"2024-09-18T01:25:06.680853+0000","last_became_peered":"2024-09-18T01:25:06.680853+0000","last_unstale":"2024-09-18T01:29:19.547156+0000","last_undegraded":"2024-09-18T01:29:19.547156+0000","last_fullsized":"2024-09-18T01:29:19.547156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:19.547055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:19.547055+0000","last_clean_scrub_stamp":"2024-09-18T01:29:19.547055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:15:01.294518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'8","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.117009+0000","last_change":"2024-09-18T01:29:02.117009+0000","last_active":"2024-09-18T01:29:02.117009+0000","last_peered":"2024-09-18T01:29:02.117009+0000","last_clean":"2024-09-18T01:29:02.117009+0000","last_became_active":"2024-09-18T01:25:08.682254+0000","last_became_peered":"2024-09-18T01:25:08.682254+0000","last_unstale":"2024-09-18T01:29:02.117009+0000","last_undegraded":"2024-09-18T01:29:02.117009+0000","last_fullsized":"2024-09-18T01:29:02.117009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:02.116885+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:02.116885+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.116885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:35:11.500133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:34.011610+0000","last_change":"2024-09-18T01:29:34.011635+0000","last_active":"2024-09-18T01:29:34.011610+0000","last_peered":"2024-09-18T01:29:34.011610+0000","last_clean":"2024-09-18T01:29:34.011610+0000","last_became_active":"2024-09-18T01:25:06.682878+0000","last_became_peered":"2024-09-18T01:25:06.682878+0000","last_unstale":"2024-09-18T01:29:34.011610+0000","last_undegraded":"2024-09-18T01:29:34.011610+0000","last_fullsized":"2024-09-18T01:29:34.011610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:34.011517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:34.011517+0000","last_clean_scrub_stamp":"2024-09-18T01:29:34.011517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:26:00.016155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:05.482588+0000","last_change":"2024-09-18T01:29:05.482588+0000","last_active":"2024-09-18T01:29:05.482588+0000","last_peered":"2024-09-18T01:29:05.482588+0000","last_clean":"2024-09-18T01:29:05.482588+0000","last_became_active":"2024-09-18T01:25:08.672574+0000","last_became_peered":"2024-09-18T01:25:08.672574+0000","last_unstale":"2024-09-18T01:29:05.482588+0000","last_undegraded":"2024-09-18T01:29:05.482588+0000","last_fullsized":"2024-09-18T01:29:05.482588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:29:05.482430+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:29:05.482430+0000","last_clean_scrub_stamp":"2024-09-18T01:29:05.482430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:36:37.124121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:18.523309+0000","last_change":"2024-09-18T01:29:18.523339+0000","last_active":"2024-09-18T01:29:18.523309+0000","last_peered":"2024-09-18T01:29:18.523309+0000","last_clean":"2024-09-18T01:29:18.523309+0000","last_became_active":"2024-09-18T01:25:06.680712+0000","last_became_peered":"2024-09-18T01:25:06.680712+0000","last_unstale":"2024-09-18T01:29:18.523309+0000","last_undegraded":"2024-09-18T01:29:18.523309+0000","last_fullsized":"2024-09-18T01:29:18.523309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:18.523194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:18.523194+0000","last_clean_scrub_stamp":"2024-09-18T01:29:18.523194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:52:44.012377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.473553+0000","last_change":"2024-09-18T01:28:59.473553+0000","last_active":"2024-09-18T01:28:59.473553+0000","last_peered":"2024-09-18T01:28:59.473553+0000","last_clean":"2024-09-18T01:28:59.473553+0000","last_became_active":"2024-09-18T01:25:08.671408+0000","last_became_peered":"2024-09-18T01:25:08.671408+0000","last_unstale":"2024-09-18T01:28:59.473553+0000","last_undegraded":"2024-09-18T01:28:59.473553+0000","last_fullsized":"2024-09-18T01:28:59.473553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:59.473436+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:59.473436+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.473436+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:23:43.979561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:12.469830+0000","last_change":"2024-09-18T01:29:12.469830+0000","last_active":"2024-09-18T01:29:12.469830+0000","last_peered":"2024-09-18T01:29:12.469830+0000","last_clean":"2024-09-18T01:29:12.469830+0000","last_became_active":"2024-09-18T01:25:06.682577+0000","last_became_peered":"2024-09-18T01:25:06.682577+0000","last_unstale":"2024-09-18T01:29:12.469830+0000","last_undegraded":"2024-09-18T01:29:12.469830+0000","last_fullsized":"2024-09-18T01:29:12.469830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:12.469703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:12.469703+0000","last_clean_scrub_stamp":"2024-09-18T01:29:12.469703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:05:36.836271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'8","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:45.320051+0000","last_change":"2024-09-18T01:28:45.320051+0000","last_active":"2024-09-18T01:28:45.320051+0000","last_peered":"2024-09-18T01:28:45.320051+0000","last_clean":"2024-09-18T01:28:45.320051+0000","last_became_active":"2024-09-18T01:25:08.687797+0000","last_became_peered":"2024-09-18T01:25:08.687797+0000","last_unstale":"2024-09-18T01:28:45.320051+0000","last_undegraded":"2024-09-18T01:28:45.320051+0000","last_fullsized":"2024-09-18T01:28:45.320051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:45.319930+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:45.319930+0000","last_clean_scrub_stamp":"2024-09-18T01:28:45.319930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:09:56.008523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:17.259295+0000","last_change":"2024-09-18T01:29:17.259295+0000","last_active":"2024-09-18T01:29:17.259295+0000","last_peered":"2024-09-18T01:29:17.259295+0000","last_clean":"2024-09-18T01:29:17.259295+0000","last_became_active":"2024-09-18T01:25:06.686154+0000","last_became_peered":"2024-09-18T01:25:06.686154+0000","last_unstale":"2024-09-18T01:29:17.259295+0000","last_undegraded":"2024-09-18T01:29:17.259295+0000","last_fullsized":"2024-09-18T01:29:17.259295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:17.259180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:17.259180+0000","last_clean_scrub_stamp":"2024-09-18T01:29:17.259180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:41.001234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'8","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.490691+0000","last_change":"2024-09-18T01:28:53.490691+0000","last_active":"2024-09-18T01:28:53.490691+0000","last_peered":"2024-09-18T01:28:53.490691+0000","last_clean":"2024-09-18T01:28:53.490691+0000","last_became_active":"2024-09-18T01:25:08.680947+0000","last_became_peered":"2024-09-18T01:25:08.680947+0000","last_unstale":"2024-09-18T01:28:53.490691+0000","last_undegraded":"2024-09-18T01:28:53.490691+0000","last_fullsized":"2024-09-18T01:28:53.490691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:28:53.490566+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:28:53.490566+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.490566+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:33.730590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.848536+0000","last_change":"2024-09-18T01:29:00.848536+0000","last_active":"2024-09-18T01:29:00.848536+0000","last_peered":"2024-09-18T01:29:00.848536+0000","last_clean":"2024-09-18T01:29:00.848536+0000","last_became_active":"2024-09-18T01:25:06.703622+0000","last_became_peered":"2024-09-18T01:25:06.703622+0000","last_unstale":"2024-09-18T01:29:00.848536+0000","last_undegraded":"2024-09-18T01:29:00.848536+0000","last_fullsized":"2024-09-18T01:29:00.848536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:00.848412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:00.848412+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.848412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:47:06.895449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:59.252691+0000","last_change":"2024-09-18T01:28:59.252691+0000","last_active":"2024-09-18T01:28:59.252691+0000","last_peered":"2024-09-18T01:28:59.252691+0000","last_clean":"2024-09-18T01:28:59.252691+0000","last_became_active":"2024-09-18T01:25:08.682143+0000","last_became_peered":"2024-09-18T01:25:08.682143+0000","last_unstale":"2024-09-18T01:28:59.252691+0000","last_undegraded":"2024-09-18T01:28:59.252691+0000","last_fullsized":"2024-09-18T01:28:59.252691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:59.252539+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:59.252539+0000","last_clean_scrub_stamp":"2024-09-18T01:28:59.252539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:19.613187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.409092+0000","last_change":"2024-09-18T01:29:02.409092+0000","last_active":"2024-09-18T01:29:02.409092+0000","last_peered":"2024-09-18T01:29:02.409092+0000","last_clean":"2024-09-18T01:29:02.409092+0000","last_became_active":"2024-09-18T01:25:06.687436+0000","last_became_peered":"2024-09-18T01:25:06.687436+0000","last_unstale":"2024-09-18T01:29:02.409092+0000","last_undegraded":"2024-09-18T01:29:02.409092+0000","last_fullsized":"2024-09-18T01:29:02.409092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:02.408948+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:02.408948+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.408948+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:27.550849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'14","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.296663+0000","last_change":"2024-09-18T01:29:00.296663+0000","last_active":"2024-09-18T01:29:00.296663+0000","last_peered":"2024-09-18T01:29:00.296663+0000","last_clean":"2024-09-18T01:29:00.296663+0000","last_became_active":"2024-09-18T01:25:08.675801+0000","last_became_peered":"2024-09-18T01:25:08.675801+0000","last_unstale":"2024-09-18T01:29:00.296663+0000","last_undegraded":"2024-09-18T01:29:00.296663+0000","last_fullsized":"2024-09-18T01:29:00.296663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-18T01:29:00.296517+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-18T01:29:00.296517+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.296517+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:42:52.269835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:26.958405+0000","last_change":"2024-09-18T01:29:26.958405+0000","last_active":"2024-09-18T01:29:26.958405+0000","last_peered":"2024-09-18T01:29:26.958405+0000","last_clean":"2024-09-18T01:29:26.958405+0000","last_became_active":"2024-09-18T01:25:06.691345+0000","last_became_peered":"2024-09-18T01:25:06.691345+0000","last_unstale":"2024-09-18T01:29:26.958405+0000","last_undegraded":"2024-09-18T01:29:26.958405+0000","last_fullsized":"2024-09-18T01:29:26.958405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:26.958274+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:26.958274+0000","last_clean_scrub_stamp":"2024-09-18T01:29:26.958274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:37:15.878720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'16","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:48.037058+0000","last_change":"2024-09-18T01:28:48.037058+0000","last_active":"2024-09-18T01:28:48.037058+0000","last_peered":"2024-09-18T01:28:48.037058+0000","last_clean":"2024-09-18T01:28:48.037058+0000","last_became_active":"2024-09-18T01:25:08.685358+0000","last_became_peered":"2024-09-18T01:25:08.685358+0000","last_unstale":"2024-09-18T01:28:48.037058+0000","last_undegraded":"2024-09-18T01:28:48.037058+0000","last_fullsized":"2024-09-18T01:28:48.037058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-18T01:28:48.036938+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-18T01:28:48.036938+0000","last_clean_scrub_stamp":"2024-09-18T01:28:48.036938+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:05:58.460295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:00.429241+0000","last_change":"2024-09-18T01:29:00.429241+0000","last_active":"2024-09-18T01:29:00.429241+0000","last_peered":"2024-09-18T01:29:00.429241+0000","last_clean":"2024-09-18T01:29:00.429241+0000","last_became_active":"2024-09-18T01:25:06.695735+0000","last_became_peered":"2024-09-18T01:25:06.695735+0000","last_unstale":"2024-09-18T01:29:00.429241+0000","last_undegraded":"2024-09-18T01:29:00.429241+0000","last_fullsized":"2024-09-18T01:29:00.429241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:00.429123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:00.429123+0000","last_clean_scrub_stamp":"2024-09-18T01:29:00.429123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:01:39.782859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"35'6","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:28.528436+0000","last_change":"2024-09-18T01:29:28.528436+0000","last_active":"2024-09-18T01:29:28.528436+0000","last_peered":"2024-09-18T01:29:28.528436+0000","last_clean":"2024-09-18T01:29:28.528436+0000","last_became_active":"2024-09-18T01:25:43.849600+0000","last_became_peered":"2024-09-18T01:25:43.849600+0000","last_unstale":"2024-09-18T01:29:28.528436+0000","last_undegraded":"2024-09-18T01:29:28.528436+0000","last_fullsized":"2024-09-18T01:29:28.528436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:28.528319+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:28.528319+0000","last_clean_scrub_stamp":"2024-09-18T01:29:28.528319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:34:33.997166+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:02.302718+0000","last_change":"2024-09-18T01:29:02.302718+0000","last_active":"2024-09-18T01:29:02.302718+0000","last_peered":"2024-09-18T01:29:02.302718+0000","last_clean":"2024-09-18T01:29:02.302718+0000","last_became_active":"2024-09-18T01:25:06.688967+0000","last_became_peered":"2024-09-18T01:25:06.688967+0000","last_unstale":"2024-09-18T01:29:02.302718+0000","last_undegraded":"2024-09-18T01:29:02.302718+0000","last_fullsized":"2024-09-18T01:29:02.302718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:02.302563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:02.302563+0000","last_clean_scrub_stamp":"2024-09-18T01:29:02.302563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:50.858341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'10","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:05.327746+0000","last_change":"2024-09-18T01:29:05.327746+0000","last_active":"2024-09-18T01:29:05.327746+0000","last_peered":"2024-09-18T01:29:05.327746+0000","last_clean":"2024-09-18T01:29:05.327746+0000","last_became_active":"2024-09-18T01:25:08.683590+0000","last_became_peered":"2024-09-18T01:25:08.683590+0000","last_unstale":"2024-09-18T01:29:05.327746+0000","last_undegraded":"2024-09-18T01:29:05.327746+0000","last_fullsized":"2024-09-18T01:29:05.327746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-18T01:29:05.327617+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-18T01:29:05.327617+0000","last_clean_scrub_stamp":"2024-09-18T01:29:05.327617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:30.469517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:16.305809+0000","last_change":"2024-09-18T01:29:16.305809+0000","last_active":"2024-09-18T01:29:16.305809+0000","last_peered":"2024-09-18T01:29:16.305809+0000","last_clean":"2024-09-18T01:29:16.305809+0000","last_became_active":"2024-09-18T01:25:06.685814+0000","last_became_peered":"2024-09-18T01:25:06.685814+0000","last_unstale":"2024-09-18T01:29:16.305809+0000","last_undegraded":"2024-09-18T01:29:16.305809+0000","last_fullsized":"2024-09-18T01:29:16.305809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:29:16.305681+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:29:16.305681+0000","last_clean_scrub_stamp":"2024-09-18T01:29:16.305681+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:20.025985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:53.209000+0000","last_change":"2024-09-18T01:28:53.209000+0000","last_active":"2024-09-18T01:28:53.209000+0000","last_peered":"2024-09-18T01:28:53.209000+0000","last_clean":"2024-09-18T01:28:53.209000+0000","last_became_active":"2024-09-18T01:25:08.686703+0000","last_became_peered":"2024-09-18T01:25:08.686703+0000","last_unstale":"2024-09-18T01:28:53.209000+0000","last_undegraded":"2024-09-18T01:28:53.209000+0000","last_fullsized":"2024-09-18T01:28:53.209000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-18T01:28:53.208858+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-18T01:28:53.208858+0000","last_clean_scrub_stamp":"2024-09-18T01:28:53.208858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:49.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:24.945635+0000","last_change":"2024-09-18T01:29:24.945635+0000","last_active":"2024-09-18T01:29:24.945635+0000","last_peered":"2024-09-18T01:29:24.945635+0000","last_clean":"2024-09-18T01:29:24.945635+0000","last_became_active":"2024-09-18T01:25:06.685120+0000","last_became_peered":"2024-09-18T01:25:06.685120+0000","last_unstale":"2024-09-18T01:29:24.945635+0000","last_undegraded":"2024-09-18T01:29:24.945635+0000","last_fullsized":"2024-09-18T01:29:24.945635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:24.945495+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:24.945495+0000","last_clean_scrub_stamp":"2024-09-18T01:29:24.945495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:44:29.408596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'8","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:11.346932+0000","last_change":"2024-09-18T01:29:11.346932+0000","last_active":"2024-09-18T01:29:11.346932+0000","last_peered":"2024-09-18T01:29:11.346932+0000","last_clean":"2024-09-18T01:29:11.346932+0000","last_became_active":"2024-09-18T01:25:08.685158+0000","last_became_peered":"2024-09-18T01:25:08.685158+0000","last_unstale":"2024-09-18T01:29:11.346932+0000","last_undegraded":"2024-09-18T01:29:11.346932+0000","last_fullsized":"2024-09-18T01:29:11.346932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-18T01:29:11.346794+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-18T01:29:11.346794+0000","last_clean_scrub_stamp":"2024-09-18T01:29:11.346794+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:37.769121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:27.937030+0000","last_change":"2024-09-18T01:29:27.937030+0000","last_active":"2024-09-18T01:29:27.937030+0000","last_peered":"2024-09-18T01:29:27.937030+0000","last_clean":"2024-09-18T01:29:27.937030+0000","last_became_active":"2024-09-18T01:25:06.684845+0000","last_became_peered":"2024-09-18T01:25:06.684845+0000","last_unstale":"2024-09-18T01:29:27.937030+0000","last_undegraded":"2024-09-18T01:29:27.937030+0000","last_fullsized":"2024-09-18T01:29:27.937030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:27.936877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:27.936877+0000","last_clean_scrub_stamp":"2024-09-18T01:29:27.936877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:09.745937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:44.994102+0000","last_change":"2024-09-18T01:28:44.994102+0000","last_active":"2024-09-18T01:28:44.994102+0000","last_peered":"2024-09-18T01:28:44.994102+0000","last_clean":"2024-09-18T01:28:44.994102+0000","last_became_active":"2024-09-18T01:25:08.687840+0000","last_became_peered":"2024-09-18T01:25:08.687840+0000","last_unstale":"2024-09-18T01:28:44.994102+0000","last_undegraded":"2024-09-18T01:28:44.994102+0000","last_fullsized":"2024-09-18T01:28:44.994102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:44.993971+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:44.993971+0000","last_clean_scrub_stamp":"2024-09-18T01:28:44.993971+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:14.403429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.816170+0000","last_change":"2024-09-18T01:28:58.816170+0000","last_active":"2024-09-18T01:28:58.816170+0000","last_peered":"2024-09-18T01:28:58.816170+0000","last_clean":"2024-09-18T01:28:58.816170+0000","last_became_active":"2024-09-18T01:25:06.704247+0000","last_became_peered":"2024-09-18T01:25:06.704247+0000","last_unstale":"2024-09-18T01:28:58.816170+0000","last_undegraded":"2024-09-18T01:28:58.816170+0000","last_fullsized":"2024-09-18T01:28:58.816170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:58.816043+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:58.816043+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.816043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:36.858075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'12","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.206349+0000","last_change":"2024-09-18T01:28:58.206349+0000","last_active":"2024-09-18T01:28:58.206349+0000","last_peered":"2024-09-18T01:28:58.206349+0000","last_clean":"2024-09-18T01:28:58.206349+0000","last_became_active":"2024-09-18T01:25:08.680916+0000","last_became_peered":"2024-09-18T01:25:08.680916+0000","last_unstale":"2024-09-18T01:28:58.206349+0000","last_undegraded":"2024-09-18T01:28:58.206349+0000","last_fullsized":"2024-09-18T01:28:58.206349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-18T01:28:58.206180+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-18T01:28:58.206180+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.206180+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:27.429284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:33.030397+0000","last_change":"2024-09-18T01:29:33.030397+0000","last_active":"2024-09-18T01:29:33.030397+0000","last_peered":"2024-09-18T01:29:33.030397+0000","last_clean":"2024-09-18T01:29:33.030397+0000","last_became_active":"2024-09-18T01:25:06.693000+0000","last_became_peered":"2024-09-18T01:25:06.693000+0000","last_unstale":"2024-09-18T01:29:33.030397+0000","last_undegraded":"2024-09-18T01:29:33.030397+0000","last_fullsized":"2024-09-18T01:29:33.030397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:29:33.030229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:29:33.030229+0000","last_clean_scrub_stamp":"2024-09-18T01:29:33.030229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:09:34.335736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:29:34.965782+0000","last_change":"2024-09-18T01:29:34.965782+0000","last_active":"2024-09-18T01:29:34.965782+0000","last_peered":"2024-09-18T01:29:34.965782+0000","last_clean":"2024-09-18T01:29:34.965782+0000","last_became_active":"2024-09-18T01:25:06.691141+0000","last_became_peered":"2024-09-18T01:25:06.691141+0000","last_unstale":"2024-09-18T01:29:34.965782+0000","last_undegraded":"2024-09-18T01:29:34.965782+0000","last_fullsized":"2024-09-18T01:29:34.965782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-18T01:29:34.965662+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-18T01:29:34.965662+0000","last_clean_scrub_stamp":"2024-09-18T01:29:34.965662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:38:57.583845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'12","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:54.447736+0000","last_change":"2024-09-18T01:28:54.447736+0000","last_active":"2024-09-18T01:28:54.447736+0000","last_peered":"2024-09-18T01:28:54.447736+0000","last_clean":"2024-09-18T01:28:54.447736+0000","last_became_active":"2024-09-18T01:25:08.681053+0000","last_became_peered":"2024-09-18T01:25:08.681053+0000","last_unstale":"2024-09-18T01:28:54.447736+0000","last_undegraded":"2024-09-18T01:28:54.447736+0000","last_fullsized":"2024-09-18T01:28:54.447736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-18T01:28:54.447595+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-18T01:28:54.447595+0000","last_clean_scrub_stamp":"2024-09-18T01:28:54.447595+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:28.469233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:58.509277+0000","last_change":"2024-09-18T01:28:58.509277+0000","last_active":"2024-09-18T01:28:58.509277+0000","last_peered":"2024-09-18T01:28:58.509277+0000","last_clean":"2024-09-18T01:28:58.509277+0000","last_became_active":"2024-09-18T01:25:06.695875+0000","last_became_peered":"2024-09-18T01:25:06.695875+0000","last_unstale":"2024-09-18T01:28:58.509277+0000","last_undegraded":"2024-09-18T01:28:58.509277+0000","last_fullsized":"2024-09-18T01:28:58.509277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:28:58.509138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:28:58.509138+0000","last_clean_scrub_stamp":"2024-09-18T01:28:58.509138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:11.477929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T01:28:46.288688+0000","last_change":"2024-09-18T01:28:46.288688+0000","last_active":"2024-09-18T01:28:46.288688+0000","last_peered":"2024-09-18T01:28:46.288688+0000","last_clean":"2024-09-18T01:28:46.288688+0000","last_became_active":"2024-09-18T01:25:08.687583+0000","last_became_peered":"2024-09-18T01:25:08.687583+0000","last_unstale":"2024-09-18T01:28:46.288688+0000","last_undegraded":"2024-09-18T01:28:46.288688+0000","last_fullsized":"2024-09-18T01:28:46.288688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-18T01:28:46.288559+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-18T01:28:46.288559+0000","last_clean_scrub_stamp":"2024-09-18T01:28:46.288559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:46:19.008800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1751,"ondisk_log_size":1751,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673027,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":487424,"data_stored":155040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673027,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":744524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673028,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36364,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335476,"statfs":{"total":96636764160,"available":96599527424,"internally_reserved":0,"allocated":1044480,"data_stored":744891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":154885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:30:09.972 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-18T01:30:10.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.092+0000 7f09f0023640 1 Processor -- start 2024-09-18T01:30:10.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.092+0000 7f09f0023640 1 -- start start 2024-09-18T01:30:10.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.092+0000 7f09f0023640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f09e806eda0 0x7f09e806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:30:10.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.092+0000 7f09f0023640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e806eba0 con 0x7f09e806f6c0 2024-09-18T01:30:10.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.092+0000 7f09f0023640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f09e806d2f0 con 0x7f09e806eda0 2024-09-18T01:30:10.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.092+0000 7f09eddbf640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f09e806eda0 0x7f09e806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:30:10.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.093+0000 7f09ed5be640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f09e806f6c0 0x7f09e8121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:52508/0 (socket says 172.21.15.92:52508) 2024-09-18T01:30:10.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.093+0000 7f09ed5be640 1 -- 172.21.15.92:0/730174616 learned_addr learned my addr 172.21.15.92:0/730174616 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-09-18T01:30:10.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.093+0000 7f09eddbf640 1 -- 172.21.15.92:0/730174616 >> v1:172.21.15.92:6789/0 conn(0x7f09e806f6c0 legacy=0x7f09e8121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:30:10.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.093+0000 7f09ecdbd640 1 -- 172.21.15.92:0/730174616 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 126037 0 0) 0x7f09e806eba0 con 0x7f09e806f6c0 2024-09-18T01:30:10.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.093+0000 7f09eddbf640 1 -- 172.21.15.92:0/730174616 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e8070d50 con 0x7f09e806eda0 2024-09-18T01:30:10.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.093+0000 7f09eddbf640 1 --2- 172.21.15.92:0/730174616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09e806eda0 0x7f09e806f180 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009720 tx=0x7f09e402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc70ad86a163deb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:30:10.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.094+0000 7f09ecdbd640 1 -- 172.21.15.92:0/730174616 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e4037070 con 0x7f09e806eda0 2024-09-18T01:30:10.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.094+0000 7f09ecdbd640 1 -- 172.21.15.92:0/730174616 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e402ae20 con 0x7f09e806eda0 2024-09-18T01:30:10.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.094+0000 7f09ecdbd640 1 -- 172.21.15.92:0/730174616 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e4032590 con 0x7f09e806eda0 2024-09-18T01:30:10.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.094+0000 7f09f0023640 1 -- 172.21.15.92:0/730174616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09e806eda0 msgr2=0x7f09e806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:30:10.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.094+0000 7f09f0023640 1 --2- 172.21.15.92:0/730174616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09e806eda0 0x7f09e806f180 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009720 tx=0x7f09e402a1a0 comp rx=0 tx=0).stop 2024-09-18T01:30:10.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.094+0000 7f09f0023640 1 -- 172.21.15.92:0/730174616 shutdown_connections 2024-09-18T01:30:10.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.094+0000 7f09f0023640 1 --2- 172.21.15.92:0/730174616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09e806eda0 0x7f09e806f180 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:30:10.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.094+0000 7f09f0023640 1 -- 172.21.15.92:0/730174616 >> 172.21.15.92:0/730174616 conn(0x7f09e809a890 msgr2=0x7f09e809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:30:10.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.094+0000 7f09f0023640 1 -- 172.21.15.92:0/730174616 shutdown_connections 2024-09-18T01:30:10.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.094+0000 7f09f0023640 1 -- 172.21.15.92:0/730174616 wait complete. 2024-09-18T01:30:10.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.095+0000 7f09f0023640 1 Processor -- start 2024-09-18T01:30:10.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.095+0000 7f09f0023640 1 -- start start 2024-09-18T01:30:10.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.095+0000 7f09f0023640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09e806eda0 0x7f09e806d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:30:10.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.095+0000 7f09f0023640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f09e8122160 con 0x7f09e806eda0 2024-09-18T01:30:10.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.095+0000 7f09eddbf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09e806eda0 0x7f09e806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:30:10.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.096+0000 7f09eddbf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09e806eda0 0x7f09e806d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40044/0 (socket says 172.21.15.92:40044) 2024-09-18T01:30:10.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.096+0000 7f09eddbf640 1 -- 172.21.15.92:0/2078119441 learned_addr learned my addr 172.21.15.92:0/2078119441 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-18T01:30:10.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.096+0000 7f09eddbf640 1 -- 172.21.15.92:0/2078119441 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e8128b00 con 0x7f09e806eda0 2024-09-18T01:30:10.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.096+0000 7f09eddbf640 1 --2- 172.21.15.92:0/2078119441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09e806eda0 0x7f09e806d910 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f09e4035040 tx=0x7f09e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:30:10.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.096+0000 7f09de7fc640 1 -- 172.21.15.92:0/2078119441 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e4037040 con 0x7f09e806eda0 2024-09-18T01:30:10.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.096+0000 7f09de7fc640 1 -- 172.21.15.92:0/2078119441 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e4032e30 con 0x7f09e806eda0 2024-09-18T01:30:10.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.096+0000 7f09de7fc640 1 -- 172.21.15.92:0/2078119441 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e4004160 con 0x7f09e806eda0 2024-09-18T01:30:10.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.096+0000 7f09f0023640 1 -- 172.21.15.92:0/2078119441 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e808df60 con 0x7f09e806eda0 2024-09-18T01:30:10.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.096+0000 7f09f0023640 1 -- 172.21.15.92:0/2078119441 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e806de50 con 0x7f09e806eda0 2024-09-18T01:30:10.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.097+0000 7f09f0023640 1 -- 172.21.15.92:0/2078119441 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e8122670 con 0x7f09e806eda0 2024-09-18T01:30:10.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.097+0000 7f09de7fc640 1 -- 172.21.15.92:0/2078119441 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f09e403a040 con 0x7f09e806eda0 2024-09-18T01:30:10.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.097+0000 7f09de7fc640 1 --2- 172.21.15.92:0/2078119441 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f09cc0382a0 0x7f09cc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:30:10.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.097+0000 7f09de7fc640 1 -- 172.21.15.92:0/2078119441 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f09e406c460 con 0x7f09e806eda0 2024-09-18T01:30:10.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.098+0000 7f09ed5be640 1 --2- 172.21.15.92:0/2078119441 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f09cc0382a0 0x7f09cc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:30:10.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.098+0000 7f09ed5be640 1 --2- 172.21.15.92:0/2078119441 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f09cc0382a0 0x7f09cc03a760 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f09d8000c00 tx=0x7f09d8007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:30:10.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.101+0000 7f09de7fc640 1 -- 172.21.15.92:0/2078119441 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09e4042020 con 0x7f09e806eda0 2024-09-18T01:30:10.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.266+0000 7f09f0023640 1 -- 172.21.15.92:0/2078119441 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f09e8096e60 con 0x7f09e806eda0 2024-09-18T01:30:10.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.269+0000 7f09de7fc640 1 -- 172.21.15.92:0/2078119441 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f09e40043b0 con 0x7f09e806eda0 2024-09-18T01:30:10.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.269+0000 7f09de7fc640 1 -- 172.21.15.92:0/2078119441 <== mon.0 v2:172.21.15.92:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f09e406c0d0 con 0x7f09e806eda0 2024-09-18T01:30:10.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.271+0000 7f09f0023640 1 -- 172.21.15.92:0/2078119441 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f09cc0382a0 msgr2=0x7f09cc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:30:10.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.271+0000 7f09f0023640 1 --2- 172.21.15.92:0/2078119441 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f09cc0382a0 0x7f09cc03a760 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f09d8000c00 tx=0x7f09d8007910 comp rx=0 tx=0).stop 2024-09-18T01:30:10.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.271+0000 7f09f0023640 1 -- 172.21.15.92:0/2078119441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09e806eda0 msgr2=0x7f09e806d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:30:10.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.271+0000 7f09f0023640 1 --2- 172.21.15.92:0/2078119441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09e806eda0 0x7f09e806d910 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f09e4035040 tx=0x7f09e40046c0 comp rx=0 tx=0).stop 2024-09-18T01:30:10.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.271+0000 7f09f0023640 1 -- 172.21.15.92:0/2078119441 shutdown_connections 2024-09-18T01:30:10.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.271+0000 7f09f0023640 1 --2- 172.21.15.92:0/2078119441 >> [v2:172.21.15.100:6824/2336055460,v1:172.21.15.100:6825/2336055460] conn(0x7f09cc0382a0 0x7f09cc03a760 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:30:10.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.271+0000 7f09f0023640 1 --2- 172.21.15.92:0/2078119441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09e806eda0 0x7f09e806d910 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:30:10.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.271+0000 7f09f0023640 1 -- 172.21.15.92:0/2078119441 >> 172.21.15.92:0/2078119441 conn(0x7f09e809a890 msgr2=0x7f09e8097ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:30:10.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.271+0000 7f09f0023640 1 -- 172.21.15.92:0/2078119441 shutdown_connections 2024-09-18T01:30:10.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-18T01:30:10.271+0000 7f09f0023640 1 -- 172.21.15.92:0/2078119441 wait complete. 2024-09-18T01:30:10.283 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-18T01:30:10.283 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-18T01:30:10.283 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-18T01:30:10.283 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T01:30:10.316 INFO:tasks.ceph.osd.0:Stopped 2024-09-18T01:30:10.317 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-18T01:30:10.317 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T01:30:10.350 INFO:tasks.ceph.osd.1:Stopped 2024-09-18T01:30:10.350 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-18T01:30:10.350 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T01:30:10.419 INFO:tasks.ceph.osd.2:Stopped 2024-09-18T01:30:10.419 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-18T01:30:10.419 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T01:30:10.504 INFO:tasks.ceph.osd.3:Stopped 2024-09-18T01:30:10.505 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-18T01:30:10.505 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-18T01:30:10.505 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T01:30:10.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-09-18T01:30:10.533 INFO:tasks.ceph.mgr.x:Stopped 2024-09-18T01:30:10.533 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-18T01:30:10.533 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-18T01:30:10.533 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T01:30:10.545 INFO:tasks.ceph.mon.a:Stopped 2024-09-18T01:30:10.545 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-18T01:30:10.545 DEBUG:teuthology.orchestra.run.smithi092:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-18T01:30:10.654 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi092.front.sepia.ceph.com 2024-09-18T01:30:10.655 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-18T01:30:10.801 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T01:30:10.801 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-18T01:30:10.945 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T01:30:10.946 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-18T01:30:11.040 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T01:30:11.040 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-18T01:30:11.098 INFO:tasks.ceph:Archiving mon data... 2024-09-18T01:30:11.099 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909724/data/mon.a.tgz 2024-09-18T01:30:11.100 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-09-18T01:30:11.116 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.kLFQb5xPAP 2024-09-18T01:30:11.116 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.kLFQb5xPAP 2024-09-18T01:30:11.249 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.kLFQb5xPAP 2024-09-18T01:30:11.331 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.kLFQb5xPAP is 271KB 2024-09-18T01:30:11.398 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.kLFQb5xPAP 2024-09-18T01:30:11.413 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-18T01:30:11.413 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T01:30:11.454 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T01:30:11.532 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-18T01:30:11.550 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-18T01:30:11.550 INFO:tasks.ceph:Archiving crash dumps... 2024-09-18T01:30:11.551 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909724/remote/smithi092/crash 2024-09-18T01:30:11.552 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T01:30:11.596 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909724/remote/smithi100/crash 2024-09-18T01:30:11.597 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T01:30:11.672 INFO:tasks.ceph:Compressing logs... 2024-09-18T01:30:11.672 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T01:30:11.675 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T01:30:11.696 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-18T01:30:11.731 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31351.log 2024-09-18T01:30:11.731 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31879.log 2024-09-18T01:30:11.731 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.31351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31243.log 2024-09-18T01:30:11.731 INFO:teuthology.orchestra.run.smithi092.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31351.log.gz 2024-09-18T01:30:11.731 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31413.log 2024-09-18T01:30:11.731 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27230.log 2024-09-18T01:30:11.732 INFO:teuthology.orchestra.run.smithi092.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31879.log.gz 2024-09-18T01:30:11.732 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31243.log: /var/log/ceph/ceph-client.admin.31413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30889.log 2024-09-18T01:30:11.732 INFO:teuthology.orchestra.run.smithi092.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31243.log.gz 2024-09-18T01:30:11.732 INFO:teuthology.orchestra.run.smithi092.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31413.log.gz 2024-09-18T01:30:11.732 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph.tmp-client.admin.27230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29071.log 2024-09-18T01:30:11.732 INFO:teuthology.orchestra.run.smithi092.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27230.log.gz 2024-09-18T01:30:11.732 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31559.log 2024-09-18T01:30:11.732 INFO:teuthology.orchestra.run.smithi092.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30889.log.gz 2024-09-18T01:30:11.732 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.29071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31921.log 2024-09-18T01:30:11.732 INFO:teuthology.orchestra.run.smithi092.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.29071.log.gz 2024-09-18T01:30:11.732 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31183.log 2024-09-18T01:30:11.732 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31921.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.31559.log.gz 2024-09-18T01:30:11.732 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30931.log 2024-09-18T01:30:11.733 INFO:teuthology.orchestra.run.smithi092.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31921.log.gz 2024-09-18T01:30:11.733 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28953.log 2024-09-18T01:30:11.733 INFO:teuthology.orchestra.run.smithi092.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31183.log.gz 2024-09-18T01:30:11.733 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32467.log 2024-09-18T01:30:11.733 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.28953.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30931.log.gz 2024-09-18T01:30:11.733 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30973.log 2024-09-18T01:30:11.733 INFO:teuthology.orchestra.run.smithi092.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28953.log.gz 2024-09-18T01:30:11.733 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.32467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31072.log 2024-09-18T01:30:11.733 INFO:teuthology.orchestra.run.smithi092.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32467.log.gz 2024-09-18T01:30:11.733 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31687.log 2024-09-18T01:30:11.733 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31072.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30973.log.gz 2024-09-18T01:30:11.733 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-18T01:30:11.733 INFO:teuthology.orchestra.run.smithi092.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31072.log.gz 2024-09-18T01:30:11.734 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31242.log 2024-09-18T01:30:11.734 INFO:teuthology.orchestra.run.smithi092.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31687.log.gz 2024-09-18T01:30:11.734 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32299.log 2024-09-18T01:30:11.734 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31073.log 2024-09-18T01:30:11.734 INFO:teuthology.orchestra.run.smithi092.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31242.log.gz 2024-09-18T01:30:11.734 INFO:teuthology.orchestra.run.smithi092.stderr: 88.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-18T01:30:11.734 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.32299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31519.log 2024-09-18T01:30:11.734 INFO:teuthology.orchestra.run.smithi092.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32299.log.gz 2024-09-18T01:30:11.734 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32047.log 2024-09-18T01:30:11.734 INFO:teuthology.orchestra.run.smithi092.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31073.log.gz 2024-09-18T01:30:11.734 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31771.log 2024-09-18T01:30:11.734 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.32047.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31519.log.gz 2024-09-18T01:30:11.734 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32089.log 2024-09-18T01:30:11.734 INFO:teuthology.orchestra.run.smithi092.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32047.log.gz 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32005.log 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31771.log.gz 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.32089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30757.log 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.32005.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32089.log.gz 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30671.log 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32005.log.gz 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31963.log 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30757.log.gz 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31391.log 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30671.log: /var/log/ceph/ceph-client.admin.31963.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30671.log.gz 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31963.log.gz 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31837.log 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31391.log.gz 2024-09-18T01:30:11.735 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32594.log 2024-09-18T01:30:11.736 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30838.log 2024-09-18T01:30:11.736 INFO:teuthology.orchestra.run.smithi092.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31837.log.gz 2024-09-18T01:30:11.736 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.32594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29111.log 2024-09-18T01:30:11.736 INFO:teuthology.orchestra.run.smithi092.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.32594.log.gz 2024-09-18T01:30:11.736 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31590.log 2024-09-18T01:30:11.736 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30838.log: /var/log/ceph/ceph-client.admin.29111.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30838.log.gz 2024-09-18T01:30:11.736 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31729.log 2024-09-18T01:30:11.736 INFO:teuthology.orchestra.run.smithi092.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.29111.log.gz 2024-09-18T01:30:11.736 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32131.log 2024-09-18T01:30:11.736 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31590.log: /var/log/ceph/ceph-client.admin.31729.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31590.log.gz 2024-09-18T01:30:11.736 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-18T01:30:11.736 INFO:teuthology.orchestra.run.smithi092.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31729.log.gz 2024-09-18T01:30:11.736 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31075.log 2024-09-18T01:30:11.737 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.32131.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32553.log 2024-09-18T01:30:11.737 INFO:teuthology.orchestra.run.smithi092.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32131.log.gz 2024-09-18T01:30:11.737 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32509.log 2024-09-18T01:30:11.737 INFO:teuthology.orchestra.run.smithi092.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31075.log.gz 2024-09-18T01:30:11.737 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.32553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31074.log 2024-09-18T01:30:11.737 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.32509.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32553.log.gz 2024-09-18T01:30:11.737 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31390.log 2024-09-18T01:30:11.737 INFO:teuthology.orchestra.run.smithi092.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32509.log.gz 2024-09-18T01:30:11.737 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32341.log 2024-09-18T01:30:11.737 INFO:teuthology.orchestra.run.smithi092.stderr: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-18T01:30:11.737 INFO:teuthology.orchestra.run.smithi092.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31074.log.gz 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.31390.log: -- /var/log/ceph/ceph-client.admin.31558.log 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.32341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32425.log 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31390.log.gz 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32341.log.gz 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.31558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32215.log 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31558.log.gz 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32257.log 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.32425.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32425.log.gz 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.32215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32173.log 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32215.log.gz 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30813.log 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.32257.log: /var/log/ceph/ceph-client.admin.32173.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32257.log.gz 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31241.log 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32173.log.gz 2024-09-18T01:30:11.738 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32383.log 2024-09-18T01:30:11.739 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30813.log: /var/log/ceph/ceph-client.admin.31241.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30813.log.gz 2024-09-18T01:30:11.739 INFO:teuthology.orchestra.run.smithi092.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31241.log.gz 2024-09-18T01:30:11.739 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.32383.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32383.log.gz 2024-09-18T01:30:11.775 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66123.log 2024-09-18T01:30:11.776 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80643.log 2024-09-18T01:30:11.776 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53418.log 2024-09-18T01:30:11.776 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.66123.log: /var/log/ceph/ceph-client.0.80643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50998.log 2024-09-18T01:30:11.776 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.53418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59468.log 2024-09-18T01:30:11.776 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.50998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77013.log 2024-09-18T01:30:11.776 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80643.log.gz 2024-09-18T01:30:11.776 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.59468.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.66123.log.gz 2024-09-18T01:30:11.776 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57653.log 2024-09-18T01:30:11.776 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53418.log.gz 2024-09-18T01:30:11.776 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.77013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84273.log 2024-09-18T01:30:11.776 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.50998.log.gz 2024-09-18T01:30:11.777 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.57653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48578.log 2024-09-18T01:30:11.777 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.84273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35650.log 2024-09-18T01:30:11.777 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.59468.log.gz 2024-09-18T01:30:11.777 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77013.log.gz 2024-09-18T01:30:11.777 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87274.log 2024-09-18T01:30:11.777 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.48578.log: /var/log/ceph/ceph-client.admin.35650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60073.log 2024-09-18T01:30:11.777 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.57653.log.gz 2024-09-18T01:30:11.777 INFO:teuthology.orchestra.run.smithi100.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.35650.log.gz 2024-09-18T01:30:11.777 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.87274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47973.log 2024-09-18T01:30:11.777 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.60073.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84273.log.gz 2024-09-18T01:30:11.777 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-18T01:30:11.777 INFO:teuthology.orchestra.run.smithi100.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.87274.log.gz 2024-09-18T01:30:11.777 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.47973.log: gzip -5 --verbose 91.3% -- -- replaced with /var/log/ceph/ceph-client.0.48578.log.gz /var/log/ceph/ceph-client.0.58258.log 2024-09-18T01:30:11.777 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-18T01:30:11.778 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-18T01:30:11.778 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.58258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51603.log 2024-09-18T01:30:11.778 INFO:teuthology.orchestra.run.smithi100.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.60073.log.gz 2024-09-18T01:30:11.778 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43133.log 2024-09-18T01:30:11.778 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47973.log.gz 2024-09-18T01:30:11.778 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.51603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31263.log 2024-09-18T01:30:11.778 INFO:teuthology.orchestra.run.smithi100.stderr: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-18T01:30:11.778 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.58258.log.gz 2024-09-18T01:30:11.778 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.43133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39509.log 2024-09-18T01:30:11.778 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86675.log 2024-09-18T01:30:11.778 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.31263.log: /var/log/ceph/ceph-client.0.39509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89688.log 2024-09-18T01:30:11.778 INFO:teuthology.orchestra.run.smithi100.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.31263.log.gz 2024-09-18T01:30:11.778 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51603.log.gz 2024-09-18T01:30:11.779 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.86675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46158.log 2024-09-18T01:30:11.779 INFO:teuthology.orchestra.run.smithi100.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.39509.log.gz 2024-09-18T01:30:11.779 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.43133.log.gz 2024-09-18T01:30:11.779 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95738.log 2024-09-18T01:30:11.779 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.89688.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.86675.log.gz 2024-09-18T01:30:11.779 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.46158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46763.log 2024-09-18T01:30:11.779 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.95738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90898.log 2024-09-18T01:30:11.779 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.46763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56443.log 2024-09-18T01:30:11.779 INFO:teuthology.orchestra.run.smithi100.stderr:gzip/var/log/ceph/ceph-client.0.90898.log: -5 --verbose -- /var/log/ceph/ceph-client.0.63098.log 2024-09-18T01:30:11.779 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% 91.2% -- replaced with /var/log/ceph/ceph-client.0.89688.log.gz 2024-09-18T01:30:11.779 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.0.46158.log.gz 2024-09-18T01:30:11.779 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.56443.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.95738.log.gz 2024-09-18T01:30:11.779 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54628.log 2024-09-18T01:30:11.779 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.63098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90293.log 2024-09-18T01:30:11.780 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.46763.log.gz 2024-09-18T01:30:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.54628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58863.log 2024-09-18T01:30:11.780 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.90898.log.gz 2024-09-18T01:30:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.90293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44948.log 2024-09-18T01:30:11.780 INFO:teuthology.orchestra.run.smithi100.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56443.log.gz 2024-09-18T01:30:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.58863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72778.log 2024-09-18T01:30:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.44948.log: gzip 91.0% -- replaced with /var/log/ceph/ceph-client.0.63098.log.gz 2024-09-18T01:30:11.780 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.42528.log 2024-09-18T01:30:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.72778.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.54628.log.gz 2024-09-18T01:30:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64913.log 2024-09-18T01:30:11.780 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.90293.log.gz 2024-09-18T01:30:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.42528.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.58863.log.gz 2024-09-18T01:30:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88478.log 2024-09-18T01:30:11.781 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44948.log.gz 2024-09-18T01:30:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.64913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61888.log 2024-09-18T01:30:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.88478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57048.log 2024-09-18T01:30:11.781 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72778.log.gz 2024-09-18T01:30:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.61888.log: gzip 91.3% -- replaced with /var/log/ceph/ceph-client.0.42528.log.gz 2024-09-18T01:30:11.781 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.54023.log 2024-09-18T01:30:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.57048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35610.log 2024-09-18T01:30:11.781 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.88478.log.gz 2024-09-18T01:30:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.54023.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64913.log.gz 2024-09-18T01:30:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78223.log 2024-09-18T01:30:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31182.log 2024-09-18T01:30:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.35610.log: /var/log/ceph/ceph-client.0.78223.log: gzip 86.5% -- replaced with /var/log/ceph/ceph-client.admin.35610.log.gz 2024-09-18T01:30:11.781 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose 91.3% -- replaced with /var/log/ceph/ceph-client.0.61888.log.gz 2024-09-18T01:30:11.782 INFO:teuthology.orchestra.run.smithi100.stderr: -- /var/log/ceph/ceph-client.0.82458.log 91.4% -- replaced with /var/log/ceph/ceph-client.0.57048.log.gz 2024-09-18T01:30:11.782 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-18T01:30:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.31182.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54023.log.gz 2024-09-18T01:30:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36484.log 2024-09-18T01:30:11.782 INFO:teuthology.orchestra.run.smithi100.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.31182.log.gz 2024-09-18T01:30:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.82458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86076.log 2024-09-18T01:30:11.782 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78223.log.gz 2024-09-18T01:30:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.36484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69753.log 2024-09-18T01:30:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73988.log 2024-09-18T01:30:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.86076.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.82458.log.gz 2024-09-18T01:30:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.69753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87873.log 2024-09-18T01:30:11.782 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.86076.log.gz 2024-09-18T01:30:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.73988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31223.log 2024-09-18T01:30:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.87873.log: 92.0%gzip -- replaced with /var/log/ceph/ceph-client.0.36484.log.gz 2024-09-18T01:30:11.783 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.72173.log 2024-09-18T01:30:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.31223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65518.log 2024-09-18T01:30:11.783 INFO:teuthology.orchestra.run.smithi100.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.31223.log.gz/var/log/ceph/ceph-client.0.72173.log: 2024-09-18T01:30:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93318.log 2024-09-18T01:30:11.783 INFO:teuthology.orchestra.run.smithi100.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.73988.log.gz 2024-09-18T01:30:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.65518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52208.log 2024-09-18T01:30:11.783 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.87873.log.gz 2024-09-18T01:30:11.783 INFO:teuthology.orchestra.run.smithi100.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.69753.log.gz 2024-09-18T01:30:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:gzip/var/log/ceph/ceph-client.0.93318.log: -5 --verbose -- /var/log/ceph/ceph-client.0.61283.log 2024-09-18T01:30:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.52208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75198.log 2024-09-18T01:30:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.61283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60678.log 2024-09-18T01:30:11.783 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% 91.2% -- replaced with /var/log/ceph/ceph-client.0.65518.log.gz 2024-09-18T01:30:11.783 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.0.93318.log.gz/var/log/ceph/ceph-client.0.75198.log: 2024-09-18T01:30:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85477.log 2024-09-18T01:30:11.784 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.52208.log.gz 2024-09-18T01:30:11.784 INFO:teuthology.orchestra.run.smithi100.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.72173.log.gz 2024-09-18T01:30:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.60678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43738.log 2024-09-18T01:30:11.784 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61283.log.gz 2024-09-18T01:30:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.85477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55838.log 2024-09-18T01:30:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49183.log 2024-09-18T01:30:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.43738.log: /var/log/ceph/ceph-client.0.55838.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75198.log.gz 2024-09-18T01:30:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40713.log 2024-09-18T01:30:11.784 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% 91.5% -- replaced with /var/log/ceph/ceph-client.0.85477.log.gz 2024-09-18T01:30:11.784 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.0.60678.log.gz 2024-09-18T01:30:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.49183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63703.log 2024-09-18T01:30:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.40713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71568.log 2024-09-18T01:30:11.784 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43738.log.gz 2024-09-18T01:30:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.63703.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55838.log.gz 2024-09-18T01:30:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91503.log 2024-09-18T01:30:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81853.log 2024-09-18T01:30:11.785 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.49183.log.gz 2024-09-18T01:30:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.71568.log: /var/log/ceph/ceph-client.0.91503.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40713.log.gz 2024-09-18T01:30:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64308.log 2024-09-18T01:30:11.785 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63703.log.gz 2024-09-18T01:30:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.81853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38904.log 2024-09-18T01:30:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92108.log 2024-09-18T01:30:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.64308.log: /var/log/ceph/ceph-client.0.38904.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91503.log.gz 2024-09-18T01:30:11.785 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.71568.log.gz 2024-09-18T01:30:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55233.log 2024-09-18T01:30:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.92108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44343.log 2024-09-18T01:30:11.786 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.55233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80038.log 2024-09-18T01:30:11.786 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.44343.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.64308.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.45553.log 2024-09-18T01:30:11.786 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-18T01:30:11.786 INFO:teuthology.orchestra.run.smithi100.stderr:gzip 91.4% -- replaced with /var/log/ceph/ceph-client.0.38904.log.gz 2024-09-18T01:30:11.786 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92108.log.gz 2024-09-18T01:30:11.786 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.93923.log 2024-09-18T01:30:11.786 INFO:teuthology.orchestra.run.smithi100.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.81853.log.gz 2024-09-18T01:30:11.786 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.80038.log: /var/log/ceph/ceph-client.0.45553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77618.log 2024-09-18T01:30:11.786 INFO:teuthology.orchestra.run.smithi100.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.55233.log.gz 2024-09-18T01:30:11.786 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.93923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66728.log 2024-09-18T01:30:11.786 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.44343.log.gz 2024-09-18T01:30:11.786 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.77618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62493.log 2024-09-18T01:30:11.786 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.45553.log.gz 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.66728.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80038.log.gz 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93923.log.gz 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.62493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35530.log 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.77618.log.gz 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84878.log 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.35530.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.66728.log.gz 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94528.log 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.35530.log.gz 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:gzip/var/log/ceph/ceph-client.0.84878.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35690.log 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.94528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70963.log 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.62493.log.gz/var/log/ceph/ceph-client.admin.35690.log: 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.84878.log.gz 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40108.log 2024-09-18T01:30:11.787 INFO:teuthology.orchestra.run.smithi100.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.35690.log.gz 2024-09-18T01:30:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.70963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67938.log 2024-09-18T01:30:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.40108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41318.log 2024-09-18T01:30:11.788 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94528.log.gz 2024-09-18T01:30:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.67938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75803.log 2024-09-18T01:30:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.41318.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.70963.log.gz 2024-09-18T01:30:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-18T01:30:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.75803.log: gzip -5 91.8% -- replaced with /var/log/ceph/ceph-client.0.40108.log.gz 2024-09-18T01:30:11.788 INFO:teuthology.orchestra.run.smithi100.stderr: --verbose -- /var/log/ceph/ceph-client.0.74593.log 2024-09-18T01:30:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37694.log 2024-09-18T01:30:11.788 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.67938.log.gz 2024-09-18T01:30:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.74593.log: gzip -5 91.3% -- replaced with /var/log/ceph/ceph-client.0.41318.log.gz 2024-09-18T01:30:11.788 INFO:teuthology.orchestra.run.smithi100.stderr: --verbose -- /var/log/ceph/ceph-client.0.52813.log 2024-09-18T01:30:11.788 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75803.log.gz 2024-09-18T01:30:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.37694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41923.log 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.52813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73383.log 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.41923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38299.log 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74593.log.gz 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.73383.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37694.log.gz 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52813.log.gz 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76408.log 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.41923.log.gz 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.38299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79433.log 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.73383.log.gz 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.76408.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.79433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89083.log 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/rgw.ceph.client.0.log: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92713.log 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.0.38299.log.gz 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76408.log.gz 2024-09-18T01:30:11.789 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78828.log 2024-09-18T01:30:11.790 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.89083.log: /var/log/ceph/ceph-client.0.92713.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.79433.log.gz 2024-09-18T01:30:11.790 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37089.log 2024-09-18T01:30:11.790 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% 91.1% -- replaced with /var/log/ceph/ceph-client.0.92713.log.gz 2024-09-18T01:30:11.790 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.78828.log: -- replaced with /var/log/ceph/ceph-client.0.89083.log.gz 2024-09-18T01:30:11.790 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68543.log 2024-09-18T01:30:11.790 INFO:teuthology.orchestra.run.smithi100.stderr:gzip/var/log/ceph/ceph-client.0.37089.log: -5 --verbose -- /var/log/ceph/ceph-client.0.70358.log 2024-09-18T01:30:11.790 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.68543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47368.log 2024-09-18T01:30:11.790 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1%/var/log/ceph/ceph-client.0.70358.log: -- replaced with /var/log/ceph/ceph-client.0.78828.log.gz 2024-09-18T01:30:11.790 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49788.log 2024-09-18T01:30:11.790 INFO:teuthology.orchestra.run.smithi100.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37089.log.gz 2024-09-18T01:30:11.790 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.47368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31311.log 2024-09-18T01:30:11.790 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.49788.log: 92.6% -- replaced with /var/log/ceph/ceph-client.0.68543.log.gz 2024-09-18T01:30:11.790 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.47368.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.81248.log 2024-09-18T01:30:11.790 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-18T01:30:11.791 INFO:teuthology.orchestra.run.smithi100.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.70358.log.gz 2024-09-18T01:30:11.791 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.31311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95133.log 2024-09-18T01:30:11.791 INFO:teuthology.orchestra.run.smithi100.stderr: 84.7% 91.1% -- replaced with /var/log/ceph/ceph-client.0.49788.log.gz 2024-09-18T01:30:11.791 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31311.log.gz/var/log/ceph/ceph-client.0.81248.log: 2024-09-18T01:30:11.791 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-18T01:30:11.791 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.95133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67333.log 2024-09-18T01:30:11.791 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50393.log 2024-09-18T01:30:11.791 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.67333.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.95133.log.gz 2024-09-18T01:30:11.791 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96395.log 2024-09-18T01:30:11.791 INFO:teuthology.orchestra.run.smithi100.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.81248.log.gz 2024-09-18T01:30:11.791 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.50393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69148.log 2024-09-18T01:30:11.791 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.96395.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.67333.log.gz 2024-09-18T01:30:11.791 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50393.log.gz 2024-09-18T01:30:11.791 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35570.log 2024-09-18T01:30:11.792 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.69148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83063.log 2024-09-18T01:30:11.792 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.35570.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.35570.log.gz 2024-09-18T01:30:11.792 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83668.log 2024-09-18T01:30:11.792 INFO:teuthology.orchestra.run.smithi100.stderr: 93.2%/var/log/ceph/ceph-client.0.83063.log: -- replaced with /var/log/ceph/ceph-client.0.96395.log.gz 2024-09-18T01:30:11.792 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.83668.log: 93.3% 91.3% -- replaced with /var/log/ceph/ceph-client.0.83063.log.gz 2024-09-18T01:30:11.792 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.0.69148.log.gz 2024-09-18T01:30:11.792 INFO:teuthology.orchestra.run.smithi100.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.83668.log.gz 2024-09-18T01:30:11.792 INFO:teuthology.orchestra.run.smithi100.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-18T01:30:11.795 INFO:teuthology.orchestra.run.smithi100.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-18T01:30:11.875 INFO:teuthology.orchestra.run.smithi092.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-18T01:30:12.678 INFO:teuthology.orchestra.run.smithi100.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-18T01:30:12.694 INFO:teuthology.orchestra.run.smithi092.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-18T01:30:12.696 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-18T01:30:12.696 INFO:teuthology.orchestra.run.smithi092.stderr:real 0m1.009s 2024-09-18T01:30:12.696 INFO:teuthology.orchestra.run.smithi092.stderr:user 0m1.150s 2024-09-18T01:30:12.696 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m0.081s 2024-09-18T01:30:12.790 INFO:teuthology.orchestra.run.smithi100.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-18T01:30:12.846 INFO:teuthology.orchestra.run.smithi100.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-18T01:30:12.848 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-18T01:30:12.848 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m1.157s 2024-09-18T01:30:12.848 INFO:teuthology.orchestra.run.smithi100.stderr:user 0m3.261s 2024-09-18T01:30:12.848 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m0.222s 2024-09-18T01:30:12.849 INFO:tasks.ceph:Archiving logs... 2024-09-18T01:30:12.849 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909724/remote/smithi092/log 2024-09-18T01:30:12.850 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T01:30:13.097 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909724/remote/smithi100/log 2024-09-18T01:30:13.097 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T01:30:13.668 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-18T01:30:13.678 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-18T01:30:13.679 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T01:30:13.681 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T01:30:13.762 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-18T01:30:13.772 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-18T01:30:13.772 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T01:30:13.775 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T01:30:13.788 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-18T01:30:13.789 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-18T01:30:13.792 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T01:30:13.792 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-18T01:30:13.792 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 -15us[+4120ns] +/- 51ms 2024-09-18T01:30:13.792 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 -1328us[-1328us] +/- 44ms 2024-09-18T01:30:13.793 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +2340us[+2340us] +/- 75ms 2024-09-18T01:30:13.793 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:30:13.794 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T01:30:13.794 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-18T01:30:13.794 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 -34us[-9461ns] +/- 51ms 2024-09-18T01:30:13.795 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 30 -1334us[-1309us] +/- 44ms 2024-09-18T01:30:13.795 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 +2308us[+2308us] +/- 75ms 2024-09-18T01:30:13.795 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:30:13.795 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-18T01:30:13.806 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-18T01:30:13.806 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-18T01:30:13.816 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T01:30:13.898 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T01:30:13.959 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T01:30:13.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:30:13.986 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T01:30:14.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:30:14.014 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-18T01:30:14.023 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-18T01:30:14.031 INFO:teuthology.task.internal:Duration was 714.150952 seconds 2024-09-18T01:30:14.031 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-18T01:30:14.040 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-18T01:30:14.040 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T01:30:14.042 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T01:30:14.078 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T01:30:14.091 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T01:30:14.494 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-18T01:30:14.494 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2024-09-18T01:30:14.494 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T01:30:14.555 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T01:30:14.555 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T01:30:14.585 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-18T01:30:14.585 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T01:30:14.598 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T01:30:14.652 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-18T01:30:14.652 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T01:30:14.665 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T01:30:14.792 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-18T01:30:14.802 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-18T01:30:14.803 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T01:30:14.827 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T01:30:14.852 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-18T01:30:14.861 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T01:30:14.869 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T01:30:14.890 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2024-09-18T01:30:14.914 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-09-18T01:30:14.949 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T01:30:14.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:30:14.967 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T01:30:15.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:30:15.003 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-18T01:30:15.013 INFO:teuthology.task.internal:Transferring archived files... 2024-09-18T01:30:15.014 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909724/remote/smithi092 2024-09-18T01:30:15.014 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T01:30:15.048 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909724/remote/smithi100 2024-09-18T01:30:15.048 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T01:30:15.081 INFO:teuthology.task.internal:Removing archive directory... 2024-09-18T01:30:15.081 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T01:30:15.085 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T01:30:15.131 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-18T01:30:15.142 INFO:teuthology.task.internal:Not uploading archives. 2024-09-18T01:30:15.142 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-18T01:30:15.150 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-18T01:30:15.151 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T01:30:15.153 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T01:30:15.165 INFO:teuthology.orchestra.run.smithi092.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 01:30 /home/ubuntu/cephtest 2024-09-18T01:30:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: 265628 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 01:30 /home/ubuntu/cephtest 2024-09-18T01:30:15.186 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-18T01:30:15.199 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-18T01:30:15.221 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} duration: 714.1509521007538 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-18T01:30:15.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T01:30:15.313 INFO:teuthology.run:pass